New model constructs astronomical catalogs from images efficiently.
problem Building accurate catalogs from large image datasets.
method Generative model with MCMC and VI for inference.
result Variational inference is 1000x faster with similar accuracy.
Bayesian method improves star location and flux estimation from coadded images.
problem Statistical analysis of coadded astronomical images is complicated by pixel dependence.
method Bayesian approach that implicitly marginalizes single-exposure pixel intensities.
result Method outperforms single-exposure image training for star parameter estimation.
Automated classification of astronomical light curves for LSST.
problem Handling massive astronomical data from LSST.
method Gradient boosting of decision trees, feature extraction and selection, augmentation.
result Achieved one of the top results in the PLAsTiCC challenge.
GANs simulate realistic galaxy images.
problem Simulate complex astronomical images efficiently.
method Progressive GANs with Wasserstein cost function.
result Generates naturalistic galaxy images.
Celeste is a procedure for inferring astronomical catalogs that attains state-of-the-art scientific results. To date, Celeste has been scaled to at most hundreds of megabytes of astronomical images: Bayesian posterior inference is notoriously demanding computationally. In this paper, we report on a scalable, parallel v…
BLISS detects and separates astronomical sources quickly and accurately.
problem Detecting and separating overlapping astronomical sources in large images.
method Bayesian Light Source Separator (BLISS) using deep generative models and variational inference.
result BLISS can process megapixel images in seconds and produce highly accurate catalogs.
State of the art methods in astronomical image reconstruction rely on the resolution of a regularized or constrained optimization problem. Solving this problem can be computationally intensive and usually leads to a quadratic or at least superlinear complexity w.r.t. the number of pixels in the image. We investigate in…
Bayesian framework for sparse signal reconstruction in astronomy and machine learning.
problem Signal reconstruction in noisy 1- and 2-dimensional signals, including astronomical images.
method Bayesian interpretation of sparse reconstruction, using priors and integer parameters for basis functions.
result Order-of-magnitude computational efficiency gains compared to traditional methods.
GANs create realistic galaxy images for astronomy.
problem Handling large astronomical datasets.
method Chained generative adversarial networks (GANs).
result GAN-generated galaxy images closely match real galaxies.
daep learns from irregular, multimodal astronomical data.
problem Learning from irregular, multimodal astronomical sequences.
method Diffusion Autoencoder with Perceivers (daep) tokenizes, compresses, and reconstructs data.
result daep outperforms VAE and maep baselines in reconstruction and fine-scale structure preservation.
New Roman pipeline detects astronomical transients.
problem Automated detection of transients from Roman Space Telescope data.
method Machine learning model RuBR for distinguishing real from fake detections.
result Effective real-bogus classification in Roman era.
We present a new, fully generative model of optical telescope image sets, along with a variational procedure for inference. Each pixel intensity is treated as a Poisson random variable, with a rate parameter dependent on latent properties of stars and galaxies. Key latent properties are themselves random, with scientif…
Predicts the age of astronomical transients from real-time data.
problem Improving understanding of transients and their progenitor systems.
method Bayesian probabilistic recurrent neural network.
result Accurately predicts the age of transients with robust uncertainties.
DeepSource uses deep learning to detect sources in radio interferometry images.
problem Challenging point source detection at low signal-to-noise in radio interferometry images.
method Convolutional neural networks to enhance SNR, dynamic blob detection.
result DeepSource achieves essentially perfect purity and completeness down to SNR = 4, outperforming PyBDSF.
The spectral energy distribution (SED) is a relatively easy way for astronomers to distinguish between different astronomical objects such as galaxies, black holes, and stellar objects. By comparing the observations from a source at different frequencies with template models, astronomers are able to infer the type of t…
A textbook on statistical machine learning for astronomy.
problem Uncertainty quantification in astronomical data analysis.
method Bayesian inference and classical statistical methods.
result Unified framework connecting modern and traditional methods.
EnKG solves inverse problems without derivatives, using diffusion models.
problem Solving inverse problems with derivative-free methods.
method Ensemble Kalman Diffusion Guidance (EnKG) using diffusion models.
result EnKG can solve inverse problems with only forward model evaluations.
Detects anomalies in astronomical time series data.
problem Identifying new and interesting transients in large astronomical surveys.
method Two novel methods: a probabilistic neural network and a Bayesian parametric model.
result Neural networks are less suitable for anomaly detection in time series data compared to parametric models.
Developing a visual platform for faster astronomical source cataloging.
problem Speeding up cataloging of large area surveys in radio astronomy.
method Integration of advanced source finding and classification tools into a visual analytic platform.
result Improvement and acceleration of cataloging process in astronomical surveys.
New algorithm separates sparse sources from Poisson measurements.
problem Blind source separation of sparse sources from Poisson measurements.
method pGMCA algorithm for Poisson measurements.
result Recovery of sparse sources from Poisson measurements.
Fink AGN classifier achieves high accuracy in classifying active galactic nuclei.
problem Classifying active galactic nuclei from astronomical data.
method Built features from photometric points and color estimation. Used active learning for optimized training sample. Applied traditional machine learning algorithms.
result Achieved 98.0% accuracy in classifying real alerts from ZTF.
Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a single night and real-time analysis is often desired. Thus, modern astronomy require…
In this letter, we propose a method for period estimation in light curves from periodic variable stars using correntropy. Light curves are astronomical time series of stellar brightness over time, and are characterized as being noisy and unevenly sampled. We propose to use slotted time lags in order to estimate corrent…
Study uses evolutionary deep learning to identify galaxies obscured by star densities.
problem Identifying galaxies in the Zone of Avoidance due to high star densities and extinction.
method Evolutionary algorithm to optimize CNN architecture for near-infrared images.
result Best evolved CNN outperforms other variants in identifying galaxies in the Zone of Avoidance.
Low-dimensional embedding, manifold learning, clustering, classification, and anomaly detection are among the most important problems in machine learning. The existing methods usually consider the case when each instance has a fixed, finite-dimensional feature representation. Here we consider a different setting. We as…
LatentNN corrects neural network attenuation bias in astronomical data.
problem Neural networks underestimate extreme values due to measurement errors.
method Jointly optimizes network parameters and latent input values.
result LatentNN reduces attenuation bias across various signal-to-noise ratios.
New method maps high-dimensional image spaces using MCMC to reveal patterns.
problem Characterizing complex probability densities in high-dimensional image spaces.
method Attraction-Diffusion (AD) MCMC tool to map metastable regions.
result AD efficiently maps highly non-convex probability densities.
The Baire metric induces an ultrametric on a dataset and is of linear computational complexity, contrasted with the standard quadratic time agglomerative hierarchical clustering algorithm. In this work we evaluate empirically this new approach to hierarchical clustering. We compare hierarchical clustering based on the …
Novel method separates astrophysical components from noisy data.
problem Separating and reconstructing astrophysical components from noisy data.
method Latent-space field tension for automated component separation.
result High accuracy in reconstructing astrophysical components.
BiLRP explains deep similarity models by decomposing scores into feature contributions.
problem Verifying meaningful patterns in complex similarity models.
method Augmenting similarity scores with feature explanations using LRP.
result BiLRP robustly explains deep neural network features and historical document similarities.
New approach to domain adaptation for astronomy models.
problem Building models on source tasks and adapting them to target tasks in astronomy.
method Assumes strong similarity in model complexity across domains and uses active learning.
result Increased accuracy and reduced computational cost in two astronomical applications.
A fast deep-learning PSF model accurately reproduces SDSS PSF.
problem Accurate modeling of Point Spread Function (PSF) for wide-field surveys.
method Fast deep-learning approach to estimate PSF parameters from noisy images.
result The model accurately reproduces SDSS PSF at the pixel level.
Deep learning classifies galaxies from Dark Energy Survey in just 8 minutes.
problem Classifying galaxies from large-scale surveys.
method Transfer learning from pre-trained neural networks.
result Achieved state-of-the-art accuracy of 99.6% in galaxy classification.
LAAT detects multiple low-density manifolds in noisy data.
problem Detecting multiple low-density manifolds in noisy data.
method Locally Aligned Ant Technique (LAAT) based on Ant Colony Optimization.
result LAAT recovers multiple manifolds in extremely noisy data.
Deep learning identifies precipitation clouds from all-sky camera data.
problem Automating cloud warning systems for observatories.
method Deep learning using EfficientNet network.
result Average accuracy of 99% in identifying rainfall potential and 96% in cloud coverage.
We deliver a call to arms for probabilistic numerical methods: algorithms for numerical tasks, including linear algebra, integration, optimization and solving differential equations, that return uncertainties in their calculations. Such uncertainties, arising from the loss of precision induced by numerical calculation …
Auto-Associative models cover a large class of methods used in data analysis. In this paper, we describe the generals properties of these models when the projection component is linear and we propose and test an easy to implement Probabilistic Semi-Linear Auto- Associative model in a Gaussian setting. We show it is a g…
We present the first public release of our generic neural network training algorithm, called SkyNet. This efficient and robust machine learning tool is able to train large and deep feed-forward neural networks, including autoencoders, for use in a wide range of supervised and unsupervised learning applications, such as…
Classifies compact radio sources in the Galactic plane using machine learning.
problem Challenges in processing large volumes of radio continuum survey data.
method Produced a curated dataset of ~20,000 images, trained two classifiers: gradient-boosted decision trees and convolutional neural networks.
result High classification accuracy (F1-score>90%) for separating Galactic objects from the extragalactic background.
AAD boosts anomaly detection in astronomical data.
problem Detecting unusual objects in astronomical light curves.
method Active learning strategy with adaptive machine learning model updates.
result AAD identified 80% more true anomalies than traditional IF.
The Baire metric induces an ultrametric on a dataset and is of linear computational complexity, contrasted with the standard quadratic time agglomerative hierarchical clustering algorithm. We apply the Baire distance to spectrometric and photometric redshifts from the Sloan Digital Sky Survey using, in this work, about…
AutoSciDACT detects scientific anomalies in noisy data.
problem Detecting anomalies in large, noisy scientific datasets.
method Contrastive pre-training for low-dimensional data representations, two-sample test using NPLM.
result Strong sensitivity to small anomalies across various scientific domains.
We invoke a Gaussian mixture model (GMM) to jointly analyse two traditional emission-line classification schemes of galaxy ionization sources: the Baldwin-Phillips-Terlevich (BPT) and WHα vs. [NII]/Hα (WHAN) diagrams, using spectroscopic data from the Sloan Digital Sky Survey Data Release 7 and SEAGal/STARLI…
A new probabilistic model for yes/no crowdsourcing in multi-class classification.
problem Difficulty in discerning among all possible classes in full questions.
method Developed a full probabilistic model for shorter yes/no queries, estimating joint posterior distributions and using Monte Carlo Sampling and Black Box Variational Inference.
result Comparable results to full query crowdsourcing, highlighting the importance of modeling labelers' failures.
The paper presents an O(N log N)-implementation of t-SNE -- an embedding technique that is commonly used for the visualization of high-dimensional data in scatter plots and that normally runs in O(N^2). The new implementation uses vantage-point trees to compute sparse pairwise similarities between the input data object…
TiK-means extends K-means for skewed groups, revealing structured clusters.
problem Clustering skewed groups using traditional K-means.
method Introduces TiK-means, a modified K-means algorithm that estimates skewness-transformation parameters.
result Reveals structured clusters that explain the skewness of groups.
New methods speed up fitting for large datasets with noisy observations.
problem Fitting large datasets with Gaussian noise and known covariance.
method Two minibatch variants of extreme deconvolution, online EM algorithm, and gradient-based optimisation.
result Methods can scale to larger models and fit larger datasets faster.
Rubin LSST DESC uses AI/ML for dark energy research.
problem Challenges in uncertainty quantification and model robustness for AI/ML in DESC.
method Bayesian inference, physics-informed methods, validation frameworks, active learning.
result AI/ML methods are essential but require rigorous evaluation and governance.