Contrastive learning simplifies statistical inference for complex models.
problem Computational intractability of likelihood functions for certain models.
method Contrastive learning as an alternative for parameter estimation and inference.
result Contrastive learning enables practical methods for diverse statistical problems.
Machine learning improves official statistics but needs rigorous validation.
problem Lack of methodological robustness in machine learning for official statistics.
method Total Machine Learning Error (TMLE) framework to validate ML models.
result TMLE addresses representativeness and measurement errors in ML models.
This work uses statistical mechanics to explain AI learning.
problem Understanding the statistical principles behind AI learning.
method Starting from sample concentration behaviors, the study applies statistical mechanics principles to AI and machine learning.
result Exponential families and statistical quantities are key in AI and machine learning.
Investigates transfer learning in spatial statistics.
problem Applying transfer learning to spatial statistics.
method Simple MLP models for spatial data.
result Potential of transfer learning in spatial statistics.
Python library for boosting statistical relational models.
problem Expressing learning and inference problems in statistical relational models.
method Adapting scikit-learn interface for boosted statistical relational models.
result Provides examples for using srlearn.
Statistical learning theory connects to spin glass models via Rademacher complexity and replica theory.
problem Bounding generalization gap in statistical learning theory.
method Linking Rademacher complexity in statistical learning to synthetic models in statistical physics.
result Rademacher complexity is closely related to ground state energy in spin glass models.
Research aims to bridge statistical learning to causal models in AI.
problem Challenges in machine learning and AI related to causality.
method Transition from statistical learning to causal models.
result Progress in AI may require advances in causal modeling.
Diffusion models learn simple statistics before complex ones, revealing a sample complexity exponent.
problem Understanding the learning dynamics of diffusion models.
method Empirical observations and theoretical analysis of diffusion models and denoisers.
result Diffusion models learn simple statistics (pair-wise correlations) at linear sample complexity, while higher-order statistics (e.g., fourth cumulant) require cubic sample complexity.
Efficiently learns Ising model parameters with limited statistics.
problem Learning Ising model parameters with limited sample configurations.
method Examines trade-offs between computation and observation, using Ising model as example.
result Reconstructs model parameters with statistics up to order O(γ) for ℓ1 width γ. Paper presents online learning for statistical arbitrage without stationarity assumptions.
problem Statistical arbitrage strategies often rely on assumptions that may not hold for non-stationary processes.
method Online learning algorithms for mean reversion models without stationarity assumptions.
result Strong learning guarantees for online learning in non-stationary processes.
Noise Sensitivity Exponent controls statistical-computational gaps in learning.
problem Understanding when learning is statistically possible yet computationally hard in high-dimensional statistics.
method Investigating statistical-computational gaps in single- and multi-index models using Noise Sensitivity Exponent.
result Noise Sensitivity Exponent governs statistical-computational gaps in high-dimensional learning.
A quantum circuit designed for efficient statistical model preparation and training.
problem Challenges in preparing and learning statistical models on quantum processors.
method Utilizes the maximum entropy principle to design a statistics-informed parameterized quantum circuit (SI-PQC).
result Improves trainability and interpretability for learning quantum states and classical model parameters.
Paper compares classical stats and statistical learning in neuroimaging.
problem Confusion between classical hypothesis testing and data-guided model estimation in neuroimaging.
method Examines commonalities and differences between classical statistics and statistical learning.
result Clarifies the conceptual implications of these methods in neuroimaging analysis.
Breiman's paper sparked debate on the future of statistics and machine learning.
problem The tension between traditional statistical modeling and model-free machine learning approaches.
method Discussion of the implications of machine learning's success and the need for new inferential approaches.
result The importance of understanding 'why' and 'if' questions in machine learning is now recognized.
MASS Learning trains models to use minimal sufficient statistics, improving performance and uncertainty quantification.
problem Training deep networks to use minimal sufficient statistics for better performance and uncertainty quantification.
method MASS Learning trains models to produce minimal sufficient statistics with respect to a class of functions, using Conserved Differential Information (CDI).
result Deep networks trained with MASS Learning achieve competitive performance on supervised learning and uncertainty quantification benchmarks.
Improves statistical learning bounds with self-concordant losses.
problem Statistical prediction with nuisance components.
method Orthogonal statistical learning with self-concordant loss.
result Non-asymptotic bounds on excess risk improved by a dimension factor.
CRL uses causality to build interpretable AI models from complex data.
problem Interpreting deep neural networks' implicit representations.
method Causal representation learning (CRL) synthesizing latent variable models, causal graphical models, and nonparametric statistics.
result CRL can improve interpretability of generative AI models.
Flexible framework for deep distributional regression models.
problem Learning conditional distributions from semi-structured data.
method Combines additive regression models with deep networks using TensorFlow.
result State-of-the-art predictive performance with interpretability.
DPpack offers R tools for private data analysis and machine learning.
problem Ensuring privacy in statistical analysis and machine learning.
method Differential privacy mechanisms (Laplace, Gaussian, exponential).
result User-friendly implementation of privacy-preserving models.
The paper tackles statistical and computational challenges in learning correlated reward models.
problem The Independence of Irrelevant Alternatives (IIA) assumption collapses human preferences into a universal utility function, leading to coarse approximations.
method The paper investigates the statistical and computational challenges of learning a correlated probit model using best-of-three preference data.
result Best-of-three preference data overcomes the limitations of pairwise preference data, allowing for more fine-grained modeling of human preferences.
A new framework for scalable uncertainty quantification in statistical models.
problem Computational bottleneck in uncertainty quantification for statistical machine learning.
method Predictive-matching Generative Parameter Sampler (GPS) framework.
result The GPS framework provides successful uncertainty quantification and additional flexibility.
Generative models are reinterpreted in statistical terms, enabling better understanding and inference.
problem Insufficient interpretability of generative models in statistical terms.
method Flow matching and orthogonalization/cross-fitting in double/debiased machine learning.
result Generative models can be used to estimate nuisance components while maintaining inferential validity.
Statistical methods remain relevant for ODE inverse problems, especially with sparse data.
problem The relevance of statistical methods in the era of deep learning for ODE inverse problems.
method Employed physics-informed neural networks (PINN) and manifold-constrained Gaussian process inference (MAGI) to compare statistical and deep learning approaches.
result Statistically principled methods outperform deep learning models in tasks like parameter inference and trajectory reconstruction.
This review assesses statistical and machine learning methods for coral bleaching.
problem Coral bleaching due to rising sea temperatures and environmental factors.
method Statistical and machine learning models for predicting and analyzing coral bleaching.
result Statistical and machine learning methods are crucial for effective reef management.
A neural network learns to summarize datasets without supervision.
problem Efficiently learning from new datasets without labeled data.
method An extension of a variational autoencoder that learns dataset statistics.
result The network can cluster, transfer models, and classify datasets.
Deep learning used for parameter estimation in hard-to-infer models.
problem Parameter estimation in intractable models like max-stable processes.
method Train deep neural networks on simulated data to estimate parameters.
result Deep learning provides accurate and faster parameter estimation.
Paper uses SLT to improve model selection for SHM.
problem Model selection for SHM using data-based systems.
method Utilizes Statistical Learning Theory to rigorously estimate generalisation.
result Incorporating domain knowledge improves model generalisation.
The paper analyzes extreme temperature forecasting using machine learning models.
problem Forecasting extreme temperatures in U.S. cities.
method Auto-Regressive Integrated Moving Average, Exponential Smoothing, Multilayer Perceptrons, Gaussian Processes.
result Multilayer Perceptrons were found to be the most effective approach for forecasting extreme temperatures.
Machine learning and statistical modeling complement each other in healthcare analytics.
problem Choosing between machine learning and statistical modeling for analytics challenges.
method Choosing based on problem, data, and desired outcomes.
result Machine learning and statistical modeling are complementary, using similar principles but different tools.
Statistical model for analyzing longitudinal data on Riemannian manifolds.
problem Analyzing longitudinal data on non-Euclidean spaces.
method Developed a recurrent statistical model for ordered data on Riemannian manifolds.
result Efficient algorithm with competitive performance and fewer parameters.
Study compares machine learning and statistical methods for downscaling precipitation.
problem Improving accuracy of precipitation predictions using machine learning.
method Compared four statistical methods and three machine learning methods.
result Linear methods outperform non-linear approaches in capturing daily anomalies and extremes.
Improves survey sampling with unbiased machine learning methods.
problem Design-consistent model-assisted estimation lacks a general theory for machine learning.
method Proposes a subsampling Rao-Blackwell method for design-unbiased estimation.
result Yields efficiency gains over standard methods while ensuring valid estimation.
RLHF uses human feedback to train AI models, posing statistical challenges.
problem Aligning AI models with human preferences using noisy, subjective feedback.
method Supervised fine-tuning, reward modeling, policy optimization, statistical ideas.
result Statistical methods for reward function learning and policy optimization.
FNNs can be made more interpretable with statistical methods.
problem FNNs lack interpretability and are often used as black-box models.
method Supplement FNNs with statistical inference and covariate-effect visualizations.
result FNNs can be made more like traditional statistical models.
New model for natural language learning using tensor networks.
problem Machine learning of systems with long distance correlations like natural languages.
method Directed acyclic graph decorated by multi-linear tensor maps.
result Explicit algebro-geometric analysis of parameter moduli space for tree graphs.
New model shows online and statistical learning are computationally equivalent with optimization oracle.
problem Online learning in non-convex games with adversarial settings.
method Strengthening the oracle model to make online and statistical learning computationally equivalent.
result Efficient computation of non-convex game equilibria, including GANs, with optimization oracle.
Paper develops efficient algorithms for robust distributed learning with statistical guarantees.
problem Limited communication power and adversarial node behaviors in distributed learning.
method Surrogate likelihood framework and median/trimmed mean operations.
result Provable robustness against Byzantine failures and optimal statistical rates.
This paper tackles robust factor models for high-dimensional data.
problem Challenges in high-dimensional, dependent data from various fields.
method Robust high-dimensional factor analysis.
result Classical PCA can be adapted for modern statistical challenges.
Tick is a Python library for fast time-dependent statistical modeling.
problem Efficient time-dependent statistical modeling.
method Optimization module with C++ implementation and state-of-the-art solvers.
result Very fast computations in a multi-core setting.
Statistical mechanics models node-perturbation learning with noisy baselines.
problem Understanding learning dynamics in node-perturbation algorithms with noisy baselines.
method Developed statistical mechanics to model node-perturbation learning with noisy baselines and derived coupled differential equations.
result Derived coupled differential equations of order parameters to depict learning dynamics and calculated generalization error.
Study interpolating estimators for causal learning from observational data.
problem Learning causal models from observational data in complex model classes.
method Investigate min-norm interpolators and ridge-regularized regressors in a linearly confounded model.
result Interpolators cannot be optimal for causal learning under the principle of independent causal mechanisms, requiring stronger regularization.
Quantum statistical models with singularities are studied for state estimation and model selection.
problem Understanding statistical properties of quantum singular models.
method Classical singular learning theory extended to quantum state estimation and model selection using algebraic geometrical methods.
result Asymptotically unbiased estimator (QWAIC) for quantum generalization loss constructed.
Statistical learning theory explains SVMs for data-driven decision making.
problem Decision making and model construction from data.
method Statistical learning theory, focusing on empirical and structural risk minimization.
result Support Vector Machines (SVMs) are a prominent implementation of structural risk minimization.
Differentially private learning of graphs improves on naive methods.
problem Learning discrete, undirected graphical models while preserving privacy.
method Developed a principled approach using collective graphical models within an expectation-maximization framework.
result The new method learns better models than competing approaches.
Establishes statistical and computational bounds for influence diagnostics.
problem Identifying influential datapoints or subsets in machine learning models.
method Finite-sample statistical bounds and computational complexity for influence functions and approximate maximum influence perturbations.
result Established statistical and computational guarantees for influence diagnostics.
The paper reviews statistical models for high-dimensional normalized vectors.
problem Handling directional data in machine learning.
method Review of mathematical models for normalized vectors on hypersphere and real projective plane.
result Common models and technical aspects are discussed.
Solla discusses neural processing using statistical physics and Bayesian methods.
problem Understanding neural information processing through statistical physics.
method Bayesian inference, Gibbs description, Generalized Linear Models, dimensionality reduction.
result Connection between neural processing and statistical physics.
Statistical model checking for PCTL on MDPs using reinforcement learning.
problem Model checking PCTL specifications on MDPs with statistical methods.
method Reinforcement learning for policy search, statistical model checking with UCB-based Q-learning.
result Provably guaranteed statistical model checking method for PCTL specifications on MDPs.