Large learning rates prevent memorization in denoising score matching.
problem Memorization of training data in diffusion-based generative models.
method Investigating the role of large learning rates in the small-noise regime, proving that they prevent convergence to the empirical optimal score.
result Large learning rates prevent memorization by making it impossible for the learned score to be arbitrarily close to the empirical optimal score.
This work extends diffusion models to handle heavy-tailed targets, improving score estimation and sampling guarantees.
problem Score estimation and sampling guarantees for heavy-tailed targets in diffusion models.
method Kernel density estimation and minimax rates analysis for score estimation and sampling guarantees.
result Sharp minimax rates for score estimation and sampling guarantees for heavy-tailed targets, revealing qualitative differences between exponential and polynomial tails.
Optimal score function estimation via empirical risk minimization
problem Estimating the score function of a probability measure on the flat torus from a sample
method Constraining the hypothesis space to a Sobolev ball
result Minimax estimation rates are achieved
Improved score matching methods for estimating score functions and Hessians without high dimensionality.
problem Estimating score functions and Hessians efficiently in high-dimensional data.
method Implicit score matching and denoising score matching, leveraging Gagliardo-Nirenberg inequalities.
result Achieves convergence rates similar to denoising score matching and estimates Hessians without dimensionality issues.
Estimates score function from data with optimal rate in high dimensions.
problem Estimating the score function of an unknown probability distribution from data.
method Empirical Bayes smoothing with a Gaussian kernel.
result Optimal rate of estimation ildeΘ(n−d+42) for d dimensions. New optimal rates for score estimation improve diffusion model performance.
problem Improving statistical rates for score estimation in diffusion models.
method Sharp minimax rates for score estimation of diffused distributions.
result Achieves sharp minimax rate without extraneous logarithmic terms.
DDPMs are robust to noisy score estimates and achieve optimal convergence rates in Wasserstein-2 distance.
problem Evaluating the quality of DDPMs in Wasserstein distance with noisy score estimates.
method Established finite-sample guarantees in Wasserstein-2 distance for DDPMs, considering noisy score estimates.
result Optimal convergence rates in Wasserstein-2 distance for DDPMs, matching Gaussian case.
The paper reconciles two conflicting fairness criteria in algorithmic risk scores.
problem How to reconcile calibration and equal error rates in algorithmic risk scores.
method Derive necessary and sufficient conditions for existence of calibrated scores achieving equal error rates, then present an algorithm to find the most accurate score subject to both criteria.
result The method can eliminate error disparities while maintaining calibration and improve profit in credit lending.
Study compares multivariate scoring rules for distribution forecasts.
problem Evaluating the discrimination ability of multivariate scoring rules.
method Simulation study comparing energy and variogram scores using historical data.
result Variogram score with p=0.5 outperforms other scores.
Deep learning predicts mismatched ratings in Amazon reviews.
problem Identifying reviews with mismatched ratings on Amazon.
method Converted reviews to vectors using paragraph vector, trained a recurrent neural network with gated recurrent unit, incorporated semantic relationships.
result Model accurately predicts rating mismatches and provides feedback.
Paper analyzes neural network models for sub-Gaussian distributions, proving approximation and generalization abilities.
problem Estimating unknown distributions from i.i.d. observations using neural network models.
method Score-based neural network generative models (SGMs) with specific network architectures and stopping strategies.
result SGMs can approximate scores with high accuracy and achieve nearly optimal convergence rates under mild assumptions.
New method improves density estimation accuracy and resistance to dimensionality issues.
problem Improving density estimation accuracy and resistance to dimensionality issues.
method Best-scored random forest density estimation method.
result The method achieves better estimation results than other state-of-the-art approaches.
Paper introduces new metrics for evaluating model accuracy.
problem Improving model accuracy and calibration.
method Developed two second-order accuracy metrics with integral and numerical representations.
result Validates model calibration settings and reveals distortions.
Paper accelerates diffusion models, improving sampling speed.
problem Low sampling speed in score-based diffusion models.
method Design of novel training-free algorithms for deterministic and stochastic samplers.
result Accelerated samplers converge faster with improved rates.
Two-stage scoring approach for P2P lending improves loan profitability prediction.
problem Class imbalance and lack of profitability prediction in existing scoring methods.
method Integrates credit scoring and profit scoring using wide and deep learning.
result Two-stage scoring approach outperforms existing methods in loan profitability prediction.
Tensor Train layer improves BLEU scores in NMT models.
problem Improving Neural Machine Translation (NMT) models' performance.
method Implemented Tensor Train layer in TensorFlow for NMT training.
result Higher learning rates and more 'rectangular' core dimensions improve BLEU scores.
Model selection for time series forecasting can be biased by the distribution of scores.
problem Model selection for probabilistic forecasting on time series data.
method Using proper scoring rules to aggregate scores across multiple time series.
result The mean score is immune to the skewness of the score distribution.
SCORE improves community detection for networks with weak signals.
problem Detecting communities in networks with weak signals and severe degree heterogeneity.
method SCORE+ incorporates new features to improve SCORE's performance.
result SCORE+ achieves lower clustering errors for networks with weak signals.
This work analyzes SGD for SGMs, providing convergence rates and error bounds.
problem Optimization dynamics of SGMs trained with stochastic gradients.
method Non-convex convergence rate analysis and Neural Tangent Kernel analysis.
result Theoretical insights into SGD convergence and error bounds for SGMs.
We revisit the problem of feature selection in linear discriminant analysis (LDA), that is, when features are correlated. First, we introduce a pooled centroids formulation of the multiclass LDA predictor function, in which the relative weights of Mahalanobis-transformed predictors are given by correlation-adjusted t…
Unified framework for ESG-inclusive portfolio optimization and pricing.
problem Incorporating ESG ratings into dynamic asset pricing theory.
method Introducing ESG-valued return as a linear transformation of financial and ESG scores, preserving traditional risk aversion with an ESG affinity parameter.
result Developed a more complex portfolio optimization problem in a space governed by reward, risk, and ESG score.
This paper examines how ESG scores can indicate riskiness.
problem Determining if ESG scores can convey information on a company's riskiness.
method High-dimensional vine copula modeling to analyze (tail) dependence structure of companies with various ESG scores.
result ESG scores can be associated with (tail) riskiness, especially during crises.
The study provides guarantees for diffusion-based models under log-concave data, offering best-known convergence rates.
problem Theoretical guarantees for convergence of diffusion-based generative models under log-concave data distributions.
method Assumption of strongly log-concave data distributions, Lipschitz continuous functions for score estimation, and novel auxiliary process.
result Best known upper bounds for Wasserstein-2 distance between Gaussian distribution and sampling algorithm.
New method improves ASR word confidence for diverse applications.
problem Mitigating ASR errors and improving word error rate.
method Heterogeneous Word Confusion Network (HWCN) with score calibration.
result Word sequence with best overall confidence is more accurate than 1-best result.
Study improves distributional regression evaluation with CRPS, finding optimal rates of convergence.
problem Improving probabilistic forecasts in meteorology using distributional regression.
method Extends theoretical properties of CRPS evaluation to include covariates and finite sample sizes, analyzing convergence rates for different methods.
result Optimal minimax rate of convergence for distributional regression methods is achieved by k-nearest neighbor and kernel methods.
The paper analyzes how curriculum learning improves machine learning performance.
problem Lack of theoretical analysis for curriculum learning in machine learning.
method Formulated an ideal difficulty score and analyzed its contribution in convex problems.
result The expected convergence rate decreases with the ideal difficulty score.
The consultative papers for the Basel II Accord require rating systems to provide a ranking of obligors in the sense that the rating categories indicate the creditworthiness in terms of default probabilities. As a consequence, the default probabilities ought to present a monotonous function of the ordered rating catego…
Anomaly detection scores from VAE gradients improve tumor detection.
problem Improving anomaly detection in medical imaging.
method Using Variational Autoencoders to approximate anomaly ratings.
result Variance Autoencoder gradient-based ratings outperform other methods in tumor detection.
High-dimensional models trained on smooth manifolds achieve optimal rates in Wasserstein metrics.
problem Training score-based generative models on complex, low-dimensional manifolds.
method Proves optimal rates for SGMs on smooth manifolds, separating into noise regimes and using ReLU nearest-projection coordinates.
result Optimal intrinsic Wasserstein rates are achieved, with polynomial ambient dependence for families with controlled geometry and density.
New models extrapolate false alarms in ASV without new data.
problem Reliable extrapolation of false alarm rates in ASV without new speaker data.
method Generative models in ASV score space for arbitrary systems.
result Models accurately extrapolate false alarm rates for large speaker populations.
This research analyzes and accelerates score-based diffusion models using discretization and Hessian information.
problem Theoretical foundations and convergence analysis of score-based diffusion models.
method Investigation of various discretization schemes, including Euler, exponential integrators, and midpoint randomization. Proposal of an accelerated sampler based on local linearization method.
result Hessian-based approach achieves faster convergence rates of order $\widetilde{\mathcal{O}}\left(\frac{1}{\varepsilon}
ight)$, significantly improving upon vanilla diffusion models.
The paper establishes bounds for score-matching in causal discovery and generative modeling.
problem Estimating causal relationships from data.
method Training a deep neural network to estimate the score function and applying it to causal discovery.
result Bounds on the error rate of causal discovery methods using score-matching.
New method uses GANs and proper scoring rules for robust scatter estimation.
problem Robust scatter estimation in statistics.
method General learning via classification framework based on proper scoring rules.
result Proposed robust scatter estimators achieve minimax rate under Huber's contamination model.
How to forecast next year's portfolio-wide credit default rate based on last year's default observations and the current score distribution? A classical approach to this problem consists of fitting a mixture of the conditional score distributions observed last year to the current score distribution. This is a special (…
Prior-weighted logistic regression has become a standard tool for calibration in speaker recognition. Logistic regression is the optimization of the expected value of the logarithmic scoring rule. We generalize this via a parametric family of proper scoring rules. Our theoretical analysis shows how different members of…
Mixed-SCORE+ improves community detection in weak signal networks.
problem Detecting communities in weak signal networks.
method Proposes Mixed-SCORE+ combining properties of Mixed-SCORE and SCORE+.
result Significantly improves detection error rates on Polblogs and weak signal networks.
Paper analyzes SGMs for learning sub-Gaussian distributions without dimensionality constraints.
problem Learning sub-Gaussian distributions in high dimensions with SGMs.
method Introduced complexity notion and proved approximation and generalization rates.
result SGMs can approximate target sub-Gaussian distributions in total variation with dimension-independent rate.
RATE metrics evaluate treatment prioritization rules, subsuming existing methods.
problem Comparing and testing the quality of treatment prioritization rules.
method Rank-weighted average treatment effect (RATE) metrics.
result RATE metrics enable asymptotically exact inference in various study settings.
This study compares neural networks, SVM, and decision trees for corporate credit rating predictions.
problem Predicting corporate credit ratings using machine learning methods.
method Applied four machine learning techniques (Bagged Decision Trees, Random Forest, SVM, MLP) to credit rating datasets.
result Decision tree-based models outperformed other techniques in terms of 'Notch Distance' measure.
New method attacks GNNs with limited node access, increasing misclassification rate.
problem Attacking GNNs with limited node access and limited attack nodes.
method Generalized gradient-based attacks using importance scores derived from random walks.
result Proposed greedy procedure significantly increases misclassification rate.
Study finds flipped classrooms improve student self-concept, enjoyment, but not exam scores.
problem Evaluating the impact of flipped classrooms on higher education outcomes.
method Double/debiased machine learning (DML) approach to analyze student data.
result No significant positive effects on exam scores, passing rates, or knowledge retention.
The study proposes a framework to assess sustainability of firms using fund-level classifications and portfolio holdings.
problem To capture market-based sustainability assessments of firms.
method Exploiting fund-level sustainability classifications and granular portfolio holdings to construct Market-Implied Sustainability (MIS) scores.
result MIS scores capture sustainability dimensions different from conventional ESG ratings and improve portfolio performance.
Study improves denoising score matching under relaxed manifold assumptions.
problem Improving denoising score matching under relaxed manifold assumptions.
method Model density with nonparametric Gaussian mixtures, relax manifold assumption, derive non-asymptotic bounds.
result Non-asymptotic bounds on approximation and generalization errors, rates of convergence determined by intrinsic dimension.
Engression uses neural networks to learn conditional distributions, analyzing its error components.
problem Analyzing the error in neural-network-based engression.
method Engression decomposes excess risk into approximation, stochastic, and Monte Carlo errors.
result Established convergence rates under compositional smoothness assumptions.
In this paper we address the following question: Can we approximately sample from a Bayesian posterior distribution if we are only allowed to touch a small mini-batch of data-items for every sample we generate?. An algorithm based on the Langevin equation with stochastic gradients (SGLD) was previously proposed to solv…
The paper improves ranking by integrating covariates and sparse intrinsic scores.
problem Ranking items with incomplete preference scores explained by covariates.
method Extends BTL model with covariate information and sparse intrinsic scores, using penalized MLE.
result Developed debiased estimator for penalized MLE with distributional properties.
Study minimax risk of score estimation for log-concave distributions.
problem Minimizing risk in score estimation for log-concave distributions.
method Developed subclasses of log-concave densities and constructed a locally adaptive, multiscale estimator.
result Established minimax rates for score estimation over specific subclasses of log-concave densities.
The paper introduces ESE scores for farmers to assess climate change risks.
problem Assessing climate change risks in individual farmers' credit evaluations.
method Integrating ESG variables into joint liability models and using a mean-variance utility function.
result Optimal group sizes and individual-ESE score relationships under various climatic conditions.