The NL score optimizes speaker recognition tasks.
problem Improving speaker recognition accuracy.
method Established the theory of optimal scores based on normalized likelihood.
result NL score is equivalent to PLDA likelihood ratio under certain conditions.
Paper develops machine learning algorithms to learn optimal integer weights for clinical risk scores.
problem Deriving optimal integer weights for clinical risk scores without computational burden.
method Flexible greedy optimization strategy to directly optimize a value function.
result Constructed an integer-weighted comorbidity score for measuring post-discharge mortality risk.
Estimates score function from data with optimal rate in high dimensions.
problem Estimating the score function of an unknown probability distribution from data.
method Empirical Bayes smoothing with a Gaussian kernel.
result Optimal rate of estimation ildeΘ(n−d+42) for d dimensions. Docking is an important tool in computational drug discovery that aims to predict the binding pose of a ligand to a target protein through a combination of pose scoring and optimization. A scoring function that is differentiable with respect to atom positions can be used for both scoring and gradient-based optimization…
Study proposes a differentiable surrogate loss function for optimizing Fβ score in binary classification with imbalanced data.
problem Non-differentiability of Fβ score makes it unsuitable for optimization by gradient-based learning. method Investigated relationship between Fβ score and loss functions, proposed a differentiable surrogate loss function. result Gradient paths of the proposed surrogate Fβ loss function approximate the gradient paths of the Fβ score. This study optimizes covariate density and propensity score for efficient ATE estimation.
problem Efficiently estimating average treatment effects (ATEs) with minimal variance.
method Adaptive experiment optimizing both covariate density and propensity score.
result Proposed method minimizes the semiparametric efficiency bound for ATE estimation.
Optimal score function estimation via empirical risk minimization
problem Estimating the score function of a probability measure on the flat torus from a sample
method Constraining the hypothesis space to a Sobolev ball
result Minimax estimation rates are achieved
The optimal ranking score between precision and recall is rarely F1 and can be found using specific methods.
problem Finding a meaningful and optimal compromise between precision and recall scores.
method Established a shortest path between precision- and recall-induced rankings, framed the problem as an optimization problem, and provided theoretical tools to find the optimal β.
result F1 and its skew-insensitive version are not optimal tradeoffs between precision and recall scores.
New optimal rates for score estimation improve diffusion model performance.
problem Improving statistical rates for score estimation in diffusion models.
method Sharp minimax rates for score estimation of diffused distributions.
result Achieves sharp minimax rate without extraneous logarithmic terms.
Improves conformal prediction by combining multiple score functions and optimizing weights.
problem Limitations of single-score conformal predictors in multi-class classification.
method Combines multiple score functions and optimizes weights to minimize prediction set size.
result Consistently outperforms single-score conformal predictors while maintaining valid coverage.
Paper introduces Isotonic Mechanism for better item scoring.
problem Noisy reviewer scores; owner prefers not to disclose true scores.
method Uses owner's ranking of items and raw scores to adjust and improve accuracy.
result Adjusted scores are significantly more accurate than raw scores.
DDPMs are robust to noisy score estimates and achieve optimal convergence rates in Wasserstein-2 distance.
problem Evaluating the quality of DDPMs in Wasserstein distance with noisy score estimates.
method Established finite-sample guarantees in Wasserstein-2 distance for DDPMs, considering noisy score estimates.
result Optimal convergence rates in Wasserstein-2 distance for DDPMs, matching Gaussian case.
Heuristic weighting improves denoising score matching without requiring noise distribution assumptions.
problem Improving denoising score matching without assuming noise distribution.
method Demonstrated heteroskedasticity, derived optimal weighting functions, and provided theoretical and empirical comparisons.
result Heuristical weighting function can achieve lower variance than optimal weighting, facilitating more stable and efficient training.
OTCP extends conformal prediction to multivariate data using optimal transport.
problem Uncertainty quantification in multivariate machine learning models.
method OTCP leverages optimal transport to rank multivariate conformity scores.
result Preserves distribution-free coverage guarantees in multidimensional settings.
Large learning rates prevent memorization in denoising score matching.
problem Memorization of training data in diffusion-based generative models.
method Investigating the role of large learning rates in the small-noise regime, proving that they prevent convergence to the empirical optimal score.
result Large learning rates prevent memorization by making it impossible for the learned score to be arbitrarily close to the empirical optimal score.
This paper considers fair probabilistic binary classification where the outputs of primary interest are predicted probabilities, commonly referred to as scores. We formulate the problem of transforming scores to satisfy fairness constraints that are linear in conditional means of scores while minimizing a cross-entropy…
Directly estimates Fisher score for likelihood maximization.
problem Intractable likelihood functions with model simulations.
method Gradient-based optimization using local score matching and linear parameterization.
result Efficient approximation of Fisher score improves likelihood maximization.
Score attack method provides a lower bound on privacy-constrained minimax risk.
problem Characterizing the optimality of privacy-constrained statistical models.
method Score attack based on tracing attack concept.
result Optimally lower bounds the minimax risk of estimating unknown model parameters.
Risk scores are simple classification models that let users make quick risk predictions by adding and subtracting a few small numbers. These models are widely used in medicine and criminal justice, but are difficult to learn from data because they need to be calibrated, sparse, use small integer coefficients, and obey …
Improved hypothesis testing and change-point detection using diffusion-based methods.
problem Limited power of score-based hypothesis tests and change-point detection.
method Extending score-based Fisher divergence to diffusion-divergence by multiplying score functions with a matrix-valued function or weight matrix.
result Theoretical quantification and demonstration of optimal performance of diffusion-based algorithms.
Model analyzes RFQ markets using stochastic control to optimize dealer performance and inventory.
problem Optimizing market making in aggregator-routed RFQ markets with varying dealer performance scores.
method Two-tier stochastic control model that separates RFQ-level price competition from macro routing.
result Optimal controls can be expressed through derivatives of reduced Hamiltonians, leading to interpretable mappings from optimal win probabilities to optimal offsets.
New maximum score estimators using ReLU functions and deep neural networks.
problem Estimating parameters in models with sign restrictions.
method ReLU-based maximum score criterion and DNN architecture.
result RMS estimator achieves n−s/(2s+1) convergence rate and asymptotic normality. Proposes a new method to minimize non-singleton predictions in conformal prediction.
problem Large prediction sets in conformal prediction are costly and inefficient.
method Introduces a new nonconformity score to minimize non-singleton sets and provides an algorithm to compute it efficiently.
result The proposed Singleton-Optimized Conformal Prediction (SOCOP) method increases singleton frequency by over 20% compared to standard scores, with minimal impact on average set size.
Algorithm optimizes biological sequences using bootstrapped training with a score-conditioned generator.
problem Optimizing biological sequences for a black-box score function.
method Bootstrapped training of score-conditioned generator (BootGen) algorithm.
result Our method outperforms competitive baselines on biological sequential design tasks.
There has been much recent interest in application of the pool-adjacent-violators (PAV) algorithm for the purpose of calibrating the probabilistic outputs of automatic pattern recognition and machine learning algorithms. Special cost functions, known as proper scoring rules form natural objective functions to judge the…
Score-based diffusion models achieve optimal error bounds under non-parametric assumptions.
problem Improving the minimax optimality of score-based diffusion models.
method Kernel-based score estimation and early stopping strategy.
result Achieves minimax optimal error bounds under sub-Gaussian and Sobolev space assumptions.
This paper provides new insight into maximizing F1 scores in the context of binary classification and also in the context of multilabel classification. The harmonic mean of precision and recall, F1 score is widely used to measure the success of a binary classifier when one class is rare. Micro average, macro average, a…
New optimal transport divergences derived from scoring functions.
problem Developing new divergences for optimal transport.
method Using scoring functions as cost functions in optimal transport.
result Comonotonic coupling is optimal for many new divergences.
Method orders Pareto solutions using transformed objective scores.
problem Lack of orderability in multi-objective optimization solutions.
method Probability integral transform to map objectives to scores.
result Pareto efficient solutions can be ordered in score space.
We solve the paradox of score-based methods by minimizing path variance.
problem Score-based methods are path-dependent, leading to inaccurate and unstable estimators.
method Propose MVP Principle to minimize path variance, derive closed-form expression, and use flexible Kumaraswamy Mixture Model.
result Establishes new state-of-the-art results on challenging benchmarks.
Score matching offers efficient estimation for certain distributions.
problem Estimating probability distributions with intractable constants.
method Score matching as an alternative to maximum likelihood.
result Score matching is computationally and statistically efficient for certain distributions.
A new bias score method optimizes fairness in classification.
problem Ensuring fairness in binary classification under group constraints.
method Introducing bias scores and developing a post-hoc approach to adapt to fairness constraints.
result The method maintains high accuracy while ensuring fairness constraints.
New framework for neural network score estimation in diffusion models.
problem Rigorous guarantees for practical score estimation with neural networks.
method Developed a mathematical framework for score estimation with GD-trained neural networks, addressing optimization and generalization.
result Established minimax-optimal generalization bounds for GD-trained neural networks in diffusion models.
New method optimizes portfolios by dynamically integrating ESG constraints.
problem Static ESG scores mismatch sequential portfolio decisions.
method MACF-X, a family of adapters that learns ESG costs from multimodal evidence.
result Reduces tail ESG budget pressure while maintaining financial performance.
DrBO uses Bayesian optimization to learn DAGs more efficiently.
problem Inaccurate and inefficient DAG learning from observational data.
method Bayesian optimization to find high-scoring DAGs efficiently.
result DrBO finds higher-scoring DAGs more efficiently than existing methods.
Extends denoising and score estimation to energy models via Tweedie's formula.
problem Linking denoising and score estimation for a wider range of distributions.
method Derives a fundamental identity connecting energy score derivatives and scores.
result Establishes a new identity for energy scores analogous to Tweedie's formula.
We propose a training method for deep neural network (DNN)-based source enhancement to increase objective sound quality assessment (OSQA) scores such as the perceptual evaluation of speech quality (PESQ). In many conventional studies, DNNs have been used as a mapping function to estimate time-frequency masks and traine…
The paper constructs denoisers that recover the Brenier map from higher-order score functions.
problem Estimating the Brenier map from noisy data.
method Constructs a hierarchy of denoisers using higher-order score functions.
result The T∞ denoiser recovers the Brenier map from the additive Gaussian model. AR-CSM models use derivatives of univariate log-conditionals to estimate joint distributions efficiently.
problem Scalability and stability issues in training autoregressive models.
method Parameterize joint distribution using derivatives of univariate log-conditionals and introduce Composite Score Matching (CSM) for efficient training.
result AR-CSM models are more scalable and stable compared to previous score matching algorithms.
Paper establishes a density formula for diffusion models, linking target density to score function.
problem Lack of theoretical foundation for optimizing DDPMs using ELBO.
method Developed a density formula for continuous-time diffusion processes, revealing the connection between target density and score function.
result The minimizer of the ELBO objective for DDPMs nearly coincides with the true objective, providing a theoretical foundation.
Optimizes data-driven design problems on implicit manifolds using score functions.
problem Optimizing over implicit low-dimensional manifolds in high-dimensional data.
method Introduces a link function connecting data distribution to manifold operations, enabling efficient optimization.
result Establishes theoretical guarantees for feasibility and optimality of proposed algorithms.
A new method optimizes anomaly scoring from score distribution to improve AD performance.
problem Vulnerability to anomaly contamination and lack of adaptability in existing AD methods.
method Optimizes anomaly scoring function from score distribution perspective, using Overlap loss.
result Overlap loss-based AD models significantly outperform state-of-the-art methods.
The study tests and optimizes fairness in credit scoring models.
problem Discrimination in credit scoring models based on protected attributes.
method Formal testing and variable identification to optimize fairness and performance.
result Guidance on monitoring and improving algorithmic fairness in credit scoring.
This work analyzes SGD for SGMs, providing convergence rates and error bounds.
problem Optimization dynamics of SGMs trained with stochastic gradients.
method Non-convex convergence rate analysis and Neural Tangent Kernel analysis.
result Theoretical insights into SGD convergence and error bounds for SGMs.
Proposes mCS for multivariate selection with FDR control.
problem Selecting high-quality candidates from multivariate datasets.
method Introduces regional monotonicity and multivariate nonconformity scores.
result Significantly improves selection power with FDR control.
BaM improves BBVI by optimizing a score-based divergence, leading to faster convergence.
problem Slow convergence of black-box variational inference methods.
method Batch and match (BaM) approach based on a score-based divergence.
result BaM converges exponentially quickly to the target mean and covariance.
Paper proposes an algorithm to learn DAGs with indirect dependencies.
problem Learning DAGs misses indirect dependencies in local variables.
method Two-phase algorithm using high-order HSIC for local optimization.
result OT algorithm outperforms existing methods in structure estimation.
Optimizes risk assessment tools using mixed-integer programming.
problem Challenges in healthcare risk assessment due to label scarcity and asymmetric misclassification costs.
method Jointly optimizes scoring weights and category thresholds via mixed-integer programming (MIP).
result Prevents label-scarce category collapse and achieves more accurate risk categorization.