This article studies the achievable guarantees on the error rates of certain learning algorithms, with particular focus on refining logarithmic factors. Many of the results are based on a general technique for obtaining bounds on the error rates of sample-consistent classifiers with monotonic error regions, in the real…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “proportional rate error”
DSDE: Using Proportion Estimation to Improve Model Selection for Out-of-Distribution Detectionstat.ML
DSDE improves OoD detection by estimating model library proportions.
problem Uncertainty quantification and balanced error rates in model selection for OoD detection.
method Inverted sequential p-value strategies, change-point detection, automatic hyperparameter selection.
result DSDE reduces FPR from 11.07% to 3.31% on CIFAR10.
learn2mix trains neural nets faster by adjusting class proportions dynamically.
problem Training neural nets efficiently with limited resources and imbalanced classes.
method Adaptive class proportion adjustment during training.
result Neural nets trained with learn2mix converge faster than static methods.
New research shows fixed-budget best-arm identification cannot match static oracle performance.
problem Fixed-budget best-arm identification's performance limitations.
method Analysis of various adaptive and static algorithms for best-arm identification.
result For any algorithm, there exists at least one instance where the error decay rate is at most \((1 + \frac{\log(K)}{8})^{-1}\) times that of the static oracle.
Harmonic Mean Point Processes: Proportional Rate Error Minimization for Obtundation Predictionstat.ML
New method improves prediction accuracy for low-risk patients in healthcare.
problem Machine learning models often focus on high-risk patients, ignoring low-risk ones.
method Proposed a new log-likelihood formulation to minimize proportional rate error.
result Improved prediction accuracy for low-risk patients in EHR data.
New learning rules achieve optimal sample complexity for weakly supervised classification.
problem Learning from label proportions in weakly supervised settings.
method Debiased proportional square loss and EasyLLP learning rule.
result Achieves optimal sample complexity in both realizable and agnostic settings.
In bankruptcy prediction, the proportion of events is very low, which is often oversampled to eliminate this bias. In this paper, we study the influence of the event rate on discrimination abilities of bankruptcy prediction models. First the statistical association and significance of public records and firmographics i…
We address the problem of non-parametric multiple model comparison: given candidate models, decide whether each candidate is as good as the best one(s) or worse than it. We propose two statistical tests, each controlling a different notion of decision errors. The first test, building on the post selection inference…
Study bounds growth rate of irreducible meanders, showing proportion vanishes.
problem Understanding growth rate of irreducible meanders.
method Provided upper and lower bounds for growth rate.
result Proportion of irreducible meanders among prime meanders approaches 0 as n increases.
We study streaming principal component analysis (PCA), that is to find, in space, the top eigenvectors of a hidden matrix with online vectors drawn from covariance matrix . We provide convergence for Oja's algorithm which is popularly used in practice but lacks t…
Approximate hedging with proportional transaction costs in stochastic volatility models with jumpsq-fin.MF
We study the problem of option replication under constant proportional transaction costs in models where stochastic volatility and jumps are combined to capture the market's important features. Assuming some mild condition on the jump size distribution we show that transaction costs can be approximately compensated by …
Study best arm identification in restless bandits with unknown TPMs.
problem Identify the best arm with fixed confidence in restless bandits with unknown TPMs.
method Proposed a policy for best arm identification and proved its expected stopping time matches the lower bound.
result The state-action visitation proportions match the optimal proportions under any asymptotically optimal policy.
Paper finds closed-form solutions for tontine with bequest motive.
problem Finding optimal fractional consumption rate and bequest amount under bequest motive.
method Relaxing fixed proportions assumption, introducing bequest proportion as control function.
result Closed-form solutions for fractional consumption rate, wealth, bequest amount, and proportion.
New framework for weakly supervised learning from label proportions.
problem Lack of consistent learning procedure and theoretical training criterion for LLP.
method Pose LLP as mutual contamination models (MCMs) and establish unbiased losses and generalization error bounds.
result Established novel technical results for MCMs and proposed a new experimental setting.
Implicit biases in multitask and continual learning from a backward error analysis perspectivestat.ML
The study analyzes implicit biases in neural networks using backward error analysis.
problem Analyzing implicit biases in multitask and continual learning settings.
method Backward error analysis to compute implicit training biases, deriving modified losses with three terms.
result The conflict term, measuring gradient alignment, is a new quantity in continual learning.
New ridge regression bounds for high-dimensional data without proportional growth.
problem Moving beyond proportional asymptotics in high-dimensional statistics.
method Revisits ridge regression on i.i.d. data, allowing high-dimensional or infinite-dimensional feature vectors.
result Establishes non-asymptotic bounds approximating bias and variance of ridge regression.
We study the community detection and recovery problem in partially-labeled stochastic block models (SBM). We develop a fast linearized message-passing algorithm to reconstruct labels for SBM (with nodes, blocks, intra and inter block connectivity) when proportion of node labels are revealed. The signa…
Smoothness Adaptivity in Constant-Depth Neural Networks: Optimal Rates via Smooth Activationsstat.ML
Smooth activations enable optimal error rates in neural networks for Sobolev function classes.
problem Achieving optimal approximation and estimation error rates for neural networks in Sobolev function classes.
method Study of neural networks with smooth activations, proving optimal rates via approximation and statistical properties.
result Constant-depth networks with smooth activations achieve optimal rates of approximation and estimation, demonstrating smoothness adaptivity.
Develops a method to estimate average hazard under non-proportional hazards without relying on proportional hazards assumption.
problem Estimation of treatment effects when hazards are non-proportional, leading to unstable hazard ratios.
method Semiparametric, doubly robust framework for covariate-adjusted average hazard estimation.
result Valid sqrt{n} inference with small bias and near-nominal confidence-interval coverage across proportional and non-proportional hazards settings.
Wealth tax equivalent to government stake, affecting returns and portfolio choice.
problem Effect of proportional wealth tax on asset returns and portfolio choice.
method Analyzes the economic equivalence and multiplicative separability of wealth tax, deriving four main results.
result The coefficient of variation of wealth is invariant to the tax rate, and optimal portfolio weights are independent of the tax rate.
We determine the optimal investment strategy in a Black-Scholes financial market to minimize the so-called {\it probability of drawdown}, namely, the probability that the value of an investment portfolio reaches some fixed proportion of its maximum value to date. We assume that the portfolio is subject to a payout that…
Minimizes indecisions in selective classification to control misclassification rates.
problem Controlling misclassification rates in high-risk scenarios.
method Using indecisions to control misclassification rates, even below Bayes optimal.
result Control of misclassification rates to any user-specified level, even below Bayes optimal.
ALO-CV approximates leave-one-out error in proportional regime.
problem Estimating generalization error in high-dimensional settings.
method Developed new analysis for ALO-CV, showed consistency under strong convexity.
result ALO-CV approximates leave-one-out error up to negligible error.
Given samples from a population of individuals belonging to different types with unknown proportions, how do we estimate the probability of discovering a new type at the -th draw? This is a classical problem in statistics, commonly referred to as the missing mass estimation problem. Recent results by Ohannes…
Zipf's law and maximum sustainable growthphysics.soc-ph
Zipf's law states that the number of firms with size greater than S is inversely proportional to S. Most explanations start with Gibrat's rule of proportional growth but require additional constraints. We show that Gibrat's rule, at all firm levels, yields Zipf's law under a balance condition between the effective grow…
New theory improves diffusion models' convergence rates.
problem Understanding and optimizing diffusion models for faster data generation.
method Developed non-asymptotic theory for diffusion models with minimal assumptions.
result Established convergence rates for two diffusion models.
New bounds on ReLU networks for low-regular functions.
problem Bounding approximation error for ReLU networks on low-regular functions.
method Complexity analysis of Fourier features residual networks to ReLU networks.
result Approximation error bound proportional to target function norm and inversely proportional to network width and depth.
This work improves confidence intervals for Cox model test error using nested CV.
problem Insufficient understanding of confidence intervals for cross-validation in Cox model.
method Generalized nested cross-validation to Cox proportional hazards model.
result Improved coverage of confidence intervals for Cox model test error.
Enhances FDR control in variable selection using neural networks.
problem Balancing rigorous error control with statistical power in high-dimensional variable selection.
method Learning-augmented T-Rex Selector framework with a neural network trained on synthetic datasets.
result Achieves superior detection of true variables compared to existing approaches.
We propose the application of a semi-supervised learning method to improve the performance of acoustic modelling for automatic speech recognition based on deep neural net- works. As opposed to unsupervised initialisation followed by supervised fine tuning, our method takes advantage of both unlabelled and labelled data…
In this paper we present a geometric control law for position and line-of-sight stabilization of the nonholonomic spherical robot actuated by three independent actuators. A simple configuration error function with an appropriately defined transport map is proposed to extract feedforward and proportional-derivative cont…
This work efficiently learns linear threshold functions from label proportions using Gaussian distributions.
problem Efficiently learning linear threshold functions from label proportions.
method Using Gaussian distributions, the algorithm estimates means and covariance matrices, and identifies a low error hypothesis LTF.
result It is possible to efficiently learn LTFs using LTFs when given access to random bags of label proportions.
We determine the optimal amount to invest in a Black-Scholes financial market for an individual who consumes at a rate equal to a constant proportion of her wealth and who wishes to minimize the expected time that her wealth spends in drawdown during her lifetime. Drawdown occurs when wealth is less than some fixed pro…
The Effect of Network Width on Stochastic Gradient Descent and Generalization: an Empirical Studycs.LG
We investigate how the final parameters found by stochastic gradient descent are influenced by over-parameterization. We generate families of models by increasing the number of channels in a base network, and then perform a large hyper-parameter search to study how the test error depends on learning rate, batch size, a…
Optimal best arm identification for multi-objective bandits with fixed error probability.
problem Identifying the best arm for each of multiple objectives with fixed confidence.
method Surrogate proportions to sample arms at each time step, eliminating max-min optimisation.
result Asymptotically optimal algorithm for multi-objective best arm identification.
Learning from Label Proportions (LLP) is a learning setting, where the training data is provided in groups, or "bags", and only the proportion of each class in each bag is known. The task is to learn a model to predict the class labels of the individual instances. LLP has broad applications in political science, market…
Mixture proportion estimation (MPE) is the problem of estimating the weight of a component distribution in a mixture, given samples from the mixture and component. This problem constitutes a key part in many "weakly supervised learning" problems like learning with positive and unlabelled samples, learning with label no…
We consider Bernoulli random variables, which are independent conditional on a common random factor determining their probability distribution. We show that certain expected functionals of the proportion of variables in a given state converge at rate as . Based on these results, we …
Estimates non-parametric logistic model using case-control data and external summary info.
problem Imbalanced binary data in case-control studies.
method Two-step estimation procedure with deep neural network for functional approximation.
result Proposed estimator achieves optimal convergence rate in non-parametric regression.
Derives TAP approximation for Bayesian linear regression.
problem Log-normalizing constant of posterior distribution in high-dimensional linear regression.
method Variational representation and Thouless-Anderson-Palmer approximation.
result Proves TAP approximation for spherical prior in proportional asymptotic regime.
In this paper, asymptotic results in a long-term growth rate portfolio optimization model under both fixed and proportional transaction costs are obtained. More precisely, the convergence of the model when the fixed costs tend to zero is investigated. A suitable limit model with purely proportional costs is introduced …
This paper studies the generalization error of invariant classifiers. In particular, we consider the common scenario where the classification task is invariant to certain transformations of the input, and that the classifier is constructed (or learned) to be invariant to these transformations. Our approach relies on fa…
The Sinkhorn-Knopp derivatives converge with linear rate.
problem Optimal transport problem with entropic regularization.
method Iterative proportional fitting procedure.
result Derivatives converge with linear rate.
Paper analyzes mistake and generalization of MNIC classifiers.
problem Understanding the performance of interpolating classifiers.
method Elementary analyses of MNIC's regret and generalization.
result MNIC generalizes with a rate proportional to the norm of the interpolating solution and inversely proportional to the number of data points.
Deep networks become equivalent to linear models in large data regimes.
problem Understanding the behavior of deep neural networks in large data regimes.
method Information-theoretic analysis of fully-trained neural networks in proportional scaling regime.
result Proves deep Gaussian equivalence principle, showing deep networks can be simplified to linear models.
We propose a novel neural sequence prediction method based on \textit{error-correcting output codes} that avoids exact softmax normalization and allows for a tradeoff between speed and performance. Instead of minimizing measures between the predicted probability distribution and true distribution, we use error-correcti…
In this paper, we consider the problem of column subset selection. We present a novel analysis of the spectral norm reconstruction for a simple randomized algorithm and establish a new bound that depends explicitly on the sampling probabilities. The sampling dependent error bound (i) allows us to better understand the …
We extend the fundamental theorem of asset pricing to a model where the risky stock is subject to proportional transaction costs in the form of bid-ask spreads and the bank account has different interest rates for borrowing and lending. We show that such a model is free of arbitrage if and only if one can embed in it a…