Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

234468701935 · Jun 202019922001200920172026
48 results for training cost

Designs a neural network to reduce training cost by mapping to higher dimensions.

problem High training cost in neural networks.
method Maps feature vectors to higher dimensional space, designs weight matrices to reduce cost, uses convex constraints.
result Reduces training cost as the number of layers increases, without cross-validation.

Ensembles of deep neural networks significantly improve generalization accuracy. However, training neural network ensembles requires a large amount of computational resources and time. State-of-the-art approaches either train all networks from scratch leading to prohibitive training cost that allows only very small ens…

2018-09-12abs ↗pdf ↗

This paper proposes CSADA to make DNNs cost-sensitive.

problem Over-parameterization challenges cost-sensitive classification in DNNs.
method CSADA framework using adversarial data augmentation.
result CSADA effectively minimizes overall cost and reduces critical errors.

New algorithm reduces misclassification costs in neural networks.

problem Reduces costs of misclassified instances in neural networks.
method Adaptive Cost-Sensitive Learning (AdaCSL) adjusts loss function to bridge class distribution mismatches.
result Deep neural networks with AdaCSL outperform other methods on cost-sensitive binary classification tasks.

A new cost-frugal HPO method controls training cost during optimization.

problem Ignoring training cost variation in HPO leads to inefficient hyperparameter tuning.
method Developed a randomized direct-search method with convergence and approximation guarantees.
result Proved an O(dK)O(\frac{\sqrt{d}}{\sqrt{K}}) convergence rate and O(dε2)O(dε^{-2}) approximation guarantee.

A new method for decision-focused learning reduces computational cost.

problem Efficiently solving combinatorial problems with uncertain parameters.
method Reframed as cost-sensitive multi-output regression, with novel loss components.
result Comparable downstream task quality with reduced computational cost.

MCAL reduces labeling costs by 6x for auto-labeling data sets.

problem Expensive human annotation for ground-truth data sets.
method Iterative approach that trains a classifier to auto-label part of the data set, determining which samples to label using humans and which to label using the classifier at each step.
result 6x lower overall cost compared to human labeling the entire data set, always cheaper than competing strategies.

Adversarial training, in which a network is trained on adversarial examples, is one of the few defenses against adversarial attacks that withstands strong attacks. Unfortunately, the high cost of generating strong adversarial examples makes standard adversarial training impractical on large-scale problems like ImageNet…

2019-04-29abs ↗pdf ↗

Several recent works have developed methods for training classifiers that are certifiably robust against norm-bounded adversarial perturbations. These methods assume that all the adversarial transformations are equally important, which is seldom the case in real-world applications. We advocate for cost-sensitive robust…

2018-10-22abs ↗pdf ↗

The paper constructs upper bounds for cost minimization in shallow neural networks.

problem Cost minimization in underparametrized shallow ReLU networks.
method Explicit construction of upper bounds based on the geometric structure of classification data.
result An upper bound on the minimum of the cost function of order O(δP)O(δ_P), with exact degenerate local minimum in the special case M=QM=Q.

Asynchronous algorithms reduce privacy costs in distributed machine learning.

problem Privacy concerns in training machine learning models on scattered private data.
method Differentially-private asynchronous algorithms for collaborative training.
result Cost of privacy is inversely proportional to dataset size and privacy budgets.

The paper discusses the limitations of efficiency metrics in machine learning models.

problem Inadequate reporting of efficiency metrics leads to incomplete conclusions.
method Thoroughly discusses common cost indicators, their advantages and disadvantages, and how they contradict each other.
result Incomplete reporting of efficiency metrics can lead to partial conclusions and a blurred picture of model practical considerations.

Frequently, acquiring training data has an associated cost. We consider the situation where the learner may purchase data during training, subject TO a budget. IN particular, we examine the CASE WHERE each feature label has an associated cost, AND the total cost OF ALL feature labels acquired during training must NOT e…

2012-10-19abs ↗pdf ↗

We propose a novel adaptive approximation approach for test-time resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our objective is to minimize overall average cost without sacrificing accuracy. We learn gat…

2017-05-26abs ↗pdf ↗

LMM predicts healthcare costs and risks with improved accuracy.

problem Wasteful healthcare spending and inefficiencies in risk prediction.
method Generative pre-trained transformer trained on patient event sequences.
result Improves cost prediction by 14.1% and chronic conditions prediction by 1.9%.

We present a dynamic model selection approach for resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our objective is to minimize overall average cost without sacrificing accuracy. We learn gating and predict…

2017-04-25abs ↗pdf ↗

This study optimizes DRL for American option hedging with new training methods.

problem Optimizing Deep Reinforcement Learning for American Put Option Hedging
method Investigates hyperparameters, introduces new training methods, and compares with Black-Scholes method.
result Weekly-trained DRL agents outperform Black-Scholes at transaction costs of 1% and 3%

Deep convolutional neural networks have achieved great success in various applications. However, training an effective DNN model for a specific task is rather challenging because it requires a prior knowledge or experience to design the network architecture, repeated trial-and-error process to tune the parameters, and …

2018-02-15abs ↗pdf ↗

Proposes a method to train neural networks that solve differential equations faster.

problem Training neural networks that solve differential equations becomes computationally expensive.
method Introduces a differentiable surrogate for numerical solver time cost using higher-order derivatives.
result Trains models that are faster to solve while maintaining nearly the same accuracy.

New method reduces deep learning training costs by approximating vector-jacobian products.

problem Efficiently training deep neural networks with reduced computational and memory costs.
method Randomized, unbiased approximations of vector-jacobian products during backpropagation.
result Validated potential for reducing deep learning training costs through unbiased estimates.

Combines cost-sensitive and Neyman-Pearson paradigms for better binary classification.

problem Asymmetric binary classification problems with unequal error severities.
method Develops TUBE-CS algorithm to bridge cost-sensitive and Neyman-Pearson paradigms.
result High-probability control of population type I error.

We seek decision rules for prediction-time cost reduction, where complete data is available for training, but during prediction-time, each feature can only be acquired for an additional cost. We propose a novel random forest algorithm to minimize prediction error for a user-specified {\it average} feature acquisition b…

2015-02-20abs ↗pdf ↗

FedLion improves Federated Learning by speeding up convergence and reducing communication costs.

problem Slow convergence and high communication costs in Federated Learning.
method Integrates Lion's adaptive approach into Federated Learning framework, using signed gradients.
result FedLion outperforms existing adaptive algorithms in convergence rate and communication efficiency.

Paper proposes a cost-sensitive conformal training method with provably controllable learning bounds.

problem Uncertainty quantification and learning bounds in conformal prediction.
method Cost-sensitive conformal training algorithm that minimizes the expected size of prediction sets using rank weighting.
result Theoretical analysis shows tightness between weighted objective and expected size of conformal prediction sets.

Recurrent Neural Networks (RNNs) are powerful models that achieve exceptional performance on several pattern recognition problems. However, the training of RNNs is a computationally difficult task owing to the well-known "vanishing/exploding" gradient problem. Algorithms proposed for training RNNs either exploit no (or…

2015-11-04abs ↗pdf ↗

Paper presents a new training method for overparametrized neural networks that reduces time per iteration.

problem Scalability issue in training overparametrized neural networks.
method Uses a new view of neural networks as binary search trees, modifying a small subset of nodes per iteration.
result Reduces amortized time per iteration to m1αnd+n3m^{1-α} n d + n^3 from previous mnd+n3mnd + n^3.

The neural network (NN)-based direct uncertainty quantification (UQ) methods have achieved the state of the art performance since the first inauguration, known as the lower-upper-bound estimation (LUBE) method. However, currently-available cost functions for uncertainty guided NN training are not always converging and …

2019-12-30abs ↗pdf ↗

Label space expansion for multi-label classification (MLC) is a methodology that encodes the original label vectors to higher dimensional codes before training and decodes the predicted codes back to the label vectors during testing. The methodology has been demonstrated to improve the performance of MLC algorithms whe…

2016-11-29abs ↗pdf ↗