Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

78156234312 · Jun 202019922001200920172026
48 results for primary loss

The paper tackles online learning with two types of losses and shows it's impossible without certain assumptions.

problem Online learning with primary and secondary losses where the secondary loss is bounded by a linear threshold.
method Analyzes the feasibility of achieving low regret with respect to the primary loss while keeping the secondary loss within a linear threshold.
result Achieving the goal is impossible without bounded variance assumption on the secondary loss.

Fuses ITRs for primary and secondary outcomes to minimize harm.

problem Learn an ITR maximizing primary outcome while minimizing harm to secondary outcomes.
method Introduces fusion penalty to encourage similar recommendations for different outcomes. Two algorithms estimate the ITR using surrogate loss functions.
result Agreement rate between primary and secondary optimal ITRs converges faster than ignoring secondary outcomes.

Aux-NAS uses auxiliary labels to improve primary task performance without extra inference cost.

problem Improving primary task performance using auxiliary labels without increasing inference cost.
method Architecture-based approach with a flexible asymmetric structure for primary and auxiliary tasks, using Neural Architecture Search (NAS) to evolve networks with only primary-to-auxiliary connections.
result Achieves improved performance on multiple tasks without increasing inference cost.

DPC uses physics and neural nets to solve SDEs.

problem Solving stochastic differential equations with missing physics.
method Physics-data fusion with conditional maximum mean discrepancy (CMMD) loss.
result DPC achieves highly accurate solutions on benchmark examples.

Learning with auxiliary tasks can improve the ability of a primary task to generalise. However, this comes at the cost of manually labelling auxiliary data. We propose a new method which automatically learns appropriate labels for an auxiliary task, such that any supervised learning task can be improved without requiri…

2019-01-25abs ↗pdf ↗

This research analyzes the consistency of convex and nonconvex surrogate losses for adversarially robust classification.

problem Ensuring classifiers are robust to adversarial perturbations.
method Analysis of convex and nonconvex surrogate losses through the lens of calibration.
result No convex surrogate loss is calibrated with respect to the adversarial 0-1 loss for linear models, but nonconvex losses can be calibrated under certain conditions.

We develop a model for contagion in reinsurance networks by which primary insurers' losses are spread through the network. Our model handles general reinsurance contracts, such as typical excess of loss contracts. We show that simpler models existing in the literature--namely proportional reinsurance--greatly underesti…

2018-05-30abs ↗pdf ↗

Bayesian neural networks improved with scalable approximate inference.

problem Performing approximate Bayesian inference in complex models like neural networks.
method Two models: primary for prediction, secondary for posterior approximation; optimised via gradient descent on posterior predictive distribution.
result Approach scales better than MCMC and more expressive than VIs, without adversarial training.

Paper examines risk measure expansions under FGM dependence, improving accuracy at extreme levels.

problem Capturing higher-order tail behavior and dependence effects in risk measures.
method Second-order asymptotic expansions using extreme value theory and regular variation theory.
result Second-order approximations reduce approximation errors, especially at extreme confidence levels.

Informer model with GMADL loss outperforms benchmarks in high frequency Bitcoin trading.

problem Developing automated trading strategies for high frequency Bitcoin data.
method Informer architecture with RMSE, GMADL, and Quantile loss functions.
result Informer model with GMADL loss function outperforms benchmarks in trading outcomes.

Improved similarity search in embeddings using InfoNCE loss.

problem Improving similarity search in embedding models trained by contrastive learning.
method Introduced a new continuity bound for InfoNCE loss via Gâteaux differentiation, preserving the averaging effect of negative samples.
result Demonstrated that the averaging effect of kk negative samples in InfoNCE loss carries over to stabilisation of generalisation error as kk grows.

SGD updates align with a low-rank subspace but do not lead to further loss reduction.

problem Understanding the training dynamics of deep neural networks, particularly the role of the dominant subspace.
method Exploring whether neural networks can be trained within the dominant subspace of the loss Hessian.
result SGD updates, when projected onto the dominant subspace, do not decrease the training loss further, suggesting spurious alignment.

Augmenting a neural network with memory that can grow without growing the number of trained parameters is a recent powerful concept with many exciting applications. We propose a design of memory augmented neural networks (MANNs) called Labeled Memory Networks (LMNs) suited for tasks requiring online adaptation in class…

2017-07-05abs ↗pdf ↗

Classifies Real primary Hopf surfaces and their associated groups.

problem Classifying Real primary Hopf surfaces and their associated groups.
method Complete classification up to Real biholomorphisms and equivariant diffeomorphisms.
result Detailed description of groups associated with Real primary Hopf surfaces.

We introduce new forecast encompassing tests for the risk measure Expected Shortfall (ES). The ES currently receives much attention through its introduction into the Basel III Accords, which stipulate its use as the primary market risk measure for the international banking regulation. We utilize joint loss functions fo…

2019-08-13abs ↗pdf ↗

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the FβF_β score, area under the precision-recall curve, Precision at K, and more. The maximization of many of these metrics can be expressed as a con…

2018-02-28abs ↗pdf ↗

Improved online learning with time-varying constraints for complex domains.

problem Constrained online convex optimization with time-varying constraints.
method Constructing a composite surrogate loss and using the online Frank-Wolfe method.
result Novel regret and cumulative constraint violation bounds for strongly convex losses.

In machine learning, statistics, econometrics and statistical physics, cross-validation (CV) is used asa standard approach in quantifying the generalisation performance of a statistical model. A directapplication of CV in time-series leads to the loss of serial correlations, a requirement of preserving anynon-stationar…

2019-10-21abs ↗pdf ↗

Flaky performance found in GNN SSL on RDBs, leading to worse linear evaluation.

problem Downstream task performances of GNN SSL on RDBs are poor.
method Proposed InfoNode to maximize mutual information between initial and final node representations.
result InfoNode improves GNN SSL performance on RDBs, supporting conjecture of conflict between SSL and GNN message passing.

Super Learner combines dynamic predictions from various models to improve survival estimates.

problem Challenges in obtaining optimal survival estimates for liver failure risk.
method Super Learner framework combining machine learning and statistical procedures.
result Super Learner outperformed individual models in primary biliary cholangitis application.

New loss function reduces outage probability in ML-assisted resource allocation.

problem Minimizing outage probability in ML-assisted resource allocation systems.
method Developed a novel loss function and trained an ML model to address the outage probability challenge.
result Exact and asymptotic expressions for the system's outage probability were established.

Learning with a primary objective, such as softmax cross entropy for classification and sequence generation, has been the norm for training deep neural networks for years. Although being a widely-adopted approach, using cross entropy as the primary objective exploits mostly the information from the ground-truth class f…

2019-03-04abs ↗pdf ↗

We address feature interpretation and reproducibility issues in dense nets, proposing a modified loss function.

problem Feature interpretation and reproducibility issues in dense nets.
method Proposed a modified loss function to circumvent basis collapse.
result Substantially concise nets with 100x fewer parameters and lower MSE loss.

The paper introduces PD learning to improve deep learning theory.

problem Lack of theoretical understanding in deep learning model fitting and generalization.
method Proposes a PD learning framework to analyze optimization and generalization mechanisms of deep learning.
result Established theoretical guarantees on optimizability and derived generalization error bounds.

We study holomorphic locally homogeneous geometric structures modelled on line bundles over the projective line. We classify these structures on primary Hopf surfaces. We write out the developing map and holonomy morphism of each of these structures explicitly on each primary Hopf surface.

2009-10-02abs ↗pdf ↗

Paper proposes a method to speed up discrete diffusion models by distilling many steps into few.

problem Challenges in capturing dependencies between elements in discrete diffusion models.
method Proposes 'mixture' models and loss functions to distill many sampling steps into few.
result Effective in distilling pretrained discrete diffusion models across image and language domains.

Large data collections required for the training of neural networks often contain sensitive information such as the medical histories of patients, and the privacy of the training data must be preserved. In this paper, we introduce a dropout technique that provides an elegant Bayesian interpretation to dropout, and show…

2017-11-30abs ↗pdf ↗

In this study, we generalize double tangent bundles to double jet bundles. We present a secondary vector bundle structure on a 1-jet of a vector bundle. We show that 1-jet of a vector bundle carries two vector bundle structures, namely primary and secondary structures. We also show that the manifold charts induced by p…

2016-01-17abs ↗pdf ↗

Paper proposes a deep hedging method for Bermudan swaptions to manage residual profit and loss.

problem Real-world market conditions differ from ideal assumptions in traditional hedging methods, leading to residual profit and loss.
method Deep hedging framework applied to Bermudan swaptions, allowing flexible risk measures and hedge strategies.
result Effective residual profit and loss management demonstrated through numerical analysis.

For all n > 0 there is a homomorphism from the smooth concordance group of knots in dimension 2n + 1 to an algebraically defined group called the rational algebraic concordance group. This algebraic concordance group splits as a direct sum of groups indexed by polynomials. For n > 1 the homomorphism is injective. This …

2019-11-19abs ↗pdf ↗

In several natural language tasks, labeled sequences are available in separate domains (say, languages), but the goal is to label sequences with mixed domain (such as code-switched text). Or, we may have available models for labeling whole passages (say, with sentiments), which we would like to exploit toward better po…

2018-11-28abs ↗pdf ↗

Randomly chosen primary hidden units and derived secondary units reduce neural network complexity.

problem Large number of hidden units in neural networks.
method Introducing primary and secondary hidden units with random weights for primary units and derived weights for secondary units.
result Significant reduction in the number of hidden units without compromising accuracy.