Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

98197295393 · Jun 202019922001200920172026
48 results for expressive losses

New expressive losses improve adversarial robustness without sacrificing accuracy.

problem Training networks for robustness at the expense of accuracy.
method Formalizing expressivity, using convex combinations of adversarial attacks and IBP bounds.
result Trivial expressive losses yield state-of-the-art results in various settings.

LogGENE uses log-cosh loss for deep learning in gene expression datasets, improving accuracy and interpretability.

problem Mining large gene expression datasets for reliable deep learning predictions.
method Develops a smooth alternative to check loss (log-cosh) for quantile regression in gene expression datasets.
result Achieves state-of-the-art performance in accuracy and provides robust uncertainty estimates.

We analyze the loss landscape and expressiveness of practical deep convolutional neural networks (CNNs) with shared weights and max pooling layers. We show that such CNNs produce linearly independent features at a "wide" layer which has more neurons than the number of training samples. This condition holds e.g. for the…

2017-10-30abs ↗pdf ↗

A new Branch-and-Bound solver tackles L0-penalized problems with flexible loss functions.

problem Solving L0-penalized optimization problems with a broader class of loss functions.
method Generic Branch-and-Bound procedure with closed-form expressions for key quantities.
result El0ps solver achieves state-of-the-art performance and extends computational feasibility.

New method prevents neural network breakdown by combining trimmed loss and variation regularization.

problem Outlier contamination in neural network training.
method Integrates transformed trimmed loss and higher-order variation regularization.
result Ensures robustness to outlier contamination with a high functional breakdown point.

This paper addresses the problem of inferring a regular expression from a given set of strings that resembles, as closely as possible, the regular expression that a human expert would have written to identify the language. This is motivated by our goal of automating the task of postmasters of an email service who use r…

2012-06-18abs ↗pdf ↗

Paper proposes dp-VAE for preserving spatial context in gene expression data.

problem Inaccessibility of spatial context in single-cell gene expression data.
method Generic representation learning and transfer learning framework with a distance-preserving regularizer.
result dp-VAE effectively reconstructs and imputes spatial context from gene expression data.

New approach connects quantum phases to VQA trainability, enabling better scaling.

problem Scalability issues in VQAs, especially barren plateaus.
method Analog VQA ansätze composed of quenches of a disordered Ising chain, tuning disorder strength.
result Thermalized and MBL phases reach maximal expressivity at large MM, but barren plateaus emerge at smaller MM in the thermalized phase.

This paper considers the problem of optimal liquidation of a position in a risky security in a financial market, where price evolution are risky and trades have an impact on price as well as uncertainty in the filling orders. The problem is formulated as a continuous time stochastic optimal control problem aiming at ma…

2019-01-03abs ↗pdf ↗

Loss to followup is a significant issue in healthcare and has serious consequences for a study's validity and cost. Methods available at present for recovering loss to followup information are restricted by their expressive capabilities and struggle to model highly non-linear relations and complex interactions. In this…

2018-02-12abs ↗pdf ↗

Transformer-based models overfit financial time series data, leading to increased prediction variance.

problem Forecast collapse of transformer-based models under squared loss in financial time series.
method Theoretical analysis and numerical experiments on high-frequency EUR/USD exchange rate data.
result Increased model expressivity in Transformer-based models leads to spurious fluctuations without reducing bias, resulting in higher prediction variance.

New loss function reduces outage probability in ML-assisted resource allocation.

problem Minimizing outage probability in ML-assisted resource allocation systems.
method Developed a novel loss function and trained an ML model to address the outage probability challenge.
result Exact and asymptotic expressions for the system's outage probability were established.

This paper extends stock trading results to include stop-loss orders.

problem Generalizing stock trading results with stop-loss orders.
method Geometric Brownian motion model, affine feedback controller, closed-form expression for cumulative distribution function.
result Affine feedback controller with stop-loss order generalizes results without stop-loss orders.

Transformers struggle to learn Markovian dynamics, showing NP-hard optimization challenges.

problem Understanding transformers' limitations in learning Markovian dynamical functions.
method Investigated through a structured ICL setup, analyzing loss landscapes and parameter optimization.
result Recovering optimal transformer parameters for Markovian functions is NP-hard.

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the FβF_β score, area under the precision-recall curve, Precision at K, and more. The maximization of many of these metrics can be expressed as a con…

2018-02-28abs ↗pdf ↗

This work explains why online imitation learning improves faster than theory predicts.

problem Online imitation learning's empirical policy improvement speed exceeds theoretical predictions.
method The authors analyze online imitation learning with a convex, smooth, and non-negative loss function, proving policy improvement in expectation and high probability.
result Adopting a sufficiently expressive policy class in online IL increases both policy improvement speed and performance bias.

Diffusion-QL uses diffusion models to improve offline RL performance.

problem Offline RL struggles with function approximation errors on out-of-distribution actions.
method Diffusion-QL represents the policy as a conditional diffusion model and optimizes action-values.
result Diffusion-QL achieves state-of-the-art performance on D4RL benchmark tasks.

Most network-based protein (or gene) function prediction methods are based on the assumption that the labels of two adjacent proteins in the network are likely to be the same. However, assuming the pairwise relationship between proteins or genes is not complete, the information a group of genes that show very similar p…

2012-12-03abs ↗pdf ↗

We consider a financial contract that delivers a single cash flow given by the terminal value of a cumulative gains process. The problem of modelling and pricing such an asset and associated derivatives is important, for example, in the determination of optimal insurance claims reserve policies, and in the pricing of r…

2007-10-15abs ↗pdf ↗

Study feature representations induced by dependence between variables.

problem Learning feature representations from dependent random variables.
method Characterized sufficient and necessary conditions for dependence-induced representations, and provided a family of loss functions.
result Features learned from the family of loss functions can be expressed as the composition of a loss-dependent function and the maximal correlation function.

New formula identifies and quantifies costs for automated market makers.

problem Adverse selection costs faced by liquidity providers in automated market makers.
method Derives a Black-Scholes-like formula for AMMs and identifies loss-versus-rebalancing cost.
result Closed-form expressions for LVR applicable to all automated market makers.

The study quantifies decision-making risks from suboptimal classifiers and proposes methods to reduce these risks.

problem Excess risk in decision-making from suboptimal probabilistic classifiers.
method Analytical expressions and upper/lower bounds for excess risk, calibration curve estimation, grouping loss estimator.
result Identifies regimes where recalibration alone or post-training is more effective.

Under the Basel II standards, the Operational Risk (OpRisk) advanced measurement approach is not prescriptive regarding the class of statistical model utilised to undertake capital estimation. It has however become well accepted to utlise a Loss Distributional Approach (LDA) paradigm to model the individual OpRisk loss…

2011-02-17abs ↗pdf ↗

We shall provide in this paper good deal pricing bounds for contingent claims induced by the shortfall risk with some loss function. Assumptions we impose on loss functions and contingent claims are very mild. We prove that the upper and lower bounds of good deal pricing bounds are expressed by convex risk measures on …

2008-02-28abs ↗pdf ↗

Individual risk models need to capture possible correlations as failing to do so typically results in an underestimation of extreme quantiles of the aggregate loss. Such dependence modelling is particularly important for managing credit risk, for instance, where joint defaults are a major cause of concern. Often, the d…

2014-12-10abs ↗pdf ↗

Recently, fully-connected and convolutional neural networks have been trained to achieve state-of-the-art performance on a wide variety of tasks such as speech recognition, image classification, natural language processing, and bioinformatics. For classification tasks, most of these "deep learning" models employ the so…

2013-06-02abs ↗pdf ↗