Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

100199299398 · Jun 202019922001200920182026
48 results for discrete losses

Paper develops a least-squares framework for learning discrete losses.

problem Learning strategies for discrete losses (e.g., multilabeling, ranking).
method Least-squares framework to systematically design learning algorithms for discrete losses.
result Improved results with explicit dependence on the number of labels and faster learning rates.

We study proper losses for discrete generative models without knowing the target distribution.

problem Evaluating generative models in the discrete setting without direct access to the target distribution.
method Define and construct black-box proper losses using statistical estimation theory.
result Black-box proper losses must be of polynomial form and involve more samples than the polynomial degree.

Data discretization is an important step in the process of machine learning, since it is easier for classifiers to deal with discrete attributes rather than continuous attributes. Over the years, several methods of performing discretization such as Boolean Reasoning, Equal Frequency Binning, Entropy have been proposed,…

2017-10-13abs ↗pdf ↗

Direct optimization of discrete variational auto-encoders using arg max.

problem Optimizing discrete latent variables in variational auto-encoders.
method Direct optimization through arg max without softmax relaxations.
result Empirical effectiveness of direct loss minimization in discrete latent variables.

New method decomposes profits and losses continuously, avoiding discrete reporting issues.

problem Analyzing profits and losses at discrete dates ignores detailed paths.
method Constructs a large class of continuous-time decompositions using extended Itô's formula.
result Identifies a preferred decomposition from exactness, symmetry, and normalization axioms.

The paper improves privacy accounting for discrete-valued mechanisms and the subsampled Gaussian mechanism.

problem Improving the accuracy and efficiency of differential privacy accounting for discrete outputs.
method Uses fast Fourier transform (FFT) for rigorous error analysis and accounting of privacy loss.
result Provides strict lower and upper bounds for (ε,δ)(\varepsilon,δ)-values, demonstrating up to 75% reduction in noise variance.

Paper proposes a method to speed up discrete diffusion models by distilling many steps into few.

problem Challenges in capturing dependencies between elements in discrete diffusion models.
method Proposes 'mixture' models and loss functions to distill many sampling steps into few.
result Effective in distilling pretrained discrete diffusion models across image and language domains.

Discretizing input space improves DLN robustness against adversarial attacks.

problem Improving machine learning models' resistance to adversarial attacks.
method Input discretization and Binary Neural Networks (BNNs).
result 2-bit input discretization significantly enhances adversarial robustness with minimal accuracy loss.

DFM binarizes feature embeddings for fast, accurate recommendation.

problem Expensive storage and computational cost due to large feature dimensions.
method DFM binarizes real-valued model parameters into binary codes for efficient storage and computation.
result DFM outperforms state-of-the-art binarized recommendation models and shows competitive performance compared to its real-valued version.

Derives derivatives of risk measures for various types of portfolio losses.

problem Calculating precise risk measures for portfolio losses.
method Analyzes first and second order derivatives of risk measures for both continuous and discrete portfolio loss scenarios.
result Provides asymptotic results for conditional moments of heavy-tailed portfolio losses.

StochasticRank optimizes ranking metrics efficiently and guarantees global convergence.

problem Optimizing discrete ranking metrics due to their ill-posed nature.
method Stochastic smoothing, gradient estimate, debiasing, and Stochastic Gradient Langevin Boosting.
result Global convergence and superior performance on ranking datasets.

Paper improves PAC-Bayes bounds for various loss types.

problem Improving PAC-Bayes bounds for different types of losses.
method Introducing new high-probability PAC-Bayes bounds for bounded and general tail behaviors losses, and extending to anytime-valid bounds.
result New fast-rate and mixed-rate bounds for losses with bounded ranges, and parameter-free bounds for losses with general tail behaviors.

PAGP uses physics-assisted Gaussian processes to solve and learn PDEs.

problem Solving and discovering unknown coefficients in PDEs with initial and boundary conditions.
method Physics-assisted Gaussian processes with continuous, discrete, and hybrid models.
result Effective in solving and discovering unknown coefficients in PDEs.

Proposes a new method for optimal graph clustering.

problem Common clustering methods have limitations in similarity graph construction, label relaxation, and label discretization.
method Adaptive learning of a structured similarity graph, explicit discrete transformation, and an adaptive robust module.
result Superior clustering results compared to state-of-the-art methods.

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce training data, overfitting is typically mitigated by adding regularization term…

2017-10-27abs ↗pdf ↗

We develop a framework for consistent polyhedral surrogates in classification and prediction.

problem Designing consistent polyhedral surrogates for classification and prediction problems.
method Formalizing and studying embeddings of predictions as points in R^d, assigning original loss values, and convexifying to create surrogates.
result Established a strong connection between embeddings and polyhedral surrogates, providing constructions and proofs of consistency or inconsistency.

New algorithm improves online learning with reduced discretization.

problem Improving adaptive online learning with refined discretization.
method Continuous time approach to online learning, followed by a new discretization argument.
result Optimal regret bound with O(VT)O(\sqrt{V_T}) dependence on gradient variance.

This work introduces a new loss function to improve the efficiency of optimization-based PDE solvers.

problem Optimization-based PDE solvers converge slowly and are inefficient compared to classical iterative solvers.
method Proposes a novel Stabilized Gradient Residual (SGR) loss function to modulate the condition number.
result The SGR loss achieves orders-of-magnitude faster convergence than the MSE loss in both ODIL and PINNs frameworks.

Extends private optimization to non-convex problems efficiently.

problem Private optimization of non-convex functions over discrete and continuous domains.
method Two algorithms: one for discrete domains and one for continuous domains, both requiring boundedness and Lipschitz continuity.
result Oracle-efficient optimization algorithms for non-convex problems, outperforming standard approaches in some cases.

We present a class of flexible and tractable static factor models for the term structure of joint default probabilities, the factor copula models. These high-dimensional models remain parsimonious with pair-copula constructions, and nest many standard models as special cases. The loss distribution of a portfolio of con…

2016-10-10abs ↗pdf ↗

This paper solves hedging in incomplete markets using neural networks.

problem Hedging in incomplete markets with risk factor, illiquidity, and discrete transaction dates.
method Proposes a jump-diffusion model and uses RNN, LSTM, and Mogrifier-LSTM neural networks for hedging strategies.
result Mogrifier-LSTM is the fastest and most effective model for hedging.

LoRA-Curve connects independent LoRA optima through continuous low-loss valleys, improving Bayesian model averaging.

problem Challenges in estimating epistemic uncertainty in LoRA-based Bayesian inference.
method Introduces LoRA-Curve, a segmented Bézier curve parameterization in the LoRA space, with free and anchored configurations.
result Empirically shows that connecting independent LoRA optima through continuous low-loss valleys improves mutual information of the predictive distribution.

Study evaluates discretized arbitrage strategies in fractional financial markets.

problem Serial correlation in financial markets with fractional Brownian motion.
method Revisit and transfer Shiryaev and Salopek's strategies to a real-world setting, distretizing dynamics and introducing transaction costs.
result Both strategies are promising with respect to terminal portfolio values and loss probabilities.

The paper studies properties of Sliced Wasserstein energy for discrete measures.

problem Optimizing discrete probability measures using Sliced Wasserstein loss.
method Investigates the regularity and optimisation properties of the Sliced Wasserstein energy and its Monte-Carlo approximation.
result Convergence results on the critical points of Monte-Carlo approximations to the Sliced Wasserstein energy.

First order discretizations of Langevin diffusion can achieve better generalization error with additional smoothness assumptions.

problem Analyzing generalization error for first order discretizations of Langevin diffusion.
method Providing a sufficient smoothness condition to show that first order methods can achieve arbitrarily runtime complexity for a given expected generalization error.
result First order methods can achieve arbitrarily runtime complexity with additional smoothness assumptions.

Work on SGDm under heavy-tailed noise, revealing its generalization properties.

problem Understanding generalization of SGDm under heavy-tailed noise.
method Analysis of continuous-time limit (SDE) and discrete-time SGDm, establishing generalization bounds.
result SGDm can have worse generalization in the presence of heavy-tailed noise for quadratic loss functions.

Unified framework for continuous-state discrete flow matching models.

problem Discrete generative modeling with continuous probabilities.
method Introducing αα-Flow, a family of CS-DFM models based on information geometry.
result Optimal flow matching loss for αα-flow minimizes generalized kinetic energy.

Improved vector quantization using Gaussian mixtures for better codebook utilization.

problem Training instability and information loss in discrete vector quantization.
method Generalized vector quantization with Gaussian mixture model and aggregated categorical posterior evidence lower bound.
result GM-VQ improves codebook utilization and reduces information loss without heuristics.