Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

91181272362 · Jun 202019922001200920172026
48 results for polynomial barrier loss

The paper proves barriers to approximating functions with small weights and depth in neural networks.

problem Proving barriers to approximating functions with constant depth neural networks.
method Reduction to open problems and natural-proof barriers in circuit complexity, and a new approach to polynomially-bounded functions.
result There are fundamental barriers to proving results beyond depth 4 for constant-depth neural networks.

A new method generates natural-looking adversarial examples by bounding internal activation values.

problem Creating natural-looking adversarial examples that closely mimic the original input.
method Bounding internal activation values through a distribution quantile bound and polynomial barrier loss function.
result Our attack achieves similar success and confidence levels as state-of-the-art methods but with more natural-looking perturbations.

Ancient caloric functions on manifolds with polynomial growth are studied under volume doubling barrier.

problem Analyzing ancient caloric functions on manifolds beyond volume doubling.
method Time polynomial structure result on ancient caloric functions with polynomial growth.
result Finiteness result for ancient caloric functions is essentially sharp, except for multi-end cases.

Bayesian method synthesizes barrier certificates for unknown systems with latent states.

problem Certifying safety in systems with unknown dynamics and latent states.
method Bayesian inference with Metropolis-Hastings sampler and sum-of-squares program.
result Probabilistic validity of barrier certificates for unknown systems.

IPMs struggle with hyperbolic spaces due to polynomially growing barrier parameters.

problem IPMs' efficiency is hindered in hyperbolic spaces.
method Analyzing the barrier parameter growth in hyperbolic and Hadamard spaces.
result The barrier parameter grows polynomially with the domain's diameter in hyperbolic spaces.

Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.

problem Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.
method Identifying entropic barriers arising from the interplay between curvature variations along low-loss paths and noise in optimization dynamics.
result Curvature-induced entropic forces bias noisy dynamics back toward the endpoints, explaining the confinement and connectivity of solutions.

New evidence shows computational barriers in graphon estimation using low-degree polynomials.

problem Estimating graphons efficiently and accurately.
method Low-degree polynomials to analyze computational limits.
result Low-degree polynomial estimators cannot significantly outperform USVT in graphon estimation.

New study reveals a polynomial penalty for adapting to unknown margin parameters in batched nonparametric bandits.

problem Adapting to an unknown margin parameter in batched nonparametric bandits.
method Introduces the regret inflation criterion and develops RoBIN algorithm to achieve optimal regret inflation.
result The optimal regret inflation grows polynomially with the horizon T, characterized by a convex optimization problem.

This work tackles Bayesian neural networks by addressing loss landscape symmetries.

problem Understanding and optimizing the loss landscape of Bayesian neural networks.
method The approach involves extending marginalized loss barrier formalism to BNNs, proposing a matching algorithm to search for linearly connected solutions using permutation matrices and combinatorial optimization.
result Nearly zero marginalized loss barriers for linearly connected solutions were found.

The paper prices long-term options with a reflecting barrier model.

problem Pricing long-term options with asset price limits.
method Model asset price as geometric Brownian motion with a lower reflecting barrier, pricing options using compound options.
result Option prices can be determined using standard risk-neutral arguments, and hedging strategies are available.

The conditional-mean barrier helps diagnose deterministic surrogates missing uncertainty.

problem Uncertainty in deterministic surrogates for complex systems.
method Developed diagnostics to locate the conditional-mean barrier and prove its necessity for distributional objectives.
result Crossing the barrier requires a loss that scores distributions, not point predictions.

Improved regret bound for adversarial MDPs with linear function approximation.

problem Learning in adversarial MDPs with changing loss functions and large state spaces.
method Two algorithms: refined FTRL with log-barrier regularizer and magnitude-reduced loss estimator.
result Achieved ildeO(K) ilde{\mathcal O}(\sqrt K) regret, improving over ildeO(K2/3) ilde{\mathcal O}(K^{2/3}).

This work refines claims about neural network connectivity, showing that simultaneous linear connectivity is possible under certain conditions.

problem Neural networks' loss landscapes are non-convex due to permutation symmetries, leading to high loss barriers between permuted networks.
method The authors introduce and analyze three claims of increasing strength regarding the connectivity of neural networks, focusing on permutations that align networks.
result The authors provide evidence that strong linear connectivity may be possible under certain conditions, specifically when interpolating among three networks of increasing width.

Quantum models face barren plateaus, but specific losses can be trainable.

problem Barren plateaus and loss concentration in quantum generative models.
method Investigated explicit and implicit losses, and their interplay.
result Explicit losses lead to new barren plateaus, while implicit losses can be trainable.

New bounds for online portfolio selection without smoothness assumptions.

problem Online portfolio selection with non-Lipschitz, non-smooth losses.
method Data-dependent bounds using novel smoothness characterizations and FTRL with self-concordant regularizers.
result Achieves logarithmic regrets when data is 'easy' and sublinear worst-case regrets.

New algorithm reduces prediction errors across various loss functions.

problem Online forecasting algorithms' inability to adapt to different loss functions.
method Design of a novel Follow-the-Perturbed-Leader (FTPL) algorithm with self-concordant noise.
result Simultaneously achieves ildeO(T) ilde O(\sqrt{T}) regret for bounded proper losses and O(logT)O(\log T) regret for bounded smooth proper losses.

REPAIR mitigates variance collapse to enable linear interpolation between SGD solutions.

problem Linear interpolation between SGD solutions is difficult due to variance collapse in permuted activations.
method REPAIR rescales preactivations of interpolated networks to mitigate variance collapse.
result 60%-100% relative barrier reduction across various architectures and tasks.

Paper generalizes VB-FTRL for online learning of quantum states with logarithmic loss.

problem Online learning of quantum states with logarithmic loss.
method Generalizes VB-FTRL algorithm for LL-OLQS with polynomial-time implementation.
result Achieves a regret rate of O(d2log(d+T))O (d^2 \log (d + T)) for LL-OLQS.

Study on size and depth of neural networks for approximating benign functions, showing barriers and explicit results.

problem Understanding how size and depth of neural networks affect their ability to approximate benign functions.
method Analyzing ReLU networks for benign functions, proving barriers and explicit results.
result Explicit benign functions that cannot be approximated by networks of certain sizes or depths, showing barriers to size and depth separation.

This paper aims to provide a better understanding of a symmetric loss. First, we emphasize that using a symmetric loss is advantageous in the balanced error rate (BER) minimization and area under the receiver operating characteristic curve (AUC) maximization from corrupted labels. Second, we prove general theoretical p…

2019-01-27abs ↗pdf ↗

Improves policy optimization with polylog(T) regret bounds for stochastic losses.

problem Improves theoretical guarantees for policy optimization in stochastic settings.
method Leverages Tsallis and Shannon entropy regularizers for polylog(T) regret, and log-barrier regularizer for adversarial settings.
result Achieves a first-order polylog(T) regret bound for policy optimization in stochastic settings.

Algorithm for online decision making with unknown dynamics and aggregate feedback.

problem Online decision making with unknown dynamics and aggregate bandit feedback.
method Developed an algorithm based on online mirror descent with a self-concordant barrier regularization and an increasing learning rate schedule.
result Achieved O(K)O(\sqrt{K}) regret for the online Markov Decision Process with KK episodes.

We present novel empirical observations regarding how stochastic gradient descent (SGD) navigates the loss landscape of over-parametrized deep neural networks (DNNs). These observations expose the qualitatively different roles of learning rate and batch-size in DNN optimization and generalization. Specifically we study…

2018-02-24abs ↗pdf ↗

Unified analysis of online optimization with self-concordant barriers, improving regret bounds.

problem Online convex optimization with specific loss functions.
method Online mirror descent with self-concordant barriers and logarithmic loss.
result Improved regret bounds for online portfolio selection and quantum state learning.

Paper explores limits of high-order clustering with planted structures.

problem Statistical and computational limits of high-order clustering with planted structures.
method Developed methods for detection and recovery of clusters, identified signal-to-noise ratio boundaries.
result Sharp boundaries of signal-to-noise ratio for statistical and computational feasibility.

Combines RL and BF for risk-managed portfolio optimization.

problem Risk management in RL-based portfolio optimization under high volatility.
method Integrates reinforcement learning with barrier functions for dynamic risk control.
result Demonstrates superior performance in real-world data compared to RL-only approaches.

Statistical-computational gap found in aligning multiple Gaussian graphs.

problem Aligning multiple Gaussian graphs with unknown signals.
method Generalized informational threshold and computational barrier analysis.
result Existence of a statistical-computational gap in multiple Gaussian graph alignment.

We show how spectral filters can improve the convergence of numerical schemes which use discrete Hilbert transforms based on a sinc function expansion, and thus ultimately on the fast Fourier transform. This is relevant, for example, for the computation of fluctuation identities, which give the distribution of the maxi…

2017-06-29abs ↗pdf ↗

The paper calculates prices for multi-step barrier options under the Black-Scholes model.

problem Calculating prices for multi-step barrier options with varying barriers and time steps.
method Derives a general, explicit expression for option prices using the Black-Scholes model and a multi-step reflection principle.
result Derives a multi-step reflection principle that generalizes the reflection principle of Brownian motion.

We study proper losses for discrete generative models without knowing the target distribution.

problem Evaluating generative models in the discrete setting without direct access to the target distribution.
method Define and construct black-box proper losses using statistical estimation theory.
result Black-box proper losses must be of polynomial form and involve more samples than the polynomial degree.

Two impossibility theorems show formal alignment certification is impossible for AI systems.

problem Formal certification of AI alignment over open-ended domains is impossible.
method Two independent impossibility theorems: Semantic and Statistical barriers.
result No procedure can simultaneously satisfy soundness, completeness, and tractability.

New findings on community recovery in SBM with many communities.

problem Determining community recovery conditions in SBM with more than sqrt(n) communities.
method Constructing motifs and counting them to prove community recovery above the proposed threshold.
result Proving community recovery above the proposed threshold in SBM with K >= sqrt(n) communities.

Analytic networks with bounded coefficients can't outperform polynomial approximations.

problem Approximation limits of neural networks with analytic activation functions under coefficient constraints.
method Deterministic analysis using comparison argument and Bernstein-type estimates.
result Networks with analytic activation functions and controlled coefficients cannot outperform classical polynomial approximation rates on non-analytic targets.

A time-dependent double-barrier option is a derivative security that delivers the terminal value φ(ST)φ(S_T) at expiry TT if neither of the continuous time-dependent barriers $b_\pm:[0,T]\to \RR_+$ have been hit during the time interval [0,T][0,T]. Using a probabilistic approach we obtain a decomposition of the barrier opti…

2008-09-10abs ↗pdf ↗

We discuss the pricing methodology for Bonus Certificates and Barrier Reverse-Convertible Structured Products. Pricing for a European barrier condition is straightforward for products of both types and depends on an efficient interpolation of observed market option pricing. Pricing products We discuss the pricing metho…

2016-07-31abs ↗pdf ↗