Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

3.8%7.6%11.4%15.2% · Mar 199719922001200920172026
48 results for staircase mechanisms

Optimal DP mechanisms for vector queries are found to be staircase distributions.

problem Designing optimal additive mechanisms for vector-valued queries under differential privacy.
method Reduction to radially symmetric distributions and convex rearrangement theory.
result Staircase mechanisms are optimal for any norm and cost function.

The straight-line flow on almost every staircase and on almost every square tiled staircase is recurrent. For almost every square tiled staircase the set of periodic orbits is dense in the phase space.

2010-05-03abs ↗pdf ↗

The staircase property aids deep learning by guiding hierarchical feature learning.

problem Understanding how hierarchical structure influences deep learning performance.
method Defined and proved the staircase property for Boolean hypercube functions, and showed its learnability by layerwise stochastic coordinate descent.
result Staircase functions can be learned in polynomial time using layerwise stochastic coordinate descent on regular neural networks.

Efficient algorithms find optimal monotone transforms for calibration under strictly convex losses.

problem Calibrating estimations to improve performance with monotone transforms.
method Proposed linear-time and space algorithm for finding optimal monotone transforms for specific loss functions. Also proposed an anytime algorithm with linear space and pseudo-linearithmic time complexity.
result Optimal monotone transforms are unique and can be found efficiently for various strictly convex loss functions.

Neural networks outperform kernels by learning features better.

problem Current theories of feature learning do not adequately assess feature quality.
method Introduced feature quality metric and examined existing theories empirically.
result Current theories of feature learning do not provide a sufficient foundation for neural network generalization.

Study on connection points on double regular polygons, providing coordinates and proving non-connection points.

problem Identifying connection points on double regular polygons.
method Examined coordinates in trace field, provided constructive proof for prime nn.
result For n=7n=7, conjectured all remaining points are connection points; for n7n \geq 7 prime, provided explicit separatrix.

Paper introduces RPWithPrior for efficient label differential privacy in regression.

problem Protecting user privacy in regression tasks with minimal accuracy loss.
method Modeling responses as continuous random variables, avoiding discretization; estimating optimal intervals for randomized responses.
result RPWithPrior algorithm guarantees ε-label differential privacy and outperforms existing methods.

What are the possible shapes of various things and why? For instance, when a closed wire or a frame is dipped into a soap solution and is raised up from the solution, the surface spanning the wire is a soap film. What are the possible shapes of soap films and why? Or, for instance, why is DNA like a double spiral stair…

2002-08-23abs ↗pdf ↗

We investigate the random dynamics of rational maps on the Riemann sphere and the dynamics of semigroups of rational maps on the Riemann sphere. We show that regarding random complex dynamics of polynomials, in most cases, the chaos of the averaged system disappears, due to the cooperation of the generators. We investi…

2008-12-24abs ↗pdf ↗

Minimal surfaces with uniform curvature (or area) bounds have been well understood and the regularity theory is complete, yet essentially nothing was known without such bounds. We discuss here the theory of embedded (i.e., without self-intersections) minimal surfaces in Euclidean 3-space without a priori bounds. The st…

2005-11-30abs ↗pdf ↗

This paper develops a cohomological hierarchy for bistable visual paradoxes.

problem Understanding the hierarchy of visual paradoxes built from bistable elements.
method Develops a cohomological hierarchy using Z2\mathbb{Z}_2 coefficients and a discrete Stokes theorem.
result Reveals a hierarchy of paradox classes from H0H^0 through H2H^2, refined at each degree by the relative/absolute distinction.

Greedy training of recursive partitioning estimators faces a computational barrier when the true function doesn't satisfy a specific property.

problem Computational inefficiency of greedy training for recursive partitioning estimators.
method Analysis of greedy training for sparse regression functions over binary features.
result Greedy training requires exponential samples when the true function doesn't satisfy a specific property (MSP), but only logarithmic samples when it does.

AGF explains feature learning in neural networks through alternating steps.

problem Understanding what features neural networks learn and how they learn them.
method AGF is an algorithmic framework that approximates the dynamics of feature learning in two-layer networks.
result AGF provides a unified framework to understand feature learning in neural networks, matching experimental results across various architectures.

New property helps SGD learn sparse functions efficiently in neural networks.

problem Characterizing functions learnable by SGD in non-linear neural networks.
method Mean-field analysis, hierarchical merged-staircase property, dimension-free dynamics approximation.
result Merged-staircase property is necessary and nearly sufficient for SGD learnability.

A Euclidean minimal torus with planar ends gives rise to an immersed Willmore torus in the conformal 3--sphere S3=R3{}S^3=\R^3\cup \{\infty\}. The class of Willmore tori obtained this way is given a spectral theoretic characterization as the class of Willmore tori with reducible spectral curve. A spectral curve of this type…

2012-12-20abs ↗pdf ↗

Data repetition improves SGD's learning of high-dimensional functions.

problem Learning pertinent features in multi-index models with high-dimensional noisy data.
method Investigation of two-layer shallow neural networks trained with gradient-based algorithms, focusing on data repetition.
result Data repetition significantly improves the computational efficiency of SGD, learning all directions with at most O(dlogd)O(d \log d) steps.

For a Legendrian knot L in R^3 with a chosen Morse complex sequence (MCS) we construct a differential graded algebra (DGA) whose differential counts "chord paths" in the front projection of L. The definition of the DGA is motivated by considering Morse-theoretic data from generating families. In particular, when the MC…

2011-06-16abs ↗pdf ↗

Let X be a proper CAT(0) cube complex admitting a proper cocompact action by a group G. We give three conditions on the action, any one of which ensures that X has a factor system in the sense of [BHS14]. We also prove that one of these conditions is necessary. This combines with results of Behrstock--Hagen--Sisto to s…

2016-09-05abs ↗pdf ↗

SGD learns neural networks with a complexity measure called leap.

problem Time complexity of SGD learning on neural networks.
method Introduced a complexity measure called leap, proved conjecture for Gaussian data, and showed saddle-to-saddle dynamics.
result Proved a conjecture about the time complexity of learning functions with low-dimensional support.

Study reveals efficient recovery of multi-modal signals via Bayesian methods and sequential learning.

problem Recovering multiple high-dimensional signals from correlated modalities.
method Bayesian Approximate Message Passing and Sequential Curriculum Learning.
result Sequential learning strategy optimally recovers weak signals in multi-modal settings.

This work connects Cramér distance to QR-DQN for DRL.

problem Improving performance in DRL by capturing full distribution of returns.
method Proves Cramér distance's equivalence to 1-Wasserstein distance and proposes a low-complexity algorithm to compute Cramér distance.
result Cramér distance and quantile regression losses yield collinear gradients under non-crossing constraints.

Neural backdoor attack is emerging as a severe security threat to deep learning, while the capability of existing defense methods is limited, especially for complex backdoor triggers. In the work, we explore the space formed by the pixel values of all possible backdoor triggers. An original trigger used by an attacker …

2019-10-10abs ↗pdf ↗

In this work, we consider the use of model-driven deep learning techniques for massive multiple-input multiple-output (MIMO) detection. Compared with conventional MIMO systems, massive MIMO promises improved spectral efficiency, coverage and range. Unfortunately, these benefits are coming at the cost of significantly i…

2019-06-10abs ↗pdf ↗

Two-layer networks learn faster with batch reuse, overcoming information and leap exponents.

problem Limitations of gradient flow and single-pass GD in learning multi-index target functions.
method Multi-pass gradient descent that reuses batches, analyzed using Dynamical Mean-Field Theory.
result Two-time-step overlap with target subspace for non-staircase functions, overcoming information and leap exponents.

We investigate the random dynamics of polynomial maps on the Riemann sphere and the dynamics of semigroups of polynomial maps on the Riemann sphere. In particular, the dynamics of a semigroup GG of polynomials whose planar postcritical set is bounded and the associated random dynamics are studied. In general, the Juli…

2011-04-19abs ↗pdf ↗

A solution for the Weinstein's Problem in the general framework of generalized Lie algebroids is the target of this paper. We present the mechanical systems called by use, mechanical (?; ?)-systems, Lagrange mechanical (?; ?)-systems or Finsler mechanical (?; ?)-systems and we develop their geometries. We obtain the ca…

2011-08-14abs ↗pdf ↗

A new description, different by the classical theory of Hamiltonian Mechanics, in the general framework of generalized Lie algebroids is presented. In the particular case of Lie algebroids, new and important results are obtained. We present the \emph{dual mechanical systems} called by use, \emph{dual mechanical}$(ρ,η) …

2011-08-25abs ↗pdf ↗

This paper assesses Gaussian and Exponential mechanisms for certifying adversarial robustness.

problem Certifying adversarial robustness using randomized smoothing mechanisms.
method Proposes a generic framework to assess the appropriateness of randomized smoothing mechanisms.
result Gaussian mechanism is an appropriate option for certifying both 2\ell_2-norm and \ell_\infty-norm robustness.

Expands differential privacy mechanisms to include the Generalized Gaussian mechanism for improved private machine learning.

problem Improving privacy in machine learning algorithms while maintaining utility.
method Introduces and analyzes the Generalized Gaussian (GG) mechanism for differential privacy.
result The GG mechanism provides better performance than the Laplace and Gaussian mechanisms across various values of β.

Differential privacy mechanism design has traditionally been tailored for a scalar-valued query function. Although many mechanisms such as the Laplace and Gaussian mechanisms can be extended to a matrix-valued query function by adding i.i.d. noise to each element of the matrix, this method is often suboptimal as it for…

2018-01-02abs ↗pdf ↗

New approach identifies latent properties from mechanisms, not just data.

problem Identifying latent properties from data generating processes.
method Equivariance perspective on identifiable representation learning.
result Identification of latent properties is possible up to shared equivariances in known mechanisms.

New RL approach learns dynamic VCG mechanisms in unknown MDP environments.

problem Learning dynamic VCG mechanisms in unknown MDP environments.
method Reward-free online RL for exploration, combined with function approximation.
result Regret bound of O~(T2/3)\tilde{\mathcal{O}}(T^{2/3}) for dynamic VCG mechanism learning.