Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

1223 · Apr 202619922001200920182026
48 results for Lars Onsager

Schrödinger and Onsager's ideas linked in nonequilibrium thermodynamics.

problem Linking Schrödinger's variational problem with Onsager's nonequilibrium statistical mechanics.
method Analyzing the historical context and comparing the two approaches.
result Schrödinger's ideas have not yet been fully integrated into the classical context of Onsager's work.

New framework for inference with LAR, explaining variable contributions and providing stopping rules.

problem LAR's lack of well-understood termination point and basic behavioral properties.
method Developed a novel framework for inference with LAR, providing new mathematical properties and stopping rules.
result LAR estimates of non-zero population correlations have independent normal distributions for inference, and zero-valued correlations have a non-normal joint distribution.

Parallelizes LARS for high-dimensional data with speedups and accuracy trade-offs.

problem Fitting linear regression models to high-dimensional data efficiently.
method Two parallel and communication avoiding versions of LARS: bLARS and Tournament-bLARS.
result Speedups up to 4x compared to LARS, with trade-offs in solution quality.

Standard optimizers perform as well as LARS and LAMB at large batch sizes.

problem Comparing optimizers for neural network training at large batch sizes.
method Used standard optimizers like Nesterov momentum and Adam to match or exceed LARS and LAMB results.
result Standard optimizers can match or exceed LARS and LAMB at large batch sizes.

Extends Onsager's conjecture to Besov spaces on manifolds with boundary.

problem Proving Onsager's conjecture on Riemannian manifolds with boundary.
method Constructing Hodge-Neumann heat kernel, obtaining off-diagonal decay and local Bernstein estimates.
result Extends Onsager's conjecture to Besov spaces B^3,V13\widehat{B}_{3,V}^{\frac{1}{3}}.

We propose Learned Accept/Reject Sampling (LARS), a method for constructing richer priors using rejection sampling with a learned acceptance function. This work is motivated by recent analyses of the VAE objective, which pointed out that commonly used simple priors can lead to underfitting. As the distribution induced …

2018-10-26abs ↗pdf ↗

Proposes LARS and LASSO methods for generalized linear models.

problem Sparse estimation for generalized linear models.
method Transforms statistical model manifold into tangent space, applies LARS and LASSO algorithms.
result Efficient and performs well, similar to l1l_1-regularized maximum likelihood estimation.

A new principle minimizes residual and introduces momentum to improve PDE solution dynamics.

problem Ill-conditioning in Dirac-Frenkel residual minimization leads to non-unique parameter dynamics.
method Introduces a history variable (momentum) to select better-conditioned parameter velocities, preserving residual minimization while promoting smooth parameter evolutions.
result The approach leads to increased robustness in singular and near-singular PDE solution regimes.

Rate GENERIC extends thermodynamics principles to non-equilibrium systems.

problem Understanding non-equilibrium thermodynamics and its relation to equilibrium thermodynamics.
method Developed a geometrical framework for rate GENERIC, extending Onsager's variational principle.
result Rate GENERIC structure provides a new perspective on thermodynamics in non-equilibrium systems.

Develops methods to find most probable paths on complex manifolds.

problem Identifying optimal paths for manifold-valued processes, especially those with non-trivial structures.
method Constructs a general approach to defining and identifying most probable paths by measuring the Onsager-Machlup function on the anti-development of such processes.
result Derives explicit equations for development most probable paths that encompass various manifold-valued processes.

Continuous phase transitions identified in Doi-Onsager, noisy transformer, and Hegselmann-Krause models.

problem Phase transitions in multimodal models and their properties.
method Sharp coercivity estimate and constrained Lebedev--Milin inequality.
result Continuous phase transitions at critical coupling strengths for Doi-Onsager, noisy transformer, and Hegselmann-Krause models.

Deep learning has gained great popularity due to its widespread success on many inference problems. We consider the application of deep learning to the sparse linear inverse problem encountered in compressive sensing, where one seeks to recover a sparse signal from a small number of noisy linear measurements. In this p…

2016-07-20abs ↗pdf ↗

The paper explores geometric calculations on probability manifolds derived from master equations.

problem Understanding geometric properties of probability manifolds from master equations.
method Deriving geometric quantities like Levi-Civita connection, gradient, Hessian, parallel transport, and curvatures on probability manifolds.
result Calculation of geometric quantities in probability manifolds, including curvatures and connections.

Paper presents a novel approach to predict volatility using robust least squares method.

problem Challenges in predicting volatility due to irregularities, high fluctuations, and noise in financial time series.
method Robust least squares method applied in two approaches: with and without least absolute residuals (LAR).
result Robust least squares method with LAR approach yields better results for volatility and its components.

Study of most probable paths for anisotropic Brownian motions on manifolds.

problem Characterizing paths of Brownian motions with anisotropic diffusion on manifolds.
method Using stochastic development and fiber bundle of linear frames, the study provides a comprehensive characterization of most probable paths.
result Explicit equations and integration methods for most probable paths on different geometries, including constant curvature surfaces.

New LAMB optimizer reduces BERT training time from 3 days to 76 minutes.

problem Training large deep neural networks on massive datasets is computationally challenging.
method Developed a new layerwise adaptive large batch optimization technique called LAMB.
result LAMB reduces BERT training time from 3 days to 76 minutes using very large batch sizes.

The paper studies geometric properties of hydrodynamical density manifolds.

problem Understanding the geometry of hydrodynamical density manifolds.
method Formulating connections, gradients, Hessians, parallel transports, and curvatures on these manifolds.
result Closed-form formulas for sectional curvatures in one-dimensional density manifolds.

Develops a machine learning framework for computing most probable paths in stochastic systems.

problem Computing the most probable paths in stochastic dynamical systems.
method Reformulates the boundary value problem of Hamiltonian systems and uses a neural network to solve the Euler-Lagrange equation for the Onsager-Machlup action functional.
result Demonstrates the efficacy and accuracy of the machine learning approach in computing most probable paths for stochastic systems with various types of noise.

Introduces optimization geometrodynamics for dynamic geometric optimization.

problem Gradient-based optimization methods struggle with changing geometric constraints.
method Optimization geometrodynamics separates invariant and improvable geometric mismatches.
result Dynamic geometric complexity measures the minimum geometric cost to reduce optimization difficulty.

New method reduces memory usage for high-dimensional variable selection.

problem Scalability issues in high-dimensional variable selection, especially in genomics.
method Adaptive sampling of null features to eliminate dummy matrix materialization.
result Reduces memory and runtime by several orders of magnitude while preserving FDR control.

We present a supervised-learning algorithm from graph data (a set of graphs) for arbitrary twice-differentiable loss functions and sparse linear models over all possible subgraph features. To date, it has been shown that under all possible subgraph features, several types of sparse learning, such as Adaboost, LPBoost, …

2014-03-20abs ↗pdf ↗

This study compares different thermodynamic structure-informed neural networks for solving differential equations.

problem Improving the accuracy and physical consistency of neural network solutions to differential equations.
method Comprehensive evaluation of various thermodynamic formulations in physics-informed neural networks.
result Newtonian-residual-based PINNs fail to reliably recover physical quantities, while structure-preserving formulations enhance accuracy and robustness.

Study proposes a new early-warning framework for high-dimensional complex systems.

problem Predicting critical transitions in complex systems like epileptic seizures.
method Integrates manifold learning with stochastic dynamical system modeling, using Schrödinger bridge theory.
result Demonstrates higher sensitivity and robustness in epilepsy prediction.

In this paper, we consider the problem of "hyper-sparse aggregation". Namely, given a dictionary F={f1,...,fM}F = \{f_1, ..., f_M \} of functions, we look for an optimal aggregation algorithm that writes f~=j=1Mθjfj\tilde f = \sum_{j=1}^M θ_j f_j with as many zero coefficients θjθ_j as possible. This problem is of particular interest when…

2009-12-08abs ↗pdf ↗

New method for fast volatility estimation robust to change points.

problem Robust high-frequency volatility estimation with change points.
method ℓ1-regularized power variation estimators using LARS for sparse estimation and dynamic programming for change point refinement.
result Minimax rates achieved for volatility estimators, providing accurate and smooth forecasts.

A denoising algorithm seeks to remove noise, errors, or perturbations from a signal. Extensive research has been devoted to this arena over the last several decades, and as a result, today's denoisers can effectively remove large amounts of additive white Gaussian noise. A compressed sensing (CS) reconstruction algorit…

2014-06-16abs ↗pdf ↗

Develops a distributed least squares approximation method for regression problems.

problem Solving large-scale regression problems on distributed systems.
method Approximates local objective functions using a local quadratic form and combines estimators by weighted average.
result Statistically efficient combined estimator with one round of communication.

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias especially at a sparse representation. There have been several studies for improving this problem such…

2018-08-22abs ↗pdf ↗