Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

87174261348 · Jun 202019922001200920172026
48 results for acceleration measurements

Paper discovers structural dynamics equations from only acceleration data.

problem Discovering equations from only acceleration measurements in structural dynamics.
method Library-based approach with Approximate Bayesian Computation (ABC) prioritizing parsimonious models.
result Efficacy demonstrated in four structural dynamics examples, including linear and nonlinear systems.

We present a selective sampling method designed to accelerate the training of deep neural networks. To this end, we introduce a novel measurement, the minimal margin score (MMS), which measures the minimal amount of displacement an input should take until its predicted classification is switched. For multi-class linear…

2019-11-16abs ↗pdf ↗

We formulate gradient-based Markov chain Monte Carlo (MCMC) sampling as optimization on the space of probability measures, with Kullback-Leibler (KL) divergence as the objective functional. We show that an underdamped form of the Langevin algorithm performs accelerated gradient descent in this metric. To characterize t…

2019-02-04abs ↗pdf ↗

Improved reSGLD accelerates convergence in non-convex learning problems.

problem Inefficient swaps due to noisy energy estimators in reSGLD.
method Variance reduction for noisy energy estimators, theoretical analysis, and numerical experiments.
result Exponential acceleration in convergence for non-convex learning problems.

Accelerating Magnetic Resonance Imaging (MRI) by taking fewer measurements has the potential to reduce medical costs, minimize stress to patients and make MRI possible in applications where it is currently prohibitively slow or expensive. We introduce the fastMRI dataset, a large-scale collection of both raw MR measure…

2018-11-21abs ↗pdf ↗

Paper addresses unsupervised learning from incomplete measurements in inverse problems.

problem Learning from incomplete measurements is challenging in inverse problems.
method Use multiple measurement operators to overcome nullspace issues; propose a novel unsupervised learning loss.
result Presented necessary and sufficient conditions for successful unsupervised learning.

Novel geometry-informed irreversible perturbation accelerates Langevin dynamics convergence.

problem Accelerating convergence of Langevin dynamics for Bayesian computation.
method Geometry-informed irreversible perturbation of Riemannian manifold Langevin dynamics.
result Improves estimation performance over irreversible perturbations that ignore geometry.

Preconditioned non-convex gradient descent improves noisy matrix estimation.

problem Estimating low-rank matrices from noisy measurements.
method Preconditioned non-convex gradient descent for noisy measurements.
result Preconditioned method converges to minimax optimal estimate at a linear rate.

New algorithm PRACTISE accelerates networks with tiny sets, reducing latency by 22%.

problem Accelerating networks with tiny training sets to improve performance and privacy.
method Proposes a new algorithm PRACTISE based on finetune convexity hypothesis and feature mimicking.
result PRACTISE outperforms previous methods by reducing latency by 22% on ImageNet-1k.

Improved SHB method for faster convergence on strongly-convex quadratics.

problem Understanding and improving the theoretical and practical advantages of SHB.
method Noise-adaptive multi-stage algorithm for SHB with accelerated convergence.
result SHB can achieve accelerated convergence with larger mini-batch sizes.

Study adapts liquidity model to equity auctions, revealing accelerated event rates and reduced price impact.

problem Understanding and predicting price dynamics in equity auctions.
method Adapted latent/revealed order book framework to equity auctions, measuring order submissions, cancellations, and diffusion rates.
result Equity auctions exhibit accelerated event rates leading to reduced price impact and decreased volatility.

Transfer Learning (TL) has shown great potential to accelerate Reinforcement Learning (RL) by leveraging prior knowledge from past learned policies of relevant tasks. Existing transfer approaches either explicitly computes the similarity between tasks or select appropriate source policies to provide guided explorations…

2020-02-19abs ↗pdf ↗

Optical scatterometry is a method to measure the size and shape of periodic micro- or nanostructures on surfaces. For this purpose the geometry parameters of the structures are obtained by reproducing experimental measurement results through numerical simulations. We compare the performance of Bayesian optimization to …

2019-03-28abs ↗pdf ↗

GADD accelerates uniform-rate discrete diffusion models by 2 orders of magnitude.

problem Slow sampling in uniform-rate discrete diffusion models.
method Gibbs-based corrector (GADD) that constructs Gibbs posterior likelihoods directly from the concrete score function.
result Achieves an overall sampling complexity of O(polylog(ε1))\mathcal{O}(\mathrm{polylog} (\varepsilon^{-1})).

Batch normalization has become ubiquitous in many state-of-the-art nets. It accelerates training and yields good performance results. However, there are various other alternatives to normalization, e.g. orthonormalization. The objective of this paper is to explore the possible alternatives to channel normalization with…

2018-12-07abs ↗pdf ↗

DRAG decreases regularization to accelerate semi-discrete OT convergence.

problem Mitigating bias in semi-discrete OT problems with entropic regularization.
method DRAG: Decreasing Regularization Averaged Gradient, a stochastic gradient descent algorithm.
result DRAG achieves unbiased O(1/t)\mathcal{O}(1/t) sample and iteration complexity for OT cost and potential estimation, and O(1/t)\mathcal{O}(1/\sqrt{t}) rate for OT map.

Accelerates pulsar light curve inference with learned representations and optimization.

problem Computational expense of Markov chain Monte Carlo methods for posterior inference.
method Combining U-Net latent representations with local simulator-guided optimization.
result 120x reduction in inference time (24 hours to 12 minutes) with accuracy preserved.

New algorithms find near-stationary points in convex optimization.

problem Finding near-stationary points in convex optimization.
method Memory-saving variant of OGM-G, accelerated SVRG, adaptively regularized accelerated SVRG.
result Schemes achieve fast rates for minimizing gradient norm and function value.

PF-LaCG removes the need for knowing smoothness and strong convexity parameters for locally accelerated CG.

problem Locally accelerated CG requires knowledge of smoothness and strong convexity parameters.
method Parameter-Free Locally Accelerated CG (PF-LaCG) algorithm.
result PF-LaCG achieves local acceleration without requiring knowledge of smoothness and strong convexity parameters.

Unified approach for learning quantum operations from measurements.

problem Accurate reconstruction of unknown quantum operations from noisy measurements.
method Matrix sensing techniques, randomized measurement design, blockwise measurement design, alternating least squares (ALS).
result The proposed method provides theoretical guarantees for the identifiability and recovery of low-rank superoperators in the presence of noise.

Continuized Nesterov acceleration accelerates stochastic gradient descent and gossip algorithms.

problem Improving the convergence rate of stochastic gradient descent and gossip algorithms.
method Introducing a continuized variant of Nesterov acceleration, which mixes variables continuously and takes gradient steps at random times.
result The continuized Nesterov acceleration achieves convergence rates similar to Nesterov's original acceleration but with random parameters.

Improves energy efficiency of neuromorphic hardware by optimizing memory organization and encoding schemes.

problem Energy inefficiency in neuromorphic hardware, especially in digital accelerators.
method Synthesized controller and memory for different encoding schemes, introduced functional encoding for structured connectivity.
result Functional encoding offers a 58% reduction in energy for weight updates in convolutional layers.

Accelerated gradient methods play a central role in optimization, achieving optimal rates in many settings. While many generalizations and extensions of Nesterov's original acceleration method have been proposed, it is not yet clear what is the natural scope of the acceleration concept. In this paper, we study accelera…

2016-03-14abs ↗pdf ↗

Develops accelerated methods for optimization using low-dimensional projected-gradient information.

problem Optimization with low-dimensional projected-gradient information and Nesterov acceleration.
method Randomized-subspace Nesterov accelerated gradient methods for smooth convex and strongly convex optimization.
result Established accelerated oracle-complexity guarantees and unified basis for comparing sketch families.