Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

149299448597 · Jun 202019922001200920172026
48 results for automatic computation

Automatic differentiation---the mechanical transformation of numeric computer programs to calculate derivatives efficiently and accurately---dates to the origin of the computer age. Reverse mode automatic differentiation both antedates and generalizes the method of backwards propagation of errors used in machine learni…

2014-04-28abs ↗pdf ↗

agtboost speeds up gradient tree boosting with automatic complexity adjustment.

problem Speeding up and simplifying gradient tree boosting computations.
method Adaptive gradient tree boosting with automatic complexity adjustment and feature importance.
result Significant decrease in computation time and simplification of model complexity.

Super-efficient automatic differentiation outperforms analytic methods in min-min optimization.

problem Optimizing functions defined as a minimum using iterative algorithms.
method Comparing automatic differentiation to analytic gradient estimation methods.
result Automatic differentiation yields an asymptotic error close to the square of the optimization error, demonstrating super-efficiency.

A method makes particle filters differentiable without altering their forward pass.

problem Compatibility issues between particle filters and automatic differentiation.
method Introduces a correction to particle weights using the stop-gradient operator.
result Automatic differentiation produces good estimators for gradients and second-order derivatives.

We use AD to compute gradients for complex functionals in stochastic model calibration.

problem Computing gradients for functions involving expectations in stochastic models.
method Automatic Adjoint Differentiation and parallelization.
result Faster and easier to implement approaches for gradient computation.

RAD estimates gradients with less memory, faster than small batch sizes.

problem Training deep models with stochastic gradient descent requires exact gradients, but they are not needed.
method Developed a framework for randomized automatic differentiation (RAD) to compute unbiased gradient estimates with reduced memory.
result RAD converges in fewer iterations than using a small batch size for feedforward networks and similar number for recurrent networks.

CoLA automates efficient numerical linear algebra for complex matrix structures.

problem Efficiently solving large-scale linear algebra problems with complex matrix structures.
method Combining linear operator abstraction with compositional dispatch rules.
result Automatic and efficient numerical algorithms for various linear algebra operations.

Bayesian TNKMs automatically infer model complexity and feature relevance.

problem Manual tuning of TN rank and feature dimensions is error-prone and computationally expensive.
method Bayesian approach with hierarchical priors on TN factors for automatic rank and feature selection.
result Superior performance in prediction accuracy, uncertainty quantification, interpretability, and scalability.

The theory of automatic groups is developed, including properties and practical algorithms.

problem Proving and understanding automatic groups and their properties.
method Historical introduction, definitions, basic properties, proofs for specific groups, software development, practical algorithms, and open problems.
result Automatic, biautomatic, and combable groups are defined and their properties are derived.

Storchastic improves stochastic AD for complex models in RL and VI.

problem Handling intractable expectations in RL and VI.
method Introduces Storchastic, a framework for AD of stochastic computation graphs with various gradient estimation methods.
result Provable unbiasedness and variance reduction for higher-order gradients.

GShard enables scaling of large neural networks with automatic sharding and lightweight APIs.

problem Scaling neural networks to handle vast training data and compute efficiently.
method GShard uses lightweight annotation APIs and XLA compiler extensions for parallel computation.
result GShard successfully trained a 600 billion parameter model on 2048 TPUs in 4 days.

This work integrates differentiation and integration in Physics-Informed Neural Networks.

problem Solving integro-differential equations and computing integral transforms.
method Augmenting Physics-Informed Neural Networks with automatic integration.
result Solving complex integral transforms and integro-differential equations.

AutoFIS automatically selects important feature interactions for CTR prediction models.

problem Manual feature interaction design is inefficient and prone to noise.
method Two-stage algorithm: search stage relaxes feature interactions to continuous parameters, re-train stage refines model performance.
result AutoFIS significantly improves CTR and CVR of FM-based models.

A new method for automatically aligning and clustering time series data.

problem Challenges in aligning and clustering time series data, especially without a template signal.
method TROUT (Temporal Registration using Optimal Unitary Transformations) method based on a novel dissimilarity measure.
result TROUT outperforms competitors in clustering time series data.

The paper proposes a method to compute higher infinitesimals in numerical and symbolic analysis.

problem Computing higher-order derivatives with higher infinitesimals.
method Automatic differentiation in terms of C-infinity rings and Weil algebras.
result A unifying theoretical framework for multivariate higher-order derivatives.

Derivatives, mostly in the form of gradients and Hessians, are ubiquitous in machine learning. Automatic differentiation (AD), also called algorithmic differentiation or simply "autodiff", is a family of techniques similar to but more general than backpropagation for efficiently and accurately evaluating derivatives of…

2015-02-20abs ↗pdf ↗

We prove a computable version of de Finetti's theorem on exchangeable sequences of real random variables. As a consequence, exchangeable stochastic processes expressed in probabilistic functional programming languages can be automatically rewritten as procedures that do not modify non-local state. Along the way, we pro…

2009-12-06abs ↗pdf ↗

Learn to automatically plug domain-specific modules into a common network.

problem Learning inflexibility and computational intensiveness in multi-domain learning.
method Neural Architecture Search (NAS) for data-driven adapter plugging and structure design.
result NAS-driven MDL model achieves comparable performance to existing approaches.

NARD extends ARD for linear models, promoting sparsity and correlation structure.

problem Sparse relationships between inputs and outputs, capturing correlation structure.
method Matrix normal prior with sparsity-inducing parameter, iterative updates, sequential evaluation, and surrogate function approximation.
result Significant computational efficiency improvements with comparable performance.

Simplifies efficient estimation via automatic differentiation and probabilistic programming.

problem Constructing efficient estimators for complex statistical models.
method Automatic differentiation applied to statistical functionals, avoiding the need to derive efficient influence functions.
result Users can generate efficient estimators with minimal code, simplifying the process for non-experts.

Bayesian network structures are usually built using only the data and starting from an empty network or from a naive Bayes structure. Very often, in some domains, like medicine, a prior structure knowledge is already known. This structure can be automatically or manually refined in search for better performance models.…

2014-06-10abs ↗pdf ↗

Systematic and multifactor risk models are revisited via methods which were already successfully developed in signal processing and in automatic control. The results, which bypass the usual criticisms on those risk modeling, are illustrated by several successful computer experiments.

2013-12-18abs ↗pdf ↗

AFR simplifies reducing reliance on spurious features, improving model performance.

problem Reducing reliance on spurious features for out-of-distribution generalization.
method Automatic Feature Reweighting (AFR) updates the model with a weighted loss.
result AFR improves model performance on benchmarks with minimal compute.

HTE improves PINNs for high-dimensional, high-order PDEs by reducing computational cost and memory usage.

problem Challenges in solving high-dimensional, high-order PDEs with PINNs due to computational cost and memory constraints.
method Introduces Hutchinson Trace Estimation (HTE) to transform Hessian matrix calculations into Hessian vector products (HVP), reducing computational cost and memory usage.
result HTE significantly reduces memory consumption and computational cost, enabling faster and more efficient solution of high-dimensional and high-order PDEs.

Automatic conflict detection has grown in relevance with the advent of body-worn technology, but existing metrics such as turn-taking and overlap are poor indicators of conflict in police-public interactions. Moreover, standard techniques to compute them fall short when applied to such diversified and noisy contexts. W…

2017-11-14abs ↗pdf ↗

ViViT efficiently computes curvature for deep networks without approximations.

problem Efficiently computing curvature for deep networks without approximations.
method Leverages the GGN's low-rank structure without further approximations.
result ViViT allows for efficient computation of eigenvalues, eigenvectors, and directional derivatives.

Interactive applications incorporating high-data rate sensing and computer vision are becoming possible due to novel runtime systems and the use of parallel computation resources. To allow interactive use, such applications require careful tuning of multiple application parameters to meet required fidelity and latency …

2012-03-15abs ↗pdf ↗