Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4080120160 · Jun 202019922001200920172026
48 results for exponential advancement

Space exploration technology advances exponentially, consistent with Moore's and Wright's laws.

problem Predicting the advancement of space exploration technology.
method Analysis of Moore's and Wright's laws applied to space exploration technology.
result Spacecraft technology advances exponentially, consistent with Moore's and Wright's laws.

Enhanced kernel framework for advanced data forecasting.

problem Complex mechanical behaviors and timefrequency dynamics in aircraft systems.
method Frequency-aware surrogate modeling with SMT kernels, extending kernel types and incorporating derivatives.
result Improved accuracy in forecasting CO2 concentrations and airline passenger traffic.

Recent advances in deep learning have brought to the fore models that can make multiple computational steps in the service of completing a task; these are capable of describ- ing long-term dependencies in sequential data. Novel recurrent attention models over possibly large external memory modules constitute the core m…

2018-09-04abs ↗pdf ↗

Learning from graph-structured data is an important task in machine learning and artificial intelligence, for which Graph Neural Networks (GNNs) have shown great promise. Motivated by recent advances in geometric representation learning, we propose a novel GNN architecture for learning representations on Riemannian man…

2019-10-28abs ↗pdf ↗

BayesPy is an open-source Python software package for performing variational Bayesian inference. It is based on the variational message passing framework and supports conjugate exponential family models. By removing the tedious task of implementing the variational Bayesian update equations, the user can construct model…

2014-10-03abs ↗pdf ↗

Bayesian learning has been recently considered as an effective means of accounting for uncertainty in trained deep network parameters. This is of crucial importance when dealing with small or sparse training datasets. On the other hand, shallow models that compute weighted sums of their inputs, after passing them throu…

2018-02-10abs ↗pdf ↗

New research shows fixed-budget best-arm identification cannot match static oracle performance.

problem Fixed-budget best-arm identification's performance limitations.
method Analysis of various adaptive and static algorithms for best-arm identification.
result For any algorithm, there exists at least one instance where the error decay rate is at most \((1 + \frac{\log(K)}{8})^{-1}\) times that of the static oracle.

Hybrid model combines LSTM and ETS for mid-term electric load forecasting.

problem Mid-term electric load forecasting accuracy.
method Combines LSTM, ETS, and ensemble learning; uses dilated LSTM for long-term relationships.
result High performance and competitiveness compared to classical and machine learning models.

Many interesting real world domains involve reinforcement learning (RL) in partially observable environments. Efficient learning in such domains is important, but existing sample complexity bounds for partially observable RL are at least exponential in the episode length. We give, to our knowledge, the first partially …

2016-05-25abs ↗pdf ↗

Paper improves generalization bounds for noisy stochastic algorithms.

problem Improving generalization bounds for noisy stochastic algorithms.
method Introduces Exponential Family Langevin Dynamics (EFLD) and establishes data-dependent expected stability based generalization bounds.
result Sharp generalization bounds with O(1/n) sample dependence and gradient discrepancy.

Paper improves deep learning convergence rates for low-dimensional data.

problem Sub-optimal rates in deep learning due to unrealistic assumptions on intrinsic dimension.
method Introduced an entropic notion of intrinsic dimension for exponential families and demonstrated improved convergence rates.
result Test error scales as O~(n2β2β+dˉ2β(λ))\tilde{\mathcal{O}}\left(n^{-\frac{2β}{2β+ \bar{d}_{2β}(λ)}}\right), improving on best-known rates.

There is accumulating evidence in the literature that stability of learning algorithms is a key characteristic that permits a learning algorithm to generalize. Despite various insightful results in this direction, there seems to be an overlooked dichotomy in the type of stability-based generalization bounds we have in …

2019-03-12abs ↗pdf ↗

An online reinforcement learning algorithm is anytime if it does not need to know in advance the horizon T of the experiment. A well-known technique to obtain an anytime algorithm from any non-anytime algorithm is the "Doubling Trick". In the context of adversarial or stochastic multi-armed bandits, the performance of …

2018-03-19abs ↗pdf ↗

New framework compresses and recovers scientific data efficiently.

problem Efficiently managing and recovering from large scientific datasets.
method Grounded in learning exponential families, preserves uncertainty and supports trade-offs.
result Preserves physical features and quantities of interest in compressed representations.

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW optimization, we provide the first proof of convergence of a FW-type saddle point solv…

2016-10-25abs ↗pdf ↗

Advanced forecasting models outperform Holt-Winters and ARIMA for stock market data.

problem Forecasting stock market data with improved accuracy.
method Developed 24 two-parameter families of forecasting functions using a nonparametric approach.
result Our models outperform Holt-Winters and ARIMA in terms of lower sum of absolute errors and higher number of accurate forecasts.

Study uses ML and statistical models to analyze climate impacts of industrial growth.

problem Understanding and predicting environmental impacts of industrial activities.
method Comparative analysis of ML and statistical models on time series data.
result ML models outperform statistical models in predicting environmental impacts.

Improved private learning for Littlestone classes with a doubly-exponential mistake bound.

problem Private learning of Littlestone classes with approximate differential privacy constraints.
method Combines refined interpretation of irreducibility technique, improved sparse selection algorithm, and Exponential Mechanism.
result Achieved a mistake bound of \(\tilde{O}(d^{9.5} \cdot \log(T))\) for online learning of Littlestone classes.

Langevin Dynamics speeds up mixing time with manifold hypothesis and multi-scale approach.

problem Langevin Dynamics struggles in high dimensions and nonconvex landscapes.
method Utilizes manifold hypothesis to reduce mixing time and employs multi-scale approach to improve image generation quality.
result Mixing time depends on intrinsic dimension rather than ambient dimension, significantly reducing computational complexity.

New framework improves EM algorithm convergence under log-Sobolev inequality.

problem Improving convergence of the EM algorithm.
method Extending gradient flow techniques to EM algorithm, using free energy representation.
result Exponential convergence of EM algorithm under log-Sobolev inequality.

Gradient flow method solves for optimal transport starting distributions.

problem Finding the optimal starting distribution for a martingale in optimal transport.
method Following the gradient flow of the Bass functional's L2-lift.
result Gradient flow converges to a minimizer of the Bass functional.

NPE improves scalability and efficiency for ERGMs.

problem Scalability and efficiency issues in Bayesian ERGM estimation.
method Neural posterior estimation (NPE) for ERGMs using neural network density estimation.
result NPE provides more efficient and scalable inference for ERGMs.

New analysis explains pathology of deep Gaussian processes.

problem Pathology of deep Gaussian processes reduces learning capacities with increased layers.
method Study nonlinear dynamic systems corresponding to DGPs, derive recurrence relations.
result Provide tighter bounds and rate of convergence for dynamic systems.

Improved neural network approximates analytic and L^p functions efficiently.

problem Efficiently approximating analytic and L^p functions using neural networks.
method Three-dimensional ReLU network architecture for sawtooth functions, improving approximation rates.
result Substantially improved exponential approximation rates for analytic functions and general L^p functions.

We construct a large class of dynamical vacuum black hole spacetimes whose exterior geometry asymptotically settles down to a fixed Schwarzschild or Kerr metric. The construction proceeds by solving a backwards scattering problem for the Einstein vacuum equations with characteristic data prescribed on the event horizon…

2013-06-23abs ↗pdf ↗

Previous work has questioned the conditions under which the decision regions of a neural network are connected and further showed the implications of the corresponding theory to the problem of adversarial manipulation of classifiers. It has been proven that for a class of activation functions including leaky ReLU, neur…

2019-01-25abs ↗pdf ↗

MELO predicts electricity loads by adapting to shifts without external indicators.

problem Adapting to non-stationary prediction challenges in online settings.
method MELO combines multiple forgetting factors and aggregation rules to adaptively predict.
result MELO reduces RMSE by 34.7% compared to base predictors and external covariates.

Forecasting time series data is an important subject in economics, business, and finance. Traditionally, there are several techniques to effectively forecast the next lag of time series data such as univariate Autoregressive (AR), univariate Moving Average (MA), Simple Exponential Smoothing (SES), and more notably Auto…

2018-03-16abs ↗pdf ↗

While considerable advances have been made in estimating high-dimensional structured models from independent data using Lasso-type models, limited progress has been made for settings when the samples are dependent. We consider estimating structured VAR (vector auto-regressive models), where the structure can be capture…

2016-02-21abs ↗pdf ↗

The paper analyzes the statistical cost of tuning kernel hyperparameters in robust regression.

problem Finding the best interpolant from a class of kernels with unknown hyperparameters under adversarial noise.
method Finite-sample guarantees, subsampling guarantee for linear regression, ε-net argument for discretizing kernel parameterizations.
result Hyperparameter optimization increases sample complexity by just a logarithmic factor, compared to known parameters.