Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

2535077601,013 · Jun 202019922001200920172026
48 results for high-dimensional state estimation

A new particle filter avoids resampling to improve state estimation in high dimensions.

problem Particle deprivation in high-dimensional state spaces.
method A resampling-free particle filter designed to mitigate particle deprivation.
result The filter offers a near-accurate representation of the posterior distribution in high-dimensional contexts.

Improved state estimation in high-dimensional models using Zig-Zag Sampler.

problem Weight degeneracy in particle filtering methods for high-dimensional state space models.
method Discrete Zig-Zag Sampler applied within the Composite MH Kernel of SMCMC framework.
result Improves estimation accuracy and increases acceptance ratio in high-dimensional state estimation.

A new method reduces high-dimensional state space for dynamic choice models.

problem Estimation of dynamic discrete choice models is computationally intensive and infeasible in high-dimensional settings.
method Recursive partitioning algorithm to reduce dimensionality of high-dimensional state space.
result Our method reduces estimation bias and makes estimation feasible.

Algorithm estimates human decision-making in high-dimensional states with finite-time guarantees.

problem Estimating optimal policies and measures of fit in dynamic decision models with high-dimensional state spaces.
method Single-loop estimation algorithm with stochastic gradient steps for reward maximization.
result Algorithm converges to a stationary solution with finite-time guarantees and approximates maximum likelihood sublinearly.

ETGPSSM efficiently models high-dimensional, non-stationary systems with reduced complexity.

problem Prohibitive computational and parametric complexity in high-dimensional, non-stationary dynamical systems.
method ETGPSSM integrates a single shared GP with input-dependent normalizing flows for scalable and flexible modeling.
result ETGPSSM outperforms existing models in computational efficiency and accuracy.

Algorithm learns diffusion processes with high-dimensional state spaces.

problem Stochastic control of unbounded diffusion processes with high-dimensional state spaces.
method Adaptive partitioning and learning algorithm that refines discretization based on estimation bias and statistical confidence.
result Established regret bounds that depend on problem parameters, extending to unbounded diffusion processes.

AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.

problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.

The paper introduces a method for interpretable principal component analysis of high-dimensional time series.

problem Inconsistent and difficult-to-interpret principal component estimates in high-dimensional regimes.
method Localized sparse principal component analysis of spectral density matrices in frequency domain.
result Efficient algorithm for sparse-localized estimates of principal subspaces.

SSNL improves simulation-based inference for high-dimensional data.

problem Performance degradation in neural likelihood estimation for high-dimensional data.
method Surjective Sequential Neural Likelihood (SSNL) using surjective normalizing flow models.
result SSNL avoids manual crafting of summary statistics and outperforms state-of-the-art methods.

The paper analyzes neural networks for solving high-dimensional Schrödinger eigenvalue problems.

problem Analyzing generalization error of neural networks for high-dimensional Schrödinger eigenvalue problems.
method Proves convergence rate of generalization error independent of dimension dd under spectral Barron space assumption. Verifies assumption by proving regularity estimate.
result Generalization error rate is independent of dimension dd under spectral Barron space assumption.

A new method for analyzing high-dimensional time-series data using deep neural networks.

problem Challenges in modeling high-dimensional time-series data with explicit state and observation processes.
method Deep Direct Discriminative Decoders (D4) for high-dimensional observation processes.
result D4 outperforms traditional SSMs and RNNs in various time-series data applications.

Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the regime where the problem dimension is large but finite. For concreteness, we co…

2016-06-06abs ↗pdf ↗

Novel approach integrates Multivariate Square-root Lasso into Synthetic Control for high-dimensional data.

problem Challenges in practical implementation and computational efficiency of Synthetic Control method for high-dimensional disaggregated data.
method Integrates Multivariate Square-root Lasso into Synthetic Control framework.
result Demonstrates superior computational efficiency without compromising estimation accuracy.

We study the performance of Local Causal Discovery (LCD), a simple and efficient constraint-based method for causal discovery, in predicting causal effects in large-scale gene expression data. We construct practical estimators specific to the high-dimensional regime. Inspired by the ICP algorithm, we use an optional pr…

2019-10-06abs ↗pdf ↗

Deep learning (DL) is a high dimensional data reduction technique for constructing high-dimensional predictors in input-output models. DL is a form of machine learning that uses hierarchical layers of latent features. In this article, we review the state-of-the-art of deep learning from a modeling and algorithmic persp…

2018-07-20abs ↗pdf ↗

Efficiently simulates slow dynamics of high-dimensional stochastic systems.

problem Simulating high-dimensional stochastic systems with slow dynamics and fast modes.
method Designs an algorithm to estimate an invariant manifold and its dynamics, averaging out fast modes.
result Efficient simulator of effective dynamics on low-dimensional invariant manifold.

Bayesian Neural Networks improve high-dimensional level set estimation.

problem Scalability issue in existing LSE methods for high-dimensional inputs.
method Bayesian Neural Networks with information-based acquisition functions.
result Proposed method achieves better results than state-of-the-art approaches.

Paper analyzes high-dimensional GMM for SSL, showing RMLE near-optimal performance.

problem Understanding when and why SSL works well with unlabeled data.
method Message-passing and state evolution methods for high-dimensional settings.
result RMLE achieves near-optimal performance in estimation and prediction with appropriate regularization.

We simplify Bayesian filtering by framing it as optimization, making it practical for high-dimensional systems.

problem Bayesian filtering struggles in high-dimensional state spaces like neural networks.
method We frame Bayesian filtering as optimization, using gradient descent for nonlinear cases.
result Our method results in effective, robust, and scalable filters for high-dimensional systems.

A new real-time method estimates system matrices and states using Kalman filter.

problem Real-time estimation of system matrices and states using Kalman filter.
method Estimation in an observation space, time-invariant interval, and online learning framework.
result Extraordinary performance in estimating matrices for damped oscillation model.

A neural network method estimates entropy production from system trajectories.

problem Estimating entropy production from system trajectories without detailed dynamics.
method Developed a neural estimator (NEEP) for entropy production (EP).
result NEEP rigorously proves to provide stochastic EP by optimizing an objective function.

GATSBI uses GANs for SBI, improving posterior estimation in high dimensions.

problem Statistical inference on stochastic models without likelihoods.
method Adversarial approach to variational objective, amortized inference, implicit priors.
result GATSBI returns well-calibrated posterior estimates in high dimensions.

A framework for forecasting high-dimensional time-series data using clustering.

problem Forecasting high-dimensional time-series data with intra-cluster similarity.
method Three-stage framework: univariate time series parameter estimation, clustering, multivariate time series parameter computation.
result Framework achieves state-of-the-art results on benchmark datasets, sometimes outperforming deep-learning-based approaches.

Improves DRL for long-term causal inference with semiparametric methods.

problem Efficient inference for policy values in nonparametric MDPs with stringent conditions.
method Semiparametric Double Reinforcement Learning (DRL) with superefficient nonparametric estimators.
result Relaxes overlap conditions and reduces high-dimensional density-ratio estimation.

New framework for discrete-state diffusion models reduces sample complexity.

problem Lack of theoretical understanding and sample complexity analysis for discrete-state diffusion models.
method Developed a principled theoretical framework, decomposing score estimation error.
result Established sample complexity bound of O~(ε2)\widetilde{\mathcal{O}}(ε^{-2}).

Nested model averaging improves high-dimensional linear regression performance.

problem High-dimensional linear regression with predictor ordering impact.
method Combining model averaging with regularized estimators on the solution path.
result Nested model averaging with lasso and SLOPE outperforms competing methods.

OptIMIS method improves SRAM yield estimation efficiency and accuracy.

problem Efficient estimation of SRAM failure probability with shrinking technology nodes.
method Generalized norm minimization method, optimal manifold concept, onion sampling, neural coupling flow.
result OptIMIS method delivers up to 3.5x efficiency and 3x accuracy over state-of-the-art methods.

RCUKF combines data-driven modeling and Bayesian estimation for accurate system state estimation.

problem Challenges in obtaining reliable process models for complex systems.
method Integrates reservoir computing with unscented Kalman filtering.
result Demonstrated effectiveness on benchmark problems and real-time vehicle trajectory estimation.

EnSF improves accuracy in tracking high-dimensional nonlinear systems.

problem Low accuracy in high-dimensional, nonlinear filtering problems.
method Score-based diffusion model, mini-batch Monte Carlo estimator.
result EnSF outperforms state-of-the-art methods in tracking high-dimensional systems.

Randomized value functions offer a promising approach towards the challenge of efficient exploration in complex environments with high dimensional state and action spaces. Unlike traditional point estimate methods, randomized value functions maintain a posterior distribution over action-space values. This prevents the …

2018-06-06abs ↗pdf ↗

SRMC framework reduces Monte Carlo variance by history-based sampling in high-dimensional spaces.

problem Efficient sampling in high-dimensional discrete or continuous state spaces.
method Score-Repellent Monte Carlo (SRMC) framework that summarizes history through running average of score evaluations.
result Improves estimator variance and mode coverage with constant memory usage.

Framework expands particle filtering to estimate states beyond prior boundaries.

problem Limitations of traditional particle filtering in estimating states outside prior support.
method Diffusion-Enhanced Particle Filtering Framework with adaptive diffusion, entropy-driven regularisation, and kernel-based perturbations.
result Framework significantly improves state estimation accuracy and success rates for out-of-boundary targets.

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data. State-of-the-art learning algorithms require computational complexity which depends …

2018-03-12abs ↗pdf ↗

t-NEB clusters high-dimensional data hierarchically with density paths.

problem Hierarchical clustering struggles with high-dimensional data.
method t-NEB uses density estimation, maximum density paths, and probabilistic merging.
result t-NEB yields state-of-the-art clustering performance on high-dimensional data.

Paper proposes new density estimators for high-dimensional data.

problem Prohibitive computational cost and slow convergence rate in high-dimensional density estimation.
method Adaptive hyperbolic cross density estimators in mixed smooth Sobolev spaces.
result Proposed estimators do not suffer curse of dimensionality under Integral Probability Metrics.

Proposes an INLA-based method for state and parameter estimation in nonlinear systems.

problem Difficulty in learning parameters accurately in nonlinear dynamical systems.
method Iterated INLA for state and parameter estimation in nonlinear dynamical systems.
result Outperforms existing methods on data assimilation tasks.

Frank-Wolfe algorithm (FW) and its variants have gained a surge of interests in machine learning community due to its projection-free property. Recently people have reduced the gradient evaluation complexity of FW algorithm to log(1ε)\log(\frac{1}ε) for the smooth and strongly convex objective. This complexity result is esp…

2018-05-20abs ↗pdf ↗

Federated framework learns causal states to predict counterfactuals without centralizing data.

problem Decentralized counterfactual reasoning in coupled industrial systems with private data.
method Federated causal representation learning in state-space systems.
result Proves convergence to centralized oracle and provides privacy guarantees.