Improved state estimation in high-dimensional models using Zig-Zag Sampler.
problem Weight degeneracy in particle filtering methods for high-dimensional state space models.
method Discrete Zig-Zag Sampler applied within the Composite MH Kernel of SMCMC framework.
result Improves estimation accuracy and increases acceptance ratio in high-dimensional state estimation.
A new particle filter avoids resampling to improve state estimation in high dimensions.
problem Particle deprivation in high-dimensional state spaces.
method A resampling-free particle filter designed to mitigate particle deprivation.
result The filter offers a near-accurate representation of the posterior distribution in high-dimensional contexts.
A new method reduces high-dimensional state space for dynamic choice models.
problem Estimation of dynamic discrete choice models is computationally intensive and infeasible in high-dimensional settings.
method Recursive partitioning algorithm to reduce dimensionality of high-dimensional state space.
result Our method reduces estimation bias and makes estimation feasible.
ETGPSSM efficiently models high-dimensional, non-stationary systems with reduced complexity.
problem Prohibitive computational and parametric complexity in high-dimensional, non-stationary dynamical systems.
method ETGPSSM integrates a single shared GP with input-dependent normalizing flows for scalable and flexible modeling.
result ETGPSSM outperforms existing models in computational efficiency and accuracy.
IBPF algorithm tackles high-dimensional parameter learning for complex systems.
problem Learning high-dimensional parameters in complex, partially observed, and nonlinear systems.
method Iterated Block Particle Filter (IBPF) for graphical state space models.
result IBPF algorithm consistently beats the curse of dimensionality across various experiments.
Algorithm learns diffusion processes with high-dimensional state spaces.
problem Stochastic control of unbounded diffusion processes with high-dimensional state spaces.
method Adaptive partitioning and learning algorithm that refines discretization based on estimation bias and statistical confidence.
result Established regret bounds that depend on problem parameters, extending to unbounded diffusion processes.
The paper analyzes neural networks for solving high-dimensional Schrödinger eigenvalue problems.
problem Analyzing generalization error of neural networks for high-dimensional Schrödinger eigenvalue problems.
method Proves convergence rate of generalization error independent of dimension d under spectral Barron space assumption. Verifies assumption by proving regularity estimate. result Generalization error rate is independent of dimension d under spectral Barron space assumption. A new method for analyzing high-dimensional time-series data using deep neural networks.
problem Challenges in modeling high-dimensional time-series data with explicit state and observation processes.
method Deep Direct Discriminative Decoders (D4) for high-dimensional observation processes.
result D4 outperforms traditional SSMs and RNNs in various time-series data applications.
Our article considers a Gaussian variational approximation of the posterior density in a high-dimensional state space model. The variational parameters to be optimized are the mean vector and the covariance matrix of the approximation. The number of parameters in the covariance matrix grows as the square of the number …
In recent years, deep reinforcement learning has been shown to be adept at solving sequential decision processes with high-dimensional state spaces such as in the Atari games. Many reinforcement learning problems, however, involve high-dimensional discrete action spaces as well as high-dimensional state spaces. This pa…
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
Method learns low-dim. state vars from noisy high-dim. data.
problem Discovering dynamical models from noisy high-dimensional data.
method Stochastic Variational Deep Kernel Learning with encoder and latent model.
result Effective denoising, compact state representation, and uncertainty quantification.
Algorithm estimates human decision-making in high-dimensional states with finite-time guarantees.
problem Estimating optimal policies and measures of fit in dynamic decision models with high-dimensional state spaces.
method Single-loop estimation algorithm with stochastic gradient steps for reward maximization.
result Algorithm converges to a stationary solution with finite-time guarantees and approximates maximum likelihood sublinearly.
Exploration is an extremely challenging problem in reinforcement learning, especially in high dimensional state and action spaces and when only sparse rewards are available. Effective representations can indicate which components of the state are task relevant and thus reduce the dimensionality of the space to explore.…
A classical result of Milman roughly states that every Lipschitz function on Sn is almost constant on a sufficiently high-dimensional sphere Sm⊂Sn. In this paper we extend the result by proving that any Lipschitz function on a positively curved homogeneous space is almost consta…
A new framework for time series analysis using state-space learning.
problem Ineffectiveness of traditional Kalman filtering in handling big data and multiple explanatory variables.
method State Space Learning (SSL) framework using statistical learning for high-dimensional regression.
result SSL outperforms traditional methods in subset selection and forecasting accuracy.
Learning a model of dynamics from high-dimensional images can be a core ingredient for success in many applications across different domains, especially in sequential decision making. However, currently prevailing methods based on latent-variable models are limited to working with low resolution images only. In this wo…
Bayesian optimization for high-dimensional combinatorial spaces using embeddings.
problem Optimizing expensive functions over large, complex input spaces.
method Dictionary-based ordinal embeddings for high-dimensional combinatorial structures, using Gaussian process models.
result The proposed method outperforms state-of-the-art BO methods on diverse real-world benchmarks.
SILBO optimizes high-dimensional Bayesian optimization using semi-supervised embedding learning.
problem Bayesian optimization struggles with high-dimensional search spaces.
method SILBO uses semi-supervised dimension reduction to find a low-dimensional space for iterative optimization.
result SILBO outperforms existing methods on high-dimensional Bayesian optimization tasks.
High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states: many problems become exponentially difficult in high dimensions. Recently, the ot…
Federated framework learns causal states to predict counterfactuals without centralizing data.
problem Decentralized counterfactual reasoning in coupled industrial systems with private data.
method Federated causal representation learning in state-space systems.
result Proves convergence to centralized oracle and provides privacy guarantees.
SRMC framework reduces Monte Carlo variance by history-based sampling in high-dimensional spaces.
problem Efficient sampling in high-dimensional discrete or continuous state spaces.
method Score-Repellent Monte Carlo (SRMC) framework that summarizes history through running average of score evaluations.
result Improves estimator variance and mode coverage with constant memory usage.
New methods combine MALA and mGRAD for scalable Bayesian inference in high-dimensional state-space models.
problem Bayesian inference in high-dimensional state-space models with limited scalability.
method Combines gradient-based MALA and prior-informed mGRAD for scalable inference.
result Extends classical MCMC methods to handle multiple time steps and particles.
Many reinforcement learning (RL) tasks provide the agent with high-dimensional observations that can be simplified into low-dimensional continuous states. To formalize this process, we introduce the concept of a DeepMDP, a parameterized latent space model that is trained via the minimization of two tractable losses: pr…
One of the key issues for imitation learning lies in making policy learned from limited samples to generalize well in the whole state-action space. This problem is much more severe in high-dimensional state environments, such as game playing with raw pixel inputs. Under this situation, even state-of-the-art adversary-b…
Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this challenge, the pixels-to-torques problem, where an RL agent learns a closed-loop con…
BOIDS optimizes high-dimensional problems by guiding optimization with one-dimensional lines.
problem Scaling Bayesian Optimization to high-dimensional problems.
method BOIDS uses a sequence of one-dimensional direction lines guided by an adaptive selection technique and incorporates subspace embedding for efficiency.
result BOIDS outperforms state-of-the-art methods on various synthetic and real-world problems.
MOCA-HESP optimizes high-dimensional combinatorial and mixed spaces using hyper-ellipsoid partitioning.
problem Challenges in optimizing high-dimensional, combinatorial and mixed spaces.
method MOCA-HESP uses hyper-ellipsoid space partitioning with different categorical encoders and multi-armed bandit for adaptive selection.
result MOCA-HESP outperforms existing methods on various synthetic and real-world benchmarks.
Data-efficient learning in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. In this paper, we consider one instance of this challenge, the pixels to torques problem, where an agent must learn a closed-loop control policy from pixel i…
A new method identifies critical transitions in high-dimensional data.
problem Challenges in identifying critical transitions in high-dimensional time-series data.
method Spatial-temporal Principal Component Analysis (stPCA)
result Identifies tipping points before critical transitions reliably.
The options framework in reinforcement learning models the notion of a skill or a temporally extended sequence of actions. The discovery of a reusable set of skills has typically entailed building options, that navigate to bottleneck states. This work adopts a complementary approach, where we attempt to discover option…
MORBO improves multi-objective BO for high-dimensional problems.
problem Optimizing multiple objectives in high-dimensional spaces with expensive evaluations.
method Parallel local BO in multiple regions with coordinated strategy.
result Significant improvement in sample efficiency for high-dimensional problems.
We simplify Bayesian filtering by framing it as optimization, making it practical for high-dimensional systems.
problem Bayesian filtering struggles in high-dimensional state spaces like neural networks.
method We frame Bayesian filtering as optimization, using gradient descent for nonlinear cases.
result Our method results in effective, robust, and scalable filters for high-dimensional systems.
AF improves sampling from high-dimensional, multi-modal distributions.
problem Sampling from high-dimensional, multi-modal distributions is challenging.
method Annealing Flow (AF) using Continuous Normalizing Flow (CNF) with dynamic Optimal Transport (OT) objective and annealing procedures.
result AF significantly improves training efficiency and stability, outperforming state-of-the-art methods.
New method improves Kalman filtering and smoothing for large state spaces.
problem High computational cost and uncertainty in large-scale Kalman filtering.
method Probabilistic numerical method leveraging GPU acceleration and tunable trade-off.
result Mitigates scaling issues and provides more accurate uncertainty estimates.
BOFiP optimizes high-dimensional functions by distributing them into sub-spaces and using game theory.
problem Optimizing high-dimensional black box functions with computational complexity.
method BOFiP decomposes high-dimensional space into sub-spaces, searches within sub-spaces, and updates beliefs using game theory.
result BOFiP outperforms competitors in high-dimensional optimization problems.
LOT framework embeds high-dimensional cell data into interpretable Euclidean space.
problem Lack of interpretable methods for high-dimensional cell data.
method Adapts Linear Optimal Transport (LOT) to irregular point clouds.
result Accurate and interpretable classification and synthetic data generation.
DiBO uses diffusion models to optimize high-dimensional black-box functions efficiently.
problem Optimizing high-dimensional and complex black-box functions efficiently.
method DiBO iterates two stages: training a diffusion model and casting candidate selection as posterior inference.
result DiBO outperforms state-of-the-art baselines across synthetic and real-world tasks.
Quantum machine learning model for binary classification.
problem Efficiency in high-dimensional binary classification tasks.
method Quantum-classical hybrid algorithm and quantum computer for inference.
result Quantum discriminator achieves 99% accuracy on Iris dataset.
This paper tackles high-dimensional uncertainty quantification with semi-supervised learning.
problem High-dimensional uncertainty quantification due to the curse of dimensionality.
method Autoencoder for dimension reduction, DFN for mapping and reconstruction, GP for surrogate modeling, semi-supervised learning for accuracy.
result The framework effectively reduces uncertainty quantification and reliability analysis for high-dimensional problems.
A planning approach learns skills from interactions, balancing exploration and exploitation.
problem Learning robust high-level skills in noisy environments with unknown pre-conditions.
method Formulates skills as high-level policies, learns plans via bandit problems, balances exploration and exploitation.
result A planner capable of learning robust high-level skills in high-dimensional state spaces.
New method improves high-dimensional Bayesian optimization efficiency using MCMC.
problem High-dimensional optimization challenges and computational complexity.
method Markov Chain Monte Carlo (MCMC) to efficiently sample from approximated posterior.
result Metropolis-Hastings and Langevin Dynamics versions outperform state-of-the-art methods.
BAxUS optimizes high-dimensional functions adaptively, avoiding performance degradation and failure.
problem State-of-the-art HDBO methods degrade or fail with increasing dimensions.
method BAxUS uses nested random subspaces to adaptively optimize high-dimensional functions.
result BAxUS outperforms state-of-the-art methods across various applications.
A new method for high-dimensional RBDO using stochastic emulators.
problem Efficient RBDO in high-dimensional settings.
method Unified stochastic representation, stochastic emulators, deterministic mapping.
result Significant computational gains in high-dimensional settings.
A new tensor network method for image classification reduces computation cost.
problem Efficiently classifying images in high-dimensional spaces.
method Proposes a multi-layered tensor network (MLTN) that performs one MPS operation per layer, reducing computation cost.
result Reduces computation cost without degrading performance.
Gradient-based meta-learning techniques are both widely applicable and proficient at solving challenging few-shot learning and fast adaptation problems. However, they have practical difficulties when operating on high-dimensional parameter spaces in extreme low-data regimes. We show that it is possible to bypass these …
Randomized value functions offer a promising approach towards the challenge of efficient exploration in complex environments with high dimensional state and action spaces. Unlike traditional point estimate methods, randomized value functions maintain a posterior distribution over action-space values. This prevents the …
Efficiently computes optimal transport maps and Wasserstein barycenters using conditional normalizing flows.
problem Computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces.
method Uses conditional normalizing flows to approximate distributions and solve the primal problem.
result Shows computational feasibility for hundreds of input distributions and yields accurate results.