Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

121241362482 · Jun 202019922001200920172026
48 results for hidden processes

The paper uses Bayesian methods to infer hidden processes with unknown parameters.

problem Estimating hidden processes from noisy observations with unknown parameters.
method Variational Bayesian inference with autoregressive moving average (ARMA) and vector autoregressive (VAR) models, combined with sequential Monte Carlo (SMC) and importance sampling resampling (SISR).
result The proposed inference method accurately estimates hidden states from non-linear noisy observations.

The generic identification problem is to decide whether a stochastic process (Xt)(X_t) is a hidden Markov process and if yes to infer its parameters for all but a subset of parametrizations that form a lower-dimensional subvariety in parameter space. Partial answers so far available depend on extra assumptions on the pro…

2011-01-19abs ↗pdf ↗

New method uncovers hidden causal connections in multivariate point process networks.

problem Unobserved hidden variables confound causal discovery in high-dimensional point process networks.
method Proposes a deconfounding procedure to estimate causal interactions among observed nodes with unknown unobserved processes.
result The method accurately identifies causal interactions among observed processes, even with hidden variables.

Modified asymmetric hidden Markov models for time series with autoregressive components.

problem Dynamic relationships between variables in time series data.
method Introducing an asymmetric autoregressive component to recent asymmetric hidden Markov models.
result The model can choose the optimal autoregressive order for better likelihood.

Study examines dependence properties of Bayesian neural network units in finite-width networks.

problem Understanding dependence properties of hidden units in practical finite-width Bayesian neural networks.
method Theoretical analysis and empirical evaluation of depth and width impacts.
result Hidden units in finite-width Bayesian neural networks are dependent, contrary to the infinite-width limit assumption.

Study on hidden units in finite Bayesian neural networks and their tail properties.

problem Understanding the behavior of hidden units in finite Bayesian neural networks.
method Introduced a generalized Weibull-tail property to describe hidden units tails.
result Unit priors become heavier-tailed going deeper, providing insights into finite Bayesian neural networks.

Paper reveals hidden convexities in deep learning models using sparse signal processing.

problem Non-convex loss functions in deep learning models complicate optimization and theoretical understanding.
method Developed convex equivalences of ReLU NNs and their connections to sparse signal processing models.
result Recent research has uncovered hidden convexities in certain NN architectures, notably two-layer ReLU networks and other architectures.

We propose dynamical systems trees (DSTs) as a flexible class of models for describing multiple processes that interact via a hierarchy of aggregating parent chains. DSTs extend Kalman filters, hidden Markov models and nonlinear dynamical systems to an interactive group scenario. Various individual processes interact a…

2012-07-11abs ↗pdf ↗

A new model separates persistence and transition priors in HDP-HMM.

problem Limitation of sticky HDP-HMM in expressing different persistence strengths.
method Developed a disentangled sticky HDP-HMM (DS-HDP-HMM) with novel Gibbs sampling algorithms.
result DS-HDP-HMM outperforms sticky HDP-HMM and HDP-HMM on synthetic and real data.

The paper optimizes portfolios in a market with hidden drift and random expert opinions.

problem Optimizing portfolios in a market with hidden Gaussian drift and random expert signals.
method Modeling the hidden drift using Kalman filters and solving the utility maximization problem with dynamic programming.
result Derivation of optimal portfolio weights and utility maximization under the given market conditions.

New model improves cancer screening prediction accuracy.

problem Modeling disease progression with heterogeneous populations and irregular data.
method Hierarchical Hidden Markov Jump Processes with piece-wise stationary transitions and scalable EM algorithm.
result Model outperforms state-of-the-art models in prediction accuracy and generating Kaplan-Meier estimators.

DISTANA improves weather prediction by inferring hidden factors from temperature data.

problem Inferring hidden factors in spatiotemporal processes without supervision.
method Enhanced DISTANA architecture for spatiotemporal data, active tuning for latent state inference.
result DISTANA achieves more accurate predictions than other methods, inferring hidden factors from temperature data.

Deep learning is the state-of-the-art in fields such as visual object recognition and speech recognition. This learning uses a large number of layers, huge number of units, and connections. Therefore, overfitting is a serious problem. To avoid this problem, dropout learning is proposed. Dropout learning neglects some i…

2017-06-20abs ↗pdf ↗

Epsilon-machines are minimal, unifilar presentations of stationary stochastic processes. They were originally defined in the history machine sense, as hidden Markov models whose states are the equivalence classes of infinite pasts with the same probability distribution over futures. In analyzing synchronization, though…

2011-11-18abs ↗pdf ↗

Supervised learning frequently boils down to determining hidden and bright parameters in a parameterized hypothesis space based on finite input-output samples. The hidden parameters determine the attributions of hidden predictors or the nonlinear mechanism of an estimator, while the bright parameters characterize how h…

2018-03-22abs ↗pdf ↗

Hidden Markov Neural Networks balance adaptation and forgetting in time-series data.

problem Balancing adaptation to new data and forgetting outdated information in time-series forecasting.
method Modeling weights as hidden states of a Hidden Markov model, using a filtering algorithm for learning a variational approximation of the posterior distribution over weights, and employing sequential Bayes by Backprop with variational DropConnect for regularization.
result Achieves strong predictive performance and effective uncertainty quantification on various tasks.

The paper examines utility maximization in markets with hidden Gaussian drift, finding restrictions on model parameters.

problem Utility maximization problems in markets with hidden Gaussian drift mean-reverting processes.
method Derives sufficient conditions for bounded maximum expected utility of terminal wealth for models with full and partial information.
result Restrictions on model parameters for bounded maximum expected utility.

This paper is concerned with the sparsification of the input-hidden weights of ELM (Extreme Learning Machine). For ordinary feedforward neural networks, the sparsification is usually done by introducing certain regularization technique into the learning process of the network. But this strategy can not be applied for E…

2018-01-22abs ↗pdf ↗

Paper proposes a new model and methods for robustly de-interleaving HMP mixtures.

problem Lack of robustness to non-ideal situations in existing HMP mixtures de-interleaving methods.
method Designs a generative model, formulates de-interleaving as posterior inference, develops exact and approximate inference methods, derives error probability bounds.
result Proposed methods are highly effective and robust for non-ideal situations, outperforming baseline methods.

Traditional Relational Topic Models provide a way to discover the hidden topics from a document network. Many theoretical and practical tasks, such as dimensional reduction, document clustering, link prediction, benefit from this revealed knowledge. However, existing relational topic models are based on an assumption t…

2015-03-30abs ↗pdf ↗

SNEPPPs use squared neural networks to efficiently model Poisson point processes.

problem Efficiently modeling Poisson point processes with flexibility.
method Parameterizing intensity function with squared norm of a two-layer neural network.
result Closed-form integration of intensity function for quadratic time computation.

Reinforcement learning (RL) in Markov decision processes (MDPs) with large state spaces is a challenging problem. The performance of standard RL algorithms degrades drastically with the dimensionality of state space. However, in practice, these large MDPs typically incorporate a latent or hidden low-dimensional structu…

2016-11-11abs ↗pdf ↗

Wide neural networks with narrow bottlenecks behave like deep Gaussian processes.

problem Understanding the behavior of neural networks with narrow layers in the wide limit.
method Analyzing the wide limit of BNNs with narrow bottlenecks, showing they behave like a composition of GPs.
result Wide neural networks with narrow bottlenecks form a composition of GPs, termed a bottleneck NNGP.

Given a collection of entities (or nodes) in a network and our intermittent observations of activities from each entity, an important problem is to learn the hidden edges depicting directional relationships among these entities. Here, we study causal relationships (excitations) that are realized by a multivariate Hawke…

2016-08-03abs ↗pdf ↗

Learning and inferring features that generate sensory input is a task continuously performed by cortex. In recent years, novel algorithms and learning rules have been proposed that allow neural network models to learn such features from natural images, written text, audio signals, etc. These networks usually involve de…

2015-06-01abs ↗pdf ↗

In this paper we consider a reduced-form intensity-based credit risk model with a hidden Markov state process. A filtering method is proposed for extracting the underlying state given the observation processes. The method may be applied to a wide range of problems. Based on this model, we derive the joint distribution …

2016-03-09abs ↗pdf ↗

Detect hidden confounding in observational data using multiple environments.

problem Detect hidden confounding in observational data.
method Theoretical framework and simulation studies to test for hidden confounding.
result The proposed procedure correctly predicts hidden confounding, especially when bias is large.

Investor selects portfolios based on news attention in a hidden Markov model.

problem Mean-variance portfolio selection in a dynamic attention context.
method Closed-loop equilibrium strategies via extended HJB equation and Markov chain approximation.
result Equilibrium strategies found through iterative algorithm and numerical examples.

Generative adversarial models are powerful tools to model structure in complex distributions for a variety of tasks. Current techniques for learning generative models require an access to samples which have high quality, and advanced generative models are applied to generate samples from noisy training data through amb…

2018-07-02abs ↗pdf ↗

UNMIX identifies hidden buyers in darknet markets by clustering anonymized IDs.

problem Identifying hidden buyers in darknet markets where IDs are anonymized.
method UNMIX, a hidden buyer identification model using Dirichlet Hawkes Process.
result UNMIX successfully groups transactions from one hidden buyer into one cluster.

Aggregates models from different datasets using shared latent structures.

problem Aggregating models from heterogeneous datasets with shared latent structures.
method Bayesian nonparametrics for identifying correspondences among local model parameterizations.
result Framework successfully aggregates various model types across different applications.

Deep Gaussian processes reduce uncertainty in porous media flow modeling.

problem Uncertainty quantification in flow through heterogeneous porous media.
method Multi-layer hierarchical Gaussian process with variational approximation.
result Automatic selection of hidden layer dimensions and uncertainty propagation.