In this paper we discuss four problems regarding Markov equivalences for subclasses of loopless mixed graphs. We classify these four problems as finding conditions for internal Markov equivalence, which is Markov equivalence within a subclass, for external Markov equivalence, which is Markov equivalence between subclas…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Markov”
The paper estimates key metrics for linear models with Markov or hidden Markov sources.
problem Estimating free energy, mutual information, and MMSE for linear models with specific signal priors.
method Replica analysis in statistical physics, focusing on Markov and hidden Markov sources.
result The linear model with Markov or hidden Markov sources can be simplified into decoupled AWGN channels.
Markov Observation Modelsstat.ML
Expands Hidden Markov Model to include Markov chain observations.
problem Handling Markov chain observations in Hidden Markov Models.
method Developed Expectation-Maximization algorithm and Viterbi algorithm analogs.
result Estimates transition probabilities for hidden states and observations.
Discrete-time weak approximation of a Black-Scholes model with drift and volatility Markov switchingmath.PR
Study approximates financial market with discrete-time models.
problem Approximating continuous-time financial market models with discrete-time.
method Constructs discrete-time market models with Markov switching and proves convergence.
result Discrete-time models converge to continuous-time Black-Scholes model with Markov switching.
New neural processes use stacked Markov operators to improve flexibility.
problem Improving flexibility in neural processes.
method Stacking neural parameterized Markov transition operators in function space.
result MNPs outperform baseline models on various tasks.
New algorithms for RL in Markov games with independent linear function approximation, breaking the curse of multiagents.
problem Tackles the challenge of learning Markov equilibria in large state space Markov games with multiple agents.
method Proposes independent linear Markov games and designs new algorithms for learning Markov coarse correlated equilibria and Markov correlated equilibria with polynomial sample complexity.
result Breaks the curse of multiagents by achieving sample complexity bounds that scale polynomially with each agent's function class complexity.
The paper bounds generalization errors for deep neural networks with Markov datasets.
problem Bounding generalization errors for deep learning with Markov datasets.
method Developed new symmetrization inequalities for Markov chains, using spectral gap of the infinitesimal generator.
result Derived upper bounds on generalization errors for deep neural networks with Markov datasets.
Markov partitions for the geodesic flow on compact Riemann surfaces of constant negative curvaturemath.DG
The paper constructs Markov partitions for geodesic flow on hyperbolic surfaces.
problem Understanding Markov partitions for general hyperbolic flows.
method Rigorous construction of Markov partitions for geodesic flow on Riemann surfaces of constant negative curvature.
result Explicit forms of rectangles and local cross sections provided for the geodesic flow.
We rephrase Gromov's definition of Markov compacta, introduce a subclass of Markov compacta defined by one building block and study cohomological dimensions of these compacta. We show that for a Markov compactum , $\dim_{\Z_{(p)}}X=\dim_{\Q}X$ for all but finitely many primes where is the localization…
Study nonparametric estimator for Markov chain transition matrices in offline setting.
problem Estimating transition matrices of finite controlled Markov chains from logged data.
method Developed sample complexity bounds and conditions for minimaxity.
result Achieving certain statistical risk requires balancing mixing properties and sample size.
The paper provides concentration inequalities for Markov chain variance estimators.
problem Estimating the variance of Markov chains with concentration properties.
method Martingale decomposition method for uniformly geometrically ergodic Markov chains.
result Explicit control of the p-th moment of the OBM estimator difference and dependence on p and mixing time.
New method estimates convergence bounds for nonlinear Markov chains.
problem Difficulty in describing properties of nonlinear Markov chains.
method Coupling Markov chains to reconstitute distribution relationships and estimate convergence bounds.
result Estimation of convergence bounds is more precise than existing results.
A new method simulates a lazy version of a Markov chain for empirical inference.
problem Estimating and testing unknown Markov chains with limited data.
method Simulates an α-lazy version of an unknown Markov chain, making it ergodic.
result The pseudo spectral gap can be applied to non-ergodic Markov chains.
We study discretizations of polynomial processes using finite state Markov processes satisfying suitable moment matching conditions. The states of these Markov processes together with their transition probabilities can be interpreted as Markov cubature rules. The polynomial property allows us to study such rules using …
This paper reviews recent advances in Bayesian nonparametric techniques for constructing and performing inference in infinite hidden Markov models. We focus on variants of Bayesian nonparametric hidden Markov models that enhance a posteriori state-persistence in particular. This paper also introduces a new Bayesian non…
The L-move for classical braids extends naturally to trivalent braids. We follow the L-move approach to the Markov Theorem, to prove a one-move Markov-type theorem for trivalent braids. We also reformulate this L-Move Markov theorem and prove a more algebraic Markov-type theorem for trivalent braids. Along the way, we …
In this paper we first give a one-move version of Markov's braid theorem for knot isotopy in that sharpens the classical theorem. Then a relative version of Markov's theorem concerning a fixed braided portion in the knot. We also prove an analogue of Markov's theorem for knot isotopy in knot complements. Finally …
New methods solve complex financial equations.
problem Solving backward stochastic differential equations driven by continuous-time Markov chains.
method Multi-stage Euler-Maruyama methods and multilevel spatial discretization.
result Efficiently solved stiff Markov BSDEs.
Unified framework for drawdown risk computation under Markov models.
problem High computational challenges in drawdown risk metrics.
method Unified framework for computing five drawdown quantities under general Markov models, using linear systems and efficient algorithms.
result Efficient algorithms achieve same complexity as path-independent problems, validated by rigorous convergence analysis and extensive experiments.
Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a variant of stochastic gradient descent where the random samples are taken on the t…
Study of algebraic dynamics on Markov cubics in tropical geometry.
problem Understanding the dynamics of Markov cubics over non-archimedean fields.
method Tropicalization and -triangle reflection group on hyperbolic plane.
result Existence of Fatou domain and finitude of orbits with rational points over prime power denominators.
Study Markov chain gradient descent in Hilbert spaces for quadratic loss.
problem Approximating optimal solutions for quadratic loss functions.
method Developed a Markov chain-based stochastic gradient algorithm in Hilbert spaces.
result Established probabilistic upper bounds on convergence.
Graphical models are popular statistical tools which are used to represent dependent or causal complex systems. Statistically equivalent causal or directed graphical models are said to belong to a Markov equivalent class. It is of great interest to describe and understand the space of such classes. However, with curren…
Reformulated Markov's conjecture in combinatorial terms.
problem Markov's uniqueness conjecture in integral necklaces.
method Geometric reformulation and combinatorial description.
result Explicitly described set of lengths on modular torus.
A new method scores contextual Markov networks without assuming chordality.
problem Learning structure in contextual Markov networks is hard due to many possible structures.
method Marginal pseudo-likelihood as a consistent structure estimator.
result Marginal pseudo-likelihood yields a consistent structure estimator.
Optimizes control of hybrid systems with multiple switching processes.
problem Optimal control of hybrid systems with multiple Markov switching processes.
method Combines two separate Markov chains into one synthetic chain, derives HJB equations, and solves the portfolio choice problem.
result Derives explicit solutions and value functions for the optimal control problem.
In this paper we describe three stochastic models based on a semi-Markov chains approach and its generalizations to study the high frequency price dynamics of traded stocks. The three models are: a simple semi-Markov chain model, an indexed semi-Markov chain model and a weighted indexed semi-Markov chain model. We show…
Efficient method for lookback option pricing under Markov models.
problem Pricing lookback options under Markov models.
method Model-free representations combined with numerical quadrature and Markov chain approximation.
result Efficient method applicable to various Markov models.
New insights into Markov chain geometry via positive transition measures.
problem Lack of statistical meaning in the space of transition probabilities.
method Constructing an extension of the space of transition probabilities using Amari's theory of positive measures.
result Introduction of a new dually flat structure for the space of positive transition measures.
This paper applies AMP theory to improve learning tasks.
problem Improving learning efficiency by optimizing task-specific models.
method Uses aggregated Markov processes to reduce model complexity and enhance learning.
result Demonstrates how AMP theory can be effectively applied to stochastic learning.
Investor selects portfolios based on news attention in a hidden Markov model.
problem Mean-variance portfolio selection in a dynamic attention context.
method Closed-loop equilibrium strategies via extended HJB equation and Markov chain approximation.
result Equilibrium strategies found through iterative algorithm and numerical examples.
This paper models time-series data with a mixture of Markov chains, automatically determining the number of components.
problem Tackles the inability of common Markov state modeling frameworks to discern heterogeneities in complex data.
method Uses a mixture of Markov chains and variational expectation-maximization algorithm for automatic component selection.
result Achieves performance consistent with theoretically optimal error scaling, identifying meaningful heterogeneities in various data sets.
On Markov's Theoremmath.GT
We give a new proof of Markov's classical theorem relating any two closed braid representations of the same knot or link. The proof is based upon ideas in a forthcoming paper by the authors, "Stabilization in the braid groups". The new proof of the classical Markov theorem is used by Nancy Wrinkle in her forthcoming ma…
Enhanced Markov chain sampler learns network statistics faster.
problem Learning network statistics efficiently.
method Integrates graph Forman curvature into Markov chain transition probabilities and stationary distribution.
result Curved Markov chain Monte Carlo achieves faster convergence.
We prove that the variance swap rate (fair strike) equals the price of a co-terminal European-style contract when the underlying is an exponential Markov process, time-changed by an arbitrary continuous stochastic clock, which has arbitrary correlation with the driving Markov process, provided that the payoff function …
Generalizes bits back coding for time-series models with latent Markov structures.
problem Efficiently compressing time-series data with latent Markov structures.
method Extends bits back coding to time-series models with latent Markov structures, including HMMs and LGSSMs.
result Effective for small scale models, promising for larger scale settings like video compression.
Method reconstructs hidden Markov chains from insurance data.
problem Recovering hidden Markov chains from incomplete insurance data.
method Neural architecture to explicitly provide transition probabilities.
result Neural model successfully validates decompression of insurance information.
Reduces identity testing of reversible Markov chains to simpler symmetric chain tests.
problem Testing identity of reversible Markov chains from a single trajectory.
method Using lumping-congruent Markov embeddings, the problem is simplified to testing symmetric chains over a larger state space.
result Achieves state-of-the-art sample complexity for identity testing.
Introducing user-prescribed constraints in Markov chains for nonlinear dimensionality reductioncs.LG
Stochastic kernel based dimensionality reduction approaches have become popular in the last decade. The central component of many of these methods is a symmetric kernel that quantifies the vicinity between pairs of data points and a kernel-induced Markov chain on the data. Typically, the Markov chain is fully specified…
New assumptions and algorithm solve offline two-player zero-sum Markov games.
problem Solving offline two-player zero-sum Markov games under insufficient assumptions.
method Proposed unilateral concentration assumption and pessimism-type algorithm.
result Algorithm efficiently learns Nash equilibrium under unilateral concentration.
We introduce Markov substitute processes, a new model at the crossroad of statistics and formal grammars, and prove its main property : Markov substitute processes with a given support form an exponential family.
Model reduction of Markov processes is a basic problem in modeling state-transition systems. Motivated by the state aggregation approach rooted in control theory, we study the statistical state compression of a discrete-state Markov chain from empirical trajectories. Through the lens of spectral decomposition, we study…
In his 2011 work, Maas has shown that the law of any time-reversible continuous-time Markov chain with finite state space evolves like a gradient flow of the relative entropy with respect to its stationary distribution. In this work we show the converse to the above by showing that if the relative law of a Markov chain…
New 'book links' generalize braids and plats, proving Markov's theorem.
problem Generalizing braid theory to new structures.
method Extending open book foliations to prove Markov's theorem for new objects.
result Proved Markov's theorem in a broader context of 'book links'.
This thesis classifies pseudo-Anosov homeomorphisms using geometric Markov partitions.
problem Classifying pseudo-Anosov homeomorphisms up to topological conjugacy.
method Algorithmic approach using geometric Markov partitions.
result Geometric type is a complete invariant of conjugation.
Elo ratings learn model parameters quickly using Markov chains.
problem Ranking players in online settings.
method Bradley--Terry--Luce model and Markov chain theory.
result Elo learns model parameters at a competitive rate.
The Viterbi process can be extended indefinitely in a pairwise Markov model.
problem Estimating hidden chains in pairwise Markov models.
method Construction of barriers to ensure Viterbi path goes through states.
result The Viterbi process is regenerative in the PMM.
New neural method for inferring Markov jump processes.
problem Inference in Markov jump processes is challenging.
method Variational inference using neural ODEs and backpropagation.
result Trains neural representations of data to approximate process rates.