Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

99197296394 · Jun 202019922001200920172026
48 results for Markov ordering

Users form information trails as they browse the web, checkin with a geolocation, rate items, or consume media. A common problem is to predict what a user might do next for the purposes of guidance, recommendation, or prefetching. First-order and higher-order Markov chains have been widely used methods to study such se…

2017-04-20abs ↗pdf ↗

Study analyzes stock order transitions during US-China trade war using Markov chains.

problem Understanding order dynamics during extreme macroeconomic events.
method First-order time-homogeneous discrete-time Markov chain model.
result Active participation by different traders during high volatility days, influencing market outcomes.

The article proposes a deep learning method to test and infer the Markov property in time series data.

problem Testing and inferring the Markov property in high-dimensional time series data.
method Deep conditional generative learning to estimate conditional density functions and derive a doubly robust test statistic.
result The test controls the type-I error asymptotically and has power approaching one.

Study analyzes order transitions in high, medium, and low market cap stocks using Markov chains.

problem Understanding order transitions in stocks of different market caps.
method First-order discrete-time Markov chain model applied to NASDAQ100 stocks.
result Limit orders exhibit higher inertia during opening hours but decrease in subsequent hours, while market orders increase.

Markov logic networks (MLNs) reconcile two opposing schools in machine learning and artificial intelligence: causal networks, which account for uncertainty extremely well, and first-order logic, which allows for formal deduction. An MLN is essentially a first-order logic template to generate Markov networks. Inference …

2016-11-24abs ↗pdf ↗

We introduce LAMP: the Linear Additive Markov Process. Transitions in LAMP may be influenced by states visited in the distant history of the process, but unlike higher-order Markov processes, LAMP retains an efficient parametrization. LAMP also allows the specific dependence on history to be learned efficiently from da…

2017-04-05abs ↗pdf ↗

Study analyzes price change patterns across different market capitalizations using Markov chains.

problem Understanding price dynamics in limit order markets across various market capitalizations.
method Discrete-time Markov chain analysis of intraday price changes in NASDAQ100 tick data.
result Systematic patterns in price inertia and stability across market capitalizations are identified.

New method identifies nonstationary causal structures in time series data.

problem Identifying causal relationships in time series data that change over time.
method High-order Markov Switching Models for regime-dependent causal discovery.
result Scalable approach for estimating high-order regime-dependent causal structures.

New concentration inequality for U-statistics of Markov chains.

problem Proving a concentration inequality for U-statistics of order two in uniformly ergodic Markov chains.
method Inductive analysis using martingale techniques, uniform ergodicity, Nummelin splitting, and Bernstein's inequality.
result Recovery of convergence rate for U-statistics of independent random variables and canonical kernels, with improved results for dependent kernels.

We describe and extract time-ordered multibody interactions from complex systems.

problem Complex systems with temporal and multibody dependencies.
method Decompose multivariate Markov chains into time-ordered multibody interactions. Algorithm to extract interactions from data. Measure complexity of interaction ensembles.
result Robust and efficient algorithm to infer time-ordered multibody interactions from data.

In this paper we propose a semi-Markov modulated model of interest rates. We assume that the switching process is a semi-Markov process with finite state space E and the modulated process is a diffusive process. We derive recursive equations for the higher order moments of the discount factor and we describe a Monte Ca…

2012-10-11abs ↗pdf ↗

We introduce a Maximum Entropy model able to capture the statistics of melodies in music. The model can be used to generate new melodies that emulate the style of the musical corpus which was used to train it. Instead of using the nn-body interactions of (n1)(n-1)-order Markov models, traditionally used in automatic mus…

2016-10-11abs ↗pdf ↗

We propose a framework to study the optimal liquidation strategy in a limit order book for large-tick stocks, with spread equal to one tick. All order book events (market orders, limit orders and cancellations) occur according to independent Poisson processes, with parameters depending on price move directions. Our goa…

2017-01-05abs ↗pdf ↗

PDHAMS improves sampling for discrete distributions with quadratic potential functions.

problem Sampling discrete distributions efficiently and accurately.
method Integrates a second-order approximation of the potential function and uses Gaussian integral trick.
result PDHAMS yields superior performance compared to other methods.

Proposes new methods for Markov chain choice models with panel data.

problem Dependence among transactions for the same customer in historical data.
method Expectation-maximization (EM) algorithms incorporating partial-ordering preference information.
result EM algorithms outperform traditional methods on synthetic and real datasets.

The paper bounds generalization errors for deep neural networks with Markov datasets.

problem Bounding generalization errors for deep learning with Markov datasets.
method Developed new symmetrization inequalities for Markov chains, using spectral gap of the infinitesimal generator.
result Derived upper bounds on generalization errors for deep neural networks with Markov datasets.

In this research, we develop a trading strategy for the discrete-time optimal liquidation problem of large order trading with different market microstructures in an illiquid market. In this framework, the flow of orders can be viewed as a point process with stochastic intensity. We model the price impact as a linear fu…

2015-07-23abs ↗pdf ↗

Paper tackles high-order inference in structured prediction tasks.

problem Maximizing a score function on the space of labels in high-order Markov random fields.
method Generative model approach with two-stage convex optimization algorithm.
result Success in general high-order inference problems driven by hyperedge expansion properties.

We show that, for generative classifiers, conditional independence corresponds to linear constraints for the induced discrimination functions. Discrimination functions of undirected Markov network classifiers can thus be characterized by sets of linear constraints. These constraints are represented by a second order fi…

2018-11-12abs ↗pdf ↗

Unified framework for drawdown risk computation under Markov models.

problem High computational challenges in drawdown risk metrics.
method Unified framework for computing five drawdown quantities under general Markov models, using linear systems and efficient algorithms.
result Efficient algorithms achieve same complexity as path-independent problems, validated by rigorous convergence analysis and extensive experiments.

Transformers with multiple layers learn to estimate bigram distributions, while single-layer models often get stuck in unigram local minima.

problem Understanding the sequential modeling capabilities of transformers using Markov chains.
method Introducing a new framework to analyze transformers via Markov chains, characterizing their loss landscapes.
result Single-layer transformers often get stuck in local minima representing the unigram distribution, while deeper models reliably converge to the ground-truth bigram.

Modified Metropolis algorithm ensures convergence for multivariate binary distributions with fixed-order updates.

problem Infeasibility of standard Metropolis algorithm for multivariate binary distributions with fixed-order updates.
method Proposed a modified Metropolis transition operator ensuring irreducibility and convergence.
result Ensures convergence to the limiting distribution in multivariate binary case with fixed-order updates.

Paper analyzes symbolic-dynamics inspired Markov modeling for time-series data.

problem Capturing temporal patterns in sequential data for statistical learning.
method Two-step process: discretization of continuous attributes and estimation of temporal memory.
result Effective Markov modeling depends on accurate discretization and memory estimation.

Study efficient algorithms for nonconvex optimization with state-dependent Markov data.

problem Stochastic optimization with Markovian data and state-dependent transition kernels.
method Projection-based and projection-free algorithms for constrained nonconvex problems.
result The number of oracle calls to achieve an εε-stationary point is O(1/ε2.5)\mathcal{O}(1/ε^{2.5}).

This paper detects Markov violations in RL with noise, improving policy development.

problem Partial observability and sensor/actuator noise invalidate Markovian assumptions in RL.
method Combines PCMCI causal discovery with Markov Violation score (MVS).
result Even substantial noise doesn't always disrupt multi-step dependencies.

We investigate probabilistic graphical models that allow for both cycles and latent variables. For this we introduce directed graphs with hyperedges (HEDGes), generalizing and combining both marginalized directed acyclic graphs (mDAGs) that can model latent (dependent) variables, and directed mixed graphs (DMGs) that c…

2017-10-24abs ↗pdf ↗

New approach reveals causal and probabilistic relationships from equations.

problem Understanding causal and probabilistic relationships from sets of equations.
method Simon's causal ordering algorithm and Markov ordering graph construction.
result Implied conditional independences and causal relations without solving equations.

Algorithm improves reinforcement learning in MDPs with partial order policies.

problem Improving reinforcement learning in MDPs with partial order policies.
method Epoch-based reinforcement learning algorithm leveraging a partial order over policy class.
result Achieves an O(wlog(Θ)T)O(\sqrt{w \log(|Θ|) T}) regret bound, independent of state and action space sizes.

Decentralized stochastic gradient method emerges as a promising solution for solving large-scale machine learning problems. This paper studies the decentralized Markov chain gradient descent (DMGD) algorithm - a variant of the decentralized stochastic gradient methods where the random samples are taken along the trajec…

2019-09-23abs ↗pdf ↗

We introduce neural Markov logic networks (NMLNs), a statistical relational learning system that borrows ideas from Markov logic. Like Markov logic networks (MLNs), NMLNs are an exponential-family model for modelling distributions over possible worlds, but unlike MLNs, they do not rely on explicitly specified first-ord…

2019-05-31abs ↗pdf ↗