This paper considers regression tasks involving high-dimensional multivariate processes whose structure is dependent on some {known} graph topology. We put forth a new definition of time-vertex wide-sense stationarity, or joint stationarity for short, that goes beyond product graphs. Joint stationarity helps by reducin…
Solves POMDPs with recurrent neural networks and natural policy gradient.
problem Non-stationarity in optimal policies of POMDPs.
method Integrates recurrent neural networks into natural policy gradient and temporal difference learning.
result Non-asymptotic theoretical guarantees for global optimality up to function approximation.
The paper sets lower bounds for sampling non-log-concave distributions using Fisher information.
problem Understanding the complexity of sampling non-log-concave distributions.
method Proves two lower bounds using Fisher information in the context of sampling.
result Lower bounds on the complexity of sampling non-log-concave distributions, ruling out high-accuracy algorithms.
New sampling method guarantees approximate first-order stationary points for non-convex functions.
problem Sampling from non-log-concave densities with non-convex potential functions.
method Averaged Langevin Monte Carlo with complexity analysis.
result Langevin Monte Carlo outputs a sample with ε-relative Fisher information after O(L²d²/ε²) iterations.
TSFMs embed non-stationary time series data, revealing specific types of changes.
problem Understanding non-stationarity in TSFMs' embedding spaces.
method Examined mean shifts, variance changes, linear trends, and persistence in TSFMs.
result Different TSFMs exhibit distinct failure modes in detecting non-stationarity.
We propose a new Quantization algorithm for the approximation of inhomogeneous random walks, which are the key terms for the valuation of CDO-tranches in latent factor models. This approach is based on a dual quantization operator which posses an intrinsic stationarity and therefore automatically leads to a second orde…
A new TS-SA method alleviates non-stationarity in TS algorithms for bandits.
problem Non-stationarity in existing TS algorithms for multi-armed bandits.
method Integrates stochastic approximation within TS framework, using Langevin Monte Carlo and SA steps.
result Establishes near-optimal regret bounds for TS-SA, with simplified analysis.
Study on fake stationary Volterra Heston model for non-stationary processes.
problem Non-stationary nature of true Volterra equations.
method Weak notion of stationarity (fake stationary regime) for inhomogeneous affine Stochastic Volterra equations.
result Existence of limiting distributions in the long run, which may depend on initial state.
Proposes LSGP for better graph signal representation.
problem Local variations in graph process characteristics.
method Locally stationary graph process (LSGP) model.
result LSGP provides accurate signal representations.
Deep RL agents suffer from transient non-stationarity, which ITER mitigates.
problem Transient non-stationarity in deep RL agents affects generalization.
method Iterated Relearning (ITER) transfers knowledge between networks to reduce non-stationarity.
result ITER improves deep RL agents' performance on generalization benchmarks.
Reinforcement learning (RL) has had many successes in both "deep" and "shallow" settings. In both cases, significant hyperparameter tuning is often required to achieve good performance. Furthermore, when nonlinear function approximation is used, non-stationarity in the state representation can lead to learning instabil…
TimeBridge addresses non-stationarity in long-term time series forecasting.
problem Non-stationarity in multivariate time series leads to spurious regressions and obscures long-term relationships.
method TimeBridge segments series into patches, applying Integrated Attention for short-term non-stationarity and Cointegrated Attention for long-term cointegration.
result TimeBridge achieves state-of-the-art performance in both short-term and long-term forecasting.
This paper compares stationarity in Bitcoin and S&P500 price indices.
problem Comparing stationarity in cryptocurrency and traditional stock market indices.
method Wide sense stationarity defined; Wiener-Khinchin Theorem applied; stationarity achieved through detrending and normalization of price returns.
result S&P500 price return achieves stationarity for 28 years with specific normalization windows, while Bitcoin's stationarity varies by segment and volatility.
The Bivariate Dynamic Contagion Processes (BDCP) are a broad class of bivariate point processes characterized by the intensities as a general class of piecewise deterministic Markov processes. The BDCP describes a rich dynamic structure where the system is under the influence of both external and internal factors model…
We study tick-by-tick financial returns belonging to the FTSE MIB index of the Italian Stock Exchange (Borsa Italiana). We can confirm previously detected non-stationarities. However, scaling properties reported in the previous literature for other high-frequency financial data are only approximately valid. As a conseq…
Consider the problem: given the data pair (x,y) drawn from a population with f∗(x)=E[y∣x=x], specify a neural network model and run gradient flow on the weights over time until reaching any stationarity. How does ft, the function computed by the neural network…
In this paper, we focus on solving a class of constrained non-convex non-concave saddle point problems in a decentralized manner by a group of nodes in a network. Specifically, we assume that each node has access to a summand of a global objective function and nodes are allowed to exchange information only with their n…
Bayesian optimization uses BNNs as efficient surrogate models for expensive function evaluations.
problem Optimizing expensive objective functions using Gaussian process surrogates.
method Study of Bayesian neural networks (BNNs) as alternatives to standard Gaussian process (GP) surrogates for optimization.
result Infinite-width BNNs are particularly promising, especially in high dimensions.
Natural spatiotemporal processes can be highly non-stationary in many ways, e.g. the low-level non-stationarity such as spatial correlations or temporal dependencies of local pixel values; and the high-level variations such as the accumulation, deformation or dissipation of radar echoes in precipitation forecasting. Fr…
New approach for principal curves on spherical data.
problem Dimension reduction of spherical data.
method Projection of data onto a continuous curve on a sphere.
result Stationary principal curves on a sphere.
Method solves complex optimization problems with high probability bounds.
problem Nonlinear equality constrained stochastic optimization problems.
method Step-search sequential quadratic programming method.
result High-probability bound on iteration complexity for first-order stationarity.
The paper explores various stationarity concepts in non-smooth optimization.
problem Understanding stationarity in non-smooth optimization problems.
method Introduction and discussion of different stationarity concepts for non-convex non-smooth functions.
result Clarification of the relationship among different stationarity concepts and their relevance in iterative methods.
Gaussian processes (GPs), or distributions over arbitrary functions in a continuous domain, can be generalized to the multi-output case: a linear model of coregionalization (LMC) is one approach. LMCs estimate and exploit correlations across the multiple outputs. While model estimation can be performed efficiently for …
Improved stock return prediction model handles noise and non-stationarity.
problem Predicting stock returns with robustness to noise and non-stationarity.
method Extended AROW algorithm to handle synchronous mini-batch updates and applied it to stock return prediction.
result The new model outperforms classical approaches in backtesting on S\&P500 stocks.
A new MCMC method for GPs tackles computational burden and intractable likelihoods.
problem High computational burden and intractable likelihoods in Gaussian process models.
method Combines variationally sparse Gaussian processes with pseudo-marginal MCMC.
result Asymptotically exact inference with computational gains for large datasets.
Master algorithm fails to detect non-stationarity in practical settings.
problem Non-Stationary Reinforcement Learning without prior knowledge.
method Master algorithm tested under various conditions, including piecewise stationary multi-armed bandits.
result Master's non-stationarity detection is ineffective for practical horizons, leading to performance similar to random restarting.
We use variational Gaussian approximations to analyze parametric models with unknown data-generating distributions.
problem Analyzing inference and learning in parametric models with unknown or intractable data-generating distributions.
method Replica method with variational Gaussian approximation in grand canonical formalism.
result Stationarity conditions adaptively determine parameters of the trial Hamiltonian for each dataset.
Inter-domain Deep Gaussian Processes improve inference for non-stationary data.
problem Inference limitations in Gaussian processes for non-stationary data.
method Combines inter-domain and deep Gaussian processes for scalable approximate inference.
result Outperforms inter-domain shallow GPs and conventional DGPs on non-stationary data.
New algorithm finds approximate stationary points faster under differential privacy constraints.
problem Finding approximate stationary points of smooth and Lipschitz functions under differential privacy constraints.
method Developed an efficient algorithm that improves convergence rates to stationary points.
result Achieved faster rates of convergence to stationary points in both finite-sum and stochastic settings.
Study classifies stock price data into stationary and non-stationary periods for mechanical trading.
problem Classifying stock price fluctuations into stationary and non-stationary periods for trading.
method Stationarity analysis using KM2O-Langevin theory and trend-based indicators for stationary periods, oscillator-based indicators for non-stationary periods. result Back testing confirms the strategy is a safe trading strategy with small maximum drawdown.
Study large deviation in stationarized fully lifted blirp interpolation.
problem Understanding atypical solutions in random optimization problems.
method Large deviation theory applied to fully lifted blirp interpolation.
result Elegant relations uncovered for fundamental interpolating parameters.
Study non-stationary bandits with resource constraints.
problem Maximize reward in a non-stationary environment with resource constraints.
method Propose new non-stationarity measure and use primal-dual analysis.
result Upper and lower bounds for non-stationary BwK problem.
We study critera for a pair ({Xn}, {Yn}) of approximating processes which guarantee closeness of moments by generalizing known results for the special case that Yn=Y for all n and Xn converges to Y in probability. This problem especially arises when working with surrogate models, e.g. …
Neural population activity often exhibits rich variability and temporal structure. This variability is thought to arise from single-neuron stochasticity, neural dynamics on short time-scales, as well as from modulations of neural firing properties on long time-scales, often referred to as "non-stationarity". To better …
Paper tackles uncertainty prediction for deep sequential regression.
problem Challenges in generating accurate uncertainty estimates for deep recurrent networks.
method Flexible method that generates symmetric and asymmetric uncertainty estimates without stationarity assumptions.
result Outperforms competitive baselines on both drift and non-drift scenarios.
Framework isolates causal effects from time series data, improving accuracy under non-stationarity and autocorrelation.
problem Causal inference in non-stationary, autocorrelated time series data.
method Decomposes time series into trend, seasonal, and residual components; performs component-specific causal analysis.
result Framework more accurately recovers ground-truth causal structure than state-of-the-art baselines, especially under strong non-stationarity and temporal autocorrelation.
Study uses RL to optimize dynamic portfolios, addressing non-stationarity and constraints.
problem Non-stationarity and investment constraints in dynamic portfolio optimization.
method Reinforcement learning with regime change variables and practical constraints integration.
result Enhanced prediction accuracy through incorporation of regime change variables.
This article develops a statistical test for the null hypothesis of strict stationarity of a discrete time stochastic process in the frequency domain. When the null hypothesis is true, the second order cumulant spectrum is zero at all the discrete Fourier frequency pairs in the principal domain. The test uses a window …
Develops RL algorithm for lifelong non-stationary environments.
problem Challenges of reinforcement learning in environments with persistent change.
method Formalizes lifelong non-stationarity, uses latent variable models, and leverages online learning and probabilistic inference.
result Substantial improvement in performance over non-reasoning approaches in lifelong non-stationary environments.
Gaussian processes (GPs) are commonplace in spatial statistics. Although many non-stationary models have been developed, there is arguably a lack of flexibility compared to equipping each location with its own parameters. However, the latter suffers from intractable computation and can lead to overfitting. Taking the i…
New method for estimating and optimizing MDPs without stationarity.
problem Challenges in offline contextual MDP estimation without stationarity.
method Introduces a new adaptive estimation and cost optimization approach for contextual MDPs.
result First robust, theoretically backed method for offline contextual MDP estimation.
New conditions for ACD model consistency and normality.
problem Random number of durations in ACD model.
method Additional sufficient conditions for consistency and normality of QMLE.
result Finite mean of durations is required for consistency and normality.
This paper explores twisted Lagrangian tori in C^2 and their Hamiltonian stationarity.
problem Understanding the Hamiltonian stationarity of twisted Lagrangian tori in C^2.
method Investigation of differential geometry of twisted tori, including product and Chekanov's exotic tori.
result Only product tori are minimal under Hamiltonian deformations, indicating Chekanov's exotic tori are not area minimal.
We propose a new framework for the analysis of low-rank tensors which lies at the intersection of spectral graph theory and signal processing. As a first step, we present a new graph based low-rank decomposition which approximates the classical low-rank SVD for matrices and multi-linear SVD for tensors. Then, building …
Graph-based methods for signal processing have shown promise for the analysis of data exhibiting irregular structure, such as those found in social, transportation, and sensor networks. Yet, though these systems are often dynamic, state-of-the-art methods for signal processing on graphs ignore the dimension of time, tr…
Proposes a probabilistic framework for stationary topological signals on simplicial complexes.
problem Complex data structures require new models and tools.
method Generalizes stationarity to topological signals on simplicial complexes.
result Defines topological power spectral density (PSD) for stationary signals.
A new QHR model extends HR model with a quadratic variance function.
problem Modeling volatility with greater flexibility and stationarity.
method Introducing a quadratic variance function to the HR model, maintaining Markovian property.
result Stationary distribution of the QHR model is Pearson type IV.
S&P 500 index data sampled at one-minute intervals over the course of 11.5 years (January 1989- May 2000) is analyzed, and in particular the Hurst parameter over segments of stationarity (the time period over which the Hurst parameter is almost constant) is estimated. An asymptotically unbiased and efficient estimator …