We introduce a new unsupervised learning problem: clustering wide-sense stationary ergodic stochastic processes. A covariance-based dissimilarity measure together with asymptotically consistent algorithms is designed for clustering offline and online datasets, respectively. We also suggest a formal criterion on the eff…
Estimates network structure from correlated node outputs of wide-sense stationary processes.
problem Learning edge connectivity from node outputs of latent inputs.
method Wide-sense stationary stochastic processes, Laplacian matrix estimation, ℓ1-regularized Whittle's MLE.
result The MLE recovers the sparsity pattern of the Laplacian matrix with high probability.
This paper compares stationarity in Bitcoin and S&P500 price indices.
problem Comparing stationarity in cryptocurrency and traditional stock market indices.
method Wide sense stationarity defined; Wiener-Khinchin Theorem applied; stationarity achieved through detrending and normalization of price returns.
result S&P500 price return achieves stationarity for 28 years with specific normalization windows, while Bitcoin's stationarity varies by segment and volatility.
This paper considers regression tasks involving high-dimensional multivariate processes whose structure is dependent on some {known} graph topology. We put forth a new definition of time-vertex wide-sense stationarity, or joint stationarity for short, that goes beyond product graphs. Joint stationarity helps by reducin…
Graphs are a central tool in machine learning and information processing as they allow to conveniently capture the structure of complex datasets. In this context, it is of high importance to develop flexible models of signals defined over graphs or networks. In this paper, we generalize the traditional concept of wide …
Stationary polyhedral varifolds minimize area in two senses.
problem Minimizing area of polyhedral varifolds.
method Proves minimization of area through specific conditions.
result Stationary polyhedral varifolds minimize area in two senses.
Proves singular set of certain integral hypercurrents has measure zero.
problem Characterizing singular sets of specific integral hypercurrents.
method Proof based on varifold stationarity.
result Singular set has measure zero.
Study on fake stationary Volterra Heston model for non-stationary processes.
problem Non-stationary nature of true Volterra equations.
method Weak notion of stationarity (fake stationary regime) for inhomogeneous affine Stochastic Volterra equations.
result Existence of limiting distributions in the long run, which may depend on initial state.
New method for testing directed graphs using surrogate data.
problem No established method for statistical testing on directed graphs.
method Define directed graph wide-sense stationary signals, generate surrogates preserving covariance, construct null distributions.
result Feasibility and superiority of new approach over existing methods.
Extends geometric approach to model non-stationary extremal dependence.
problem Capturing evolving extremal dependence in multivariate data.
method Geometric framework for non-stationary multivariate extreme value modelling.
result Framework can capture various dependence forms and is robust to different model formulations.
The method approximates stationary distributions of Markov models by truncating irrelevant states.
problem Computing the stationary distribution of complex Markov models is computationally challenging.
method A state-space lumping scheme that aggregates states in a grid structure, iteratively refining the state-space.
result The method provides a well-justified finite-state projection tailored to the stationary behavior of Markov models.
Wavelet scattering spectra model non-Gaussian time-series, proving scale invariance for self-similar processes.
problem Modeling non-Gaussian time-series with stationary increments.
method Complex wavelet transform for scale variations, joint correlation matrix for scale dependencies, second wavelet transform for diagonalization, maximum entropy models conditioned by scattering spectra coefficients.
result Scattering spectra of self-similar processes are scale invariant, allowing statistical testing and generation of new time-series.
Transformers achieve near-optimal dynamic regret in non-stationary reinforcement learning.
problem Understanding and handling non-stationary environments in reinforcement learning.
method Demonstrated that transformers can achieve nearly optimal dynamic regret bounds in non-stationary settings.
result Transformers can approximate and learn strategies for non-stationary environments, matching or outperforming existing expert algorithms.
In this short report, we investigate the ability of the DCCA coefficient to measure correlation level between non-stationary series. Based on a wide Monte Carlo simulation study, we show that the DCCA coefficient can estimate the correlation coefficient accurately regardless the strength of non-stationarity (measured b…
New definition resolves ambiguity in non-stationary bandit classification.
problem Ambiguity in classifying non-stationary bandits using existing definitions.
method Introducing a formal definition that resolves ambiguity and provides a unified approach.
result Unified approach applicable to both Bayesian and frequentist formulations, resolves classification issues.
This article determines the spectral data, in the integrable systems sense, for all weakly conformally immersed Hamiltonian stationary Lagrangian in R4. This enables us to describe their moduli space and the locus of branch points of such an immersion. This is also an informative example in integrable systems geome…
We construct stationary flat three-dimensional Lorentzian manifolds with singularities that are obtained from Euclidean surfaces with cone singularities and closed one-forms on these surfaces. In the application to (2+1)-gravity, these spacetimes correspond to models containing massive particles with spin. We analyse t…
DESTRESS optimizes decentralized nonconvex optimization with optimal IFO complexity and efficient communication.
problem Decentralized nonconvex finite-sum optimization in multi-agent systems.
method DESTRESS uses stochastic recursive gradient updates, gradient tracking, and careful hyper-parameter choices to achieve optimal IFO complexity with efficient communication.
result DESTRESS matches the optimal IFO complexity of centralized algorithms while maintaining communication efficiency.
The expressive power of Gaussian processes depends heavily on the choice of kernel. In this work we propose the novel harmonizable mixture kernel (HMK), a family of expressive, interpretable, non-stationary kernels derived from mixture models on the generalized spectral representation. As a theoretically sound treatmen…
Predictive sampling improves on Thompson sampling for non-stationary bandit environments.
problem Thompson sampling fails in non-stationary bandit environments.
method Proposes predictive sampling, which deprioritizes actions based on information loss rate.
result Predictive sampling outperforms Thompson sampling in all tested non-stationary environments.
Electroencephalographic (EEG) monitoring of neural activity is widely used for sleep disorder diagnostics and research. The standard of care is to manually classify 30-second epochs of EEG time-domain traces into 5 discrete sleep stages. Unfortunately, this scoring process is subjective and time-consuming, and the defi…
The paper models financial markets using information theory to minimize information.
problem Understanding the dynamics of financial markets.
method Modeling financial market dynamics with independent stationary scalar diffusions, interpreting the market as a communication system, and minimizing information-theoretical joint information.
result Financial market dynamics are represented by squared radial Ornstein-Uhlenbeck processes with additivity and self-similarity properties.
Gradient descent and its variants are widely used in machine learning. However, oracle access of gradient may not be available in many applications, limiting the direct use of gradient descent. This paper proposes a method of estimating gradient to perform gradient descent, that converges to a stationary point for gene…
Study on recovering Lorentzian metrics from scattering data.
problem Recovering Lorentzian metrics from scattering data on a boundary.
method Analyzing the role of boundary distance functions and linearizing the light ray transform.
result Scattering rigidity can be reduced to boundary rigidity of magnetic systems.
Formula derived for blow-up of quaternionic maps on Hyperkähler manifolds.
problem Analyzing the behavior of quaternionic maps near singularities.
method Deriving a blow-up formula for the limit of weakly converging quaternionic maps.
result A blow-up formula for the limit of quaternionic maps is derived.
Algorithm speeds up search for stationary targets with guaranteed accuracy.
problem Minimize search time while ensuring high detection accuracy of stationary targets.
method Multi-fidelity Gaussian process model and EMTS algorithm.
result Guaranteed performance in target detection accuracy and search time.
New algorithm for non-stationary bandits with slow drifts.
problem Minimizing dynamic regret in non-stationary bandits with slowly varying rewards.
method Extends Successive Elimination to non-stationary bandits with a novel gap profile characterization.
result First instance-dependent regret upper bound for slowly varying non-stationary bandits.
New algorithms reduce dynamic regret in non-stationary RL environments.
problem Optimizing policies in environments that change over time.
method POWER and POWER++ algorithms for policy optimization with dynamic regret analysis.
result POWER++ improves dynamic regret by actively adapting to non-stationarity.
Policy gradients methods apply to complex, poorly understood, control problems by performing stochastic gradient descent over a parameterized class of polices. Unfortunately, even for simple control problems solvable by standard dynamic programming techniques, policy gradient algorithms face non-convex optimization pro…
Hamiltonian stationary Lagrangian submanifolds (HSLAG) are a natural generalization of special Lagrangian manifolds (SLAG). The latter only make sense on Calabi-Yau manifolds whereas the former are defined for any almost Kähler manifold. Special Lagrangians, and, more specificaly, fibrations by special Lagrangians play…
New algorithm reduces dynamic regret without prior function change knowledge.
problem Non-stationary stochastic optimization with bandit feedback.
method Fixed step sizes combined with multi-scale sampling framework.
result Achieves optimal dynamic regret without prior function change knowledge.
We consider a column of a rotating stationary surface in Euclidean space. We obtain a value l0>0 in such way that if the length l of column satisfies l>l0, then the surface is instable. This extends, in some sense, previous results due to Plateau and Rayleigh for columns of surfaces with constant mean curvature…
Develops nonstationary MOGP kernels for better performance.
problem Limited applicability of existing MOGP kernels for nonstationary data.
method Harmonizable spectral mixture kernels for nonstationary MOGP.
result Automatic identification of nonstationary behavior in data.
Wide and shallow networks approximate convex functions well.
problem Understanding why wide and shallow neural networks perform well.
method Analyzing the epigraph of the input-output map of shallow and wide neural networks.
result The epigraph of the input-output map approximates a convex function.
New method improves stability of soft FQI for offline RL.
problem Stability issues in soft FQI under function approximation.
method Stationary reweighting to align operator norms.
result Local linear convergence proved under certain conditions.
I propose a frequency domain adaptation of the Expectation Maximization (EM) algorithm to group a family of time series in classes of similar dynamic structure. It does this by viewing the magnitude of the discrete Fourier transform (DFT) of each signal (or power spectrum) as a probability density/mass function (pdf/pm…
Non-stationary reinforcement learning is challenging due to the complexity of updating value functions.
problem Challenges in non-stationary reinforcement learning, especially in updating value functions.
method Proved a worst-case complexity result for modifying reinforcement learning problems.
result Modifying reinforcement learning problems requires an amount of time almost as large as the number of states.
A new kernel improves Gaussian process performance for non-stationary data.
problem Poor prediction and uncertainty quantification with standard GPs.
method Study and comparison of non-stationary kernels, propose a new combined kernel.
result A new kernel outperforms existing stationary and non-stationary kernels.
New insights into Bartnik mass from improvability of dominant energy scalar.
problem Characterizing Bartnik mass minimizing initial data sets.
method Introducing improvability concept, proving non-improvability consequences, and analyzing pp-wave counterexamples.
result Bartnik mass minimizing initial data sets are characterized, advancing conjectures.
Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this relatively low degree of popularity is the lack of a well developed system of theory an…
Study reveals convergence properties of SGD with random learning rate.
problem Analyzing convergence of SGD with random learning rate in non-convex optimization.
method Introduced Poisson SGD with random learning rate and used stationary distribution analysis.
result Poisson SGD converges to a stationary distribution and finds global minima in non-convex optimization.
G-framework is presented by Peng [41] for measure risk under uncertainty. In this paper, we define fractional G-Brownian motion (fGBm). Fractional G-Brownian motion is a centered G-Gaussian process with zero mean and stationary increments in the sense of sub-linearity with Hurst index H∈(0,1). This process has sta…
Weight normalization speeds up matrix sensing problems.
problem Matrix sensing with overparameterization.
method Generalized weight normalization with Riemannian optimization.
result WN achieves linear convergence, improving speed and complexity.
Recently, a new viewpoint on the classical c-boundary in Mathematical Relativity has been developed, the relations of this boundary with the conformal one and other classical boundaries have been analyzed, and its computation in some classes of spacetimes, as the standard stationary ones, has been carried out. In the p…
Paper establishes lower bounds for non-stationary kernelized bandits.
problem Optimizing functions with noisy observations in non-stationary scenarios.
method Develops algorithm-independent lower bounds for time-varying functions under total variation constraints.
result First algorithm-independent lower bounds for time-varying kernelized bandits.
We present an information-theoretic framework for sequential adaptive compressed sensing, Info-Greedy Sensing, where measurements are chosen to maximize the extracted information conditioned on the previous measurements. We show that the widely used bisection approach is Info-Greedy for a family of k-sparse signals b…
Study of spacelike submanifolds in spherical RW spacetime, proving a Lorentzian Takahashi theorem.
problem Characterizing stationary spacelike submanifolds in spherical RW spacetime.
method Embedding spherical RW spacetime in Lorentz-Minkowski spacetime, studying Lorentzian hypersurfaces, and applying results to submanifolds.
result Wide extension of Lorentzian Takahashi theorem for stationary spacelike submanifolds.
New Hida-Matérn kernels enable flexible process priors and efficient GP inference.
problem Flexible modeling of stationary processes with oscillatory components.
method Introducing a new class of covariance functions (Hida-Matérn kernels) and their state space representations.
result Efficient Gaussian Process inference and improved numerical stability.