Unified formulation bridges adversarial and nonstationary bandits.
problem Handling time-varying reward distributions in multi-armed bandit problems.
method Unified oracle that switches between adversarial and nonstationary bandit oracles based on window size.
result Optimal regret achieved with matching lower bound.
Proposes ENCI for inferring nonstationary causal models.
problem Nonstationary data in real-world applications.
method Kernel embedding-based approach for multiple domains.
result Identifies cause-effect pairs and causal graphs under nonstationary conditions.
LISAL learns nonstationary spatio-temporal models efficiently.
problem Learning nonstationary spatio-temporal models in dynamic environments.
method LISAL uses Gaussian processes to model nonstationary dynamics and latent space changes.
result LISAL reduces computational cost by adaptively sampling latent space dynamics.
CtrlNS learns latent factors and distribution shifts from sparse transitions without prior knowledge.
problem Lack of prior knowledge of domain variables limits causal temporal representation learning.
method Sparse transition assumption and identifiability results from theoretical perspective.
result Effective in identifying distribution shifts and latent factors without prior knowledge.
Adaptive estimation for nonstationary time series reduces computational cost.
problem Estimating parameters of nonstationary time series with varying parameters over time.
method Moving exponential moving ML estimator for scale parameter estimation.
result Significantly improved log-likelihoods compared to standard estimation.
The paper analyzes prediction error in nonstationary settings using weighted risk minimization.
problem Prediction under distribution drift and nonstationary conditions.
method General decomposition of excess risk into learning and drift terms, proving oracle inequalities under mixing conditions.
result Oracle inequalities for the learning error, providing bounds that hold uniformly over arbitrary weight classes.
Adaptive t-distribution estimates nonstationary time series using moving moments.
problem Nonstationary time series with varying dependence structure.
method Moving estimator optimizing a weighted log-likelihood, using exponential moving averages for moments.
result Evolution of ν parameter in Student's t-distribution, capturing tail behavior and extreme events.
SyMPLER improves time series forecasting in nonstationary environments with explainable models.
problem Nonstationary time series forecasting with limited interpretability.
method Dynamic piecewise-linear approximations based on Statistical Learning Theory generalization bounds.
result SyMPLER achieves comparable performance to black-box and explainable models while maintaining interpretability.
A new algorithm maximizes entropy or mutual information for efficient inference of nonstationary Gaussian processes.
problem Nonstationary dynamics in real-world phenomena pose challenges to accurate modeling.
method LISAL algorithm that adaptively maximizes entropy or mutual information on induced latent dynamics and marginal likelihood.
result Efficient inference of nonstationary Gaussian processes for large-scale real-world applications.
A new method for nonstationary Gaussian processes using Fourier features.
problem Efficient simulation of nonstationary Gaussian processes with high-dimensional distributions.
method Discretizes the spectral representation of nonstationary processes, avoiding probability measure assumptions.
result An efficient low-rank approximation of nonstationary spectral densities, consistent and positive semi-definite.
New method tests independence with single nonstationary time series.
problem Testing independence in nonstationary nonlinear time series.
method Time-varying nonlinear regression, local long-run covariance estimation, strong Gaussian approximation.
result First framework for conditional independence testing with a single realization of a nonstationary nonlinear process.
Framework for causal discovery from changing data.
problem Challenges of causal discovery in heterogeneous or nonstationary data.
method Constraint-based CD-NOD framework for causal skeleton and orientation recovery, independent changes detection.
result Efficient estimation of causal mechanism changes and low-dimensional representation of nonstationarity.
We study a special case of the problem of statistical learning without the i.i.d. assumption. Specifically, we suppose a learning method is presented with a sequence of data points, and required to make a prediction (e.g., a classification) for each one, and can then observe the loss incurred by this prediction. We go …
TCP provides well-calibrated prediction intervals for nonstationary time series.
problem Nonstationary time series forecasting with well-calibrated prediction intervals.
method Temporal Conformal Prediction (TCP) couples a modern quantile forecaster with a rolling split-conformal calibration layer.
result TCP achieves near-nominal coverage, providing slightly wider intervals than Historical Simulation.
Flexible nonstationary Gaussian process with neural network parameters.
problem Limited expressiveness of stationary Gaussian processes.
method Nonstationary kernels with neural network parameters trained jointly.
result Better accuracy and log-score compared to stationary and hierarchical models.
LatentTrack generates model parameters online for nonstationary data.
problem Online probabilistic prediction under nonstationary dynamics.
method Sequential neural architecture with latent filtering and amortized inference.
result Consistently lower negative log-likelihood and mean squared error than baselines.
New framework for analyzing nonstationary time series using locally coupled Gaussian processes.
problem Analysis of nonstationary time series in various fields.
method Locally coupled Gaussian processes with hidden Markov model.
result Arbitrary complex nonstationary covariance functions can be obtained by combining simpler stationary building blocks.
Adaptive estimation of alpha-Stable distribution and Hurst exponent for nonstationary time series.
problem Nonstationary time series require adaptive models to avoid bias.
method Moving estimator with exponentially weakening weights of old values, optimized using EMA of absolute central moments.
result Continuous adaptive estimation of alpha-Stable distribution and Hurst exponent for market stability evaluation.
New method disentangles latent variables in nonstationary data.
problem Disentangling latent variables in nonstationary sequential data.
method NCTRL framework exploiting Markov assumption and temporal structure.
result Independent latent components can be recovered from nonlinear mixture without auxiliary variables.
Paper analyzes algorithms for nonstationary saddle-point optimization problems.
problem Nonstationary saddle-point optimization problems in game theory, reinforcement learning, and machine learning.
method Proposes extragradient and Frank-Wolfe algorithms for online and bandit settings.
result Establishes sub-linear regret bounds for the proposed algorithms.
DTS improves robustness of bandit algorithms in nonstationary environments.
problem Brittle behavior of multi-armed bandit algorithms in nonstationary exogenous factors.
method Deconfounded Thompson Sampling (DTS) that projects population-level performance while controlling for context.
result DTS provides resilience to exogenous variation and balances exploration and exploitation.
Prototype-based memory network learns visual categories from unlabeled data.
problem Learning from nonstationary, unlabeled data with sequential dependencies.
method Online prototype-based memory network with contrastive loss.
result Significantly better category recognition compared to state-of-the-art methods.
A new approach learns to represent context for nonstationary bandits.
problem Nonstationary contextual bandits where patterns change over time.
method Combines recurrent neural networks with contextual linear bandit algorithm.
result Consistently outperforms handcrafted historical contexts and other methods.
Model nonstationary spatial processes using normalizing flows.
problem Difficult selection of spatial warping functions.
method Neural autoregressive flows (NAFs) for complex, high-dimensional warpings.
result NAFs model has greater representational capacity than other spatial process models.
New algorithm for nonstationary multi-armed bandits with optimal performance.
problem Nonstationary multi-armed bandits with changing model parameters over time.
method Adaptive Resetting Bandit (ADR-bandit) algorithm using adaptive windowing techniques.
result ADR-bandit achieves nearly optimal performance in both abrupt and gradual changes.
ConvNets improve nonstationary covariance estimation for large-scale spatial data.
problem Estimating nonstationary spatial covariance functions on large scales.
method Convolutional Neural Networks (ConvNets) for subregion identification and selection.
result Enhanced accuracy in parameter estimation using ConvNet-based partitioning.
NonSTOP predicts nonstationary time series with improved performance.
problem Handling nonstationary artifacts in time series data.
method Applying transformations to time series in the learning with experts setting.
result Improved prediction performance through transformations and follow-the-leader analysis.
The paper tackles causal discovery and forecasting in nonstationary environments using state-space models.
problem Challenges in identifying causal relations and forecasting in nonstationary time series.
method Exploiting a particular type of state-space model to represent nonstationary processes, allowing changes in causal strengths and noise variances.
result Nonstationarity helps identify causal structure and improves forecasting.
SORSCNs improve nonstationary data modeling by self-organizing and adjusting network parameters.
problem Nonstationary data challenges traditional models in continuous learning.
method SORSCNs autonomously adjust network parameters and structure in real-time using adaptive algorithms.
result SORSCNs outperform other models in generalizing to nonstationary data.
Paper develops bandit algorithms for nonstationary nonconvex optimization.
problem Nonstationary online nonconvex optimization problems.
method Proposes and analyzes bandit algorithms for nonconvex functions with nonstationary regret.
result Develops bandit versions of Newton's method for nonstationary nonconvex optimization.
We analyze the question whether sliding window time averages applied to stationary increment processes converge to a limit in probability. The question centers on averages, correlations, and densities constructed via time averages of the increment x(t,T)=x(t+T)-x(t)and the assumption is that the increment is distribute…
The paper analyzes Adam and SGD in nonstationary optimization, revealing tradeoffs between noise and drift.
problem Analyzing Adam and SGD in nonstationary optimization problems.
method Theoretical analysis of Adam and SGD under non-stationary stochastic objectives, separating two regimes.
result Characterizes the tradeoff between noise and drift in Adam and SGD, revealing when adaptive step-sizing is beneficial or harmful.
We propose a method to clean covariance matrices of nonstationary systems by using time-independent eigenvalues.
problem Noise in covariance matrices of nonstationary systems with time-independent eigenvalues.
method Data-driven approach to use independent eigenvalues encoding long-term influence of future on present.
result Our method outperforms optimal stationary methods for filtering covariance matrix and its inverse.
Momentum SGD fails to track nonstationary optima due to drift amplification.
problem Tracking nonstationary optima in stochastic optimization.
method Theoretical analysis of SGD and momentum variants under strong convexity and smoothness.
result Momentum incurs a drift-amplification penalty that diverges as the momentum parameter approaches 1, leading to systematic lag.
New method identifies nonstationary causal structures in time series data.
problem Identifying causal relationships in time series data that change over time.
method High-order Markov Switching Models for regime-dependent causal discovery.
result Scalable approach for estimating high-order regime-dependent causal structures.
Improves spatial statistics with nonstationary kernels.
problem Limited expressiveness of stationary kernels in spatial statistics.
method Exploits Fourier feature representations and Gaussian processes to learn nonstationary kernels.
result Nonstationary kernels improve generalization and interpretability.
New method for identifying causal relationships in financial time series data.
problem Identifying causal relationships in nonstationary financial time series data.
method Refined constraint-based causal discovery algorithm (CD-NOTS) for nonstationary time series data.
result CD-NOTS effectively identifies causal connections in financial applications.
Markovian RNN adapts to nonstationary data using HMM for better time series prediction.
problem Nonstationary sequential data in real-life applications.
method Markovian RNN with HMM for regime switching and end-to-end optimization.
result Significant performance gains over vanilla RNN and Markov Switching ARIMA.
Extends inequalities to nonstationary Markov chains for better risk bounds.
problem Proving inequalities for nonstationary, non-i.i.d. Markov chains.
method Extends Dedecker and Fan's (2015) inequalities to nonstationary Markov chains.
result Provides a Bernstein-type inequality for periodic autoregressive processes.
AREBA algorithm improves learning from imbalanced, nonstationary data.
problem Learning from imbalanced, nonstationary data in online settings.
method Adaptive REBAlancing (AREBA) algorithm that selectively includes examples to maintain class balance.
result AREBA significantly outperforms other algorithms in learning speed and quality.
BerlinUCB learns from episodic rewards in nonstationary contexts.
problem Online learning with episodic rewards in nonstationary environments.
method BerlinUCB integrates clustering for self-supervision.
result BerlinUCB outperforms standard contextual bandits in various scenarios.
A novel nonstationary permanental process relaxes kernel constraints and captures complex data patterns.
problem Limitations of existing permanental processes in terms of kernel types and stationarity.
method Sparse spectral representation of nonstationary kernels and hierarchical stacking of spectral feature mappings.
result Enhanced model expressiveness and reduced computational complexity.
New method infers causal relationships from nonstationary time series data.
problem Challenges in inferring causal relationships from nonstationary time series data.
method Proposes a new class of restricted SCM with time-varying filters and stationary noise, leveraging asymmetry from nonstationarity.
result Demonstrates effectiveness of the proposed methodology on various synthetic and real datasets.
Optimizes spectral density estimation for stationary and nonstationary processes.
problem Estimating spectral density of time series with complex structure.
method Optimally adaptive Bayesian spectral density estimation using smoothing spline covariance structure.
result Optimal eigendecomposition provides superior performance compared to alternative covariance functions.
Bayesian topological learning improves EEG signal analysis for brain state classification.
problem Challenges in classifying and analyzing noisy, nonlinear, nonstationary EEG signals.
method Persistent homology with Bayesian framework to track topological features and incorporate prior knowledge.
result Bayesian topological learning outperforms existing methods for noisy EEG classification.
Develops nonstationary MOGP kernels for better performance.
problem Limited applicability of existing MOGP kernels for nonstationary data.
method Harmonizable spectral mixture kernels for nonstationary MOGP.
result Automatic identification of nonstationary behavior in data.
Online learning of nonstationary functions using Gaussian processes.
problem Real-time estimation of time-dependent functions with Gaussian processes.
method Sequential Monte Carlo algorithm for infinite mixtures of non-stationary GPs.
result Empirical improvement over state-of-the-art methods for online GP estimation.
New RL algorithm tackles nonstationary MDPs with linear approximations and varying rewards.
problem Nonstationary reinforcement learning with evolving reward and state transition functions.
method Developed a new algorithm LSVI-UCB-Restart with periodic restart, and parameter-free Ada-LSVI-UCB-Restart for unknown variation budgets.
result First minimax dynamic regret lower bound for nonstationary linear MDPs and linear MDPs lower bound.