Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

69137206274 · May 202619922001200920172026
48 results for mixed regime

Unified formula for training dynamics of linear networks combining lazy and balanced regimes.

problem Training dynamics of linear networks in two distinct setups: lazy and balanced/active.
method Unified formula for the evolution of the learned matrix, combining lazy and balanced regimes.
result Unified formula allows for rapid convergence and low rank bias, proving a complete phase diagram.

New model clusters mixed-type data with missing values, improving air quality analysis.

problem Clustering mixed-type data with missing values and regime persistence.
method Statistical jump model incorporating regime persistence and handling missing data.
result Superior performance in inferring persistent air quality regimes compared to traditional methods.

In this article we discuss some of the consequences of the mixed membership perspective on time series analysis. In its most abstract form, a mixed membership model aims to associate an individual entity with some set of attributes based on a collection of observed data. Although much of the literature on mixed members…

2013-09-13abs ↗pdf ↗

Study bounds noise level in linear regression with dependent data.

problem Analyzing noise level in linear regression with dependent data.
method Derive upper bounds for random design linear regression with ββ-mixing data, without realizability assumptions.
result Correctly recovers the noise level of the problem, exhibiting graceful degradation with misspecification.

EM algorithm achieves optimal sample complexity for learning two-component mixed linear regression.

problem Learning two-component mixed linear regression under varying signal-to-noise ratios.
method Analysis of EM algorithm convergence rates under different SNR regimes.
result EM algorithm achieves minimax optimal sample complexity in all SNR regimes.

HANET combines LSTM and attention mechanisms for better financial forecasting.

problem Lack of distinct macroeconomic regimes in financial datasets.
method Hierarchical Cross-Attention mechanism integrating long-run macro contexts with high-frequency market dynamics.
result HANET outperforms neural forecasters, especially during turbulent periods.

New insights into statistical and computational limits for mixed sparse linear regression.

problem Recovering two sparse signals from noisy linear measurements.
method Analysis of low-degree polynomials and a simple thresholding algorithm.
result Identification of a smooth information-computation tradeoff and order-optimality of the thresholding algorithm.

Generative model identifies temporal count data components with regime-dependent contributions.

problem Modeling temporal count data with regime-dependent dynamics.
method Generative framework combining regime-adaptive dynamics with Poisson log-normal emissions.
result Established identifiability of the model and revealed co-variation patterns and regime shifts.

The paper analyzes convergence rates of Langevin dynamics and Proximal Sampler using ΦΦ-divergence.

problem Analyzing convergence rates of Langevin dynamics and Proximal Sampler.
method Extending mixing time analyses to ΦΦ-divergence, using strong data processing inequalities.
result Convergence of ΦΦ-divergence to 0 exponentially fast along Unadjusted Langevin Algorithm and Proximal Sampler.

The study examines mixing times of data-augmentation Gibbs samplers for high-dimensional probit regression.

problem Investigating convergence properties of data-augmentation samplers for Bayesian probit regression.
method Using recent results on Gibbs samplers for log-concave targets, the study provides non-asymptotic bounds on mixing times.
result Explicit non-asymptotic bounds on mixing times depend on design matrix and prior precision, holding uniformly over responses.

Spectral methods improve signal recovery in mixed GLMs with precise asymptotics.

problem Estimating multiple signals from unlabeled observations in mixed GLMs.
method Developed exact asymptotics for spectral methods in a proportional regime.
result Optimized spectral method combined with a linear estimator minimizes estimation error.

A new framework uses an Incremental Transformer to design geopolymer mixtures efficiently.

problem Designing geopolymer mixtures with limited data and physical constraints.
method Topology-aware surrogate framework guided by Incremental Transformer.
result The design space is redundant, with fewer effective mixture regimes.

DeRegiME forecasts with regime structure, improving probabilistic predictions across various time series.

problem Probabilistic forecasting discards residual uncertainty, and distribution shifts are hard to capture.
method DeRegiME uses a sparse variational Gaussian process with a nonstationary regime-mixing kernel to separate latent uncertainty regimes.
result DeRegiME improves NLPD by 20.3% on average across benchmarks, with gains on CRPS and MSE.

Study free energy in spherical spin glasses, proving universality dichotomy.

problem Analyzing free energy in spherical spin glass models with different tail exponents.
method Introduced a tail-adapted normalization and used universality dichotomy.
result Sharp universality dichotomy for free energy across different tail exponents.

Curriculum learning helps neural networks learn parities more efficiently.

problem Improving learning efficiency for neural networks on parity targets.
method Using a curriculum learning approach with a mixture of sparse and dense inputs.
result A 2-layer ReLU neural network can learn parities more efficiently than a fully connected network.

Reflective Hamiltonian Monte Carlo struggles with high-dimensional sampling.

problem Slow mixing in reflective Hamiltonian Monte Carlo with inexact reflections.
method Quantifying instantaneous non-uniformity with Sinkhorn divergence; analyzing particle motion in spheres and cubes; constructing low-dimensional toy models.
result Particles spontaneously unmix, leading to resonances in particle density.

Mix-n-Match improves uncertainty calibration in deep learning.

problem Post-hoc calibration of machine learning classifiers.
method Ensemble and composition strategies to improve accuracy, efficiency, and expressive power.
result Mix-n-Match strategies achieve better data-efficiency and expressive power while maintaining classification accuracy.

The problem of finding overlapping communities in networks has gained much attention recently. Optimization-based approaches use non-negative matrix factorization (NMF) or variants, but the global optimum cannot be provably attained in general. Model-based approaches, such as the popular mixed-membership stochastic blo…

2016-07-01abs ↗pdf ↗

Optimal SD improves ridge regression performance strictly and precisely.

problem Improving ridge regression performance through self-distillation.
method Analyzes unconstrained SD for ridge regression, deriving optimal mixing weight and asymptotic risk.
result Optimal SD strictly improves ridge regression performance, with exact risk equivalents derived.

New AMP algorithm estimates signals and latent variables in mixed regression models.

problem Estimating signals and latent variables in mixed regression models.
method Approximate Message Passing (AMP) algorithm for matrix GLM.
result State evolution recursion and optimal denoising functions for precise error minimization.

Adding linear layers to ReLU networks favors functions with low mixed variation.

problem Understanding function space bias in overparameterized neural networks.
method Examined a family of networks with varying depths and same capacity but different representation costs, focusing on the effect of adding linear layers to the input side.
result Adding linear layers to shallow ReLU networks results in a bias towards functions with low mixed variation, which can be well approximated by single- or multi-index models.

Study long-only minimum variance portfolio in one-factor market with arbitrary sign betas.

problem Characterize the long-only minimum variance portfolio in a one-factor market with mixed-sign betas.
method Explicit solution for long-only minimum variance portfolio, explicit characterization of active set, asymptotic analysis in high-dimensional regime.
result Proportion of active assets in LOMV portfolio converges to F(β)F(β^*) in high-dimensional regime, with rate O(F(0)1/3)O(F(0)^{1/3}) when F(0)>0F(0) > 0.

AM converges super-linearly for solving mixed linear regression problems.

problem Learning linear regressors from unlabeled observations in multiple linear regression models.
method Alternating Minimization (AM) algorithm, which alternates between label estimation and regression solving.
result AM converges super-linearly in certain parameter regimes, requiring only O(log log(1/ε)) iterations to achieve an error of ε.

This paper examines cryptocurrency integration with traditional markets, showing how network structure and turbulence influence cross-asset spillovers.

problem Understanding how cryptocurrencies integrate with traditional financial markets and the impact of market stress on cross-asset spillovers.
method Combining rolling correlation networks, community structure, market-specific and system-wide Turbulence Indices, and VAR-based connectedness analysis.
result Cross-asset integration is episodic, with network structure and turbulence playing a role in transmission during stress periods.

Paper analyzes EM algorithm's trajectory in 2MLR, revealing cycloid behavior.

problem Understanding the convergence and trajectory of EM algorithm in 2MLR.
method Explicit closed-form expressions for EM updates, recurrence relation derivation at population level.
result EM iterations lie on a cycloid trajectory, leading to theoretical estimate of convergence exponent.

The study analyzes numerical stability in large language models using mixed-precision arithmetic.

problem Numerical stability of large language models using low-precision arithmetic.
method Developed a mixed-precision analysis of transformer inference, deriving bounds for condition numbers and forward error.
result Established that numerical stability is determined by the interplay between weight magnitude and the growth of the residual stream.

New model predicts energy prices under different scenarios.

problem Complex causal relationships in energy markets with continuous regime changes.
method Augmented Time Series Structural Causal Models (ATSCM) integrating neural causal discovery.
result Enables novel counterfactual queries in energy markets.

Time series forecasting models fail to consistently select the best model across different datasets.

problem Inconsistency in model selection for time series forecasting across varying data regimes.
method Characterized time series using descriptors like trend strength, seasonality, noise level, and temporal dependence. Developed a rule-based selection mechanism to map data regimes to candidate models.
result Rule-based model selection achieves low accuracy, with correct model identification occurring in only a small fraction of cases.

Hybrid Policy Optimization tackles reinforcement learning in hybrid spaces, improving performance over PPO.

problem Credit assignment issues and biased gradients in hybrid discrete-continuous action spaces.
method Mixed gradient estimator combining pathwise and score-function gradients, reformulating problems in hybrid form.
result HPO substantially outperforms PPO on inventory control and switched systems, with performance gaps increasing with continuous action dimension.

Survey on recent developments in isometric immersions using PDE techniques.

problem Analyzing isometric immersions with low Sobolev regularity.
method Compensated compactness and Coulomb-Uhlenbeck gauges.
result Weak continuity and stability of Gauss-Codazzi-Ricci equations.

The Gaussian process (GP) is a popular way to specify dependencies between random variables in a probabilistic model. In the Bayesian framework the covariance structure can be specified using unknown hyperparameters. Integrating over these hyperparameters considers different possible explanations for the data when maki…

2010-06-04abs ↗pdf ↗

New method for accurate Bayesian inference in GLMMs for large-scale data.

problem Challenges in scalable Bayesian inference for GLMMs due to intractable marginal likelihood and high computational cost.
method Stochastic gradient Markov Chain Monte Carlo (SGMCMC) algorithm using Fisher's identity for gradient estimation.
result Accurate posterior inference in large-sample settings with properly calibrated uncertainty.

We present new algorithms for detecting the emergence of a community in large networks from sequential observations. The networks are modeled using Erdos-Renyi random graphs with edges forming between nodes in the community with higher probability. Based on statistical changepoint detection methodology, we develop thre…

2014-07-22abs ↗pdf ↗

Introduces CCR for constructing confidence regions from conformal predictions.

problem Challenges in constructing confidence regions for model parameters.
method Combines conformal prediction intervals for model outputs to establish confidence regions for parameters under minimal assumptions.
result Valid coverage guarantees for finite sample regime, applicable to various model types.

Study on Lane-Emden equation on curved spaces, revealing new existence and non-existence phenomena.

problem Existence and non-existence of positive solutions for the Lane-Emden equation on Riemannian models.
method Analysis of the subcritical Lane-Emden equation on various Riemannian manifolds with polynomial volume growth.
result Subcritical regime divides into three ranges with distinct existence and non-existence phenomena.