Optimal estimator derived for partially observable LTI systems.
problem Optimal estimator for partially observable LTI systems.
method State-space representation for derivation of optimal estimator.
result Derivation of minimum error variance estimator for partially observable LTI systems.
Clustering stocks reduces estimation error in global minimum variance portfolio.
problem High estimation error in covariance matrix estimation.
method Bounded clustering to limit maximum cluster size.
result Reduction in out-of-sample volatility and gap between in-sample and out-of-sample volatility.
Bayesian method recovers causal structure in SEMs with equal error variances.
problem Recovering causal structure in SEMs with equal error variances.
method Bayesian DAG selection method using g-priors and the key property of minimum expected squared errors.
result The method consistently recovers the true graph without additional distributional assumptions.
LoCoV reduces portfolio optimization errors from sample covariance matrices.
problem Large errors in sample covariance matrix for optimal portfolio weights.
method LoCoV (low dimension covariance voting) algorithm to reduce these errors.
result LoCoV outperforms classical methods in portfolio optimization experiments.
The study analyzes how covariance estimation errors affect the global minimum-variance portfolio under heavy-tailed distributions.
problem The impact of covariance estimation errors on the global minimum-variance portfolio under heavy-tailed distributions.
method Characterization of covariance-estimation error's effect on GMVP suboptimality, derivation of regret identity and bound, application to heavy-tailed returns.
result The decision geometry of GMVP regret is invariant to a (p-1)-dimensional projection of the error matrix, with invariance to the covariance-scale direction as an exact special case.
New proof shows how to identify DAGs with weakly increasing errors.
problem Identifying the true DAG in models with weakly increasing error variances.
method Minimum-trace DAG method and hill climbing algorithm with R2R neighborhood.
result Hill climbing algorithm without strict local optima under weakly increasing error variances.
Paper uses DFL to optimize portfolio risk and outperforms conventional methods.
problem Optimizing portfolio risk and return under uncertainty.
method Decision-focused learning (DFL) to derive global minimum variance portfolio (GMVP).
result DFL-based methods consistently deliver superior decision performance in portfolio optimization.
Neural-SDE models improve option hedging with lower errors and robustness.
problem Improving option hedging strategies using machine learning.
method Derive sensitivity-based and minimum-variance-based hedging strategies using neural-SDE market models.
result Neural-SDE models achieve lower hedging errors and are more robust than traditional models.
The paper examines prediction and estimation risks of ridgeless least squares under general error assumptions.
problem Prediction and estimation risks of ridgeless least squares under realistic error structures.
method Analysis of prediction and estimation risks under general regression error assumptions, including clustered or serial dependence.
result The benefits of overparameterization extend to time series, panel, and grouped data.
This paper optimizes portfolio selection by penalizing tracking error, improving Sharpe ratio.
problem Optimizing portfolio allocation with a penalty for deviation from a reference portfolio.
method Formulated as a McKean-Vlasov control problem, provides explicit solutions and asymptotic expansions.
result The penalized portfolio strategy outperforms standard mean-variance and reference portfolios in most cases.
ML helps select variables for minimum-variance portfolios, reducing risk and improving performance.
problem Optimizing minimum-variance portfolios with relevant predictors.
method Parameterized minimum-variance portfolio weights using a large pool of firm-level characteristics and their transformations.
result ML-selected predictors lead to lower risk and better performance in minimum-variance portfolios.
A scalable gradient-based framework for sparse portfolio selection.
problem Sparse minimum-variance portfolio selection with cardinality constraint.
method Gradient-based optimization with Boolean relaxation and tunable parameter.
result Matches commercial solvers in most instances, differing by a few assets with negligible error in portfolio variance.
We study a new class of codes for lossy compression with the squared-error distortion criterion, designed using the statistical framework of high-dimensional linear regression. Codewords are linear combinations of subsets of columns of a design matrix. Called a Sparse Superposition or Sparse Regression codebook, this s…
Study introduces AMVP and AMRR for dynamic portfolio optimization in volatile markets.
problem Optimizing portfolios in volatile and nonstationary financial markets.
method Adaptive Minimum-Variance Portfolio (AMVP) framework with ARFIMA-FIGARCH processes and non-Gaussian innovations.
result Demonstrated superior performance in risk reduction and portfolio stability during market breaks.
Investigates the long-only minimum variance portfolio in factor models.
problem Understanding the long-only minimum variance portfolio in factor models.
method Investigates the long-only global minimum variance portfolio in a factor model of returns, providing explicit and geometric descriptions for different factor models.
result Provides rigorous and explicit descriptions of the long-only solution in terms of covariance matrix parameters and geometric descriptions for multiple factors.
Proposes variational autoencoder for efficient MMSE estimation.
problem Efficient parameterized MMSE estimation for noisy observations.
method Variational autoencoder models data distribution, approximates MMSE.
result Proposed estimator performs well compared to state-of-the-art.
Paper connects two portfolio methods, HRP and Minimum Variance, revealing their underlying similarity.
problem Inability to universally adopt optimization-based portfolio construction methods.
method Unifies Hierarchical Risk Parity and Minimum Variance approaches.
result Schur complementary allocation reveals the connection between HRP and Minimum Variance.
A new estimator for asynchronous tick data shows better correlation estimates.
problem Estimating correlation from asynchronous tick data.
method Derive a minimum-variance estimator and a fast linear-time estimator.
result The fast tickwise estimator has smaller estimation errors than the usual method.
Improved portfolio optimization method yields better risk-adjusted returns.
problem Optimizing global minimum variance portfolios with reduced risk.
method k-fold boosted k−BAHC covariance cleaning procedure for correlation matrices. result Our method outperforms other filtering methods in Sharpe ratios, despite higher turnover.
Improved global minimum-variance portfolios using cross-validation for high-dimensional covariance estimation.
problem Ill-conditioned sample covariance matrix in high-dimensional data leads to suboptimal portfolios.
method Cross-validation technique to select tuning parameters for efficient covariance matrix estimation methods.
result Data-driven tuning parameters improve out-of-sample performance of global minimum-variance portfolios.
Choosing appropriate step sizes is critical for reducing the computational cost of training large-scale neural network models. Mini-batch sub-sampling (MBSS) is often employed for computational tractability. However, MBSS introduces a sampling error, that can manifest as a bias or variance in a line search. This is bec…
The paper identifies the minimum mean-variance spanning set and its importance in asset evaluation.
problem Estimating the minimum subset of assets that span the efficient frontier.
method Established identification conditions and developed a novel procedure for MSS estimation and inference.
result The MSS estimator accurately covers the true MSS and converges to it at any desired confidence level.
DLNs dynamics change with variance, leading to saddle-to-saddle training phases.
problem Understanding the dynamics of DLNs with varying initialization variance.
method Analyzing the phase transition of DLNs' dynamics as variance changes.
result Gradient descent visits a sequence of saddles, reaching a sparse global minimum.
Develops a neural network for global minimum variance portfolio optimization.
problem Minimizing portfolio variance for large equity covariance matrices.
method Rotation-invariant neural network that learns lag-transformed returns and covariance regularization.
result End-to-end trained model outperforms competitors in realized volatility and Sharpe ratios.
Optimizes high-dimensional portfolios using joint shrinkage.
problem Optimizing portfolios with many assets where classical methods fail.
method Regression-based joint shrinkage method for estimating partial correlations.
result Superior performance in variance, weight, and risk estimation compared to other methods.
In this report, we present an unsupervised machine learning method for determining groups of molecular systems according to similarity in their dynamics or structures using Ward's minimum variance objective function. We first apply the minimum variance clustering to a set of simulated tripeptides using the information …
VRSMD improves SMD convergence and has implicit regularization.
problem Efficiently estimating models with large datasets.
method Variance reduction in stochastic mirror descent.
result VRSMD converges to the minimum mirror interpolant.
Proposes a robust portfolio method for large asset universes.
problem Outliers in return data affect traditional portfolio optimizations.
method Robust PCA, shrinkage estimation, and adaptive portfolio weights.
result Superior portfolio performance in numerical and empirical tests.
Improves trial efficiency by adjusting for historical prognostic scores.
problem Reducing statistical uncertainty in randomized trial estimates.
method Linear covariate adjustment using a prognostic model trained on historical data.
result Prognostic covariate adjustment achieves minimum variance and reduces mean-squared error.
Study long-only minimum variance portfolio in one-factor market with arbitrary sign betas.
problem Characterize the long-only minimum variance portfolio in a one-factor market with mixed-sign betas.
method Explicit solution for long-only minimum variance portfolio, explicit characterization of active set, asymptotic analysis in high-dimensional regime.
result Proportion of active assets in LOMV portfolio converges to F(β∗) in high-dimensional regime, with rate O(F(0)1/3) when F(0)>0. The study analyzes robustness of estimators in linear models with adversarial errors.
problem Analyzing robustness of estimators in linear models with adversarial errors.
method Develops a general theory for minimum norm interpolating estimators and RERM in linear models without conditions on errors.
result Quantitative bound for the prediction error relating it to Rademacher complexity, norm of minimum norm interpolator of errors, and subdifferential size.
The paper introduces a dynamic MVP model using high-frequency financial data.
problem Capturing the dynamics of minimum variance portfolio weights in financial markets.
method Imposes autoregressive structure on MVP processes and uses CLIME and LASSO for estimation.
result Proposes DR-MVP model with established asymptotic properties.
This paper presents a ML-based receiver for SDR that outperforms conventional methods.
problem Complexity and performance issues in multiuser detection.
method Supervised learning for direct symbol detection without parameter estimation.
result The ML-based receiver achieves similar or better performance than SIC and MMSE receivers.
TPLVM models portfolio construction for non-Gaussian financial data.
problem Optimal asset allocation in finance with non-Gaussian fluctuations.
method Student's t-process latent variable model (TPLVM) for portfolio optimization.
result TPLVM outperforms Gaussian process latent variable model in minimum-variance portfolio construction.
Minimum-norm solutions generalize well in over-parametrized neural networks.
problem Generalization error in over-parametrized neural networks.
method Analyzing three models: random feature model, two-layer neural network, and residual network.
result Generalization error for minimum-norm solutions is comparable to Monte Carlo rate, up to logarithmic terms.
Paper improves robustness of PINNs by smoothing and quantifying uncertainty.
problem PINNs can overfit and converge to local minima due to training data errors.
method Introduces Gaussian Process smoothing and sparse inducing points.
result Recover robust PINN performance against noise and errors.
This paper describes an empirical study of shortfall optimization with Barra Extreme Risk. We compare minimum shortfall to minimum variance portfolios in the US, UK, and Japanese equity markets using Barra Style Factors (Value, Growth, Momentum, etc.). We show that minimizing shortfall generally improves performance ov…
Regression models can interpolate noisy data and still perform well, contrary to the bias-variance tradeoff.
problem Understanding why overparametrized models can generalize well despite the bias-variance tradeoff.
method Analysis of minimum norm solutions and ridge regression, focusing on the smallest singular value of the regression matrix.
result Testing error exhibits double descent behavior as model order increases, contrary to the classical bias-variance tradeoff.
We propose a sample efficient stochastic variance-reduced cubic regularization (Lite-SVRC) algorithm for finding the local minimum efficiently in nonconvex optimization. The proposed algorithm achieves a lower sample complexity of Hessian matrix computation than existing cubic regularization based methods. At the heart…
Study tightens bounds for interpolating noisy data using minimum l1-norm.
problem Predicting noisy data with minimum l1-norm interpolation.
method Provided matching upper and lower bounds for prediction error.
result Tight consistency up to negligible terms for d≫n. This paper introduces a new market-based carbon risk measure for portfolio optimization.
problem The challenge of measuring and managing carbon risk in investment portfolios.
method Develops a market-based carbon risk measure and applies it to minimum variance portfolio construction.
result Market-based carbon risk measures can complement fundamental-based approaches in portfolio optimization.
Risk-aware MMSE improves stability in volatile scenarios.
problem In MMSE estimators, volatility of error is unconstrained, leading to significant performance differences.
method Introduces risk-aware MMSE by constraining expected predictive variance.
result Risk-aware MMSE provides better performance, especially in skewed, heavy-tailed distributions.
We study least squares linear regression over N uncorrelated Gaussian features that are selected in order of decreasing variance. When the number of selected features p is at most the sample size n, the estimator under consideration coincides with the principal component regression estimator; when p>n, the esti…
Improved portfolio optimization method reduces risk and improves performance.
problem Minimizing risk in large portfolios with limited data.
method Combines Tikhonov regularization and direct shrinkage of portfolio weights.
result Significantly reduces out-of-sample variance and Sharpe ratio compared to existing methods.
Minimum attention improves reinforcement learning performance in high-dimensional dynamics.
problem Improving reinforcement learning performance in high-dimensional nonlinear dynamics.
method Applying minimum attention as a regularization technique in reinforcement learning, including model-based and model-free approaches.
result Minimum attention outperforms state-of-the-art algorithms in few-shot adaptation and variance reduction.
Paper proposes deep neural networks for nonparametric regression from dependent data.
problem Nonparametric regression from strongly mixing observations.
method Minimum error entropy principle applied to deep neural networks.
result Deep neural networks achieve minimax optimal convergence rates for Gaussian errors.
Paper develops a robust hedging framework to reduce market risk and uncertainty.
problem Managing uncertainty and risk exposure in portfolio management.
method Combines high-frequency realized variance, covariance measures, and autoregressive models for multi-step volatility forecasting. Uses a box-uncertainty robust optimization scheme to derive a closed-form solution for the robust hedge ratio.
result Robust hedge ratios are more stable and entail lower turnover than standard dynamic hedges, improving downside protection and risk-adjusted performance.
The discrete-time mean-variance portfolio selection formulation, a representative of general dynamic mean-risk portfolio selection problems, does not satisfy time consistency in efficiency (TCIE) in general, i.e., a truncated pre-committed efficient policy may become inefficient when considering the corresponding trunc…