Study Whittle index learning algorithms for restless bandits with constant stepsizes.
problem Optimizing decisions in restless multi-armed bandits with constant stepsizes.
method Developed Q-learning algorithms with constant stepsizes for index learning in restless bandits, extending to DQN and function approximations.
result The algorithms learn the Whittle index effectively.
Deep learning predicts market sensitivities for cost-effective index tracking.
problem Costly and impractical replication of index funds.
method Learning to predict market sensitivities using deep learning models.
result Significant reduction in prediction errors compared to historical methods.
Enhances index selection for databases with task-specific inductive biases.
problem Challenges in traditional and automatic tuning strategies for database index set selection.
method Applies deep RL with task-specific inductive biases to index set selection, reformulating the problem as permutation learning.
result Improves index selection, achieving up to 40% smaller configurations with similar latency.
New algorithm uses Whittle index to improve Q-learning for restless bandits.
problem Optimizing decision-making in multiarmed restless bandits with average reward.
method Introduces a novel reinforcement learning algorithm combining Q-learning and Whittle index policy.
result Demonstrates significant computational gains and excellent empirical performance.
AIDEL improves scalability of learned indexes in storage systems.
problem Expensive retraining and heavy inter-model dependency in learned indexes limit scalability.
method Construct different linear regression models based on data distribution, making them independent and easier to partition.
result AIDEL improves insertion performance by about 2x and comparable lookup performance.
Deep learning predicts S&P 500 index direction.
problem Accurate stock price prediction remains challenging.
method Convolutional neural network model for S&P 500 index forecasting.
result Model achieves over 55% accuracy in predicting index direction.
Paper tackles continual learning with single-index models, proving regret bounds.
problem Continual learning with single-index models across multiple tasks.
method Proposes a randomized strategy to learn a common single-index and task-specific link functions.
result Proves regret bounds for the proposed strategy under various loss function assumptions.
Paper presents an efficient exploration method for reinforcement learning.
problem Efficient exploration in reinforcement learning with uncertainty quantification.
method Parameterized Indexed Value Function (PIV) using index sampling.
result Proves the regret bound for learning PIV in a tabular setting and proposes PINs for computational learning.
Tree Index evaluates cluster quality by creating decision trees from data.
problem Evaluating the quality of cluster results from various techniques.
method Tree Index creates a decision tree from clustered data, combining entropy and depth of leaves.
result Tree Index discriminates between sensible and non-sensible clusters on brain dataset.
Improved stock index analysis using fuzzy parameters and machine learning.
problem Analyzing the S&P 500 stock index with long-term dependence.
method Combining fuzzy theory and machine learning to modify the Barndorff-Nielsen and Shephard model.
result The new model effectively captures the stochastic dynamics of the stock index time series.
Researchers analyze the relationship between ML cost functions and the C-index in survival analysis.
problem Understanding the relationship between ML cost functions and the C-index in survival analysis.
method Provided C-index Fisher-consistency results and excess risk bounds for various cost functions in survival analysis.
result Identified conditions under which ML cost functions are consistent with the C-index.
Adversarial robustness in multi-index models is as easy as standard learning.
problem Adversarial robustness in high-dimensional multi-index models.
method Proves that hidden directions of multi-index models offer a Bayes optimal low-dimensional projection for robustness against ℓ2-bounded adversarial perturbations. result Adversarially robust learning is as easy as standard learning, requiring no additional samples.
SGD shows distinct phases in learning single-index models, achieving optimal sample complexity and regret.
problem Learning single-index models with SGD in adaptive data settings.
method Stochastic gradient descent (SGD) with an optimal learning rate schedule.
result SGD achieves near-optimal sample complexity and regret guarantees across both burn-in and learning phases.
A new stock index model simplifies high-dimensional stock data.
problem Reflecting the overall stock market activity in high-dimensional data.
method Manifold learning and feature detection on discrete Laplace-Beltrami operator.
result The MF index series approximates the stock market better and has lower risk.
Optimizes credit index option hedging with reinforcement learning.
problem Finding the best strategy for hedging credit index options.
method Applied reinforcement learning with TRVO algorithm in a realistic setting.
result The derived hedging strategy outperforms traditional methods.
This paper uses machine learning to improve VIX index calculation and detect market manipulation.
problem Inaccuracies and potential market manipulation in VIX index calculation.
method Replicates VIX index using a subset of SP options and neural networks.
result A small number of SP options can accurately replicate the VIX index.
Paper decomposes C-index to analyze survival prediction model performance.
problem Evaluating the performance of survival prediction models.
method Decomposes C-index into two weighted quantities: ranking observed vs. other events and observed vs. censored cases.
result Deep learning models outperform classical models in ranking observed events, leading to better C-index stability.
Study examines cross-training neural networks for financial index prediction.
problem Predicting financial indexes from different markets using machine learning.
method Investigated various neural network architectures and trained them on one market index to predict another.
result Cross-training models on one market index improved prediction accuracy for another market index.
The paper challenges the validity of cluster validity measures in unsupervised learning.
problem The validity of cluster validity measures in selecting optimal clusterings.
method The authors investigate the use of cluster validity measures as objective functions in unsupervised learning and introduce a new variant of the Dunn index.
result Many cluster validity measures promote clusterings that do not match expert knowledge well.
Noise Sensitivity Exponent controls statistical-computational gaps in learning.
problem Understanding when learning is statistically possible yet computationally hard in high-dimensional statistics.
method Investigating statistical-computational gaps in single- and multi-index models using Noise Sensitivity Exponent.
result Noise Sensitivity Exponent governs statistical-computational gaps in high-dimensional learning.
NeurWIN learns Whittle indices for restless bandits using deep reinforcement learning.
problem Finding optimal solutions for restless bandits with complex transition kernels.
method NeurWIN uses a neural network to learn Whittle indices, leveraging the Whittle indices' mathematical properties.
result NeurWIN outperforms other RL algorithms in solving three recently studied restless bandit problems.
New RL algorithms learn Gittins indices for unknown Markovian states.
problem Learning Gittins indices for unknown Markovian state transitions.
method Tabular (QGI) and Deep RL (DGN) algorithms based on retirement formulation.
result Lower run time, less storage space, better convergence to Gittins index.
Training a neural network for a classification task typically assumes that the data to train are given from the beginning. However, in the real world, additional data accumulate gradually and the model requires additional training without accessing the old training data. This usually leads to the catastrophic forgettin…
Large-scale industrial recommender systems are usually confronted with computational problems due to the enormous corpus size. To retrieve and recommend the most relevant items to users under response time limits, resorting to an efficient index structure is an effective and practical solution. The previous work Tree-b…
Machine learning improves kidney transplant outcomes prediction.
problem Improving prediction of kidney transplant success.
method Random forest machine learning model trained on kidney donor risk index data.
result Random forest predicted 2,148 more successful transplants than the risk index.
C-index varies among software, complicating model comparison.
problem Variation in C-index calculations across software.
method Comparison of C-index estimators in R and Python.
result Different implementations yield varying results.
New neural networks learn single-index models efficiently.
problem Learning low-dimensional structure in high-dimensional data.
method Shallow neural networks with frozen biases, studied via gradient flow.
result Generalization guarantees match near-optimal sample complexity.
Randomly biased data makes complex models as easy to learn as simple ones.
problem Learning complex models like multi-index and sparse Boolean functions.
method Introducing a small random shift in the first moment of the data distribution.
result Randomly biased data makes Gaussian single index models and sparse Boolean functions as easy to learn as linear functions.
Kernelized bandit algorithm tackles adaptive contextual bandits with single-index models.
problem Adaptive contextual bandits with single-index models and unknown link functions.
method Kernelized ε-greedy algorithm combining Stein-based index estimation and kernel ridge regression for reward functions.
result Unified framework for simultaneous learning and inference in single-index contextual bandits.
DFR models dynamic distributional data with weighted Fréchet means.
problem Regression of distribution-valued responses over time.
method Dynamic Fréchet Regression (DFR) with index-aware weighting and feature selection.
result Improved predictive accuracy and feature recovery over existing methods.
CTLNet predicts Shanghai Composite Index with improved accuracy.
problem Predicting Shanghai Composite Index for investors and researchers.
method Proposes CNN-Transformer-LSTM Networks (CTLNet) for multivariate time series forecasting.
result CTLNet outperforms state-of-the-art baselines in Shanghai Composite Index prediction.
The paper uses machine learning to predict volatility from option data.
problem Improving predictability and liquidity of VIX-styled volatility indices.
method Regularized regression and Feedforward Neural Networks (FNN) were tested on S&P 500 Index and its option data.
result Ridge regression and FNN improve volatility indexing with higher prediction performance and fewer options required.
Paper introduces IC-index to evaluate interaction prediction methods.
problem Evaluate interaction prediction methods using IC-index.
method IC-index measures interaction direction prediction performance.
result IC-index complements existing prediction performance estimators.
Improved SGD learning for single index models reduces sample complexity.
problem Learning a single index model with optimal sample complexity.
method Using smoothed loss in online SGD to reduce sample complexity.
result Online SGD with smoothed loss achieves optimal sample complexity of dk⋆/2. The Surprise index assesses autonomous systems' competency in uncertain environments.
problem Evaluating competency of autonomous systems in dynamic, uncertain environments.
method Surprise index, a measure that quantifies system performance based on available data.
result The Surprise index can be computed for dynamic systems with Gaussian marginal distributions.
Proposes first method for continuously indexed domain adaptation.
problem Challenges of transferring knowledge between continuously indexed domains.
method Combines adversarial adaptation with a novel discriminator.
result Outperforms state-of-the-art methods on synthetic and real-world datasets.
Local EGOP learns functions varying along a few directions.
problem Efficient estimation of functions varying along a few directions in high-dimensional space.
method Local EGOP learning, a recursive algorithm using EGOP quadratic form as metric and inverse-covariance.
result Local EGOP learning achieves intrinsic dimensional learning rates under noisy manifold hypothesis.
Unified framework predicts S&P500 index direction using transfer learning and causal graph.
problem Predicting the movement of financial indices like S&P500.
method Transfer learning, causal graph, multidisciplinary knowledge, VAE network.
result 74.3% accuracy, 67% F1-score, 0.42 Matthew correlation on 12 years test period.
New method uses spherical harmonics to simplify learning single-index models.
problem Learning single-index models with unknown one-dimensional projections.
method Proposes using spherical harmonics instead of Hermite polynomials to capture rotational symmetry.
result Characterizes the complexity of learning single-index models under arbitrary spherically symmetric input distributions.
Efficiently learns Single-Index Models with constant factor approximation.
problem Learning Single-Index Models under L22 loss with unknown link functions. method An efficient algorithm using alignment sharpness for optimization.
result Achieves constant factor approximation to optimal loss for various distributions and link functions.
A new index measures confounding effects in medical data.
problem Misleading predictive performance due to unaccounted confounders.
method Introduces a novel index to quantify confounding effects.
result Validated on simulated and real-world data.
Study creates a global living index to assess quality of life.
problem Long-term impacts of global economic changes on living conditions.
method Machine learning framework combining socio-economic factors.
result Developed a practical tool for policymakers to identify areas needing improvement.
Single index model is a powerful yet simple model, widely used in statistics, machine learning, and other scientific fields. It models the regression function as g(<a,x>), where a is an unknown index vector and x are the features. This paper deals with a nonlinear generalization of this framework to allow for a regre…
Combines SV and RNN models for stock market volatility.
problem Capturing complex volatility effects in stock markets.
method Statistical Recurrent Stochastic Volatility (SR-SV) model.
result Out-of-sample forecast performance is impressive.
A new method tracks index using topological data analysis for sparse portfolios.
problem Sparse index tracking with robust risk management.
method Topological learning via Vietoris-Rips filtration for sparse regularization.
result The method outperforms state-of-the-art techniques in various market conditions.
Paper compares different models for time-to-event analysis.
problem Comparing models for time-to-event analysis.
method Experimental comparison of semi-parametric, parametric, and machine learning models.
result Models' performance evaluated using concordance index.
Neural Index Policy for multi-action bandits with heterogeneous budgets.
problem Real-world settings often involve multiple interventions with heterogeneous costs and constraints, breaking classical assumptions.
method Introduces a Neural Index Policy (NIP) that learns to assign budget-aware indices to arm-action pairs using a neural network and differentiable knapsack layer.
result Empirically achieves near-optimal performance while strictly enforcing heterogeneous budgets and scaling to hundreds of arms.
This paper reviews and analyzes various modeling approaches for financial index tracking.
problem Efficient replication of market index performance in financial markets.
method Categorization into three frameworks: optimization, statistical, and machine learning; empirical study on S&P 500 dataset.
result Optimization-based models deliver the most precise index tracking, statistical-based models achieve the strongest return-risk balance, and data-driven models provide competitive performance.