Develops algorithms to exploit historical and pre-clustered arm information in bandit problems.
problem Optimizing decision-making in multi-armed bandit and contextual bandit problems with historical observations and pre-clustered arms.
method META algorithm that combines historical observations and pre-clustering information, deriving regret bounds for various scenarios.
result META algorithm effectively balances between using historical observations and clustering, outperforming the other in different scenarios.
NeuTSFlow models continuous functions behind time series forecasting.
problem Forecasting treats time series as discrete sequences, ignoring their continuous nature.
method NeuTSFlow uses Neural Operators to learn the transition between historical and future function families.
result NeuTSFlow outperforms traditional methods in forecasting accuracy and robustness.
How do we learn from biased data? Historical datasets often reflect historical prejudices; sensitive or protected attributes may affect the observed treatments and outcomes. Classification algorithms tasked with predicting outcomes accurately from these datasets tend to replicate these biases. We advocate a causal mode…
Study optimal product assortment using historical data, proving item coverage suffices.
problem Offline assortment optimization under MNL model with limited historical data.
method Pessimistic Rank-Breaking (PRB) algorithm combining rank-breaking and pessimistic estimation.
result Optimal item coverage is both sufficient and necessary for efficient offline learning.
In this paper a highly abstracted view on the historical development of Genetic Algorithms for the Traveling Salesman Problem is given. In a meta-data analysis three phases in the development can be distinguished. First exponential growth in interest till 1996 can be observed, growth stays linear till 2011 and after th…
This paper studies an application of machine learning in extracting features from the historical market implied corporate bond yields. We consider an example of a hypothetical illiquid fixed income market. After choosing a surrogate liquid market, we apply the Denoising Autoencoder (DAE) algorithm to learn the features…
The paper develops loss functions for pricing models using observational data.
problem Evaluating pricing policies directly from observational data with historical biases.
method Adapting machine learning techniques for corrupted labels to derive unbiased loss functions.
result Identifies minimum variance and robust estimators for contextual pricing.
Deep learning predicts path-dependent processes from historical data.
problem Predicting path-dependent processes using historical data.
method Nonparametric regression with deep neural networks.
result Deep learning method converges to theoretical predictions as observation frequency increases.
Novel method for nowcasting implied volatility using neural operators.
problem Dynamic and spatially changing option prices in financial markets.
method Operator Deep Smoothing using graph neural operators.
result Highly accurate implied volatility smoothing on ten years of S&P 500 options data.
We revisit the problem of pricing options with historical volatility estimators. We do this in the context of a generalized GARCH model with multiple time scales and asymmetry. It is argued that the reason for the observed volatility risk premium is tail risk aversion. We parametrize such risk aversion in terms of thre…
Paper tackles rough volatility estimation from high-frequency data.
problem Estimating historical volatility from high-frequency asset price data.
method Uses fractional Brownian motion representation and particle methods for filtering and parameter estimation.
result Demonstrates efficient estimation of rough volatility using standard techniques.
Bayesian meta-learning predicts Alzheimer's disease progression.
problem Predicting individual Alzheimer's disease progression from limited data.
method Bayesian meta-learning approach that dynamically predicts disease score distributions.
result Bayesian meta-learner outperforms single-task models and deterministic meta-learners, especially for long-term predictions.
Improves trial efficiency by adjusting for historical prognostic scores.
problem Reducing statistical uncertainty in randomized trial estimates.
method Linear covariate adjustment using a prognostic model trained on historical data.
result Prognostic covariate adjustment achieves minimum variance and reduces mean-squared error.
Improves RL from historical data by stitching trajectories.
problem Lack of high-quality data for offline RL.
method Trajectory Stitching (TS) to augment historical data with synthetic actions.
result Improves RL policy performance over baseline.
The main purpose of this study is the determination of the optimal length of the historical data for the estimation of statistical parameters in Markowitz Portfolio Optimization. We present a trading simulation using Markowitz method, for a portfolio consisting of foreign currency exchange rates and selected assets fro…
We consider optimal investment problems for a diffusion market model with non-observable random drifts that evolve as an Ito's process. Admissible strategies do not use direct observations of the market parameters, but rather use historical stock prices. For a non-linear problem with a general performance criterion, th…
Historical daily data for eleven years of the fifty constituent stocks of the NIFTY index traded on the National Stock Exchange have been analyzed to check for the stylized facts in the Indian market. It is observed that while some stylized facts of other markets are also observed in Indian market, there are significan…
Two econometric models forecast security volatility using various data sources.
problem Forecasting security volatility using low, high, and option data.
method Proposes two GARCH models integrating low, high, and option data.
result GARCH-Itô-OI and GARCH-Itô-IV models outperform other models in 5-minute high-frequency data.
VRER selectively reuses samples to improve policy optimization in complex systems.
problem Lack of effective reuse of historical samples in reinforcement learning.
method Variance reduction based experience replay (VRER) framework.
result VRER accelerates policy optimization and enhances performance.
New method predicts outcomes even when some factors are not used in models.
problem Predicting outcomes under runtime confounding where some factors are unavailable.
method Doubly-robust procedure for counterfactual predictions.
result Method often outperforms competing approaches in runtime confounding.
Proposes a method to learn from historical data for personalized decision-making.
problem Sample hunger in sequential decision-making algorithms for personalized medicine.
method Identifiable latent bandit framework using nonlinear independent component analysis.
result Optimal decision-making with shorter exploration time than classical bandits.
The paper analyzes stress shocks and their impact on historical data.
problem Determining the appropriate size of stress shocks for historical data analysis.
method Investigates the number of standard deviations required to exceed any historical observation, considering kurtosis.
result Provides tighter bounds for stress shocks than existing inequalities.
This paper corrects climate model biases using a factor model approach.
problem Systematic biases in GCM outputs due to unobserved confounders.
method Factor model approach to learn latent confounders from historical data and apply them to enhance bias correction.
result Significant improvements in the accuracy of precipitation outputs.
Paper establishes MLE consistency for market microstructure models.
problem Estimating parameters in partially observed diffusion models.
method Tractable sufficient condition for MLE consistency based on stationary distribution.
result Maximum likelihood estimators are consistent for market microstructure parameters.
Unified HS and related methods with explicit modeling assumptions.
problem Lack of clear assumptions in HS methods for Value-at-Risk.
method Explicitly defined parametric model for asset returns and extraction of innovation process.
result HS and related methods require more assumptions than commonly acknowledged.
AnEn uses past analogs for weather forecasting, but this work replaces the dataset with deep generative models.
problem Memory and computational costs for storing and searching historical data.
method Deep generative models to replace historical data and analogs search.
result Generative models reduce memory and computational costs significantly.
Study models extreme skew surges along French Atlantic coast.
problem Appropriate modelling of extreme skew surges for coastal risk management.
method Peak-over-threshold framework, multivariate generalized Pareto distribution, extreme regression framework.
result Reconstructed historical skew surge time series at stations with limited data.
We propose a general formulation for addressing reinforcement learning (RL) problems in settings with observational data. That is, we consider the problem of learning good policies solely from historical data in which unobserved factors (confounders) affect both observed actions and rewards. Our formulation allows us t…
The link between different psychophysiological measures during emotion episodes is not well understood. To analyse the functional relationship between electroencephalography (EEG) and facial electromyography (EMG), we apply historical function-on-function regression models to EEG and EMG data that were simultaneously r…
Study predicts traffic congestion based on population mobility data.
problem Predicting traffic congestion in multimodal transport networks.
method Machine learning methods applied to population mobility data.
result Likely prediction of congestion based on population movements.
Nostradamus links climate and stock market performance.
problem Understanding the impact of climate on stock prices.
method Analyzing historical data, climate indicators, and natural disasters.
result Significant correlation between climate and stock price fluctuations.
We investigate the forecasting ability of the most commonly used benchmarks in financial economics. We approach the usual caveats of probabilistic forecasts studies -small samples, limited models and non-holistic validations- by performing a comprehensive comparison of 15 predictive schemes during a time period of over…
ArtificialReplay improves data efficiency in bandits using historical data.
problem Data inefficiency in warm-starting bandit algorithms.
method ArtificialReplay, a meta-algorithm for incorporating historical data into any bandit algorithm.
result ArtificialReplay uses only a fraction of historical data compared to a full warm-start approach, achieving identical regret.
Study on newsvendor problem with censored data, showing how much information is lost.
problem Minimizing costs in a newsvendor problem with limited historical demand data.
method Distributionally robust optimization framework, evaluating policies based on worst-case regret.
result Characterization of information loss due to demand censoring and development of a robust algorithm.
ADR helps LLMs find and use historical analogies for foresight analysis.
problem LLMs struggle to find relevant historical analogies due to surface-level matching.
method Proposes CANA framework with mechanism alignment and cross-analogy confirmation.
result CANA improves historical analogy generation by up to 10%.
Unified framework for efficient RL in MDP, POMDP, and PSR.
problem Sample efficient reinforcement learning under various decision-making frameworks.
method Proposed GEC complexity measure and a posterior sampling algorithm.
result Sample efficient learning achieved with sublinear regret bound in terms of GEC.
The paper proposes a framework to calibrate multi-agent simulation models from output series using Bayesian optimization.
problem Calibrating multi-agent simulation models from observable output series.
method Novel eligibility set concept, two-sample Kolmogorov-Smirnov test with Bonferroni correction, Bayesian optimization (BO), and trust-region BO (TuRBO).
result Demonstrated the efficiency of the proposed framework using numerical experiments.
Proposes dynamic borrowing method for historical data in clinical trials.
problem Insufficient statistical power in rare and pediatric disease clinical trials.
method Dynamic borrowing method based on frequentist approach using similarity measures.
result Demonstrates usefulness of dynamic borrowing in reanalyzing clinical trial data.
Study on market data relaxation and correlations in mean-reverting models.
problem Analyzing relaxation and correlations in market data using mean-reverting models.
method Derived closed-form expressions for correlation functions and leverage for various models, applied eigenvalue analysis for the Heston model, tested findings on historic financial markets data.
result Agreement between general analysis and Heston model's eigenvalue analysis for correlation function.
Study efficient sequential evaluation of large language models using historical data.
problem Sequentially evaluate a new large language model (LLM) on a fixed question set.
method Construct a confidence sequence (CS) and design active querying rules to shrink CS width.
result Simple uniform sampling can sometimes outperform adaptive querying rules.
Bayesian model improves categorization of explosions from sparse data.
problem Challenges in categorizing explosions from limited data.
method Bayesian update to Event Categorization Matrix model with Bayesian Decision Theory.
result Consistent gains in overall accuracy and lower false negative rates.
Data describing historical economic growth are analysed. Included in the analysis is the world and regional economic growth. The analysis demonstrates that historical economic growth had a natural tendency to follow hyperbolic distributions. Parameters describing hyperbolic distributions have been determined. A search …
A brief historical perspective is first given concerning financial crashes, - from the 17th till the 20th century. In modern times, it seems that log periodic oscillations are found before crashes in several financial indices. The same is found in sand pile avalanches on Sierpinski gaskets. A discussion pertains to the…
This study reviews techniques to estimate volatility and price Variance Swaps.
problem Estimating historical volatility and pricing Variance Swaps.
method Review of existing techniques.
result Discussion of various methods to estimate volatility and price Variance Swaps.
Implied volatilities form a well-known structure of smile or surface which accommodates the Bachelier model and observed market prices of interest rate options. For the swaptions that we study, three parameters are taken into account for indexing the implied volatilities and form a "volatility cube": strike (or moneyne…
25% of people who received a liver transplant will go on to develop diabetes within the next 5 years. These thousands of individuals are at 2-fold higher risk of cardiovascular events, graft loss, infections, as well as lower long-term survival. This is partly due to the medication used during and/or after transplant t…
We give an explicit algorithm and source code for computing optimal weights for combining a large number N of alphas. This algorithm does not cost O(N^3) or even O(N^2) operations but is much cheaper, in fact, the number of required operations scales linearly with N. We discuss how in the absence of binary or quasi-bin…
Study finds varying market efficiency in prewar and wartime Japanese stock market.
problem Measuring market efficiency in prewar and wartime Japanese stock market.
method Using a new market capitalization-weighted stock price index, the study examines market efficiency over time and historical events.
result The adaptive market hypothesis is supported in the prewar and wartime Japanese stock market, with efficiency varying over time and with historical events.