Random investment strategies outperform sensible ones, even with forecasts.
problem The usefulness of investment strategies based on forecasts is questioned.
method Investigated the performance of sensible and nonsensical investment strategies, including forecasts.
result There is no substantial difference between the performances of ``best'' and ``trivial'' forecasts.
In this paper we address the problem of pool based active learning, and provide an algorithm, called UPAL, that works by minimizing the unbiased estimator of the risk of a hypothesis in a given hypothesis space. For the space of linear classifiers and the squared loss we show that UPAL is equivalent to an exponentially…
We provide a model to understand how adverse weather conditions modify traffic flow dynamic. We first prove that the microscopic Free Flow Speed of the vehicles is changed and then provide a rule to model this change. For this, we consider a thresholded linear model, corresponding to an application of a MARS model to r…
The autocorrelation function of volatility in financial time series is fitted well by a superposition of several exponents. Such a case admits an explicit analytical solution of the problem of constructing the best linear forecast of a stationary stochastic process. We describe and apply the proposed analytical method …
The Barankin bound is generalized to the vector case in the mean square error sense. Necessary and sufficient conditions are obtained to achieve the lower bound. To obtain the result, a simple finite dimensional real vector valued generalization of the Riesz representation theorem for Hilbert spaces is given. The bound…
TiDE uses MLP for fast, simple long-term time-series forecasting.
problem Long-term time-series forecasting challenges.
method Time-series Dense Encoder (TiDE) based on MLP.
result TiDE matches or outperforms Transformer models while being 5-10x faster.
AutoPQ automates quantile forecasting for smart grids, reducing workload and environmental impact.
problem Accurate and unbiased uncertainty quantification in probabilistic forecasting for smart grid operations.
method AutoPQ uses a conditional Invertible Neural Network (cINN) to generate quantile forecasts from point forecasts, automating model selection and hyperparameter optimization.
result AutoPQ outperforms state-of-the-art methods while reducing computational effort and environmental impact.
Improved electricity price forecasting model combining linear and non-linear structures.
problem Day-ahead electricity price forecasting in energy systems.
method Recurrent neural networks with embedded linear structures.
result Approximately 11% higher accuracy than state-of-the-art models.
We propose an algebraic combinatorial method for solving large sparse linear systems of equations locally - that is, a method which can compute single evaluations of the signal without computing the whole signal. The method scales only in the sparsity of the system and not in its size, and allows to provide error estim…
This paper provides estimation and inference methods for the best linear predictor (approximation) of a structural function, such as conditional average structural and treatment effects, and structural derivatives, based on modern machine learning (ML) tools. We represent this structural function as a conditional expec…
Algorithm finds best Dirac mass approximation of target measure.
problem Finding optimal Dirac mass approximation of target measure.
method Minimizes statistical distance between original measure and quantized version using Huber-energy kernel.
result HEMQ algorithm robust and versatile, matches intuitive behavior.
Conditional forecasts improve performative prediction accuracy.
problem Performative predictions undermine standard forecasting methods.
method Condition forecasts on covariates to make them forecast-invariant.
result Proper scoring rules fail under conditioning, but two solutions are identified.
Bayesian consensus improves accuracy of forecasts from miscalibrated sources.
problem Aggregating predictions from miscalibrated and noisy sources.
method Bayesian approach to adjust for bias and noise, using hierarchical models.
result Bayesian consensus estimator is unbiased and more efficient than alternatives.
INF-clip optimizes heavy-tailed MAB problems with improved performance.
problem Optimizing multi-armed bandit problems with heavy-tailed rewards.
method INF-clip algorithm for adversarial and stochastic heavy-tailed MAB settings.
result INF-clip is optimal for linear and non-linear heavy-tailed stochastic MAB problems.
Kernel quadrature improves CRPS estimation for probabilistic time-series forecasting.
problem Intractable integrations in CRPS evaluation metrics lead to improper rankings of forecasting models.
method Introduced kernel quadrature approach for unbiased CRPS estimation and scalable computation.
result Our approach consistently outperforms existing CRPS estimators.
The study improves Bitcoin price prediction using hybrid machine learning and enhances interpretability.
problem Improving Bitcoin price prediction accuracy and interpretability.
method Hybrid machine learning algorithms (OLS, LASSO, LSTM, decision tree regressors) and preprocessing techniques for time-series data.
result Linear regression achieves the best performance in predicting Bitcoin prices.
Project forecasts liquidity withdrawal using machine learning models.
problem Predicting liquidity withdrawal at individual stock levels.
method Tested a framework using machine learning models (AR, HAR, XGBoost) on Nasdaq MBO data.
result Introduced the Liquidity Withdrawal Index (LWI) for measuring liquidity removal.
Study analyzes Disney stock market performance using machine learning.
problem Forecasting stock market performance of Disney.
method Exploratory data analysis, feature engineering, model selection (linear regression).
result Linear regression model performed best.
Paper introduces probabilistic forecasting methods for cryptocurrency volatility.
problem Inadequate point forecasting methods for capturing full spectrum of volatility outcomes.
method Combines multiple base models (statistical and machine learning) to estimate conditional quantiles of cryptocurrency realized variance.
result QRS method outperforms sophisticated alternatives for Bitcoin volatility forecasting.
With the advent of massive data sets much of the computational science and engineering community has moved toward data-intensive approaches in regression and classification. However, these present significant challenges due to increasing size, complexity and dimensionality of the problems. In particular, covariance mat…
Daily streamflow forecasting through data-driven approaches is traditionally performed using a single machine learning algorithm. Existing applications are mostly restricted to examination of few case studies, not allowing accurate assessment of the predictive performance of the algorithms involved. Here we propose sup…
We address online linear optimization problems when the possible actions of the decision maker are represented by binary vectors. The regret of the decision maker is the difference between her realized loss and the best loss she would have achieved by picking, in hindsight, the best possible action. Our goal is to unde…
It is very vital for suppliers and distributors to predict the deregulated electricity prices for creating their bidding strategies in the competitive market area. Pre requirement of succeeding in this field, accurate and suitable electricity tariff price forecasting tools are needed. In the presence of effective forec…
We develop a new DTSM with nonlinearities using Gaussian Processes for better interest rate forecasting.
problem Linear DTSMs fail to capture nonlinear relationships between macroeconomic variables and interest rates.
method We propose a Gaussian Process-based sequential Monte Carlo estimation and forecasting scheme.
result Nonlinear models outperform linear ones in forecasting core inflation, leading to significant economic value gains.
The primary goal of this study is doing a meta-analysis research on two groups of published studies. First, the ones that focus on the evaluation of the United States Department of Agriculture (USDA) forecasts and second, the ones that evaluate the market reactions to the USDA forecasts. We investigate four questions. …
A simple baseline outperforms deep learning methods in transportation forecasting.
problem The importance of stationarity and recurrent patterns in transportation data.
method A naive baseline based on average weekly patterns and linear regression.
result The baseline method achieves comparable or better results than state-of-the-art deep learning approaches.
The paper evaluates and benchmarks electricity price forecasting models.
problem Lack of rigorous evaluation methods and open datasets.
method Literature review, cross-market comparison, open datasets, and python toolbox.
result Best practices for electricity price forecasting are proposed.
Improved probabilistic solar irradiance forecasting models for grid integration.
problem Enhancing accuracy of solar irradiance forecasts for grid integration.
method Developed and calibrated probabilistic models using post-hoc calibration techniques.
result NGBoost model with CRUDE calibration achieves comparable performance to numerical weather prediction models.
We consider the combined use of resampling and partial rejection control in sequential Monte Carlo methods, also known as particle filters. While the variance reducing properties of rejection control are known, there has not been (to the best of our knowledge) any work on unbiased estimation of the marginal likelihood …
ProFITi model forecasts irregular time series with missing values using conditional flows.
problem Probabilistic forecasting of irregularly sampled multivariate time series with missing values.
method ProFITi model uses conditional normalizing flows and invertible layers to learn joint distributions conditioned on past observations and queried channels and times.
result ProFITi model provides 4 times higher likelihood than the previous best model.
New method corrects seasonal Arctic sea ice predictions with probabilistic models.
problem Systematic biases and errors in climate model forecasts of Arctic sea ice.
method Conditional Variational Autoencoder model to map observation distribution given biased model predictions.
result Probabilistic adjusted forecasts are better calibrated and have smaller errors.
Global models outperform local models in forecasting intermittent time series.
problem Forecasting intermittent time series with zeros in supply chains.
method Comparison of state-of-the-art probabilistic local and global models on five datasets.
result TiDE, a simple neural network architecture, achieves the best accuracy among global models.
New concept of proper-calibeating extends classic calibrated forecasts to proper scoring rules.
problem Defining and extending calibrated forecasts to proper scoring rules.
method Extending the concepts of calibrated and calibeating forecasts to proper scoring rules and proving their properties.
result Proper-calibration always implies calibration, but proper-calibeating does not necessarily imply calibeating.
Study evaluates model selection methods for time series forecasting.
problem Evaluating which model is best for time series forecasting.
method Compared various estimation methods for selecting the best model.
result Accuracy of model selection estimators is low, and performance loss is significant.
Combines multiple OPE estimators into a more accurate and efficient estimate.
problem Offline evaluation of recommender systems using biased data.
method Meta-analysis of correlated OPE estimators, accounting for inter-estimator correlation.
result Improved statistical efficiency and accuracy in estimating policy value.
Improves survey sampling with unbiased machine learning methods.
problem Design-consistent model-assisted estimation lacks a general theory for machine learning.
method Proposes a subsampling Rao-Blackwell method for design-unbiased estimation.
result Yields efficiency gains over standard methods while ensuring valid estimation.
In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the Stochastic Gradient Langevin Dynamics algorithm to draw samples from the posterior …
Time series forecasting is widely used in a multitude of domains. In this paper, we present four models to predict the stock price using the SPX index as input time series data. The martingale and ordinary linear models require the strongest assumption in stationarity which we use as baseline models. The generalized li…
Meta-learning predicts optimal ensemble size and methods for time series forecasting.
problem Finding the best ensemble of time series forecasting methods.
method Two-step approach using meta-learning to predict ensemble size and methods.
result Meta-learning outperformed benchmarks in forecasting errors for all data types and horizons.
Quantized Stochastic Primal-Dual Methods for Distributed Optimization
problem Distributed optimization with stochastic gradients and finite-bit communication
method q-PDGD, a quantized stochastic primal-dual method
result Linear contraction to an explicit neighborhood under RSI, O(1/k) convergence under PL inequality
The accuracy of the household electricity consumption forecast is vital in taking better cost effective and energy efficient decisions. In order to design accurate, proper and efficient forecasting model, characteristics of the series have to been analyzed. The source of time series data comes from Online Enerjisa Syst…
This paper extends forecast reconciliation to non-linearly constrained time series.
problem Forecasting time series with non-linear constraints.
method Non-linearly Constrained Reconciliation (NLCR) algorithm that adjusts forecasts to meet non-linear constraints.
result NLCR significantly improves forecast accuracy compared to benchmarks.
Study compares forecasting models for European financial markets and cryptocurrencies, finding hybrid ETS-ANN model best.
problem Challenges in predicting financial market fluctuations and cryptocurrency prices.
method Comparative analysis of ARIMA, hybrid ETS-ANN, and kNN models on European financial markets and cryptocurrency data.
result Hybrid ETS-ANN model performs best over extended periods, with moderate accuracy.
New variance-reduction methods solve stochastic composite inclusions.
problem Solving nonmonotone stochastic composite inclusions.
method Developed unbiased and biased variance-reduced estimators for FRBS method.
result Achieved best oracle complexities for finite-sum and expectation settings.
Bayesian model predicts oncology demand trends with high accuracy.
problem Accurate forecasting of oncology demand for resource planning.
method Boosting-based Bayesian conjugate models for Poisson process.
result Model outperforms other methods in trend detection accuracy.
Unified framework for integrating linear constraints in time series forecasting.
problem Challenges in traditional time series forecasting algorithms.
method Unified framework combining linear constraints in time series forecasting.
result Exact minimizer of the constrained empirical risk can be computed efficiently using linear algebra.
A new method speeds up sampling of Boltzmann distribution in high-dimensional systems.
problem High computational cost of obtaining Jacobian of flow-based models in high dimensions.
method Flow perturbation method that incorporates stochastic perturbations and reweighting.
result Achieves unbiased sampling of Boltzmann distribution with orders of magnitude speedup.
LSTM models outperform traditional ARIMA in S&P 500 forecasting.
problem Forecasting volatile financial data with non-linear dependencies.
method Compared LSTM and ARIMA models using historical data and technical indicators.
result LSTM models outperformed ARIMA in accuracy and error metrics.