Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

50100150200 · Jun 202019922001200920172026
48 results for online aggregation

BOA improves financial forecasting by combining expert models.

problem Challenges in choosing between multiple machine learning models for financial forecasting.
method Online aggregation of expert models using Bernstein Online Aggregation (BOA) procedure.
result BOA leads to better portfolio performance, higher Sharpe Ratio, and lower shortfall.

Adaptive Bayesian learning aggregates experts to improve performance.

problem Bayesian online learning's performance depends on inferential choices.
method Treat Bayesian update rules as experts and aggregate them based on sequential predictive losses.
result The aggregate competes with the best expert in hindsight at a low aggregation cost.

MELO predicts electricity loads by adapting to shifts without external indicators.

problem Adapting to non-stationary prediction challenges in online settings.
method MELO combines multiple forgetting factors and aggregation rules to adaptively predict.
result MELO reduces RMSE by 34.7% compared to base predictors and external covariates.

Algorithm for online decision making with unknown dynamics and aggregate feedback.

problem Online decision making with unknown dynamics and aggregate bandit feedback.
method Developed an algorithm based on online mirror descent with a self-concordant barrier regularization and an increasing learning rate schedule.
result Achieved O(K)O(\sqrt{K}) regret for the online Markov Decision Process with KK episodes.

Study online monotone density estimation with expert aggregation and log-optimal calibration.

problem Online monotone density estimation and log-optimal calibration.
method Proposed two online estimators: Grenander estimator and expert aggregation estimator.
result Online estimators achieve O(n1/3)O(n^{1/3}) cumulative log-likelihood gap and nlogn\sqrt{n\log{n}} pathwise regret bound.

Noisy labeled data is more a norm than a rarity for crowd sourced contents. It is effective to distill noise and infer correct labels through aggregation results from crowd workers. To ensure the time relevance and overcome slow responses of workers, online label aggregation is increasingly requested, calling for solut…

2018-07-19abs ↗pdf ↗

Study online learning in MDPs with aggregate bandit feedback, achieving low regret in both stochastic and adversarial settings.

problem Online learning in finite-horizon episodic MDPs with aggregate bandit feedback.
method Best-of-both-worlds (BOBW) algorithms using FTRL over occupancy measures, self-bounding techniques, and new loss estimators.
result First BOBW algorithms for episodic tabular MDPs with aggregate bandit feedback achieving O(logT)O(\log T) regret in stochastic and O(T){O}(\sqrt{T}) regret in adversarial settings.

New method improves forecast accuracy using CRPS for probabilistic predictions.

problem Improving forecast accuracy for probabilistic predictions, especially in the tails of distributions.
method Introduces a new weighting method for pointwise CRPS learning, optimizing across quantiles.
result Proposed fully adaptive Bernstein online aggregation (BOA) method for pointwise CRPS online learning has optimal convergence properties.

A winning method for day-ahead electricity demand forecasting during and after the COVID-19 pandemic.

problem Day-ahead electricity demand forecasting during and after the COVID-19 pandemic.
method Online forecast combination of multiple point prediction models with a holiday adjustment procedure and smoothed Bernstein Online Aggregation (BOA).
result Excellent forecasting performance, particularly due to the holiday adjustment procedure and fully adaptive smoothed BOA approach.

We introduce a new recursive aggregation procedure called Bernstein Online Aggregation (BOA). The exponential weights include an accuracy term and a second order term that is a proxy of the quadratic variation as in Hazan and Kale (2010). This second term stabilizes the procedure that is optimal in different senses. We…

2014-04-04abs ↗pdf ↗

New method forecasts time series with changing variances.

problem Real-world processes with changing variances cannot be captured by classical models.
method State-space model with Markov switching variances, using online learning and expert aggregation.
result Proposed method outperforms traditional expert aggregation and is robust to misspecification.

The paper explores trade-offs between regret and variance in online learning algorithms.

problem Investigating the trade-offs between regret and variance in online learning.
method Analysis of the Exponentially Weighted Average (EWA) algorithm and its variants.
result A variant of EWA either achieves negative regret or guarantees a logarithmic bound on both variance and regret.

Distillation is an effective knowledge-transfer technique that uses predicted distributions of a powerful teacher model as soft targets to train a less-parameterized student model. A pre-trained high capacity teacher, however, is not always available. Recently proposed online variants use the aggregated intermediate pr…

2019-12-01abs ↗pdf ↗

The paper addresses fairness in online learning by extending auditing schemes and presenting efficient algorithms.

problem Ensuring fairness in online learning while maximizing predictive accuracy.
method Extending auditing schemes to handle multiple auditors and presenting oracle-efficient algorithms.
result Presented algorithms achieve upper bounds on regret and fairness violations, improving on existing bounds.

Algorithm aggregates rewards from multiple players to learn related tasks in online bandit learning.

problem Learning related but slightly different tasks in an online setting with heterogeneous feedback.
method RobustAgg(ε)(ε) algorithm that aggregates rewards from different players.
result Achieves instance-dependent regret guarantees and nearly matching lower bounds.

Value aggregation is a general framework for solving imitation learning problems. Based on the idea of data aggregation, it generates a policy sequence by iteratively interleaving policy optimization and evaluation in an online learning setting. While the existence of a good policy in the policy sequence can be guarant…

2018-01-22abs ↗pdf ↗

We use online convex optimization (OCO) for setpoint tracking with uncertain, flexible loads. We consider full feedback from the loads, bandit feedback, and two intermediate types of feedback: partial bandit where a subset of the loads are individually observed and the rest are observed in aggregate, and Bernoulli feed…

2017-09-12abs ↗pdf ↗

Random Forests (RF) is one of the algorithms of choice in many supervised learning applications, be it classification or regression. The appeal of such tree-ensemble methods comes from a combination of several characteristics: a remarkable accuracy in a variety of tasks, a small number of parameters to tune, robustness…

2019-06-25abs ↗pdf ↗

We consider online learning in episodic loop-free Markov decision processes (MDPs), where the loss function can change arbitrarily between episodes, and the transition function is not known to the learner. We show O~(LXAT)\tilde{O}(L|X|\sqrt{|A|T}) regret bound, where TT is the number of episodes, XX is the state space, $A…

2019-05-19abs ↗pdf ↗

Improved multiclass logistic regression with lower computational complexity.

problem High computational complexity in existing methods for multiclass logistic regression.
method Developed a new algorithm that achieves a lower computational complexity.
result Achieved a regret of O(log(Bn))O(\log(Bn)) with computational complexity O(n1.5)O(n^{1.5}).

The paper develops a method for forecasting power consumption at various levels of aggregation.

problem Forecasting power consumption at different levels of household aggregation.
method Three-step process: feature generation, aggregation, and projection.
result The method provides theoretical guarantees on prediction error and performs well on real data.

Algorithm learns expert weights to minimize regret in adversarial setting.

problem Learning to aggregate expert forecasts with no-regret guarantee in adversarial conditions.
method Online mirror descent algorithm for logarithmic pooling of expert forecasts.
result Achieves O(TlogT)O(\sqrt{T} \log T) expected regret compared to best weights.

Paper proposes a faster method for fuzzy neural networks by removing unsuitable hyperboxes.

problem Reducing training time for fuzzy neural networks.
method A novel hyperbox selection rule based on mathematical formulas to remove unsuitable hyperboxes.
result Significant decrease in training time for both online and agglomerative learning algorithms.

New method for online learning IC models with node-level feedback.

problem Learning IC models with node-level feedback in social networks.
method Detailed analysis and online algorithm with O(T)\mathcal{O}( \sqrt{T}) cumulative regret.
result First confidence-region result and online algorithm for IC models with node-level feedback.

Recent advancements in deep neural networks for graph-structured data have led to state-of-the-art performance on recommender system benchmarks. In this work, we present a Graph Convolutional Network (GCN) algorithm SWAG (Sample Weight and AGgregate), which combines efficient random walks and graph convolutions on weig…

2019-11-22abs ↗pdf ↗

We consider the problem of learning over non-stationary ranking streams. The rankings can be interpreted as the preferences of a population and the non-stationarity means that the distribution of preferences changes over time. Our goal is to learn, in an online manner, the current distribution of rankings. The bottlene…

2019-10-19abs ↗pdf ↗

Improved Thompson Sampling reduces regret in contextual bandits and reinforcement learning.

problem Thompson Sampling's exploration is insufficient in some contexts.
method Developed Feel-Good Thompson Sampling to address exploration issues.
result Feel-Good Thompson Sampling reduces regret compared to standard Thompson Sampling.

We study the question of how to aggregate controllers for dynamical systems in order to improve their performance. To this end, we propose a framework of boosting for online control. Our main result is an efficient boosting algorithm that combines weak controllers into a provably more accurate one. Empirical evaluation…

2019-06-20abs ↗pdf ↗

Paper proposes a method to aggregate customer engagement data for better ranking of e-commerce results.

problem Cold start problem and under-representation of new or under-impressed products in e-commerce search results.
method Aggregates customer engagements within a day for the same query as input training data for machine learning models.
result Training models on aggregated data leads to better ranking of new and under-impressed products.

Efficient strategies for online learning against bandit algorithms solve minimax problems.

problem Solving min-max problems in convex-linear settings with empirical distributions.
method Designing online learning algorithms that play against bandit algorithms, leveraging properties of the set of empirical distributions.
result High-probability convergence guarantees to minimax values for a specific family of sets.