Federated learning algorithm improves with intermittent client availability.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Unified framework for intermittent demand forecasting using renewal processes.
This paper introduces intermittent learning - the goal of which is to enable energy harvested computing platforms capable of executing certain classes of machine learning tasks effectively and efficiently. We identify unique challenges to intermittent learning relating to the data and application semantics of machine l…
The study uses Gaussian Processes with Tweedie likelihood for forecasting intermittent time series.
Intermittent demand, where demand occurrences appear sporadically in time, is a common and challenging problem in forecasting. In this paper, we first make the connections between renewal processes, and a collection of current models used for intermittent demand forecasting. We then develop a set of models that benefit…
Global models outperform local models in forecasting intermittent time series.
A new Bayesian model improves forecasting for intermittent demand.
Maximum likelihood estimation applied to high-frequency data allows us to quantify intermittency in the fluctu- ations of asset prices. From time records as short as one month these methods permit extraction of a meaningful intermittency parameter λ characterising the degree of volatility clustering of asset prices. We…
We present a model of financial markets originally proposed for a turbulent flow, as a dynamic basis of its intermittent behavior. Time evolution of the price change is assumed to be described by Brownian motion in a power-law potential, where the `temperature' fluctuates slowly. The model generally yields a fat-tailed…
A new metric optimizes forecasts for lumpy, intermittent demand.
A new model captures multifractal volatility in stock returns.
A new model captures multifractal volatility in stock returns.
Factorial moments are convenient tools in nuclear physics to characterize the multiplicity distributions when phase-space resolution () becomes small. For uncorrelated particle production within , Gaussian statistics holds and factorial moments are equal to unity for all orders . Correlations between par…
NeuralPrefix fills in missing sensor data without additional training.
In this paper we study the price dynamics in a simple model of financial markets with heterogeneous agents. We concentrate on how increases in the total number of active traders influences fluctuations of asset prices. We find that a curious route to chaos is observed when the total number of [active traders] increases…
Multiplicative random cascade model naturally reproduces the intermittency or multifractality, which is frequently shown among hierarchical complex systems such as turbulence and financial markets. As described herein, we investigate the validity of a multiplicative hierarchical random cascade model through an empirica…
We present a scalable and robust Bayesian inference method for linear state space models. The method is applied to demand forecasting in the context of a large e-commerce platform, paying special attention to intermittent and bursty target statistics. Inference is approximated by the Newton-Raphson algorithm, reduced t…
Sharp heat kernel estimates on manifolds lead to solutions of the Parabolic Anderson model.
SurvSurf predicts first hitting times for intermittent events without monotonic violations.
Paper addresses state estimation in sensor networks with intermittent data.
Proposes a pricing agent using reinforcement learning to balance renewable energy demand.
A new hierarchical forecasting method improves overall accuracy.
The Minority Game framework was recently generalized to account for the possibility that agents adapt not only through strategy selection but also by diversifying their response according to the kind of dynamical regime, or the risk, they perceive. Here we study the effects of this mechanism in different information st…
Successful implementation of California's Renewable Portfolio Standard (RPS) mandating 33 percent renewable energy generation by 2020 requires inclusion of a robust strategy to mitigate increased risk of energy deficits (blackouts) due to short time-scale (sub 1 hour) intermittencies in renewable energy sources. Of the…
This work optimizes DNN inference for energy-harvesting devices by compressing and selectively executing neural network exits.
Studying the impact of climate change on precipitation is constrained by finding a way to evaluate the evolution of precipitation variability over time. Classical approaches (feature-based) have shown their limitations for this issue due to the intermittent and irregular nature of precipitation. In this study, we prese…
Method extracts governing laws from non-Gaussian stochastic systems data.
ACI uses Bayesian data assimilation to trace causes from effects in complex systems.
In this paper, we show how simple logistic growth that was studied intensively during the last 200 years in many domains of science could be extended in a rather simple way and with these extensions is capable to produce a collection of behaviors widely observed in an enormous number of real-life systems in Economics, …
Bayesian method improves grid admittance matrix estimation from noisy data.
Paper shows local SGD outperforms mini-batch SGD under certain conditions.
Unified analysis of FL with arbitrary client participation.
Large-scale distributed training requires significant communication bandwidth for gradient exchange that limits the scalability of multi-node training, and requires expensive high-bandwidth network infrastructure. The situation gets even worse with distributed training on mobile devices (federated learning), which suff…
The formation of price in a financial market is modelled as a chain of Ising spin with three fundamental figures of trading. We investigate the time behaviour of the model, and we compare the results with the real EURO/USD change rate. By using the test of local Poisson hypothesis, we show that this minimal model leads…
New method models complex dynamics using a base variable.
We find empirically a characteristic sharp peak-flat trough pattern in a large set of commodity prices. We argue that the sharp peak structure reflects an endogenous inter-market organization, and that peaks may be seen as local ``singularities'' resulting from imitation and herding. These findings impose a novel strin…
In Europe, Germany is taking the lead in the switch from the conventional to renewable energy. This poses new challenges as wind and solar energy are fundamentally intermittent, weather-dependent and less predictable. It is therefore of considerable interest to investigate the evolution of price volatility in this post…
We introduce a minimal Agent Based Model for financial markets to understand the nature and Self-Organization of the Stylized Facts. The model is minimal in the sense that we try to identify the essential ingredients to reproduce the main most important deviations of price time series from a Random Walk behavior. We fo…
SPECTRA improves probabilistic energy forecasting by separating trends and uncertainties.
Paper optimizes FL communication efficiency with stochastic optimization.
We suggest a general oracle-based framework that captures different parallel stochastic optimization settings described by a dependency graph, and derive generic lower bounds in terms of this graph. We then use the framework and derive lower bounds for several specific parallel optimization settings, including delayed …
We consider several estimation and learning problems that networked agents face when making decisions given their uncertainty about an unknown variable. Our methods are designed to efficiently deal with heterogeneity in both size and quality of the observed data, as well as heterogeneity over time (intermittence). The …
Study on collaborative vs. non-collaborative online and bandit convex optimization.
We study a phenomenological model for the continuous double auction, equivalent to two independent queues. The continuous double auction defines a continuous-time random walk for trade prices. The conditions for ergodicity of the auction are derived and, as a consequence, three possible regimes in the behavior …
A new method reduces communication in Federated Learning by pulling less often.
This is a short review in honor of B. Mandelbrot's 80st birthday, to appear in W ilmott magazine. We discuss how multiplicative cascades and related multifractal ideas might be relevant to model the main statistical features of financial time series, in particular the intermittent, long-memory nature of the volatility.…
Trajectory segmentation is the process of subdividing a trajectory into parts either by grouping points similar with respect to some measure of interest, or by minimizing a global objective function. Here we present a novel online algorithm for segmentation and summary, based on point density along the trajectory, and …
The scaling properties of the time series of asset prices and trading volumes of stock markets are analysed. It is shown that similarly to the asset prices, the trading volume data obey multi-scaling length-distribution of low-variability periods. In the case of asset prices, such scaling behaviour can be used for risk…