Paper proposes a GPU-based system for training massive deep learning models in ads systems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
EPD method accurately captures parameter distributions from RCS data.
A defining feature of non-stationary systems is the time dependence of their statistical parameters. Measured time series may exhibit Gaussian statistics on short time horizons, due to the central limit theorem. The sample statistics for long time horizons, however, averages over the time-dependent parameters. To model…
Paper fine-tunes a simulation-driven estimator to reduce out-of-distribution errors.
Economic systems are similar with physic systems for their large number of individuals and the exist of equilibrium. In this paper, we present a model applying the equilibrium statistical model in economic systems. Consistent with statistical physics, we define a series of concepts, such as economic temperature, econom…
EIDGM model estimates DE parameters from RCS data.
A deterministic system of coupled maps is proposed as a model for economic activity among interacting agents. The values of the maps represent the wealth of the agents. The dynamics of the system is controlled by two parameters. One parameter expresses the growth capacity of the agents and the other describes the local…
A fast method for estimating radar amplitude density parameters.
In distributed ML applications, shared parameters are usually replicated among computing nodes to minimize network overhead. Therefore, proper consistency model must be carefully chosen to ensure algorithm's correctness and provide high throughput. Existing consistency models used in general-purpose databases and moder…
Exact results on power-law distributions in systems with resets.
Study optimizes sensor placement for accurate parameter estimation in complex systems.
Derives PDEs from data using manifold learning and neural networks.
We address the problem of parameter estimation in models of systems biology from noisy observations. The models we consider are characterized by simultaneous deterministic nonlinear differential equations whose parameters are either taken from in vitro experiments, or are hand-tuned during the model development process…
The parameter server architecture is prevalently used for distributed deep learning. Each worker machine in a parameter server system trains the complete model, which leads to a hefty amount of network data transfer between workers and servers. We empirically observe that the data transfer has a non-negligible impact o…
Based on the stochastic model proposed by Patriarca-Kaski-Chakraborti that describes the exchange of wealth between economic agents, we analyze the evolution of the corresponding economies under the assumption of a Gaussian background, modeling the exchange parameter . We demonstrate, that within Gaussian noise,…
Paper designs energy-based controllers and observers for complex systems.
KOMET identifies Koopman operators from model parameter trajectories to adapt to evolving data distributions.
The performance of fully synchronized distributed systems has faced a bottleneck due to the big data trend, under which asynchronous distributed systems are becoming a major popularity due to their powerful scalability. In this paper, we study the generalization performance of stochastic gradient descent (SGD) on a dis…
New method optimizes sensor placement for stochastic systems efficiently.
To know the statistical distribution of a variable is an important problem in management of resources. Distributions of the power law type are observed in many real systems. However power law distributions have an infinite variance and thus can not be used as a standard distribution. Normally professionals in the area …
Bayesian inference models failure distributions in autonomous systems.
Recently, reinforcement learning (RL) algorithms have demonstrated remarkable success in learning complicated behaviors from minimally processed input. However, most of this success is limited to simulation. While there are promising successes in applying RL algorithms directly on real systems, their performance on mor…
A deterministic system of interacting agents is considered as a model for economic dynamics. The dynamics of the system is described by a coupled map lattice with near neighbor interactions. The evolution of each agent results from the competition between two factors: the agent's own tendency to grow and the environmen…
DiffOPF solves multi-valued OPF problems by sampling from system history.
A distributed system identification method for LTI systems using reverse experience replay.
VED framework learns low-dimensional latent representations of physical systems.
We consider the problem of online learning of optimal control for repeatedly operated systems in the presence of parametric uncertainty. During each round of operation, environment selects system parameters according to a fixed but unknown probability distribution. These parameters govern the dynamics of a plant. An ag…
Neural networks improve gravitational-wave parameter estimation.
Develops unbiased averaging methods for second order optimization in distributed systems.
Method leverages population data to deconvolve unknown noise and model parameters.
We propose an input design method for a general class of parametric probabilistic models, including nonlinear dynamical systems with process noise. The goal of the procedure is to select inputs such that the parameter posterior distribution concentrates about the true value of the parameters; however, exact computation…
In many distributed learning problems, the heterogeneous loading of computing machines may harm the overall performance of synchronous strategies. In this paper, we propose an effective asynchronous distributed framework for the minimization of a sum of smooth functions, where each machine performs iterations in parall…
CAdam optimizes online learning by adapting to distribution shifts and noise.
Solves parameter non-identifiability in Bayesian LTI system identification.
RODE-Net learns ODEs from data with random parameters using neural networks and GANs.
We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete or continuous distribution over random matrices. Our reformulation has several e…
Paper develops PAC-Bayes bounds for unknown linear systems.
End-to-end portfolio system accounts for model risk.
The main challenge for adaptive regulation of linear-quadratic systems is the trade-off between identification and control. An adaptive policy needs to address both the estimation of unknown dynamics parameters (exploration), as well as the regulation of the underlying system (exploitation). To this end, optimism-based…
A new method estimates time-varying parameters in earth system models using offline and online data assimilation.
Bayesian ANN method predicts chaotic systems with uncertainty.
The paper analyzes heavy-tailed multivariate distributions in non-stationary systems using random matrix theory.
In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the Stochastic Gradient Langevin Dynamics algorithm to draw samples from the posterior …
Study analyzes stock market correlations using multivariate distributions.
The Allen-Cahn system on manifolds yields multiple phase distributions.
The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the system as the parameter values are varied. This process often encounters two major d…
Complex non-linear interactions between banks and assets we model by two time-dependent Erdős Renyi network models where each node, representing bank, can invest either to a single asset (model I) or multiple assets (model II). We use dynamical network approach to evaluate the collective financial failure---systemic ri…
In science and engineering, intelligent processing of complex signals such as images, sound or language is often performed by a parameterized hierarchy of nonlinear processing layers, sometimes biologically inspired. Hierarchical systems (or, more generally, nested systems) offer a way to generate complex mappings usin…