Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

12.5%25.0%37.5%50.0% · May 199319922001200920172026
48 results for distributed parameter systems

Paper proposes a GPU-based system for training massive deep learning models in ads systems.

problem Training massive deep learning models with terabyte-scale parameters in ads systems.
method Hierarchical GPU parameter server with 3-layer storage (GPU High-Bandwidth Memory, CPU main memory, SSD).
result 4-node hierarchical GPU parameter server trains a model 2X faster than a 150-node in-memory system.

EPD method accurately captures parameter distributions from RCS data.

problem Limitations of traditional methods in estimating parameter distributions from RCS data.
method EPD method generates synthetic trajectories, estimates parameters, and selects parameters based on discrepancy.
result EPD provides accurate distribution of parameters without data loss.

Paper fine-tunes a simulation-driven estimator to reduce out-of-distribution errors.

problem Out-of-distribution errors in simulation-driven parameter estimators.
method Fine-tuning a Two-Stage estimator to improve accuracy for true parameters outside the sampled range.
result The fine-tuning approach reduces out-of-distribution errors and improves accuracy.

EIDGM model estimates DE parameters from RCS data.

problem Estimating DE parameters from RCS data with heterogeneities.
method Physics-informed neural network emulator + Wasserstein GAN parameter generator.
result EIDGM accurately captures diverse parameter distributions.

A deterministic system of coupled maps is proposed as a model for economic activity among interacting agents. The values of the maps represent the wealth of the agents. The dynamics of the system is controlled by two parameters. One parameter expresses the growth capacity of the agents and the other describes the local…

2007-01-09abs ↗pdf ↗

A fast method for estimating radar amplitude density parameters.

problem Accurate estimation of amplitude density function parameters in radar applications.
method Projecting amplitude data onto horizontal and vertical axes, then using MLE for α\alpha-stale distribution parameters.
result The average of computed MLEs based on two projections is a fast and accurate estimator for amplitude distribution parameters.

In distributed ML applications, shared parameters are usually replicated among computing nodes to minimize network overhead. Therefore, proper consistency model must be carefully chosen to ensure algorithm's correctness and provide high throughput. Existing consistency models used in general-purpose databases and moder…

2013-12-30abs ↗pdf ↗

Exact results on power-law distributions in systems with resets.

problem Understanding power-law distributions in systems with resets.
method Exact mathematical analysis of multiplicative processes with resets.
result Power-law distributions are built up over time and their moments behave quantitatively determined by parameters.

Study optimizes sensor placement for accurate parameter estimation in complex systems.

problem Challenges in parameter estimation with limited or noisy data.
method Physics-Informed Neural Networks (PINNs) for optimal sensor placement and parameter estimation.
result PINNs-based framework achieves higher accuracy in parameter estimation compared to random sensor placements.

The parameter server architecture is prevalently used for distributed deep learning. Each worker machine in a parameter server system trains the complete model, which leads to a hefty amount of network data transfer between workers and servers. We empirically observe that the data transfer has a non-negligible impact o…

2018-12-27abs ↗pdf ↗

Paper designs energy-based controllers and observers for complex systems.

problem Controlling and observing infinite-dimensional systems with in-domain actuation.
method Uses Stokes-Dirac structures and jet-bundle structures to derive controllers and observers.
result Control schemes derived in both frameworks are equivalent.

KOMET identifies Koopman operators from model parameter trajectories to adapt to evolving data distributions.

problem Adaptation of parametric models to non-stationary environments.
method Data-driven framework using Koopman operator identification and Extended Dynamic Mode Decomposition (EDMD).
result KOMET achieves high autonomous-rollout accuracies of 0.981 to 1.000 over 100 time steps on various drifting datasets.

The performance of fully synchronized distributed systems has faced a bottleneck due to the big data trend, under which asynchronous distributed systems are becoming a major popularity due to their powerful scalability. In this paper, we study the generalization performance of stochastic gradient descent (SGD) on a dis…

2019-09-29abs ↗pdf ↗

New method optimizes sensor placement for stochastic systems efficiently.

problem Optimizing sensor placements for black-box stochastic systems with computational constraints.
method Trains a joint energy-based model on simulation data to learn parameter and solution distributions, allowing efficient sensor placement.
result Demonstrates lower computational cost and more informative sensor locations compared to conventional approaches.

DiffOPF solves multi-valued OPF problems by sampling from system history.

problem Multi-valued and non-convex OPF problems due to system parameter variability.
method DiffOPF treats OPF as a conditional sampling problem, learning from historical data.
result DiffOPF enables statistically credible warm starts with favorable cost and constraint satisfaction trade-offs.

A distributed system identification method for LTI systems using reverse experience replay.

problem Online system identification of LTI systems over multi-agent networks.
method DSGD-RER, a distributed variant of SGD-RER with backward updates.
result The estimation error decreases as the network size grows.

VED framework learns low-dimensional latent representations of physical systems.

problem Learning latent representations of complex physical systems.
method Variational Encoder-Decoder (VED) framework with KL divergence and covariance regularization.
result VED achieves lower-dimensional latent representations with improved feature disentanglement.

We consider the problem of online learning of optimal control for repeatedly operated systems in the presence of parametric uncertainty. During each round of operation, environment selects system parameters according to a fixed but unknown probability distribution. These parameters govern the dynamics of a plant. An ag…

2016-09-18abs ↗pdf ↗

Neural networks improve gravitational-wave parameter estimation.

problem Estimating parameters of binary black hole systems from gravitational-wave data.
method Autoregressive normalizing flows for likelihood-free inference.
result Performance comparable to current best deep-learning approaches, with fast sampling.

Develops unbiased averaging methods for second order optimization in distributed systems.

problem Computing the Hessian is challenging and communication is a bottleneck in distributed optimization.
method Unbiased parameter averaging methods using sampling and sketching of the Hessian.
result Provably minimizes bias for sketched Newton directions.

We propose an input design method for a general class of parametric probabilistic models, including nonlinear dynamical systems with process noise. The goal of the procedure is to select inputs such that the parameter posterior distribution concentrates about the true value of the parameters; however, exact computation…

2019-03-06abs ↗pdf ↗

CAdam optimizes online learning by adapting to distribution shifts and noise.

problem Challenges in online learning data, including distribution shifts and noise, affect Adam's performance.
method CAdam uses a confidence-based approach to assess the consistency between momentum and gradients before updating parameters.
result CAdam outperforms other optimizers in various settings with distribution shift or noise.

Solves parameter non-identifiability in Bayesian LTI system identification.

problem Parameter non-identifiability in standard Bayesian approaches for LTI system identification.
method Embedding canonical forms of LTI systems within the Bayesian framework.
result Unlocking the use of meaningful priors and robust uncertainty estimates.

RODE-Net learns ODEs from data with random parameters using neural networks and GANs.

problem Learning ODEs from data with unknown and random parameters.
method RODE-Net combines symbolic networks and GANs to estimate both the ODE and its parameters.
result RODE-Net can accurately estimate the distribution of model parameters and make reliable predictions.

The main challenge for adaptive regulation of linear-quadratic systems is the trade-off between identification and control. An adaptive policy needs to address both the estimation of unknown dynamics parameters (exploration), as well as the regulation of the underlying system (exploitation). To this end, optimism-based…

2017-11-20abs ↗pdf ↗

A new method estimates time-varying parameters in earth system models using offline and online data assimilation.

problem Estimating time-varying parameters in complex earth system models.
method Hybrid Offline Online Parameter Estimation with Particle Filtering (HOOPE-PF)
result HOOPE-PF outperforms existing methods, especially with small ensemble sizes.

The paper analyzes heavy-tailed multivariate distributions in non-stationary systems using random matrix theory.

problem Risk assessment for rare events in complex, non-stationary systems.
method Generalized scalar product between correlation matrices, model for non-stationary fluctuations.
result Formulae for multivariate distributions with reduced parameters, facilitating applications.

Study analyzes stock market correlations using multivariate distributions.

problem Capturing the correlation structure of complex, non-stationary systems.
method Applied Random Matrix Model to empirical data of 479 US stocks.
result Described and quantified changes in empirical distributions due to non-stationarity.

The Allen-Cahn system on manifolds yields multiple phase distributions.

problem Finding the number of solutions to the Allen-Cahn system on manifolds.
method Volume-fixing variations approach to classify isoperimetric clusters.
result The number of solutions is bounded by topological invariants for parallelizable manifolds.

Complex non-linear interactions between banks and assets we model by two time-dependent Erdős Renyi network models where each node, representing bank, can invest either to a single asset (model I) or multiple assets (model II). We use dynamical network approach to evaluate the collective financial failure---systemic ri…

2014-03-22abs ↗pdf ↗

In science and engineering, intelligent processing of complex signals such as images, sound or language is often performed by a parameterized hierarchy of nonlinear processing layers, sometimes biologically inspired. Hierarchical systems (or, more generally, nested systems) offer a way to generate complex mappings usin…

2012-12-24abs ↗pdf ↗