ShadowSync separates background synchronization for scalable distributed training.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Research explores how interconnected systems synchronize and how to control their behavior.
A predictor improves power grid frequency forecasts up to one hour.
Efficient and robust algorithms for decentralized estimation in networks are essential to many distributed systems. Whereas distributed estimation of sample mean statistics has been the subject of a good deal of attention, computation of -statistics, relying on more expensive averaging over pairs of observations, is…
One dimensional stylized model taking into account spatial activity of firms with uniformly distributed customers is proposed. The spatial selling area of each firm is defined by a short interval cut out from selling space (large interval). In this representation, the firm size is directly associated with the size of i…
We present Distributed Equivalent Substitution (DES) training, a novel distributed training framework for large-scale recommender systems with dynamic sparse features. DES introduces fully synchronous training to large-scale recommendation system for the first time by reducing communication, thus making the training of…
Novel higher-order group synchronization for noisy local measurements on hypergraphs.
New method uses neural networks for accurate angle estimation in noisy conditions.
The sectoral synchronization observed for the Japanese business cycle in the Indices of Industrial Production data is an example of synchronization. The stability of this synchronization under a shock, e.g., fluctuation of supply or demand, is a matter of interest in physics and economics. We consider an economic syste…
We analyze how an observer synchronizes to the internal state of a finite-state information source, using the epsilon-machine causal representation. Here, we treat the case of exact synchronization, when it is possible for the observer to synchronize completely after a finite number of observations. The more difficult …
New algorithm uses PSO to optimize DNN training parameters in distributed systems.
In this work, we propose a hybrid approach to synchronize large scale networks. In particular, we draw on Kalman Filtering (KF) along with time-stamps generated by the Precision Time Protocol (PTP) for pairwise node synchronization. Furthermore, we investigate the merit of Factor Graphs (FGs) along with Belief Propagat…
New method synchronizes graphs with probability measures on rotations.
Study predicts synchronization state of financial time series using cross-recurrence plots.
This paper proposes a general model for synchronized crowding behavior. An order parameter is introduced to quantify the level of synchronization which is shown a function of percentage of agents in reactive state. Further, synchronization is shown to be driven by the most active agents with the highest volatility. A t…
Efficiently estimates rotations with corrupted data.
Study optimizes estimation of orthogonal and rotation matrices from noisy data.
Solves complex clustering and rotation synchronization problem.
Spectral method for joint community detection and group synchronization.
Study financial markets using synchronization measures and clustering algorithms.
Spectral methods achieve near-optimal performance in orthogonal and permutation group synchronization.
Networks of coupled dynamical systems provide a powerful way to model systems with enormously complex dynamics, such as the human brain. Control of synchronization in such networked systems has far reaching applications in many domains, including engineering and medicine. In this paper, we formulate the synchronization…
Machine learning predicts synchronization transitions in unknown systems.
New method linearizes nonlinear coupled oscillators on graphs.
New approach predicts stock price synchronization using RNNs and LSTMs.
Adaptive synchronization improves deep reinforcement learning performance.
KuramotoGNN uses Kuramoto model to prevent over-smoothing in graph neural networks.
The paper studies how noise synchronizes tokens in deep transformer models.
Paper presents a probabilistic framework for diffusion synchronization.
We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find that an observer's average uncertainty in the source state vanishes exponential…
Paper addresses group synchronization with incomplete measurements and proves linear convergence of GPM.
The asymptotic pseudo-trajectory approach to stochastic approximation of Benaim, Hofbauer and Sorin is extended for asynchronous stochastic approximations with a set-valued mean field. The asynchronicity of the process is incorporated into the mean field to produce convergence results which remain similar to those of a…
Researchers compare two GAN models for lip-synchronization tasks.
The bulk synchronous parallel (BSP) is a celebrated synchronization model for general-purpose parallel computing that has successfully been employed for distributed training of machine learning models. A prevalent shortcoming of the BSP is that it requires workers to wait for the straggler at every iteration. To amelio…
Existing multi-armed bandit (MAB) models make two implicit assumptions: an arm generates a payoff only when it is played, and the agent observes every payoff that is generated. This paper introduces synchronization bandits, a MAB variant where all arms generate costs at all times, but the agent observes an arm's instan…
We study the quantum synchronization between a pair of two-level systems inside two coupled cavities. By using a digital-analog decomposition of the master equation that rules the system dynamics, we show that this approach leads to quantum synchronization between both two-level systems. Moreover, we can identify in th…
Study on synchronization in financial markets with time delays.
NS-RGS improves orthogonal group synchronization with faster convergence.
The waiting time needed for a stock market index to undergo a given percentage change in its value is found to have an up-down asymmetry, which, surprisingly, is not observed for the individual stocks composing that index. To explain this, we introduce a market model consisting of randomly fluctuating stocks that occas…
Extends angular synchronization to heterogeneous groups, improving accuracy in multiple applications.
Detects synchronized behavior in streaming data.
We adapt tools from information theory to analyze how an observer comes to synchronize with the hidden states of a finitary, stationary stochastic process. We show that synchronization is determined by both the process's internal organization and by an observer's model of it. We analyze these components using the conve…
We propose a general framework for solving the group synchronization problem, where we focus on the setting of adversarial or uniform corruption and sufficiently small noise. Specifically, we apply a novel message passing procedure that uses cycle consistency information in order to estimate the corruption levels of gr…
A probing scheme is considered with an accessible and controllable qubit, used to probe an out-of equilibrium system consisting of a second qubit interacting with an environment. Quantum spontaneous synchronization between the probe and the system emerges in this model and, by tuning the probe frequency, can occur both…
Novel method solves group synchronization with robust corruption tolerance.
DS-Sync improves distributed DNN training efficiency by 94% with minimal accuracy loss.
The paper develops robust tests for detecting independence in synchronous stochastic systems with finite sample guarantees.
In this paper, we show synchronization for a group of output passive agents that communicate with each other according to an underlying communication graph to achieve a common goal. We propose a distributed event-triggered control framework that will guarantee synchronization and considerably decrease the required comm…