A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
ADPSGD optimizes SGD convergence by varying averaging periods based on model variance.
STL-SGD accelerates Local SGD by gradually increasing communication periods.
Novel periodic momentum SGD method for decentralized training with linear speedup.
Communication-efficient SGD algorithms, which allow nodes to perform local updates and periodically synchronize local models, are highly effective in improving the speed and scalability of distributed SGD. However, a rigorous convergence analysis and comparative study of different communication-reduction strategies rem…
Federated learning is a distributed framework according to which a model is trained over a set of devices, while keeping data localized. This framework faces several systems-oriented challenges which include (i) communication bottleneck since a large number of devices upload their local updates to a parameter server, a…
The detection of community structure in stock market is of theoretical and practical significance for the study of financial dynamics and portfolio risk estimation. We here study the community structures in Chinese stock markets from the aspects of both price returns and turnover rates, by using a combination of the PM…
We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept drifts. This leads to a reduction of communication by an order of magnitude compared t…
Study examines Fed's pandemic communication strategies.
Unified analysis of federated learning with compression for various data distributions.
This article proposes a communication-efficient decentralized deep learning algorithm, coined layer-wise federated group ADMM (L-FGADMM). To minimize an empirical risk, every worker in L-FGADMM periodically communicates with two neighbors, in which the periods are separately adjusted for different layers of its deep ne…
Recently, the technique of local updates is a powerful tool in centralized settings to improve communication efficiency via periodical communication. For decentralized settings, it is still unclear how to efficiently combine local updates and decentralized communication. In this work, we propose an algorithm named as L…
Study examines financial contagion at community level, finding increased contagion density and widespread transmission.
This study diversifies stock and crypto portfolios using network analysis.
The paper analyzes cryptocurrency returns and uses community detection to create an investment portfolio.
FedGAN trains GANs across distributed data sources with reduced communication.
We study the cluster dynamics of multichannel (multivariate) time series by representing their correlations as time-dependent networks and investigating the evolution of network communities. We employ a node-centric approach that allows us to track the effects of the community evolution on the functional roles of indiv…
We study collaborative machine learning (ML) across wireless devices, each with its own local dataset. Offloading these datasets to a cloud or an edge server to implement powerful ML solutions is often not feasible due to latency, bandwidth and privacy constraints. Instead, we consider federated edge learning (FEEL), w…
About the economic growth the Keynesian theorists defend circular and cumulative processes, benefiting the rich localities and harming the poorest, without external interventions. In these processes the Verdoorn law has an important role. For Verdoorn (1949) the productivity growth rate is endogenous and depends of the…
CSER improves SGD efficiency by resetting errors and partial synchronization.
Large-scale machine learning training, in particular distributed stochastic gradient descent, needs to be robust to inherent system variability such as node straggling and random communication delays. This work considers a distributed training framework where each worker node is allowed to perform local model updates a…
A Health Service Area (HSA) is a group of geographic regions served by similar health care facilities. The delineation of HSAs plays a pivotal role in the characterization of health care services available in an area, enabling a better planning and regulation of health care services. Though Dartmouth HSAs have been the…
A new algorithm reduces communication in distributed SVD by factors.
Communication overhead is one of the key challenges that hinders the scalability of distributed optimization algorithms. In this paper, we study local distributed SGD, where data is partitioned among computation nodes, and the computation nodes perform local updates with periodically exchanging the model among the work…
In this work, we ask two questions: 1. Can we predict the type of community interested in a news article using only features from the article content? and 2. How well do these models generalize over time? To answer these questions, we compute well-studied content-based features on over 60K news articles from 4 communit…
A new algorithm reduces communication in decentralized optimization.
We use techniques from network science to study correlations in the foreign exchange (FX) market over the period 1991--2008. We consider an FX market network in which each node represents an exchange rate and each weighted edge represents a time-dependent correlation between the rates. To provide insights into the clus…
A new hybrid-ordered SGD method reduces communication and complexity for non-convex optimization.
MpFL models clients as strategic players to reach equilibrium with less communication.
We study the relationship between the sentiment levels of Twitter users and the evolving network structure that the users created by @-mentioning each other. We use a large dataset of tweets to which we apply three sentiment scoring algorithms, including the open source SentiStrength program. Specifically we make three…
Achieving international food security requires improved understanding of how international trade networks connect countries around the world through the import-export flows of food commodities. The properties of food trade networks are still poorly documented, especially from a multi-network perspective. In particular,…
The paper analyzes how market prices respond to information processing and non-linear dynamics.
We introduce tools to capture the dynamics of three different pathways, in which the synchronization of human decision-making could lead to turbulent periods and contagion phenomena in financial markets. The first pathway is caused when stock market indices, seen as a set of coupled integrate-and-fire oscillators, sync…
The deep learning trend has recently impacted a variety of fields, including communication systems, where various approaches have explored the application of neural networks in place of traditional designs. Neural networks flexibly allow for data/simulation-driven optimization, but are often employed as black boxes det…
This paper pretends to analyze the importance which the natural advantages and local resources are in the manufacturing industry location, in relation with the "spillovers" effects and industrial policies. To this, we estimate the Rybczynski equation matrix for the various manufacturing industries in Portugal, at regio…
Paper proposes a DRL-based controller for networked AP systems that reduces communication frequency.
Advanced kernels improve Gaussian process accuracy by incorporating domain knowledge.
Distributed optimization is essential for training large models on large datasets. Multiple approaches have been proposed to reduce the communication overhead in distributed training, such as synchronizing only after performing multiple local SGD steps, and decentralized methods (e.g., using gossip algorithms) to decou…
A standard belief on emerging collective behavior is that it emerges from simple individual rules. Most of the mathematical research on such collective behavior starts from imperative individual rules, like always go to the center. But how could an (optimal) individual rule emerge during a short period within the group…
The classical dynamic programming-based optimal stochastic control methods fail to cope with nonseparable dynamic optimization problems as the principle of optimality no longer applies in such situations. Among these notorious nonseparable problems, the dynamic mean-variance portfolio selection formulation had posted a…
A new algorithm reduces communication in deep learning training.
Since the beginning of the new millennium, stock markets went through every state from long-time troughs, trade suspensions to all-time highs. The literature on asset pricing hence assumes random processes to be underlying the movement of stock returns. Observed procyclicality and time-varying correlation of stock retu…
We provide an explicit aggregation in the neoclassical growth model with aggregate shocks and uninsurable employment risk. We show there are two restrictions on the unemployment shock for approximate aggregation to occur. First the probability of unemployment must be positive for each agent in each time period. That en…
A feature-rich Bitcoin trading assistant using reinforcement learning.
Agents collaboratively learn optimal policies in MDPs with limited capabilities.
In this note we study the bilateral merchandise trade flows between 186 countries over the 1948-2005 period using data from the International Monetary Fund. We use Pajek to identify network structure and behavior across thresholds and over time. In particular, we focus on the evolution of trade "islands" in the a world…
Semi-decentralized federated learning combines device-to-server and device-to-device communications for faster convergence.
The financial market is a complex dynamical system composed of a large variety of intricate relationships between several entities, such as banks, corporations and institutions. At the heart of the system lies the stock exchange mechanism, which establishes a time-evolving network of trades among companies and individu…
We present an analysis of the credit market of Japan. The analysis is performed by investigating the bipartite network of banks and firms which is obtained by setting a link between a bank and a firm when a credit relationship is present in a given time window. In our investigation we focus on a community detection alg…