A new method reduces communication in Federated Learning by pulling less often.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
UDVD uses deep learning to denoise videos without supervision.
In this paper, we take a new approach for time of arrival geo-localization. We show that the main sources of error in metropolitan areas are due to environmental imperfections that bias our solutions, and that we can rely on a probabilistic model to learn and compensate for them. The resulting localization error is val…
The Canonical Regression Quantile method predicts CEO compensation and future performance.
The paper simplifies calculus for semimartingales using multiplicative compensation.
Machine learning improves PMD compensation in multiplexed systems.
We propose and study the known-compensation multi-arm bandit (KCMAB) problem, where a system controller offers a set of arms to many short-term players for steps. In each step, one short-term player arrives to the system. Upon arrival, the player aims to select an arm with the current best average reward and receiv…
Study incentivizes exploration in non-stationary MAB with compensation.
New neural network improves MRI reconstruction for non-Cartesian data.
The paper analyzes fairness of compensation-based risk-sharing schemes for fund payouts.
A machine learning model for PMD compensation in dual-polarization systems.
We present a method to compensate statistical errors in the calculation of correlations on asynchronous time series. The method is based on the assumption of an underlying time series. We set up a model and apply it to financial data to examine the decrease of calculated correlations towards smaller return intervals (E…
Extends compactness theory to variable-coefficient pseudo-differential operators on manifolds.
The problem of completeness of the forward rate based bond market model driven by a Lévy process under the physical measure is examined. The incompleteness of market in the case when the Lévy measure has a density function is shown. The required elements of the theory of stochastic integration over the compensated jump…
Communication is a key bottleneck in distributed training. Recently, an \emph{error-compensated} compression technology was particularly designed for the \emph{centralized} learning and receives huge successes, by showing significant advantages over state-of-the-art compression based methods in saving the communication…
Let be a continuous-time, time-homogeneous strong Markov process with possible jumps and let be its first hitting time of a Borel subset of the state space. Suppose is sampled at random times and suppose also that has not hit the Borel set by time . What is the intensity process of ba…
A new IC-Connection improves disentanglement in conditional GANs.
Data parallelism has become the de facto standard for training Deep Neural Network on multiple processing units. In this work we propose DC-S3GD, a decentralized (without Parameter Server) stale-synchronous version of the Delay-Compensated Asynchronous Stochastic Gradient Descent (DC-ASGD) algorithm. In our approach, w…
We discuss the pricing of defaultable assets in an incomplete information model where the default time is given by a first hitting time of an unobservable process. We show that in a fairly general Markov setting, the indicator function of the default has an absolutely continuous compensator. Given this compensator we t…
For the efficient compensation of fiber nonlinearity, one of the guiding principles appears to be: fewer steps are better and more efficient. We challenge this assumption and show that carefully designed multi-step approaches can lead to better performance-complexity trade-offs than their few-step counterparts.
Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this problem have been proposed, including different forms of gradient compression or computing local models and mixing them iteratively. In this paper…
We present two statistical causes for the distortion of correlations on high-frequency financial data. We demonstrate that the asynchrony of trades as well as the decimalization of stock prices has a large impact on the decline of the correlation coefficients towards smaller return intervals (Epps effect). These distor…
A reliable controller is critical and essential for the execution of safe and smooth maneuvers of an autonomous vehicle.The controller must be robust to external disturbances, such as road surface, weather, and wind conditions, and so on.It also needs to deal with the internal parametric variations of vehicle sub-syste…
Extends weak continuity of Yang-Mills connections to a broader class.
A second order self-adjoint operator is uniquely defined by its principal symbol and potential if it acts on half-densities. We analyse the potential as a compensating field (gauge field) in the sense that it compensates the action of coordinate transformations on the second derivatives in…
This paper proposed a bias-compensated normalized maximum correntropy criterion (BCNMCC) algorithm charactered by its low steady-state misalignment for system identification with noisy input in an impulsive output noise environment. The normalized maximum correntropy criterion (NMCC) is derived from a correntropy based…
The study proves a theorem on Riemannian manifolds for wedge products of weakly convergent differential forms.
Integrated gradients are widely employed to evaluate the contribution of input features in classification models because it satisfies the axioms for attribution of prediction. This method, however, requires an appropriate baseline for reliable determination of the contributions. We propose a compensated integrated grad…
Proposes a compensation mechanism for improving individual forecast confidence.
In this paper the method of compensated compactness is applied to the problem of isometric immersion of a two dimensional Riemannian manifold with negative Gauss curvature into three dimensional Euclidean space. Previous applications of the method to this problem have required decay of order in the Gauss curva…
This paper explores how enforcing equivariance constraints limits neural network expressivity and proposes compensatory model size increases.
Proposes ContSup to boost local learning by supplying context between isolated modules.
A CNN-based method improves DTI of the human heart, compensating for motion.
We present a compensated compactness theorem in Banach spaces established recently, whose formulation is originally motivated by the weak rigidity problem for isometric immersions of manifolds with lower regularity. As a corollary, a geometrically intrinsic div-curl lemma for tensor fields on Riemannian manifolds is ob…
Paper introduces non-linear discounting models for default compensation and climate valuation.
Survey on recent developments in isometric immersions using PDE techniques.
Study compactness and continuity in Sobolev wave front set spaces for smooth vector bundles.
In this paper, a class of statistics named ART (the alternant recursive topology statistics) is proposed to measure the properties of correlation between two variables. A wide range of bi-variable correlations both linear and nonlinear can be evaluated by ART efficiently and equitably even if nothing is known about the…
Critical points of scale-invariant curvature energies in 4D are analytic.
Compensation methods correct overestimation of adversarial robustness in neural networks.
Study optimal control strategy for hedge funds managers with PSAHARA utility family.
Federated learning is a recently proposed paradigm that enables multiple clients to collaboratively train a joint model. It allows clients to train models locally, and leverages the parameter server to generate a global model by aggregating the locally submitted gradient updates at each round. Although the incentive mo…
We study incentivized exploration for the multi-armed bandit (MAB) problem where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward. We seek to understand the impact of this drifted reward feedback by analyzing the performance of three instantiatio…
New techniques improve distributed training with compressed gradients.
A fundamental problem in differential geometry is to characterize intrinsic metrics on a two-dimensional Riemannian manifold which can be realized as isometric immersions into . This problem can be formulated as initial and/or boundary value problems for a system of nonlinear partial differential…
Study on optimal fees in hedge funds with first-loss compensation.
The paper models market dynamics using a limit order book system to explain slippage and inefficiency.
We are concerned with the global weak continuity of the Cartan structural system -- or equivalently, the Gauss--Codazzi--Ricci system -- on semi-Riemannian manifolds with lower regularity. For this purpose, we first formulate and prove a geometric compensated compactness theorem on vector bundles over semi-Riemannian m…