Deep-Lock secures DNN models with secret keys.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
ESOP uses Bayesian optimization to find optimal lock-down schedules.
Lock-in, the escalating commitment of decision-makers to an ineffective course of action, has the potential to explain the large cost overruns in large scale transportation infrastructure projects. Lock-in can occur both at the decision-making level (before the decision to build) and at the project level (after the dec…
Study on bit threads and their locking properties in holographic spacetimes.
Training the deep convolutional neural network for computer vision problems is slow and inefficient, especially when it is large and distributed across multiple devices. The inefficiency is caused by the backpropagation algorithm's forward locking, backward locking, and update locking problems. Existing solutions for a…
Several experimental studies claim to be able to predict the outcome of simple decisions from brain signals measured before subjects are aware of their decision. Often, these studies use multivariate pattern recognition methods with the underlying assumption that the ability to classify the brain signal is equivalent t…
Due to space limitations, our submission "Source Separation and Clustering of Phase-Locked Subspaces", accepted for publication on the IEEE Transactions on Neural Networks in 2011, presented some results without proof. Those proofs are provided in this paper.
New methods combine model predictions to avoid linear mixtures' limitations.
Study finds TVL doesn't predict cryptocurrency returns.
Study on TVL computation in DeFi protocols, proposing verifiable metrics.
Paper tackles dynamic behavior of variable topology mechanisms, presenting new transition conditions.
Backpropagation algorithm is indispensable for the training of feedforward neural networks. It requires propagating error gradients sequentially from the output layer all the way back to the input layer. The backward locking in backpropagation algorithm constrains us from updating network layers in parallel and fully l…
Accelerates optimization in asynchronous systems with sparse updates.
MAC combines models without locking them, improving ensemble performance.
Stochastic gradient descent~(SGD) and its variants have attracted much attention in machine learning due to their efficiency and effectiveness for optimization. To handle large-scale problems, researchers have recently proposed several lock-free strategy based parallel SGD~(LF-PSGD) methods for multi-core systems. Howe…
This study analyzes the effects of lifting lockdowns on Brazil's COVID-19 spread.
Study factors affecting liquidity on decentralized exchanges, introducing new metrics.
While the backpropagation of error algorithm enables deep neural network training, it implies (i) bidirectional synaptic weight transport and (ii) update locking until the forward and backward passes are completed. Not only do these constraints preclude biological plausibility, but they also hinder the development of l…
Proves Riemannian positive mass theorem with singularities.
Neuroscientists have enjoyed much success in understanding brain functions by constructing brain connectivity networks using data collected under highly controlled experimental settings. However, these experimental settings bear little resemblance to our real-life experience in day-to-day interactions with the surround…
We present CYCLADES, a general framework for parallelizing stochastic optimization algorithms in a shared memory setting. CYCLADES is asynchronous during shared model updates, and requires no memory locking mechanisms, similar to HOGWILD!-type algorithms. Unlike HOGWILD!, CYCLADES introduces no conflicts during the par…
Exchanges acquire excess processing capacity to accommodate trading activity surges associated with zero-sum high-frequency trader (HFT) "duels." The idle capacity's opportunity cost is an externality of low-latency trading. We build a model of decentralized exchanges (DEX) with flexible capacity. On DEX, HFTs acquire …
Backpropagation (BP) is the cornerstone of today's deep learning algorithms, but it is inefficient partially because of backward locking, which means updating the weights of one layer locks the weight updates in the other layers. Consequently, it is challenging to apply parallel computing or a pipeline structure to upd…
Study on synchronization in financial markets with time delays.
OOM-RL uses financial market losses to align AI agents in autonomous systems.
Social learning can make financial markets inefficient, but individual learning can fix this.
Language models are essential for natural language processing (NLP) tasks, such as machine translation and text summarization. Remarkable performance has been demonstrated recently across many NLP domains via a Transformer-based language model with over a billion parameters, verifying the benefits of model size. Model …
In this paper we introduce two models of opinion dynamics in oligopoly markets and apply them to a situation, where a new entrant challenges two incumbents of the same size. The models differ in the way the two forces influencing consumer choice -- (local) social interactions and (global) advertising -- interact. We st…
Based on administrative data of unemployed in Belgium, we estimate the labour market effects of three training programmes at various aggregation levels using Modified Causal Forests, a causal machine learning estimator. While all programmes have positive effects after the lock-in period, we find substantial heterogenei…
We show that the bordism group of closed 3-manifolds with positive scalar curvature (psc) metrics is trivial by explicit methods. Our constructions are derived from scalar-flat K{ä}hler ALE surfaces discovered by Lock-Viaclovsky. Next, we study psc 4-manifolds with metric singularities along points and embedded circles…
Study predicts success of crypto-tokens on Pump.fun platform.
KLD token adjusts supply based on macroeconomic debt index, creating deflationary effect.
Hidden Markov Model helps track asymptomatic carriers in pandemic.
A new method uses conformal prediction to create reliable confidence masks for image super-resolution.
We introduce the HSIC (Hilbert-Schmidt independence criterion) bottleneck for training deep neural networks. The HSIC bottleneck is an alternative to the conventional cross-entropy loss and backpropagation that has a number of distinct advantages. It mitigates exploding and vanishing gradients, resulting in the ability…
Extending methods first used by Casson, we show how to verify a hyperbolic structure on a finite triangulation of a closed 3-manifold using interval arithmetic methods. A key ingredient is a new theoretical result (akin to a theorem by Neumann-Zagier and Moser for ideal triangulations upon which HIKMOT is based) showin…
Deep learning applied to SAR data is explored in this paper.
This work reveals a new scaling law for optimal design of multirotor aerial vehicles.
GNMR controls runtime stability in low-precision language model training.
The introduction of automated flight control and management systems have made possible aircraft designs that sacrifice arodynamic stability in order to incorporate stealth technology intro their shape, operate more efficiently, and are highly maneuverable. Therefore, modern flight management systems are reliant on mult…
Probabilistic programming aids in automatically dating ice cores, reducing manual error and uncertainty.
A new model for simulating cloth manipulation in robots, accurate to within 1cm.
Constant Proportion Portfolio Insurance (CPPI) is an investment strategy designed to give participation in the performance of a risky asset while protecting the invested capital. This protection is however not perfect and the gap risk must be quantified. CPPI strategies are path-dependent and may have American exercise…
EagerPy simplifies writing code for multiple deep learning frameworks.
Study links public concern in Italy to financial markets worldwide.
Stochastic variational inference (SVI) employs stochastic optimization to scale up Bayesian computation to massive data. Since SVI is at its core a stochastic gradient-based algorithm, horizontal parallelism can be harnessed to allow larger scale inference. We propose a lock-free parallel implementation for SVI which a…
We look at how asset exchange models can be mapped to random iterated function systems (IFS) giving new insights into the dynamics of wealth accumulation in such models. In particular, we focus on the "yard-sale" (winner gets a random fraction of the poorer players wealth) and the "theft-and-fraud" (winner gets a rando…
Stochastic variational inference (SVI), the state-of-the-art algorithm for scaling variational inference to large-datasets, is inherently serial. Moreover, it requires the parameters to fit in the memory of a single processor; this is problematic when the number of parameters is in billions. In this paper, we propose e…