A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Random walks on Fuchsian Schottky groups have harmonic measures with lower dimension.
RDIS fills missing values in time series data explicitly.
In this paper we study the learnability of deep random networks from both theoretical and practical points of view. On the theoretical front, we show that the learnability of random deep networks with sign activation drops exponentially with its depth. On the practical front, we find that the learnability drops sharply…
Drop-Muon updates only some layers, speeding up training.
Dropout is often used in deep neural networks to prevent over-fitting. Conventionally, dropout training invokes \textit{random drop} of nodes from the hidden layers of a Neural Network. It is our hypothesis that a guided selection of nodes for intelligent dropout can lead to better generalization as compared to the tra…
Dropout is used to avoid overfitting by randomly dropping units from the neural networks during training. Inspired by dropout, this paper presents GI-Dropout, a novel dropout method integrating with global information to improve neural networks for text classification. Unlike the traditional dropout method in which the…
LightSecAgg reduces secure aggregation complexity in FL.
Round balls minimize liquid drop model volumes ≤ 1.
Despite achieving remarkable success in various domains, recent studies have uncovered the vulnerability of deep neural networks to adversarial perturbations, creating concerns on model generalizability and new threats such as prediction-evasive misclassification or stealthy reprogramming. Among different defense propo…
Repelling random walks improve graph-based sampling efficiency.
Proposes MIP, a privacy notion that requires less randomness than DP, leading to better utility.
Empirical study shows GANs overfit and drop modes when training is deterministic.
Overfitting frequently occurs in deep learning. In this paper, we propose a novel regularization method called Drop-Activation to reduce overfitting and improve generalization. The key idea is to drop nonlinear activation functions by setting them to be identity functions randomly during training time. During testing, …
When training clinical prediction models from electronic health records (EHRs), a key concern should be a model's ability to sustain performance over time when deployed, even as care practices, database systems, and population demographics evolve. Due to de-identification requirements, however, current experimental pra…
The study examines mass drop and multiplicity in mean curvature flow.
This paper analyzes the configurations of shapes that shows a spacelike liquid drop in Minkowski space deposited over a spacelike plane . We assume the presence of a uniform gravity field directed toward and that the volume of the drop is prescribed. Our interest are the liquid drops that are critical points of …
Deep neural networks have dramatically achieved great success on a variety of challenging tasks. However, most successful DNNs have an extremely complex structure, leading to extensive research on model compression.As a significant area of progress in model compression, traditional gradual pruning approaches involve an…
A new method improves graph random features with quasi-Monte Carlo techniques.
Deep neural networks (DNNs) have been proven to have many redundancies. Hence, many efforts have been made to compress DNNs. However, the existing model compression methods treat all the input samples equally while ignoring the fact that the difficulties of various input samples being correctly classified are different…
The training phases of Deep neural network~(DNN) consumes enormous processing time and energy. Compression techniques utilizing the sparsity of DNNs can effectively accelerate the inference phase of DNNs. However, it can be hardly used in the training phase because the training phase involves dense matrix-multiplicatio…
Paper resolves Huisken's conjecture without strict genus drop theorem.
Study on liquidation games with market drop-out, proving unique equilibria.
A new variable importance measure for DRFs detects broader impacts on output distributions.
Study reveals LLM personas have two distinct components: frame-robust aggregated traits and frame-dependent geometric features.
The Frank-Wolfe (FW) algorithm has been widely used in solving nuclear norm constrained problems, since it does not require projections. However, FW often yields high rank intermediate iterates, which can be very expensive in time and space costs for large problems. To address this issue, we propose a rank-drop method …
New hyperparameter ensembles boost neural network performance and uncertainty.
Study connects hyperbolic geometry to membrane shapes.
In this paper we compare market price fluctuations with the response to fundamental price drops within the Lux-Marchesi model which is able to reproduce the most important stylized facts of real market data. Major differences can be observed between the decay of spontaneous fluctuations and of changes due to external p…
Recent advances in machine learning (ML) algorithms, especially deep neural networks (DNNs), have demonstrated remarkable success (sometimes exceeding human-level performance) on several tasks, including face and speech recognition. However, ML algorithms are vulnerable to \emph{adversarial attacks}, such test-time, tr…
LC-CRFs are equivalent to HMMs, and MPM/MAP classifiers can be reformulated as CRFs.
In this work, we leverage advances in sparse coding techniques to reduce the number of trainable parameters in a fully connected neural network. While most of the works in literature impose regularization, DropOut or DropConnect techniques to induce sparsity, our scheme considers feature importance as a criter…
Lower Ricci curvature bound prevents first Betti number from dropping more than dimension in collapsing manifolds.
Enhances time-series modeling by dropping patches, improving efficiency and adaptability.
Study reveals statistical bias in dataset replication, reducing accuracy drop from 11-14% to 3.6%.
Randomly chosen primary hidden units and derived secondary units reduce neural network complexity.
We present a probabilistic framework for studying adversarial attacks on discrete data. Based on this framework, we derive a perturbation-based method, Greedy Attack, and a scalable learning-based method, Gumbel Attack, that illustrate various tradeoffs in the design of attacks. We demonstrate the effectiveness of thes…
Recent studies have revealed the vulnerability of deep neural networks: A small adversarial perturbation that is imperceptible to human can easily make a well-trained deep neural network misclassify. This makes it unsafe to apply neural networks in security-critical applications. In this paper, we propose a new defense…
Out-of-distribution (OOD) detection approaches usually present special requirements (e.g., hyperparameter validation, collection of outlier data) and produce side effects (e.g., classification accuracy drop, slower energy-inefficient inferences). We argue that these issues are a consequence of the SoftMax loss anisotro…
The study of heavy-tailed distributions in economic and financial systems has been widely addressed since financial time series has become a research subject.After the eighties, several "highly improbable" market drops were observed (e.g. the 1987 stock market drop known as "Black Monday" and on even more recent ones, …
Paper uses Random Matrix Theory for optimal training-testing data split.
Study on stability of 3D sessile drops, identifying degenerate kernel.
Dropout is a simple yet effective algorithm for regularizing neural networks by randomly dropping out units through Bernoulli multiplicative noise, and for some restricted problem classes, such as linear or logistic regression, several theoretical studies have demonstrated the equivalence between dropout and a fully de…
New method trains generative models without discriminators, improving stability and accuracy.
We study the dynamic evolution of cross-correlations in the Chinese stock market mainly based on the random matrix theory (RMT). The correlation matrices constructed from the return series of 367 A-share stocks traded on the Shanghai Stock Exchange from January 4, 1999 to December 30, 2011 are calculated over a moving …
We establish explicit socially optimal rules for an irreversible investment deci- sion with time-to-build and uncertainty. Assuming a price sensitive demand function with a random intercept, we provide comparative statics and economic interpreta- tions for three models of demand (arithmetic Brownian, geometric Brownian…
We study the long time existence theory for a non local flow associated to a free boundary problem for a trapped non liquid drop. The drop has free boundary components on two horizontal plates and its free energy is anisotropic and axially symmetric. For axially symmetric initial surfaces with sufficiently large volume…
Critical volatility triggers log-normal to power-law transitions in interconnected systems.
Dropping a tiny fraction of preferences can significantly alter the rankings of top LLMs.