SGD learns neural networks with a complexity measure called leap.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
LEAPS samples discrete distributions via CTMCs and locally equivariant networks.
Graph edges, along with their labels, can represent information of fundamental importance, such as links between web pages, friendship between users, the rating given by users to other users or items, and much more. We introduce LEAP, a trainable, general framework for predicting the presence and properties of edges on…
Two-layer networks learn faster with batch reuse, overcoming information and leap exponents.
The paper analyzes sampling efficiency of discrete diffusion models, providing sharp and adaptive guarantees.
We propose a novel neural network embedding approach to model power transmission grids, in which high voltage lines are disconnected and reconnected with one-another from time to time, either accidentally or willfully. We call our architeture LEAP net, for Latent Encoding of Atypical Perturbation. Our method implements…
Study efficient estimation of hidden subspaces in Gaussian Multi-index models.
In complex transfer learning scenarios new tasks might not be tightly linked to previous tasks. Approaches that transfer information contained only in the final parameters of a source model will therefore struggle. Instead, transfer learning at a higher level of abstraction is needed. We propose Leap, a framework that …
Corrected samplers reduce discretization error in discrete flow models without additional computational cost.
Building deep reinforcement learning agents that can generalize and adapt to unseen environments remains a fundamental challenge for AI. This paper describes progresses on this challenge in the context of man-made environments, which are visually diverse but contain intrinsic semantic regularities. We propose a hybrid …
LEAP identifies latent causal variables from temporal data.
This work analyzes discrete diffusion models using stochastic integrals, providing error bounds and insights.
Feature selection and attribute reduction are crucial problems, and widely used techniques in the field of machine learning, data mining and pattern recognition to overcome the well-known phenomenon of the Curse of Dimensionality, by either selecting a subset of features or removing unrelated ones. This paper presents …
New method improves inference for discrete diffusion models, achieving better quality and efficiency.
In this report, an automated bartender system was developed for making orders in a bar using hand gestures. The gesture recognition of the system was developed using Machine Learning techniques, where the model was trained to classify gestures using collected data. The final model used in the system reached an average …
We consider the problem of impulse response estimation of stable linear single-input single-output systems. It is a well-studied problem where flexible non-parametric models recently offered a leap in performance compared to the classical finite-dimensional model structures. Inspired by this development and the success…
Survey on discovering causal relationships from data.
Designing of touchless user interface is gaining popularity in various contexts. Using such interfaces, users can interact with electronic devices even when the hands are dirty or non-conductive. Also, user with partial physical disability can interact with electronic devices using such systems. Research in this direct…
Medical applications challenge today's text categorization techniques by demanding both high accuracy and ease-of-interpretation. Although deep learning has provided a leap ahead in accuracy, this leap comes at the sacrifice of interpretability. To address this accuracy-interpretability challenge, we here introduce, fo…
Reweighted ALPS improves sampling from multimodal distributions using warm start points.
Kernel methods can learn hierarchical polynomials efficiently.
Study shows how price protection affects online learning algorithms for dynamic pricing.
One of the defining characteristics of human creativity is the ability to make conceptual leaps, creating something surprising from typical knowledge. In comparison, deep neural networks often struggle to handle cases outside of their training data, which is especially problematic for problems with limited training dat…
Survey on quantum computing and neural networks.
In this article, a compact finite difference method is proposed for pricing European and American options under jump-diffusion models. Partial integro-differential equation and linear complementary problem governing European and American options respectively are discretized using Crank-Nicolson Leap-Frog scheme. In pro…
Normalizing flows are shown to be equivalent to Bayesian networks, revealing new insights.
MEC-IP uses IP to efficiently find MECs in BNs from observational data.
FutureQuant Transformer predicts price ranges and volatility for futures trading.
New method uses birth-death process and exploration component to accelerate sampling from multimodal distributions.
Machine learning algorithms relying on deep neural networks recently allowed a great leap forward in artificial intelligence. Despite the popularity of their applications, the efficiency of these algorithms remains largely unexplained from a theoretical point of view. The mathematical description of learning problems i…
The study explores how machine learning can enhance scientific research.
In recent years, advances in deep learning have resulted in unprecedented leaps in diverse tasks spanning from speech and object recognition to context awareness and health monitoring. As a result, an increasing number of AI-enabled applications are being developed targeting ubiquitous and mobile devices. While deep ne…
Randomly biased data makes complex models as easy to learn as simple ones.
Learning how to automatically solve optimization problems has the potential to provide the next big leap in optimization technology. The performance of automatically learned heuristics on routing problems has been steadily improving in recent years, but approaches based purely on machine learning are still outperformed…
TLRS improves predictive power of mined formulaic alpha factors.
We propose a fast second-order method that can be used as a drop-in replacement for current deep learning solvers. Compared to stochastic gradient descent (SGD), it only requires two additional forward-mode automatic differentiation operations per iteration, which has a computational cost comparable to two standard for…
VTrackIt creates a synthetic dataset with infrastructure and vehicle info for AVs.
The prevalence of wearable sensors (e.g., smart wristband) is creating unprecedented opportunities to not only inform health and wellness states of individuals, but also assess and infer personal attributes, including demographic and personality attributes. However, the data captured from wearables, such as heart rate …
MarketSenseAI uses AI to select stocks with 10-30% excess alpha.
The complex world around us is inherently multimodal and sequential (continuous). Information is scattered across different modalities and requires multiple continuous sensors to be captured. As machine learning leaps towards better generalization to real world, multimodal sequential learning becomes a fundamental rese…
New method tackles rugged optimization landscapes in contact-rich scenarios.
The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in …
In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap in performance towards solving various vision-based research problems such as o…
In recent years, Multifactorial Optimization (MFO) has gained a notable momentum in the research community. MFO is known for its inherent capability to efficiently address multiple optimization tasks at the same time, while transferring information among such tasks to improve their convergence speed. On the other hand,…
This work optimizes neural network bit-width and layer-width for efficiency.
The paper tackles intervention generalization using factor graph models.
Meta learning enables cross-domain Hamiltonian dynamics.
Kolmogorov-Arnold Networks promise scalable performance in high dimensions.