Investigates the fundamental components of attention mechanisms.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New DP mechanisms improve ML privacy-utility-computational tradeoffs.
Some online advertising offers pay only when an ad elicits a response. Randomness and uncertainty about response rates make showing those ads a risky investment for online publishers. Like financial investors, publishers can use portfolio allocation over multiple advertising offers to pursue revenue while controlling r…
CICME estimates common and domain-specific causal mechanisms from multi-sensor data.
Unified framework for subsampling mechanisms with tighter privacy guarantees.
Modeling student behaviors and multiple predictions for early intervention.
Study investigates OOD generalization methods for mechanics problems.
MKLpy simplifies Multiple Kernel Learning in Python.
GAT-AGNN learns stock trends using graph and attention mechanisms.
Deep learning models forecast multiple yield curves with improved accuracy.
This study presents a rapid multiple incremental and decremental mechanism based on Weight-Error Curves (WECs) for support-vector analysis. Recursion-free computation is proposed for predicting the Lagrangian multipliers of new samples. This study examines Ridge Support Vector Models, subsequently devising a recursion-…
Detect hidden confounding in observational data using multiple environments.
New mechanisms improve differential privacy for scalar queries.
Explains deep learning models and their geometric properties.
In reinforcement learning algorithms, leveraging multiple views of the environment can improve the learning of complicated policies. In multi-view environments, due to the fact that the views may frequently suffer from partial observability, their level of importance are often different. In this paper, we propose a dee…
A neural network predicts drug interactions using attention mechanisms.
A new Gaussian mechanism for differential privacy in the shuffle model is introduced.
Stable cooperation emerges in fluctuating environments.
Although data may be abundant, complete data is less so, due to missing columns or rows. This missingness undermines the performance of downstream data products that either omit incomplete cases or create derived completed data for subsequent processing. Appropriately managing missing data is required in order to fully…
New mechanisms from primate vision improve neural network robustness.
New RL approach learns dynamic VCG mechanisms in unknown MDP environments.
This paper solves optimal market making for multiple goods, including bundling, under adverse selection.
The field of fluid mechanics is rapidly advancing, driven by unprecedented volumes of data from field measurements, experiments and large-scale simulations at multiple spatiotemporal scales. Machine learning offers a wealth of techniques to extract information from data that could be translated into knowledge about the…
The paper investigates how Global Self-attention improves GCNs.
Agents learn and control complex mechanical systems through shared memories.
Mechanisms for fair resource allocation learn user preferences online.
The Yukawa term in statistical mechanics quantifies information generation.
Paper proposes mechanism learning to reverse causal inference in ML.
This work generalizes Hamiltonian mechanics using closed differential forms.
MIMONets speed up neural network inference by processing multiple inputs in parallel.
Causal inference using observational data is challenging, especially in the bivariate case. Through the minimum description length principle, we link the postulate of independence between the generating mechanisms of the cause and of the effect given the cause to quantile regression. Based on this theory, we develop Bi…
Algorithm learns optimal dynamic mechanisms from data.
Two environments are enough to infer causal graphs and counterfactuals.
Prediction markets show considerable promise for developing flexible mechanisms for machine learning. Here, machine learning markets for multivariate systems are defined, and a utility-based framework is established for their analysis. This differs from the usual approach of defining static betting functions. It is sho…
The one-class kernel spectral regression (OC-KSR), the regression-based formulation of the kernel null-space approach has been found to be an effective Fisher criterion-based methodology for one-class classification (OCC), achieving state-of-the-art performance in one-class classification while providing relatively hig…
Learning modular structures which reflect the dynamics of the environment can lead to better generalization and robustness to changes which only affect a few of the underlying causes. We propose Recurrent Independent Mechanisms (RIMs), a new recurrent architecture in which multiple groups of recurrent cells operate wit…
We introduce the stochastic multiplicative point process modelling trading activity of financial markets. Such a model system exhibits power-law spectral density S(f) ~ 1/f**beta, scaled as power of frequency for various values of beta between 0.5 and 2. Furthermore, we analyze the relation between the power-law autoco…
In this paper we seek to demonstrate the predictability of stock market returns and explain the nature of this return predictability. To this end, we introduce investors with different investment horizons into the news-driven, analytic, agent-based market model developed in Gusev et al. (2015). This heterogeneous frame…
New neural network can learn multiple patterns at once.
We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of languages. This is made possible by having a single attention mechanism that is …
Building machine translation (MT) test sets is a relatively expensive task. As MT becomes increasingly desired for more and more language pairs and more and more domains, it becomes necessary to build test sets for each case. In this paper, we investigate using Amazon's Mechanical Turk (MTurk) to make MT test sets chea…
Sensors are an integral part of modern Internet of Things (IoT) applications. There is a critical need for the analysis of heterogeneous multivariate temporal data obtained from the individual sensors of these systems. In this paper we particularly focus on the problem of the scarce amount of training data available pe…
Stock price change in financial market occurs through transactions in analogy with diffusion in stochastic physical systems. The analysis of price changes in real markets shows that long-range correlations of price fluctuations largely depend on the number of transactions. We introduce the multiplicative stochastic mod…
Investigates the benefits of multi-head attention in Transformers, deriving convergence and generalization guarantees.
We consider the problem of Probably Approximate Correct (PAC) learning of a binary classifier from noisy labeled examples acquired from multiple annotators (each characterized by a respective classification noise rate). First, we consider the complete information scenario, where the learner knows the noise rates of all…
We introduce an algorithm to locate contours of functions that are expensive to evaluate. The problem of locating contours arises in many applications, including classification, constrained optimization, and performance analysis of mechanical and dynamical systems (reliability, probability of failure, stability, etc.).…
Automation of machine learning model development is increasingly becoming an established research area. While automated model selection and automated data pre-processing have been studied in depth, there is, however, a gap concerning automated model adaptation strategies when multiple strategies are available. Manually…
New method estimates causal effects of multiple versions of treatment.