Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

295786114 · Jun 202019922001200920172026
48 results for opposing signals

Outliers with opposing signals significantly affect neural network optimization.

problem Understanding and mitigating the impact of outliers with opposing signals on neural network training.
method Identifying and analyzing pairs of outliers with strong opposing signals in training data.
result Outliers with opposing signals can cause optimization to enter a narrow valley, leading to oscillatory behavior and eventual loss spikes.

We introduce Contrastive Multivariate Singular Spectrum Analysis, a novel unsupervised method for dimensionality reduction and signal decomposition of time series data. By utilizing an appropriate background dataset, the method transforms a target time series dataset in a way that evinces the sub-signals that are enhan…

2018-10-31abs ↗pdf ↗

Study explores DNNs' reliance on existing vs. new features in physiological signals.

problem Understanding how deep neural networks discover new features in physiological signals.
method Proposes a method to remove hand-engineered features and force DNNs to learn new representations.
result DNNs often rediscover known features, but can also learn new ones.

New method distinguishes stochastic from deterministic signals using excursion counts.

problem Distinguishing between stochastic and deterministic signals in discrete time series.
method Excursion and crossing theorems for continuous semimartingales, comparing empirical excursion counts to theoretical expectation.
result A robust data-driven diffusion test that classifies signals based on log-log slope deviation.

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in one dataset relative to another. These pairs of datasets occur commonly, for ins…

2018-11-14abs ↗pdf ↗

A large set of signals can sometimes be described sparsely using a dictionary, that is, every element can be represented as a linear combination of few elements from the dictionary. Algorithms for various signal processing applications, including classification, denoising and signal separation, learn a dictionary from …

2010-11-24abs ↗pdf ↗

Twitter, a popular social network, presents great opportunities for on-line machine learning research. However, previous research has focused almost entirely on learning from passively collected data. We study the problem of learning to acquire followers through normative user behavior, as opposed to the mass following…

2015-04-16abs ↗pdf ↗

In this work, we present a continuous-time large-population game for modeling market microstructure betweentwo consecutive trades. The proposed modeling framework is inspired by our previous work [23]. In this framework, the Limit Order Book (LOB) arises as an outcome of an equilibrium between multiple agents who have …

2016-05-31abs ↗pdf ↗

For neural networks (NNs) with rectified linear unit (ReLU) or binary activation functions, we show that their training can be accomplished in a reduced parameter space. Specifically, the weights in each neuron can be trained on the unit sphere, as opposed to the entire space, and the threshold can be trained in a boun…

2018-05-22abs ↗pdf ↗

Paper proposes a new method for sparse covariance Cholesky factor estimation.

problem Estimating sparse covariance matrices for ordered data.
method Matrix loss penalization approach for sparse Cholesky factor estimation.
result The proposed method outperforms existing regression-based approaches in simulations and real data.

Many spectral unmixing methods rely on the non-negative decomposition of spectral data onto a dictionary of spectral templates. In particular, state-of-the-art music transcription systems decompose the spectrogram of the input signal onto a dictionary of representative note spectra. The typical measures of fit used to …

2016-09-30abs ↗pdf ↗

We discuss a simple extension of the Ho and Lee model with generic time-dependent drift in which: 1) we compute bond prices analytically; 2) the yield curve is sensible and the asymptotic yield is positive; and 3) our analytical solution provides a clean and simple way of separating volatility from the drift in the sho…

2015-02-21abs ↗pdf ↗

Our analysis of financial data, in terms of super-exponential growth, suggests that the seed of the 2002/03 crisis of the Dutch supermarket giant AHOLD was planted in 1996. It became quite visible in 1999 when the post-bubble destabilization regime was well-developed and acted as the precursor of an inevitable collapse…

2004-03-22abs ↗pdf ↗

Deep learning improves image reconstruction, but scaling up training sets doesn't significantly boost performance.

problem Understanding the impact of training set size on deep learning image reconstruction.
method Empirical study and analytical characterization of performance scaling laws.
result Scaling up training set size does not significantly improve reconstruction quality for deep learning.

Objective: This work investigates the hypothesis that focal seizures can be predicted using scalp electroencephalogram (EEG) data. Our first aim is to learn features that distinguish between the interictal and preictal regions. The second aim is to define a prediction horizon in which the prediction is as accurate and …

2018-05-29abs ↗pdf ↗

This project proposes using reinforcement learning to train spiking neural networks.

problem Training spiking neural networks using traditional methods is challenging due to the discrete nature of spikes.
method The project investigates two approaches: 1) treating each neuron as an RL agent, 2) applying the reparameterization trick.
result The project demonstrates that reinforcement learning can be applied to train spiking neural networks.

We introduce a new geometric approach to a manifold equipped with a smooth density function that takes a torsion-free affine connection, as opposed to a weighted measure or Laplacian, as the fundamental object of study. The connection motivates new versions of the volume and Laplacian comparison theorems that are valid…

2016-02-25abs ↗pdf ↗

We use Hamiltonian actions to construct nonstandard (as opposed to $\RP^n$ and TnT^n) Lagrangian submanifolds of $\CP^n$. First of all, a quotient of $\RP^3$ by the dihedral group D3D_3 is a Lagrangian submanifold of $\CP^3$. Secondly, $\Su(n)/\Z_n$ are Lagrangian submanifolds of $\CP^{n^2-1}$.

2003-03-20abs ↗pdf ↗

We introduce Independently Recurrent Long Short-term Memory cells: IndyLSTMs. These differ from regular LSTM cells in that the recurrent weights are not modeled as a full matrix, but as a diagonal matrix, i.e.\ the output and state of each LSTM cell depends on the inputs and its own output/state, as opposed to the inpu…

2019-03-19abs ↗pdf ↗

We show that every trivial 3-strand braid diagram contains a disk, defined as a ribbon ending in opposed crossings. Under a convenient algebraic form, the result extends to every Artin--Tits group of dihedral type, but it fails to extend to braids with 4 strands and more. The proof uses a partition of the Cayley graph …

2003-11-19abs ↗pdf ↗

A new method learns discrete representations for images and videos, improving upon previous models.

problem Learning discrete representations for images and videos to improve performance.
method Depthwise application of Vector Quantized Variational Autoencoders (VQVAE) to feature axis.
result 33% improvement in performance compared to previous discrete models.

Irrespective of local conditions imposed on the metric, any extendible spacetime U has a maximal extension containing no closed causal curves outside the chronological past of U. We prove this fact and interpret it as impossibility (in classical general relativity) of the time machines, insofar as the latter are define…

2001-11-17abs ↗pdf ↗

The paper simplifies influence computations for large-scale machine learning models.

problem Improving training efficiency and accuracy in large-scale models.
method Study influence functions, define memorization, simplify computations.
result Influence functions can be practical for large-scale models, indicating memorization.

We propose a conceptual design for a quantum blockchain. Our method involves encoding the blockchain into a temporal GHZ (Greenberger-Horne-Zeilinger) state of photons that do not simultaneously coexist. It is shown that the entanglement in time, as opposed to an entanglement in space, provides the crucial quantum adva…

2018-04-16abs ↗pdf ↗

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknown matrix that is simultaneously low-rank and sparse. However, such problems are highly challenging t…

2018-09-27abs ↗pdf ↗

In this paper we propose a synergistic melting of neural networks and decision trees (DT) we call neural decision trees (NDT). NDT is an architecture a la decision tree where each splitting node is an independent multilayer perceptron allowing oblique decision functions or arbritrary nonlinear decision function if more…

2017-02-23abs ↗pdf ↗

We prove some structure results for \emph{transverse reducible} Sasaki manifolds. In particular, we show Sasaki manifolds with positive Ricci curvature is transversely irreducible, and so there is no join (product) construction for irregular Sasaki-Einstein manifolds, as opposed to the quasi-regular case done by Wang-Z…

2012-09-18abs ↗pdf ↗

A new geometry for comparing signals, overcoming traditional limitations.

problem Comparing and interpolating discontinuous and signed signals.
method Investigation of Riemannian geometry on signal space, introducing a metric that measures both horizontal and vertical deformations.
result Characterization of metric properties and establishment of geodesic regularity and stability.

Paper presents a unique method to recover signals from their bispectrum.

problem Retrieving signals accurately from their bispectrum.
method Two-step trust region algorithm that minimizes a non-convex objective function.
result Signals with finite spectral or temporal support can be recovered from at least 3B measurements of their bispectrum.

Paper proposes efficient methods for clustering and signal recovery in high-dimensional data with block structures.

problem High-dimensional clustering and signal recovery under block signal structures.
method CFA-PCA and MA-PCA methods for sparse and dense block signals.
result Proposed methods achieve computational minimax optimality for clustering and signal recovery.

Gradient descent proves global convergence for deep networks with a single wide layer.

problem Proving global convergence of gradient descent for deep ReLU networks.
method Simplified proof using a single wide layer, leveraging ReLU's Lipschitz property.
result Gradient descent converges globally for networks with a single wide layer.