Paper proposes FOFE for efficient WSD.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The softmax content-based attention mechanism has proven to be very beneficial in many applications of recurrent neural networks. Nevertheless it suffers from two major computational limitations. First, its computations for an attention lookup scale linearly in the size of the attended sequence. Second, it does not enc…
A method to uniformly sample graph-encoded surfaces of fixed size.
Deep neural networks can approximate complex functions through repeated compositions of a fixed-size ReLU network.
New activation functions achieve arbitrary-accuracy Sobolev approximation by fixed-size neural networks.
Local nonparametric meta-learning improves meta-generalization across tasks.
Streamable model improves speech recognition performance.
Learning to remember long sequences remains a challenging task for recurrent neural networks. Register memory and attention mechanisms were both proposed to resolve the issue with either high computational cost to retain memory differentiability, or by discounting the RNN representation learning towards encoding shorte…
Reliable 4D aircraft trajectory prediction, whether in a real-time setting or for analysis of counterfactuals, is important to the efficiency of the aviation system. Toward this end, we first propose a highly generalizable efficient tree-based matching algorithm to construct image-like feature maps from high-fidelity m…
Formula found for minimum ARI between clusterings of fixed sizes.
New model learns graph features for classification.
New method speeds up sparse graph neural networks training on dense hardware.
Determinantal Point Processes (DPPs) are popular models for point processes with repulsion. They appear in numerous contexts, from physics to graph theory, and display appealing theoretical properties. On the more practical side of things, since DPPs tend to select sets of points that are some distance apart (repulsion…
Methods for learning feature representations for Offline Handwritten Signature Verification have been successfully proposed in recent literature, using Deep Convolutional Neural Networks to learn representations from signature pixels. Such methods reported large performance improvements compared to handcrafted feature …
In Statistical Learning, the Vapnik-Chervonenkis (VC) dimension is an important combinatorial property of classifiers. To our knowledge, no theoretical results yet exist for the VC dimension of edited nearest-neighbour (1NN) classifiers with reference set of fixed size. Related theoretical results are scattered in the …
Improved batched SH algorithm maintains original performance.
In this paper, we investigate the significance of choosing an appropriate tessellation strategy for a spatio-temporal taxi demand-supply modeling framework. Our study compares (i) the variable-sized polygon based Voronoi tessellation, and (ii) the fixed-sized grid based Geohash tessellation, using taxi demand-supply GP…
TaLK Convolutions improve sequence modeling efficiency.
Unsupervised model learns word and context embeddings from character sequences.
We discuss our recent work [4] in which gravitational radiation was studied by evaluating the Wang-Yau quasi-local mass of surfaces of fixed size at the infinity of both axial and polar perturbations of the Schwarzschild spacetime, à la Chandrasekhar [1].
MeshfreeFlowNet generates high-resolution spatio-temporal solutions from low-resolution inputs.
New findings show modern neural networks have finite sample complexity in o-minimal structures.
In this paper, we study the global geometry of complete, constant mean curvature hypersurfaces embedded in n-manifolds. More precisely, we give conditions that imply properness of such surfaces and prove the existence of fixed size one-sided regular neighborhoods for certain constant mean curvature hypersurfaces in cer…
New model generates realistic single-cell gene expression data.
Accurate taxi demand-supply forecasting is a challenging application of ITS (Intelligent Transportation Systems), due to the complex spatial and temporal patterns. We investigate the impact of different spatial partitioning techniques on the prediction performance of an LSTM (Long Short-Term Memory) network, in the con…
Introduces Spectral Attention for better long-range time series forecasting.
MR-GNN predicts interactions between structured entities using multi-resolution and dual graph neural networks.
Bayesian optimization improves efficiency with semi-supervised learning.
Capsule Neural Networks classify graphs from categorical features and relationships.
We introduce a deep learning architecture for structure-based virtual screening that generates fixed-sized fingerprints of proteins and small molecules by applying learnable atom convolution and softmax operations to each compound separately. These fingerprints are further transformed non-linearly, their inner-product …
The discrete Nahm equations, a system of matrix valued difference equations, arose in the work of Braam and Austin on half-integral mass hyperbolic monopoles. We show that the discrete Nahm equations are completely integrable in a natural sense: to any solution we can associate a spectral curve and a holomorphic line-b…
This paper considers binomial approximation of continuous time stochastic processes. It is shown that, under some mild integrability conditions, a process can be approximated in mean square sense and in other strong metrics by binomial processes, i.e., by processes with fixed size binary increments at sampling points. …
OMD monitors stock market dynamics through matrix trajectories and reveals crisis patterns.
OMD monitors stock market dynamics through matrix trajectories, revealing crisis patterns and sector rotations.
Paper develops efficient method for probability estimation.
There are two important statements regarding the Trautman-Bondi mass [1,8,5] at null infinity: one is the positivity [7,6], and the other is the Bondi mass loss formula [1], which are both global in nature. The positivity of the quasi-local mass can potentially lead to a local description at null infinity. This is conf…
The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish similar performance with fewer examples, known as one-shot or more generally few-sh…
GraphSW reduces training cost for GNN-based recommender models by selectively accessing graph features.
Expectation maximization (EM) has recently been shown to be an efficient algorithm for learning finite-state controllers (FSCs) in large decentralized POMDPs (Dec-POMDPs). However, current methods use fixed-size FSCs and often converge to maxima that are far from optimal. This paper considers a variable-size FSC to rep…
We compute an approximate Fréchet mean for sets of sparse graphs.
Semi-supervised GANs improve travel mode inference from GPS data.
Spectral graph convolutional neural networks (CNNs) require approximation to the convolution to alleviate the computational complexity, resulting in performance loss. This paper proposes the topology adaptive graph convolutional network (TAGCN), a novel graph convolutional network defined in the vertex domain. We provi…
Graph connection Laplacian (GCL) is a modern data analysis technique that is starting to be applied for the analysis of high dimensional and massive datasets. Motivated by this technique, we study matrices that are akin to the ones appearing in the null case of GCL, i.e the case where there is no structure in the datas…
SHMM models human mobility from GPS and text data, overcoming text sparsity.
Persistent homology (PH) is a rigorous mathematical theory that provides a robust descriptor of data in the form of persistence diagrams (PDs) which are 2D multisets of points. Their variable size makes them, however, difficult to combine with typical machine learning workflows. In this paper we introduce persistence c…
Conformal prediction sets improve human decision making by quantifying model uncertainty.
The paper computes an approximation to the sample Frechet mean of graph sets using spectral information.
Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or features are useful or not. Recent methods have improved solutions by sampling a fixed …