Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

149297446594 · Jun 202019922001200920172026
48 results for embedding machines

GEM improves recommendation by capturing complex feature interactions.

problem Capturing complex high-order interaction signals in feature-based recommendation models.
method Integrates graph convolution networks to generate high-order embeddings and combines with FM-based models.
result Significant improvement in recommendation performance over baselines.

The recent proliferation of publicly available graph-structured data has sparked an interest in machine learning algorithms for graph data. Since most traditional machine learning algorithms assume data to be tabular, embedding algorithms for mapping graph data to real-valued vector spaces has become an active area of …

2019-08-08abs ↗pdf ↗

The paper explores theories behind graph and relational data vector embeddings.

problem Understanding the foundations of vector embeddings for graphs and relational structures.
method Proposes two theoretical approaches to understand vector embeddings.
result Draws connections between various embedding techniques and suggests future research directions.

Graph embedding methods produce unsupervised node features from graphs that can then be used for a variety of machine learning tasks. Modern graphs, particularly in industrial applications, contain billions of nodes and trillions of edges, which exceeds the capability of existing embedding systems. We present PyTorch-B…

2019-03-28abs ↗pdf ↗

We develop computationally efficient Riemannian manifolds for graph embeddings.

problem Challenging to maintain computational tractability in non-Euclidean graph embeddings.
method Explore computationally efficient matrix manifolds for graph embeddings.
result Consistent improvements over Euclidean geometry and outperforming hyperbolic and elliptical embeddings.

Networks are one of the most powerful structures for modeling problems in the real world. Downstream machine learning tasks defined on networks have the potential to solve a variety of problems. With link prediction, for instance, one can predict whether two persons will become friends on a social network. Many machine…

2019-11-26abs ↗pdf ↗

Paper provides conditions for reliable use of pre-trained embeddings in econometrics.

problem Uncertainty in using pre-trained embeddings for econometric tasks.
method Derives sufficient conditions and convergence rates for machine learning models with pre-trained embeddings.
result Establishes theoretical foundations for reliable use of pre-trained embeddings in econometrics.

Proposes FEFM and DeepFEFM for CTR prediction, outperforming state-of-the-art models.

problem Click-through rate prediction in online applications.
method Field-Embedded Factorization Machine (FEFM) and its deep counterpart DeepFEFM, combining feature embeddings and deep neural networks.
result FEFM and DeepFEFM outperform existing models in CTR prediction tasks.

We present a new approach for detecting related crime series, by unsupervised learning of the latent feature embeddings from narratives of crime record via the Gaussian-Bernoulli Restricted Boltzmann Machines (RBM). This is a drastically different approach from prior work on crime analysis, which typically considers on…

2017-10-28abs ↗pdf ↗

The paper uses news headlines to predict stock prices using embeddings.

problem Predicting stock prices using news headlines.
method Using OpenAI-based text embedding models and PCA to create vector encodings of news headlines, then training machine learning models on financial data.
result Headline data embeddings improve stock price prediction by at least 40%.

Proposes clustering as a new evaluation method for clinical knowledge embedding.

problem Traditional Link Prediction evaluation protocol loses information and harms model accuracy.
method Proposes Clustering Evaluation Protocol as an alternative.
result Experimental results show the proposed protocol can potentially replace Link Prediction.

Paper explores understanding of neural source code embeddings.

problem Lack of understanding of contents and characteristics of code2vec embeddings.
method Small case study using code2vec embeddings to create binary SVM classifiers and compare performance with handcrafted features.
result Code2vec embeddings perform similarly to handcrafted features and have more evenly distributed information gains.

Word embeddings are a powerful approach for unsupervised analysis of language. Recently, Rudolph et al. (2016) developed exponential family embeddings, which cast word embeddings in a probabilistic framework. Here, we develop dynamic embeddings, building on exponential family embeddings to capture how the meanings of w…

2017-03-23abs ↗pdf ↗

Algorithm learns stock correlation matrix embedding using graph machine learning.

problem Understanding complex relationships among stocks based on their correlation matrix.
method Proposes a graph machine learning approach called Node2Vec to compress the correlation network into an embedding.
result The algorithm can learn an embedding from the correlation network of S&P 500 stock data.

A new method speeds up SoftMax normalization for embedding learning.

problem Efficiently learning distributed representations with SoftMax normalization.
method Proposes a linear-time heuristic approximation for mSoftMax(XYT){ m SoftMax}(XY^T), optimizing cross entropy.
result Achieves higher or comparable accuracy to existing methods with lower computational time.

The paper explores how word embeddings affect the stability of downstream NLP models.

problem Small changes in training data can cause significant changes in model predictions.
method Empirical and theoretical analysis of embedding instability, including the introduction of eigenspace instability measure.
result Increasing embedding memory can reduce the disagreement in predictions by 5% to 37%.

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias. The widespread use of these algorithms in machine learning systems, from automa…

2018-10-08abs ↗pdf ↗

Paper proposes a matrix optimization model for reliable Euclidean embedding from noisy data.

problem Challenges in Euclidean embedding from noisy observations containing outliers.
method Matrix optimization based embedding model to detect and remove outliers.
result The model provides high accuracy estimators and successfully identifies outliers.

The success of machine learning methods heavily relies on having an appropriate representation for data at hand. Traditionally, machine learning approaches relied on user-defined heuristics to extract features encoding structural information about data. However, recently there has been a surge in approaches that learn …

2018-10-25abs ↗pdf ↗

Obtaining continuous representations of structural data such as directed acyclic graphs (DAGs) has gained attention in machine learning and artificial intelligence. However, embedding complex DAGs in which both ancestors and descendants of nodes are exponentially increasing is difficult. Tackling in this problem, we de…

2019-02-12abs ↗pdf ↗

KEEN Universe provides reproducible and transferable knowledge graph embeddings.

problem Lack of reproducibility and transferability in KGE experiments.
method Developed an ecosystem with Python packages for reproducible and transferable KGEs.
result KEEN Universe facilitates sharing of trained KGE models across different fields.

New method uses product embeddings to predict bundle success.

problem Designing effective product bundles in large retail settings.
method Leverage historical purchases and clickstream data to generate product embeddings, then use heuristics for complementarity and substitutability.
result Embeddings-based heuristics predict bundle success, robust across categories and retailers.

In recent years, there have been significant efforts on mitigating unethical demographic biases in machine learning methods. However, very little is done for kernel methods. In this paper, we propose a new fair kernel regression method via fair feature embedding (FKR-F2^2E) in kernel space. Motivated by prior works on…

2019-07-04abs ↗pdf ↗

Large-scale automated meta-analysis of neuroimaging data has recently established itself as an important tool in advancing our understanding of human brain function. This research has been pioneered by NeuroSynth, a database collecting both brain activation coordinates and associated text across a large cohort of neuro…

2016-05-01abs ↗pdf ↗

MAD framework learns operators from physics-embedded data efficiently.

problem Data-driven methods require costly labeled datasets and model-driven techniques face efficiency-accuracy trade-offs.
method Integrates physical laws with data-driven learning to generate physics-embedded analytical solutions and synthetic data.
result Eliminates dependence on experimental or simulated training data, enabling efficient operator learning across multi-parameter systems.

Interactive machine learning with weak supervision and pre-trained embeddings.

problem Training machine learning models with limited labeled data.
method Use pre-trained embeddings to define a distance function and extend source votes to nearby points.
result Significantly outperforms traditional weakly-supervised and fully-supervised methods.

Financial transactions can be considered edges in a heterogeneous graph between entities sending money and entities receiving money. For financial institutions, such a graph is likely large (with millions or billions of edges) while also sparsely connected. It becomes challenging to apply machine learning to such large…

2019-07-16abs ↗pdf ↗