Graph embedding methods produce unsupervised node features from graphs that can then be used for a variety of machine learning tasks. Modern graphs, particularly in industrial applications, contain billions of nodes and trillions of edges, which exceeds the capability of existing embedding systems. We present PyTorch-B…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “embedded systems”
Phase2vec learns embeddings of dynamical systems without supervision.
problem Predicting the classes of 2D dynamical systems from data.
method Physics-informed convolutional network that extracts geometric features and minimizes reconstruction loss.
result Learned embeddings respect the semantics of physical systems and outperform blackbox classifiers.
Graph embedding is a popular algorithmic approach for creating vector representations for individual vertices in networks. Training these algorithms at scale is important for creating embeddings that can be used for classification, ranking, recommendation and other common applications in industry. While industrial syst…
Measures time-delay embedding for noisy, sparse data.
problem Applying Takens' embedding theorem to real-world, noisy data.
method Formulated a measure-theoretic generalization of the embedding theorem, using optimal transport.
result Reconstructed full state of dynamical systems from time-lagged partial observations robust to noise and sparsity.
Production recommendation systems rely on embedding methods to represent various features. An impeding challenge in practice is that the large embedding matrix incurs substantial memory footprint in serving as the number of features grows over time. We propose a similarity-aware embedding matrix compression method call…
The paper explores weight systems and their applications to graph and embedded graph invariants.
problem Developing weight systems for graphs and embedded graphs.
method Construction of weight systems from graph invariants and metrized Lie algebras, and extending to arbitrary embedded graphs.
result Explicit forms of generating functions and recurrence relations for weight systems on chord diagrams and embedded graphs.
QENDy learns quadratic dynamics from nonlinear systems data.
problem Identifying governing equations of highly nonlinear dynamical systems.
method QENDy embeds nonlinear dynamics into a quadratic feature space, requiring trajectory data and preselected basis functions.
result QENDy accurately identifies quadratic dynamics and outperforms SINDy and deep learning methods.
The paper examines the consistency of item embeddings in recommendation systems.
problem The relevance of averaging item embeddings for user or concept representation.
method Proposes an expected precision score to measure consistency and analyzes it theoretically and empirically.
result Real-world averages are less consistent for recommendation compared to theoretical assumptions.
Paper introduces privacy-preserving few-shot learning for images.
problem Privacy risk in few-shot learning systems.
method Discrete embedding vectors and one-way hash functions.
result Achieves computational pan privacy without storing embeddings.
Improved neural speaker embeddings enhance ASR performance.
problem Few studies have explored neural speaker embeddings for ASR.
method Integrating improved neural speaker embeddings into a conformer-based hybrid HMM ASR system.
result Improved neural embeddings achieve on-par performance with i-vectors.
Alternative approach to regularize time-dependent singular Lagrangian systems.
problem Regularizing time-dependent singular Lagrangian systems.
method Employing the coisotropic embedding theorem and the Tulczyjew isomorphism.
result Uniqueness of the Lagrangian regularization to first order.
Electronic health record (EHR) systems are used extensively throughout the healthcare domain. However, data interchangeability between EHR systems is limited due to the use of different coding standards across systems. Existing methods of mapping coding standards based on manual human experts mapping, dictionary mappin…
We establish the weak continuity of the Gauss-Coddazi-Ricci system for isometric embedding with respect to the uniform -bounded solution sequence for , which implies that the weak limit of the isometric embeddings of the manifold is still an isometric embedding. More generally, we establish a compensated comp…
Embeddings are ubiquitous in machine learning, appearing in recommender systems, NLP, and many other applications. Researchers and developers often need to explore the properties of a specific embedding, and one way to analyze embeddings is to visualize them. We present the Embedding Projector, a tool for interactive v…
DVE models dynamic changes in feature embeddings for better sequence-aware applications.
problem Dynamic characterization of feature variations in time-varying data.
method Dynamic Variational Embedding (DVE) using recurrent neural networks.
result DVE models intrinsic nature and temporal variation of nodes effectively.
As a human choosing a supervised learning algorithm, it is natural to begin by reading a text description of the dataset and documentation for the algorithms you might use. We demonstrate that the same idea improves the performance of automated machine learning methods. We use language embeddings from modern NLP to imp…
Given a smooth 2-dimensional Riemannian or pseudo-Riemannian manifold and an ambient 3-dimensional Riemannian or pseudo-Riemannian manifold , one can ask under what circumstances does the exterior differential system for the isometric embedding $M\hookrightarrow …
COLoKe adapts Koopman embeddings online, reducing overfitting and improving long-term predictions.
problem Online adaptation of Koopman embeddings to avoid overfitting and maintain long-term predictive accuracy.
method Combines deep feature learning with multistep prediction consistency in a lifted space, using a conformal-style mechanism for selective updates.
result Empirically effective in reducing overfitting and maintaining long-term predictive accuracy.
In this paper we prove a conjecture of Bryant, Griffiths, and Yang concerning the characteristic variety for the determined isometric embedding system. In particular, we show that the characteristic variety is not smooth for any dimension greater than 4. This is accomplished by introducing a smaller yet equivalent line…
BC-Aligner maintains backward compatibility of embeddings after frequent updates.
problem Updating embeddings without requiring consumer teams to retrain their models.
method Learning backward compatible embeddings through BC-Aligner.
result BC-Aligner maintains backward compatibility with existing unintended tasks after multiple model version updates.
Dimensionality Reduction of Complex Metastable Systems via Kernel Embeddings of Transition Manifoldsmath.DS
We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework for the computation of optimal reaction coordinates of such systems that is based …
Enhances forecasting of complex systems using FKMD.
problem Forecasting high-dimensional dynamical systems with unknown features.
method Featurized Koopman Mode Decomposition (FKMD) using delay embedding and learned Mahalanobis distance.
result Improves prediction accuracy for various complex systems.
PinnerSage creates multi-modal user embeddings for better Pinterest recommendations.
problem Single high-dimensional embeddings fail to fully understand user interests.
method Hierarchical clustering and Medoids to summarize user actions into coherent clusters.
result PinnerSage outperforms single embedding methods in personalized recommendations.
Improved recommendation systems using multi-layer embeddings reduce model size while maintaining accuracy.
problem Improving model accuracy in recommendation systems while minimizing model size.
method Introducing a multi-layer embedding training (MLET) architecture that trains embeddings via a sequence of linear layers.
result Substantial advantages in model accuracy and memory footprint are achieved with reduced embedding dimensions.
This paper proposes a zero-shot learning approach for audio classification based on the textual information about class labels without any audio samples from target classes. We propose an audio classification system built on the bilinear model, which takes audio feature embeddings and semantic class label embeddings as…
Author2Vec generates user embeddings from social media data.
problem Generating useful user embeddings from noisy social media data.
method End-to-end neural network with BERT sentence representations and unsupervised pre-training.
result Author2Vec outperforms traditional methods in user classification tasks.
This work enables UAVs to autonomously form desired trajectories without needing a central plan.
problem Autonomous formation of complex trajectories in UAVs.
method Decentralized control system using geometric embeddings.
result Quadcopters self-organize into desired trajectories while maintaining separation.
Embedding representations power machine intelligence in many applications, including recommendation systems, but they are space intensive -- potentially occupying hundreds of gigabytes in large-scale settings. To help manage this outsized memory consumption, we explore mixed dimension embeddings, an embedding layer arc…
We consider an embedding of a -dimensional CW complex into the -sphere, and construct it's dual graph. Then we obtain a homogeneous system of linear equations from the -dimensional CW complex in the first homology group of the complement of the dual graph. By checking that the homogeneous system of linear equa…
For many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications. However, mirroring the rise of deep learning in various domains, neural network based audio embeddings, also known as d-vectors, have consistently demonstrated superior spe…
Extends coisotropic embedding theorem to various geometric settings.
problem Regularization problem of singular Lagrangian systems.
method Generic methodology applied to cosymplectic, contact, and multisymplectic manifolds.
result Fundamental basis for applying results to regularization problem.
We give a new proof for the local existence of a smooth isometric embedding of a smooth -dimensional Riemannian manifold with nonzero Riemannian curvature tensor into -dimensional Euclidean space. Our proof avoids the sophisticated arguments via microlocal analysis used in earlier proofs. In Part 1, we introduce …
Sparse oblique decision tree improves security rules for renewable power systems.
problem Identifying secure operating conditions in power systems with high renewable energy.
method Sparse weighted oblique decision tree to learn and embed linear security rules.
result The method significantly increases secure states and reduces solution time.
A new method estimates rare failure events in complex systems.
problem Estimating the probability of rare failure events in non-linear systems.
method Stochastic Spectral Embedding (SSE) combined with modifications for efficient rare event estimation.
result Rare failure probability decomposed into conditional probabilities for easier computation.
Study limits of quasi-local angular momentum at infinity of gravitating systems.
problem Understanding limits of quasi-local angular momentum at infinity of gravitating systems.
method Based on optimal isometric embedding and quasilocal mass theory, the study defines and analyzes the limits of quasi-local angular momentum at spatial and null infinity.
result Limits of quasi-local angular momentum are discussed at spatial and null infinity of an isolated gravitating system.
Unified deep framework for personalized recommendations with uncertainty.
problem Uncertainty in user preferences in recommendation systems.
method Gaussian embeddings, Monte-Carlo sampling, convolutional neural networks.
result Superior performance in recommendation accuracy compared to state-of-the-art models.
Deep learning system generates new Chinese fonts via style variables.
problem Efficiently design new Chinese fonts.
method End-to-end deep learning system generating new style fonts via interpolation of latent style-related embedding variables.
result Smooth transition between different font styles achieved.
DINOSAUR improves retrieval by accounting for embedding uncertainty in recommender systems.
problem Retrieval bias towards popular items due to noisy embeddings.
method Samples multiple embeddings per item and queries with sampled embeddings to account for uncertainty.
result Improves coverage of long-tail niche content without sacrificing recall.
Proposes a deep hybrid model for better recommendation systems.
problem Limited studies on hybrid recommender systems and the need for more advanced approaches.
method Integrates deep learning with ID embeddings and auxiliary features for improved recommendation.
result Improves recommendation results over deep learning models using ID embeddings.
Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systemscs.LG
Modern deep learning-based recommendation systems exploit hundreds to thousands of different categorical features, each with millions of different categories ranging from clicks to posts. To respect the natural diversity within the categorical data, embeddings map each category to a unique dense representation within a…
Researchers link vertex algebras to non-Kähler solutions of the Hull-Strominger system.
problem Constructing representations of vertex algebras from non-Kähler solutions of the Hull-Strominger system.
method Embedding the N=2 superconformal vertex algebra in the chiral de Rham complex of a string Courant algebroid, with a condition on the Hermitian-Yang-Mills connection.
result Any solution of the Hull-Strominger system satisfying the Hermitian-Yang-Mills condition has an associated N=2 embedding.
PGRec improves recommendation by modeling user-item preferences as a graph and embedding it for better predictions.
problem Sparse user-item data in recommender systems.
method PGRec models user-item preferences as a PrefGraph, then uses deep learning and factorization to embed and predict user preferences.
result PGRec outperforms state-of-the-art methods by up to 3.2% in NDCG@10.
We give a solution to the equivalence and the embedding problems for smooth CR-submanifolds of complex spaces (and, more generally, for abstract CR-manifolds) in terms of complete differential systems in jet bundles satisfied by all CR-equivalences or CR-embeddings respectively (local and global). For the equivalence p…
Speaker diarization with session-level speaker embedding refinement using graph neural networkseess.AS
Graph neural networks refine speaker embeddings for better session-level diarization.
problem Local speaker distinction in meeting sessions using deep embeddings.
method Graph Neural Networks (GNNs) refine speaker embeddings using session-level structural information.
result Spectral clustering on refined embeddings outperforms original embeddings significantly.
We prove that 2-dimensional simplicial complexes whose first homology group is trivial have topological embeddings in 3-space if and only if there are embeddings of their link graphs in the plane that are compatible at the edges and they are simply connected.
MPP trains a transformer to predict multiple physical systems, improving accuracy across various tasks.
problem Training models for specific physical systems is inefficient and requires fine-tuning.
method MPP trains a shared transformer on multiple heterogeneous physical systems, projecting fields into a shared embedding space.
result A single MPP-pretrained transformer outperforms task-specific models on all pretraining sub-tasks and downstream tasks.
The recent advances in deep neural networks (DNNs) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-constrained computing devices. Model compression techniques can address the computation issue of deep inference on embedded devices. This technique is …
Identifying coordinate transformations that make strongly nonlinear dynamics approximately linear is a central challenge in modern dynamical systems. These transformations have the potential to enable prediction, estimation, and control of nonlinear systems using standard linear theory. The Koopman operator has emerged…