Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,738 papers · 148 categories

Trend · papers per month

91182272363 · Jun 202019922001200920172026
48 results for inference nodes

MultiImport infers node importance from multiple KG signals.

problem Inferring node importance in a knowledge graph from multiple input signals.
method End-to-end latent variable model using attentive graph neural networks.
result MultiImport consistently outperforms existing methods, achieving up to 23.7% higher NDCG@100.

We introduce a novel view to understand how dropout works as an inexplicit ensemble learning method, which doesn't point out how many and which nodes to learn a certain feature. We propose a new training method named internal node bagging, it explicitly forces a group of nodes to learn a certain feature in training tim…

2018-05-01abs ↗pdf ↗

Proposes a method to model uncertainty in neural ordinary differential equations.

problem Lack of uncertainty modeling and robustness in neural ordinary differential equations.
method Introduces a novel approach to model uncertainty by considering a distribution over the end-time of the ODE solver.
result Demonstrates the effectiveness of the proposed approaches in modelling uncertainty and robustness through experiments.

New models infer causal effects from graph-based time-series data.

problem Inferring causal effects from graph-based relational time-series data.
method Proposes causal inference models leveraging graph topology and time-series data.
result Relational time-series causal inference models accurately estimate local causal effects of individual nodes.

AP-Calculus offers a new framework for causal inference in Bayesian networks.

problem Causal inference in Bayesian networks with complex architectures.
method Introduces Attribution Projection Calculus (AP-Calculus) to determine causal relationships.
result Proves that for each label, exactly one intermediate node acts as a deconfounder.

New algorithms cluster nodes in SBM graphs faster and more accurately.

problem Efficiently clustering nodes in graphs generated from SBM models.
method Inspired by Lloyd's algorithm, proposes model-free clustering methods for SBM graphs.
result Consistent estimation of node clusters and parameters in SBM graphs.

New BNN model proves optimal posterior concentration and enables practical inference.

problem Improving generalization and uncertainty quantification in deep neural networks.
method Proposes a new node-sparse BNN model with theoretical guarantees and a novel MCMC algorithm for inference.
result Proves near minimax optimal posterior concentration rate and adaptiveness to true model smoothness.

We tackle the problem of inferring node labels in a partially labeled graph where each node in the graph has multiple label types and each label type has a large number of possible labels. Our primary example, and the focus of this paper, is the joint inference of label types such as hometown, current city, and employe…

2014-01-30abs ↗pdf ↗

Develops a Markov Random Field model for hypergraphs to improve machine learning tasks.

problem Modeling data generation processes on hypergraphs for better machine learning.
method Hypergraph Markov Random Field model using multivariate Gaussian distribution.
result Proposed model enhances algorithm design and outperforms existing methods in structure inference and node classification.

In this work, we developed a network inference method from incomplete data ("PathInf") , as massive and non-uniformly distributed missing values is a common challenge in practical problems. PathInf is a two-stages inference model. In the first stage, it applies a data summarization model based on maximum likelihood to …

2018-10-01abs ↗pdf ↗

IoT nodes compress measurements into DNN outputs for efficient communication.

problem Efficient communication of high-dimensional IoT data with limited bandwidth.
method Modeling IoT node measurements as DNN intermediate outputs and optimizing model parameters.
result Approximately 96% reduction in transmissions with only 2.5% loss in inference accuracy.

We provide the first information theoretic tight analysis for inference of latent community structure given a sparse graph along with high dimensional node covariates, correlated with the same latent communities. Our work bridges recent theoretical breakthroughs in the detection of latent community structure without no…

2018-07-23abs ↗pdf ↗

We propose a novel method for network inference from partially observed edges using a node-specific degree prior. The degree prior is derived from observed edges in the network to be inferred, and its hyper-parameters are determined by cross validation. Then we formulate network inference as a matrix completion problem…

2016-02-07abs ↗pdf ↗

Proposes VCLANC for attributed network clustering using node and attribute embeddings.

problem Lack of mutual affinity exploitation between nodes and attributes in graph convolution.
method Dual variational auto-encoders for node and attribute embeddings, Gaussian mixture model priors, mutual distance and clustering assignment hardening losses.
result Demonstrates effectiveness on real-world attributed network datasets.

Combines neural networks and probabilistic graphical models for efficient higher-order inference.

problem Lack of efficient higher-order relational information in graph neural networks and probabilistic graphical models.
method Derives efficient approximate sum-product loopy belief propagation for higher-order PGMs, embeds into neural network, proposes methods for constructing higher-order factors.
result Substantially outperforms state-of-the-art k-order graph neural networks in molecular datasets.

Network-assisted regression uses conformal prediction for valid inference.

problem Predicting node attributes using network and conventional covariates with valid statistical inference.
method Network analog of conformal prediction under mild joint exchangeability assumption.
result Achieves finite sample validity and asymptotic conditional validity for various network covariates.

RBMs model binary interactions with hidden node activation effects.

problem Understanding how RBM hidden node activation affects binary variable distributions.
method Investigated RBM marginal distributions with different hidden node activation functions.
result Found exact expressions for RBM marginals as interacting binary variables.

GRADE models evolving graph dynamics by learning node and community representations.

problem Lack of tools to study temporal community dynamics in evolving graphs.
method GRADE is a probabilistic model that learns evolving node and community representations via a random walk prior and variational inference.
result GRADE outperforms baselines in dynamic link prediction and dynamic community detection.

We develop the Latent Multi-group Membership Graph (LMMG) model, a model of networks with rich node feature structure. In the LMMG model, each node belongs to multiple groups and each latent group models the occurrence of links as well as the node feature structure. The LMMG can be used to summarize the network structu…

2012-05-21abs ↗pdf ↗

Study bandwidth-limited training and inference of language models.

problem Training and inference of language models on scattered data with limited bandwidth.
method Analyzed two protocols: Federated Probe-Logit Distillation (FPLD) for training and Federated Conformal RAG (FC-RAG) for inference.
result Explicit high-probability KL-consistency rate and distribution-free marginal-coverage bound for Federated Conformal RAG.

Enhances inference of spreading processes using neural-network priors.

problem Estimating initial states of graph processes from partial observations.
method Bayesian framework with single-layer perceptron neural network for initial states; hybrid BP-AMP algorithm.
result Model exhibits first-order phase transitions, creating a statistical-to-computational gap.

Graph convolutional neural networks (GCNN) have numerous applications in different graph based learning tasks. Although the techniques obtain impressive results, they often fall short in accounting for the uncertainty associated with the underlying graph structure. In the recently proposed Bayesian GCNN (BGCN) framewor…

2019-11-08abs ↗pdf ↗

VFG model embeds flow-based models with hierarchical structures using variational inference.

problem Flow-based models struggle with high-dimensional latent spaces and lack of tractable inference for graphical structures.
method Integrates flow-based functions through variational inference with aggregation nodes for hierarchical information integration.
result VFG models achieve improved ELBO and likelihood values on multiple datasets.

As an efficient and scalable graph neural network, GraphSAGE has enabled an inductive capability for inferring unseen nodes or graphs by aggregating subsampled local neighborhoods and by learning in a mini-batch gradient descent fashion. The neighborhood sampling used in GraphSAGE is effective in order to improve compu…

2019-04-29abs ↗pdf ↗

A novel GNN architecture improves link prediction by combining positive and negative samples.

problem Link prediction accuracy limited by node-wise methods and increased model complexity of edge-wise methods.
method Proposes a novel GNN architecture that uses both positive and negative samples to inform node embeddings.
result The method retains the inference speed of node-wise models while achieving competitive accuracy with edge-wise alternatives.

New method estimates Nishimori temperature for node classification in weighted graphs.

problem Estimating Nishimori temperature for Bayesian inference.
method Spectral method using eigenvalues of Bethe Hessian matrix.
result Spectral method outperforms existing approaches in node classification.

A method for inferring graph from multivariate time series using ADMM.

problem Inferring conditional independence graph from multivariate Gaussian time series.
method Formulated as multi-attribute graph estimation, used ADMM to minimize penalized negative log-likelihood.
result Proposed method outperforms existing frequency-domain approaches in graph edge detection.

We consider the problem of estimating community memberships of nodes in a network, where every node is associated with a vector determining its degree of membership in each community. Existing provably consistent algorithms often require strong assumptions about the population, are computationally expensive, and only p…

2017-09-01abs ↗pdf ↗

SIMPLE-RC method tests group membership profiles in large networks with weak signals.

problem Testing group membership profiles in large networks with weak signals.
method Random coupling technique to construct maximum SIMPLE tests for subsampled node pairs.
result Asymptotic distributions of SIMPLE-RC test are derived, enabling delicate analysis.

In this paper, we focus on learning low-dimensional embeddings for nodes in graph-structured data. To achieve this, we propose Caps2NE -- a new unsupervised embedding model leveraging a network of two capsule layers. Caps2NE induces a routing process to aggregate feature vectors of context neighbors of a given target n…

2019-11-12abs ↗pdf ↗