A new method for embedding sparse high-order interactions.
problem Learning embeddings from sparse high-order interaction events.
method Hybridizing sparse hypergraph and matrix Gaussian processes.
result Strong asymptotic bounds on sparsity ratio.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,341 papers · 148 categories
Trend · papers per month
48 results for “sparse interactions”
The study analyzes neural interactions using an Ising model to reveal contributions of pairwise interactions to sparseness and fluctuation.
problem Understanding the contributions of pairwise interactions to sparseness and fluctuation in neural activity.
method Inference methods for a time-dependent Ising model to analyze neural interactions and estimate time-dependent neural interactions with credible intervals.
result Pairwise interactions contribute to increasing sparseness and fluctuation in neural activity.
WHInter: A Working set algorithm for High-dimensional sparse second order Interaction modelsq-bio.QM
WHInter solves high-dimensional sparse interaction models efficiently.
problem Learning sparse models with two-way interactions in high-dimensional data.
method Working set algorithm for l1-regularised problems with quadratic interactions.
result Two orders of magnitude faster than state-of-the-art methods.
New model captures sparse, evolving multigraph structures.
problem Understanding sparse, evolving multigraph structures in dynamic interaction data.
method Dynamic nonparametric Bayesian model combining sparsity and clustering.
result Improved held-out likelihood and predictive performance.
AdaEnsemble learns adaptive feature interactions for CTR prediction.
problem Learning feature interactions for CTR prediction in recommender systems and Ads ranking.
method AdaEnsemble is a Sparsely-Gated Mixture-of-Experts (SparseMoE) architecture that dynamically selects feature interaction depth.
result AdaEnsemble achieves better prediction accuracy and inference efficiency compared to state-of-the-art models.
SPARTAN learns sparse interaction graphs between objects in scenes.
problem Capturing structured interactions between entities in complex settings remains challenging.
method SPARTAN is a Transformer-based world model that learns sparse, context-dependent interaction graphs through sparsity regularization on attention patterns.
result SPARTAN achieves significantly improved few-shot adaptation to dynamics changes and robustness against distractors.
New regularization scheme for FMs improves feature interaction selection.
problem Feature selection in FMs leads to loss of feature interactions.
method Proposes a new regularization scheme for FMs with upper bound of regularizer.
result Improves feature interaction selection without restricting sparsity patterns.
FI-GNNs learn expressive node representations from sparse features.
problem Sparse and high-dimensional node features limit GNN performance.
method Plug-and-play GNN framework that highlights informative feature interactions.
result FI-GNNs learn highly expressive node representations on feature-sparse graphs.
Methodology for learning sparse models using all multiplicative interactions efficiently.
problem Learning high-order feature interactions with fine control.
method Fine Control Kernel framework, combining Fenchel Duality and Apriori algorithm.
result Efficiently solves large sparse learning problems with sparse feature screening rules.
A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Modelstat.ML
Sparse Bayesian learning algorithm for estimating interaction kernels in Motsch-Tadmor model.
problem Data-driven identification of asymmetric interaction kernels in the Motsch-Tadmor model.
method Variational framework reformulating kernel identification as a subspace identification problem; sparse Bayesian learning algorithm with informative priors.
result Accurate, robust, and interpretable estimation of interaction kernels across various noise levels and data regimes.
SIAN bridges simple models to neural networks by identifying necessary feature combinations.
problem The gap between simple models and powerful neural networks in performance.
method Feature interaction detection and sparse selection algorithm.
result Competitive performance across multiple tabular datasets with optimal tradeoff.
SDAMI enhances interpretable high-dimensional regression with sparse deep learning and footprint principle.
problem Personalized models for small samples and high-dimensional features with interpretability.
method Sparse Deep Additive Model with Interactions (SDAMI) combining sparsity-driven feature selection and deep subnetworks.
result SDAMI successfully identifies pure interactions with near-zero false positive rates.
Proposes a method to learn sparse and low-rank interactions in Ising models with latent variables.
problem Learning sparse interactions in Ising models with latent variables.
method Sparse + low-rank decomposition of Ising model parameters using convex regularized likelihood problem.
result Consistency properties in high-dimensional settings with growing number of variables and samples.
Bayesian method identifies dynamical models with uncertainty quantification.
problem Uncertainty in selecting governing equations for dynamical systems.
method Bayesian sparse identification with model averaging.
result Accurately recovers sparse interaction structures with uncertainty quantification.
We face network data from various sources, such as protein interactions and online social networks. A critical problem is to model network interactions and identify latent groups of network nodes. This problem is challenging due to many reasons. For example, the network nodes are interdependent instead of independent o…
Bayesian Pliable Lasso with Horseshoe Prior for Interaction Effects in GLMs with Missing Responsesstat.ME
Bayesian pliable lasso with horseshoe prior models interactions in GLMs with missing data.
problem Modeling interactions in sparse regression problems with missing responses.
method Bayesian pliable lasso with hierarchical horseshoe prior for sparsity and uncertainty quantification.
result Advantages over existing methods in recovering complex interaction patterns under incomplete data.
New algorithms approximate Rashomon set for sparse models, aiding expert interaction.
problem Lack of interaction between models and domain experts in classical machine learning.
method Approximate Rashomon set of sparse, generalized additive models using ellipsoids.
result Efficiently approximated Rashomon set facilitates model selection and exploration.
Model financial default cascades on sparse graphs via hitting times.
problem Capturing systemic risk in large, sparsely-connected financial networks.
method Dynamic particle systems with hitting times and convergence theory.
result Characterization of default time distribution in tree-like networks.
New method finds significant high-order interactions efficiently.
problem Finding statistically significant high-order interactions in high-dimensional data.
method Extends selective inference to high-order interaction models with pruning strategy.
result Demonstrated efficient and powerful method for high-order interactions.
IntHT solves sparse quadratic regression in sub-quadratic time and space.
problem Sparse quadratic regression in high-dimensional problems.
method Interaction Hard Thresholding (IntHT) is a variant of Iterative Hard Thresholding tailored for quadratic structures.
result IntHT provably converges to a consistent estimate under high-dimensional sparse recovery assumptions.
Human advice improves deep learning from sparse samples.
problem Learning from sparse, noisy samples in deep models.
method Knowledge-augmented Column Networks using human advice.
result Significantly improved performance or faster convergence.
This paper is concerned with the problems of interaction screening and nonlinear classification in a high-dimensional setting. We propose a two-step procedure, IIS-SQDA, where in the first step an innovated interaction screening (IIS) approach based on transforming the original -dimensional feature vector is propose…
Develops a sparse Bayesian model for high-dimensional data.
problem Sparse nonparametric regression with complex interactions.
method Sparse additive Gaussian process with soft interactions.
result Excellent performance in simulated and real data.
Visual reranking is effective to improve the performance of the text-based video search. However, existing reranking algorithms can only achieve limited improvement because of the well-known semantic gap between low level visual features and high level semantic concepts. In this paper, we adopt interactive video search…
Proposes a method to estimate sparse low-rank matrices from noisy data.
problem Estimating sparse low-rank matrices from noisy observations.
method Objective function with non-convex penalties, ADMM algorithm.
result Proposed method outperforms convex methods in estimating sparse low-rank matrices.
Randomized feature models learn interaction kernels from agent paths.
problem Learning interaction kernels from noisy agent paths.
method Randomized feature algorithm and sparse regression.
result Pruned features reduce overfitting and lower simulation cost.
Wide & Deep combines linear and deep learning for better app recommendations.
problem Sparse user-item interactions lead to less relevant recommendations.
method Jointly trains wide linear models and deep neural networks.
result Wide & Deep significantly increases app acquisitions compared to wide-only and deep-only models.
Estimates complex functions with sparse interactions in high dimensions.
problem Estimating functions with sparse interactions in high-dimensional data.
method Randomized algorithm for estimating function components and interactions.
result Exact recovery of function components and interactions from samples.
New algorithms improve inference in non-differentiable models.
problem Inference and learning in latent variable models with non-differentiable densities.
method Proximal interacting particle Langevin algorithms (PIPLA).
result Nonasymptotic bounds and effectiveness demonstrated in various models.
New algorithms for estimating complex functions with sparse interactions.
problem Estimating functions with sparse additive components and interactions in high dimensions.
method Developed efficient algorithms to recover the set of variables and their interactions from noisy or noiseless samples.
result Provable recovery of the set of variables and their interactions with finite sample bounds.
LORIS model estimates main and interaction effects in large data frames.
problem Handling large data frames with missing values and explicit modeling of main effects.
method Low-rank interaction and sparse additive effects (LORIS) model with mixed coordinate gradient descent (MCGD).
result LORIS method provides statistical guarantees and converges efficiently for large data sets.
New method identifies important features and interactions in RF models.
problem Limited theoretical understanding of local feature and interaction importance in RF models.
method Combines global and local analysis to identify frequent feature co-occurrences.
result Proves consistent recovery of true local signal features and interactions.
A new method for predicting with confidence for complex models.
problem Lack of reliable confidence in high-stake decision-making models.
method Developed a full-CP for sparse high-order interaction model using homotopy mining.
result SHIM achieves comparable accuracy to complex models and superior statistical power.
Study infers evolutionary interactions from protein sequences using regularization methods.
problem Inferring evolutionary interactions from protein sequences.
method Regularization methods, including for fields and group for couplings, with parameter tuning.
result Effective regularization parameters for sparse couplings improve accuracy.
New method decomposes KL error using refined information and mode interactions.
problem Learning probability distributions over discrete variables with higher-order interactions.
method Using information geometry, refined mode interactions, and a novel Monte-Carlo sampling technique.
result Complete decomposition of KL error and efficient data use.
New approach improves cross-domain recommendation for sparse target domains.
problem Cross-domain recommendation challenges with sparse target domains.
method Guided neural collaborative filtering with domain-invariant components across dense and sparse domains.
result Effective and scalable approach demonstrated on public and Visa datasets.
SeqFM models dynamic and sequential features for better predictive analytics.
problem Inadequate handling of sequential dependencies in existing FM-based models.
method Introduces SeqFM, a novel model that incorporates multi-view self-attention to model static, dynamic, and their interactions.
result SeqFM outperforms existing models in ranking, classification, and regression tasks on six large-scale datasets.
Dynamic models learn from sparse, interacting sub-systems.
problem Learning robust models for systems with local views and spatial locations.
method Abstracting the system as a collection of sparsely interacting sub-systems, each with a learned topology informed by spatial structure.
result Models are more robust to the number of available views and generalize better to novel tasks.
The paper introduces a penalized matrix estimation procedure aiming at solutions which are sparse and low-rank at the same time. Such structures arise in the context of social networks or protein interactions where underlying graphs have adjacency matrices which are block-diagonal in the appropriate basis. We introduce…
We expand the item response theory to study the case of "cheating students" for a set of exams, trying to detect them by applying a greedy algorithm of inference. This extended model is closely related to the Boltzmann machine learning. In this paper we aim to infer the correct biases and interactions of our model by c…
HopGAT improves node classification in sparsely labeled graphs by learning from distant neighbors.
problem Classifying nodes in sparsely labeled graphs with limited labeled data.
method Hop-aware supervision mechanism and simulated annealing learning strategy.
result The model achieves high accuracy even with 40% labeled data, reducing performance loss to 3.9%.
Proposes a new model for high-dimensional data analysis with unknown link function.
problem Estimating link function, component functions, and variable interactions in high-dimensional data.
method Generalized Sparse Additive Model with Unknown Link Function (GSAMUL) using B-spline basis and MLP network for link estimation, with -norm regularizer for variable selection.
result Can realize both variable selection and hidden interaction.
Taking into account high-order interactions among covariates is valuable in many practical regression problems. This is, however, computationally challenging task because the number of high-order interaction features to be considered would be extremely large unless the number of covariates is sufficiently small. In thi…
Dynamic model clusters interactions over time, improving prediction.
problem Sparse, evolving interaction graphs with temporal dynamics.
method Structured, nonparametric edge-exchangeable model for dynamic clustering.
result Improved predictive performance compared to static models.
ONN learns different representations for different operations to improve user response prediction.
problem Improving user response prediction in online advertising and recommendation systems.
method Proposes Operation-aware Neural Networks (ONN) to learn different representations for different operations.
result ONN consistently outperforms state-of-the-art models in both offline and online environments.
We propose an inference method to estimate sparse interactions and biases according to Boltzmann machine learning. The basis of this method is regularization, which is often used in compressed sensing, a technique for reconstructing sparse input signals from undersampled outputs. regularization impedes the …
Sparse Network Inference under Imperfect Detection and its Application to Ecological Networksstat.ML
Framework for inferring latent structure from sparse, imperfectly detected bipartite networks.
problem Recovering latent structure from sparse, imperfectly detected bipartite networks in ecology.
method Structured sparse nonnegative low-rank factorization with detection probability estimation and ADMM-based algorithm.
result Improved recovery of latent factors and structure compared to existing methods.
Random Intersection Chainsstat.ML
Random Intersection Chains selects important interactions from categorical features.
problem Heavy computational burden in considering all interactions for categorical features.
method Randomly generates chains of intersections, estimates and selects frequent patterns.
result Selected patterns are the most frequent in the data set.