Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

51101152202 · Jun 202019922001200920182026
48 results for sparse hierarchical

There has been a surge in the number of large and flat data sets - data sets containing a large number of features and a relatively small number of observations - due to the growing ability to collect and store information in medical research and other fields. Hierarchical clustering is a widely used clustering tool. I…

2014-09-02abs ↗pdf ↗

Sparse model for noisy datasets using hierarchical regularization.

problem Learning from large noisy datasets with sparse representations.
method Hierarchical learning strategy with projection-based penalty operators.
result Efficient sparse model reconstruction and generalizability on real datasets.

We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods that is significantly faster than previous approaches, making it possible to perfor…

2014-06-08abs ↗pdf ↗

We present a novel method for exact hierarchical sparse polynomial regression. Our regressor is that degree rr polynomial which depends on at most kk inputs, counting at most \ell monomial terms, which minimizes the sum of the squares of its prediction errors. The previous hierarchical sparse specification aligns w…

2017-09-28abs ↗pdf ↗

Sparse deep neural networks(DNNs) are efficient in both memory and compute when compared to dense DNNs. But due to irregularity in computation of sparse DNNs, their efficiencies are much lower than that of dense DNNs on regular parallel hardware such as TPU. This inefficiency leads to poor/no performance benefits for s…

2018-08-10abs ↗pdf ↗

In this paper a new Bayesian model for sparse linear regression with a spatio-temporal structure is proposed. It incorporates the structural assumptions based on a hierarchical Gaussian process prior for spike and slab coefficients. We design an inference algorithm based on Expectation Propagation and evaluate the mode…

2017-04-27abs ↗pdf ↗

Proposes a hierarchical deep generative model for natural images.

problem Analyzing piecewise smooth signals like natural images.
method Hierarchical deep generative model with alternating minimization algorithm.
result Demonstrates the model's representation capabilities and classification performance.

Sparse hierarchical graph classification improves graph-based benchmarks.

problem Sparse hierarchical graph classification challenges.
method Combining recent advances in graph neural network design, differentiable graph coarsening, and sparse pooling.
result Competitive hierarchical graph classification results possible without sacrificing sparsity.

RG-Flow combines RG and sparse priors for hierarchical image disentanglement.

problem Disentangling and manipulating image representations at different scales.
method Hierarchical flow model using RG and sparse prior distributions.
result RG-Flow enables semantic manipulation and style mixing at different image scales.

Paper tackles NAS problem by modeling it as a sparse supernet.

problem Neural Architecture Search (NAS) problem, particularly Mixed-Path Search.
method Model NAS as a sparse supernet with sparsity constraints. Use hierarchical accelerated proximal gradient algorithm for optimization.
result Proposed method finds compact, general, and powerful neural architectures.

Novel method extracts hierarchical brain connectivity patterns from fMRI.

problem Functional hierarchical organization of the human brain.
method Sparse Connectivity Patterns (SCPs) with hierarchy of sparse overlapping patterns, deep factorization of correlation matrices.
result Reproducible multi-scale hierarchical SCPs more stable than single-scale patterns.

SRHM explains deep learning's hierarchy and insensitivity to transformations.

problem Understanding how deep networks learn hierarchical and invariant representations.
method Introducing sparsity to generative hierarchical models of data.
result Hierarchical representations and insensitivity to transformations correlate strongly with deep network performance.

Proposes a nonparametric tensor factorization for sparse data.

problem Handling sparse tensor data with structural and interpretability benefits.
method Hierarchical Gamma processes and Poisson random measures for tensor-valued process, Dirichlet processes for sampling entry indices, Gaussian processes for values.
result Demonstrates superior performance on benchmark datasets.

ASAP improves graph pooling for hierarchical graph representations.

problem Pooling in graphs fails to effectively capture substructure or scale to large graphs.
method ASAP uses self-attention and modified GNN to capture node importance and learn sparse soft cluster assignments.
result Combining ASAP with GNN architectures leads to state-of-the-art results on graph classification benchmarks.

Efficiently trains HDP topic models on large datasets using a sparse data-parallel sampler.

problem Scaling non-parametric topic models to large datasets.
method Data-parallel training with a doubly sparse sampler for HDP topic models.
result Trains HDP topic models on a 8m document, 768m token PubMed corpus in under 4 days.

Non-negative matrix factorization models based on a hierarchical Gamma-Poisson structure capture user and item behavior effectively in extremely sparse data sets, making them the ideal choice for collaborative filtering applications. Hierarchical Poisson factorization (HPF) in particular has proved successful for scala…

2016-04-13abs ↗pdf ↗

HIRM models noisy, sparse, heterogeneous relational data using hierarchical clustering and Dirichlet processes.

problem Modeling noisy, sparse, and heterogeneous relational data.
method Hierarchical Chinese restaurant process and Dirichlet process mixture for clustering and modeling relation values.
result HIRM generalizes standard models and discovers relational structure in real-world datasets.

A new method for Bayesian neural networks using probabilistic backpropagation.

problem Approximating posterior distributions in Bayesian neural networks.
method Variational Expectation Propagation (VEP) with probabilistic backpropagation.
result Efficient algorithm for approximate integration over posterior distributions.

Efficiently trains deep Gaussian processes with sparse approximations.

problem High computational complexity in training and inference for DGP models.
method Tensor Markov Gaussian Processes (TMGP) and hierarchical expansion to create DTMGP model.
result DTMGP model achieves superior computational efficiency compared to existing DGP models.

A new Bayesian model improves forecasting for intermittent demand.

problem Sparse observations, cold-start items, and obsolescence in intermittent demand forecasting.
method Hierarchical Bayesian TSB model with partial pooling and calibrated probabilistic configuration.
result TSB-HB achieves the lowest RMSE and RMSSE on the UCI Online Retail dataset.

We propose a nonparametric Bayesian factor regression model that accounts for uncertainty in the number of factors, and the relationship between factors. To accomplish this, we propose a sparse variant of the Indian Buffet Process and couple this with a hierarchical model over factors, based on Kingman's coalescent. We…

2009-08-05abs ↗pdf ↗

Oracle inequality for sparse neural nets adapts to unknown structure.

problem Sparse deep neural nets in nonparametric regression.
method Gibbs posterior distribution with Metropolis-adjusted Langevin algorithms and mixture of uniform priors.
result Oracle inequality showing adaptation to unknown regularity and structure, achieving minimax-optimal rate of convergence.

We present a signal representation framework called the sparse manifold transform that combines key ideas from sparse coding, manifold learning, and slow feature analysis. It turns non-linear transformations in the primary sensory signal space into linear interpolations in a representational embedding space while maint…

2018-06-23abs ↗pdf ↗

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is performed by solving an L1-regularized linear regression problem, commonly referred to as Lasso or Basis Pursuit. In this work we combine the sparsity-inducing property of the Lasso model at the indivi…

2010-06-07abs ↗pdf ↗

Paper proposes a new method for efficient exploration in reinforcement learning.

problem Sparse reward reinforcement learning challenges in exploration.
method Learn separate intrinsic and extrinsic task policies, schedule between them, and use successor feature control (SFC).
result Substantially improved exploration efficiency with SFC and hierarchical usage of intrinsic drives.

We study how to effectively leverage expert feedback to learn sequential decision-making policies. We focus on problems with sparse rewards and long time horizons, which typically pose significant challenges in reinforcement learning. We propose an algorithmic framework, called hierarchical guidance, that leverages the…

2018-03-01abs ↗pdf ↗

A new HRL algorithm learns and exploits multiple subgoals for faster exploration.

problem Sparse reward problem in reinforcement learning.
method Multi-goal HRL algorithm with Manager and Worker policies.
result Significantly improved exploration efficiency with reduced training time.

EASIER-net uses sparse networks to improve prediction accuracy for high-dimensional data.

problem Limited use of neural networks in high-dimensional data with small samples.
method Ensemble by Averaging Sparse-Input Hierarchical networks (EASIER-net) with small modifications to neural network architecture and training procedure.
result EASIER-net achieves higher prediction accuracy than off-the-shelf methods on average.