Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

36912 · Jun 202019922001200920172026
48 results for Sample-based

The study proves sampling-based GNNs can approximate training on full graphs with small subgraphs.

problem Training Graph Neural Networks (GNNs) on large graphs is computationally expensive.
method Theoretical framework using graph local limits to prove approximation of GNN training on small samples.
result Parameters learned from sampling-based GNNs on small subgraphs are close to those on full graphs.

New method for Bayesian neural networks reduces inference difficulty.

problem Difficulty in sample-based inference for Bayesian neural networks.
method Embracing mode-connectedness to link overparameterization and sampling difficulty.
result Practical guidelines and deep ensemble approach for effective SBI.

Given a data matrix XRn×dX \in R^{n\times d} and a response vector yRny \in R^{n}, suppose n>dn>d, it costs O(nd2)O(n d^2) time and O(nd)O(n d) space to solve the least squares regression (LSR) problem. When nn and dd are both large, exactly solving the LSR problem is very expensive. When ndn \gg d, one feasible approach to spee…

2014-03-30abs ↗pdf ↗

A scalable method for Bayesian inference in large linear models.

problem High computational cost in Bayesian linear models for large networks.
method Sample-based inference and g-prior for hyperparameter selection.
result Linearised neural network inference on large datasets (ResNet-18, ResNet-50, U-Net).

We present an embedding of stochastic optimal control problems, of the so called path integral form, into reproducing kernel Hilbert spaces. Using consistent, sample based estimates of the embedding leads to a model free, non-parametric approach for calculation of an approximate solution to the control problem. This fo…

2012-08-13abs ↗pdf ↗

Improves generalization with few samples using a new regularization method.

problem Training deep neural networks with limited data leads to overfitting.
method Sample-based regularization (SBR) to improve generalization without relying on source model knowledge.
result SBR outperformed existing methods in various configurations.

This work compares and evaluates various sampling methods for neural language models.

problem Lack of systematic comparison and myths about sampling methods.
method Monte Carlo sampling, importance sampling, compensated partial summation, noise contrastive estimation.
result All sampling methods can perform equally well if posterior probabilities are corrected.

A new method improves SVI for high-dimensional, poorly-conditioned distributions.

problem Challenges in existing SVI methods for high-dimensional, poorly-conditioned distributions.
method Trust-region optimization approach leveraging conditional independences and second-order information.
result Superior numerical performance and better scalability in high-dimensional distributions.

We study the problem of finding the optimal dosage in early stage clinical trials through the multi-armed bandit lens. We advocate the use of the Thompson Sampling principle, a flexible algorithm that can accommodate different types of monotonicity assumptions on the toxicity and efficacy of the doses. For the simplest…

2019-03-17abs ↗pdf ↗

Deep unfolding accelerates MCMC-based COP solvers.

problem Optimizing combinatorial problems with MCMC and gradient descent.
method Combines MCMC and gradient descent, trains step sizes, uses variance estimation for non-differentiable MCMC.
result Significantly accelerates convergence speed for COPs.

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization of approaches, divided into, what we refer to as, sample-based, feature-based and…

2019-01-16abs ↗pdf ↗

Differentiable learning via SGD and GD can simulate various learning problems, depending on precision and minibatch size.

problem Understanding the power of differentiable learning via SGD and GD compared to statistical query (SQ) learning.
method Comparing the learning power of SGD and GD on population and empirical losses with statistical query learning.
result The learning power of SGD and GD depends on the precision of gradient calculations relative to the minibatch size or sample size.

MIRA scores assess conditional distribution accuracy using joint samples.

problem Assessing the accuracy of candidate conditional distributions.
method Analytic expression for Mira score based on equal probability mass regions.
result Mira enables Bayesian model comparison by quantifying alignment with true process.

Bounded rationality investigates utility-optimizing decision-makers with limited information-processing power. In particular, information theoretic bounded rationality models formalize resource constraints abstractly in terms of relative Shannon information, namely the Kullback-Leibler Divergence between the agents' pr…

2018-09-04abs ↗pdf ↗

Efficient clustering for large datasets using a sampling-based approach.

problem Clustering high-dimensional data with a large number of clusters efficiently.
method A simple and efficient clustering method that evaluates distances of data points with a subset of cluster centers.
result Optimal solutions of the approximation are the same as in the exact solution, but more efficient at extracting clusters.

Efficient algorithm finds fast Transformer models.

problem Slow inference time of Transformer models.
method Decompose Transformer architecture into components, use sampling-based one-shot search.
result Achieved 10% to 30% speedup on pre-trained BERT and 70% on top of a previous state-of-the-art model.

A framework for hypothesis testing on attributed graphs using sampling.

problem Statistical testing on graph data, especially large attributed graphs.
method Sampling-based framework with PHASE and PHASEopt for accurate and efficient hypothesis testing.
result PHASE and PHASEopt improve accuracy and efficiency of hypothesis testing in attributed graphs.

HH-VAEM improves imputation and acquisition of missing data using hierarchical models and Hamiltonian Monte Carlo.

problem Imputation and acquisition of missing heterogeneous data.
method Hierarchical VAE model with Hamiltonian Monte Carlo and automatic hyper-parameter tuning.
result HH-VAEM outperforms existing methods in imputation and supervised learning tasks.

We propose a relaxation-based approximate inference algorithm that samples near-MAP configurations of a binary pairwise Markov random field. We experiment on MAP inference tasks in several restricted Boltzmann machines. We also use our underlying sampler to estimate the log-partition function of restricted Boltzmann ma…

2013-12-21abs ↗pdf ↗

Graph Convolutional Networks (GCNs) are powerful models for learning representations of attributed graphs. To scale GCNs to large graphs, state-of-the-art methods use various layer sampling techniques to alleviate the "neighbor explosion" problem during minibatch training. We propose GraphSAINT, a graph sampling based …

2019-07-10abs ↗pdf ↗

PS4POMDPs algorithm simplifies online learning for episodic POMDPs with unknown models.

problem Learning in POMDPs is harder than in MDPs; online learning is especially challenging.
method Posterior Sampling-based reinforcement learning algorithm (PS4POMDPs)
result Bayesian regret scales as √number of episodes and is polynomial in other parameters.

Improved Thompson Sampling algorithms for bandits with tighter regret bounds.

problem Efficient and adaptive algorithms for stochastic bandits with bounded rewards.
method Proposed two parameterized Thompson Sampling-based algorithms: TS-MA-α and TS-TD-α.
result Achieved O(Kln^(α+1)(T)/Δ) regret bound, improving scalability and resource allocation.

New method learns graph structure and uncertainty from data.

problem Learning latent graph structures and their uncertainty from data.
method Proposes a sampling-based method to learn latent graph structure and uncertainty simultaneously.
result Proves that suitable loss functions on stochastic model outputs solve both learning latent graph structure and achieving optimal predictions.

DGFS improves sampling from complex densities by optimizing partial trajectories.

problem Sampling from intractable high-dimensional density functions.
method DGFS uses a flow function to break down the training process into short partial trajectory segments, leveraging intermediate learning signals.
result DGFS achieves more accurate estimates of the normalization constant.

SDPG algorithm improves sample efficiency and reward in DRL for continuous action spaces.

problem Improving sample efficiency and reward in distributional reinforcement learning for continuous action spaces.
method SDPG algorithm models return distribution using samples via reparameterization technique.
result SDPG shows better sample efficiency and higher reward in OpenAI Gym environments.

Paper proposes robust methods for estimating optimal treatment rules with censored survival data.

problem Estimating optimal treatment rules for censored survival data.
method Developed two robust criteria and a sampling-based difference-of-convex algorithm for learning optimal treatment rules.
result Proposed methods show improved performance compared to existing methods in simulations and real data.

New method for efficient marginalization of discrete latent variables in neural networks.

problem Computational challenges in training models with discrete latent variables.
method Parameterizing discrete distributions using sparse mappings (sparsemax and structured variants) to reduce support and enable efficient marginalization.
result Achieved good performance in various tasks with efficient and practical training.

LaPSRL achieves optimal regret for isoperimetric RL distributions.

problem Designing RL algorithms with sublinear regret for non-log-concave distributions.
method Posterior Sampling (PSRL) and Langevin sampling (LaPSRL) for isoperimetric distributions.
result LaPSRL achieves order-optimal regret and subquadratic complexity.

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of matrix entries in the context of these low-rank approximations and other sampling-…

2010-09-04abs ↗pdf ↗

LLMs generate answers under incomplete context, and their uncertainty should scale with missing information.

problem Evaluating the quality of LLM answers under incomplete context.
method A controlled framework with varying context availability, and two uncertainty measures (sampling-based confidence and response entropy) evaluated on SQuAD.
result Response entropy increases with context removal and explains more variance in accuracy than confidence, suggesting it is a more responsive uncertainty measure.