Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

149297446594 · Jun 202019922001200920172026
48 results for Scalable sampling

This paper introduces a neural sampler for scalable sampling from complex distributions.

problem Efficiently sampling from high-dimensional un-normalized distributions.
method Neural implicit sampler trained with KL and Fisher divergence methods.
result The neural sampler generates large batches of samples with low computational costs.

Scalable method completes ill-conditioned matrices from few samples.

problem Matrix completion from few samples for ill-conditioned matrices.
method Iterative algorithm combining IRLS, smoothing Newton, and proximal gradient methods.
result Local quadratic convergence rate and well-conditioned linear systems.

A scalable algorithm for sampling and fine-tuning models using Tilt Matching.

problem Efficient sampling and fine-tuning of generative models.
method Tilt Matching, arising from a dynamical equation, minimizes variance and inherits regularity from stochastic interpolants.
result Empirically verified to be efficient and highly scalable, providing state-of-the-art results.

This paper introduces a scalable benchmark for evaluating local posterior sampling in neural networks.

problem Degeneracy in neural network loss landscapes and its impact on SGMCMC algorithms.
method Development of a scalable benchmark for local posterior sampling.
result RMSProp-preconditioned SGLD is most effective at representing the local geometry of the posterior distribution.

This work tackles scalable sampling for nonsymmetric DPPs.

problem Scalability issue in existing DPP sampling algorithms for nonsymmetric DPPs.
method Developed a linear-time algorithm for kernels with low-rank structure and a sublinear-time rejection sampling algorithm.
result Bounded rejection rate for kernels with structural constraints.

A new method improves Bayesian deep learning by balancing scalability and accuracy.

problem Scalability issues in Bayesian neural networks.
method Collapsed inference scheme that performs Bayesian model averaging using collapsed samples.
result Significant improvements over existing methods in predictive performance and uncertainty estimation.

Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing

problem Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing
method Reformulating Stein discrepancy construction as an explicit SNR^2 maximisation problem
result Avoiding exponential SNR^2 collapse and achieving stable SNR^2

Novel method for scalable neural network-based blackbox optimization.

problem Scalability challenges in high-dimensional Bayesian Optimization.
method SNBO: Adds new samples using separate criteria for exploration and exploitation, adaptively controlling the sampling region.
result SNBO achieves better function values with 40-60% fewer function evaluations and reduced runtime.

DIGing-SGLD improves SGLD for scalable Bayesian learning in dynamic networks.

problem Scalable Bayesian learning in multi-agent systems with time-varying networks.
method Integrates Langevin sampling with gradient-tracking for decentralized learning over time-varying networks.
result Achieves geometric convergence to the target distribution with finite-time guarantees.

Conventional sampling techniques fall short of drawing descriptive sketches of the data when the data is grossly corrupted as such corruptions break the low rank structure required for them to perform satisfactorily. In this paper, we present new sampling algorithms which can locate the informative columns in presence …

2016-11-18abs ↗pdf ↗

New graph representation learning network improves scalability and feature integration.

problem Scalability and feature integration in graph neural networks for large, dense graphs.
method Adaptive sampling of neighbours based on weighted multi-step transition probabilities.
result Comparable or better results on various graph benchmarks.

The Graph Convolutional Network (GCN) model and its variants are powerful graph embedding tools for facilitating classification and clustering on graphs. However, a major challenge is to reduce the complexity of layered GCNs and make them parallelizable and scalable on very large graphs -- state-of the art techniques a…

2018-10-28abs ↗pdf ↗

A new method for assessing Bayesian sampling quality, PSD, is proposed and shown to be more powerful and efficient.

problem Scalability and convergence assessment of Bayesian sampling algorithms, especially for high-dimensional problems.
method Polynomial Stein Discrepancy (PSD) for measuring discrepancy between samples and posterior distributions.
result PSD detects differences in the first r moments for Gaussian targets and is more powerful and efficient than competitors.

Paper proposes scalable algorithm to estimate intervention targets in linear models.

problem Estimating intervention targets in linear models from observational and interventional data.
method The paper proposes a scalable algorithm that estimates intervention sites from the difference between precision matrices of observational and interventional datasets.
result The algorithm consistently identifies all intervention targets and updates observational Markov equivalence classes to interventional ones.

We propose a new scalable algorithm for holistic linear regression building on Bertsimas & King (2016). Specifically, we develop new theory to model significance and multicollinearity as lazy constraints rather than checking the conditions iteratively. The resulting algorithm scales with the number of samples nn in th…

2019-02-08abs ↗pdf ↗

Thompson sampling (TS) is a class of algorithms for sequential decision-making, which requires maintaining a posterior distribution over a model. However, calculating exact posterior distributions is intractable for all but the simplest models. Consequently, efficient computation of an approximate posterior distributio…

2019-02-19abs ↗pdf ↗

Improved sampling for high-dimensional posteriors with underdamped Langevin.

problem Scalability issues in high-dimensional problems with approximate Thompson sampling.
method Underdamped Langevin Monte Carlo for accelerated posterior concentration.
result Logarithmic regret improvement from ildeO(d)\mathcal{ ilde O}(d) to ildeO(d)\mathcal{ ilde O}(\sqrt{d}).

Unified framework for scalable black-box optimization.

problem Expensive black-box evaluations in scientific and engineering domains.
method Integrates active learning, multi-armed bandits, and distributed computing.
result Consistently outperforms state-of-the-art black-box optimizers.

ESAC combines genetic methods with RL to improve scalability and efficiency.

problem Combining genetic scalability with RL's data efficiency and optimal control.
method Combines Evolution Strategies (ES) with Soft Actor-Critic (SAC) to enable skill transfer and reduce hyperparameter sensitivity.
result Demonstrates improved performance and sample efficiency in challenging tasks.

New algorithm optimizes interventions under network interference, scaling to large networks.

problem Optimal policy learning under network interference where one individual's treatment affects others.
method Developed a scalable Thompson sampling algorithm for dynamic networks.
result Proved a Bayesian regret bound that is sublinear in network size and rounds.

Ensemble++ uses shared-factor ensembles to scale Thompson Sampling for linear and nonlinear bandits.

problem Computational challenges in Thompson Sampling for large-scale or non-conjugate settings.
method Ensemble++ with shared-factor architecture and random linear combinations.
result Ensemble++ achieves comparable regret to exact Thompson Sampling with significantly smaller ensemble sizes.

Scalable algorithm for sampling Gaussian processes using sparse grids and preconditioners.

problem Generating high-dimensional Gaussian random vectors for GP sampling is computationally challenging.
method Proposes a scalable algorithm using inducing points approximation with sparse grids and additive Schwarz preconditioners.
result Demonstrates the efficacy and accuracy of the proposed method through experiments and comparisons.

Develops scalable methods to assess sensitivity and uncertainty in continuous treatment effects.

problem Estimating effects of continuous-valued interventions from observational data, especially when ignorability and positivity assumptions are violated.
method Continuous treatment-effect marginal sensitivity model (CMSM), scalable algorithm, uncertainty-aware deep models.
result Derives bounds that agree with observed data and a defined level of hidden confounding.

DTS improves inference-time alignment of diffusion models with less compute.

problem Inference-time alignment of diffusion models suffers from inaccurate value estimation and inefficient reuse of past computations.
method Diffusion Tree Sampling (DTS) uses a tree-based approach to propagate terminal rewards and iteratively refine value estimates.
result DTS produces asymptotically exact samples and matches the FID of best-performing baselines with up to 10x less compute.

NIPA aims to translate brain learning mechanisms into scalable Bayesian inference.

problem Scalable Bayesian inference for large-scale statistical machine learning problems.
method Neural-inspired algorithm combining model-based, model-free, and episodic-control modules.
result Advances Bayesian methods and facilitates their application to deep learning.

Scalable Bayesian sampling is playing an important role in modern machine learning, especially in the fast-developed unsupervised-(deep)-learning models. While tremendous progresses have been achieved via scalable Bayesian sampling such as stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD)…

2018-11-21abs ↗pdf ↗

Meta-learning interpretable decision trees with synthetic data.

problem Lack of efficient, scalable methods for generating synthetic data for decision tree meta-learning.
method Synthetic generation of near-optimal decision trees using the MetaTree transformer architecture.
result Meta-learning of decision trees achieves performance comparable to real-world data or optimal decision trees, with significant computational cost reduction.

Bayesian inference engines improve density estimation accuracy and scalability.

problem Constructing accurate and scalable probability density functions.
method Bayesian inference engines (no-U-turn sampling and expectation propagation) with binning strategy.
result Density estimates have excellent comparative performance and scale well to large sample sizes.

Improved Thompson Sampling algorithms for bandits with tighter regret bounds.

problem Efficient and adaptive algorithms for stochastic bandits with bounded rewards.
method Proposed two parameterized Thompson Sampling-based algorithms: TS-MA-α and TS-TD-α.
result Achieved O(Kln^(α+1)(T)/Δ) regret bound, improving scalability and resource allocation.

Develops coresets for scalable multivariate distribution estimation.

problem Handling large-scale data in non-parametric or semi-parametric regression and density estimation.
method Novel coreset construction for multivariate conditional transformation models (MCTMs).
result Substantial data reduction with high log-likelihood accuracy.

This thesis tackles non-convex Bayesian learning via scalable dynamic importance sampling algorithms.

problem Non-convex Bayesian learning problem in deep neural networks.
method Replica exchange Langevin Monte Carlo, control variates method, population-chain replica exchange, scalable dynamic importance sampling.
result Control variates method reduces variance and accelerates convergence in non-convex Bayesian learning.

Graphs are ubiquitous real-world data structures, and generative models that approximate distributions over graphs and derive new samples from them have significant importance. Among the known challenges in graph generation tasks, scalability handling of large graphs and datasets is one of the most important for practi…

2019-06-05abs ↗pdf ↗