Polynomial-time Gibbs sampling generates DPP samples efficiently.
problem Sampling from continuous Determinantal Point Processes (DPPs).
method Polynomial-time Gibbs sampling algorithm.
result Gibbs sampler generates DPP samples in polynomial time.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Continuous DPPs”
Determinantal point processes (DPPs) are random point processes well-suited for modeling repulsion. In machine learning, the focus of DPP-based models has been on diverse subset selection from a discrete and finite base set. This discrete setting admits an efficient sampling algorithm based on the eigendecomposition of…
DPPy offers Python tools for sampling DPPs.
problem Sampling from DPPs is challenging.
method Gathers exact and approximate sampling algorithms for finite and continuous DPPs.
result DPPy provides Python tools for DPP sampling.
This paper solves nonparametric estimation of continuous DPPs using kernel methods.
problem Estimating continuous Determinantal Point Processes (DPPs) without assuming a parametric form.
method Developed a fixed point algorithm based on a representer theorem for nonnegative functions in RKHS.
result Demonstrated a finite-dimensional problem for nonparametric MLE of continuous DPPs.
State-of-art minibatches via novel DPP kernels: discretization, wavelets, and rough objectivesstat.ML
New DPP kernels improve minibatch efficiency for large datasets.
problem Efficiently generating minibatches from large datasets.
method Wavelet-based DPPs and novel discrete conversion methods.
result Improved minibatch efficiency with low-rank decompositions.
Study the limits of discrete DPPs to continuous DPPs as set size grows.
problem Characterize the behavior of discrete DPPs as they approach continuous DPPs.
method Non-asymptotic characterization of the limit in terms of weak coherency.
result Sufficient conditions for weak coherency are identified.
We propose a new class of determinantal point processes (DPPs) which can be manipulated for inference and parameter learning in potentially sublinear time in the number of items. This class, based on a specific low-rank factorization of the marginal kernel, is particularly suited to a subclass of continuous DPPs and DP…
Analysis of DPPs and k-DPPs via spectral decomposition reveals identifiable parameters and non-identifiability gaps.
problem Identifying parameters of DPPs and k-DPPs through spectral decomposition.
method Spectral decomposition of the covariance matrix, analysis of invariances, and counting arguments.
result Identifiability of parameters changes fundamentally for k-DPPs, with specific invariances and non-identifiability gaps.
Determinantal point processes (DPPs) are well-suited for modeling repulsion and have proven useful in many applications where diversity is desired. While DPPs have many appealing properties, such as efficient sampling, learning the parameters of a DPP is still considered a difficult problem due to the non-convex nature…
Determinantal point processes (DPPs) are point process models that naturally encode diversity between the points of a given realization, through a positive definite kernel . DPPs possess desirable properties, such as exact sampling or analyticity of the moments, but learning the parameters of kernel through like…
Faster sampler reduces DPP sampling cost to O(nm + m^3 log m).
problem High cost of sampling discrete DPPs.
method Uses rejection sampling and leverage score i.i.d. sampling.
result Reduces sampling cost from O(n^3) to O(nm + m^3 log m).
Determinantal point processes based on orthogonal polynomials for sampling minibatches in SGDstat.ML
This work improves SGD minibatch sampling using determinantal point processes based on orthogonal polynomials.
problem Improving variance reduction in stochastic gradient descent (SGD) for large datasets.
method Orthogonal polynomial-based determinantal point processes for sampling minibatches in SGD.
result DPP minibatches lead to a smaller mean square approximation error than uniform minibatches.
Deep DPP model uses neural networks to learn kernel matrices for DPPs.
problem Limitations of DPPs in capturing nonlinear interactions and incorporating item metadata.
method Integrates a deep feed-forward neural network to learn the kernel matrix of DPPs.
result Deep DPP model improves predictive performance and outperforms baselines.
Kernel quadrature with DPPsstat.ML
Kernel quadrature uses DPPs for sampling with tight error bounds.
problem Efficiently sampling nodes for quadrature rules in RKHS.
method Nodes sampled from a truncated and saturated DPP kernel.
result Tighter quadrature error bounds using DPPs.
Paper tests DPPs for diversity models, distinguishing them from other distributions.
problem Testing whether a given distribution is a Determinantal Point Process (DPP) or far from any DPP.
method Proposes the first algorithm for DPP testing and establishes a lower bound on sample complexity.
result Establishes a matching lower bound on the sample complexity of DPP testing.
Driven by the need for parallelizable hyperparameter optimization methods, this paper studies \emph{open loop} search methods: sequences that are predetermined and can be generated before a single configuration is evaluated. Examples include grid search, uniform random search, low discrepancy sequences, and other sampl…
Enhanced DPP model improves basket completion tasks.
problem Improving recommendation quality for basket completion.
method Specialized multi-task DPP model for multi-class classification.
result Multi-task DPP provides significantly better predictive quality.
A novel online feature selection method using DPP for diversity.
problem Online feature selection for diverse feature sets.
method DPP-based framework with three stages: sampling, local criteria, and global criteria.
result Demonstrated better compactness and comparable/outsuperior performance.
DPP-BBO diversifies batched Bayesian optimization using DPPs.
problem Efficiently proposing diverse and informative batches in batched Bayesian optimization.
method Introducing DPP-Batch Bayesian Optimization (DPP-BBO) with DPP-Thompson Sampling (DPP-TS).
result Novel Bayesian simple regret bounds for DPP-TS show improved performance over classical methods.
Determinantal Point Processes (DPPs) are popular models for point processes with repulsion. They appear in numerous contexts, from physics to graph theory, and display appealing theoretical properties. On the more practical side of things, since DPPs tend to select sets of points that are some distance apart (repulsion…
Determinantal point processes (DPPs) are distributions over sets of items that model diversity using kernels. Their applications in machine learning include summary extraction and recommendation systems. Yet, the cost of sampling from a DPP is prohibitive in large-scale applications, which has triggered an effort towar…
Determinantal point processes (DPPs) are an important concept in random matrix theory and combinatorics. They have also recently attracted interest in the study of numerical methods for machine learning, as they offer an elegant "missing link" between independent Monte Carlo sampling and deterministic evaluation on reg…
New method learns nonsymmetric DPPs for better modeling diverse sets.
problem Nonsymmetric DPPs for better modeling diverse sets.
method Maximum likelihood estimation with a specific kernel decomposition.
result Improved predictive performance compared to symmetric DPPs.
Researchers derive Markov properties of discrete DPPs.
problem Lack of statistical properties exploration for discrete DPPs.
method Derive Markov properties using graphical models.
result Markov properties of discrete DPPs can be expressed.
DPPS uses DP priors for Bayesian non-parametric multi-arm bandits.
problem Optimizing multi-arm bandit environments with prior beliefs.
method Bayesian non-parametric algorithm based on Dirichlet Process priors.
result DPPS provides principled incorporation of prior beliefs and is optimal in Bayesian regret setup.
A determinantal point process (DPP) is a random process useful for modeling the combinatorial problem of subset selection. In particular, DPPs encourage a random subset Y to contain a diverse set of items selected from a base set Y. For example, we might use a DPP to display a set of news headlines that are relevant to…
Determinantal point processes (DPPs) are an elegant model for encoding probabilities over subsets, such as shopping baskets, of a ground set, such as an item catalog. They are useful for a number of machine learning tasks, including product recommendation. DPPs are parametrized by a positive semi-definite kernel matrix…
New method samples DPPs efficiently without downsampling or low-rank approximations.
problem Efficient sampling from DPPs for diverse selections.
method Directly approximates distribution function of linear statistics using Laplace inversion.
result Scalable sampling for general DPPs, beyond symmetric kernels.
Higher-Order Generalization Bounds: Learning Deep Probabilistic Programs via PAC-Bayes Objectivescs.LG
Unified framework for learning flexible probabilistic programs using DPP and PAC-Bayes bounds.
problem Learning and generalizing from complex probabilistic models.
method Unified DPP representation and PAC-Bayes bounds for stochastic programs.
result Improved performance and generalization prediction using flexible DPP model representations and learned complexity measures.
DPPNets approximate DPP sampling with deep learning for efficient subset selection.
problem Efficiently sampling from Determinantal Point Processes (DPPs) with high diversity and quality.
method Developed DPPNets using transformer networks with an inhibitive attention mechanism.
result Samples from DPPNets receive high likelihood under the more expensive DPP alternative, demonstrating efficiency.
Adaptive algorithm samples items from a DPP without seeing all items.
problem Efficiently sample items from a DPP without preprocessing all items.
method Adaptive uniform sampling of a subset of data, followed by -DPP sampling on this subset.
result Produces a -DPP sample after observing only a small fraction of all elements, significantly faster than state-of-the-art.
Determinantal consensus clustering improves clustering robustness.
problem Robustness of clustering algorithms.
method Use of determinantal point processes (DPP) for random restart of clustering algorithms.
result Determinantal consensus clustering outperforms classical algorithms.
Paper explores duality in DPPs using embedding structure analysis.
problem Understanding the geometric structure of determinantal point processes.
method Analyzes the exponential family embedding of DPPs and uses the e-embedding curvature tensor.
result Discovers the duality between marginal and L-ensemble kernels.
This paper shows DPPs can outperform random coresets in machine learning tasks.
problem Building efficient coresets for machine learning models.
method Using determinantal point processes (DPPs) to construct coresets with provable improvements over random sampling.
result DPPs can provably outperform independently drawn coresets in terms of approximation of total loss.
Paper explores how DPP sampling can implicitly regularize kernel regression.
problem Improving kernel regression by reducing redundancy in data.
method Using Determinantal Point Processes (DPPs) to sample subsets implicitly regularizes ridgeless Kernel Regression.
result Ensemble of ridgeless regressors can be effective for datasets with redundant information.
Determinantal Point Processes (DPPs) are probabilistic models that arise in quantum physics and random matrix theory and have recently found numerous applications in computer science. DPPs define distributions over subsets of a given ground set, they exhibit interesting properties such as negative correlation, and, unl…
In this paper, we propose a novel policy iteration method, called dynamic policy programming (DPP), to estimate the optimal policy in the infinite-horizon Markov decision processes. We prove the finite-iteration and asymptotic l\infty-norm performance-loss bounds for DPP in the presence of approximation/estimation erro…
This work tackles scalable sampling for nonsymmetric DPPs.
problem Scalability issue in existing DPP sampling algorithms for nonsymmetric DPPs.
method Developed a linear-time algorithm for kernels with low-rank structure and a sublinear-time rejection sampling algorithm.
result Bounded rejection rate for kernels with structural constraints.
Determinantal point processes (DPPs) are elegant probabilistic models of repulsion that arise in quantum physics and random matrix theory. In contrast to traditional structured models like Markov random fields, which become intractable and hard to approximate in the presence of negative correlations, DPPs offer efficie…
Determinantal Point Processes (DPPs) are probabilistic models over all subsets a ground set of items. They have recently gained prominence in several applications that rely on "diverse" subsets. However, their applicability to large problems is still limited due to the complexity of core tasks suc…
This research uses DPPs to improve semi-parametric regression models.
problem Improving comprehensibility in semi-parametric regression models without sacrificing accuracy.
method Introduced a novel representation of finite DPPs and used it to derive a key identity illustrating implicit regularization.
result Demonstrated the implicit regularization effect of determinantal sampling for semi-parametric regression.
Determinantal point processes (DPPs) have garnered attention as an elegant probabilistic model of set diversity. They are useful for a number of subset selection tasks, including product recommendation. DPPs are parametrized by a positive semi-definite kernel matrix. In this work we present a new method for learning th…
Generative model learns diverse generations using DPP to avoid mode collapse.
problem Mode collapse in generative models, limiting output to few modes.
method Inspired by DPP, proposes an unsupervised penalty loss to enhance diversity.
result Generative DPP approach consistently resists mode-collapse and outperforms state-of-the-art methods.
We propose a novel diverse feature selection method based on determinantal point processes (DPPs). Our model enables one to flexibly define diversity based on the covariance of features (similar to orthogonal matching pursuit) or alternatively based on side information. We introduce our approach in the context of Bayes…
Existing MAP inference algorithms for determinantal point processes (DPPs) need to calculate determinants or conduct eigenvalue decomposition generally at the scale of the full kernel, which presents a great challenge for real-world applications. In this paper, we introduce a class of DPPs, called BwDPPs, that are char…
Paper presents a deterministic method for diverse subset selection.
problem Diverse subset selection problems in recommendation, summarization, and search.
method Greedy deterministic adaptation of k-DPP for low-rank approximations and image search.
result The method yields low-rank approximations of kernel matrices and demonstrates effectiveness in image search.
New scalable MCMC sampling for nonsymmetric DPPs speeds up computations.
problem Efficient sampling for nonsymmetric DPPs with low-rank kernels.
method Enhanced rejection sampling with efficient proposal distribution construction.
result Sublinear runtime for scalable MCMC sampling of -NDPPs.
We present a new random sampling strategy for k-bandlimited signals defined on graphs, based on determinantal point processes (DPP). For small graphs, ie, in cases where the spectrum of the graph is accessible, we exhibit a DPP sampling scheme that enables perfect recovery of bandlimited signals. For large graphs, ie, …