Optimal weights improve particle-based approximations of discrete distributions.
problem Improving particle-based approximations of discrete distributions.
method Proving optimality of weights and showing how to compute them efficiently.
result Optimal weights can be computed from existing particle-based methods without extra costs.
Copula-based normalizing flows improve flexibility and stability for heavy-tailed data.
problem Limited expressive power of vanilla normalizing flows.
method Generalize base distribution to copula for more accurate representation of target distribution.
result Copula-based normalizing flows improve flexibility, stability, and effectiveness for heavy-tailed data.
In this letter, we derive the optimal discriminant functions for modulation classification based on the sampled distribution distance. The proposed method classifies various candidate constellations using a low complexity approach based on the distribution distance at specific testpoints along the cumulative distributi…
Gradient-based methods can be biased by distributional asymmetries in bivariate categorical data.
problem Gradient-based causal discovery methods can be biased by distributional asymmetries in bivariate categorical data.
method Identified and examined two distributional biases: Marginal Distribution Asymmetry and Marginal Distribution Shift Asymmetry. Employed two simple models to demonstrate and control these biases.
result Gradient-based methods can be biased by distributional asymmetries, and these biases can be controlled.
A new base distribution for normalizing flows allows modeling complex distributions without sacrificing invertibility.
problem Normalizing flows struggle with complex, non-trivial distributions.
method Learned rejection sampling for base distribution, combined with optimization of log-likelihood and Kullback-Leibler divergence.
result The method effectively models complicated distributions without sacrificing invertibility.
A new distributed clustering framework using distributional kernel.
problem Clustering in distributed networks with arbitrary shapes, sizes, and densities.
method Distributed Clustering based on Distributional Kernel (KDC) using similarity of distributions.
result KDC guarantees equivalent clustering outcomes to centralized methods, reduces runtime, and discovers arbitrary clusters.
Distributional approaches to value-based reinforcement learning model the entire distribution of returns, rather than just their expected values, and have recently been shown to yield state-of-the-art empirical performance. This was demonstrated by the recently proposed C51 algorithm, based on categorical distributiona…
In this paper, an issue of building the RRC model using probability distributions other than beta distribution is addressed. More precisely, in this paper, we propose to build the RRR model using the truncated normal distribution. Heuristic procedures for expected value and the variance of the truncated-normal distribu…
BiDVL improves EBLVMs for visual tasks by optimizing two variational distributions.
problem Training EBLVMs is challenging due to intractable distributions.
method Bi-level doubly variational learning with two tractable distributions.
result BiDVL achieves impressive image generation and reconstruction performance.
New polynomial convergence guarantees for SGM on general data distributions.
problem Efficient guarantees for multimodal and non-smooth distributions in SGM.
method Polynomial convergence guarantees for denoising diffusion models on general data distributions, with no assumptions on functional inequalities or smoothness.
result Wasserstein distance guarantees for distributions of bounded support or decaying tails, and TV guarantees for further smoothness assumptions.
A new method samples from multi-modal distributions without hyperparameter tuning.
problem Sampling from multi-modal distributions is challenging and requires tuning hyperparameters.
method Learned Reference-based Diffusion Sampler (LRDS) that learns a reference model on high-density regions and uses it to train a diffusion-based sampler.
result LRDS best exploits prior knowledge on multi-modal distributions compared to competing algorithms.
New method calibrates uncertainty estimates for image classifiers without labeled data.
problem Uncertainty estimates for modern classifiers are unreliable without labeled calibration data.
method Calibrates uncertainty estimates using unlabeled examples for distribution shifts.
result Proposes a method that provides excellent uncertainty estimates under natural distribution shifts.
Unified framework for OOD detection using class ratio estimation.
problem Density-based OOD detection is unreliable for OOD images.
method Unified framework that builds energy-based models and employs differing base distributions, directly estimating the density ratio through class ratio estimation.
result Competitive results on OOD image problems compared to recent work.
Unified probabilistic gradient boosting for entire conditional distribution modeling.
problem Creating accurate probabilistic forecasts from regression tasks.
method Unified probabilistic gradient boosting framework using XGBoost and LightGBM, modeling conditional moments or CDF via Normalizing Flows.
result Achieves state-of-the-art forecast accuracy.
TTF improves performance of normalizing flows for heavy-tailed distributions.
problem Improving performance of normalizing flows for heavy-tailed distributions.
method Uses a Gaussian base distribution and a final transformation layer to produce heavy tails.
result Experimental results show TTF outperforms current methods, especially in high-dimensional or heavy-tailed scenarios.
Many machine learning problems can be characterized by mutual contamination models. In these problems, one observes several random samples from different convex combinations of a set of unknown base distributions. It is of interest to decontaminate mutual contamination models, i.e., to recover the base distributions ei…
Proposes an energy-based sliced Wasserstein distance for improved probability measure comparison.
problem Inefficiencies and limitations in existing sliced Wasserstein distance approaches.
method Introduces an energy-based slicing distribution for better performance and stability.
result Demonstrates superior performance of the EBSW distance in various applications.
Event-based learning reduces communication in distributed networks.
problem Distributed learning with diverse data distributions and communication inefficiencies.
method A distributed learning algorithm using ADMM with event-triggered communication.
result The algorithm converges even with distinct local data distributions and achieves accelerated convergence in convex settings.
Piecewise normalizing flows improve multi-modal distribution modeling.
problem Improving accuracy in modeling multi-modal distributions.
method Divide target distribution into clusters, train flows to match standard normal base.
result Piecewise flows outperform standard approaches in accuracy.
Random variables of the generalized Pareto distribution, can be transformed to that of the Pareto distribution. Explicit expressions exist for the maximum likelihood estimators of the parameters of the Pareto distribution. The performance of the estimation of the shape parameter of generalized Pareto distributed using …
Proposes PGPS for efficient Bayesian inference.
problem Efficient sampling from complex posterior distributions.
method Path-guided particle-based sampling with Log-weighted Shrinkage.
result PGPS generates samples closer to target distribution.
A quantum walk-based method for generating precise probability distributions efficiently.
problem Generating high-precision probability distributions for various applications.
method Integrates variational quantum circuits with split-step quantum walks to dynamically tune coin parameters and evolve quantum states.
result Achieves high simulation fidelity and reduces computational overhead compared to conventional methods.
A new variable importance measure for DRFs detects broader impacts on output distributions.
problem Estimating full conditional distributions of multivariate outputs given inputs.
method Based on the drop and relearn principle and MMD distance.
result Consistent and high-performing variable importance measure for DRFs.
Fiber simplifies RL and population-based methods for distributed training.
problem Challenges in RL and population-based methods, including frequent interaction with simulations and dynamic scaling.
method Introducing Fiber, a scalable distributed computing framework.
result Significantly expands accessibility of large-scale parallel computation.
A new measure scales MMD to assess distribution closeness.
problem Testing statistical significance of distribution closeness.
method Norm-adaptive MMD (NAMMD) for distributional discrepancy.
result NAMMD-based DCT has higher test power than MMD-based DCT.
New methods for distributed CP improve reliability in healthcare.
problem Post-hoc calibration of models in safety-critical domains.
method Quantile-based and histogram-based distributed conformal prediction via message passing.
result Improved reliability and coverage guarantees in decentralized settings.
A new policy for contextual bandits adapts to reward vector shifts.
problem Learning under reward vector shifts with ordered rewards.
method Adaptive-discretization and optimistic elimination policy.
result Established upper bounds on preference-based regret.
This paper presents a distance-based discriminative framework for learning with probability distributions. Instead of using kernel mean embeddings or generalized radial basis kernels, we introduce embeddings based on dissimilarity of distributions to some reference distributions denoted as templates. Our framework exte…
Researchers develop a method to generate diffusion-based samples from a tilted distribution.
problem Generating samples from a distribution that has been tilted by a parameter.
method Developed a plug-in estimator and proved Wasserstein bounds and TV-accuracy under certain conditions.
result The method is minimax-optimal and can be applied in various domains like finance and climate modeling.
New RL algorithm minimizes distributional learning error.
problem Improving distributional reinforcement learning for better error minimization.
method Proposes a new model-based algorithm with theoretical minimax optimality.
result Proves minimax optimality for approximating return distributions.
This paper improves reinforcement learning by estimating return distributions using quantiles.
problem Improving reinforcement learning by estimating return distributions.
method The paper uses quantile-based distributional reinforcement learning to characterize return distributions.
result The quantile-based approach achieves optimal sample efficiency and asymptotic efficiency.
Domain adaptation is essential to enable wide usage of deep learning based networks trained using large labeled datasets. Adversarial learning based techniques have shown their utility towards solving this problem using a discriminator that ensures source and target distributions are close. However, here we suggest tha…
UDJ-FL framework achieves multiple distributive justice-based fairness metrics in federated learning.
problem Ensuring fairness in federated learning across different client data distributions.
method UDJ-FL framework uses aleatoric uncertainty-based client weighing and fair resource allocation techniques.
result UDJ-FL achieves egalitarian, utilitarian, Rawls' difference principle, and desert-based fairness metrics.
Best-of-N sampling reveals reward targets from preference data, influencing N and base distribution choices.
problem Understanding reward extraction from Best-of-N preference data and optimal N and base distribution choices.
method Specialized analysis of preference data via induced conditional distribution, deriving reward targets and design principles.
result Reward targets are explicit functions of N and base distribution, and bounded-class minimizers approach these targets as N grows.
A new clustering method for functional data using skewed distributions.
problem Clustering functional data with skewed distributions.
method Mixtures of functional linear regression models and three skewed multivariate distributions (variance-gamma, skew-t, normal-inverse Gaussian).
result The proposed method funWeightClustSkew performs well on simulated and real data.
New aggregation methods improve robustness and efficiency in distributed learning.
problem Outliers and malicious agents compromise traditional averaging in distributed learning.
method Developed statistically efficient and robust aggregation schemes based on median and trimmed mean variations.
result Achieved higher sample efficiency compared to traditional robust aggregation schemes.
Distributional reinforcement learning (DRL) is a recent reinforcement learning framework whose success has been supported by various empirical studies. It relies on the key idea of replacing the expected return with the return distribution, which captures the intrinsic randomness of the long term rewards. Most of the e…
AIS uses a suboptimal extended target distribution, which this paper improves using SGM.
problem Improving the efficiency of Annealed Importance Sampling for marginal likelihood estimation.
method Leveraging score-based generative modeling to approximate the optimal extended target distribution.
result Demonstrated novel, differentiable AIS procedures on synthetic and real-world data.
A new method for averaging probability distributions based on optimal weak mass transport.
problem Averaging probability distributions in a geometric way.
method Weak barycenters based on optimal weak mass transport.
result Extracts common geometric information shared by all input distributions.
A new method for aligning multiple distributions efficiently.
problem Aligning multiple distributions in a shared latent space.
method Iterative alignment of variational approximations of distribution divergences using invertible alignment maps.
result Our method achieves competitive distribution alignment at low computational cost.
Develops a neural framework for probabilistic forecasting of dynamical systems.
problem Uncertainty quantification in dynamical systems using trajectory-oriented approaches.
method D2D neural probabilistic forecasting framework using kernel mean embeddings and mixture density networks.
result The D2D model captures distributional evolution in chaotic systems and produces skillful probabilistic forecasts.
Paper proposes a distributed sampling method for Bayesian inference.
problem Privacy and communication constraints in spatially distributed datasets.
method Alternating Direction Method of Multipliers for distributed sampling.
result Algorithm converges to target distribution in Wasserstein distance.
We propose a new blind source separation algorithm based on mixtures of alpha-stable distributions. Complex symmetric alpha-stable distributions have been recently showed to better model audio signals in the time-frequency domain than classical Gaussian distributions thanks to their larger dynamic range. However, infer…
A new Wasserstein K-means method for clustering probability distributions.
problem Clustering probability distributions using the Wasserstein metric.
method Distance-based K-means with SDP relaxation for Wasserstein barycenters. result Distance-based K-means outperforms centroid-based K-means for clustering probability distributions. Transformers show better in-context learning resilience under distribution shifts than simple MLPs.
problem Understanding in-context learning under varying distribution shifts.
method Comparing transformers and set-based MLPs on linear regression tasks.
result Transformers better emulate OLS performance and exhibit better resilience to mild distribution shifts.
New adversarial attack method based on deep feature distributions.
problem Adversarial attacks on CNN classifiers using output layer information.
method Modeling and exploiting class-wise and layer-wise deep feature distributions.
result Achieves state-of-the-art transfer-based attack results for undefended ImageNet models.
A new framework for measuring uncertainty in machine learning models.
problem Uncertainty measures for second-order distributions in machine learning models have theoretical flaws.
method Formal criteria and a general framework based on the Wasserstein distance.
result The Wasserstein distance-based measure satisfies all proposed criteria for meaningful uncertainty measures.
Unified framework for global and local two-sample conditional distribution testing.
problem Testing equality of two conditional distributions.
method Distance and kernel methods, conditional U-statistics, local bootstrap.
result Developed reliable global and local tests.