New method upsamples sparse, non-uniform point clouds more accurately.
problem Suboptimal results from existing point cloud upsampling methods.
method Imposes manifold distribution constraints using Gaussian functions.
result Generates higher-quality, more uniformly distributed dense point clouds.
Transforms uniform learners to work under arbitrary distributions efficiently.
problem Learning under arbitrary distributions from uniform learners.
method Black-box transformation using decision tree decomposition.
result Efficient transformation with runtime scaling with distribution complexity.
Efficiently learns uniform state distributions in unknown MDPs.
problem Learning uniform state distributions in unknown MDPs without rewards.
method Uses conditional gradient method with approximate MDP solver.
result Provable efficiency in sample and computational complexities.
A new method for efficient exploration in reinforcement learning.
problem Improving exploration in reinforcement learning agents.
method State Marginal Matching (SMM) to learn policies matching a target state distribution.
result Agents that optimize SMM explore faster and adapt quicker to new tasks.
Energy-efficient sampling for machine learning using magnetic tunnel junctions.
problem Costly and inefficient random sampling in machine learning.
method Energy-efficient algorithm using stochastic magnetic tunnel junctions for uniform Float16 sampling.
result Higher energy efficiency than state-of-the-art algorithms, with a minimum factor of 9721.
We study here numerically the behavior of an ideal gas like model of markets having only one non-consumable commodity. We investigate the behavior of the steady-state distributions of money, commodity and total wealth, as the dynamics of trading or exchange of money and commodity proceeds, with local (in time) fluctuat…
This work improves policy optimization by maximizing entropy of state distribution, leading to better exploration.
problem Lack of exploration in state space when maximizing policy entropy.
method Proposes maximizing the entropy of a lower bound approximation to the state weighting distribution, based on latent space representation.
result Entropy regularization based on marginal state distribution achieves superior state space coverage and better performance in various domains.
Random matrix ensembles yield uniform distributions on manifolds.
problem Understanding distributions of vectors in random matrix ensembles.
method Analyzing eigenvalues, singular values, and Autonne-Takagi vectors of various random matrix ensembles.
result Uniform distributions on specific manifolds for different types of random matrix ensembles.
New bounds for agnostic learning with average smoothness.
problem Distribution-free nonparametric regression with average smoothness.
method Distribution-free uniform convergence bounds and agnostic learning algorithm.
result Distribution-free uniform convergence bounds for average-smoothness classes in the agnostic setting.
New material groupoid theory subdivides non-uniform bodies into smoothly uniform parts and isolated points.
problem Lack of differentiability in material bodies leads to non-uniformity.
method Introducing material groupoid and material distribution to study non-uniform bodies rigorously.
result Material bodies can be subdivided into smoothly uniform parts and isolated points.
Uniform AMMs control loss in prediction markets.
problem Controlling loss in prediction markets.
method Loss-versus-rebalancing (LVR) framework and uniform AMMs.
result Uniform AMMs achieve proportional LVR to pool value.
Uniform AMMs control loss in prediction markets.
problem Controlling loss in prediction markets.
method Loss-versus-rebalancing (LVR) framework and uniform AMMs.
result Uniform AMMs achieve proportional LVR to pool value.
New methods learn sampling distributions for particle filters without supervision.
problem Designing accurate sampling distributions for nonlinear dynamical systems.
method Proposed four unsupervised learning methods for multivariate Gaussian and nonparametric distributions.
result Learned sampling distributions outperform designed ones in accuracy.
New uniformity tester ensures consistent results across different samples.
problem Non-replicable behavior of uniformity testing algorithms.
method Develops a replicable uniformity tester with improved sample complexity.
result Achieves nearly linear dependence on replicability factor ρ. Improved sampling from mean-field stationary distributions.
problem Sampling from the stationary distribution of mean-field SDEs.
method Decoupling the problem into two aspects: approximation of mean-field SDE and sampling from finite-particle distribution.
result Improved guarantees in various settings, including optimizing neural networks.
Discrete diffusion models improve data generation for discrete data like language and graphs.
problem Adapting diffusion models to discrete state spaces for better data generation.
method Formulated as CTMCs, used uniformization of continuous Markov chains for sampling.
result Derive guarantees for sampling from any distribution on a hypercube, aligning with state-of-the-art achievements.
New method for inferring Markov chains from large state spaces, applied to epidemic models.
problem Challenging to compute matrix exponentials and derivatives for large state spaces.
method Differentiated uniformization method for continuous-time Markov chains.
result Estimation of infection and recovery rates during the first wave of COVID-19 in Austria.
The paper proposes a uniformity regularization scheme to improve deep neural network transferability.
problem Improving deep neural network transferability and adaptation to new tasks.
method Introduces a uniformity regularization scheme to encourage high uniformity in embedding space.
result Uniformity regularization consistently offers benefits over baseline methods and achieves state-of-the-art performance in Deep Metric Learning and Meta-Learning.
The theory of learning under the uniform distribution is rich and deep, with connections to cryptography, computational complexity, and the analysis of boolean functions to name a few areas. This theory however is very limited due to the fact that the uniform distribution and the corresponding Fourier basis are rarely …
The paper tests properties of multiple distributions with limited samples.
problem Testing properties of multiple distributions with few samples.
method Designing testers for uniformity, identity, and closeness testing under specific conditions.
result Sample optimal testers for uniformity, identity, and closeness testing are provided.
Paper proves hardness of learning various complex models under local pseudorandom generators.
problem Hardness of learning various complex models.
method Existence of local pseudorandom generators.
result Proves hardness of learning shallow ReLU neural networks and other models.
We analyze an ideal gas like models of a trading market. We propose a new fit for the money distribution in the fixed or uniform saving market. For the marketwith quenched random saving factors for its agents we show that the steady state income (m) distribution P(m) in the model has a power law tail with Pareto in…
Improved uniform convergence bound with fat-shattering dimension reduces sample complexity gap.
problem Gap between upper and lower bounds on sample complexity for fat-shattering dimension.
method Provided an improved uniform convergence bound.
result Closed the gap between existing upper and lower bounds on sample complexity.
Unified framework for non-uniform materials evolving over time.
problem Dealing with non-uniform materials evolving over time.
method Constructing a material groupoid and material distribution.
result Unified framework for general non-uniform evolution materials.
Enhanced Hopfield model boosts memory retrieval capacity.
problem Memory retrieval in modern Hopfield models with limited capacity.
method Introduces a learnable feature map transforming energy function into kernel space, minimizing separation loss for uniform memory distribution.
result Significant reduction in metastable states, enhancing memory capacity and retrieval accuracy.
Simpler, faster algorithm for uniformity testing in the shuffle model.
problem Testing uniformity of data in the shuffle model with privacy constraints.
method Simplified analysis and use of privacy amplification via shuffling.
result An algorithm with the same guarantees but simpler and more streamlined.
This work proposes a novel approach to learn quantizers from data, improving similarity search performance.
problem Learning optimal quantizers for multi-dimensional data distributions.
method Train a neural net to form a fixed parameter-free quantizer, using uniformity in a spherical latent space as a proxy objective.
result The proposed method outperforms most learned quantization methods and is competitive with state-of-the-art approaches.
The paper explores how language models can provide reliable state measurements without being interpreted as beliefs.
problem How to use language models to reliably infer states without misinterpreting them as beliefs.
method Developed a semantic map and semiparametric inverse to link language probabilities to state probabilities, avoiding hidden models.
result Conditions for existence, identification, stable recovery, and uniform stability of posterior states from observable language probabilities.
New method improves robustness in partially observable domains by training against latent distribution shifts.
problem Challenges in robustness under latent distribution shift in partially observable reinforcement learning.
method Formalizes adversarial latent-initial-state POMDP, proves minimax principle, derives best-response inequalities.
result Reduces robustness gaps from 10.3 to 3.1 shots with targeted exposure to shifted latent distributions.
Develops uniform convergence guarantees for a broad class of risk functionals in supervised learning.
problem Bounding generalization gaps for various risk functionals beyond the expectation.
method Establishes uniform convergence for Hölder risk functionals, providing guarantees for empirical risk minimization.
result First uniform convergence results for estimating the CDF of loss distributions, applicable to various risk functionals.
Proposes a tensor Laplacian-based method for better subspace clustering of non-uniformly distributed data.
problem LRR's inability to handle non-uniform data distribution and local information loss.
method Tensor Laplacian Regularized Low-Rank Representation (TLRR) using hypergraph model and tensor Laplacian algorithm.
result Higher accuracy and precision in subspace clustering compared to state-of-the-art methods.
New findings on PAC learning and marginal distribution estimation.
problem Understanding how PAC learning relates to marginal distribution estimation under distributional constraints.
method Revisited the connection between PAC learning, uniform convergence, and density estimation, considering a known family of marginal distributions.
result PAC learning is sandwiched between two refined models of density estimation, differing only in whether the learner knows the set of well-estimated events in H.
We compute the expected value of the Kullback-Leibler divergence to various fundamental statistical models with respect to canonical priors on the probability simplex. We obtain closed formulas for the expected model approximation errors, depending on the dimension of the models and the cardinalities of their sample sp…
Improved neural network training for speech recognition using power-law nonlinearity and uniform distribution criterion.
problem Stability and uniformity of feature distribution in neural network training.
method Power-function based and histogram-based Maximum Uniformity of Distribution (MUD) algorithms.
result Power-function based MUD outperforms conventional MFCCs in speech recognition systems.
New approach to adversarial robustness with non-uniform perturbations.
problem Real-world adversaries craft adversarial examples with non-uniform perturbations.
method Proposes non-uniform perturbations based on feature dependencies and data distribution.
result Shows improved robustness to real-world attacks compared to uniform perturbations.
New model learns SDEs without gradient matching for non-uniform time increments.
problem Learning non-parametric drift and diffusion functions for SDEs.
method Formulates sensitivity equations for learning and optimizes path distributions.
result Robust and efficient learning of SDE systems with non-uniform time increments.
Uniform consistency proven for spatial distribution and depth estimators in any dimension.
problem Uniform consistency of spatial distribution and depth estimators in arbitrary dimensions.
method Proof of uniform L1-consistency using sample size n as the only dependency. result Consistency rate is independent of dimension d and sample size n. Skew-Fit learns goal distributions for reinforcement learning, enabling state coverage.
problem Learning flexible skills without manual reward design.
method Formal exploration objective for maximizing state coverage, combined with entropy maximization.
result Skew-Fit converges to a uniform state distribution, enabling new skill learning.
UT module refines VAE latent space, improving disentanglement and interpretability.
problem Irregular latent distributions cause posterior collapse and misalignment in VAEs.
method UT module uses G-KDE clustering, GM modeling, and PIT to transform latent space into uniform distribution.
result UT module enhances disentanglement and interpretability of latent representations.
In this work, we study stability of distributed filtering of Markov chains with finite state space, partially observed in conditionally Gaussian noise. We consider a nonlinear filtering scheme over a Distributed Network of Agents (DNA), which relies on the distributed evaluation of the likelihood part of the centralize…
APoT quantization improves neural network efficiency and accuracy.
problem Efficiently quantizing weights and activations in neural networks.
method Constraining quantization levels as sums of Powers-of-Two terms, applying reparameterization, and weight normalization.
result 4-bit quantized ResNet-50 achieves 76.6% top-1 accuracy, 22% computational cost reduction.
UCRL3 improves UCRL2's efficiency in reinforcement learning by reducing exploration.
problem Long burn-in phases in numerical experiments of UCRL2.
method UCRL3 uses state-of-the-art time-uniform concentration inequalities and adaptive support computation to tighten exploration.
result UCRL3 achieves a better numerical improvement over UCRL2 in standard environments.
We study the spherical cap packing problem with a probabilistic approach. Such probabilistic considerations result in an asymptotic sharp universal uniform bound on the maximal inner product between any set of unit vectors and a stochastically independent uniformly distributed unit vector. When the set of unit vectors …
New tester outperforms existing ones in uniformity testing.
problem Improving uniformity testing accuracy in simulations.
method Introducing a Huber loss-based tester.
result Matches the separation of the collisions tester and has Gaussian-like tails.
Study uniform consistency in nonparametric mixture models and mixed regression.
problem Uniform consistency in nonparametric mixture models and mixed regression models.
method Construct uniformly consistent estimators under general conditions, develop novel technical tools.
result Prove uniform consistency results for nonparametric mixtures and mixed regression models.
Study sets limits for detecting a subhypergraph in uniform hypergraphs.
problem Recovering a subhypergraph from a uniform hypergraph with different edge probabilities.
method Information-theoretic analysis for weak and exact recovery.
result Sharp conditions for weak or exact recovery of the subhypergraph.
Concrete distribution properties examined on simplex.
problem Properties of Concrete distribution on simplex.
method Reflection and location-scale transformation of uniform distribution; explicit parameterization to Poincaré half-space.
result Fisher information and information metric are hyperbolic space; Fisher-Rao geodesic distance computed.
New algorithm uniformly samples high-dimensional convex bodies efficiently.
problem Uniform sampling of high-dimensional convex bodies.
method Stochastic diffusion perspective to show contraction to the target distribution.
result Achieves state-of-the-art runtime complexity with strong guarantees on output.