A simple method for estimating PMF on large supports, preserving structure and suppressing noise.
problem Nonparametric estimation of multi-modal, heavy-tailed PMF on large discrete support.
method Data-dependent low-pass filtering on a line graph Laplacian.
result Smooth, multi-modal estimate of PMF that preserves coarse structure and suppresses noise.
Estimating the joint probability mass function (PMF) of a set of random variables lies at the heart of statistical learning and signal processing. Without structural assumptions, such as modeling the variables as a Markov chain, tree, or other graphical model, joint PMF estimation is often considered mission impossible…
This paper presents a Bayesian method for estimating the rank of a low-rank tensor model of joint PMF.
problem Estimating the rank of a low-rank tensor model of joint PMF from observed data.
method Bayesian framework for estimating low-rank components and rank simultaneously, using variational inference.
result Automatic rank detection and improved estimation accuracy compared to cross-validation methods.
There has recently been considerable interest in completing a low-rank matrix or tensor given only a small fraction (or few linear combinations) of its entries. Related approaches have found considerable success in the area of recommender systems, under machine learning. From a statistical estimation point of view, the…
Estimates joint probability distribution from 1-way marginals using low-rank tensors and random projections.
problem Nonparametric estimation of joint probability mass function (PMF) from limited data.
method Low-rank tensor decomposition and random projections to link data to PMF estimation.
result Estimates joint density from 1-way marginals using transformed space and novel algorithm.
This work proposes a new method to estimate joint probability from pairwise marginals, reducing sample complexity.
problem Direct nonparametric estimation of high-dimensional joint probability is infeasible due to the curse of dimensionality.
method Developed a coupled nonnegative matrix factorization (CNMF) framework using only pairwise marginals.
result The method provably recovers the joint probability mass function up to bounded error in finite iterations under reasonable conditions.
Kaimanovich and Masur showed that a random walk on the mapping class group for an initial distribution with finite first moment and whose support generates a non-elementary subgroup, converges almost surely to a point in the space PMF of projective measured foliations on the surface. This defines a harmonic measure on …
Previous work on recommender systems mainly focus on fitting the ratings provided by users. However, the response patterns, i.e., some items are rated while others not, are generally ignored. We argue that failing to observe such response patterns can lead to biased parameter estimation and sub-optimal model performanc…
CG-BGs combine flow-based models with PMFs to sample large systems efficiently.
problem Sampling equilibrium molecular configurations from the Boltzmann distribution is challenging.
method Coarse-grained Boltzmann Generators (CG-BGs) use flow-based models and learned PMFs for efficient sampling.
result CG-BGs provide a practical route for sampling larger molecular systems efficiently.
Exact simulation of correlated binary outcomes using PMF constraints and linear programming.
problem Simulating dependent Bernoulli outcomes with specific means and correlations.
method Formulate the problem over the joint Bernoulli PMF, impose constraints, and solve as a linear program. Use convex-hull characterization and truncated-moment completion scheme for feasibility and simulation.
result Exact simulation framework for correlated binary outcomes, providing a convex-hull characterization and truncated-moment completion scheme.
This project compares MCMC and VI for Bayesian PMF on MovieLens.
problem Intractable posterior distribution in PMF.
method Employed MCMC and VI for Bayesian inference on MovieLens.
result VI converges faster, MCMC provides more accurate estimates.
Probabilistic matrix factorization (PMF) is a powerful method for modeling data associated with pairwise relationships, finding use in collaborative filtering, computational biology, and document analysis, among other areas. In many domains, there is additional information that can assist in prediction. For example, wh…
Probabilistic matrix factorization (PMF) is a powerful method for modeling data associ- ated with pairwise relationships, Finding use in collaborative Filtering, computational bi- ology, and document analysis, among other areas. In many domains, there are additional covariates that can assist in prediction. For example…
A method for predicting survival using neural networks for both continuous and discrete time.
problem Survival prediction for both continuous and discrete time data.
method Proposes a scheme for discretizing continuous-time data and two interpolation schemes for continuous-time survival estimates.
result The hazard rate parametrization of neural networks yields better performance than the parametrization of the probability mass function.
Recommender systems recommend items more accurately by analyzing users' potential interest on different brands' items. In conjunction with users' rating similarity, the presence of users' implicit feedbacks like clicking items, viewing items specifications, watching videos etc. have been proved to be helpful for learni…
Develops probabilistic models for gene regulatory network inference.
problem Challenges in reconstructing gene regulatory networks from genome-wide data.
method Two complementary frameworks: PMF-GRN and GLM-Prior.
result Probabilistic inference refines regulatory estimates with quantified uncertainty.
We propose a novel exponentially-modified Gaussian (EMG) mixture residual model. The EMG mixture is well suited to model residuals that are contaminated by a distribution with positive support. This is in contrast to commonly used robust residual models, like the Huber loss or ℓ1, which assume a symmetric contami…
We construct a Teichmuller geodesic which does not have a limit on the Thurston boundary of the Teichmuller space.
Paper proves non-arithmetic Teichmüller length spectra for subgroup of mapping class groups.
problem Proving non-arithmetic Teichmüller length spectra for subgroups of mapping class groups.
method Introducing cross-ratios on Teichmüller and projectable mapping classes, studying their geometric and dynamical properties.
result Every non-elementary subgroup of the mapping class group has non-arithmetic Teichmüller length spectrum.
New method selects features via tensor decomposition and submodular optimization.
problem Feature selection for high-dimensional data.
method Low-rank tensor model, submodular optimization, greedy algorithm.
result Proposed method outperforms state-of-the-art feature selection.
We consider the limit set in Thurston's compactification PMF of Teichmueller space of some Teichmueller geodesics defined by quadratic differentials with minimal but not uniquely ergodic vertical foliations. We show that a) there are quadratic differentials so that the limit set of the geodesic is a unique point, b) th…
For a convex cocompact subgroup G<Mod(S), and points x,y∈Teich(S) we obtain asymptotic formulas as R→∞ of ∣BR(x)∩Gy∣ as well as the number of conjugacy classes of pseudo-Anosov elements in G of dilatation at most R. We do this by developing an analogue of Patterson-Sullivan theory for the…
PRZI traders adapt their quote-prices based on a strategy parameter s, affecting market dynamics.
problem Understanding the dynamics of continuous double auction markets with adaptive traders.
method Introduced a new zero-intelligence trader PRZI that uses a parameterised probability distribution to generate quote-prices. Used a stochastic hill-climber algorithm to adapt strategies based on market conditions.
result The co-evolutionary dynamics of PRZI traders can lead to rich and complex market behaviors, including periods of stability and change.
Rare Teichmüller disks converge to small limit sets.
problem Understanding limit sets of Teichmüller disks.
method Analyzing Thurston boundary of Teichmüller space.
result Teichmüller disks with smallest limit sets are exceptional.
Introduce a thermodynamically informed, temperature-transferable MLCG framework for proteins.
problem Temperature transferability of MLCG models for proteins.
method Explicit decomposition of CG potential into energetic and entropic components.
result Reproduces temperature-dependent quantities like heat capacity.
Matrix factorization (MF) has become a common approach to collaborative filtering, due to ease of implementation and scalability to large data sets. Two existing drawbacks of the basic model is that it does not incorporate side information on either users or items, and assumes a common variance for all users. We extend…
Polytopic Matrix Factorization models data as latent vectors from a polytope, maximizing determinant for identifiability.
problem Data decomposition with semi-structured latent vectors and polytope constraints.
method Model input data as latent vectors from a polytope, using determinant maximization for identifiability.
result Identifiability condition for polytopes with specific symmetry restrictions.
Paper shows ergodicity and irreducibility of mapping class group boundary representation.
problem Ergodicity and irreducibility of mapping class group boundary representation.
method Statistical hyperbolicity and classical result of Masur generalization.
result Boundary representation of mapping class group is ergodic and irreducible.
Study of spacetime dynamics in 2+1 gravity leads to Thurston boundary.
problem Understanding spacetime dynamics in 2+1 gravity.
method Analysis of solution curves, Teichmüller space, Dirichlet energy, harmonic maps.
result Solution curves approach Thurston boundary at big bang limit.
Each training step for a variational autoencoder (VAE) requires us to sample from the approximate posterior, so we usually choose simple (e.g. factorised) approximate posteriors in which sampling is an efficient computation that fully exploits GPU parallelism. However, such simple approximate posteriors are often insuf…
Graph convolutional neural networks (GCNNs) have been attracting increasing research attention due to its great potential in inference over graph structures. However, insufficient effort has been devoted to the aggregation methods between different convolution graph layers. In this paper, we introduce a graph attribute…
This work tackles multivariate CDFs and copulas using tensor factorization.
problem Learning multivariate distributions, especially for mixed random variables, is challenging.
method Introducing a low-rank model for efficient sampling, inference, and uncertainty quantification.
result The proposed model outperforms traditional methods in various applications.
In this paper, we investigate the common scenario where every candidate item for recommendation is characterized by a maximum capacity, i.e., number of seats in a Point-of-Interest (POI) or size of an item's inventory. Despite the prevalence of the task of recommending items under capacity constraints in a variety of s…
I propose a frequency domain adaptation of the Expectation Maximization (EM) algorithm to group a family of time series in classes of similar dynamic structure. It does this by viewing the magnitude of the discrete Fourier transform (DFT) of each signal (or power spectrum) as a probability density/mass function (pdf/pm…
Study analyzes Airbnb lead-time distributions for Nights Booked and Gross Booking Value, finding divergent shapes and tail behavior.
problem Analyzing lead-time distributions for Airbnb demand metrics.
method Compositional analysis of daily lead-time vectors, fitting Gamma, Weibull, and Lognormal distributions, using generalized Pareto for tail inference.
result Lead-time distributions for Nights Booked and Gross Booking Value diverge, with GBV concentrating more in mid-range horizons.
While the Matrix Generalized Inverse Gaussian (MGIG) distribution arises naturally in some settings as a distribution over symmetric positive semi-definite matrices, certain key properties of the distribution and effective ways of sampling from the distribution have not been carefully studied. In this paper…
Transforms uniform learners to work under arbitrary distributions efficiently.
problem Learning under arbitrary distributions from uniform learners.
method Black-box transformation using decision tree decomposition.
result Efficient transformation with runtime scaling with distribution complexity.
Improved SVI with adjustable annealing for better optimization.
problem Improving optimization in stochastic variational inference.
method Tuneable stochastic annealing in SVI with adjustable batch size.
result Approximation to maximum entropy stochastic gradient at desired variance level.
Study recovers tree structure in noisy MRFs with support size 3 or more.
problem Learning tree-structured MRFs with symmetric noise.
method Characterized recoverability based on joint PMF, provided algorithm for recovery.
result Structure of leaf clusters can be partially or fully identifiable.
New estimators outperform maximum likelihood without hyper-parameter estimation.
problem Improving system identification performance without hyper-parameter estimation.
method Developed generalized Bayes and closed-form biased estimators using excess MSE.
result New estimators have comparable performance to empirical-Bayes-based regularized estimator.
New estimator reduces kernel mean estimation error.
problem Kernel mean estimation in reproducing kernel Hilbert spaces.
method Corrupt data with known distributions and estimate kernel mean under the corrupted distribution.
result The marginalized kernel mean estimator achieves lower estimation error.
Dual Bayesian Affine Estimators for Wiener-type state-space models
problem Estimating parameters in Wiener-type state-space models
method Fixed-point architecture combining two affine estimators
result Dual basis-parameter estimator achieves comparable parameter MSE to purely affine estimator
Enhances gradient estimates for Hermitian Monge-Ampère equations.
problem Improving estimates for Hermitian Monge-Ampère equations.
method Improves gradient estimates using Evans-Krylov and third derivatives estimates.
result Enhanced estimates for second and third order derivatives.
Paper proposes robust estimators for GANs under Wasserstein contamination.
problem Robust estimation of distributions under contamination.
method Wasserstein GAN-based estimators for location, covariance, and regression.
result Proposed estimators are minimax optimal in many scenarios.
New framework converts offline to online estimation using black-box offline estimators.
problem Convert offline estimation algorithms to online estimation algorithms.
method Oracle-Efficient Online Estimation (OEOE) framework.
result Achieves near-optimal online estimation error via black-box offline estimators.
Proposes variational autoencoder for efficient MMSE estimation.
problem Efficient parameterized MMSE estimation for noisy observations.
method Variational autoencoder models data distribution, approximates MMSE.
result Proposed estimator performs well compared to state-of-the-art.
Paper improves Fisher information estimation methods.
problem Estimating Fisher information for location parameters.
method Revisits and improves Bhattacharya estimator, introduces clipped estimator.
result Clipped estimator shows superior convergence rates in Gaussian noise.
Proposes a robust estimator for RD designs.
problem Estimating treatment effects in RD designs.
method Doubly robust estimator combining two estimators.
result Enhances robustness of treatment effect estimators.