Maximum likelihood estimation fails to be well-posed in Gaussian process regression.
problem Establishing well-posedness of maximum likelihood estimation in Gaussian process regression.
method Analyzing the conditions under which maximum likelihood estimation is not Lipschitz in the data with respect to the Hellinger distance.
result Maximum likelihood estimation is not well-posed in the noiseless data setting for any Gaussian process with a stationary covariance function whose lengthscale parameter is estimated using maximum likelihood.
New maximum score estimators using ReLU functions and deep neural networks.
problem Estimating parameters in models with sign restrictions.
method ReLU-based maximum score criterion and DNN architecture.
result RMS estimator achieves n−s/(2s+1) convergence rate and asymptotic normality. We present a new statistical learning paradigm for Boltzmann machines based on a new inference principle we have proposed: the latent maximum entropy principle (LME). LME is different both from Jaynes maximum entropy principle and from standard maximum likelihood estimation.We demonstrate the LME principle BY deriving …
Paper proposes a new UCB approach for estimating maximum mean.
problem Estimating the maximum mean in various applications.
method Upper Confidence Bound (UCB) approach with adaptive sampling.
result LSA estimator shows faster bias decay compared to GA.
We propose a robust estimator to improve maximum likelihood in probabilistic models.
problem Overfitting and sensitivity to noise in maximum likelihood estimation.
method Distributionally robust maximum likelihood estimator that minimizes worst-case expected log-loss.
result The robust estimator is statistically consistent and performs well in regression and classification tasks.
In this paper we present a proof of a Neumann type maximum principle for the Laplace operator on compact Riemannian manifolds. A key p oint is the simple geometric nature of the constant in the a priori estimate of this maximum principle. In particular, this maximum principle can be applied to manifolds with Ricci curv…
We investigate the accuracy of the two most common estimators for the maximum expected value of a general set of random variables: a generalization of the maximum sample average, and cross validation. No unbiased estimator exists and we show that it is non-trivial to select a good estimator without knowledge about the …
New estimate for complex Monge-Ampère equations improves previous results.
problem Improving estimates for complex Monge-Ampère equations.
method Using the ABP maximum principle to prove a new gradient estimate.
result Proves a new gradient estimate for complex Monge-Ampère equations.
Paper presents a method for estimating Hawkes process parameters.
problem Estimating parameters of Hawkes processes with self-excitation or inhibition.
method Maximum likelihood estimation for Hawkes processes with self-excitation or inhibition.
result The proposed estimator provides more accurate estimations in the inhibition context.
Proposes a new approach to approximate maximum likelihood for complex models.
problem Intractable likelihood functions in complex parametric models.
method Simulation-based constrained approximation to the structural model.
result Estimators nearly as efficient as maximum likelihood, feasible in many cases.
The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sampled data is ubiquitous in science. Many approaches to this problem have been described, but none is yet regarded as providing a definitive solution. Maximum entropy estimation and Bayesian field theory are two such appr…
A new method improves text generation quality and diversity.
problem Exposure bias in Maximum Likelihood Estimation for text generation.
method ψ-MLE, a new training scheme based on density ratio estimation.
result ψ-MLE outperforms Maximum Likelihood Estimation and other models in text generation quality and diversity.
MAXENT method outperforms ML in sparse data with specific prior correlations.
problem Evaluating MAXENT method's validity limits and comparing it with ML.
method Bayesian decision theory, Dirichlet density, KL distance, regularized maximum likelihood.
result MAXENT can outperform ML in sparse data with specific prior correlations.
We improve maximum likelihood for location estimation in finite samples.
problem Estimating a parameter from samples with unknown or varying distribution.
method Use smoothed Fisher information for finite sample size and varying distributions.
result Recover optimal estimation theory for finite n and arbitrary f. We develop a maximum penalized quasi-likelihood estimator for estimating in a nonparametric way the diffusion function of a diffusion process, as an alternative to more traditional kernel-based estimators. After developing a numerical scheme for computing the maximizer of the penalized maximum quasi-likelihood function…
This paper addresses the estimation of parameters of a Bayesian network from incomplete data. The task is usually tackled by running the Expectation-Maximization (EM) algorithm several times in order to obtain a high log-likelihood estimate. We argue that choosing the maximum log-likelihood estimate (as well as the max…
Invertibility conditions for observation-driven time series models often fail to be guaranteed in empirical applications. As a result, the asymptotic theory of maximum likelihood and quasi-maximum likelihood estimators may be compromised. We derive considerably weaker conditions that can be used in practice to ensure t…
Estimates GLMs robustly against label corruptions.
problem Learning GLMs under adversarial label corruptions.
method Iterative trimmed maximum likelihood estimator.
result Achieves minimax near-optimal risk.
We study the connections between spectral clustering and the problems of maximum margin clustering, and estimation of the components of level sets of a density function. Specifically, we obtain bounds on the eigenvectors of graph Laplacian matrices in terms of the between cluster separation, and within cluster connecti…
Investigates numerical issues in GP interpolation parameter estimation.
problem Numerical issues in maximum likelihood parameter estimation for Gaussian process interpolation.
method Investigates and proposes strategies to improve open-source software implementations.
result Improves reliability and reproducibility of studies relying on GP implementations.
A boosting method improves nonparametric density estimation without smoothing assumptions.
problem Overfitting in nonparametric data fitting.
method Introduces a boosting algorithm for univariate nonparametric maximum likelihood estimation.
result Demonstrates the effectiveness of the boosting approach through simulations and real data experiments.
Paper quantifies label shift robustly.
problem Quantifying label shift in datasets.
method Robust estimators of label distribution.
result Maximum Likelihood Estimator is a robust estimator.
Machine learning should incorporate maximum likelihood for better estimation.
problem Lack of rigorous foundational theory in machine learning.
method Integrate maximum likelihood estimation into machine learning models.
result Foundationally rigorous machine learning models have greater practical impact.
Unified plug-in approach for estimating symmetric properties of distributions efficiently.
problem Estimating symmetric properties of distributions with high accuracy and efficiency.
method Profile-maximum-likelihood (PML) based estimator.
result Achieves theoretical limit for universal symmetric property estimation.
New approach resolves ambiguity in PPCA model's maximum likelihood estimation.
problem Ambiguity in maximum likelihood estimation of PPCA model due to rotational symmetry.
method Using quotient topological spaces, the approach resolves ambiguity and shows consistency of the maximum likelihood solution.
result Maximum likelihood solution is consistent in an appropriate quotient Euclidean space.
Bayesian approach improves ODE solution accuracy.
problem Improving numerical solutions of ordinary differential equations.
method Bayesian inference with Gaussian filtering and smoothing.
result Maximum a posteriori estimate converges to true solution at polynomial rate.
We consider two connected aspects of maximum likelihood estimation of the parameter for high-dimensional discrete graphical models: the existence of the maximum likelihood estimate (mle) and its computation. When the data is sparse, there are many zeros in the contingency table and the maximum likelihood estimate of th…
Geometric approach solves maximum likelihood for Cauchy-like distributions.
problem Estimating center and scatter robustly from heavy-tailed data.
method Geodesic convexity and symmetry spaces of noncompact type.
result Efficient numerical solution for robust estimates of location and spread.
A new method avoids partition function computation for Gibbs density estimation.
problem Estimating Gibbs density functions without partition function computation.
method Maximum Recovery MAP (MR-MAP) and least-action type potential.
result MR-MAP estimators solve optimization problem quickly using neural network.
Consistent estimator for mixtures of nonparametric elliptical distributions helps cluster analysis.
problem Consistency of maximum likelihood estimator for mixtures of nonparametric elliptical distributions.
method Maximum likelihood estimation for mixtures of elliptically-symmetric distributions under nonparametric P. result Components of the estimator correspond to well-separated components of the underlying distribution P. The EM algorithm is a novel numerical method to obtain maximum likelihood estimates and is often used for practical calculations. However, many of maximum likelihood estimation problems are nonconvex, and it is known that the EM algorithm fails to give the optimal estimate by being trapped by local optima. In order to …
MESSY estimation recovers symbolic density functions from samples using maximum entropy.
problem Estimating probability density functions from limited samples.
method Maximum-Entropy approach with gradient flow and symbolic regression.
result Efficiently finds optimal symbolic expressions for unknown distributions.
Paper proposes a method to estimate true positive proportion without knowing it.
problem Bias in binary classifier performance due to different positive item proportions.
method Maximum likelihood estimator for true proportion of positives.
result Method accurately estimates true positive proportion in data sets.
The maximum likelihood approach is adapted to the problem of estimation of drift and diffusion functions of stochastic processes from measured time series. We reconcile a previously devised iterative procedure [Kleinhans et al., Physics Letters A (346), 2005] and put the application of the method on a firm theoretical …
Efficiently estimates GEV distribution parameters using neural networks.
problem Computational intensity of maximum likelihood estimation for GEV distribution.
method Neural network-based likelihood-free estimation method.
result Comparable accuracy to maximum likelihood method with significant speedup.
Study uniform rates for estimating Gaussian mixtures without separation assumption.
problem Estimating parameters in two-component Gaussian mixtures without separation.
method Uniform convergence rates derived using minimax lower bounds and careful analysis of polynomial equalities.
result Phase transition in optimal estimation rate based on mixture balance.
New estimators improve efficiency in two-phase designs with coarsened data.
problem Efficient estimation in two-phase designs with incomplete data.
method Developed new estimators within the TMLE framework.
result New estimators are asymptotically equivalent and more efficient.
New proof of Kähler-Einstein Fano manifold L∞ estimates.
problem Uniform L∞ estimates for Kähler-Ricci flow on Kähler-Einstein Fano manifolds. method Using Chen-Cheng's auxiliary Monge-Ampère equation and the Alexandrov-Bakelman-Pucci maximum principle, without pluripotential theory.
result Uniform L∞ estimates derived for Kähler-Ricci flow on Kähler-Einstein Fano manifolds. Improved MMD estimator for likelihood-free inference.
problem Computational challenges in estimating MMD for likelihood-free inference.
method Optimally-weighted MMD estimator with improved sample complexity.
result Significantly improved sample complexity for accurate MMD estimation.
New estimators outperform maximum likelihood without hyper-parameter estimation.
problem Improving system identification performance without hyper-parameter estimation.
method Developed generalized Bayes and closed-form biased estimators using excess MSE.
result New estimators have comparable performance to empirical-Bayes-based regularized estimator.
Corrects pseudo log-likelihood method issues in various applications.
problem Log-likelihood function unbounded issues in pseudo log-likelihood methods.
method Provided a counterexample and corrected algorithms in previous literature.
result Ensured well-definedness of maximum pseudo log-likelihood estimation.
New method for efficient maximum likelihood estimation of p-generalized probit regression.
problem Efficient estimation of p-generalized probit regression models. method Combining sketching techniques with importance subsampling to obtain a coreset.
result Maximum likelihood estimator can be approximated efficiently up to a factor of (1+ε) on large data. We propose a new method for estimating the intrinsic dimension of a dataset by applying the principle of regularized maximum likelihood to the distances between close neighbors. We propose a regularization scheme which is motivated by divergence minimization principles. We derive the estimator by a Poisson process appr…
New method estimates Schrödinger bridges using ML techniques.
problem Finding most likely stochastic evolution between two distributions.
method Equivalence with maximum likelihood estimation, numerical Gaussian process approach.
result Direct application of ML techniques for SBP estimation.
New estimator for tensor weights with improved bias.
problem Estimating tensor weights from noisy data.
method Random matrix theory and KKT conditions.
result Asymptotically unbiased estimator for tensor rank.
Paper proposes a simple estimator for DPP correlation kernels.
problem Estimating the correlation kernel matrix of DPPs.
method Closed-form estimator for correlation kernel, easy to implement.
result Consistency and asymptotic normality of the estimator proved.
New particle algorithms optimize latent variable models.
problem Optimizing latent variable models for maximum likelihood estimation.
method Identify gradient flows associated with free energy functional and discretize them to create particle-based algorithms.
result Novel particle algorithms scale to high-dimensional settings and perform well in experiments.
Note establishes a local maximum principle for Ricci flow under curvature conditions.
problem Preserving nonnegativity of curvature along Ricci flow with unbounded curvature.
method Combining scaling invariant curvature condition with Dirichlet heat kernel estimates.
result Unified and more direct proof of localized maximum principle.