Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

131262392523 · May 202619922001200920172026
48 results for EM framework

New framework improves EM algorithm convergence under log-Sobolev inequality.

problem Improving convergence of the EM algorithm.
method Extending gradient flow techniques to EM algorithm, using free energy representation.
result Exponential convergence of EM algorithm under log-Sobolev inequality.

DeepPPMNet forecasts EMS demand and performs causal analyses for policy-making.

problem Accurate prediction and causal analysis of EMS demand for effective policy-making.
method DeepPPMNet, a LSTM-based framework, globally forecasts and analyzes causal relationships using Granger causality.
result DeepPPMNet outperforms traditional methods in forecasting EMS demand and policy-making.

Paper introduces deterministic EM approximations for non-convex likelihood functions.

problem Deterministic approximations for the E-step of EM algorithm are lacking.
method Developed a theoretical framework for deterministic approximations, analyzed Riemann sums and tempered EM.
result Proved convergence guarantees for deterministic approximations and new non-trivial temperature profiles.

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for parameter estimation that encompasses both on-line learning, where the model is c…

2013-02-06abs ↗pdf ↗

Expectation maximization (EM) algorithm is to find maximum likelihood solution for models having latent variables. A typical example is Gaussian Mixture Model (GMM) which requires Gaussian assumption, however, natural images are highly non-Gaussian so that GMM cannot be applied to perform clustering task on pixel space…

2018-12-02abs ↗pdf ↗

We consider the problem of inference in a linear regression model in which the relative ordering of the input features and output labels is not known. Such datasets naturally arise from experiments in which the samples are shuffled or permuted during the protocol. In this work, we propose a framework that treats the un…

2018-04-02abs ↗pdf ↗

Develops a high-dimensional differentially-private EM algorithm with near-optimal statistical guarantees.

problem Designing differentially-private EM algorithms for high-dimensional latent variable models.
method Noisy iterative hard-thresholding, statistical guarantees, near-optimal convergence rates.
result Near-optimal statistical guarantees and minimax rate optimality in high-dimensional settings.

As an automatic method of determining model complexity using the training data alone, Bayesian linear regression provides us a principled way to select hyperparameters. But one often needs approximation inference if distribution assumption is beyond Gaussian distribution. In this paper, we propose a Bayesian linear reg…

2016-04-15abs ↗pdf ↗

Constructing of molecular structural models from Cryo-Electron Microscopy (Cryo-EM) density volumes is the critical last step of structure determination by Cryo-EM technologies. Methods have evolved from manual construction by structural biologists to perform 6D translation-rotation searching, which is extremely comput…

2019-01-03abs ↗pdf ↗

A new EM framework for goal-conditioned RL improves performance on sparse reward tasks.

problem Handling sparse rewards in goal-conditioned reinforcement learning.
method A graphical model framework with an EM algorithm that includes a learning-in-hindsight E-step and a supervised M-step.
result hEM significantly outperforms model-free baselines on goal-conditioned benchmarks with sparse rewards.

Paper analyzes EM algorithm's trajectory in 2MLR, revealing cycloid behavior.

problem Understanding the convergence and trajectory of EM algorithm in 2MLR.
method Explicit closed-form expressions for EM updates, recurrence relation derivation at population level.
result EM iterations lie on a cycloid trajectory, leading to theoretical estimate of convergence exponent.

Proposes new methods for Markov chain choice models with panel data.

problem Dependence among transactions for the same customer in historical data.
method Expectation-maximization (EM) algorithms incorporating partial-ordering preference information.
result EM algorithms outperform traditional methods on synthetic and real datasets.

In the classical Lagrangian approach to conservation laws of gauge-natural field theories a suitable (vector) density is known to generate the so--called {\em conserved Noether currents}. It turns out that along any section of the relevant gauge--natural bundle this density is the divergence of a skew--symmetric (tenso…

2003-11-19abs ↗pdf ↗

Cryo-EM reconstruction is reformulated as a stochastic inverse problem to handle structural heterogeneity.

problem Handling structural heterogeneity in cryo-EM 3D reconstruction.
method Formulated as a stochastic inverse problem over probability measures, using variational discrepancy and Wasserstein gradient flow.
result Validated approach using synthetic examples, demonstrating recovery of continuous structural distributions.

Gradient EM converges exponentially to optimal solution in agnostic mixtures.

problem Fitting kk parametric functions to given data points without a generative model.
method Gradient EM algorithm for agnostic mixtures of arbitrary parametric functions.
result Gradient EM converges exponentially to population loss minimizers with high probability.

Marginal MAP problems are notoriously difficult tasks for graphical models. We derive a general variational framework for solving marginal MAP problems, in which we apply analogues of the Bethe, tree-reweighted, and mean field approximations. We then derive a "mixed" message passing algorithm and a convergent alternati…

2012-02-14abs ↗pdf ↗

Optimizing distributed learning systems is an art of balancing between computation and communication. There have been two lines of research that try to deal with slower networks: {\em communication compression} for low bandwidth networks, and {\em decentralization} for high latency networks. In this paper, We explore a…

2018-03-17abs ↗pdf ↗

Gradient-EM Bayesian meta-learning accelerates adaptation with reduced computation and improved robustness.

problem Efficient and robust adaptation to new tasks with uncertainty assessment.
method Extends Bayesian meta-learning with gradient-EM algorithm, decoupling inner-update from meta-update.
result Improves accuracy with less computation cost and enhanced robustness to uncertainty.

New accelerators for EM improve convergence speed in complex mixture models.

problem Improving the convergence speed of the EM algorithm for complex mixture models.
method Derive a new operator connecting global descent and local convergence, and use it to develop two acceleration strategies.
result Two new acceleration strategies (G-Accelerator and Geo-Adaptive) significantly improve EM algorithm performance.

This paper uses dynamical systems to analyze and ensure convergence of the Bayesian EM algorithm.

problem Ensuring convergence of the Bayesian EM algorithm in incomplete-data scenarios.
method Applying Lyapunov stability theory to discrete-time dynamical systems.
result Conditions for convergence and potential for fast convergence of MAP-EM are established.

FIEM accelerates EM for large datasets with nonasymptotic convergence bounds.

problem Efficiently optimizing large datasets using EM framework.
method FIEM recasts EM in Stochastic Approximation framework and provides nonasymptotic convergence bounds.
result Nonasymptotic bounds for convergence in expectation as a function of nn and $\kmax$.

New saliency evaluations focus on completeness and soundness, improving explanations.

problem Current saliency evaluations focus on completeness but ignore soundness.
method Introduces new intrinsic evaluation metrics based on completeness and soundness.
result Simple saliency method matches or outperforms prior methods in new evaluations.

This paper proposes an EM approach to reduce inference latency in NAR sequence generation.

problem High inference latency in NAR models due to multi-modality in sequence generation.
method A unified EM framework that jointly optimizes AR and NAR models, with iterative refinement.
result The proposed approach achieves competitive performance with existing NAR models and significantly reduces inference latency.

New EM algorithm for mixtures of elliptical distributions handles missing data and outliers.

problem Missing data imputation for noisy and non-Gaussian data.
method Investigation of a new EM algorithm for mixtures of elliptical distributions.
result The proposed algorithm is robust to outliers and competitive with other methods.

In classical Hawkes process, the baseline intensity and triggering kernel are assumed to be a constant and parametric function respectively, which limits the model flexibility. To generalize it, we present a fully Bayesian nonparametric model, namely Gaussian process modulated Hawkes process and propose an EM-variation…

2019-05-29abs ↗pdf ↗

DM framework improves robustness and efficiency in latent-mixture models.

problem Efficient and robust inference in latent-mixture models.
method Divergence-minimization framework with monotonic convergence and robustness guarantees.
result DM yields consistent and asymptotically normal estimators under correct specification.