Max-Entropy approach improves variational inference for complex posterior distributions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Maximum entropy distributions with discrete support in dimensions arise in machine learning, statistics, information theory, and theoretical computer science. While structural and computational properties of max-entropy distributions have been extensively studied, basic questions such as: Do max-entropy distributio…
The paper analyzes RLHF with human feedback and provides convergence results for MLE and pessimistic MLE.
New method reduces false positives in weakly supervised pixel-level localization.
New method defends against neural backdoors using generative modeling.
In this paper, we present a novel and general framework called {\it Maximum Entropy Discrimination Markov Networks} (MaxEnDNet), which integrates the max-margin structured learning and Bayesian-style estimation and combines and extends their merits. Major innovations of this model include: 1) It generalizes the extant …
EBIL simplifies IL by estimating expert energy as reward, achieving effective performance.
New algorithms speed up inverse reinforcement learning by solving MDPs once.
We define On-Average KL-Privacy and present its properties and connections to differential privacy, generalization and information-theoretic quantities including max-information and mutual information. The new definition significantly weakens differential privacy, while preserving its minimalistic design features such …
Max entropy exploration guides reinforcement learning agents to pursue achievable goals.
The rising volume of datasets has made training machine learning (ML) models a major computational cost in the enterprise. Given the iterative nature of model and parameter tuning, many analysts use a small sample of their entire data during their initial stage of analysis to make quick decisions (e.g., what features o…
Attention to entropic communication improves message decoding and cooperation.