Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

0111 · Jan 200919922001200920172026
12 results for max-entropy

Maximum entropy distributions with discrete support in mm dimensions arise in machine learning, statistics, information theory, and theoretical computer science. While structural and computational properties of max-entropy distributions have been extensively studied, basic questions such as: Do max-entropy distributio…

2017-11-06abs ↗pdf ↗

The paper analyzes RLHF with human feedback and provides convergence results for MLE and pessimistic MLE.

problem Improving RLHF with human feedback from pairwise or KK-wise comparisons.
method Theoretical framework for RLHF with convergence analysis of MLE and pessimistic MLE.
result MLE fails but pessimistic MLE provides improved policies under certain coverage assumptions.

New method reduces false positives in weakly supervised pixel-level localization.

problem Reduces false positives in weakly supervised pixel-level localization.
method Proposes a deep learning method using conditional entropy to constrain the localizer.
result Significant improvements in image-level classification and pixel-level localization.

New method defends against neural backdoors using generative modeling.

problem Neural backdoor attacks pose a significant security threat to deep learning models.
method Proposes max-entropy staircase approximator (MESA) for high-dimensional sampling-free generative modeling of backdoor trigger distributions.
result Demonstrates the effectiveness of MESA in modeling backdoor trigger distributions and robustness of the proposed defense method.

In this paper, we present a novel and general framework called {\it Maximum Entropy Discrimination Markov Networks} (MaxEnDNet), which integrates the max-margin structured learning and Bayesian-style estimation and combines and extends their merits. Major innovations of this model include: 1) It generalizes the extant …

2009-01-18abs ↗pdf ↗

EBIL simplifies IL by estimating expert energy as reward, achieving effective performance.

problem Recovering optimal policy from expert demonstrations without reward signals.
method EBIL uses a two-stage solution: first estimating expert energy as reward, then learning policy.
result EBIL achieves effective performance and interpretable reward signals.

Max entropy exploration guides reinforcement learning agents to pursue achievable goals.

problem Achieving distant test-time goals in long-horizon tasks.
method Optimize entropy of historical achieved goals by focusing on sparsely explored areas.
result Order of magnitude better sample efficiency on long-horizon multi-goal tasks.