Best-of-Majority improves inference performance in Pass@ settings.
problem Inference in difficult tasks often underperforms with single-shot selection methods.
method Combining majority voting and Best-of-N, Best-of-Majority restricts candidates to high-frequency responses.
result Best-of-Majority achieves minimax optimal regret and outperforms other methods.