Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3773110146 · May 202619922001200920172026
48 results for feedback alignment

PILAF optimizes reward models from human feedback for better policy alignment.

problem Creating accurate reward models from human feedback for policy optimization.
method Policy-Interpolated Learning for Aligned Feedback (PILAF) that explicitly aligns preference learning with maximizing underlying oracle reward.
result PILAF is optimal from both optimization and statistical perspectives, demonstrating strong performance in RLHF settings.

Efficiently identifies good policies by choosing contexts for human feedback.

problem Efficiently acquiring human feedback for preference alignment in large language models.
method Formalizes active exploration as a dueling bandit problem and proposes an active exploration algorithm with a polynomial worst-case regret bound.
result Proposed method outperforms baselines with limited human preferences on various language models and datasets.

Study improves understanding and performance of FA learning rules in neural networks.

problem Lack of theoretical understanding and limited applications of Feedback Alignment (FA) methods.
method Introduces a unified framework linking synaptic weight changes to implicit regularization, providing convergence conditions and empirical evidence.
result Better alignment can enhance FA performance on complex multi-class tasks.

Recent advances in deep neural networks (DNNs) owe their success to training algorithms that use backpropagation and gradient-descent. Backpropagation, while highly effective on von Neumann architectures, becomes inefficient when scaling to large networks. Commonly referred to as the weight transport problem, each neur…

2019-01-30abs ↗pdf ↗

SAIL improves online alignment of large language models with minimal feedback.

problem Offline RLHF methods often lead to sub-optimal performance due to fixed preference datasets.
method SAIL uses bilevel optimization and a single-level first-order method to iteratively refine model alignment.
result SAIL significantly improves alignment performance on open-sourced datasets with minimal computational overhead.

Improved text-to-image alignment using iterative VQA feedback.

problem Misalignment between text prompts and generated images, especially for complex inputs.
method Decompose complex prompts into assertions, evaluate each using VQA, combine scores iteratively.
result Significantly higher correlation with human ratings compared to CLIP, BLIP scores.

Direct Feedback Alignment performs well on diverse deep learning tasks and architectures.

problem The limitations of backpropagation in parallelizing and scaling to modern deep learning tasks.
method Direct Feedback Alignment approach applied to neural view synthesis, recommender systems, geometric learning, and natural language processing.
result Direct Feedback Alignment successfully trains a wide range of state-of-the-art deep learning architectures with performance close to fine-tuned backpropagation.

The abstract explores connections between reinforcement learning, scaling, and diffusion.

problem Aligning reinforcement learning with human feedback and scaling techniques.
method Clarifying connections between reinforcement learning, scaling, and diffusion.
result Introducing a resampling approach for alignment and reward-directed diffusion models.

The backpropagation algorithm has long been the canonical training method for neural networks. Modern paradigms are implicitly optimized for it, and numerous guidelines exist to ensure its proper use. Recently, synthetic gradients methods -where the error gradient is only roughly approximated - have garnered interest. …

2019-06-11abs ↗pdf ↗

FA algorithm provides convergence guarantees for deep linear networks.

problem Training efficiency and convergence of deep neural networks.
method Theoretical analysis of Feedback Alignment (FA) algorithm for deep linear networks.
result Certain initializations lead to implicit anti-regularization, affecting learning effectiveness.

New method prevents RLHF alignment collapse by accounting for policy's influence on reward model updates.

problem Iterative RLHF leads to alignment collapse where policies exploit RM's blind spots.
method Foresighted policy optimization (FPO) restores missing steering term via regularization.
result FPO prevents alignment collapse on LLM alignment pipelines using Llama-3.2-1B.

Unified framework for aligning LLMs from human feedback.

problem Lack of strong theoretical justification for RLHF and inability to compare methods.
method Reframed alignment as distribution learning from pairwise preferences, proposing three principled objectives.
result Proposed objectives achieve strong non-asymptotic convergence to target LM.

Current algorithms for deep learning probably cannot run in the brain because they rely on weight transport, where forward-path neurons transmit their synaptic weights to a feedback path, in a way that is likely impossible biologically. An algorithm called feedback alignment achieves deep learning without weight transp…

2019-04-10abs ↗pdf ↗

RLHF uses human feedback to train AI models, posing statistical challenges.

problem Aligning AI models with human preferences using noisy, subjective feedback.
method Supervised fine-tuning, reward modeling, policy optimization, statistical ideas.
result Statistical methods for reward function learning and policy optimization.

Photonic co-processor speeds up training of large neural networks.

problem Training large neural networks with backpropagation is inefficient and communication is a bottleneck.
method Direct Feedback Alignment (DFA) with a photonic accelerator.
result Photonic accelerator can compute random projections with trillions of parameters.

Artificial neural networks are most commonly trained with the back-propagation algorithm, where the gradient for learning is provided by back-propagating the error, layer by layer, from the output layer to the hidden layers. A recently discovered method called feedback-alignment shows that the weights used for propagat…

2016-09-06abs ↗pdf ↗

Method tackles uncertainty in reward models for LLMs from heterogeneous human feedback.

problem Uncertainty in reward models for LLMs from heterogeneous human feedback.
method Heterogeneous preference framework and alternating gradient descent algorithm.
result Established theoretical guarantees for estimator convergence and asymptotic distribution.

RAFT fine-tunes models using high-quality samples to align them with human preferences.

problem Aligning generative models with human ethics and preferences.
method RAFT selects high-quality samples, discards undesired behavior, and fine-tunes the model on filtered samples.
result RAFT improves model performance in reward learning and automated metrics.

Paper addresses online alignment of large language models under uncertain preference feedback.

problem Online alignment of large language models with misspecified preference feedback.
method Formulates an oracle-robust objective as a worst-case optimization problem for log-linear policies, and develops projected stochastic composite updates.
result Shows that the robust objective admits an exact closed-form decomposition and achieves O~(ε2)\widetilde{O}(\varepsilon^{-2}) oracle complexity.

Dual active learning improves RLHF by selecting optimal conversations and teachers.

problem Efficiently aligning LLMs with human preferences using RLHF from feedback.
method Offline RL for conversation and teacher selection, dual active reward learning, pessimistic RL.
result The proposed algorithm achieves minimal generalized variance and outperforms state-of-the-arts.

New algorithm shows neural networks can learn without full backpropagation.

problem Stochastic gradient descent with backpropagation is non-biologically plausible.
method Random and fixed backpropagation weights in a feedback alignment algorithm.
result Error converges to zero exponentially fast in overparameterized networks.

A new method reduces the computational burden of safety alignment for large language models.

problem Safety concerns in large language models and the need to align them with human preferences.
method Optimal dualization approach to reduce constrained alignment to an unconstrained problem.
result Our algorithms MoCAN and PeCAN significantly reduce computational burden and improve training stability.

Ongoing studies have identified similarities between neural representations in biological networks and in deep artificial neural networks. This has led to renewed interest in developing analogies between the backpropagation learning algorithm used to train artificial networks and the synaptic plasticity rules operative…

2018-12-12abs ↗pdf ↗

SLHF uses sequential game theory to optimize preferences from human feedback.

problem Optimizing preferences from human feedback in sequential settings.
method SLHF frames the problem as a sequential-move game between Leader and Follower, decomposing the optimization into refinement and adversarial optimization.
result SLHF achieves strong alignment across diverse preference datasets and scales to large models.

Paper explores limits and possibilities of aligning LLMs with human preferences.

problem Aligning LLMs with diverse human preferences to ensure fairness and informed outcomes.
method Analysis of probabilistic representation of human preferences and preservation of diverse preferences.
result LLMs can't fully align with human preferences using reward-based approaches due to Condorcet cycles, but mixed strategies are statistically possible.

The paper proposes a method to align AI models using conformal risk control.

problem Aligning AI models to meet end-user requirements in non-generative settings.
method Post-processing a pre-trained model to better align with a subset of functions using conformal risk control.
result A probabilistic guarantee that the resulting conformal interval around a model contains a function approximately satisfying a desired property.

Random Feedback Alignment helps solve low-rank matrix factorization problems.

problem Solving low-rank matrix factorization problems efficiently.
method Random Feedback Alignment (FA) as a bio-plausible alternative to gradient descent.
result FA converges to the optimal solution when the rank of the matrix is at least the rank of the input matrix.

Paper addresses RLHF alignment challenges with novel algorithms.

problem Challenges in RLHF alignment, especially in strategic exploration.
method Develops a reverse-KL regularized contextual bandit formulation and proposes efficient algorithms with theoretical guarantees.
result Proposed methods significantly outperform existing RLHF algorithms in real-world experiments.

This paper solves the multiple reference model problem in RLHF with exact solutions and sample complexity guarantees.

problem Limitations of single reference models in aligning LLMs with human feedback.
method Integrates multiple reference models into RLHF frameworks, addressing theoretical challenges with exact solutions and sample complexity guarantees.
result First exact solution to the multiple reference model problem in reverse KL-regularized RLHF.

New framework formalizes RLHF trilemma: improving safety, fairness, and robustness is computationally infeasible.

problem Aligning large language models with diverse human values while maintaining computational feasibility and robustness.
method Complexity-theoretic analysis integrating statistical learning theory and robust optimization.
result Achieving both representativeness (epsilon <= 0.01) and robustness (delta <= 0.001) for global-scale populations requires super-polynomial operations.

DRO-REBEL improves LLM alignment by robustly updating models online.

problem Overfitting and drifting of LLMs during RLHF.
method DRO-REBEL uses type-pp Wasserstein, KL, and χ2χ^2 ambiguity sets for robust online updates.
result DRO-REBEL achieves faster convergence and better performance than prior methods.

New method learns interpretable concepts from user feedback for high-dimensional data.

problem Lack of interpretable concepts in machine learning models trained on high-dimensional tabular data.
method Proposes a method for learning transparent concept definitions from user labeling of concept features, not instances.
result Demonstrates more efficient learning of aligned concept definitions from user feedback compared to alternative transparent approaches.

Extends reinforcement learning alignment to scalar rewards, improving math reasoning.

problem Designing reinforcement learning algorithms for general LLM alignment.
method Introduces f-GRPO and f-HAL, estimating f-divergences between reward-aligned and unaligned distributions.
result Improves math reasoning RLVR tasks and mitigates reward hacking.

Modeling alignment as resource-limited cognitive processes, researchers derive performance bounds.

problem Systematic deviations in feedback-based alignment of large language models.
method Modeling alignment as a two-stage cascade UoHoYU o H o Y given SS, with cognitive and total capacities.
result Capacity-coupled Alignment Performance Interval derived from Fano and PAC-Bayes bounds.

OOM-RL uses financial market losses to align AI agents in autonomous systems.

problem Constrained alignment of autonomous software agents in live financial markets.
method Deploying agents in live financial markets to enforce strict test-driven workflows.
result Final OOM-RL-aligned system achieved a stable equilibrium with an annualized Sharpe ratio of 2.06.