Paper fine-tunes LLMs using user edits, unifying preference, supervision, and reward feedback.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Unified framework simplifies DPO algorithms for LLM alignment.
Quantum character varieties unify four construction methods.
A new formulation of the Anomaly flow in the case of vanishing slope parameter is given, where the dependence on the global section of the canonical bundle appears only in the initial data. This allows a natural unification of the Anomaly flow with the Kähler-Ricci flow.
We investigate unification of two systems of identical elements having different dimensions which may be of interest for both physics and economics. Characteristic parameters as well as explicit formulae for the temperature (in economics - capital turnover) and dimension of the united system are obtained as functions o…
In the paper [4] is presented a theory which unifies the gravitation theory and the mechanical effects, which is different from the Riemannian theories like GTR. Moreover it is built in the style of the electomagnetic field theory. This paper is a continuation of [4] such that the complex variant of that theory yields …
Human reasoning involves recognising common underlying principles across many examples. The by-products of such reasoning are invariants that capture patterns such as "if someone went somewhere then they are there", expressed using variables "someone" and "somewhere" instead of mentioning specific people or places. Hum…
Unified study of Riemannian and sub-Riemannian geometries with synthetic Ricci curvature bounds.
In this paper, algebroid bundle associated to affine metrics provide an structure for unification of gravity and electromagnetism and, geometrization of matter.
Associating stock mechanics to real economy, in terms of volume, number of transactions, and cost, i.e. money flow for shares, we obtained the fundamental laws of stock mechanics.
This study analyzes public debts and deficits between European countries. The statistical evidence here seems in general to reveal that sovereign debts and government deficits of countries within European Monetary Unification-in average- are getting worse than countries outside European Monetary Unification, in particu…
Starting from a relativistic phenomenology of anyons in crystals, we discuss the concept of relativistic interaction and the need to unify electromagnetism and gravitation within the Spencer cohomology of Lie equations. Then, from the sophisticated non-linear Spencer complex of the Poincaré and conformal Lie pseudogrou…
This article provides the role of big idea statisticians in future of Big Data Science. We describe the `United Statistical Algorithms' framework for comprehensive unification of traditional and novel statistical methods for modeling Small Data and Big Data, especially mixed data (discrete, continuous).
Unified field theory from higher-order Riemannian geometry.
The paper glosses different forms of an introducing of higher order tangent-like functors, especially functors derived from higher order nonholonomic tangent functors. A special attention is devoted to higher order osculating bundles: their identification with higher order tangent bundles is demonstrated as the main re…
The paper improves on existing algorithms for minimizing different types of regret in online learning.
Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular algorithms for solving such problems, e.g., ADMM, often involve non-trivial optimiz…
Unified framework for spectral methods, kernel learning, and manifold unfolding.
A novel class of integrable surfaces is recorded. This class of O surfaces is shown to include and generalize classical surfaces such as isothermic, constant mean curvature, minimal, `linear' Weingarten, Guichard and Petot surfaces and surfaces of constant Gaussian curvature. It is demonstrated that the construction of…
We use a new approach that we call unification to prove that standard weighted double bubbles in -dimensional Euclidean space minimize immiscible fluid surface energy, that is, surface area weighted by constants. The result is new for weighted area, and also gives the simplest known proof to date of the (unit weight…
Non-associtive algebras is a research direction gaining much attention these days. New developments show that associative algebras and some not-associative structures can be unified at the level of Yang-Baxter structures. In this paper, we present a unification for associative algebras, Jordan algebras and Lie algebras…
New insights into cascade feedback linearization of control systems.
New method learns from either positive or negative feedback alone.
Novel power transform unifies various mathematical functions.
User preferences for items can be inferred from either explicit feedback, such as item ratings, or implicit feedback, such as rental histories. Research in collaborative filtering has concentrated on explicit feedback, resulting in the development of accurate and scalable models. However, since explicit feedback is oft…
This paper improves image retrieval accuracy through novel relevance feedback methods.
Paper connects two portfolio methods, HRP and Minimum Variance, revealing their underlying similarity.
Recommender systems recommend items more accurately by analyzing users' potential interest on different brands' items. In conjunction with users' rating similarity, the presence of users' implicit feedbacks like clicking items, viewing items specifications, watching videos etc. have been proved to be helpful for learni…
We introduce a new class of quantum enhancements we call biquandle brackets, which are customized skein invariants for biquandle colored links.Quantum enhancements of biquandle counting invariants form a class of knot and link invariants that includes biquandle cocycle invariants and skein invariants such as the HOMFLY…
In 2006 Habiro initiated a construction of generating functions for Witten-Reshetikhin-Turaev (WRT) invariants known as unified WRT invariants. In a series of papers together with Irmgard Buehler and Christian Blanchet we extended his construction to a larger class of 3-manifolds. The unified invariants provide a stron…
Study evaluates new models using human feedback from another model.
Develops a new model for RLHF accounting for partially observed states and intermediate feedback.
Classifier learns to ignore unreliable feedback from end users.
Paper characterizes minimax regret rates for online ranking with top-k feedback.
The 2-parameter family of certain homogeneous Lorentzian 3-manifolds which includes Minkowski 3-space and anti-de Sitter 3-space is considered. Each homogeneous Lorentzian 3-manifold in the 2-parameter family has a solvable Lie group structure with left invariant metric. A generalized integral representation formula wh…
Lean 4 library formalizes mathematical finance, verifying over 200 theorems.
Study on sample complexity for pure exploration in feedback graph settings.
One-bit feedback suffices for a bandit problem's optimal strategy.
Sharp comparison for sub-Gaussian random variables in convex order.
Advocates a local feedback approach for RL in unknown systems.
Study how communication and feedback graphs affect learning outcomes.
New method uses correlated auxiliary feedback to reduce regret in parameterized bandits.
Test for linearizing 2-input systems with 2D feedback.
In this paper we describe market in projective geometry language and give definition of a matrix of market rate, which is related to the matrix rate of return and the matrix of judgements in the Analytic Hierarchy Process (AHP). We use these observations to extend the AHP model to projective geometry formalism and gene…
The problem of feedback equivalence for control systems is considered. An algebra of differential invariants and criteria for the feedback equivalence for regular control systems are found.
Reduces user feedback needed for accurate recommender systems.
We present a study on reinforcement learning (RL) from human bandit feedback for sequence-to-sequence learning, exemplified by the task of bandit neural machine translation (NMT). We investigate the reliability of human bandit feedback, and analyze the influence of reliability on the learnability of a reward estimator,…
New algorithm for recommending best arms with aggregated feedback.