Analyzes feature learning in neural networks using a self-consistent dynamical field theory.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New theory for clustering in geometric and adaptive settings.
RLHF performs well despite violating social choice theory axioms.
Consistent estimator derived for confounding strength in observational data.
This paper establishes a theoretical foundation for consistency training in diffusion models.
Diffusion models' consistency across splits explained by random matrix theory.
A popular approach to semi-supervised learning proceeds by endowing the input data with a graph structure in order to extract geometric information and incorporate it into a Bayesian framework. We introduce new theory that gives appropriate scalings of graph parameters that provably lead to a well-defined limiting post…
The braneworld theory appear with the purpose of solving the problem of the hierarchy of the fundamental interactions. The perspectives of the theory emerge as a new physics, for example, deviation of the law of Newton's gravity. One of the principles of the theory is to suppose that the braneworld is local submanifold…
Paper explores grafting consistent estimators to improve Random Forest consistency.
As a testament to their success, the theory of random forests has long been outpaced by their application in practice. In this paper, we take a step towards narrowing this gap by providing a consistency result for online random forests.
GES algorithm improves consistency for nonparametric DAG models.
Random forests are a type of ensemble method which makes predictions by combining the results of several independent trees. However, the theory of random forests has long been outpaced by their application. In this paper, we propose a novel random forests algorithm based on cooperative game theory. Banzhaf power index …
Subject of present paper is the review of results of authors on foliation theory and applications of foliation theory in control systems. The paper consists of two parts. In the first part the results of authors on foliation theory are presented, in the second part the results on applications of foliation theory in the…
We derive behavioral finance option pricing formulas consistent with the rational dynamic asset pricing theory. In the existing behavioral finance option pricing formulas, the price process of the representative agent is not a semimartingale, which leads to arbitrage opportunities for the option seller. In the literatu…
Study on -consistency bounds for machine learning surrogates.
Kleinberg introduced three natural clustering properties, or axioms, and showed they cannot be simultaneously satisfied by any clustering algorithm. We present a new clustering property, Monotonic Consistency, which avoids the well-known problematic behaviour of Kleinberg's Consistency axiom, and the impossibility resu…
This work proposes a new method to match distributions across different spaces using cycle-consistent maps.
Theory captures feature learning effects in finite CNNs.
We provide an action for gauge theories discretized on simplicial meshes, inspired by finite element methods. The action is discretely gauge invariant and we give a proof of consistency. A discrete Noether's theorem that can be applied to our setting, is also proved.
Variable screening is a fast dimension reduction technique for assisting high dimensional feature selection. As a preselection method, it selects a moderate size subset of candidate variables for further refining via feature selection to produce the final model. The performance of variable screening depends on both com…
Proof of Gaussian ML estimator consistency in linear auto-regressive models.
Fictitious play is a simple and widely studied adaptive heuristic for playing repeated games. It is well known that fictitious play fails to be Hannan consistent. Several variants of fictitious play including regret matching, generalized regret matching and smooth fictitious play, are known to be Hannan consistent. In …
This work initiates a general study of learning and generalization without the i.i.d. assumption, starting from first principles. While the traditional approach to statistical learning theory typically relies on standard assumptions from probability theory (e.g., i.i.d. or stationary ergodic), in this work we are inter…
New theory for partial disentanglement from sparse graphs.
The article consist of two main parts: an analog of the Leray Theory for Singular Varieties and its application to the Theory of Parshin's Residues. The first part is independent from the second. It uses the theory of Whitney stratifications. The second part is an application of the first. In particular, a geometric an…
Aether theory is introduced to implement the violation of the Lorentz invariance in general relativity. For this purpose a unit timelike vector field introduced to theory in addition to the metric tensor. Aether theory contains four free parameters which satisfy some inequalities in order that the theory to be consiste…
Invertibility conditions for observation-driven time series models often fail to be guaranteed in empirical applications. As a result, the asymptotic theory of maximum likelihood and quasi-maximum likelihood estimators may be compromised. We derive considerably weaker conditions that can be used in practice to ensure t…
This paper improves deep learning model consistency through ensemble methods.
Kernel ridge regression imputation with consistent variance estimation for handling missing data.
A framework for constructing new kinds of gauge theories is suggested. Essentially it consists in replacing Lie algebras by Lie or Courant algebroids. Besides presenting novel topological theories defined in arbitrary spacetime dimensions, we show that equipping Lie algebroids E with a fiber metric having sufficiently …
Study examines if LLMs' trading styles match real market behavior.
New approach simplifies gauge field theory without groups.
In this paper we study time-consistent risk measures for returns that are given by a GARCH(1,1) model. We present a construction of risk measures based on their static counterparts that overcomes the lack of time-consistency. We then study in detail our construction for the risk measures Value-at-Risk (VaR) and Average…
We explain the main concepts of Prospect Theory and Cumulative Prospect Theory within the framework of rational dynamic asset pricing theory. We derive option pricing formulas when asset returns are altered with a generalized Prospect Theory value function or a modified Prelec weighting probability function and introdu…
The paper characterizes boundaries in Turaev-Viro TQFTs and Dijkgraaf-Witten theories.
This paper investigates Frequentist consistency properties of the posterior distributions constructed via Generalized Variational Inference (GVI). A number of generic and novel strategies are given for proving consistency, relying on the theory of -convergence. Specifically, this paper shows that under minimal regul…
The paper introduces a sampling theory for graphons with a Poincaré inequality and proves consistency.
We extend a recently proposed 1-nearest-neighbor based multiclass learning algorithm and prove that our modification is universally strongly Bayes-consistent in all metric spaces admitting any such learner, making it an "optimistically universal" Bayes-consistent learner. This is the first learning algorithm known to e…
An axiomatic approach to signal reconstruction is formulated, involving a sample consistent set and a guiding set, describing desired reconstructions. New frame-less reconstruction methods are proposed, based on a novel concept of a reconstruction set, defined as a shortest pathway between the sample consistent set and…
New theory explains forgetting in learning algorithms.
We prove that there is no parity anomaly in M-theory in the low-energy field theory approximation. Our approach is computational. We determine generators for the 12-dimensional bordism group of pin manifolds with a w_1-twisted integer lift of w_4; these are the manifolds on which Wick-rotated M-theory exists. The anoma…
Unique optimal strategy identified for state-dependent risk aversion.
The paper bounds eigenvalues and integrals of eigenfunctions on hyperbolic manifolds.
New method interpolates training data and is consistent for various data distributions.
Graph theory provides a language for studying the structure of relations, and it is often used to study interactions over time too. However, it poorly captures the both temporal and structural nature of interactions, that calls for a dedicated formalism. In this paper, we generalize graph concepts in order to cope with…
The paper introduces risk consistency properties for credit ratings.
We have embedded the classical theory of stochastic finance into a differential geometric framework called Geometric Arbitrage Theory and show that it is possible to: --Write arbitrage as curvature of a principal fibre bundle. --Parameterize arbitrage strategies by its holonomy. --Give the Fundamental Theorem of Asset …
Geometric problems are usually formulated by means of (exterior) differential systems. In this theory, one enriches the system by adding algebraic and differential constraints, and then looks for regular solutions. Here we adopt a dual approach, which consists to enrich a plane field, as this is often practised in cont…