Framework learns robust control policies from expert demonstrations.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Theoretical model for iterative user discovery in recommender systems.
The problem of Reinforcement Learning (RL) in an unknown nonlinear dynamical system is equivalent to the search for an optimal feedback law utilizing the simulations/ rollouts of the dynamical system. Most RL techniques search over a complex global nonlinear feedback parametrization making them suffer from high trainin…
CAFL breaks feedback loops in recommender systems using causal inference.
Traditional collaborative filtering (CF) based recommender systems tend to perform poorly when the user-item interactions/ratings are highly scarce. To address this, we propose a learning framework that improves collaborative filtering with a synthetic feedback loop (CF-SFL) to simulate the user feedback. The proposed …
Classifier learns to ignore unreliable feedback from end users.
Superconducting circuit technologies have recently achieved quantum protocols involving closed feedback loops. Quantum artificial intelligence and quantum machine learning are emerging fields inside quantum technologies which may enable quantum devices to acquire information from the outer world and improve themselves …
Financial models shape markets through performativity, creating self-fulfilling prophecies.
Formula adjusts steady-state models for control confounding.
The paper provides guarantees for feedback control with sensor errors.
Study uses geometric algebra to analyze credit cycles, revealing dangerous feedback loops.
New budget quantifies drift in closed-loop learning, improving reproducibility.
We propose a novel spectral convolutional neural network (CNN) model on graph structured data, namely Distributed Feedback-Looped Networks (DFNets). This model is incorporated with a robust class of spectral graph filters, called feedback-looped filters, to provide better localization on vertices, while still attaining…
Feedback loops amplify dataset biases, affecting future model performance.
Predictive policing systems are increasingly used to determine how to allocate police across a city in order to best prevent crime. Discovered crime data (e.g., arrest counts) are used to help update the model, and the process is repeated. Such systems have been empirically shown to be susceptible to runaway feedback l…
Study shows visual feedback and monetary incentives reduce plugload energy consumption in commercial buildings.
The study aims to prevent unfair content presentation in recommender systems.
We show LLMs can be locally linear, enabling better control of activations.
The paper optimizes exceptions in a statistical production system using machine learning.
Self-reinforcing feedback loops in personalization systems are typically caused by users choosing from a limited set of alternatives presented systematically based on previous choices. We propose a Bayesian choice model built on Luce axioms that explicitly accounts for users' limited exposure to alternatives. Our model…
Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this challenge, the pixels-to-torques problem, where an RL agent learns a closed-loop con…
Online algorithms stabilize in feedback loops of performative prediction.
Interactive RL and DT feedback improve feature selection efficiency.
Fuzzy cognitive maps (FCMs) model feedback causal relations in interwoven webs of causality and policy variables. FCMs are fuzzy signed directed graphs that allow degrees of causal influence and event occurrence. Such causal models can simulate a wide range of policy scenarios and decision processes. Their directed loo…
Machine learning is used extensively in recommender systems deployed in products. The decisions made by these systems can influence user beliefs and preferences which in turn affect the feedback the learning system receives - thus creating a feedback loop. This phenomenon can give rise to the so-called "echo chambers" …
Study stabilizes second-order systems to first-order dynamics.
New framework optimizes forecasting and decision-making in dynamic systems.
We review the evidence that the erratic dynamics of markets is to a large extent of endogenous origin, i.e. determined by the trading activity itself and not due to the rational processing of exogenous news. In order to understand why and how prices move, the joint fluctuations of order flow and liquidity - and the way…
We propose a novel {\it Equilibrated Recurrent Neural Network} (ERNN) to combat the issues of inaccuracy and instability in conventional RNNs. Drawing upon the concept of autapse in neuroscience, we propose augmenting an RNN with a time-delayed self-feedback loop. Our sole purpose is to modify the dynamics of each inte…
A human-in-the-loop ML framework for precision dosing reduces expert workload and removes bias.
A predictor that is deployed in a live production system may perturb the features it uses to make predictions. Such a feedback loop can occur, for example, when a model that predicts a certain type of behavior ends up causing the behavior it predicts, thus creating a self-fulfilling prophecy. In this paper we analyze p…
Cycles in causal learning cause feedback loops under intervention.
Develops a framework for analyzing multi-agent and many-body systems with feedback loops.
New algorithm mitigates affinity bias in hiring feedback loops.
This work proposes a new method for simultaneous probabilistic identification and control of an observable, fully-actuated mechanical system. Identification is achieved by conditioning stochastic process priors on observations of configurations and noisy estimates of configuration derivatives. In contrast to previous w…
LLMs optimize quantum circuits by iteratively improving proposals with feedback and memory traces.
The paper tackles exact linearization and control of flat discrete-time systems.
We propose a method for learning cyclic causal models from a combination of observational and interventional equilibrium data. Novel aspects of the proposed method are its ability to work with continuous data (without assuming linearity) and to deal with feedback loops. Within the context of biochemical reactions, we a…
New algorithm reduces high-probability regret for time-varying feedback graphs.
Proposes a TS approach for Bayesian optimization with preferential feedback.
Method improves volatility targeting for index construction.
Robust model predictive control (MPC) is a well-known control technique for model-based control with constraints and uncertainties. In classic robust tube-based MPC approaches, an open-loop control sequence is computed via periodically solving an online nominal MPC problem, which requires prior model information and fr…
Online learning with delayed feedback has received increasing attention recently due to its several applications in distributed, web-based learning problems. In this paper we provide a systematic study of the topic, and analyze the effect of delay on the regret of online learning algorithms. Somewhat surprisingly, it t…
A skew loop is a closed curve without parallel tangent lines. We prove: The only complete surfaces in euclidean 3-space with a point of positive curvature and no skew loops are the quadrics. In particular, ellipsoids are the only closed surfaces without skew loops. We also prove results about skew loops on cylinders an…
Paper solves complex game theory problems with new equations.
Study finds loops with specific curvature exist using Hardy's inequality.
We show the Chas-Sullivan product (on the homology of the free loop space of a Riemannian manifold) is related to the Morse index of its closed geodesics. We construct related products in the cohomology of the free loop space and of the based loop space, and show they are nontrivial.
Framework for multi-agent RL with human feedback in a Snake game.