New framework for task-independent legged locomotion.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A decentralized deep RL controller improves hexapod locomotion learning.
The paper develops a learning framework for diverse legged robots.
'Sharing of statistical strength' is a phrase often employed in machine learning and signal processing. In sensor networks, for example, missing signals from certain sensors may be predicted by exploiting their correlation with observed signals acquired from other sensors. For humans, our hands move synchronously with …
Legged robots pose one of the greatest challenges in robotics. Dynamic and agile maneuvers of animals cannot be imitated by existing methods that are crafted by humans. A compelling alternative is reinforcement learning, which requires minimal craftsmanship and promotes the natural evolution of a control policy. Howeve…
When the Poincaré map associated with a periodic orbit of a hybrid dynamical system has constant-rank iterates, we demonstrate the existence of a constant-dimensional invariant subsystem near the orbit which attracts all nearby trajectories in finite time. This result shows that the long-term behavior of a hybrid model…
ROBEL is an open-source platform of cost-effective robots designed for reinforcement learning in the real world. ROBEL introduces two robots, each aimed to accelerate reinforcement learning research in different task domains: D'Claw is a three-fingered hand robot that facilitates learning dexterous manipulation tasks, …
We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain. We present an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. Using the same learning algorithm, network architecture and hyper-parameters, our algo…
Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning locomotion skills with minimal engineering and without an explicit model of the robot…
Interest in derivative-free optimization (DFO) and "evolutionary strategies" (ES) has recently surged in the Reinforcement Learning (RL) community, with growing evidence that they can match state of the art methods for policy optimization problems in Robotics. However, it is well known that DFO methods suffer from proh…
In this note we study the Seifert rational homology spheres with two complementary legs, i.e. with a pair of invariants whose fractions add up to one. We give a complete classification of the Seifert manifolds with 3 exceptional fibers and two complementary legs which bound rational homology balls. The result translate…
Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well as low-level tasks, like motion control, which are critical components for missi…
Market portfolio decomposed into body and tail legs
The design of gaits for robot locomotion can be a daunting process which requires significant expert knowledge and engineering. This process is even more challenging for robots that do not have an accurate physical model, such as compliant or micro-scale robots. Data-driven gait optimization provides an automated alter…
Study decomposes market portfolio into body and tail legs, revealing systematic differences.
A novel approach learns goal-conditioned policies for locomotion using batch RL.
Despite the recent successes in robotic locomotion control, the design of robot relies heavily on human engineering. Automatic robot design has been a long studied subject, but the recent progress has been slowed due to the large combinatorial search space and the difficulty in evaluating the found candidates. To addre…
We study topology of configuration spaces of planar linkages having one leg of variable length. Such telescopic legs are common in modern robotics where they are used for shock absorbtion and serve a variety of other purposes. Using a Morse theoretic technique, we compute explicitly, in terms of the metric data, the Be…
Study shows Seifert fibered spaces don't bound rational homology balls.
Tests factor models by decomposing market into body and tail legs, revealing inconsistent results.
Study compares short vs long strategies for equity factors, finds short strategy better.
HiPPO framework optimizes memory compression for sequential data.
New framework for RL transfer learning with state-action mismatch.
A new GNN module learns geometric scattering features for better graph classification and feature exploration.
Study confirms a 2-sphere metric with three geodesics of minimal length.
New friction model for geometric locomotion systems.
Robotics: Rolling robots on a moving platform can be controlled.
The study establishes a criterion for the holomorphy of curvature in smooth webs and applies it to dual webs of homogeneous foliations.
Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only when the task has been successfully completed, can lead to better policies. Howe…
We propose a new method of measuring the third and fourth moments of return distribution based on quadratic variation method when the return process is assumed to have zero drift. The realized third and fourth moments variations computed from high frequency return series are good approximations to corresponding actual …
Optimizes Ethena's yield strategy by controlling stETH and ETH futures positions.
The third moment variation of a financial asset return process is defined by the quadratic covariation between the return and square return processes. The skew and fat tail risk of an underlying asset can be hedged using a third moment variation swap under which a predetermined fixed leg and the floating leg of the rea…
Study bounds variance modulation function for K-spider distributions.
Manually authoring transition animations for a complete locomotion system can be a tedious and time-consuming task, especially for large games that allow complex and constrained locomotion movements, where the number of transitions grows exponentially with the number of states. In this paper, we present a novel approac…
The Kontsevich integral of a knot is a powerful invariant which takes values in an algebra of trivalent graphs with legs. Given a Lie algebra, the Kontsevich integral determines an invariant of knots (the so-called colored Jones function) with values in the symmetric algebra of the Lie algebra. Recently A. Kricker and …
We prove a conjecture about approximating Gaussian Processes on one dimension.
A framework for computing holonomy groups of hybrid systems to achieve forward motion.
Mobile robot navigation in complex and dynamic environments is a challenging but important problem. Reinforcement learning approaches fail to solve these tasks efficiently due to reward sparsities, temporal complexities and high-dimensionality of sensorimotor spaces which are inherent in such problems. We present a nov…
Much attention has been given to automatic sleep staging algorithms in past years, but the detection of discrete events in sleep studies is also crucial for precise characterization of sleep patterns and possible diagnosis of sleep disorders. We propose here a deep learning model for automatic detection and annotation …
This paper examines linear embeddings for high-dimensional Bayesian optimization, identifying and addressing issues to improve performance.
SAVO actor improves reinforcement learning by avoiding local optima in complex Q-functions.
PerCDL learns personalized dictionaries for physiological signals combining global and local structures.
Generalizes Lefschetz fibrations with rational homology disk smoothings.
Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause proficient but specialized policies to fail at test time. Given that it is impractical …
CARL controls a quadruped to move naturally in complex environments.
The paper presents new algebraic structures on the 2-sphere using topological field theories.
Proves representability of complex semigroup systems.
A deep neural network detects sleep events in polysomnograms with high accuracy.