SympFormer accelerates attention blocks using inertial dynamics on density spaces.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Inertial information processing plays a pivotal role in ego-motion awareness for mobile agents, as inertial measurements are entirely egocentric and not environment dependent. However, they are affected greatly by changes in sensor placement/orientation or motion dynamics, and it is infeasible to collect labelled data …
Neural networks outperform conventional filters in inertial sensor-based attitude estimation.
Human inertial thinking schemes can be formed through learning, which are then applied to quickly solve similar problems later. However, when problems are significantly different, inertial thinking generally presents the solutions that are definitely imperfect. In such cases, people will apply creative thinking, such a…
RIO uses rotation-equivariance to train robust inertial odometry models.
This paper proposes IMU preintegrated features for efficient deep inertial odometry.
We describe a method to infer dense depth from camera motion and sparse depth as estimated using a visual-inertial odometry system. Unlike other scenarios using point clouds from lidar or structured light sensors, we have few hundreds to few thousand points, insufficient to inform the topology of the scene. Our method …
Compared to other biometrics, gait is difficult to conceal and has the advantage of being unobtrusive. Inertial sensors, such as accelerometers and gyroscopes, are often used to capture gait dynamics. These inertial sensors are commonly integrated into smartphones and are widely used by the average person, which makes …
We study the Whitehead torsions of inertial h-cobordisms, and identify various types representing a nested sequence of subsets of the Whitehead group. A number of examples are given to show that these subsets are all different in general.
The proximal inertial gradient descent is efficient for the composite minimization and applicable for broad of machine learning problems. In this paper, we revisit the computational complexity of this algorithm and present other novel results, especially on the convergence rates of the objective function values. The no…
Develops a gradient flow for Muon optimizer, a method for optimization.
In this paper we propose a novel accurate method for dead-reckoning of wheeled vehicles based only on an Inertial Measurement Unit (IMU). In the context of intelligent vehicles, robust and accurate dead-reckoning based on the IMU may prove useful to correlate feeds from imaging sensors, to safely navigate through obstr…
Classically time is kept fixed for infinitesimal variations in problems in mechanics. Apparently, there appears to be no mathematical justification in the literature for this standard procedure. This can be explained canonically by unveiling the intrinsic mathematical structure of time in Lagrangian mechanics. Moreover…
In this work, we propose a new learning approach for autonomous navigation and landing of an Unmanned-Aerial-Vehicle (UAV). We develop a multimodal fusion of deep neural architectures for visual-inertial odometry. We train the model in an end-to-end fashion to estimate the current vehicle pose from streams of visual an…
Foot-mounted inertial positioning (FMIP) can face problems of inertial drifts and unknown initial states in real applications, which renders the estimated trajectories inaccurate and not obtained in a well defined coordinate system for matching trajectories of different users. In this paper, an approach adopting receiv…
Accelerates coordinate descent methods for machine learning problems.
Paper proposes a deep learning method for better IMU gyroscope data.
There is significant interest in using modern neural networks for scientific applications due to their effectiveness in modeling highly complex, non-linear problems in a data-driven fashion. However, a common challenge is to verify the scientific plausibility or validity of outputs predicted by a neural network. This w…
We propose inertial versions of block coordinate descent methods for solving non-convex non-smooth composite optimization problems. Our methods possess three main advantages compared to current state-of-the-art accelerated first-order methods: (1) they allow using two different extrapolation points to evaluate the grad…
Multimodal fusion frameworks for Human Action Recognition (HAR) using depth and inertial sensor data have been proposed over the years. In most of the existing works, fusion is performed at a single level (feature level or decision level), missing the opportunity to fuse rich mid-level features necessary for better cla…
TransFall uses transfer learning to improve activity recognition from mobile sensors.
Matrix Factorization is a popular non-convex optimization problem, for which alternating minimization schemes are mostly used. They usually suffer from the major drawback that the solution is biased towards one of the optimization variables. A remedy is non-alternating schemes. However, due to a lack of Lipschitz conti…
We introduce a new second-order inertial optimization method for machine learning called INNA. It exploits the geometry of the loss function while only requiring stochastic approximations of the function values and the generalized gradients. This makes INNA fully implementable and adapted to large-scale optimization pr…
The problem of automatic identification of physical activities performed by human subjects is referred to as Human Activity Recognition (HAR). There exist several techniques to measure motion characteristics during these physical activities, such as Inertial Measurement Units (IMUs). IMUs have a cornerstone position in…
Jointly estimates flow fields and particle properties from Lagrangian data.
Develops active learning for scale-bridging simulations.
We prove that the essential smoothness of the gravitational metric at shock waves in GR, a PDE regularity issue for weak solutions of the Einstein equations, is determined by a geometrical condition which we introduce and name the {\it Riemann-flat condition}. The Riemann-flat condition determines whether or not the es…
Solves memorization in diffusion models for manifold data.
A significant challenge for a supervised learning approach to inertial human activity recognition is the heterogeneity of data between individual users, resulting in very poor performance of impersonal algorithms for some subjects. We present an approach to personalized activity recognition based on deep embeddings der…
The Schroedinger operator on the Newtonian space-time is defined in a way which is independent on the class of inertial observers. In this picture the Schroedinger operator acts not on functions on the space-time but on sections of certain one-dimensional complex vector bundle over space-time. This bundle, constructed …
Neural networks have become very popular in surrogate modeling because of their ability to characterize arbitrary, high dimensional functions in a data driven fashion. This paper advocates for the training of surrogates that are consistent with the physical manifold -- i.e., predictions are always physically meaningful…
Paper models market dynamics using bull and bear forces.
Adaptive Langevin dynamics reduces bias in Bayesian inference with mini-batching.
Dynamical models estimate and predict the temporal evolution of physical systems. State Space Models (SSMs) in particular represent the system dynamics with many desirable properties, such as being able to model uncertainty in both the model and measurements, and optimal (in the Bayesian sense) recursive formulations e…
In this paper, we develop a new sequential regression modeling approach for data streams. Data streams are commonly found around us, e.g in a retail enterprise sales data is continuously collected every day. A demand forecasting model is an important outcome from the data that needs to be continuously updated with the …
The Schroedinger operators on the Newtonian space-time are defined in a way which make them independent on the class of inertial observers. In this picture the Schroedinger operators act not on functions on the space-time but on sections of certain one-dimensional complex vector bundle -- the Schroedinger line bundle. …
Robotics: Rolling robots on a moving platform can be controlled.
Revisits Finsler spacetimes from inertial observer perspective.
We reinterpret special relativity, or more precisely its de Sitter deformation, in terms of 3d conformal geometry, as opposed to (3+1)d spacetime geometry. An inertial observer, usually described by a geodesic in spacetime, becomes instead a choice of ways to reverse the conformal compactification of a Euclidean vector…
A frame independent formulation of analytical mechanics in the Newtonian space-time is presented. The differential geometry of affine values i.e., the differential geometry in which affine bundles replace vector bundles and sections of one dimensional affine bundles replace functions on manifolds, is used. Lagrangian a…
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
The ubiquitous availability of wearable sensors is responsible for driving the Internet-of-Things but is also making an impact on sport sciences and precision medicine. While human activity recognition from smartphone data or other types of inertial measurement units (IMU) has evolved to one of the most prominent daily…
Inertial confinement fusion (ICF) experiments are designed using computer simulations that are approximations of reality, and therefore must be calibrated to accurately predict experimental observations. In this work, we propose a novel nonlinear technique for calibrating from simulations to experiments, or from low fi…
The Wall surgery obstruction groups have two interesting geometrically defined subgroups, consisting of the surgery obstructions between closed manifolds, and the inertial elements. We show that the inertia group and the closed manifold subgroup are equal in dimensions , for any…
Paper presents a new port-Hamiltonian model for vehicle manipulators.
Develops a new model to predict training dynamics of large language models.
Owing to the expeditious growth in the information and communication technologies, smart cities have raised the expectations in terms of efficient functioning and management. One key aspect of residents' daily comfort is assured through affording reliable traffic management and route planning. Comprehensively, the majo…
New derivation shows spacetime interval is quadratic without light.