Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

70139209278 · Jun 202019922001200920172026
48 results for rotary position embedding

ElasTST improves time-series forecasting across varying horizons.

problem Robust forecasting across different time horizons in varied industrial sectors.
method Elastic Time-Series Transformer (ElasTST) with non-autoregressive design, rotary position embedding, and multi-scale patching.
result ElasTST provides robust forecasts across varying horizons without retraining.

STRING improves 2D and 3D position encodings for better performance.

problem Efficient and accurate position encoding for 2D and 3D applications.
method STRING extends Rotary Position Encodings with a unifying theoretical framework, maintaining translation invariance and low computational cost.
result STRING shows substantial gains in open-vocabulary object detection and robotics.

This paper introduces a new task to better understand Transformers in quantitative contexts.

problem Understanding Transformers in high-stakes quantitative and scientific applications.
method Introduces a novel contextual counting task and analyzes it with causal and non-causal Transformer architectures.
result Causal attention is better suited for the contextual counting task, and no positional embeddings lead to the best accuracy.

DRFormer uses dynamic tokenization and multi-scale transformer to forecast long time series.

problem Forecasting long-term time series data across diverse scales.
method Dynamic tokenizer, multi-scale transformer, dynamic sparse learning, rotary position encoding.
result DRFormer outperforms existing methods in forecasting accuracy.

Paper proposes new methods for improving interatomic potentials.

problem Limitations of conventional SO(2) Linear architectures in MLIPs.
method Direct Cartesian construction, recursive Clebsch-Gordan construction, Edge Complex Product Basis, Radial Rotary Complex Attention.
result TECE-OAM-RRA-1.0 achieves SOTA performance on Matbench Discovery.

An energy based approach for stabilizing a mechanical system has offered a simple yet powerful control scheme. However, since it does not impose such strong constraints on parameter space of the controller, finding appropriate parameter values for an optimal controller is known to be hard. This paper intends to generat…

2019-04-02abs ↗pdf ↗

This paper explores the relationship between the existence of an exact embedded Lagrangian filling for a Legendrian knot in the standard contact $\rr^3$ and the hierarchy of positive, strongly quasi-positive, and quasi-positive knots. On one hand, results of Eliashberg and especially Boileau and Orevkov show that every…

2013-07-29abs ↗pdf ↗

We propose to formulate multi-label learning as a estimation of class distribution in a non-linear embedding space, where for each label, its positive data embeddings and negative data embeddings distribute compactly to form a positive component and negative component respectively, while the positive component and nega…

2019-11-17abs ↗pdf ↗

The paper proves the existence of at least 4 embedded minimal tori in a three-sphere with positive Ricci curvature.

problem Proving the existence of embedded minimal tori in three-spheres with positive Ricci curvature.
method The proof relies on a multiplicity one theorem for the Simon-Smith min-max theory.
result There exist at least 4 distinct embedded minimal tori in the three-sphere with positive Ricci curvature.

This paper proposes grid cells encode position via a conformal isometric embedding of 2D physical space.

problem Hexagonal grid firing patterns in grid cells.
method Learning a distance-preserving position embedding in neural space using a recurrent neural network.
result The conformal isometric embedding of 2D physical space into neural space explains hexagonal grid firing patterns.

Forecasting the future traffic flow distribution in an area is an important issue for traffic management in an intelligent transportation system. The key challenge of traffic prediction is to capture spatial and temporal relations between future traffic flows and historical traffic due to highly dynamical patterns of h…

2019-04-12abs ↗pdf ↗

The paper proves the existence of embedded hypersurfaces of constant mean curvature in manifolds with positive Ricci curvature.

problem Proving the existence of embedded hypersurfaces of constant mean curvature in manifolds with positive Ricci curvature.
method Using the Allen--Cahn min-max scheme with a non-zero constant prescribing function.
result The existence of embedded, closed λ-CMC hypersurfaces with Morse index 1 for any prescribed non-zero constant λ.

We consider the problem of vertex classification for graphs constructed from the latent position model. It was shown previously that the approach of embedding the graphs into some Euclidean space followed by classification in that space can yields a universally consistent vertex classifier. However, a major technical d…

2013-05-21abs ↗pdf ↗

MEANTIME improves sequential recommendation by using multi-temporal embeddings and attention mechanisms.

problem Limited use of timestamp information and information bottleneck in sequential recommendation models.
method MEANTIME employs multiple types of temporal embeddings and attention mechanisms to capture diverse patterns from user behavior sequences.
result MEANTIME outperforms state-of-the-art sequential recommendation methods.

The study finds large Betti numbers in minimal hypersurfaces with positive Ricci curvature.

problem Minimal hypersurfaces with large Betti numbers in manifolds with positive Ricci curvature.
method Constructing sequences of manifolds with embedded minimal hypersurfaces.
result Minimal hypersurfaces have unbounded first Betti numbers.

Generalized Tanaka prolongation ensures convergence of formal embeddings of complex manifolds.

problem Ensuring convergence of formal embeddings of complex manifolds under weaker conditions.
method Formulated and proved generalized Tanaka prolongation for geometric structures.
result Convergence of formal embeddings holds under weaker semi-positive normal bundle conditions.

The study counts minimal surfaces in 3-manifolds with positive Ricci curvature.

problem Counting minimal surfaces in 3-manifolds with positive Ricci curvature.
method An enumerative min-max theorem linking surface counts to topological properties.
result Every 3-sphere of positive Ricci curvature contains at least 4 embedded minimal surfaces of genus 2.

In this article, we study a free boundary isometric embedding problem for abstract Riemannian two-manifolds with the topology of the disc. Under the assumption of positive Gauss curvature and geodesic curvature of the boundary being equal to one, we show that any such disc may be isometrically embedded into the Euclide…

2019-08-29abs ↗pdf ↗

Paper introduces a new distance measure for Gaussian Mixture Models.

problem Developing a new distance measure for Gaussian Mixture Models.
method Embedding K-component Gaussian Mixture Models into the manifold of symmetric positive definite matrices and calculating a lower bound for the Fisher-Rao metric.
result Demonstrated effectiveness through experiments on standard datasets.

Due to Čencov's theorem, there exists a unique family of invariant symmetric (0,2)(0,2)-tensor fields on the space of positive probability measures on a set of nn-points indexed by nNn\in \mathbb{N} under Markov embeddings. We deform Markov embeddings keeping sufficiency, and prove existence and uniqueness of invariant f…

2019-10-27abs ↗pdf ↗

The study shows that ergodic measures are not generic on non-positively curved manifolds.

problem Determining the genericity of ergodic measures on non-positively curved Riemannian manifolds.
method Investigates the existence of an open isometric embedding of a product manifold with a factor isometric to S1S^1.
result The closure of the set of ergodic measures does not encompass all invariant measures, indicating the failure of genericity.

Kodaira embedding theorem provides an effective characterization of projectivity of a Kähler manifold in terms the second cohomology. Recently X. Yang [21] proved that any compact Kähler manifold with positive holomorphic sectional curvature must be projective. This gives a metric criterion of the projectivity in terms…

2018-04-25abs ↗pdf ↗