Geometrically, Legendrian surfaces related by surgery have related skein-valued cluster spaces.
problem Understanding the skein-valued cluster transformation in Legendrian surfaces.
method Geometric considerations of moduli of holomorphic curves.
result Skein-valued cluster transformation of Legendrian surfaces related by surgery.
The paper derives and proves the Helgason Fourier transform for vector bundle-valued differential forms on homogeneous spaces.
problem Deriving the Helgason Fourier transform for vector bundle-valued differential forms on homogeneous spaces.
method Employing the perspective of the functional equation satisfied by the classical Fourier transform, the paper derives the Helgason Fourier transform map and proves its properties.
result The Fourier transform is explicitly given and proven to be a map from vector bundle-valued differential forms to another vector bundle-valued differential form on the product space.
Enhances Transformers for better risk assessment in finance.
problem Transformer models lack sensitivity to extreme financial losses.
method Integrates Loss-at-Risk function with Value at Risk (VaR) and Conditional Value at Risk (CVaR).
result Improves risk prediction and management in financial datasets.
Imputation-free method learns tabular data with missing values using transformer.
problem Machine learning on tabular data with missing values often leads to unreliable outcomes due to synthetic imputation.
method Incremental attention learning (IFIAL) using transformer with attention masks.
result IFIAL outperforms state-of-the-art methods in 17 diverse tabular data sets.
We give a construction of a Poisson transform mapping density valued differential forms on generalized flag manifolds to differential forms on the corresponding Riemannian symmetric spaces, which can be described entirely in terms of finite dimensional representations of reductive Lie groups. Moreover, we will explicit…
Researchers improve imputation of missing data using diffusion transformers, quantifying uncertainty.
problem Enhancing the quality of time-series data with missing values.
method Conditional diffusion transformers for imputation, with statistical sample complexity bounds and uncertainty quantification.
result Theoretical insights into the efficiency and accuracy of imputation, influenced by missing patterns.
This paper reviews digital transformation research from 2011-2024, focusing on corporate finance.
problem Lack of systematic review in digital transformation from corporate finance perspective.
method Combines bibliometric and content analysis methods.
result Emerging and rapidly growing focus on digital transformation, particularly in developed countries.
Improved singular value approximation for convolutional layers.
problem Improving accuracy of singular value approximation for linear convolutional layers.
method Developed a new spectral density matrix method for singular value approximation with improved accuracy and reduced computational complexity.
result Obtained moderate improvement in singular value distribution compared to circular approximation.
The p-Laplacian Transformer improves transformer models by assigning higher attention weights to tokens in close proximity.
problem The self-attention mechanism in transformers does not effectively distinguish attention weights between tokens in close and non-close proximity.
method Proposes a novel class of transformers, p-Laplacian Transformers, that use p-Laplacian regularization to assign higher attention weights to tokens in close proximity. result Empirically demonstrates that p-Laplacian Transformers outperform baseline transformers on various benchmark datasets.
Pion optimizes LLMs by preserving weight matrix singular values.
problem Training large language models (LLMs) with standard optimizers leads to unstable weight matrices.
method Pion uses orthogonal transformations to update weight matrices, preserving their singular values.
result Pion offers a stable alternative to standard optimizers for LLM pretraining and finetuning.
Transformers learn to predict chess moves with surprising accuracy and strength.
problem Training transformers on chess to predict moves accurately.
method Large-scale chess dataset (10M games), supervised learning with up to 270M parameters.
result Transformers can predict action-values for novel boards with high accuracy.
Quantum SVT reduces credit risk analysis costs.
problem Efficiently estimating credit risk metrics using quantum computing.
method Quantum Singular Value Transformation (QSVT) to reduce state preparation costs.
result Significant reduction in implementation costs for quantum credit risk analysis.
A new model designs molecules with desired properties.
problem Finding molecules with optimal chemical or biological properties.
method A latent prompt Transformer model with three components: latent vector, molecule generation, and property prediction.
result The model achieves state-of-the-art performance on molecule design tasks.
Simplified calculus for semimartingales makes complex transformations easier.
problem Complex transformations of semimartingales.
method Unified treatment of transformations for real and complex semimartingales.
result Unified calculus for semimartingales simplifies various transformations.
We propose a simple yet powerful framework for modeling integer-valued data, such as counts, scores, and rounded data. The data-generating process is defined by Simultaneously Transforming and Rounding (STAR) a continuous-valued process, which produces a flexible family of integer-valued distributions capable of modeli…
While deep learning has received a surge of interest in a variety of fields in recent years, major deep learning models barely use complex numbers. However, speech, signal and audio data are naturally complex-valued after Fourier Transform, and studies have shown a potentially richer representation of complex nets. In …
New method predicts y distributions from imperfect data.
problem Predicting y from imperfect data (discrete, truncated, censored).
method Optimal transformations to estimate p(y|x).
result Estimates location, scale, and shape of y distribution.
We incorporate Tensor-Product Representations within the Transformer in order to better support the explicit representation of relation structure. Our Tensor-Product Transformer (TP-Transformer) sets a new state of the art on the recently-introduced Mathematics Dataset containing 56 categories of free-form math word-pr…
New insights into X-ray transform on hyperbolic disk, with functional relations and range characterizations.
problem Understanding the X-ray transform on hyperbolic geometry.
method Derived new singular value decompositions, range characterizations, and intertwining relations with wedge-type differential operators.
result Sharp understanding of boundary behavior and invertibility settings for the X-ray transform.
We present a new construction for Poisson transforms between vector bundle valued differential forms on homogeneous parabolic geometries and the corresponding Riemannian symmetric space, which can be described in terms of finite dimensional representations of reductive Lie groups. In particular, we use these operators …
Recovering matrix valued potentials from wave equation data on stationary spacetimes.
problem Recovering a time-dependent matrix valued potential from wave equation data.
method Reduction to non-Abelian light ray transform and study of the transform.
result Sufficient conditions for solving the inverse problem on stationary spacetimes.
Novel power transform unifies various mathematical functions.
problem Normalizing and standardizing datasets.
method Presented a novel power transform.
result Unified various mathematical functions.
QTRAN++ improves MARL performance in complex environments.
problem Poor empirical performance of QTRAN in complex environments.
method Stabilizing training objective, removing role separation, and introducing a multi-head mixing network.
result QTRAN++ achieves state-of-the-art performance in the Starcraft Multi-Agent Challenge (SMAC).
Transform non-private e-values into differentially private ones.
problem Leaking sensitive data through non-private e-values.
method Developed a novel biased multiplicative noise mechanism.
result Differentially private e-values maintain strong statistical power and asymptotic equivalence to non-private ones.
We show injectivity of the X-ray transform and the d-plane Radon transform for distributions on the n-torus, lowering the regularity assumption in the recent work by Abouelaz and Rouvière. We also show solenoidal injectivity of the X-ray transform on the n-torus for tensor fields of any order, allowing the tensor…
Paper improves tensor completion by reducing sample entries needed.
problem Reducing the number of required sample entries for tensor completion.
method Utilizes multi-rank and unitary transformation in tensor singular value decomposition.
result Provides a bound on the number of required sample entries for tensor completion.
This research explores complex-valued neural networks and their implementation.
problem The challenges of implementing complex-valued neural networks and their potential for non-complex data.
method Detailed theory and implementation of CVNN, including Wirtinger calculus, complex backpropagation, and modules like complex layers and activation functions. Python implementation using cvnn toolbox.
result Demonstrates the potential of CVNN for non-complex data through simulations.
SurVAE Flows combine VAEs and flows using surjective transformations.
problem Combining the strengths of VAEs and flows to model complex densities.
method Modular framework of composable deterministic and stochastic transformations.
result Exact likelihood computation and lower bound on likelihood.
In this paper we consider Fourier transform techniques to efficiently compute the Value-at-Risk and the Conditional Value-at-Risk of an arbitrary loss random variable, characterized by having a computable generalized characteristic function. We exploit the property of these risk measures of being the solution of an ele…
Transformer model improves asset allocation by unifying forecasting and optimization.
problem Separation of forecasting and optimization leads to suboptimal portfolios.
method Signature Informed Transformer using path signatures and specialized attention.
result Direct minimization of Conditional Value at Risk improves performance.
We introduce the 2-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors. We show that this architecture is a useful inductive …
In this paper, we study robust tensor completion by using transformed tensor singular value decomposition (SVD), which employs unitary transform matrices instead of discrete Fourier transform matrix that is used in the traditional tensor SVD. The main motivation is that a lower tubal rank tensor can be obtained by usin…
Equivariant CNNs improve RL performance in symmetric environments.
problem Learning equivariant representations for RL in symmetric environments.
method Proposed and studied equivariant CNNs for RL.
result Equivariant CNNs enhance RL performance and sample efficiency.
Spacetimeformer learns spatiotemporal relationships from data alone.
problem Forecasting multivariate time series with distinct spatial relationships.
method Transformers with dynamic graph connections learning interactions between space, time, and value.
result Competitive results on various time series prediction benchmarks.
Transforms uniquely determine Higgs fields on real-analytic manifolds.
problem Determining Higgs fields from transforms on manifolds.
method Matrix-weighted real-analytic double fibration transforms.
result Higgs fields can be uniquely determined from transforms.
In the 3-gauge theory, a 3-connection is given by a 1-form A valued in the Lie algebra g, a 2-form B valued in the Lie algebra h and a 3-form C valued in the Lie algebra l, where (g,h,l) constitutes a differential 2-crossed modu…
We reduce boundary determination of an unknown function and its normal derivatives from the (possibly weighted and attenuated) broken ray data to the injectivity of certain geodesic ray transforms on the boundary. For determination of the values of the function itself we obtain the usual geodesic ray transform, but for…
The visibility transformation embeds data position into signature features for efficient pattern recognition.
problem Embedding absolute position into signature features for efficient pattern recognition.
method The visibility transformation is put on a theoretical footing and used to embed absolute position into signature features efficiently.
result The generated feature set simplifies pattern recognition by accommodating nonlinear functions of absolute and relative values.
We study the limiting behaviour of Darboux and Calapso transforms of polarized curves in the conformal n-dimensional sphere, when the polarization has a pole of first or second order at some point. We prove that for a pole of first order, as the singularity is approached all Darboux transforms converge to the original …
This paper shows using classification instead of regression improves deep RL scalability.
problem Challenges in training value functions for large networks in deep RL.
method Used categorical cross-entropy loss instead of mean squared error regression.
result Significant improvements in performance and scalability across various domains.
We first give a constructive answer to the attenuated tensor tomography problem on simple surfaces. We then use this result to propose two approaches to produce vector-valued integral transforms which are fully injective over tensor fields. The first approach is by construction of appropriate weights which vary along t…
New insights show stochastic initialization prevents token clustering in deep Transformers.
problem Understanding token dynamics in deep stochastic Transformers.
method Analysis of deep Transformers with random initialization noise, proving convergence to an interacting-particle system on the sphere.
result Initialization noise prevents token clustering, leading to antipodal formations.
Given a real-valued function defined on the Heisenberg group, we provide a definition of abstract convexity and Fenchel transform that takes into account the sub-Riemannian structure of the group. In our main result, we prove that, likewise the Euclidean case, a convex function can be characterized via its iterated Fen…
SISR improves feature attribution in complex payoff schemes.
problem Distorted feature attributions due to non-additive payoff functions and high-dimensional feature spaces.
method Sparse Isotonic Shapley Regression (SISR) learns a monotonic transformation to restore additivity and enforces L0 sparsity.
result SISR achieves strong support recovery and stable attributions across various payoff schemes.
Solves problem of describing transformations for upper triangular Toeplitz operators.
problem Describing coordinate transformations preserving upper triangular Toeplitz form of operator fields.
method Implicit formulas involving matrix-valued functions for describing transformations and Nijenhuis operators.
result Formulas for coordinate transformations and Nijenhuis operators in upper triangular Toeplitz form.
New bounds adaptively control spectral complexity of trained Transformers.
problem Understanding why Transformers generalize well in machine learning.
method Spectrum-adaptive post hoc generalization bounds for multi-layer Transformers.
result Bounds adaptively trade off spectral complexity against dimension and depth factors.
We introduce (binary) Darboux transformation for general differential equation of the second order in two independent variables. We present a discrete version of the transformation for a 6-point difference scheme. The scheme is appropriate to solving a hyperbolic type initial-boundary value problem. We discuss several …
Preformer improves Transformer for long-term time series forecasting.
problem Transformer's quadratic complexity and lack of context-awareness for long-term forecasting.
method Introduces Multi-Scale Segment-Correlation mechanism for efficient time series segmentation and context-aware attention.
result Preformer outperforms other Transformer-based methods in long-term time series forecasting.