Firm size data usually do not show the normality that is often assumed in statistical analysis such as regression analysis. In this study we focus on two firm size data: the number of employees and sale. Those data deviate considerably from a normal distribution. To improve the normality of those data we transform them…
Improves Gaussian process for non-Gaussian time series with efficient training and warping.
problem Modeling non-Gaussian time series with complex correlation structures.
method Combines Gaussian processes with Box-Cox transformation for efficient training and inference.
result Analytical predictions and improved performance on real-world datasets.
Novel power transform unifies various mathematical functions.
problem Normalizing and standardizing datasets.
method Presented a novel power transform.
result Unified various mathematical functions.
Improves data normality with robust transformations.
problem Skewed data distribution.
method Modified Box-Cox and Yeo-Johnson transformations with robust parameter estimation.
result Transformed data approximates normality in the center with outliers.
Approaches for big data regression using sufficient statistics.
problem Challenges in computing closed-form solutions for large datasets.
method Multiple learning approaches using sufficient statistics arrays.
result Achieves closed-form solutions for multiple models at half the training time of traditional methods.
Study extends geodesic ray transform results to orientable surfaces.
problem Characterize and stabilize mixed and transverse ray transforms on surfaces.
method Algebraic arguments applied to various geometries and ray transforms.
result Characterization of kernel and stability for mixed and transverse ray transforms on orientable surfaces.
Classifies different types of Darboux transformations for multidimensional operators.
problem Classifying Darboux transformations for multidimensional operators.
method Analyzes all known types of Darboux transformations and introduces new types.
result Full classification of first-order Darboux transformations and a description of higher-order transformations.
The paper introduces models to learn generalized transformation equivariant representations.
problem Capturing intrinsic visual structures equivariant to various transformations.
method Deterministic and probabilistic AutoEncoding Transformations (AET and AVT) models trained to learn visual representations from generic groups of transformations.
result Generalized TERs (GTERs) that are equivariant to transformations in a more general fashion.
New filter bank sparsifying transforms outperform patch-based methods for image denoising.
problem Improving image denoising performance using data-adaptive sparsifying transforms.
method Proposes a new transform learning framework using undecimated perfect reconstruction filter banks, allowing independent filter length choice.
result Filter bank sparsifying transforms outperform existing patch-based methods for image denoising.
Integration procedure for Lie groupoid natural transformations.
problem Infinitesimal counterpart of natural transformations in Lie groupoids.
method Integration procedure for Lie groupoid morphisms.
result Provides smooth natural transformations between Lie groupoid morphisms.
Proposes differential and integral invariants under Mobius transformation.
problem Handling non-rigid deformation in 2-D and 3-D shapes.
method Focuses on Mobius transformation, proposes differential and integral invariants.
result Proposes differential and integral invariants under Mobius transformation.
New Lehmer Transform for analyzing non-stationary signals.
problem Analyzing non-stationary signals like brain waves.
method Proposes a new Lehmer Transform to decompose statistical moments.
result Theoretical properties of the Lehmer Transform are presented.
Introduces pseudo-codecomposition of transformation groups.
problem Understanding and categorizing transformation groups.
method Introduces pseudo-codecomposition and analyzes properties of transformation groups.
result The class of pseudo-codecomposable transformation groups is a proper intermediate class.
This paper investigates efficient Transformers and finds they scale with problem size.
problem Finding suitable replacements for standard Transformers in large-scale tasks.
method Modeling efficient Transformers (Sparse and Linear) as Dynamic Programming problems and analyzing their reasoning capabilities.
result Efficient Transformers scale with problem size, but can be more efficient for certain DP problems.
The conformal geometry of spacelike surfaces in 4-dimensional Lorentzian space forms has been studied by the authors in a previous paper, where the so-called polar transform was introduced. Here it is shown that this transform preserves spacelike conformal isothermic surfaces. We relate this new transform with the know…
Paper improves tensor completion using unitary transforms.
problem Robust tensor completion for various datasets.
method Transformed tensor SVD with unitary matrices.
result Recovered images have better PSNR than traditional methods.
Transforms classical connections using pushforwards and gauge transformations.
problem Transforming classical connections in categorical settings.
method Constructing pushforwards and applying gauge transformations to decorated path spaces.
result Combines traditional gauge transformation with affine translation.
Paper introduces graph-based transforms for video compression.
problem Efficiently represent video signals for compression.
method Develops two techniques for designing graph-based transforms (GL-GBTs and EA-GBTs).
result Graph-based transforms outperform traditional KLT in video compression.
Transformers interpret as probabilistic mixtures, offering new insights.
problem Understanding Transformers from a probabilistic perspective.
method Modeling Transformers as mixtures of Gaussian models.
result Transformers can be seen as maximum posterior probability estimators.
Study normal operators of double fibration transforms with conjugate points.
problem Normal operators of double fibration transforms with conjugate points.
method Stable conditions on the distribution of conjugate points, splitting into elliptic and Fourier integral operators.
result Normal operator splits into an elliptic pseudodifferential operator and Fourier integral operators.
Transformer-MGK replaces redundant heads with Gaussian key mixtures, improving efficiency and performance.
problem Redundant attention heads in transformers degrade performance and efficiency.
method Transformer-MGK replaces redundant heads with a mixture of Gaussian keys.
result Transformer-MGK accelerates training and inference, reduces parameters and FLOPs, and achieves comparable or better accuracy.
Adversarial learning improves image augmentation for neural networks.
problem Improving data augmentation for neural networks with limited data.
method Adversarial learning using an encoder-decoder architecture with a spatial transformer network.
result Our approach outperforms previous generative data augmentation methods.
B-cos transformers explain Vision Transformers' decisions.
problem Lack of holistic explanations for transformer outputs.
method Formulate each component as dynamic linear, allowing a single linear transform for summarization.
result Bcos-ViTs are highly interpretable and competitive on ImageNet.
The paper examines how polarized curves behave near singular points.
problem Analyzing the behavior of polarized curves near singular points.
method Investigates the limiting behavior of Darboux and Calapso transforms of polarized curves in the conformal n-dimensional sphere.
result For a pole of first order, all transforms converge to the original curve. For a pole of second order, a generic Darboux transform converges, but a Calapso transform has a limit point or circle.
The paper analyzes transformation models in high-dimensional settings.
problem Analyzing transformation models in high-dimensional data.
method Proposed an estimator for transformation parameter and showed asymptotic normality.
result The proposed estimator works well in small samples and tests the log-wage transformation.
XR-Transformer accelerates XMC by recursively fine-tuning on multi-resolution objectives.
problem Efficiently classifying texts with large label sets.
method Recursive multi-resolution fine-tuning of transformers.
result XR-Transformer achieves 20x faster training time and 54% Precision@1 on Amazon-3M.
Algorithm finds optimal affine transformation to minimize overall distortion.
problem Minimizing distortion in affine transformations.
method Riemannian geometry approach to define and minimize distortion.
result Mean distorting transformation found for minimizing overall distortion.
We study the dynamics of the discrete bicycle (Darboux, Backlund) transformation of polygons in n-dimensional Euclidean space. This transformation is a discretization of the continuous bicycle transformation, recently studied by Foote, Levi, and Tabachnikov. We prove that the respective monodromy is a Moebius transform…
Transformers struggle to approximate smooth functions, relying on piecewise constant approximations.
problem Understanding the expressivity of Transformers for function approximation.
method Theoretical analysis and experimental validation of Transformer's ability to approximate smooth functions.
result Transformers cannot reliably approximate smooth functions, relying on piecewise constant approximations.
The Weyl transform is introduced as a rich framework for data representation. Transform coefficients are connected to the Walsh-Hadamard transform of multiscale autocorrelations, and different forms of dyadic periodicity in a signal are shown to appear as different features in its Weyl coefficients. The Weyl transform …
Defines gauge transformations for Jacobi structures and their effects on contact groupoids.
problem Understanding transformations of Jacobi structures and their implications.
method Definition and discussion of gauge transformations for Jacobi structures and their impact on contact groupoids.
result Gauge transformations affect the contact structure of contact groupoids.
Gaussian process quadrature improves moment transformation accuracy.
problem Computing moments of transformed Gaussian variables with error accounting.
method Bayesian quadrature (Gaussian process quadrature) for numerically estimating integrals.
result Proposed method outperforms classical quadrature methods in accuracy.
We define a transformation on harmonic maps from a Riemann surface into the 2-sphere which depends on a complex parameter, the so-called mu-Darboux transformation. In the case when the harmonic map N is the Gauss map of a constant mean curvature surface f and the parameter is real, the mu-Darboux transformation of -N i…
Transforms surfaces into spheres using mean curvature.
problem Transforming surfaces into spheres.
method Transformation based on mean curvature.
result Surfaces morphed into round spheres.
We begin by considering several properties commonly (but not universally) possessed by Bäcklund transformations between hyperbolic Monge-Ampère equations: wavelike nature of the underlying equations, preservation of independent variables, quasilinearity of the transformation, and autonomy of the transformation. We show…
Geometrizes second order Lagrangians transformations.
problem No specific problem stated; focuses on geometrization.
method Building a proper Tulczyjew's triplet.
result Symplectic relation between Ostrogradsky-Legendre and Schmidt-Legendre transformations.
Geometric approach uses Bäcklund transformations to create integrable discrete analogs of surface nets.
problem Creating integrable discrete analogs of surface nets and conjugate nets.
method Interpreting classical differential geometry results through Bäcklund transformations and applying permutability properties.
result Integrable discrete analogs of asymptotic and conjugate nets are constructed.
ETs improve model robustness to transformations in images.
problem Improving model robustness to predefined transformations.
method Equivariant Transformers (ETs) incorporating functions equivariant to continuous transformation groups.
result ETs achieve up to 15% relative improvement in error rate on image classification tasks.
New geometric transformations link discrete and continuous curve motions.
problem Establishing a connection between discrete and continuous curve motions.
method Infinitesimal Darboux transformations of smooth curves.
result Alternate geometric interpretation for semi-discrete mKdV equation.
SPTN uses invertible transformations to improve sum-product networks.
problem Improving inference efficiency and tractability in sum-product networks.
method Integrates invertible transformations into sum-product networks (SPNs).
result SPTNs with Gaussian leaves and affine transformations are as tractable as SPNs.
Extracts transformations from images without supervision.
problem Learning meaningful image transformations from unlabeled data.
method Unsupervised learning via convex relaxation of linear combinations of nearest neighbors.
result Generated high-quality modified images with linear transformations.
Proves upper bounds for Bäcklund transformations in hyperbolic systems.
problem Bounding the generality of Bäcklund transformations in hyperbolic systems.
method Cartan's Method of Equivalence, classification results for specific symmetry groups.
result Obtains classification results and new examples of auto-Bäcklund transformations.
FEDformer combines Transformer with seasonal-trend decomposition for efficient long-term forecasting.
problem Transformer's inefficiency and inability to capture global time series views.
method Combines seasonal-trend decomposition with Transformer, exploiting Fourier basis for frequency enhancement.
result Reduces prediction error by 14.8% and 22.6% for multivariate and univariate time series, respectively.
One-layer transformers can't solve induction heads task efficiently.
problem Solving the induction heads task efficiently with one-layer transformers.
method Communication complexity argument showing exponential size requirement.
result No one-layer transformer can solve the induction heads task efficiently.
BoostTransformer uses boosting to improve transformer efficiency and accuracy.
problem Heavy computational resources and hyperparameter tuning in transformer architectures.
method Augments transformers with boosting principles through subgrid token selection and importance-weighted sampling, incorporating a least square boosting objective directly into the pipeline.
result BoostTransformer demonstrates faster convergence and higher accuracy compared to standard transformers.
W-Transformers use wavelets to improve time series forecasting.
problem Forecasting non-stationary time series with long-range dependencies.
method Wavelet-based transformer architecture.
result W-Transformers outperform baseline models on various time series datasets.
We study an analogue of the classical Bianchi-Darboux transformation for L-isothermic surfaces in Laguerre geometry, the Bianchi-Darboux transformation. We show how to construct the Bianchi-Darboux transforms of an L-isothermic surface by solving an integrable linear differential system. We then establish a permutabili…
Transforms improve CNNs' invariance to image transformations.
problem Current CNN models lack robustness to spatial transformations.
method Randomly transform feature maps during training to learn invariant representations.
result Significant improvements on benchmark tasks, including image recognition and retrieval.