We extend the Fourier cosine method to discrete probability distributions, achieving faster convergence rates.
problem Extending Fourier cosine method to discrete probability distributions.
method Spectral filters and convergence rates analysis.
result Spectral filters achieve one order faster convergence rates than previously recognized.
We introduce a new discretization of O'Hara's Möbius energy. In contrast to the known discretizations of Simon and Kim and Kusner it is invariant under Möbius transformations of the surrounding space. The starting point for this new discretization is the cosine formula of Doyle and Schramm. We then show Γ-convergence…
Cosine schedule is optimal for discrete diffusion models.
problem Choosing the best discretization schedule for diffusion models.
method Optimized using Fisher-Rao geometry.
result Cosine schedule is Fisher-Rao optimal.
New algorithm defends against adversarial examples in image classification.
problem Defending against adversarial examples in image classification.
method Approximates Discrete Fourier transform of sparse signals corrupted by L0 noise. result Successfully defends against L0 adversaries in image classification. The spherical Radon transform on the unit sphere can be regarded as a member of the analytic family of suitably normalized generalized cosine transforms. We derive new formulas for these transforms and apply them to study classes of intersections bodies in convex geometry.
We study rigidity of polyhedral surfaces and the moduli space of polyhedral surfaces using variational principles. Curvature like quantities for polyhedral surfaces are introduced. Many of them are shown to determine the polyhedral metric up to isometry. The action functionals in the variational approaches are derived …
Improved text classification performance through conformal transformations of kernels.
problem Text document categorization in high-dimensional spaces.
method Introduced new Gaussian Cosine kernel and two conformal transformations.
result Conformal transformations significantly improve kernel performance, especially for sub-optimal kernels.
Fast object detection in JPEG images without decompression.
problem Efficient object detection in compressed JPEG images.
method Modified SSD with DCT coefficients input processing.
result 2x faster detection with promising performance.
The paper proposes efficient dictionary learning algorithms that avoid multiplications for sparse representations.
problem Sparse representation with reduced computational complexity.
method Factorizations of the dictionary into binary orthonormal, scaling, and shear transformations with closed-form solutions.
result The proposed methods are effective and can be compared to well-known transforms like FFT and DCT.
A new MLDS model captures nonlinear tensor time series with improved accuracy and efficiency.
problem Modeling and analyzing nonlinear tensor time series data.
method Transform-based multilinear dynamical system (MLDS) with EM algorithm for parameter estimation.
result Significantly higher prediction accuracy and exponential improvement in training time compared to state-of-the-art models.
Automatically learns efficient algorithms for structured transforms like FFT.
problem Efficient algorithms for structured linear transforms.
method Generic parameterization of divide-and-conquer methods.
result Reproduces Cooley-Tukey FFT algorithm to machine precision.
Paper proposes graph-based separable transforms for video coding.
problem Improving video coding efficiency by better capturing residual block statistics.
method Derives graph-based separable transforms (GBSTs) from line graphs with weights determined by parameters.
result GBSTs achieve about 0.4% average coding gain over existing transforms in VVC.
DCT-SNN uses DCT to reduce inference latency in SNNs.
problem High inference latency in SNNs.
method Proposes a time-based encoding scheme using DCT to reduce timesteps.
result Achieves top-1 accuracy comparable to standard deep learning while reducing inference latency.
Proposes AWS method for precise speech enhancement using DNN.
problem T-F resolution problem in fixed-resolution short-time frequency transforms.
method Incorporates trainable adaptive window switching into speech enhancement procedure.
result Achieved higher signal-to-distortion ratio than conventional methods.
A new quasi-Newton method tackles NMF with transform learning on orthogonal manifolds.
problem Efficiently learning transforms for NMF in non-convex optimization on orthogonal manifolds.
method Derives a quasi-Newton method on the orthogonal matrix manifold using sparse approximations of the Hessian.
result Outperforms state-of-the-art methods by orders of magnitude in experiments on synthetic and real audio data.
The note evaluates different methods for option pricing using Shannon Wavelets.
problem Efficient computation of Shannon Wavelet coefficients for option pricing.
method Evaluation of cosine expansion, direct algorithms, and Filon quadrature.
result Filon quadrature is more efficient for computing Shannon Wavelet coefficients.
Generates high-quality images using sparse DCT representations.
problem Challenges in generating images due to high dimensionality.
method Transformers trained on sparse DCT block sequences.
result Competitive image generation quality with state-of-the-art methods.
The Lp-cosine transform of an even, continuous function $f\in C_e(\Sn)$ is defined by: $$H(x)=\int_{\Sn}|\ip{x}ξ|^pf(ξ) dξ,\quad x\in {\R}^n.$$ It is shown that if p is not an even integer then all partial derivatives of even order of H(x) up to order p+1 (including p+1 if p is an odd integer) exist and ar…
Robust Transformer-Based One-Step Stock Index Forecasting via Shifted Data Augmentation
problem Robust stock index forecasting
method Modified Transformer architecture with Shifted Data Augmentation
result Best performance on benchmark datasets
A new topology design improves zero-shot classification performance in contrastive learning.
problem Improving zero-shot classification performance in contrastive visual-textual alignment.
method Proposed an alternative topology design using multiple class tokens and an oblique manifold with negative inner product.
result Improves zero-shot classification performance by an average of 6.1%.
Improved CNN with general image processing kernels reduces training time and achieves high accuracy.
problem Training time and accuracy of CNNs.
method Used 41 general-purpose kernels for the first layer of CNNs.
result GFNN reduces training time by 30% and achieves 99.56% accuracy.
iCOS method estimates risk-neutral densities and option prices without model assumptions.
problem Estimating risk-neutral densities and option prices without model assumptions.
method Leverages Fourier-cosine technique using option-implied cosine series coefficients, without model assumptions.
result Effective in extracting information from option prices under various market conditions.
Modified cosine distance improves similarity performance in data with variance and correlation.
problem Limitations of traditional cosine similarity in random variable spaces with variance and correlation.
method Proposed a variance-adjusted cosine distance metric to overcome limitations of traditional cosine similarity.
result Modified cosine distance shows 100% test accuracy in KNN model on the Wisconsin Breast Cancer Dataset.
A solution of Hilberts fourth problem lead to integral equation of the type generalized cosine transform. The present paper considers the solution that integral equation by integral geometry methods and propose an inversion formula for reconstruction of Crofton measures from projective smooth Finsler metrics in R3.
Improved MoE performance through perturbing cosine router.
problem Representation collapse and parameter redundancy in MoE models.
method Least square estimation of cosine router in MoE, followed by noise addition to improve convergence rates.
result Perturbed cosine router leads to polynomial convergence rates for MoE models.
A new geometric metric identifies true data changes from parametrization artifacts in high-dimensional representations.
problem Quantifying representation drift in high-dimensional data using Euclidean or cosine distances can misattribute changes due to arbitrary parametrizations.
method Introducing the Fubini Study metric to identify representations that differ only by gauge transformations.
result The Fubini Study metric isolates intrinsic evolution by remaining invariant under gauge-induced fluctuations, providing a diagnostic for meaningful structural changes.
Coherent Multiplex analyzes real-time wavelet coherence among multiple signals.
problem Identifying and visualizing coherence among multiple time series.
method Fast spectral similarity based on cosine similarity metrics of Fourier-transformed signals and sparse time-frequency wavelet coherence.
result Scalable real-time system for low-latency inference and monitoring of inter-signal relationships.
This study shows how DDPM can be represented by the OU process.
problem Designing optimal noise schedules for DDPM.
method Formal equivalence between DDPM and OU process, heuristic designs based on Fisher Information.
result Fisher-Information-motivated schedule corresponds to cosine noise schedule.
A new NUFFT method speeds up option pricing for various strikes.
problem Efficiently pricing many options of the same maturity but different strikes.
method Non-uniform fast Fourier transform (NUFFT) applied to the COS method.
result Significantly faster computation of option prices.
DeformRS certifies deep networks against various input deformations.
problem Vulnerability of deep networks to input deformations.
method Randomized smoothing reformulation for general deformations.
result Certifies rich deformations including translations, rotations, scaling, and affine.
Traditionally, multi-layer neural networks use dot product between the output vector of previous layer and the incoming weight vector as the input to activation function. The result of dot product is unbounded, thus increases the risk of large variance. Large variance of neuron makes the model sensitive to the change o…
Researchers establish bounds and continuity of decomposed Möbius energies using cosine formula.
problem Estimating the bounds and continuity of decomposed Möbius energies.
method Using the cosine formula to evaluate upper and lower bounds and modulus of continuity of decomposed energies.
result Affirmative answer to the question of estimating decomposed energies using the cosine formula.
New method linearizes Darboux transformations of discrete curves.
problem Linearizing Darboux transformations of discrete curves.
method Expressing Darboux transformations as parallel sections of discrete connections in quaternionic formalism.
result Closed-form discrete parametrisations of all Darboux transforms and bicycle correspondences.
Geometric approach uses Bäcklund transformations to create integrable discrete analogs of surface nets.
problem Creating integrable discrete analogs of surface nets and conjugate nets.
method Interpreting classical differential geometry results through Bäcklund transformations and applying permutability properties.
result Integrable discrete analogs of asymptotic and conjugate nets are constructed.
QFDA combines machine learning and information theory for image classification.
problem Lack of literature on combining machine learning and information theory.
method Quantized Fisher Discriminant Analysis (QFDA) using a cost function for rate-distortion optimization.
result QFDA achieves at least as good classification accuracy as FDA on quantized images.
New geometric transformations link discrete and continuous curve motions.
problem Establishing a connection between discrete and continuous curve motions.
method Infinitesimal Darboux transformations of smooth curves.
result Alternate geometric interpretation for semi-discrete mKdV equation.
We study the dynamics of the discrete bicycle (Darboux, Backlund) transformation of polygons in n-dimensional Euclidean space. This transformation is a discretization of the continuous bicycle transformation, recently studied by Foote, Levi, and Tabachnikov. We prove that the respective monodromy is a Moebius transform…
Derives hyperbolic laws of cosines and sines with fermionic corrections.
problem Deriving hyperbolic laws of cosines and sines with new mathematical corrections.
method Using Minkowski supergeometry, the laws of cosines and sines are derived in the super hyperbolic plane.
result Identical formulae to classical cases with fermionic corrections for cosines and sines.
Permutability of surface transforms yields discrete analogs.
problem Discretization of smooth surfaces with specific properties.
method Permutability of transforms of smooth surfaces.
result Discrete surfaces with discrete analogs of original properties.
Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS which was otherwise hard. In the prior work, the authors use asymmetric transformations which convert th…
Cosine similarity can force points to grow in magnitude, causing convergence issues.
problem Cosine similarity loss can lead to convergence issues in deep learning.
method Analyzing under-explored settings and proposing cut-initialization.
result Cosine similarity optimization forces points to grow in magnitude, leading to convergence issues.
This work shows cosine similarity is equivalent to Pearson correlation for word vectors, but not all vectors are suitable for cosine.
problem The use of cosine similarity for semantic textual similarity is often taken for granted, despite its limitations.
method Characterized cases where Pearson correlation is unfit and introduced rank correlation as an alternative.
result Pearson correlation is equivalent to cosine similarity for many word vectors but not all, and rank correlation can improve performance.
The worldwide surge of multiresistant microbial strains has propelled the search for alternative treatment options. The study of Protein-Protein Interactions (PPIs) has been a cornerstone in the clarification of complex physiological and pathogenic processes, thus being a priority for the identification of vital compon…
We study the rigidity of polyhedral surfaces using variational principle. The action functionals are derived from the cosine laws. The main focus of this paper is on the cosine law for a non-triangular region bounded by three possibly disjoint geodesics. Several of these cosine laws were first discovered and used by Fe…
A new method for discrete data normalizing flows using latent transformations.
problem Challenges in parameterizing bijective transformations for discrete data.
method Predict a distribution over latent transformations to make the marginal likelihood differentiable.
result Discrete-data normalizing flows can be trained using gradient-based learning with unbiased score function estimation.
Cosine loss improves CNN performance on small datasets.
problem Training CNNs from scratch on small datasets without pre-training.
method Used cosine loss instead of cross-entropy loss.
result Accuracy on CUB-200-2011 dataset is 30% higher with cosine loss.
New Bäcklund transformations for discrete pseudospherical surfaces of revolution are found.
problem Constructing new non-rotational discrete pseudospherical surfaces.
method Explicit parametrizations and Bäcklund transformations for discrete constant negative Gaussian curvature surfaces of revolution.
result Conditions for Bäcklund transformations to preserve periodicity are provided.
New method for European option pricing faster and more robust.
problem Pricing European options efficiently and accurately.
method Fourier cosine series expansions for models with known characteristic functions.
result More robust and faster than the original COS method.