This paper extends depth separation results to piece-wise oscillatory functions.
problem Approximating functions with piece-wise oscillatory structure using neural networks.
method Extends existing results to piece-wise oscillatory functions using proof strategy from (Eldan and Shamir, 2016).
result Approximation by one-hidden-layer networks holds at a poly(d) rate for functions with constant domain radius and oscillation rate.
Study oscillatory integrals with degenerate singular points in multivariable phase functions.
problem Analyzing oscillatory integrals with degenerate singular points in phase functions.
method Using asymptotic expansions and results from one variable, the study examines multivariable phase functions.
result Asymptotic expansions of oscillatory integrals for multivariable phase functions with degenerate singular points.
The paper calculates asymptotic expansions for specific types of oscillatory integrals.
problem Analyzing oscillatory integrals with complex phase functions.
method Using asymptotic expansions of simpler phase functions to derive results for more complex cases.
result Explicit computation of coefficients in asymptotic expansions for certain integrals.
Study shows global oscillatory solutions for Yang-Mills heat flow in 4D space.
problem Investigating long-time dynamics of Yang-Mills heat flow with specific initial data.
method Analysis of SO(4)-equivariant Yang-Mills heat flow with SU(2) group in 4D space. result Global solutions can exhibit oscillatory behavior at time infinity.
We introduce a Hilbert A-module structure on the higher oscillatory module, where A denotes the C∗-algebra of bounded endomorphisms of the basic oscillatory module. We also define the notion of an exterior covariant derivative in an A-Hilbert bundle and use it for a construction of an A-elliptic complex of d…
We show that thick morphisms (or microformal morphisms) between smooth (super)manifolds, introduced by us before, are classical limits of `quantum thick morphisms' defined here as particular oscillatory integral operators on functions.
This paper proposes a novel kernel-based optimization scheme to handle tasks in the analysis, e.g., signal spectral estimation and single-channel source separation of 1D non-stationary oscillatory data. The key insight of our optimization scheme for reconstructing the time-frequency information is that when a nonparame…
PyChEst detects changes in non-stationary time series without distributional assumptions.
problem Detecting changes in non-stationary time series data.
method Nonparametric algorithms for consistent detection of multiple changepoints in piece-wise stationary processes.
result PyChEst consistently detects changes without distributional assumptions.
This paper proposes a method to approximate non-Gaussian likelihoods in Gaussian Processes.
problem Approximating non-Gaussian likelihoods in Gaussian Processes.
method Proposes a piece-wise constant approximation for the inverse-link function.
result Yields a closed form solution for the SVGP lower bound.
Estimates change-points and graph structures in a time-varying Ising model.
problem Detecting and understanding changes in a time-varying Ising model.
method Maximizing a penalized conditional log-likelihood to estimate neighborhood of each node, enforcing sparsity and piece-wise constant graph structures.
result First change-points consistency theorems for unknown number of change-points in time-varying Ising model.
Improved bounds for Carleson-Sjölin operators on manifolds with specific curvature conditions.
problem Bounding Carleson-Sjölin operators on manifolds with special curvature conditions.
method Two different methods: one using distance function conditions and the other using contact orders of oscillatory integral operators.
result Improved Lp bounds for Carleson-Sjölin operators on manifolds with constant sectional curvature and those satisfying Sogge's chaotic curvature condition. Sparse regression models CMs from oscillatory shear data efficiently.
problem Discovering parsimonious constitutive models from oscillatory shear experiments.
method Sparse regression with tensor basis functions, l1 regularization, and greedy two-stage algorithm.
result Inferred CMs extrapolate well beyond training data and flow conditions.
D-LinOSS models learn to dissipate energy, improving performance on long-range tasks.
problem Representational limitations of LinOSS models in long-range reasoning.
method Introducing Damped Linear Oscillatory State-Space models (D-LinOSS) that learn to dissipate latent state energy on arbitrary time scales.
result D-LinOSS consistently outperforms previous LinOSS methods on long-range learning tasks, achieving faster convergence and reducing hyperparameter search space.
XOFM explains attribute effects in ordinal regression using piece-wise linear functions.
problem Lack of detailed attribute contributions in existing ordinal regression models.
method XOFM uses piece-wise linear functions to approximate attribute contributions and introduces ordinal transformation.
result XOFM provides superior explainability and state-of-the-art prediction accuracy.
Global propagator for massless Dirac operator defined and analyzed.
problem Analyzing the massless Dirac operator on 3-manifolds.
method Constructing propagator as sum of oscillatory integrals, providing global definitions and small time expansions.
result Explicit calculation of propagators' symbols and coefficients in eigenvalue counting functions.
In his seminal paper, A. N. Varchenko precisely investigates the leading term of the asymptotic expansion of an oscillatory integral with real analytic phase. He expresses the order of this term by means of the geometry of the Newton polyhedron of the phase. The purpose of this paper is to generalize and improve his re…
Bayesian method detects change points and clusters in piece-wise constant signals.
problem Detecting change points and clustering in piece-wise constant signals.
method Nonparametric penalized least square model selection on partitions of design points, with an efficient algorithm.
result Oracle inequality and adaptive upper bound on expected square risk of the estimator.
Study measures inequality in social-economic systems using Fokker-Planck equations and Lotka-Volterra dynamics.
problem Measuring inequality in oscillatory social-economic systems described by Fokker-Planck equations and Lotka-Volterra dynamics.
method Used Fokker-Planck equations and Lotka-Volterra dynamics to model inequality, focusing on coefficient of variation as a measure.
result Inequality initially tends to decrease in oscillatory systems, contrary to steady-state models.
Geometric approach to Dirac operator evolution on spacetimes.
problem Constructing the Cauchy evolution operator for Lorentzian Dirac operators.
method Realizing the operator as a sum of oscillatory integrals, relating to Feynman propagator.
result Relating Cauchy evolution operators to Feynman propagators and constructing Hadamard states.
Interpretable machine-learning models can be unstable under multicollinearity, leading to oscillatory weights that do not reflect meaningful contributions.
problem Interpretable machine-learning models can be unstable under multicollinearity.
method Theoretical analysis of eigenmodes of the feature correlation matrix.
result Small-eigenvalue modes associated with multicollinearity amplify fluctuations in the weights and generate oscillatory patterns that do not necessarily reflect meaningful contributions.
We give an explicit formula, as a formal differential operator, for quantum microformal morphisms of (super)manifolds that we introduced earlier. Such quantum microformal morphisms are essentially oscillatory integral operators or Fourier integral operators of a particular kind. They act on oscillatory wave functions, …
Oscillations lie at the core of many biological processes, from the cell cycle, to circadian oscillations and developmental processes. Time-keeping mechanisms are essential to enable organisms to adapt to varying conditions in environmental cycles, from day/night to seasonal. Transcriptional regulatory networks are one…
Efficiently infers switching nonlinear systems with collapsed amortized variational inference.
problem Inference in switching nonlinear dynamical systems with discrete latent variables.
method Learn an inference network as a proposal for continuous latent variables, performing exact marginalization of discrete variables.
result Successfully segments time series data into meaningful regimes using piece-wise nonlinear dynamics.
L*ReLU improves deep learning for fine-grained image classification.
problem Fine-grained image classification requires specific AFs.
method Proposes L*ReLU, piece-wise linear AFs for deep learning.
result L*ReLU achieves superior results on FGVC datasets.
Data-driven spatial filtering algorithms optimize scores such as the contrast between two conditions to extract oscillatory brain signal components. Most machine learning approaches for filter estimation, however, disregard within-trial temporal dynamics and are extremely sensitive to changes in training data and invol…
The geometry of oscillatory integrals on manifolds with intermediate symmetry.
problem Classification of curvature conditions in Sogge's program.
method Proposing a classification of curvature conditions.
result No manifolds satisfy the chaotic curvature condition of order 1.
We show that accelerated gradient descent, averaged gradient descent and the heavy-ball method for non-strongly-convex problems may be reformulated as constant parameter second-order difference equation algorithms, where stability of the system is equivalent to convergence at rate O(1/n 2), where n is the number of ite…
Paper investigates a new type of elastica formed during beam rupture.
problem Understanding the shape of a beam during sudden rupture.
method Developed a mathematical theory using elliptic ζ-function.
result Explicit shape of the new elastica (Λ-elastica) is described.
In this survey article, we review the relation between heat kernels and path integrals. In particular, we review recent results on the approximation of the Wiener measure on compact manifold by measures on (finite-dimensional) spaces of piece-wise geodesics.
DAMI uses interpretable regions to select informative samples for deep learning models.
problem Efficiently identifying informative samples for deep learning models with minimal annotation cost.
method Inspired by piece-wise linear interpretability in DNN, DAMI selects samples on different linearly separable regions.
result DAMI outperforms state-of-the-art approaches in tabular data.
CTR prediction in real-world business is a difficult machine learning problem with large scale nonlinear sparse data. In this paper, we introduce an industrial strength solution with model named Large Scale Piece-wise Linear Model (LS-PLM). We formulate the learning problem with L1 and L2,1 regularizers, leadin…
This work simplifies adversarial attacks using neural networks, reducing computation and improving training convergence.
problem Efficiently generating and training against ideal adversarial attacks with minimal computational overhead.
method Representing ideal adversarial attacks as smooth piece-wise functions and approximating them with neural networks. Using a mathematical game between an attack network and a defense network for adversarial training.
result Obtained convergence rates of adversarial loss in terms of sample size n for adversarial training. New Hida-Matérn kernels enable flexible process priors and efficient GP inference.
problem Flexible modeling of stationary processes with oscillatory components.
method Introducing a new class of covariance functions (Hida-Matérn kernels) and their state space representations.
result Efficient Gaussian Process inference and improved numerical stability.
RUMBoost combines RUMs and deep learning for better choice modelling.
problem Creating interpretable and robust discrete choice models.
method Gradient Boosted Regression Trees for utility functions, with constraints for interpretability and monotonicity.
result RUMBoost outperforms ML and RUM benchmarks in predictive performance and interpretability.
Neural models can realize decision trees with parameter sharing and improved performance.
problem Training and optimizing oblique decision trees.
method Locally constant networks based on ReLU gradients, parameter sharing, and neural tools.
result Locally constant networks can implicitly model oblique decision trees with fewer neurons.
To define oscillatory movements of securities market, we put in the non-local extension of Ito- equation for wavelet-images of random processes. It is proposed an algorithm of creation of evolutionary equation and a model of prediction of the most probable price movement path. It is carried out experimental validation …
The paper proves Sard's theorem for polynomial maps in infinite dimensions.
problem The validity of Sard's theorem for polynomial maps in infinite-dimensional Banach manifolds.
method Sharp quantitative criteria for the validity of Sard's theorem.
result The paper provides criteria for the validity of Sard's theorem in infinite-dimensional Banach manifolds.
Considering Wirtinger's inequality for piece-wise equipartite functions we find a discrete version of this classical inequality. The main tool we use is the theorem of classification of isometries. Our approach provides a new elementary proof of Wirtinger's inequality that also allows to study the case of equality. Mor…
Develops a new model to predict training dynamics of large language models.
problem Lack of mechanistic understanding of training dynamics in large language models.
method A first-principles reduced-order model of training dynamics, predicting group-size invariance and stability thresholds.
result Closed-form model predicts training dynamics with high accuracy and provides new diagnostics.
AKOrN uses synchronized neurons to improve AI tasks.
problem Improving AI performance through better neural representations.
method AKOrN introduces synchronized neurons to replace threshold units.
result AKOrN improves performance across various AI tasks.
We extend a result of the second author \cite[Theorem 1.1]{soggekaknik} to dimensions d≥3 which relates the size of Lp-norms of eigenfunctions for 2<p<d−12(d+1) to the amount of L2-mass in shrinking tubes about unit-length geodesics. The proof uses bilinear oscillatory integral estimates of Lee …
Method to create rational Seifert surfaces for knots in Lens space.
problem Creating rational Seifert surfaces for knots in Lens space.
method Assuming a regular projection, construct rational Seifert surface on twist toroidal diagram.
result A method to construct rational Seifert surfaces for knots in Lens space.
It is shown that most of the well-known basic results for Sobolev-Slobodeckii and Bessel potential spaces, known to hold on bounded smooth domains in Rn, continue to be valid on a wide class of Riemannian manifolds with singularities and boundary, provided suitable weights, which reflect the nature of the s…
Let S be a triangulated 2-sphere with fixed triangulation T. We apply the methods of thin position from knot theory to obtain a simple version of the three geodesics theorem for the 2-sphere [5]. In general these three geodesics may be unstable, corresponding, for example, to the three equators of an ellipsoid. Using a…
Given two points on a soup can or conical cup with lid, we find and classify all paths of minimal length connecting them. When the number of minimal paths is finite, there are at most four on a can and three on a cup. At worst, minimal paths are piece-wise smooth with three components, each of which is a classical geod…
Researchers extend microlocal analysis across event horizons of rotating black holes.
problem Incomplete microlocal theory of fields across black hole event horizons.
method Extended microlocal theory for extremal rotating black holes, showing null covectors form an involutive double characteristic manifold.
result Mathematical basis for asymptotic oscillatory solutions near event horizons.
Financial market dynamics is rigorously studied via the exact generalized Langevin equation. Assuming market Brownian self-similarity, the market return rate memory and autocorrelation functions are derived, which exhibit an oscillatory-decaying behavior with a long-time tail, similar to empirical observations. Individ…
Mathematical study of learning long-term integration in linear RNNs.
problem How do linear recurrent neural networks learn to integrate over long timescales?
method Analytical study of linear RNNs trained to integrate white noise and damped oscillatory filters.
result Learning dynamics are described by low-dimensional effective equations for outlier eigenvalues.