Study finds Deep Taylor Decomposition is unreliable for explaining neural networks.
problem Reliability of Deep Taylor Decomposition for explaining neural networks.
method Investigated the theoretical foundations of Deep Taylor Decomposition (DTD) and found it under-constrained.
result DTD is unreliable because its theoretical foundations are under-constrained and roots do not align with input.
Proposes a Taylor framework to unify and analyze attribution methods.
problem Lack of a unified guideline for feature contribution assignment in machine learning models.
method Introduces a Taylor attribution framework to model the attribution problem and reformulates fourteen mainstream methods.
result Empirically validates the Taylor reformulations and reveals a positive correlation between performance and principles followed.
TaylorPODA uses Taylor expansions to improve feature attributions for opaque models.
problem Lack of systematic framework for quantifying feature contributions in opaque models.
method Taylor expansion framework with postulates (precision, federation, zero-discrepancy, adaptation).
result TaylorPODA achieves competitive results and provides principled explanations.
The Adomian decomposition method is shown to be equivalent to the Taylor series approach.
problem Incorrectly perceived complexity of the Adomian decomposition method.
method Demonstrates the Adomian decomposition method as equivalent to the Taylor series approach.
result The Adomian decomposition method is simpler and more straightforward.
Unified framework for analyzing machine learning model attributions.
problem Lack of a general and theoretical framework for understanding attribution methods.
method Proposes a Taylor attribution framework to unify and analyze seven mainstream attribution methods.
result Established three principles for good attribution and empirically validated the Taylor reformulations.
Kernelized Taylor diagram visualizes data populations with fewer assumptions.
problem Limitations of Taylor diagram in capturing non-linear relationships and sensitivity to outliers.
method Proposes a kernelized version of the Taylor diagram that uses maximum mean discrepancy and kernel mean embedding.
result Kernelized Taylor diagram visualizes data populations with minimal assumptions of data distributions.
The paper is concerned with non-linear Gaussian filtering and smoothing in continuous-discrete state-space models, where the dynamic model is formulated as an Itô stochastic differential equation (SDE), and the measurements are obtained at discrete time instants. We propose novel Taylor moment expansion (TME) Gaussian …
Taylor expansions improve reinforcement learning policies.
problem Improving reinforcement learning policy optimization.
method Taylor expansion policy optimization.
result Taylor expansions enhance performance of distributed algorithms.
We introduce Taylor expansions that do not require the differentiability. We also provide new solutions to partial differential equations. We apply our methods to finance.
An expanding literature articulates the view that Taylor rules are helpful in predicting exchange rates. In a changing world however, Taylor rule parameters may be subject to structural instabilities, for example during the Global Financial Crisis. This paper forecasts exchange rates using such Taylor rules with Time V…
This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher efficient with probabilistic models. Such a framework will be shown to also provide mathematical justification to combine higher order methods …
Proves a special case of the Gaussian kinematic formula using large sphere limits.
problem Proving a special case of the Gaussian kinematic formula.
method Viewing the GKF as the limit of spherical kinematic formulas for large dimension spheres.
result Proves a special case of the Gaussian kinematic formula.
Modern convolutional networks, incorporating rectifiers and max-pooling, are neither smooth nor convex; standard guarantees therefore do not apply. Nevertheless, methods from convex optimization such as gradient descent and Adam are widely used as building blocks for deep learning algorithms. This paper provides the fi…
Developed Taylor series for muscle-finger system analysis.
problem Understanding the complex relationship between muscle activity and finger movement.
method Used Dendrite Net to develop Taylor series and construct relation spectrum.
result Found muscle synergy and coupling in hand movement.
We provide new exact Taylor's series with fixed coefficients and without the remainder. We demonstrate the usefulness of this contribution by using it to obtain very simple solutions to (non-linear) PDEs. We also apply the method to the portfolio model.
We propose \emph{Taylorized training} as an initiative towards better understanding neural network training at finite width. Taylorized training involves training the k-th order Taylor expansion of the neural network at initialization, and is a principled extension of linearized training---a recently proposed theory …
New resonance theory for Anosov flows connects spectral properties to mixing measures.
problem Defining and analyzing Ruelle-Taylor resonances for Anosov actions.
method Combining microlocal methods and J. Taylor's cohomological theory, defining Ruelle-Taylor resonances and proving Fredholm theory.
result Ruelle-Taylor resonances form a discrete subset of Cκ with λ=0 being a leading resonance. We apply results of Malliavin-Thalmaier-Watanabe for strong and weak Taylor expansions of solutions of perturbed stochastic differential equations (SDEs). In particular, we work out weight expressions for the Taylor coefficients of the expansion. The results are applied to LIBOR market models in order to deal with the …
The first aperiodic monotiling, introduced by Taylor, was based on a trapezoidal prototile equipped with 14 distinct decorations. A presentation of the closely related Taylor-Socolar aperiodic monotiling is based on a hexagonal prototile equipped with 7 decorations. This paper gives decoration-free algebraic descriptio…
Paper proves existence of a CMC hypertorus in 4D sphere using numerical methods.
problem Proving the existence of a constant mean curvature (CMC) hypertorus in \(S^4\).
method Employed the round Taylor method with rational arithmetic and the Poincare-Miranda theorem.
result Existence of a constant mean curvature (CMC) hypertorus in \(S^4\).
New approximations for Asian basket spread options using stochastic Taylor expansions.
problem Pricing Asian basket spread options under the Black-Scholes model.
method Stochastic Taylor expansion applied to a log-normal proxy model.
result Highly accurate approximations for Asian and spread options, without numerical integration.
Paper develops a new algorithm to find shortest paths on surfaces.
problem Finding shortest paths on surfaces with defined metrics.
method Uses Taylor expansion of exponential map for numerical computation.
result Developed a new algorithm to find geodesics efficiently.
In this paper we define a small variation of the Taylor method and a formula for the global error of this new numerical method that allows us to keep track of the round-off error and does not require previous knowledge of the exact solution. As an application we provide a rigorous proof of the construction/existence of…
New learning algorithm for real analytic functions without gradient descent.
problem Learning real analytic functions without gradient descent.
method Taylor approximation and sampling data distribution.
result Nonuniform learning result for real analytic functions.
New insights on pruning deep networks by preserving function locality.
problem Designing effective pruning methods for deep neural networks.
method Revisited loss modeling using first and second order Taylor expansions, emphasizing locality.
result Both first and second order Taylor expansions can achieve similar performance in pruning.
SOAR improves deep networks' robustness against adversarial examples.
problem Improving deep neural networks' robustness against adversarial examples.
method Formulated adversarial robustness problem under robust optimization framework, approximated loss function using second-order Taylor series expansion.
result SOAR significantly improves robustness of networks against adversarial perturbations.
In this article we develop a method for the strong approximation of stochastic differential equations (SDEs) driven by Lévy processes or general semimartingales. The main ingredients of our method is the perturbation of the SDE and the Taylor expansion of the resulting parameterized curve. We apply this method to devel…
Paper develops formulas for shape derivatives in wave scattering.
problem Computing high order shape derivatives for wave scattering is challenging.
method Introduces elegant recurrence formulas using differential forms and Lie derivatives.
result Unified framework for computing high order shape perturbations in scattering problems.
Paper introduces cubature method for stochastic Volterra equations.
problem Solving stochastic Volterra integral equations efficiently.
method Derive stochastic Taylor expansion, introduce cubature measure.
result Cubature method is more efficient than Euler scheme under certain conditions.
This paper extends AD techniques to Monte Carlo processes for efficient derivative calculation.
problem Obtaining derivatives of expectation values in Monte Carlo processes.
method Two approaches: reweighting and Hamiltonian extension of HMC.
result Hamiltonian approach as a change of variables simplifies variance reduction.
Paper presents a new backward deep BSDE method for solving nonlinear FBSDE problems.
problem Nonlinear Forward Backward Stochastic Differential Equations (FBSDE) with terminal conditions.
method Backward deep BSDE method applied to FBSDE with nonlinear generators and random initial conditions.
result Derives exact and Taylor-based approximations for time-stepping nonlinear BSDEs.
Iterative tilting fine-tunes diffusion models for reward-tilted distributions.
problem Fine-tuning diffusion models for reward-tilted distributions.
method Decomposes large reward tilts into smaller, tractable tilts via first-order Taylor expansion, avoiding backpropagation.
result Validated on a two-dimensional Gaussian mixture, achieving exact closed-form solutions.
In this work we consider the Taylor expansion of the exponential map of a submanifold immersed in R^n up to order three, in order to introduce the concepts of lateral and frontal deviation. We compute the directions of extreme lateral and frontal deviation for surfaces in R^3. Also we compute, by using the Taylor expan…
New method detects text changes under dependencies, outperforming baselines.
problem Detecting structural changes in m-dependent text data. method Kernel change-point detection under m-dependence. result Consistent and weakly consistent detection of change points in m-dependent text. Paper proves existence of solutions for complex surface diffusion equation.
problem Existence of solutions for anisotropic surface diffusion with elasticity.
method Cahn-Taylor minimizing movement scheme for three-dimensional analysis.
result Proves existence of classical solutions without curvature regularization.
New sampling scheme improves ML accuracy in physics simulations.
problem Improving accuracy of ML models in physics simulations.
method Taylor-based data sampling scheme for DNNs.
result Reduces error in DNN solutions of ODE systems.
TEAM generates more powerful adversarial examples for DNNs.
problem Vulnerability of DNNs to imperceptible adversarial examples.
method TEAM uses Taylor expansion and Lagrangian multiplier method to craft adversarial examples.
result TEAM generates adversarial examples with 100% attack success rate using smaller perturbations.
Although Deep Neural Networks(DNNs) have achieved successful applications in many fields, they are vulnerable to adversarial examples.Adversarial training is one of the most effective methods to improve the robustness of DNNs, and it is generally considered as solving a saddle point problem that minimizes risk and maxi…
New samplers reduce NFEs for diffusion models.
problem High NFEs in diffusion models.
method Quasi-Taylor samplers based on ideal derivatives.
result Reduced NFEs for image synthesis.
Develops AMITE for analyzing neural network nonlinearities.
problem Addressing difficulties in verification, explainability, and security in neural network analysis.
method Analytically modified integral transform expansion (AMITE) for neural network nonlinearities.
result First to provide six mutually exclusive desired expansion properties.
In this paper we study the Taylor series of an operator-valued function related to the differential of the exponential map. For a smooth manifold M with a torsion-free affine connection the operator Ep(v) acting on the space TpM is defined to be the composition of the differential …
Examines how central bank policies affect stock markets and asset prices.
problem Understanding the impact of monetary policy on stock markets and asset prices.
method Used Taylor rule equations to analyze data from 1990 to 2020 for US and UK, testing with various econometric methods.
result Monetary policy can explain asset price volatility and output gap better than just inflation rate.
The paper modifies asset pricing models using Taylor series expansions and market-based averages.
problem Improving asset pricing models to better reflect market dynamics.
method Derives new pricing equations using Taylor series expansions and market-based averages.
result New expressions for asset prices and volatilities derived from market data.
In this paper we derive estimates to the free boundary problem for the Euler equation with surface tension, and without surface tension provided the Rayleigh-Taylor sign condition holds. We prove that as the surface tension tends to zero, when the Rayleigh-Taylor condition is satisfied, solutions converge to the Euler …
Approximates option prices in Barndorff-Nielsen and Shephard models using Taylor expansion.
problem Approximating option prices in complex stochastic volatility models.
method Taylor expansion and recursive algorithm for closed-form approximations.
result Explicit results for inverse Gaussian and gamma stationary distributions, with favorable comparisons to characteristic function.
Expanding the rough Heston model in H
problem Analyzing the dependence of the fractional Riccati equation on the Hurst parameter H method Deriving a Taylor expansion of the Riccati solution in H result Local uniform convergence and analyticity of the fractional Riccati solution
Improved Frank-Wolfe method reduces dependence on data size for empirical risk minimization.
problem Reducing dependence on number of data observations in Frank-Wolfe methods.
method Taylor-series approximated gradients applied to Frank-Wolfe method.
result Significant speed-ups over existing methods on real-world datasets.
In this paper we propose a closed-form approximation for the price of basket options under a multivariate Black-Scholes model, based on Taylor expansions and the calculation of mixed exponential-power moments of a Gaussian distribution. Our numerical results show that a second order expansion provides accurate prices o…