New methods avoid spectral pollution in transfer operators for accurate analysis.
problem Spectral pollution in finite-dimensional approximations of transfer operators.
method Algorithms for computing spectral properties of transfer operators without spectral pollution.
result Accurate spectral estimation across various applications, including protein folding models.
Framework transfers complementary operating conditions to train anomaly detectors.
problem Training anomaly detectors on changing operating conditions requires comprehensive data, which is hard to obtain.
method Proposes unsupervised transfer learning to align and combine data from different units.
result Demonstrates improved anomaly detection in changing operating conditions.
This paper extends transfer operator theory to McKean-Vlasov equations.
problem Analyzing the behavior of complex dynamical systems using transfer operators.
method Extended dynamic mode decomposition and Galerkin projection.
result Finite-dimensional approximations of transfer operators computed.
New methods for clustering graphs using spectral analysis.
problem Graph clustering for complex systems.
method Transfer operators and spectral properties.
result Spectral clustering can be interpreted using Koopman operators.
Kernel transfer operators, which can be regarded as approximations of transfer operators such as the Perron-Frobenius or Koopman operator in reproducing kernel Hilbert spaces, are defined in terms of covariance and cross-covariance operators and have been shown to be closely related to the conditional mean embedding fr…
Paper proposes operator deep Q-learning for quick reward adaptation.
problem Standard RL can only handle one reward function and struggles with unseen rewards.
method Develops operator neural networks to map reward functions to value functions.
result Operator deep Q-learning can quickly adapt to new reward functions.
Analyzes string topology operations using Chen's integrals and homotopy transfer.
problem Relating string topology to perturbative Chern-Simons theory.
method Develops integrals over configuration spaces and applies homotopy transfer.
result Intertwines involutive Lie bialgebra structures on homology.
Transfer operators such as the Perron--Frobenius or Koopman operator play an important role in the global analysis of complex dynamical systems. The eigenfunctions of these operators can be used to detect metastable sets, to project the dynamics onto the dominant slow processes, or to separate superimposed signals. We …
MetaNOR learns common nonlocal kernels for efficient metamaterial modeling.
problem Efficiently modeling wave propagation in new metamaterials.
method Meta-learns a common nonlocal kernel from existing tasks and transfers this knowledge to new tasks with minimal data.
result Substantial improvements in sampling efficiency for new metamaterials.
Transfer learning improves HVAC fault detection with minimal labeled data.
problem Lack of labeled data for HVAC system faults.
method Bayesian classifier trained on large data, then transferred to new buildings with few normal operation samples.
result Few samples are sufficient to maintain classifier precision and recall.
RaNNDy uses randomized neural networks to learn transfer operators efficiently.
problem Efficiently learning transfer operators from data.
method Randomized neural network approach with randomly initialized hidden layers and trained output layer.
result Significant reduction in training time and resources with improved stability.
A new method estimates generative model mappings using kernel transfer operators, reducing costs and improving performance.
problem Efficiently estimating mappings between known and unknown distributions in generative models.
method Adapting kernel transfer operators to estimate mappings, reducing computational costs.
result Significant runtime savings and good empirical performance compared to existing methods.
We prove exponential decay of correlations for Hölder continuous observables with respect to any Gibbs measure for contact Anosov flows admitting Pesin sets with exponentially small tails. This is achieved by establishing strong spectral estimates for certain Ruelle transfer operators for such flows.
This work extends GNNs to handle multiple graphs with non-commuting operators, proving transferability.
problem Handling multiple graphs with non-commuting operators in graph neural networks.
method Developed a mathematical theory for graph-tuple neural networks (GtNNs) with non-commuting non-expansive operators.
result Proved universal transferability of GtNNs, ensuring no non-transferable energy under convergence.
Paper explores properties of slice-matching operators for measure transfer.
problem Efficiently transferring measures in high dimensions.
method Examines an associated slice-matching operator with source, target measures and slicing directions.
result Establishes invariance, equivariance, Lipschitz continuity, and error bounds.
Unified framework for analyzing graph neural operators converging to graph limits.
problem Analyzing convergence of graph neural operators to graph limits.
method Develops a unified spectral framework for graph neural operators under various graphon assumptions.
result Unified framework enables direct comparison of convergence rates and tradeoffs.
New optimizers control network width scaling, improving stability and transfer across different model sizes.
problem Designing stable optimizers for networks of varying widths.
method Interpreting optimizers as steepest descent under mean-normalized operator norms, enabling layerwise composability and width-independent bounds.
result New optimizers like row normalization and column normalization provide stable learning-rate transfer across different model widths.
Data-driven methods link graphon limits to random walks and spectral clustering.
problem Clustering signals evolving over time with graphon limits.
method Transfer operators, Koopman and Perron-Frobenius, for estimating graphon from signal data.
result Spectral clustering can be extended to graphons, reconstructing transition densities and graphons.
In this note, we explain how the f-invariant of a circle transfer can be computed on the framed manifold itself in terms of the spectral asymmetry of twisted Dirac operators on the base. Some explicit examples and a treatment of the quaternionic case are provided as well.
Operator-theoretic analysis of nonlinear dynamical systems has attracted much attention in a variety of engineering and scientific fields, endowed with practical estimation methods using data such as dynamic mode decomposition. In this paper, we address a lifted representation of nonlinear dynamical systems with random…
A detailed understanding of wind turbine performance status classification can improve operations and maintenance in the wind energy industry. Due to different engineering properties of wind turbines, the standard supervised learning models used for classification do not generalize across data sets obtained from differ…
The paper proves exponential mixing for hyperbolic manifolds, with applications to geodesic holonomy.
problem Establishing exponential mixing for frame flows on hyperbolic manifolds.
method Using spectral bounds on transfer operators twisted by holonomy, building on Dolgopyat's method.
result Exponential mixing of frame flows for convex cocompact hyperbolic manifolds.
Bayesian model transfers knowledge across different engineering fleets.
problem Data sparsity in predictive models for engineering infrastructure.
method Hierarchical Bayesian approach with multitask learning.
result Improves survival analysis and power prediction in truck fleets and wind farms.
For a pinched Hadamard manifold X and a discrete group of isometries Γ of X, the critical exponent δΓ is the exponential growth rate of the orbit of a point in X under the action of Γ. We show that the critical exponent for any family N of normal subgroups of Γ0 has the same coarse behaviour…
Existing approaches to combine both additive and multiplicative neural units either use a fixed assignment of operations or require discrete optimization to determine what function a neuron should perform. This leads either to an inefficient distribution of computational resources or an extensive increase in the comput…
Transfer learning improves machine learning models for equipment diagnostics.
problem Limited model performance due to training data mismatch.
method Transfer learning to reuse knowledge from similar tasks.
result Transfer learning enhances model applicability in PHM.
Optimal scaling found to depend on operator norm across large models and datasets.
problem Lack of unifying principle for optimal hyperparameter scaling across models and datasets.
method Discovered that optimal scaling is conditioned on the operator norm of the output layer.
result The optimal learning rate/batch size pair (η∗,B∗) consistently has the same operator norm value. New AI method improves anomaly detection across different IIoT sensors.
problem Poor performance of anomaly detection models when applied to different machines.
method Robust AI method using pre-processing and multiple models on different pumps.
result Models perform well across different environments and types of pumps.
New metrics solve machine learning limitations.
problem Previous success metrics restrict application to specific forms of machine learning.
method Define decomposable metrics as linear operations on probability distributions.
result Demonstrated theorems bounding success in various ways, generalizing existing results.
A simple approach improves performance on both past and future tasks in lifelong learning.
problem Forgetting in lifelong learning, where performance on past tasks degrades when learning new tasks.
method Representation ensembling to improve performance on both future and past tasks.
result Representation ensembling demonstrates both forward and backward transfer across various datasets.
This paper proposes a step toward obtaining general models of knowledge for facial analysis, by addressing the question of multi-source transfer learning. More precisely, the proposed approach consists in two successive training steps: the first one consists in applying a combination operator to define a common embeddi…
One-step Bellman alignment improves online RL by reducing task mismatch.
problem Online RL struggles with task similarity defined by rewards or transitions.
method One-step Bellman alignment and re-weighted targeting (RWT) to correct task mismatch.
result Regret bounds show task shift complexity, not target MDP, affects performance.
Improved language models with talking-heads attention.
problem Language model perplexity and quality issues.
method Added linear projections in multi-head attention.
result Better perplexities and quality in language tasks.
Machine learning speeds up CRTM model predictions for weather forecasting.
problem Insufficient computational efficiency of radiative transfer models.
method Probabilistic neural network emulator of CRTM.
result Emulator predicts brightness temperatures with RMSE < 0.1 K for clear sky conditions.
A modular GP framework for efficient transfer learning.
problem Efficiently transfer knowledge across different tasks or datasets.
method Modular variational Gaussian processes (GPs) with a dictionary of well-fitted GPs.
result Reduces computational costs and allows the transfer of uncertainty metrics.
This paper develops geometric tools for causal inference using information flow concepts.
problem Developing a geometric interpretation of causal inference from probabilistic measures.
method Introducing a new measure, GeoC_{y
ightarrow x}, based on fractal correlation dimension.
result Avoids boundedness issues in transfer entropy, providing a more robust measure of causal inference.
This paper presents a novel Inter Catchment Wastewater Transfer (ICWT) method for mitigating sewer overflow. The ICWT aims at balancing the spatial mismatch of sewer flow and treatment capacity of Wastewater Treatment Plant (WWTP), through collaborative operation of sewer system facilities. Using a hydraulic model, the…
This paper explores how the generalization of substitute classifiers affects the success of black-box adversarial attacks.
problem Understanding the factors driving the transferability of black-box adversarial examples.
method Max-min adversarial example game framework and theoretical generalization bounds.
result Substitute NN with better generalization behavior results in more transferable adversarial examples.
The traditional paradigm for developing machine prognostics usually relies on generalization from data acquired in experiments under controlled conditions prior to deployment of the equipment. Detecting or predicting failures and estimating machine health in this way assumes that future field data will have a very simi…
Many problems in sequential decision making and stochastic control often have natural multiscale structure: sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure, particularly beyond a single level of abstraction, has remained a longstanding challen…
In this paper, we construct a category of short exact sequences of vector bundles and prove that it is equivalent to the category of double vector bundles. Moreover, operations on double vector bundles can be transferred to operations on the corresponding short exact sequences. In particular, we study the duality theor…
The study uses transfer learning to compare surgical outcomes across racial/ethnic subgroups.
problem Difficulty in comparing surgical outcomes due to racial/ethnic and geographic differences.
method Causal inference framework and transfer learning to incorporate data from multiple populations.
result Racial and ethnic differences in surgical outcomes are found, with non-Hispanic Black patients experiencing wide variability.
The paper explains how continuous language models can produce discrete, interpretable meanings.
problem Semantic collapse in continuous systems of large language models.
method Formalizing large language models as Continuous State Machines (CSMs) and analyzing the associated transfer operator.
result The leading eigenfunctions of the transfer operator induce a finite number of invariant meaning basins, explaining how continuous computation can produce discrete, interpretable semantics.
Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the distribution are well-matched, for instance have the same frequencies of classes b…
SF-DQN improves RL transfer by learning successor features.
problem Transfer RL with shared dynamics but different reward functions.
method Decomposes Q-function into SF and reward mapping; uses GPI for policy improvement.
result SF-DQN with GPI converges faster and generalizes better than traditional RL methods.
BeST metric selects best source models for transfer learning.
problem Efficiently selecting top source models for a new target task.
method Quantization-level optimization procedure for similarity measure.
result BeST consistently identifies best source models for target tasks.
Improves functional linear regression with shape transfer learning.
problem Data scarcity in functional linear models.
method Shape-based transfer learning from auxiliary to target domains.
result Enhances robustness and generalizability of functional linear models.
Reproducing kernel Hilbert spaces (RKHSs) play an important role in many statistics and machine learning applications ranging from support vector machines to Gaussian processes and kernel embeddings of distributions. Operators acting on such spaces are, for instance, required to embed conditional probability distributi…