Physics-informed neural networks simulate radiative transfer efficiently.
problem Simulating radiative transfer accurately and efficiently.
method Physics-informed neural networks trained to minimize radiative transfer equations.
result PINNs provide an easy-to-implement, robust, and accurate method for radiative transfer simulation.
New model predicts radiative properties of nanoparticle layers with high accuracy and uncertainty.
problem Predicting radiative properties of nanoparticle embedded layers accurately and with uncertainty.
method Conditional normalizing flows learn conditional distributions of optical outputs given input parameters.
result The model achieves high predictive accuracy and reliable uncertainty estimates.
Efficient neural network speeds up radiative transfer model processing for climate change analysis.
problem Computational inefficiency in processing spectroscopy data for climate change analysis.
method Developed an algorithm using neural networks to emulate radiative transfer models (RTMs), significantly reducing processing time.
result Multifold speedup in processing time for radiative transfer models, enabling their use with high volume imaging spectrometers.
Machine learning speeds up CRTM model predictions for weather forecasting.
problem Insufficient computational efficiency of radiative transfer models.
method Probabilistic neural network emulator of CRTM.
result Emulator predicts brightness temperatures with RMSE < 0.1 K for clear sky conditions.
ClimART dataset benchmarks ML emulators for atmospheric RT in climate models.
problem Lack of a comprehensive dataset and standardized practices for ML benchmarking in climate models.
method Builds ClimART, a large dataset with over 10 million samples, and presents novel baselines.
result Indicates shortcomings of prior datasets and network architectures.
RADIS uses deep regression to create efficient importance sampling for model inversion and emulation.
problem Efficiently sampling from posterior distributions for model inversion and emulation.
method RADIS uses a deep architecture of nested importance sampling schemes to construct a non-parametric emulator that mimics the posterior distribution.
result RADIS asymptotically converges to an exact sampler under mild conditions and can be used as a surrogate model.
In a vacuum spacetime equipped with the Bondi's radiating metric which is asymptotically flat at spatial infinity including gravitational radiation ({\bf Condition D}), we establish the relation between the ADM total energy-momentum and the Bondi energy-momentum for perturbed radiative spatial infinity. The perturbatio…
Kichenassamy's work spans theoretical physics, from relativity to applications.
problem Clarifying the postulational basis of relativity theories.
method Introducing the C-equivalence principle to replace the strong equivalence principle.
result New insights into measurements in both special and general relativity.
New geometrization of gravitational wave phase space.
problem Understanding the geometry of null-infinity in asymptotically flat space-times.
method Proposes a new geometrization using tractor calculus adapted to degenerate conformal metrics.
result Gravitational waves correspond to a class of tractor connections called 'null-normal'.
Consider a broken geodesics α([0,l]) on a compact Riemannian manifold (M,g) with boundary of dimension n≥3. The broken geodesics are unions of two geodesics with the property that they have a common end point. Assume that for every broken geodesic α([0,l]) starting at and ending to the boundary ∂M…
This thesis advances algorithms and software for QMC, GP, and sciML.
problem Efficient high-dimensional integration, interpolation, and PDE modeling.
method Developed new algorithms and software for QMC, GP, and sciML.
result Efficient and accurate methods for high-dimensional problems.
In a vacuum spacetime equips with the Bondi's radiating metric which is asymptotically flat at spatial infinity including gravitational radiation ({\bf Condition D}), we establish the relation between the ADM total linear momentum and the Bondi momentum. The relation between the ADM total energy and the Bondi mass in t…
Neural network model improves leaf spectral reflectance prediction for grapevines.
problem Inaccurate modeling of grapevine leaf spectral reflectance from traits.
method Multi-head attention neural network trained on grapevine-specific data.
result Model achieved high accuracy (R^2=0.84, NRMSE=1.52%) and outperformed PROSPECT-PRO.
Solving inverse problems is central to geosciences and remote sensing. Radiative transfer models (RTMs) represent mathematically the physical laws which govern the phenomena in remote sensing applications (forward models). The numerical inversion of the RTM equations is a challenging and computationally demanding probl…
DiTSNe-Ia model accurately reconstructs supernovae spectra from light curves.
problem Difficult identification and interpretation of diverse sub-populations of supernovae.
method Variational diffusion-based generative model conditioned on light curves.
result DiTSNe-Ia achieves significantly more accurate reconstructions than SALT3 across all phases.
X-TFC solves parametric DEs with neural networks and physics constraints.
problem Solving parametric differential equations with physics constraints.
method Combines Theory of Functional Connections and Physics-Informed Neural Networks with a single-layer Extreme Learning Machine.
result Achieves high accuracy with low computational time.
A discussion is given of the conformal Einstein field equations coupled with matter whose energy-momentum tensor is trace-free. These resulting equations are expressed in terms of a generic Weyl connection. The article shows how in the presence of matter it is possible to construct a conformal gauge which allows to kno…
Study how past radiation determines present matter in Penrose's cyclic cosmology.
problem Determining matter content in the present eon from past radiation in Penrose's cyclic cosmology.
method Solve Einstein's equations for a spherical wave in the past eon, then apply reciprocity to find the present eon's matter content.
result The present eon is filled with three types of radiation: a damped wave, an in-going wave, and randomly scattered waves.
This paper explores the connection between adversarial and knowledge transferability.
problem Understanding the factors affecting knowledge transferability.
method Theoretical analysis and practical metrics for adversarial transferability.
result Adversarial transferability and knowledge transferability are closely related.
Survey connects and systematizes transfer learning research.
problem Reduce dependence on target domain data for target learners.
method Systematic review of 40+ transfer learning approaches.
result Importance of choosing appropriate transfer learning models.
Study measures impact of data and neural net similarity on transferability in restaurant sales data.
problem Identify indicators for successful transferability of neural nets across different data sets.
method Empirical study on sales data from six restaurants, calculating indicators based on data and neural net similarities.
result Negative correlations between transferability and indicators, allowing better model performance and fewer transfers.
Adversarially robust models transfer better than standard models in image classification.
problem Improving transfer learning performance in image classification.
method Focused on adversarially robust ImageNet classifiers, compared to standard models.
result Adversarially robust models yield improved accuracy on downstream classification tasks.
Adaptive source selection for positive transfer in linear models improves target dataset performance.
problem Limited task-specific labeled data in business settings.
method Greedily decides from which sources and how many samples to incorporate into the target dataset using an accept/reject rule based on a data-dependent estimate of the transfer gain.
result Consistent gains over classical and recent strong baselines while avoiding negative transfer.
Enhances generative model accuracy through knowledge transfer.
problem Improving generative model precision across different tasks.
method Introduces a novel framework for transfer learning using shared structures.
result Demonstrates enhanced performance in diffusion and normalizing flows models.
Simple methods improve regression transferability estimation.
problem Estimating how well regression models transfer between tasks.
method Two simple, computationally efficient approaches based on negative regularized mean squared error.
result Significantly outperform existing methods in accuracy and efficiency.
LOL-GP model improves surrogate modeling of expensive simulators.
problem Costly computer simulations for complex systems.
method Local transfer learning Gaussian process.
result Improved surrogate performance over existing methods.
New framework explains fast transfer of hyperparameters across model scales.
problem Understanding and optimizing hyperparameters for large-scale models.
method Developed a conceptual framework for HP transfer across scale, showing fast transfer is equivalent to useful transfer for compute-optimal grid search.
result Fast transfer of hyperparameters is equivalent to useful transfer for compute-optimal grid search, offering asymptotic computational advantage.
The paper explores transferability of adversarial examples between convex and 01 loss models, finding non-transferability due to different decision boundaries caused by outliers.
problem Transferability of adversarial examples between convex and 01 loss models.
method Empirical study of transferability between linear 01 loss and convex (hinge) loss models, and between neural networks with different activation functions.
result Adversarial examples are non-transferable between convex and 01 loss models due to different decision boundaries caused by outliers.
Investigates transfer learning in spatial statistics.
problem Applying transfer learning to spatial statistics.
method Simple MLP models for spatial data.
result Potential of transfer learning in spatial statistics.
Paper proposes a statistical test for transfer learning in linear regression.
problem Theoretical framework for parameter transfer in linear regression.
method Developed a statistical test to predict transfer quality.
result The test can predict if a fine-tuned model has lower prediction risk.
New analysis shows transfer learning can significantly reduce sample size for complex models.
problem Reducing sample size needed for complex models like large language models.
method Optimal transport viewpoint applied to analyze transfer learning efficiency.
result Transfer learning can achieve better sample efficiency for complex models.
Transferability captures the ability of an attack against a machine-learning model to be effective against a different, potentially unknown, model. Empirical evidence for transferability has been shown in previous work, but the underlying reasons why an attack transfers or not are not yet well understood. In this paper…
This paper introduces a new transfer learning method for regression.
problem Boosting predictive power in scenarios with scarce data.
method Affine model transfer, following expected-square loss minimization.
result The affine model transfer method encompasses various existing methods and clarifies its theoretical properties.
Headless attacks bypass classification heads to fool transfer learning models.
problem Adversarial attacks against transfer learning models without access to the classification head.
method Label-blind adversarial attacks that do not require class-label information.
result Transfer attack lowers ResNet18 accuracy on CIFAR10 by over 40%.
Unified view on GP transfer learning for Bayesian optimization.
problem Improving data efficiency in Bayesian optimization with scarce data.
method Unified hierarchical GP models for transfer learning, including a novel boosted GP transfer model.
result Unified analysis and comparison of transfer learning methods for GP models.
Designs a framework to transfer causal models between similar environments.
problem Transferability of causal models between different but similar environments.
method Object-oriented representations and continuous optimization for structure learning.
result Demonstrates advantages in gridworld settings using reinforcement learning.
We extend graph neural networks to transfer performance across different input sizes.
problem Transferability of graph neural networks across varying input dimensions.
method Introduce a general framework for transferability across dimensions, showing it corresponds to continuity in a limit space.
result Transferability of graph neural networks is driven by data and learning task, and can be ensured with design principles.
Transfer learning improves model robustness against adversarial attacks.
problem Understanding how transfer learning affects model robustness against adversarial attacks.
method Extensive empirical evaluations of white-box and black-box attacks on fine-tuned transfer learning models.
result Adversarial examples are more transferable when fine-tuning is used than when networks are trained independently.
TX-Ray analyzes and quantifies model knowledge transfer in NLP.
problem Insufficient methods for explaining and quantifying model knowledge transfer in NLP.
method Modified computer vision explainability principle to NLP, visualizing feature preference distributions.
result TX-Ray reveals how self-supervised models learn linguistic abstractions and improves generalization.
Framework reuses pre-trained models for data-free transfer learning.
problem Challenges in retrieving source data for model training.
method Model Recycling Framework for parameter-efficient training.
result Makes multi-source data-free supervised transfer learning possible.
Transfer learning framework for fragility modeling under domain shift and class imbalance
problem Data gaps in structural fragility modeling
method Transfer learning
result Improves failure detection and predictive stability in low-data regimes
Localized transfer learning improves nonparametric regression performance.
problem Improving nonparametric regression performance on target tasks.
method Localized transfer learning framework that models heterogeneity and partition covariate space into cells.
result Sharp minimax rates show local transfer mitigates the curse of dimensionality.
Estimates task difficulty and transferability without trained models.
problem Estimating the difficulty and transferability of supervised classification tasks.
method Information theoretic approach using conditional entropy between training labels.
result Hardness and transferability estimates correlate with empirical values.
Enhances adversarial example transferability by fine-tuning existing examples.
problem Adversarial examples are often overfit to a source model, limiting black-box transferability.
method Intermediate Level Attack (ILA) fine-tunes adversarial examples on a pre-specified layer of the source model.
result ILAs achieve high transferability to target models without knowledge of their architecture.
A number of approaches to solving the well-known transfer pricing problem are known. However, few models satisfactorily resolve the core problem of allowing both the source and receiving divisions to earn a profit on transfers during a period in such a way that sub-optimal output levels are avoided. In 1969, Samuel pro…
Recent years, transfer learning has attracted much attention in the community of machine learning. In this paper, we mainly focus on the tasks of parameter transfer under the framework of extreme learning machine (ELM). Unlike the existing parameter transfer approaches, which incorporate the source model information in…
New method improves model robustness against adversarial attacks.
problem Adversarial attacks can deceive models trained with transfer learning.
method Noisy feature distillation method for random initialization.
result Models trained with random initialization are more robust to attacks.
Transfer learning does not improve character recognition performance.
problem Improving character recognition performance using transfer learning.
method Performed experiments with varying levels of similarity between source and target tasks, transferring both parameters and features.
result No significant advantage gained by transfer learning over traditional machine learning.