New method to predict adversarial perturbation intensity for logistic regression.
problem Adversarial attacks on machine learning models.
method Probabilistic definition of adversarial examples using logistic regression's asymptotic properties.
result Derive a closed-form expression for adversarial perturbation intensity.
Proves Riemannian positive mass theorem with singularities.
problem Proves Riemannian positive mass theorem for specific types of singular manifolds.
method Uses initial data sets with a second fundamental form to transfer convexity between different singularity components.
result Proves the theorem for manifolds with some mean-concave components and others mean-convex.
AdaTrans adapts to feature and sample transfer in high-dimensional regression.
problem High-dimensional linear regression with more features than samples.
method F-AdaTrans and S-AdaTrans methods using fused-penalties and adaptive weights.
result AdaTrans achieves convergence rates close to oracle estimators and near-minimax optimal rates.
New methods avoid spectral pollution in transfer operators for accurate analysis.
problem Spectral pollution in finite-dimensional approximations of transfer operators.
method Algorithms for computing spectral properties of transfer operators without spectral pollution.
result Accurate spectral estimation across various applications, including protein folding models.
Improves accuracy in image classification tasks by optimizing learning rates.
problem Learning from small amounts of labeled data in deep learning.
method Optimizes learning rates for neural network layers based on dataset parameters.
result Improvements in accuracy of 127% on ImageNet22k and Oxford Flowers datasets.
New method UADs improves transferability of adversarial perturbations.
problem Transferability of adversarial perturbations across different DNN architectures.
method Proposes Universal Adversarial Directions (UADs) to improve transferability.
result UADs can achieve a Nash equilibrium, indicating potential transferability.
This paper proposes Dropping Networks for improved transfer learning in natural language understanding tasks.
problem Transfer learning between natural language understanding tasks often suffers from negative transfer.
method Combines Dropout and Bagging (Dropping) for improved transferability in neural networks.
result Improves transfer learning performance and comparable results to state-of-the-art using a fraction of target task data.
HGKT transfers knowledge from seen to unseen classes in GZSL without prior unseen class info.
problem Learning to classify unseen classes in GZSL.
method Structured heterogeneous graph with graph neural network for knowledge transfer.
result Achieves state-of-the-art results on public benchmark datasets.
Paper presents Transfer Portal model for accurate player performance predictions.
problem Predicting future player performance after a transfer.
method Personalized neural network and Bayesian updating framework.
result Model generates accurate predictions for player performance at new clubs.
Integrates skills and world models for efficient task solving and transfer.
problem Quickly solve new tasks in complex environments using reusable knowledge.
method Leverages partial amortization for fast adaptation and online skill planning.
result Improved sample efficiency in single tasks and transfer between tasks.
This work studies adversarial transferability and proposes ensemble methods to improve robustness.
problem Adversarial transferability in neural networks and its implications for robustness.
method Investigates the effect of various factors on adversarial transferability and proposes ensemble attack methods.
result Transferability is significantly hampered by input quantization and architectural mismatch, but not by initialization.
The paper explores transferring functions from one data space to another.
problem Approximating a function on a new data set using a learned function from an old data set.
method Transfer learning from one data space to another, focusing on subsets of the target data space.
result Local smoothness of the function and its lifting are related.
Machine learning methods in general and Deep Neural Networks in particular have shown to be vulnerable to adversarial perturbations. So far this phenomenon has mainly been studied in the context of whole-image classification. In this contribution, we analyse how adversarial perturbations can affect the task of semantic…
Morpheo is a transparent and secure machine learning platform collecting and analysing large datasets. It aims at building state-of-the art prediction models in various fields where data are sensitive. Indeed, it offers strong privacy of data and algorithm, by preventing anyone to read the data, apart from the owner an…
New proof improves differential privacy guarantees for adaptive data analysis.
problem Ensuring accuracy of statistical queries in adaptive data analysis.
method Elementary proof of transfer theorem using posterior distributions and resampling.
result Better concrete bounds on accuracy out-of-sample for differential privacy mechanisms.
Paper targets clean-label poisoning attacks on neural nets.
problem Manipulating neural net behavior with poisoned data.
method Optimization-based and watermarking strategies for crafting and deploying poisons.
result A single poisoned image can control classifier behavior.
ConvTimeNet is a pre-trained CNN for time series classification.
problem Training deep neural networks for time series classification requires careful tuning and resources.
method ConvTimeNet is a pre-trained deep convolutional neural network trained on diverse univariate time series datasets. It adapts to new tasks with minimal fine-tuning.
result ConvTimeNet achieves significant gains in classification accuracy and computational efficiency compared to existing methods.
AutoAugment learns optimal data augmentation policies automatically.
problem Improving image classifier accuracy through better data augmentation.
method AutoAugment uses a search algorithm to find the best augmentation policies in a defined search space.
result AutoAugment achieves state-of-the-art accuracy on multiple datasets.
Transfer learning improves portfolio optimization by identifying transfer risk.
problem Financial portfolio optimization problem.
method Introduces transfer risk concept within transfer learning framework.
result Transfer risk is a significant indicator of transferability and enhances portfolio management efficiency.
Paper analyzes transfer risk in transfer learning for finance.
problem Evaluate transferability of transfer learning in finance.
method Proposes transfer risk concept and applies to stock return prediction and portfolio optimization.
result Transfer risk correlates with transfer learning performance and identifies appropriate source tasks.
This paper explores the connection between adversarial and knowledge transferability.
problem Understanding the factors affecting knowledge transferability.
method Theoretical analysis and practical metrics for adversarial transferability.
result Adversarial transferability and knowledge transferability are closely related.
Mathematical framework for transfer learning feasibility and transfer risk.
problem Theoretical analysis of transfer learning.
method Reformulated transfer learning as an optimization problem, introduced transfer risk concept.
result Demonstrated the potential and benefits of incorporating transfer risk in transfer learning evaluation.
L2T learns to automatically decide what and how to transfer knowledge.
problem Optimal transfer learning algorithm selection is computationally intractable.
method L2T framework learns transfer learning skills through meta-cognitive reflection and optimizes them for new domains.
result L2T outperforms state-of-the-art transfer learning algorithms and discovers more transferable knowledge.
Survey connects and systematizes transfer learning research.
problem Reduce dependence on target domain data for target learners.
method Systematic review of 40+ transfer learning approaches.
result Importance of choosing appropriate transfer learning models.
Enhances transfer learning with semantic reasoning for robust predictions.
problem Improving robustness of transfer learning models.
method Integrates semantic representations for better knowledge transfer.
result Demonstrated robustness in bus delay and air quality forecasting.
Transfer learning can worsen fairness, study finds.
problem Transfer learning can reduce fairness in predictions.
method Examined fairness of standard transfer and multi-task learning algorithms.
result Both standard algorithms suffer from discriminatory transfer.
We construct non-trivial continuous isospectral deformations of Riemannian metrics on the ball and on the sphere in Rn for every n≥9. The metrics on the sphere can be chosen arbitrarily close to the round metric; in particular, they can be chosen to be positively curved. The metrics on the ball are both Diric…
Study measures impact of data and neural net similarity on transferability in restaurant sales data.
problem Identify indicators for successful transferability of neural nets across different data sets.
method Empirical study on sales data from six restaurants, calculating indicators based on data and neural net similarities.
result Negative correlations between transferability and indicators, allowing better model performance and fewer transfers.
Paper defines and mitigates negative transfer in transfer learning.
problem Negative transfer occurs when transferring knowledge from a less related source task inversely harms target performance.
method Formal definition, analysis of three aspects, adversarial networks-based technique.
result The proposed method consistently improves target performance and largely avoids negative transfer.
The paper analyzes phase transitions in transfer learning for perceptrons.
problem Understanding when transfer learning from a source task to a target task is beneficial.
method Theoretical analysis of a pair of related perceptron learning tasks.
result Reveals a phase transition from negative to positive transfer as task similarity changes.
ProductNet curates high-quality product datasets for better product understanding.
problem Lack of high-quality product datasets for product representation learning.
method Curated high-quality product datasets with a multi-modal deep neural network and active learning.
result Master model yields high categorization accuracy (94.7% top-1 accuracy for 1240 classes).
Adaptive source selection for positive transfer in linear models improves target dataset performance.
problem Limited task-specific labeled data in business settings.
method Greedily decides from which sources and how many samples to incorporate into the target dataset using an accept/reject rule based on a data-dependent estimate of the transfer gain.
result Consistent gains over classical and recent strong baselines while avoiding negative transfer.
New research on limits of transfer learning, proving key selection and dependence requirements.
problem Insufficient theoretical foundation for transfer learning.
method Proved novel results on transfer learning, emphasizing selection of information and dependence between domains.
result Upper bound on improvement possible with transfer learning, highlighting the need for careful selection.
Proposes a transfer learning method for high-dimensional quantile regression.
problem Inadequate handling of heterogeneity and heavy tails in transfer learning.
method High-dimensional quantile regression framework with double transfer learning estimator.
result Established error bounds and valid confidence intervals for high-dimensional quantile regression coefficients.
Localized transfer learning improves nonparametric regression performance.
problem Improving nonparametric regression performance on target tasks.
method Localized transfer learning framework that models heterogeneity and partition covariate space into cells.
result Sharp minimax rates show local transfer mitigates the curse of dimensionality.
This work transfers causal knowledge between tasks for Individual Treatment Effect estimation.
problem Estimating Individual Treatment Effects (ITE) requires a large amount of data, making it challenging.
method The authors introduce a practical framework for efficient transfer of causal knowledge between tasks, using a Causal Inference Task Affinity (CITA) measure.
result ITE knowledge transfer can significantly reduce the amount of data needed for ITE estimation.
Investigates transfer learning in spatial statistics.
problem Applying transfer learning to spatial statistics.
method Simple MLP models for spatial data.
result Potential of transfer learning in spatial statistics.
A meta-learning approach for automatic knowledge transfer between networks.
problem Improving performance in small-data real-world problems with heterogeneous architectures and tasks.
method Meta-learning to automatically learn what knowledge to transfer and where in the target network.
result Meta-transfer approach significantly outperforms hand-crafted methods on various datasets and network architectures.
With the help of transfer entropy, we analyze information flows between communities of complex networks. We show that the transfer entropy provides a coherent description of interactions between communities, including non-linear interactions. To put some flesh on the bare bones, we analyze transfer entropies between co…
Simple methods improve regression transferability estimation.
problem Estimating how well regression models transfer between tasks.
method Two simple, computationally efficient approaches based on negative regularized mean squared error.
result Significantly outperform existing methods in accuracy and efficiency.
This paper defines and quantifies transferability in domain generalization.
problem Understanding and quantifying transferability between domains.
method Formal definition and estimation of transferability, upper bound for target error.
result Many algorithms do not learn transferable features, proposing a new algorithm.
Training a source model optimally for its own task is suboptimal for downstream transfer.
problem The optimality of a source model for its own task hinders downstream transfer performance.
method Analyzes L2-SP ridge regression, characterizes transfer-optimal source penalty, and identifies alignment-dependent effects.
result Transfer benefits from stronger source regularization when aligned imperfectly, and from weaker regularization when aligned perfectly.
PTU learns fine-grained parameter transfer for deep networks.
problem Discrete transfer states and lack of principled approach to learn transfer strategies.
method PTU learns a fine-grained nonlinear combination of activations from source and target networks using two gates.
result PTU outperforms heuristic methods in most settings.
Transfer learning does not improve character recognition performance.
problem Improving character recognition performance using transfer learning.
method Performed experiments with varying levels of similarity between source and target tasks, transferring both parameters and features.
result No significant advantage gained by transfer learning over traditional machine learning.
Adversarial perturbations fool wearable sensor systems, showing transferability across different systems.
problem Adversarial examples fool wearable sensor systems, showing transferability across different systems.
method Study of adversarial transferability in wearable sensor systems from four perspectives: systems, subjects, sensor body locations, and datasets.
result Strong untargeted transferability in most cases, targeted attacks less successful.
Paper tackles continuous transfer learning with evolving target domains.
problem Challenges of negative transfer in evolving target domains.
method Proposes label-informed C-divergence for measuring distribution shift and negative transfer.
result Demonstrates effectiveness of TransLATE framework in minimizing classification error and C-divergence.
Paper introduces a new method for improving reinforcement learning performance using transfer learning.
problem Improving reinforcement learning performance with limited sample sizes in dynamic decision-making scenarios.
method Developed a novel ``re-weighted targeting procedure'' and ``transfer deep Q∗-learning'' approach. result Demonstrated improved reinforcement learning performance through strategic sample construction.
A new method transfers parameters in ELM networks using projective model.
problem Parameter transfer in extreme learning machine networks.
method Projective model to bridge source and target model parameters, L2,1-norm penalty for joint feature selection and parameter transfer.
result Significantly outperforms non-transfer ELM networks and other methods.