Adaptive networks improve model robustness through conditional normalization.
problem Limited robustness of adversarial-trained networks due to network capacity and training samples.
method Proposes a conditional normalization module to adapt networks during adversarial training.
result Adaptive networks outperform both clean validation accuracy and robustness compared to non-adaptive counterparts.
Adaptive step-size improves optimization in complex geometries.
problem Optimizing functions with non-Euclidean geometries.
method Adaptive step-size strategy for optimization algorithms.
result Guaranteed convergence for Adaptive Conditional Gradient Descent.
The paper improves generalization bounds for domain adaptation.
problem Improving generalization bounds for domain adaptation under practical conditions.
method Derives generalization bounds for domain adaptation based on finitely many moments and smoothness conditions.
result Obtains generalization bounds for domain adaptation.
New method for adaptive estimation and inference in econometric models without knowing smoothness.
problem Adaptive estimation and inference in ill-posed linear inverse problems with unknown smoothness.
method Discrepancy principle-based framework for adaptive hyperparameter selection.
result Achieves optimal rates in weak and strong metrics for linear functionals.
New technique for multiple-source adaptation without density estimation.
problem Multiple-source adaptation problem.
method Discriminative technique that uses conditional probabilities from unlabeled data.
result Our technique outperforms previous generative solutions and other domain adaptation baselines.
Efficient inference for adaptive data with directional stability condition.
problem Efficient inference on scalar targets after adaptive data collection.
method Introduces directional stability, a weaker condition than i.i.d. data, and shows asymptotic normality and efficiency of estimators.
result Estimators remain asymptotically normal and semiparametrically efficient under directional stability.
This paper analyzes adaptive gradient algorithms for better performance in ill-conditioned problems.
problem Poor performance of standard stochastic gradient algorithms in ill-conditioned problems.
method Non-asymptotic analysis of adaptive gradient algorithms (Adagrad and Stochastic Newton) for strongly convex objectives.
result Theoretical analysis and adaptation to practical applications like linear regression and regularized GLM.
A classical condition for fast learning rates is the margin condition, first introduced by Mammen and Tsybakov. We tackle in this paper the problem of adaptivity to this condition in the context of model selection, in a general learning framework. Actually, we consider a weaker version of this condition that allows one…
Perfect adaptation in systems is identified and tested using graphical tools.
problem Identifying perfect adaptation in dynamical systems.
method Causal ordering algorithm and graphical representations of dynamical systems.
result Sufficient graphical and testing conditions for perfect adaptation.
Client adaptation improves federated learning performance with non-IID data.
problem Improving model performance in federated learning with non-identically and non-independently distributed data.
method Simulates heterogeneous clients to learn client-specific conditioning using a conditional gated activation unit.
result Client adaptation enhances model performance across balanced and imbalanced data sets from audio and image domains.
Sequential Kernel-based Conditional Independence Testing via Adaptive Betting
problem Testing conditional independence
method Testing-by-betting on an adaptively optimized Kernel Conditional Independence statistic
result Significantly reduces Type I error inflation while preserving high power
EnMDAP aligns conditional distributions for multi-source domain adaptation using pseudolabels.
problem Training a target model with no labeled data in the absence of target data labels.
method EnMDAP uses label-wise moment matching and ensemble learning with multiple feature extractors.
result EnMDAP achieves state-of-the-art performance in multi-source domain adaptation tasks.
Discriminative active learning reduces data annotation costs for domain adaptation.
problem Conditional shift problem hinders domain adaptation between related but different domains.
method Three-stage active adversarial training: invariant feature space learning, uncertainty and diversity criteria, re-training with queried labels.
result Empirical comparisons show the proposed approach is more effective than existing methods.
New methods for better uncertainty prediction in ML.
problem Insufficient calibration in machine learning regression.
method Conditional calibration with respect to input features (adaptivity).
result Consistency and adaptivity are complementary, and good consistency does not guarantee good adaptivity.
First we show that a curvature-adapted proper complex equifocal submanifold is a principal orbit of a Hermann type action under certain condition. Next we show that a proper complex equifocal submanifold is curvature-adapted under certain condition.
Due to the advantage of achieving a better performance under weak regularization, elastic net has attracted wide attention in statistics, machine learning, bioinformatics, and other fields. In particular, a variation of the elastic net, adaptive elastic net (AEN), integrates the adaptive grouping effect. In this paper,…
CWAN tackles multi-source heterogeneous domain adaptation with conditional weighting.
problem Learning cross-domain samples from multiple heterogeneous domains.
method CWAN uses a feature transformer, label classifier, and domain discriminator to learn from multiple sources.
result CWAN outperforms state-of-the-art methods on four real-world datasets.
In this paper we formally analyse the use of sparse filtering algorithms to perform covariate shift adaptation. We provide a theoretical analysis of sparse filtering by evaluating the conditions required to perform covariate shift adaptation. We prove that sparse filtering can perform adaptation only if the conditional…
MOPI optimizes flexible set-valued mappings to achieve superior shape adaptivity in conformal prediction.
problem Challenges in achieving valid conditional coverage in conformal prediction.
method Minimax Optimization Predictive Inference (MOPI) framework that optimizes over a flexible class of set-valued mappings.
result MOPI achieves superior shape adaptivity and maintains a principled connection to mean squared coverage error.
VFMs use noise adapters to conditionally generate images in one step.
problem Conditional image generation with iterative models is slow and requires explicit sampling paths.
method Developed a variational flow map framework that learns noise distributions for conditional sampling.
result VFMs achieve well-calibrated conditional samples in a single forward pass.
Optimal transport aligns source and target distributions for domain adaptation.
problem Unsupervised domain adaptation with joint class-conditional and label shifts.
method Minimizes importance weighted loss and Wasserstein distance for aligned marginals and class-conditional distributions.
result Our method outperforms competitors on various domain adaptation tasks.
We propose two approaches of locally adaptive activation functions namely, layer-wise and neuron-wise locally adaptive activation functions, which improve the performance of deep and physics-informed neural networks. The local adaptation of activation function is achieved by introducing a scalable parameter in each lay…
New method improves conditional coverage of conformal prediction.
problem Improving conditional coverage in conformal prediction.
method Trainable transformation of conformity scores to improve conditional coverage.
result Highly adaptive to local data structure, outperforming existing methods.
Paper proposes CCVAE for generalized zero-shot domain adaptation.
problem Adapting to unseen classes in target domain with limited labeled data.
method Coupled Conditional Variational Autoencoder (CCVAE).
result CCVAE generates synthetic target domain features for unseen classes.
Unseen data conditions can inflict serious performance degradation on systems relying on supervised machine learning algorithms. Because data can often be unseen, and because traditional machine learning algorithms are trained in a supervised manner, unsupervised adaptation techniques must be used to adapt the model to…
Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the learnt representation, together with the hypothesis learnt from the source doma…
Adaptive denoising models adjust the number of steps based on noise level.
problem Generating data with lower intrinsic dimensions.
method Adaptive diffusion models using Doob's h-transform to terminate at a random time.
result Adaptive models simplify termination to a first-hitting rule, enhancing adaptability.
PriorGrad improves speech synthesis models by using data-dependent adaptive priors.
problem Inefficiency in denoising diffusion models due to mismatch between prior and data distributions.
method Proposes PriorGrad, an adaptive prior derived from data statistics based on conditional information.
result PriorGrad achieves faster convergence and superior performance in speech synthesis models.
A new algorithm reduces inference error in adaptive contextual bandits.
problem Challenges in statistical inference for adaptive contextual bandits.
method Proposes a regularized EXP4 algorithm that satisfies the Lai-Wei stability condition.
result Valid Wald-type confidence intervals for linear functionals can be achieved without the price of adaptivity.
The teacher-student (T/S) learning has been shown to be effective for a variety of problems such as domain adaptation and model compression. One shortcoming of the T/S learning is that a teacher model, not always perfect, sporadically produces wrong guidance in form of posterior probabilities that misleads the student …
New insights on bias in multi-armed bandits under conditional sampling.
problem Understanding bias in multi-armed bandits under conditional sampling.
method Characterized the sign of conditional bias of monotone functions of rewards.
result Sign of conditional bias can differ from marginal bias, depending on conditioning events.
New algorithm adapts to unknown demand smoothness for dynamic pricing.
problem Dynamic pricing with unknown Hölder smoothness of demand function.
method Self-similarity condition and adaptive algorithm.
result Adaptive algorithm achieves minimax optimal regret without prior knowledge of smoothness.
Novel unsupervised scheme for highly imbalanced and overlapping datasets.
problem Highly imbalanced and overlapping classes in medical datasets.
method Unsupervised domain adaptation scheme based on Quantification.
result High quality results for Quantification and Domain Adaptation.
Adaptive method improves numerical solution of Cox-Ingersoll-Ross model.
problem Approximating solutions to the Cox-Ingersoll-Ross model efficiently.
method Path-bounded timestepping with hybrid approach, including a backstop method.
result The adaptive method is strongly convergent, with strong error control.
We show that the two-stage adaptive Lasso procedure (Zou, 2006) is consistent for high-dimensional model selection in linear and Gaussian graphical models. Our conditions for consistency cover more general situations than those accomplished in previous work: we prove that restricted eigenvalue conditions (Bickel et al.…
New algorithm tackles nonconvex machine learning problems with adaptive normalization and independent sampling.
problem Nonconvex machine learning problems with generalized-smoothness.
method Adaptive gradient normalization, independent sampling, and gradient clipping.
result Achieves an O(ε^(-4)) sample complexity for fast convergence.
Novel method for time-series prediction with tighter confidence intervals.
problem Improving prediction intervals for time-series data.
method Kernel-based Optimally Weighted Conformal Prediction Intervals (KOWCPI) using adaptive weights.
result KOWCPI achieves narrower confidence intervals with guaranteed coverage.
The paper proposes a method to adapt machine learning models to changing conditions.
problem Machine learning models need to adapt to new conditions in a constantly changing environment.
method Reuse knowledge from existing models to train future generations.
result The proposed method allows machine learning models to adapt and survive in a dynamic environment.
Adaptive framework predicts stock prices better during volatile periods.
problem Inability of standard prediction models to handle regime-dependent stock market behavior.
method Autoencoder-Gated Dual Node Transformers with Reinforcement Learning Control.
result 0.59% MAPE with adaptive system, compared to 0.80% for baseline.
This study addresses an issue of co-adaptation between a feature extractor and a classifier in a neural network. A naive joint optimization of a feature extractor and a classifier often brings situations in which an excessively complex feature distribution adapted to a very specific classifier degrades the test perform…
Meta-reinforcement learning improves fault-adaptive control efficiency.
problem Adaptive control under abrupt system faults with strict time constraints.
method Model-agnostic meta learning (MAML) with a fault library of prior policies.
result Improved sample efficiency and quick adaptation to new faults.
CoDA adapts dynamics models to new physical systems by conditioning on context.
problem Generalizing to new physical systems with shared dynamics but different contexts.
method Context-informed dynamics adaptation (CoDA) using multiple environments and a hypernetwork.
result State-of-the-art generalization results on nonlinear dynamics.
Paper tackles backwards-compatible data adaptation for confounded covariate and label shifts.
problem Adapt covariates to predict labels confounded with covariate shifts.
method Proposes confounded shift framework based on minimizing divergence between source and target conditional distributions, conditioning on confounders.
result Demonstrates approach on synthetic and real datasets, achieving backwards-compatible data adaptation.
New scalable methods for unbalanced optimal transport improve efficiency and applicability.
problem Scalable algorithms for unbalanced optimal transport remain underexplored.
method Analysis of semi-dual formulation and adaptive gradient methods.
result SGD methods achieve a convergence rate of O(n/εT) for large-scale applications.
Paper proposes a new method to aggregate multiple sources with different label distributions.
problem Aggregating from multiple target-shifted sources with different label distributions.
method Unified framework to select relevant sources for domain adaptation with limited label, unsupervised, and label partial unsupervised scenarios.
result Empirical results significantly outperform baselines.
Graphs models are vulnerable to distribution shifts, which this work explains and mitigates.
problem Graph Neural Networks (GNNs) are susceptible to distribution shift, leading to performance degradation.
method Theoretical analysis quantifying conditional shift, proposing an approach to estimate and minimize it.
result The proposed approach demonstrates up to 10% absolute ROC AUC improvement under various distribution shifts.
Improved conformalized quantile regression for adaptive prediction intervals.
problem Lack of adaptiveness in the conformal step of conformalized quantile regression.
method Cluster explanatory variables by permutation importance and apply k conformal steps.
result Improved prediction intervals are more adaptive to heteroscedasticity.
Neural HMM with AGA captures multi-scale dynamics in financial markets.
problem Capturing multi-scale temporal dynamics in financial markets.
method Parallel multi-resolution encoders, adaptive gating, and multi-head attention.
result Outperforms fixed-resolution baselines in predicting price movements and liquidity shocks.