MAGAN improves GANs stability and performance with adaptive hinge loss.
problem Improving stability and performance of GANs.
method Adaptive hinge loss function with estimated margin based on target distribution energy.
result MAGAN converges to global optimum under certain assumptions.
A classical condition for fast learning rates is the margin condition, first introduced by Mammen and Tsybakov. We tackle in this paper the problem of adaptivity to this condition in the context of model selection, in a general learning framework. Actually, we consider a weaker version of this condition that allows one…
Paper proposes adaptive margin loss to improve few-shot learning.
problem Few-shot learning's difficulty in generalizing from a few examples.
method Develops class-relevant and task-relevant additive margin losses.
result Boosts performance of metric-based meta-learning approaches.
New study reveals a polynomial penalty for adapting to unknown margin parameters in batched nonparametric bandits.
problem Adapting to an unknown margin parameter in batched nonparametric bandits.
method Introduces the regret inflation criterion and develops RoBIN algorithm to achieve optimal regret inflation.
result The optimal regret inflation grows polynomially with the horizon T, characterized by a convex optimization problem.
Paper bridges theory and algorithm for domain adaptation.
problem Domain adaptation from theory to algorithm gap.
method Extended domain adaptation theories, introduced Margin Disparity Discrepancy, and transformed into adversarial learning algorithm.
result Empirical studies show state-of-the-art accuracies on domain adaptation tasks.
We consider the problem of adaptation to the margin and to complexity in binary classification. We suggest an exponential weighting aggregation scheme. We use this aggregation procedure to construct classifiers which adapt automatically to margin and complexity. Two main examples are worked out in which adaptivity is a…
A new method for unsupervised domain adaptation using Gaussian processes.
problem Reducing target domain error by aligning input and output distributions.
method Max-margin Gaussian process approach to achieve hypothesis consistency.
result Our method effectively minimizes maximum discrepancy and maximizes margins.
Novel upper bound for unsupervised domain adaptation considers joint error.
problem Addressing the issue of mixing samples from different classes when matching marginal distributions.
method Proposes a general upper bound that penalizes undesirable joint error, uses constrained hypothesis space, and introduces cross margin discrepancy.
result Our proposal outperforms related approaches in image classification error rates on domain adaptation benchmarks.
New rates and adaptive algorithm for nonparametric active learning under noise conditions.
problem Establishing new minimax-rates for active learning under noise conditions.
method Generic algorithmic strategy for adaptivity to unknown noise smoothness and margin.
result Achieves optimal rates in many general situations and avoids adaptive confidence sets.
This paper proposes a new method to improve domain adaptation by distinguishing between marginal and dependence structure differences.
problem Existing domain adaptation methods fail to differentiate between marginal and dependence structure differences, leading to suboptimal transferability.
method The paper introduces a new approach that measures and optimizes the differences in internal dependence structure separately from marginals.
result The new method significantly improves transferability and robustness compared to existing benchmarks on real-world datasets.
Study shows how steepest descent algorithms' geometric margin increases during training.
problem Understanding implicit bias in steepest descent algorithms for neural networks.
method Analysis of steepest descent algorithms with infinitesimal learning rates in homogeneous neural networks.
result Limit points of training trajectories correspond to KKT points of margin-maximization problems.
Adapts PAC-Bayesian analysis to convolutional neural networks.
problem Generalization error of convolutional neural networks.
method PAC-Bayesian framework applied to convolutional layers.
result Margin bounds for convolutional neural networks.
Improved neural network robustness with instance-specific perturbation margins.
problem Adversarial training fails to generalize well to unperturbed test set.
method Instance adaptive adversarial training with sample-specific perturbation margins.
result Test accuracy improves with a marginal drop in robustness.
A fast method estimates group-adaptive elastic net penalties using co-data.
problem Computational inefficiency in estimating group-adaptive elastic net penalties.
method Derive low-dimensional representation of Taylor approximation for marginal likelihood and its derivative for group-adaptive ridge penalties; approximate elastic net marginal likelihood by ridge; transform ridge penalties to elastic net penalties.
result Significantly decreases computation time and outperforms other methods.
Improves Gaussian process regression without bias.
problem Bias in Gaussian process regression estimates.
method Adaptive computation selection to minimize bias.
result Guaranteed small bias in log marginal likelihood estimates.
We obtain a tight distribution-specific characterization of the sample complexity of large-margin classification with L_2 regularization: We introduce the γ-adapted-dimension, which is a simple function of the spectrum of a distribution's covariance matrix, and show distribution-specific upper and lower bounds on the s…
New research shows the maximum ℓ1-margin classifier doesn't adapt to sparse ground truths.
problem Understanding the limitations of the maximum ℓ1-margin classifier in high-dimensional settings.
method Analyzing convergence and prediction error rates of the maximum ℓ1-margin classifier.
result Proves tight upper and lower bounds for prediction error, showing benign overfitting.
A new method improves maximum margin criterion for better pattern analysis.
problem Handling high dimensionality and large data in pattern analysis.
method Introducing an improved maximum margin criterion (MMC) and its variants.
result Experimental results show the MMC methods are effective in complex scenarios.
This work introduces a noise-adaptive conformal inference method for better prediction sets in noisy data.
problem Real-world complications like random label noise limit the effectiveness of conformal inference.
method An adaptive conformal inference method capable of handling deviations from exchangeability.
result Informative prediction sets with tight marginal coverage guarantees in noisy data.
Causal invariance can improve finite-sample domain adaptation, but only when the target risk margins are large.
problem Finite-sample domain adaptation
method Linear regression with causal knowledge
result Adaptive aggregation can match best candidate predictor while avoiding negative transfer
We obtain a tight distribution-specific characterization of the sample complexity of large-margin classification with L2 regularization: We introduce the margin-adapted dimension, which is a simple function of the second order statistics of the data distribution, and show distribution-specific upper and lower bounds on…
We derive integral and sup-estimates for the curvature of stably marginally outer trapped surfaces in a sliced space-time. The estimates bound the shear of a marginally outer trapped surface in terms of the intrinsic and extrinsic curvature of a slice containing the surface. These estimates are well adapted to situatio…
New framework using Jensen-Shannon divergence improves domain adaptation theory.
problem Incoherence between empirical domain adversarial training and theoretical H-divergence. method Established new theoretical framework based on Jensen-Shannon divergence, derived bi-directional upper bounds.
result Framework exhibits flexibilities for various transfer learning problems.
Proposes BDA for better transfer learning performance.
problem Distribution divergence between source and target domains, especially marginal and conditional.
method Balanced Distribution Adaptation (BDA) and Weighted BDA (W-BDA) algorithms.
result Improves transfer learning performance on both balanced and imbalanced datasets.
GD with large, adaptive stepsizes achieves optimal risk in logistic regression.
problem Optimizing logistic regression with large stepsizes.
method Gradient Descent with adaptive stepsizes.
result GD achieves minimax optimal convergence in logistic regression.
Paper improves DP-ERM for binary linear classification with large-margin subsets.
problem Differentially private binary linear classification with large-margin subsets.
method Efficient (ε,δ)-DP algorithm with empirical zero-one risk bound. result Improved empirical zero-one risk bound for binary linear classification.
Adaptive kernel model for multi-view learning reduces overfitting and scales with data.
problem Overfitting and high computational cost in multi-view learning.
method Bayesian framework, Dirichlet process Gaussian mixtures, random Fourier features, max-margin constraints, MCMC sampler.
result Adaptive learning of shift-invariant kernels from data.
Proposes a new method for learning flexible nonparametric kernels.
problem Improving model flexibility in margin-based kernel methods.
method Data-adaptive non-parametric kernel learning framework with two constraints.
result Enhanced model flexibility and improved performance on benchmark data sets.
We solve the Plateau problem for marginally outer trapped surfaces in general Cauchy data sets. We employ the Perron method and tools from geometric measure theory to force and control a blow-up of Jang's equation. Substantial new geometric insights regarding the lower order properties of marginally outer trapped surfa…
MMA training maximizes margins for adversarial robustness.
problem Adversarial robustness of neural networks.
method Directly maximizes margins through adaptive adversarial training.
result MMA training improves adversarial robustness compared to fixed ε adversarial training.
Paper tackles noise-robust domain adaptation in noisy environments.
problem Learning machines struggle with domain adaptation in noisy environments.
method The paper proposes offline curriculum learning and proxy distribution based margin discrepancy to mitigate label and feature noise.
result The proposed algorithm significantly outperforms state-of-the-art methods in noisy environments.
Proposes AML loss function for TransE to improve link prediction in knowledge graphs.
problem Low performance of TransE due to insufficient scores of positive triples.
method Introduces Adaptive Margin Loss (AML) to automatically adjust margin during training.
result AML improves TransE's performance on link prediction tasks in knowledge graphs.
Paper proposes DDA for better transfer learning performance.
problem Domain discrepancy between source and target distributions.
method Dynamic Distribution Adaptation (DDA) to evaluate and adapt distribution importance.
result DDA improves transfer learning performance on various tasks.
Adaptive classification methods ensure correct prediction intervals.
problem Developing methods to ensure correct prediction intervals for classification problems.
method Specialized conformal inference techniques combining cross-validation+, jackknife+, and a novel conformity score.
result The methods provide guaranteed approximate conditional coverage for complex data distributions.
Introduces Cauchy-Schwarz divergence for domain adaptation.
problem Evaluating discrepancy between source and target domains in unsupervised domain adaptation.
method Introduces Cauchy-Schwarz divergence as a measure for evaluating discrepancy between marginal and conditional distributions.
result CS divergence offers a tighter generalization error bound than Kullback-Leibler divergence.
A new method learns both global and local features for domain adaptation.
problem Lack of local relationship learning between instances in different domains.
method Dual autoencoders (MDAad and MMDA) for global and local feature learning, leveraging label information.
result Outperforms state-of-the-art methods in domain adaptation tasks.
Optimal transport aligns source and target distributions for domain adaptation.
problem Unsupervised domain adaptation with joint class-conditional and label shifts.
method Minimizes importance weighted loss and Wasserstein distance for aligned marginals and class-conditional distributions.
result Our method outperforms competitors on various domain adaptation tasks.
Paper proposes DAPNA to improve few-shot learning with domain adaptation.
problem Improving recognition of unseen classes with limited samples.
method Domain adaptation prototypical network with attention (DAPNA).
result DAPNA outperforms state-of-the-art FSL alternatives in experiments.
Adapts conformal prediction for missing data, ensuring valid coverage.
problem Uncertainty quantification with missing covariates.
method Proposes a reweighted conformal prediction procedure for handling missing values.
result Guaranteed Marginal Coverage and Mask-Conditional Validity for general missing data mechanisms.
A new approach to cost-sensitive multiclass classification prioritizes certain classes over others.
problem Cost-sensitive multiclass classification where some classes are more important than others.
method Apportioned margin framework that shifts the decision boundary to prioritize certain classes.
result The method improves the error rate for important classes while reducing overall error.
Efficiently estimates marginal likelihood using SGAIS.
problem Estimating marginal likelihood in i.i.d. data settings.
method Stochastic Gradient Annealed Importance Sampling (SGAIS).
result Significantly faster and more accurate estimates of marginal likelihood.
A fast method for training linear classifiers maximizes margins.
problem Training linear classifiers with maximum margins.
method Momentum-based gradient method derived from convex dual with Nesterov acceleration.
result Exponentially faster convergence rate compared to standard methods.
Deep Gaussian processes provide a flexible approach to probabilistic modelling of data using either supervised or unsupervised learning. For tractable inference approximations to the marginal likelihood of the model must be made. The original approach to approximate inference in these models used variational compressio…
Adapts AUM to identify ambiguous tasks in crowdsourced learning, improving generalization.
problem Discerning ambiguous tasks in crowdsourced labels to prevent mislabeling.
method Introduces Weighted Areas Under the Margin (WAUM) to average AUMs weighted by task-specific scores.
result Improves generalization performance by discarding ambiguous tasks.
New method improves conditional coverage of conformal prediction.
problem Improving conditional coverage in conformal prediction.
method Trainable transformation of conformity scores to improve conditional coverage.
result Highly adaptive to local data structure, outperforming existing methods.
PrAda-GAN improves synthetic data generation under differential privacy.
problem Generating synthetic data under differential privacy with marginal-based methods.
method Sequential generator architecture integrating GAN and marginal-based approaches, with adaptive regularization of Bayes network structure.
result PrAda-GAN outperforms existing methods in privacy-utility trade-off on synthetic and real-world datasets.
Paper proposes MDAT to stabilize domain alignment in label-scarce settings.
problem Stable and comprehensive domain alignment in label-scarce settings.
method Max-margin Domain-Adversarial Training (MDAT) with Adversarial Reconstruction Network (ARN).
result MDAT stabilizes gradient reversing and achieves strong robustness to hyper-parameters.
Proposes CDDA method to adapt models across domains with minimized discrepancy and increased discriminative power.
problem Transfer learning across domains with different distributions.
method CDDA method that minimizes discrepancy and increases discriminative power through latent feature representation.
result Consistently outperforms state-of-the-art methods in cross-domain image classification tasks.