Study improves RF sensor robustness for target recognition.
problem Variability in RF target responses makes them vulnerable to attacks.
method Evaluates techniques for building robust classification architectures.
result Improves accuracy in identifying true target characteristics.
Improves domain adaptation by clustering target representations.
problem Learning invariant and discriminative representations for unlabeled target domains.
method Simultaneously learns tightly clustered target representations and assigns each cluster to a unique class from the source.
result Achieves state-of-the-art performance in balanced, imbalanced, and partial domain adaptation.
Enhances source domain knowledge with target data for transfer learning.
problem Limited data in target domains and rigid model assumptions in transfer learning.
method Transfer learning through Enhanced Sufficient Representation (TESR).
result TESR enhances source domain knowledge with target data, improving transfer learning performance.
Paper proposes a method to learn linear regression models using multiple pre-trained models.
problem Learning a linear regression model with limited target data.
method Representation transfer learning method using multiple pre-trained models.
result The method achieves better sample complexity compared to baseline methods.
GEFA predicts drug-target affinity using graph neural networks.
problem Accurate prediction of drug-target interactions for rapid drug repurposing.
method GEFA (Graph Early Fusion Affinity) is a novel graph-in-graph neural network with attention mechanism.
result GEFA effectively models drug-target interactions, demonstrating the effectiveness of pre-trained protein embedding and nested graph representation.
Paper tackles robust domain adaptation without target domain data.
problem Learning domain invariant representations without target domain data.
method Integrates deep autoencoder and causal structure learning into a unified model.
result CAE learns causal representations using only source domain data.
HiGraphDTI learns drug and target representations from molecular graphs to predict DTIs.
problem Inaccurate drug-target interaction prediction due to insufficient chemical information extraction.
method Hierarchical graph representation learning to extract chemical information from atoms, motifs, and molecules.
result HiGraphDTI outperforms state-of-the-art methods in DTI prediction and interaction interpretation.
Improves supervised learning with target-embedding autoencoders.
problem Improving generalization in purely supervised settings with high-dimensional target spaces.
method Target-Embedding Autoencoders (TEA) for jointly optimizing latent representations for prediction and feature predictability.
result Guaranteed generalization for linear TEAs through uniform stability, and empirical validation across multivariate sequence forecasting.
New DTI model using self-attention molecule representation outperforms state-of-the-art.
problem Predicting drug-target interactions to reduce costs and improve personalized medicine.
method Proposes a new molecule representation using self-attention and a new DTI model.
result Our DTI model outperforms state-of-the-art by up to 4.9% points in precision-recall.
Paper develops upper-bounds for target general loss in multiple source DA and DG settings.
problem Complexity and trade-offs in multiple source domain adaptation and domain generalization.
method Defines two types of domain-invariant representations and studies their pros, cons, and trade-offs.
result Developed upper-bounds for target general loss offer insights into domain-invariant representations.
New approach improves domain adaptation by enforcing cluster assumption in target domain.
problem Lack of robustness in target classifier due to violation of cluster assumption.
method Enforces cluster assumption in target domain (Target Consistency) paired with Class-Level InVariance.
result Significant improvement in image classification and segmentation benchmarks.
New approach tackles domain adaptation without assuming domain invariant representations.
problem Learning models on source domains for target domains with labeled and unlabeled data.
method Hidden Covariate Shift hypothesis; learning representation to match joint distributions.
result State-of-the-art performance on Amazon Reviews dataset.
Estimates model performance under distribution shift using domain-invariant predictors.
problem Poor performance of models on test distributions different from training distributions.
method Uses domain-invariant predictors as a proxy for unknown target labels.
result Shows that the complexity of latent representations influences target risk.
This research finds that using mean-squared error and codeword targets improves adversarial robustness.
problem Evaluating and improving the robustness of neural networks against adversarial attacks.
method Training neural networks on mean-squared error and using codeword targets as representations.
result The modified models show up to 98.7% increase in accuracy against untargeted attacks and up to 99.8% decrease in targeted attack success rates.
Proposes a self-attention-based method for drug-target interaction prediction.
problem Interpreting machine learning models for drug-target interactions.
method Self-attention-based multi-view representation learning approach.
result Competitive prediction performance with biologically interpretable results.
The paper explores how disentangled representations can improve fairness in prediction tasks.
problem Improving fairness in prediction tasks using disentangled representations.
method Investigates different notions of disentanglement and analyzes representations of state-of-the-art models.
result Disentanglement scores are correlated with increased fairness in prediction tasks.
Develops a direct debiased machine learning framework using Bregman divergence.
problem Reduces bias in machine learning estimates of causal effects or structural models.
method Neyman targeted estimation and generalized Riesz regression using Bregman divergence.
result Improves estimation of parameters of interest in causal models.
Vector representations of words have heralded a transformational approach to classical problems in NLP; the most popular example is word2vec. However, a single vector does not suffice to model the polysemous nature of many (frequent) words, i.e., words with multiple meanings. In this paper, we propose a three-fold appr…
We complete the classification of maximal representations of uniform complex hyperbolic lattices in Hermitian Lie groups by dealing with the exceptional groups E6 and E7. We prove that if ρ is a maximal representation of a uniform complex hyperbolic lattice Γ⊂SU(1,n), n>1, in an exce…
TCRI improves domain generalization by enforcing conditional independence constraints.
problem Limitations of existing domain generalization methods due to incomplete constraints.
method TCRI implements regularizers motivated by conditional independence constraints.
result TCRI achieves cross-domain stability and outperforms baselines in worst-domain accuracy.
Improves transferability of representations from source to target domains with weights and invariant representations.
problem Label shift between source and target domains in unsupervised domain adaptation.
method Integrates weights and invariant representations to bound the target risk, highlighting the role of inductive bias.
result Empirical evidence shows that weak inductive bias makes adaptation more robust.
A new method aligns source and target distributions by tuning their weights.
problem Domain adaptation on unlabeled target datasets using labeled source datasets.
method Weighted Joint Distribution Optimal Transport (WJDOT) method that finds alignment between source and target distributions and re-weighting of source distributions.
result Achieves state-of-the-art performance on simulated and real-life datasets.
HTAD predicts diagnoses from EHRs using target-aware attention.
problem Lack of specificity in aggregating clinical records for diagnosis prediction.
method Hierarchical target-attentive mechanism for EHRs.
result Target-aware attention significantly improves diagnosis prediction performance.
Transfer learning aims to improve learning in target domain by borrowing knowledge from a related but different source domain. To reduce the distribution shift between source and target domains, recent methods have focused on exploring invariant representations that have similar distributions across domains. However, w…
This work proposes a model to disentangle image factors effectively and control their manipulation.
problem Controlling disentanglement during image editing while preserving object identity.
method Encoder-decoder architecture with decorrelation regularization and soft target representations.
result The model successfully disentangles image factors and manipulates them effectively.
AI2V learns user representations by focusing on recent interests.
problem User interests and behavior change over time, affecting recommendation quality.
method Introduces AI2V, a neural attentive model that learns user representations by focusing on recent interests.
result AI2V outperforms other models on various datasets.
A new method for representation and metric learning on manifolds boosts performance.
problem Improving representation and metric learning on complex, non-Euclidean data.
method Atlas-based manifold representation with a modified encoder and MMD loss.
result Substantial performance boost over baseline for low-dimensional encodings.
Domain adaptation leverages the knowledge in one domain - the source domain - to improve learning efficiency in another domain - the target domain. Existing heterogeneous domain adaptation research is relatively well-progressed, but only in situations where the target domain contains at least a few labeled instances. I…
The paper shows how to learn causal representations with few environments and finite samples.
problem Learning causal representations from limited data and environments.
method Explicit, finite-sample guarantees with a logarithmic number of interventions.
result Consistent recovery of latent causal graph, mixing matrix, and unknown intervention targets.
Sharp theory of neural network scaling laws for hierarchical targets.
problem Learning hierarchical multi-index models in neural networks.
method Sharp information-theoretic scaling laws derived for two-layer neural networks.
result Optimal rates achieved by a simple spectral estimator.
A new method for precise user targeting in advertising using hyperbolic manifold learning.
problem Improving user satisfaction in targeted advertising by overcoming skepticism and spam perception.
method Proposes a Multi-Manifold Learning framework to learn hierarchical user and ad representations in the hyperbolic space.
result Demonstrates improved performance in user targeting and prediction accuracy on both public datasets and a large-scale commercial system.
DM improves self-supervised transfer learning by matching target distributions.
problem Improving self-supervised transfer learning performance.
method Distribution Matching (DM) method that drives representation distribution towards a predefined reference distribution.
result DM outperforms existing methods on target classification tasks.
This work explores how neural network architecture affects robustness to noisy labels.
problem The impact of neural network architecture on robustness to noisy labels.
method Formal framework connecting robustness to architecture alignments, measured by predictive power in representations.
result Network robustness to noisy labels improves when its architecture is more aligned with the target function.
Paper introduces a method to create robust representations against covariate shifts.
problem Distribution shift between training and testing data in machine learning.
method Introduces a variational objective with two components: discriminative representation and invariant support.
result Optimal representations ensure robustness to covariate shifts, improving performance on DomainBed.
The paper tackles transfer learning for growing matrix representations, improving estimation accuracy.
problem Structured matrix estimation under growing ambient dimensions and latent representations.
method Proposes a general transfer framework decomposing target parameters into embedded source components, low-rank innovations, and sparse edits. Develops an anchored alternating projection estimator.
result Establishes deterministic error bounds that separate target noise, representation growth, and source estimation error, yielding improved rates.
Transfer knowledge from multiple sources to improve matrix completion.
problem Matrix completion with noisy data.
method Aggregating singular subspaces information from multiple sources to solve a two-way PCA problem and transform into a low-dimensional linear regression.
result Guaranteed statistical efficiency in transforming the high-dimensional target matrix completion problem.
Agent learns diverse hierarchical structures in unknown environments.
problem Autonomous discovery and learning of diverse structures in unknown changing environments.
method Progressive construction of a Hierarchy of Observation Latent Models for Exploration Stratification (HOLMES).
result Agent can learn and reuse representations to progressively explore and discover diverse structures.
Study compares new audio representation methods for limited data music retrieval.
problem Improving machine learning for audio data with limited training data.
method Investigated mel-spectrogram and Mel scattering representations, and augmented target loss function.
result All proposed methods outperform standard mel-spectrogram when using limited data.
A model learns causal representations from high-dimensional data.
problem Challenges in learning causal representations from high-dimensional data.
method Formulated a latent variable decoder model, Decoder BCD, for Bayesian causal discovery.
result Shows that using known intervention targets as labels helps in unsupervised Bayesian inference over structure and parameters.
RL models improve target control in SSGs for security applications.
problem Improving RL algorithms for target control in SSGs.
method Investigates improvements to target representations in RL algorithms.
result Enhanced RL models control targets better in SSGs.
New findings on representation learning beyond linear functions.
problem Achieving diversity in representation learning beyond linear prediction functions.
method Analysis of eluder dimension and empirical risks.
result Diversity holds even with nonlinear prediction functions and multiple layers in neural networks.
One-shot VC model converts voices without parallel data.
problem Limited VC applicability due to training data restriction.
method Disentangles speaker and content representations with instance normalization.
result Model converts voices from unseen speakers with high similarity.
iREPA shows spatial structure, not global semantic, drives generation performance in REPA.
problem Understanding what aspect of the target representation matters for generation.
method Empirical analysis of 27 vision encoders, two modifications to REPA.
result Spatial structure, not global semantic, drives generation performance.
The paper explores how AI systems use information geometry to encode semantic structure.
problem How AI systems encode semantic structure into geometric representation spaces.
method Focuses on softmax distributions and develops dual steering method for robust concept manipulation.
result Dual steering optimally modifies target concepts while minimizing off-target changes.
BYOL learns image representations without negative pairs.
problem Self-supervised image representation learning.
method Two neural networks interact and learn from each other, updating the target network with a slow-moving average of the online network.
result Achieves state-of-the-art performance on ImageNet.
Sparse molecular representations improve interpretability in graph neural networks.
problem Difficulty in understanding which molecular graph aspects drive deep learning predictions.
method Constrain weights in a graph convolutional neural network using the Gini index to maximize representation inequality.
result The Gini-constrained approach does not degrade evaluation metrics and allows for interpretable representation combination.
The identification of novel drug-target (DT) interactions is a substantial part of the drug discovery process. Most of the computational methods that have been proposed to predict DT interactions have focused on binary classification, where the goal is to determine whether a DT pair interacts or not. However, protein-l…
Paper shows deep nets can't guarantee domain adaptation without invariant features.
problem Learning domain-invariant features for successful domain adaptation.
method Proposes a counterexample and a new generalization upper bound.
result Shows conditional shift and characterizes a fundamental tradeoff.