Graph-RISE learns image embeddings for ultra-fine-grained semantics.
problem Learning image representations for fine-grained semantics.
method Graph-regularized neural graph learning framework.
result Graph-RISE outperforms state-of-the-art on image classification and triplet ranking.
LEAPS uses semantic models to improve reinforcement learning in diverse environments.
problem Generalizing and adapting to unseen environments in reinforcement learning.
method Hybrid model-based and model-free approach with a multi-target sub-policy and a Bayesian semantic model.
result LEAPS outperforms baselines in visual navigation tasks using diverse indoor scenes.
Sherlock uses deep learning to accurately detect data types from column headers.
problem Detecting accurate semantic types of data columns for data science tasks.
method Sherlock is a multi-input deep neural network trained on a corpus of 686,765 data columns.
result Sherlock achieves a support-weighted F1 score of 0.89, outperforming existing methods.
Mathematical theory explains neural network semantic development.
problem Understanding how neural networks acquire and organize abstract knowledge.
method Mathematical analysis of deep linear networks.
result Exact solutions reveal principles of semantic development.
This work prevents variational autoencoders from collapsing by adding an auxiliary decoder.
problem Variational autoencoders can collapse into autodecoders, losing semantic information.
method Adding an auxiliary decoder to regularize the latent space.
result Auxiliary decoders increase semantic information in the latent space and reconstructions.
Improved zero-shot learning with graph-based regularization.
problem Transfer knowledge to unknown classes in zero-shot learning.
method Isoperimetric loss for learning map between visual and semantic embeddings, exploiting graph structure.
result Regularization alone outperforms state-of-the-art methods in zero-shot learning benchmarks.
DCoM uses deep neural networks to detect semantic data types from raw column values.
problem Detecting semantic data types from dirty and unseen data.
method DCoM employs multi-input NLP-based deep neural networks trained on 686,765 data columns.
result DCoM outperforms existing methods significantly on 78 different semantic data types.
Improves cross-modal retrieval by integrating unlabeled data.
problem Lack of semantic similarity constraints and unlabeled data in cross-modal retrieval.
method Integrates quadruplet ranking loss and semi-supervised contrastive loss in a multi-task learning architecture.
result Boosts cross-modal retrieval accuracy by exploiting unlabeled data.
This work shows how transformers use multi-concept word semantics for efficient in-context learning.
problem Understanding the connection between transformer-based LLMs' multi-concept semantic representation and their innovative in-context learning abilities.
method A concept-based low-noise sparse coding prompt model, leveraging advanced techniques to analyze the exponential convergence of 0-1 loss over non-convex training dynamics.
result Transformers leverage multi-concept word semantics to enable powerful and excellent out-of-distribution in-context learning.
This work tackles semantic validity in graph generation, proposing a regularization framework for variational autoencoders.
problem Ensuring semantic validity in graph generation, especially for combinatorial structures like molecular graphs and protein interaction networks.
method Proposes a regularization framework for variational autoencoders to enforce semantic constraints in graph generation.
result Significantly higher likelihood of sampling valid graphs compared to existing methods.
CNNs struggle with negative images, showing lower accuracy.
problem The limitation of CNNs in recognizing negative images.
method Evaluation of CNNs on negative images to assess their semantic understanding.
result CNNs perform poorly on negative images, suggesting lack of generalization.
A new topic model uses word embeddings on a sphere for better topic coherence.
problem Traditional topic models ignore semantic word correlations.
method Proposes von Mises-Fisher distribution for word density on a unit sphere, using Hierarchical Dirichlet Process and Stochastic Variational Inference.
result The model outperforms existing methods in topic coherence.
IZF uses flow-based models to overcome ZSL limitations.
problem Hardness of training ZSL models and limited generation quality.
method IZF incorporates flow-based models to learn factorized data embeddings and generates samples.
result IZF significantly outperforms existing methods on ZSL benchmarks.
A new method uncovers intrinsic data structures for unsupervised domain adaptation.
problem Learning domain-aligned features can damage intrinsic target discrimination.
method Structurally Regularized Deep Clustering (H-SRDC) integrating structural source regularization.
result H-SRDC outperforms existing methods in image classification and semantic segmentation.
PixelDCL addresses checkerboard problem in deconvolutional layers.
problem Checkerboard problem in deconvolutional layers.
method Fresh interpretation of deconvolution operation to establish direct relationships among adjacent pixels.
result PixelDCL can consider spatial features and yields more accurate segmentation outputs.
Enhances hand gesture recognition with separate networks and shared features.
problem Improving recognition accuracy of unimodal 3D-CNNs for dynamic hand gestures.
method Separate networks for each modality, collaborative learning, spatiotemporal semantic alignment loss, focal regularization.
result Improves test time recognition accuracy and state-of-the-art performance.
New Bayes' theorem optimizes semantic channels for machine learning.
problem Class imbalance and semantic meaning evolution in natural language.
method Convert Shannon's channel to semantic channel using third kind of Bayes' theorem.
result CM algorithm explains natural language evolution and improves predictive models.
LEAK learns from mistakes to improve point cloud segmentation.
problem Improving point cloud semantic segmentation performance.
method Coarse-to-fine clustering, class-conditional prototypical feature alignment, fairness weighting.
result State-of-the-art performances on different architectures, datasets, and tasks.
LPL optimizes embeddings to align local neighborhoods, improving cross-lingual word alignment.
problem Aligning embeddings across different datasets and languages.
method Locality Preserving Loss (LPL) optimizes model to project embeddings while maintaining local neighborhoods and aligning them.
result LPL-based alignment leads to better and consistent accuracy, especially in small training set settings.
The paper explains how continuous language models can produce discrete, interpretable meanings.
problem Semantic collapse in continuous systems of large language models.
method Formalizing large language models as Continuous State Machines (CSMs) and analyzing the associated transfer operator.
result The leading eigenfunctions of the transfer operator induce a finite number of invariant meaning basins, explaining how continuous computation can produce discrete, interpretable semantics.
This paper uses financial news to improve macroeconomic forecasts.
problem Inaccurate and biased economic forecasts.
method Combining machine learning with semantic analysis for interpretable predictions.
result Significant reduction in forecast errors with long-term predictions.
CM algorithm matches Shannon's and semantic channels for multi-label classification.
problem Tackles label learning and selection for multi-label classification.
method Adheres to maximum semantic information criterion, uses Bayes' theorem, and trains truth functions.
result Shows improved performance and adaptability to changing source distributions.
MADOD meta-learns invariant features for OOD detection across unseen domains.
problem Simultaneous covariate and semantic shifts in real-world machine learning applications.
method Meta-learning and G-invariance to learn robust, domain-invariant features.
result Superior performance in semantic OOD detection across unseen domains.
New method neutralizes gender bias in word embeddings without losing semantic information.
problem Gender biases in word embeddings trained on human-generated corpora.
method Latent Disentanglement and Counterfactual Generation with siamese auto-encoder and gradient reversal layer.
result Our method outperforms existing debiasing methods in preserving semantic information and neutralizing gender biases.
Improves GAN-based semi-supervised learning with consistency regularization.
problem Lack of consistency in class probability predictions under local perturbations.
method Introduces consistency regularization to GANs, leveraging both local and interpolation consistency.
result Significantly improves performance and achieves new state-of-the-art results.
New algorithm improves CRF inference and learning.
problem Efficient inference and learning for dense CRFs.
method Regularized Frank-Wolfe algorithm for nonconvex CRF optimization.
result Regularized Frank-Wolfe outperforms mean field and CNN baselines.
New method predicts protein features using statistical relational learning.
problem Challenges in automatic protein feature annotation due to limited homology data.
method Introduces Semantically Based Regularization to incorporate prior knowledge.
result Improved overall prediction quality with constraints.
IdBench benchmarks semantic representations of identifiers, revealing strengths and weaknesses.
problem Evaluating semantic representations of identifiers in source code.
method Created a benchmark using developer ratings, evaluated natural language and source code embeddings, and compared lexical string distance functions.
result No single technique provides a satisfactory representation of semantic similarities, but ensemble models can improve performance.
LLMs show surprising confidence in their answers, beyond just tokens.
problem LLMs lack meaningful confidence estimates for their responses.
method Semantic calibration test based on local loss optimality and equivalence classes.
result Base LLMs are semantically calibrated across tasks, contrary to expectations.
Unsupervised scheme ranks sentences in text documents based on semantic importance.
problem Ranking sentences in text documents without labeled data.
method Extracts essential words and phrases, constructs semantic phrase and sentence graphs, applies PageRank, combines scores, and optimizes for topic diversity.
result SSR outperforms individual judges and compares favorably with combined rankings on benchmarks.
Proposes CSG model to separate semantic and variation factors for OOD prediction.
problem Out-of-distribution examples cause conventional models to mix semantic and variation factors, leading to poor performance.
method Causal Semantic Generative model (CSG) based on causal reasoning, using variational Bayes for efficient learning and prediction.
result CSG can identify semantic factor and improve OOD prediction performance.
Superpixel-mix enhances reliability in semantic segmentation.
problem Improving reliability in real-world semantic segmentation.
method Superpixel-mix, a new data augmentation method with teacher-student consistency training.
result Superpixel-mix achieves state-of-the-art results in semi-supervised semantic segmentation.
New framework aligns latent representations over-the-air using intelligent metasurfaces.
problem Heterogeneous transmitter-receiver models produce misaligned latent representations in semantic communication.
method Intelligent metasurfaces (SIM) emulate supervised and zero-shot semantic aligners directly in the wave domain.
result SIMs achieve up to 90% task accuracy in high SNR regimes, robust to low SNR.
Protocol for constructing tailored evaluation datasets for semantic models.
problem Evaluation of domain-specific semantic models, focusing on top ranks.
method Adaptive pairwise comparisons, relatedness-based evaluation dataset, metrics, stochastic transitivity model.
result Effectiveness of the proposed dataset construction protocol confirmed.
Tensor-based embeddings improve knowledge graph fact prediction.
problem Predicting new facts in knowledge graphs.
method Knowledge-Enriched Tensor Factorization
result 5% to 50% relative improvement over state-of-the-art techniques.
Semantify-NN verifies neural network robustness against semantic perturbations.
problem Verifying robustness of neural networks against semantic adversarial attacks.
method Inserting semantic perturbation layers (SP-layers) into neural networks to verify robustness.
result Semantify-NN significantly improves robustness verification performance over ℓp-norm-based methods. Neural Photo Editor uses AI to edit photos accurately and coherently.
problem Achieving accurate reconstructions in photo editing.
method Introspective Adversarial Network (VAE-GAN hybrid) with weight-shared dilated convolutions and Orthogonal Regularization.
result Produces high-fidelity photo edits and reconstructions.
Probabilistic inpainting learns multiple plausible images from missing data.
problem Generating multiple plausible images from missing data in images.
method Building a PixelCNN model that learns a distribution of images conditioned on visible pixels.
result The method produces diverse and realistic inpaintings.
Advances citation and subject label recommendation using multi-modal adversarial autoencoders.
problem Improving recommendation systems for citations and subject labels.
method Multi-modal adversarial autoencoders with adversarial regularization, sparsity, and input modality analysis.
result Adversarial regularization consistently improves recommendation performance.
Proposes feature conformal prediction for broader application in semantic feature spaces.
problem Establishing valid prediction intervals in semantic feature spaces.
method Extends conformal prediction to semantic feature spaces using deep representation learning.
result Feature conformal prediction outperforms regular conformal prediction under mild assumptions.
SECRET combines ML and NLP for better real-world task classification.
problem Limited integration of semantic relationships in supervised ML.
method SECRET fuses semantic information from NLP with feature space of supervised ML.
result Up to 14.0% accuracy and 13.1% F1 score improvements over traditional supervised learning.
A new method for optimizing language-based agentic systems using semantic backpropagation.
problem Lack of proper feedback assignment in optimizing agentic systems.
method Formalization of semantic backpropagation with semantic gradients and semantic gradient descent.
result Our method outperforms existing state-of-the-art methods for solving GASO problems.
Paper improves robustness of semantic segmentation models.
problem Improving robustness of semantic segmentation models for safer interactions.
method Analyzes and corrects softmax function mappings to improve model robustness.
result Improves robustness with minimal performance impact and code changes.
Enhances cooperative multi-task SemCom for distributed users.
problem Performance degradation in cooperative multi-tasking due to negative information transfer.
method Federated learning (FL) with semantic-aware task clustering.
result Constructive cooperation across distributed users with semantic-aware task clustering.
Unsupervised method improves word vectors by suppressing high variance features.
problem Improving semantic information in word vectors.
method Using conceptors to suppress high variance features in word vectors.
result Post-processed word vectors outperform existing alternatives in lexical evaluation tasks.
Paper proposes structured semantic perturbations to improve adversarial attacks.
problem Vulnerability of deep neural networks to adversarial attacks.
method Manipulates semantic attributes via disentangled latent codes.
result Demonstrates the effectiveness of structured semantic perturbations.
New diffusion models improve counterfactual image generation with semantic control.
problem Challenges in preserving identity, maintaining quality, and ensuring causal model faithfulness in counterfactual image generation.
method Integrates semantic representations into diffusion models through Pearlian causality, introducing spatial, semantic, and dynamic abduction.
result Demonstrates high-level semantic identity preservation and principled trade-offs between faithful causal control and identity preservation.
New approach uses SPG for semantic communication without a known channel model.
problem Designing efficient semantic communication systems without a known channel model.
method Applying Stochastic Policy Gradient (SPG) for reinforcement learning.
result Achieves comparable performance to model-aware approaches with a decreased convergence rate.