Enhances hand gesture recognition with separate networks and shared features.
problem Improving recognition accuracy of unimodal 3D-CNNs for dynamic hand gestures.
method Separate networks for each modality, collaborative learning, spatiotemporal semantic alignment loss, focal regularization.
result Improves test time recognition accuracy and state-of-the-art performance.
New framework aligns latent representations over-the-air using intelligent metasurfaces.
problem Heterogeneous transmitter-receiver models produce misaligned latent representations in semantic communication.
method Intelligent metasurfaces (SIM) emulate supervised and zero-shot semantic aligners directly in the wave domain.
result SIMs achieve up to 90% task accuracy in high SNR regimes, robust to low SNR.
Proposes AMS-SFE to improve zero-shot learning by aligning semantic feature spaces.
problem Domain shift problem in zero-shot learning due to disjoint seen and unseen data.
method Expands semantic features using an autoencoder and aligns them with visual feature manifold.
result Remarkable performance improvement over existing methods.
Method aligns multilingual news for better stock return prediction.
problem Losing nuances in multilingual news translations.
method Optimal transport for sentence alignment.
result Aligned sentences correlate better with stock returns.
HSACC improves multi-view clustering of incomplete data.
problem Challenges in clustering incomplete multi-view data.
method Hierarchical Semantic Alignment and Cooperative Completion framework.
result HSACC outperforms state-of-the-art methods on benchmark datasets.
Paper develops a new unsupervised scoring function for cross-lingual document alignment.
problem Aligning documents across different languages for NLP tasks.
method Uses cross-lingual sentence embeddings to compute semantic distances and guides document alignment.
result The proposed scoring function outperforms current methods by 7-22% on various language pairs.
LPL optimizes embeddings to align local neighborhoods, improving cross-lingual word alignment.
problem Aligning embeddings across different datasets and languages.
method Locality Preserving Loss (LPL) optimizes model to project embeddings while maintaining local neighborhoods and aligning them.
result LPL-based alignment leads to better and consistent accuracy, especially in small training set settings.
Jointly optimizes domain alignment and classifier learning for unsupervised domain adaptation.
problem Transfer classifier from source to target domain without labeled data.
method Jointly optimizes semantic domain alignment and target classifier learning.
result Joint optimization yields best performance compared to state-of-the-art methods.
SFAVEL distills features from language models for fact verification without annotations.
problem Fact verification with semantically meaningful and compact features.
method Self-supervised pretraining using contrastive loss with language models.
result Achieved state-of-the-art results on FB15k-237 and FEVER.
ADS explains object differences by quantifying and removing underlying properties.
problem Explaining differences between two object images.
method Align-Deform-Subtract (ADS) framework that uses semantic alignments and iterative quantification/removal of differences.
result ADS provides disentangled error measures explaining object differences in terms of underlying properties.
Interpretable semantic textual similarity (iSTS) task adds a crucial explanatory layer to pairwise sentence similarity. We address various components of this task: chunk level semantic alignment along with assignment of similarity type and score for aligned chunks with a novel system presented in this paper. We propose…
HawkesLLM models text generation with temporal influence, improving semantic alignment under limited memory.
problem Path-dependent uncertainty in agentic text-simulation systems.
method HawkesLLM framework separates temporal influence modeling from text generation, using a multivariate Hawkes process and a language model.
result HawkesLLM improves late-stage semantic alignment under a compact prompt-memory budget.
STRAPSim measures ETF portfolio similarity better than existing methods.
problem Measuring portfolio similarity for ETFs and portfolios.
method Semantic, two-level, residual-aware portfolio similarity computation.
result STRAPSim outperforms existing methods in predictive accuracy and ranking alignment.
Framework quantifies financial NLP robustness under regime shifts.
problem Semantic and causal drift in financial news narratives.
method Four metrics: FCAS, PCS, TSV, NLICS.
result Transformer models are more affected by semantic drift.
Enhances thematic investing with stock embeddings from textual data.
problem Challenges in constructing thematic portfolios due to overlapping sector boundaries and evolving market dynamics.
method Introduces THEME, a framework that fine-tunes embeddings using hierarchical contrastive learning, aligning themes and stocks using their hierarchical relationship and incorporating stock returns.
result Theme-aligned portfolios demonstrate compelling performance, significantly outperforming large language models in thematic asset retrieval.
SEMASIA provides a large dataset of latent representations for model comparison.
problem Difficulty in comparing semantic structures across different neural network models.
method Collection of latent representations from 1700 pretrained models across various benchmarks.
result Consistent semantic organization across models and datasets.
In this paper we study image captioning as a conditional GAN training, proposing both a context-aware LSTM captioner and co-attentive discriminator, which enforces semantic alignment between images and captions. We empirically focus on the viability of two training methods: Self-critical Sequence Training (SCST) and Gu…
We address the problem of image translation between domains or modalities for which no direct paired data is available (i.e. zero-pair translation). We propose mix and match networks, based on multiple encoders and decoders aligned in such a way that other encoder-decoder pairs can be composed at test time to perform u…
New diffusion models improve counterfactual image generation with semantic control.
problem Challenges in preserving identity, maintaining quality, and ensuring causal model faithfulness in counterfactual image generation.
method Integrates semantic representations into diffusion models through Pearlian causality, introducing spatial, semantic, and dynamic abduction.
result Demonstrates high-level semantic identity preservation and principled trade-offs between faithful causal control and identity preservation.
RESTA defends LLMs against jailbreaking attacks by adding random noise to embeddings.
problem Vulnerability of LLMs to jailbreaking attacks that generate harmful outputs.
method Adds random noise to embedding vectors and aggregates during token generation.
result RESTA achieves superior robustness versus utility tradeoffs compared to baseline defenses.
Proposes COALA method for learning audio representations aligned with tags.
problem Lack of annotated data for high-performance audio representation learning.
method Aligns latent representations of audio and tags using a contrastive loss.
result Audio embedding model captures both acoustic and semantic characteristics.
iREPA shows spatial structure, not global semantic, drives generation performance in REPA.
problem Understanding what aspect of the target representation matters for generation.
method Empirical analysis of 27 vision encoders, two modifications to REPA.
result Spatial structure, not global semantic, drives generation performance.
CauSTream forecasts streamflow by integrating causal graphs for better interpretability.
problem Streamflow forecasting lacks interpretability and generalization due to fixed causal models.
method CauSTream learns causal graphs for meteorological forcings and routing dependencies.
result CauSTream outperforms existing methods, especially at longer forecast windows.
Merlin improves robustness of MTSF models to missing data.
problem Suboptimal forecasting performance due to unfixed missing rates in MTSF models.
method Offline knowledge distillation and multi-view contrastive learning.
result Merlin enhances robustness of MTSF models while preserving accuracy.
Proposes a method to cluster tasks for constructive cooperative multi-tasking.
problem Destructive cooperation in cooperative multi-tasking.
method Semantic clustering followed by end-to-end joint training within clusters.
result Effective mitigation of destructive cooperation and negative transfer.
Introduces PCG for better counterfactual explanations in vision models.
problem Ambiguity in latent-space optimization methods for counterfactual explanations.
method Constructs counterfactuals by tracing geodesics under a perceptually Riemannian metric.
result PCG outperforms baselines and reveals hidden failure modes.
Word evolution refers to the changing meanings and associations of words throughout time, as a byproduct of human language evolution. By studying word evolution, we can infer social trends and language constructs over different periods of human history. However, traditional techniques such as word representation learni…
Proposes a method for weakly-supervised object localization to improve few-shot learning.
problem Challenges of few-shot learning, especially with fine-grained categories.
method Introduces a Self-Attention Based Complementary Module (SAC Module) for weakly-supervised object localization.
result Significantly outperforms state-of-the-art methods on benchmark datasets, especially for fine-grained few-shot tasks.
Recent progress on automatic generation of image captions has shown that it is possible to describe the most salient information conveyed by images with accurate and meaningful sentences. In this paper, we propose an image caption system that exploits the parallel structures between images and sentences. In our model, …
Paper uses CNN to create realistic LiDAR data.
problem Creating high-resolution LiDAR data with missing points.
method Modified per-point loss and perceptual loss applied to generate realistic LiDAR data.
result Significant improvement in geometric and semantic accuracy over traditional methods.
OTSeg uses multi-prompt Sinkhorn attention to improve zero-shot semantic segmentation.
problem Leveraging pre-trained CLIP knowledge to align text embeddings with pixel embeddings.
method OTSeg employs Multi-Prompts Sinkhorn (MPS) and Multi-Prompts Sinkhorn Attention (MPSA) to enhance semantic feature matching.
result OTSeg achieves state-of-the-art performance in zero-shot semantic segmentation tasks.
ClusTR improves clustering-based models' robustness without adversarial training.
problem Improving clustering-based models' robustness.
method Proposes ClusTR, a clustering-based training framework for robust models without adversarial training.
result ClusTR outperforms adversarially-trained models by up to 4% under strong PGD attacks.
New method neutralizes gender bias in word embeddings without losing semantic information.
problem Gender biases in word embeddings trained on human-generated corpora.
method Latent Disentanglement and Counterfactual Generation with siamese auto-encoder and gradient reversal layer.
result Our method outperforms existing debiasing methods in preserving semantic information and neutralizing gender biases.
Trade-R1 bridges verifiable rewards to stochastic financial markets via process-level reasoning verification.
problem Extending RL to financial markets where rewards are verifiable but noisy.
method A verification method that transforms reasoning over financial documents into a structured RAG task, using a triangular consistency metric.
result DSR achieves superior cross-market generalization while maintaining reasoning consistency.
Enhances stock return prediction using LLMs and hybrid models.
problem Insufficient use of semantic information and alignment of LLMs with stock features.
method LG model with three strategies for global information modeling and SCRL for embedding alignment.
result Superior performance in Rank Information Coefficient and returns compared to models relying only on stock features.
Algorithm adapts pretrained semantic segmentation models to new domains.
problem Adapting pretrained models to new, unlabeled domains without source data.
method Learn prototypical distribution in embedding space, align target domain with source domain.
result Method achieves competitive performance on benchmark tasks.
This paper reviews spatial and spatiotemporal volatility models.
problem Capturing spatial dependence in volatility of spatial and spatiotemporal data.
method Review of time series volatility models and their extensions.
result Comparison and practical recommendations for spatial and spatiotemporal volatility models.
Novel CNN-based gaze scanpath comparison distinguishes experts from novices in dental radiograph interpretation.
problem Distinguishing expertise in dental radiograph interpretation based on gaze behavior.
method Convolutional neural networks (CNN) process scene information at the fixation level, using image patches as input to compare gaze scanpaths.
result 93% accuracy in distinguishing experts from novices using image patch features.
TRAKNN detects rare atmospheric trajectories efficiently.
problem Detecting rare atmospheric anomalies over long periods.
method Unsupervised, recurrence-based kNN algorithm.
result Rare trajectories correspond to physical anomalies.
SWD improves unsupervised domain adaptation by measuring classifier outputs.
problem Improving unsupervised domain adaptation between domains.
method Proposes sliced Wasserstein discrepancy (SWD) for feature distribution alignment.
result SWD effectively aligns source and target distributions for various tasks.
Geometric method captures rare topics and temporal alignment in co-author networks.
problem Missing rare topics and smooth temporal alignment in topic modeling.
method Integrates multimodal text and co-author network data using Hellinger distances and Ward's linkage.
result Effective identification of rare topics and visualization of topic drift over time.
POLAR framework interprets word embeddings using polar opposites.
problem Lack of interpretability in pre-trained word embeddings.
method Adopt semantic differentials and polar opposites to transform embeddings.
result Interpretable word embeddings maintain performance comparable to original embeddings.
A new semi-supervised learning method using label gradients.
problem Improve accuracy in semi-supervised learning with limited labeled data.
method Impute labels for unlabeled data using a distance metric based on model gradients, then optimize these imputed labels.
result Demonstrates state-of-the-art accuracy in semi-supervised CIFAR-10 classification.
Bayesian Complementary Kernelized Learning models complex spatiotemporal data.
problem Modeling complex, nonstationary, and nonseparable spatiotemporal data.
method Integrates kernelized low-rank tensor factorization and short-range spatiotemporal Gaussian Processes.
result BCKL offers superior performance in providing accurate posterior mean and high-quality uncertainty estimates.
Dynamic model captures spatial, temporal, and spatiotemporal volatility effects.
problem Analyzing volatility in spatial and temporal networks.
method Dynamic spatiotemporal and network ARCH model with common factors, Bayesian estimation.
result Model captures strong spatial/network interactions and spillover effects.
Package {mlr3spatiotempcv} simplifies spatiotemporal resampling methods in R.
problem Assessing and tuning spatial and spatiotemporal machine learning models.
method Integrates various spatiotemporal resampling methods into the {mlr3} framework.
result Provides a consistent interface for spatiotemporal resampling methods.
A vast majority of computation in the brain is performed by spiking neural networks. Despite the ubiquity of such spiking, we currently lack an understanding of how biological spiking neural circuits learn and compute in-vivo, as well as how we can instantiate such capabilities in artificial spiking circuits in-silico.…
ZegOT uses optimal transport to zero-shot segment images with text prompts.
problem Zero-shot semantic segmentation with limited image-text alignment knowledge.
method ZegOT uses optimal transport to match multiple text prompts with frozen image embeddings.
result ZegOT achieves state-of-the-art performance in zero-shot semantic segmentation.