Learn to automatically plug domain-specific modules into a common network.
problem Learning inflexibility and computational intensiveness in multi-domain learning.
method Neural Architecture Search (NAS) for data-driven adapter plugging and structure design.
result NAS-driven MDL model achieves comparable performance to existing approaches.
NACs learn modular neural architectures without domain knowledge.
problem Jointly learn module configuration and execution without domain knowledge.
method Jointly trains two systems: module configuration and execution.
result Improves low-shot adaptation and OOD robustness.
System automates identification of cancer drug repurposing from PubMed.
problem Manual extraction of cancer drug repurposing evidence from scientific publications is infeasible.
method NLP pipeline including querying, filtering, entity extraction, classification, and study type classification.
result Automated system extracts cancer drug repurposing evidence from PubMed abstracts.
We address the problem of tuning word embeddings for specific use cases and domains. We propose a new method that automatically combines multiple domain-specific embeddings, selected from a wide range of pre-trained domain-specific embeddings, to improve their combined expressive power. Our approach relies on two key c…
There is a growing interest in learning data representations that work well for many different types of problems and data. In this paper, we look in particular at the task of learning a single visual representation that can be successfully utilized in the analysis of very different types of images, from dog breeds to s…
CosML combines domain-specific meta-learners for cross-domain few-shot classification.
problem Generalizing to unseen domains while meta-learning on multiple seen domains.
method CosML trains domain-specific meta-learners and combines their meta-parameters in the parameter space.
result CosML outperforms state-of-the-art methods and achieves strong cross-domain generalization.
Study introduces KorFinMTEB for Korean financial texts, revealing model limitations.
problem Limited evaluation benchmarks for low-resource domains, especially Korean.
method Developed KorFinMTEB, a tailored benchmark for Korean financial texts.
result Models perform better on translated benchmarks than on domain-specific ones.
This paper explores different graph neural network functions to improve graph isomorphism.
problem Lack of robust implementation for graph neural networks due to limited analysis of underlying functions.
method Examines various alternative functions for different modules in GNNs using benchmark datasets.
result Generally used underlying techniques do not always capture the overall graph structure.
Method constructs finance LLMs without instruction data using pretraining and model merging.
problem Developing domain-specific LLMs for finance is resource-intensive.
method Continual pretraining on financial data + model merging of instruction-tuned and domain-specific pretrained vectors.
result Successfully constructs instruction-tuned LLMs for finance without additional instruction data.
The paper improves classification accuracy by leveraging a shared signal across domains in high-dimensional classification.
problem Improving classification accuracy in high-dimensional data with shared signals across domains.
method Transfer learning for linear discriminant analysis, decomposing mean differences into common and domain-specific components.
result Deterministic limits for transfer performance, leading to optimal weights and corrections for bias.
Non-parallel multi-domain voice conversion (VC) is a technique for learning mappings among multiple domains without relying on parallel data. This is important but challenging owing to the requirement of learning multiple mappings and the non-availability of explicit supervision. Recently, StarGAN-VC has garnered atten…
We propose a method to infer domain-specific models such as classifiers for unseen domains, from which no data are given in the training phase, without domain semantic descriptors. When training and test distributions are different, standard supervised learning methods perform poorly. Zero-shot domain adaptation attemp…
CSD learns a common component for domain generalization, outperforming existing methods.
problem Training models to generalize across unseen domains.
method CSD decomposes the model into a common and specific component, discarding the latter.
result CSD outperforms state-of-the-art domain generalization methods.
EQD model improves domain-specific QA by 0.6% to 10.5%.
problem Challenges in domain-specific quantitative reasoning for LLMs.
method Two-step fine-tuning framework guided by a reward function.
result EQD outperforms state-of-the-art models and prompting strategies.
DAF uses attention sharing to adapt forecasts from abundant to scarce data.
problem Limited data for time series forecasting.
method Attention-based shared module and domain discriminator for domain adaptation.
result DAF outperforms state-of-the-art methods on various domains.
Interventional domain adaptation improves feature transferability by removing spurious correlations.
problem Improper feature transferability due to spurious correlations in domain adaptation.
method Intervention strategy using unlabeled target data to generate counterfactual features and train discriminability invariance.
result Consistent performance improvements over state-of-the-art approaches in various domain adaptation tasks.
LLMs translate natural language trading intents into correct option strategies using a domain-specific language.
problem Challenges in translating natural language trading intents into correct option strategies due to the complexity of option chain data.
method Introduce Option Query Language (OQL) as a domain-specific intermediate representation to abstract option markets into high-level primitives under grammatical rules. Use LLMs as semantic parsers and validate queries by an engine.
result Significantly improves execution accuracy and logical consistency over direct baselines.
The paper tackles learning domain-specific bias by learning many tasks from the same domain.
problem Learning appropriate domain-specific bias in machine learning models.
method Learning many related tasks from the same domain, with a theorem bounding the number of tasks needed.
result The number of examples required per task for good generalization scales like \(O(a + \frac{b}{n})\), where \(O(a)\) is the minimum number of examples per task and \(O(a + b)\) is the number of examples per task independently.
Study reveals XAI methods fail in neuroimaging, suggesting domain-specific adaptation.
problem Systematic failures of XAI methods in neuroimaging applications.
method Systematic comparison of XAI methods on 45,000 structural brain MRIs using a novel validation framework.
result Two widely used XAI methods (GradCAM and Layer-wise Relevance Propagation) fail to accurately explain neuroimaging data.
This paper introduces Sigma, a domain-specific computational representation for collaboration in large-scale for the field of economics. A computational representation is not a programming language or a software platform. A computational representation is a domain-specific representation system based on three specific …
Recent advancements in radio frequency machine learning (RFML) have demonstrated the use of raw in-phase and quadrature (IQ) samples for multiple spectrum sensing tasks. Yet, deep learning techniques have been shown, in other applications, to be vulnerable to adversarial machine learning (ML) techniques, which seek to …
Proposes a new method to improve target annotation in ATR.
problem Challenges in annotating automatic target recognition due to lack of labeled data.
method Hybrid contrastive learning and cycle-consistency-based transductive transfer learning (C3TTL) framework.
result Significantly lower Fréchet Inception Distance (FID) score and improved performance in annotating civilian and military vehicles, as well as ship targets.
DACL tackles domain-specific contrastive learning by using Mixup noise.
problem Domain-specific contrastive learning methods rely on data augmentation techniques that require domain knowledge.
method DACL uses Mixup noise to create similar and dissimilar examples without domain-specific data augmentation.
result DACL outperforms other domain-agnostic noising methods and combines well with domain-specific methods.
We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks while allowing them to share all other model parameters, which is realized by a tw…
EMFs combine deep learning and probabilistic models for better density estimation.
problem Combining domain-specific knowledge with general-purpose deep learning.
method Alternating transformations with structured layers that embed domain-specific inductive biases.
result EMFs induce desirable properties like multimodality and hierarchical coupling.
Protocol for constructing tailored evaluation datasets for semantic models.
problem Evaluation of domain-specific semantic models, focusing on top ranks.
method Adaptive pairwise comparisons, relatedness-based evaluation dataset, metrics, stochastic transitivity model.
result Effectiveness of the proposed dataset construction protocol confirmed.
In this paper, we consider domain-invariant deep learning by explicitly modeling domain shifts with only a small amount of domain-specific parameters in a Convolutional Neural Network (CNN). By exploiting the observation that a convolutional filter can be well approximated as a linear combination of a small set of dict…
Survey of methods to train deep architectures without E2EBP.
problem Training deep architectures without end-to-end backpropagation.
method Modular training, weakly modular hybrids.
result Provably optimal alternatives to E2EBP can match or surpass E2EBP performance.
Hybrid approach combines topic and graph embeddings for legal document clustering.
problem Challenges in classifying legal texts due to domain-specific language and limited labeled data.
method Combines unsupervised topic and graph embeddings with a supervised model.
result Improves clustering quality over text-only or graph-only embeddings.
New method transfers word embeddings from large to small datasets efficiently.
problem Challenges in learning word embeddings from new domains with limited data.
method Group-sparse matrix factorization for transfer learning.
result Efficiently learns domain-specific word embeddings with less data.
AutoStan improves Bayesian models via predictive feedback.
problem Improving Bayesian models written in Stan.
method Iterative improvement of Stan models using NLPD and sampler diagnostics feedback.
result AutoStan can autonomously improve diverse Bayesian models across various structures.
Method learns domain-specific representations without supervision.
problem Domain generalization without labeled data.
method Hierarchical variational autoencoder approach.
result Model generalizes to unseen domains without domain supervision.
Paper proposes a unified time series forecasting model with adaptive transfer.
problem General forecasting models for diverse time series data.
method Unified representations through Decomposed Frequency Learning and adaptive domain-specific features via Time Series Register.
result State-of-the-art forecasting performance on seven real-world benchmarks.
Sequential data often originates from diverse domains across which statistical regularities and domain specifics exist. To specifically learn cross-domain sequence representations, we introduce disentangled state space models (DSSM) -- a class of SSM in which domain-invariant state dynamics is explicitly disentangled f…
GenSBI offers JAX-native SBI methods for natural sciences.
problem Lack of native SBI libraries in JAX for natural sciences.
method Flow and diffusion generative models in JAX.
result Near-ideal mean C2ST scores on SBIBM tasks.
A new model for imputing missing values in time series data across domains.
problem Imputing missing values in time series data across domains with domain shifts and high missing rates.
method A diffusion-based imputation model that integrates shared spectral components and domain-specific temporal structures, with cross-domain consistency alignment.
result Our model effectively handles missing values and domain shifts, outperforming existing methods.
Unified model learns concepts across domains like left and right.
problem Limited generalization of language concepts in inference-only models.
method Logic-Enhanced Foundation Model (LEFT) with a differentiable, domain-independent program executor.
result LEFT flexibly learns and reasons with concepts across 2D images, 3D scenes, human motions, and robotic manipulation.
Ontology learning is a critical task in industry, dealing with identifying and extracting concepts captured in text data such that these concepts can be used in different tasks, e.g. information retrieval. Ontology learning is non-trivial due to several reasons with limited amount of prior research work that automatica…
Classifies modules of surface-knots in terms of their properties.
problem Characterizing modules of surface-knots in terms of their properties.
method Using homology and covering spaces, the reduced first module is characterized.
result The reduced first module for every genus g is characterized in terms of properties of a finitely generated module.
By introducing several improvements to the AlphaZero process and architecture, we greatly accelerate self-play learning in Go, achieving a 50x reduction in computation over comparable methods. Like AlphaZero and replications such as ELF OpenGo and Leela Zero, our bot KataGo only learns from neural-net-guided Monte Carl…
TINs use neural networks to interpret technical indicators for trading.
problem Lack of interpretable neural architectures for technical indicators in trading.
method Introduced TINs, a neural architecture that reformulates technical indicators into trainable modules.
result Improved risk-adjusted performance compared to traditional indicator-based strategies.
Proves finiteness and holonomicity of skein modules for 3-manifolds.
problem Finiteness and holonomicity of skein modules for 3-manifolds.
method Defining skein transfer bimodules and using q-analogues of D-module theory.
result Internal skein modules are holonomic modules over the internal skein algebra of the boundary.
Defines super projective modules and explores their properties.
problem Exploring the geometric-algebraic link in super geometry.
method Defined and explored super projective modules over supersmooth functions.
result Module of vector fields over a supersphere is a super projective module.
A new method to derive presentations of skein modules is developed. For the case of homotopy skein modules it will be shown how the topology of a 3-manifold is reflected in the structure of the module. The freeness problem for q-homotopy skein modules is solved, and a natural skein module related to linking numbers is …
We introduce higher skein modules of links generalizing the Conway skein module. We show that these modules are closely connected to the HOMFLY polynomial.
Neural Module Networks, originally proposed for the task of visual question answering, are a class of neural network architectures that involve human-specified neural modules, each designed for a specific form of reasoning. In current formulations of such networks only the parameters of the neural modules and/or the or…
Paper compares skein modules to Kauffman bracket modules.
problem Comparing skein modules to Kauffman bracket modules.
method Using skein relations and Reshetikhin-Turaev model.
result Resolved the problem of comparing skein modules to Kauffman bracket modules.
Skein modules are the main objects of an algebraic topology based on knots (or position). In the same spirit as Leibniz we would call our approach "algebra situs." When looking at the panorama of skein modules we see, past the rolling hills of homologies and homotopies, distant mountains - the Kauffman bracket skein mo…