arXiv research

Proposes SROF for row-wise fusion in federated learning for multivariate responses.

New method estimates heterogeneous treatment effects with improved guarantees.

Paper proposes Sinkformers for Transformers with doubly stochastic attention.

Sensor fusion has wide applications in many domains including health care and autonomous systems. While the advent of deep learning has enabled promising multi-modal fusion of high-level features and end-to-end sensor fusion solutions, existing deep learning based sensor fusion techniques including deep gating architec…

Proposes Fusion Recurrent Neural Network for sequence data.

Meta Fusion integrates various multimodal data fusion strategies into a unified framework.

We propose a generalized class of multimodal fusion operators for the task of visual question answering (VQA). We identify generalizations of existing multimodal fusion operators based on the Hadamard product, and show that specific non-trivial instantiations of this generalized fusion operator exhibit superior perform…

New insights into knot fusion numbers via cabling.

Developed a Particle-Gibbs sampler for Bayesian feature allocation models.

We introduce semisimple 2-categories, fusion 2-categories, and spherical fusion 2-categories. For each spherical fusion 2-category, we construct a state-sum invariant of oriented singular piecewise-linear 4-manifolds.

A new memory-based fusion layer improves multi-modal deep learning performance.

Algorithms that fuse multiple input sources benefit from both complementary and shared information. Shared information may provide robustness against faulty or noisy inputs, which is indispensable for safety-critical applications like self-driving cars. We investigate learning fusion algorithms that are robust against …

This paper improves model fusion by training-time neuron alignment, reducing barriers in multi-model fusion.

We classify all fusion categories for a given set of fusion rules with three simple object types. If a conjecture of Ostrik is true, our classification completes the classification of fusion categories with three simple object types. To facilitate the discussion we describe a convenient, concrete and useful variation o…

Novel fusion network combines polarization and radiomics features for liver cancer classification.

Study fusion methods for financial image views to improve robustness against attacks.

New proof and formula linking fusion trees to quantum knot invariants.

Paper proposes a new method for Bayesian linear regression using spike-and-slab priors.

Study Coxeter groups over fusion rings and their geometric realisations.

A lot of attention has been devoted to multimedia indexing over the past few years. In the literature, we often consider two kinds of fusion schemes: The early fusion and the late fusion. In this paper we focus on late classifier fusion, where one combines the scores of each modality at the decision level. To tackle th…

Gradient descent constructs tight fusion frames.

Constructs a fusion product on spinor bundle over loop space.

Bayesian fusion improves radar target recognition for UAVs.

Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the interactions within each modality (intra-modal interactions) but more importantly the in…

Fusion of transformer networks using optimal transport for improved performance.

The paper analyzes how shared priors affect Bayesian data fusion performance.

Partial fusion combines neural networks to balance accuracy and efficiency.

This paper reviews deep learning for multi-modality medical image segmentation.

We present a baseline approach for cross-modal knowledge fusion. Different basic fusion methods are evaluated on existing embedding approaches to show the potential of joining knowledge about certain concepts across modalities in a fused concept representation.

New 4-manifold invariant defined from trisection diagrams.

Spinor bundle constructed on loop space for string manifolds.

MNIST-NET10 fusion improves MNIST classification to 0.1% error rate.

This paper develops a mathematical and computational framework for analyzing the expected performance of Bayesian data fusion, or joint statistical inference, within a sensor network. We use variational techniques to obtain the posterior expectation as the optimal fusion rule under a deterministic constraint and a quad…

EmbraceNet fusion model for multi-sensor activity recognition.

Bayesian model fuses multiple classifiers with explicit correlation modeling.

New method learns fusion rules from few images using granular ball priors.

In a previous paper, we introduced special types of fusions, so called simple-ribbon fusions on links. A knot obtained from the trivial knot by a finite sequence of simple-ribbon fusions is called a simple-ribbon knot. Every ribbon knot with <10 crossings is a simple-ribbon knot. In this paper, we give a formula for th…

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal representation with respect to the unimodal representations. In this paper, we prop…

In this paper, we propose to employ a bank of modality-dedicated Convolutional Neural Networks (CNNs), fuse, train, and optimize them together for person classification tasks. A modality-dedicated CNN is used for each modality to extract modality-specific features. We demonstrate that, rather than spatial fusion at the…

A new Fusion method combines multiple distributions efficiently.

Adaptive data fusion boosts efficiency in multi-task optimization.

Explains fusion for Yang-Baxter equation and braid group.

Fusion framework improves time series classification across different datasets.

We consider the space of odd spinors on the circle, and a decomposition into spinors supported on either the top or on the bottom half of the circle. If an operator preserves this decomposition, and acts on the bottom half in the same way as a second operator acts on the top half, then the fusion of both operators is a…

Solutions of tt*-equation from SU(2)_k fusion algebra.

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary information from different sensors, we show that target detection and classificatio…

In the past few years, a lot of attention has been devoted to multimedia indexing by fusing multimodal informations. Two kinds of fusion schemes are generally considered: The early fusion and the late fusion. We focus on late classifier fusion, where one combines the scores of each modality at the decision level. To ta…

LMGPs enable efficient, accurate data fusion across multiple data sources.