arXiv research

Paper presents a novel approach for global feature aggregation in Graph Neural Networks.

FedBE aggregates local models into a robust global model via Bayesian inference.

Improved local explainer aggregation for interpretable machine learning models.

BAFFLE uses blockchain to federate learning without a central aggregator.

NormLIME improves feature importance explanations for deep neural networks.

Paper tightens statistical aggregation results using local complexity.

Optimal transport aggregation combines distributed MoE models efficiently.

Quantum computing improves graph neural network aggregation.

Dynamic defense against Byzantine poisoning in federated learning.

Aggregates models from different datasets using shared latent structures.

New method for decentralized learning from diverse clients.

LightSecAgg reduces secure aggregation complexity in FL.

Federated learning is protected against adversarial attacks with residual-based reweighting.

Global pooling, such as max- or sum-pooling, is one of the key ingredients in deep neural networks used for processing images, texts, graphs and other types of structured data. Based on the recent DeepSets architecture proposed by Zaheer et al. (NIPS 2017), we introduce a Set Aggregation Network (SAN) as an alternative…

In many applications, the training data for a machine learning task is partitioned across multiple nodes, and aggregating this data may be infeasible due to communication, privacy, or storage constraints. Existing distributed optimization methods for learning global models in these settings typically aggregate local up…

In this work, we introduce the Global Planar Convolution module as a building-block for fully-convolutional networks that aggregates global information and, therefore, enhances the context perception capabilities of segmentation networks in the context of brain tumor segmentation. We implement two baseline architecture…

One-round FL method improves robustness and reduces communication rounds.

Study uses echo-sounder buoys to analyze tuna schools' association with dFADs globally.

Current approaches for explaining machine learning models fall into two distinct classes: antecedent event influence and value attribution. The former leverages training instances to describe how much influence a training point exerts on a test point, while the latter attempts to attribute value to the features most pe…

While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global mapping of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new in…

Graph convolutional networks (GCNs) have been successfully applied in node classification tasks of network mining. However, most of these models based on neighborhood aggregation are usually shallow and lack the "graph pooling" mechanism, which prevents the model from obtaining adequate global information. In order to …

Study shows safely discarding features based on aggregate SHAP values is sound.

A new federated learning method clusters users into multiple models for better data distribution handling.

Secure federated learning framework resists adversarial users.

A note on learning with agents having global perspectives and a principal optimizing their performance.

We present one-shot federated learning, where a central server learns a global model over a network of federated devices in a single round of communication. Our approach - drawing on ensemble learning and knowledge aggregation - achieves an average relative gain of 51.5% in AUC over local baselines and comes within 90.…

Improves global counterfactual explanations for model recourse.

Study uses RL to optimize global equity portfolios, finds mixed results.

We propose a decentralized learning algorithm over a general social network. The algorithm leaves the training data distributed on the mobile devices while utilizing a peer to peer model aggregation method. The proposed algorithm allows agents with local data to learn a shared model explaining the global training data …

We investigate the community structure of the global ownership network of transnational corporations. We find a pronounced organization in communities that cannot be explained by randomness. Despite the global character of this network, communities reflect first of all the geographical location of firms, while the indu…

Rank aggregation systems collect ordinal preferences from individuals to produce a global ranking that represents the social preference. Rank-breaking is a common practice to reduce the computational complexity of learning the global ranking. The individual preferences are broken into pairwise comparisons and applied t…

FedCONST adapts update magnitudes to enhance feature generalization in FL.

As a non-parametric Bayesian model which produces informative predictive distribution, Gaussian process (GP) has been widely used in various fields, like regression, classification and optimization. The cubic complexity of standard GP however leads to poor scalability, which poses challenges in the era of big data. Hen…

Local adaptive methods in FL can accelerate convergence but introduce bias, which is corrected.

A framework for federated adversarial learning with convergence analysis.

In this paper we present a hybrid active sampling strategy for pairwise preference aggregation, which aims at recovering the underlying rating of the test candidates from sparse and noisy pairwise labelling. Our method employs Bayesian optimization framework and Bradley-Terry model to construct the utility function, th…

We consider the problem of analyzing the heterogeneity of clustering distributions for multiple groups of observed data, each of which is indexed by a covariate value, and inferring global clusters arising from observations aggregated over the covariate domain. We propose a novel Bayesian nonparametric method reposing …

The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine learning becomes increasingly attractive for performing training and inference directl…

Deep learning models have shown state-of-the-art performance in many inverse reconstruction problems. However, it is not well understood what properties of the latent representation may improve the generalization ability of the network. Furthermore, limited models have been presented for inverse reconstructions over ti…

New method aggregates Gaussian experts by detecting conditional independence violations.

Financial models are studied where each asset may potentially lose value relative to any other. Conditioning on non-devaluation, each asset can serve as proper numéraire and classical valuation rules can be formulated. It is shown when and how these local valuation rules can be aggregated to obtain global arbitrage-fre…

AAggFF improves federated learning fairness through sequential decision making.

We analyze a fast incremental aggregated gradient method for optimizing nonconvex problems of the form $\min_x \sum_i f_i(x)$. Specifically, we analyze the SAGA algorithm within an Incremental First-order Oracle framework, and show that it converges to a stationary point provably faster than both gradient descent and s…

A new method combines Gaussian graphical models for better distributed Gaussian process predictions.

New method ranks sectors and countries using local and aggregate I-O data.

A federated model learns shared archetypes from heterogeneous clients in continual learning.

Study finds conditions for global minimizers on curved manifolds with fast diffusion and nonlocal interactions.

Federated learning promises to make machine learning feasible on distributed, private datasets by implementing gradient descent using secure aggregation methods. The idea is to compute a global weight update without revealing the contributions of individual users. Current practical protocols for secure aggregation work…