FedProx tackles heterogeneity in federated learning networks.
problem Significant variability in systems characteristics and non-identically distributed data in federated networks.
method FedProx is a framework that generalizes and re-parametrizes FedAvg, introducing modifications to handle both systems and statistical heterogeneity.
result FedProx demonstrates significantly more stable and accurate convergence behavior than FedAvg, improving test accuracy by 22% on average in highly heterogeneous settings.
Introduces a new system for modeling bank solvency contagion with heterogeneous impacts and exposures.
problem Modeling bank solvency contagion with asymmetric interactions and heterogeneous exposures.
method Develops a heterogeneous McKean-Vlasov system to characterize solvency contagion in interbank markets.
result Derives a unique solution for the system under certain conditions, resolving instability issues.
The goal of this paper is to study organized flocking behavior and systemic risk in heterogeneous mean-field interacting diffusions. We illustrate in a number of case studies the effect of heterogeneity in the behavior of systemic risk in the system, i.e., the risk that several agents default simultaneously as a result…
Framework for joint inference of network topology and interaction types in heterogeneous systems.
problem Joint inference of network topology, multi-type interaction kernels, and latent type assignments in heterogeneous interacting particle systems.
method Three-stage approach: shared structure recovery, discrete interaction type identification, and matrix factorization.
result The method yields accurate reconstruction of underlying dynamics and is robust to noise.
A new 3D NoC design optimizes heterogeneous manycore systems for deep learning.
problem Designing energy-efficient 3D manycore platforms for deep learning.
method ML-based multi-objective optimization for heterogeneous requirements.
result 9.6% better Energy-Delay Product compared to thermally-optimized designs.
This thesis tackles data fusion issues across different biological scales and types.
problem Heterogeneity in data types and scales in systems biology.
method Developed statistical methods to fuse heterogeneous data sets.
result Advantages of proposed methods assessed through simulations and real data analysis.
Study interbank lending and borrowing dynamics with heterogeneous mean field model.
problem Modeling systemic risk in a network of banks with varying capitalization.
method Developed a mean field type model with coupled diffusions to describe log-capitalization evolution.
result Existence of Nash equilibria in large-scale heterogeneous interbank networks.
Paper explores how to use mixed types of side information for better recommendations.
problem Challenges in using heterogeneous side information for recommender systems.
method Proposes a framework to jointly capture flat and hierarchical side information.
result Demonstrates significant performance gains over state-of-the-art methods.
Economics tool predicts failure times in reliability systems.
problem Predicting optimal failure times in weighted k-out-of-n reliability systems with heterogeneous component failure.
method Using rational expectations to analyze and predict failure times in reliability systems with heterogeneous component failure.
result Different measures are optimal for predicting system failure depending on component failure distributions.
FLAME auto-labels mobile data efficiently on diverse processors.
problem Accurately and efficiently labeling mobile data with unknown labels on heterogeneous processors.
method Self-adaptive auto-labeling system Flame that schedules and executes workloads on mobile processors.
result Flame achieves high labeling accuracy and performance on heterogeneous mobile processors.
The paper analyzes systemic risk in an insurance model with multiple business lines and heterogeneous claims.
problem Analyzing systemic risk in a multi-dimensional insurance model with heterogeneous claims.
method A multi-dimensional Lévy process-based renewal risk model with pairwise asymptotic independence (PAI).
result Asymptotic formulas for tail probabilities and systemic risk measures are derived.
DeepHGNN detects program identity changes using system behaviors.
problem Detecting program identity changes to prevent malware.
method Attentional heterogeneous graph neural network (DeepHGNN) for graph classification.
result DeepHGNN effectively identifies program identities across various metrics.
Model shows how heterogeneity in strategies and risk tolerance affects financial market stability.
problem Understanding how heterogeneity impacts financial market dynamics.
method Agent-based model incorporating heterogeneous investment strategies and risk tolerance.
result Heterogeneity in strategies and risk tolerance suppresses price fluctuations.
Friend recommendation system using heterogeneous edge embeddings.
problem Inadequate performance of existing network embedding techniques on multi-graph social networks.
method Proposes a method to mine network representation exploiting heterogeneity in multi-graphs.
result Outperforms state-of-the-art baselines on Hike's social network in terms of accuracy and user satisfaction.
Study shows neural ODEs generalize well on synthetic graphs but struggle with degree heterogeneity and clustering.
problem Understanding neural ODEs on complex networks, especially with varying graph sizes and structures.
method Synthetic data from five dynamical systems on graphs, using Barabási-Barzel form vector fields.
result Degree heterogeneity and dynamical system type are primary factors affecting neural ODEs' generalization.
TiFL divides clients into tiers to improve federated learning performance.
problem Heterogeneity in resource and data quality impacts FL performance.
method TiFL divides clients into tiers based on training performance and selects clients from the same tier in each training round.
result TiFL achieves faster training performance with comparable or better test accuracy.
Survey of IoT recommendation systems and their limitations.
problem Traditional recommender systems fail to handle IoT data.
method Comprehensive review of IoT recommender systems and techniques.
result Proposes a reference framework for future research.
A new method measures heterogeneity without needing categorical partitioning or distance measurement.
problem Measuring heterogeneity in non-categorical data requires categorical partitioning and distance measurement, limiting applicability.
method Representational Rényi heterogeneity (RRH) transforms data into a latent space where heterogeneity can be measured without these requirements.
result RRH can generalize existing indices and better responds to changes in mixture component separation and weighting.
Study on identifying and inferring nonlinear dynamics on unknown networks.
problem Identifying network structure in nonlinear dynamic systems with unknown interactions.
method Showed network structure is not generically identified, requiring sufficient spectral heterogeneity. Developed necessary and sufficient conditions for identification and proposed a semiparametric estimator.
result Necessary and sufficient conditions for identification of network structure in nonlinear dynamic systems.
The paper studies how and when a treatment triggers different effects for individuals.
problem Estimating how treatment effects vary among individuals based on their characteristics.
method Tree-based learning method to find individual-level treatment triggers.
result The proposed method learns treatment triggers better than existing approaches.
KHGRec tackles noisy and incomplete KG-enhanced recommendations by modeling complex interactions.
problem Challenges in integrating KGs for accurate recommendations, especially in complex higher-order interactions and heterogeneous modalities.
method KHGRec uses a collaborative knowledge heterogeneous hypergraph (CKHG) to model group-wise interdependencies, employing two hypergraph encoders and attention mechanisms.
result KHGRec achieves an average 5.18% relative improvement over state-of-the-art baselines on four real-world datasets.
Paper develops efficient recursive learning for multi-channel systems with heterogeneous dynamics.
problem Accurately learning system dynamics in complex, multi-channel systems with nonlinear and noisy data.
method Formulates system as Gaussian process state-space models (GPSSMs), introduces heterogeneous multi-output kernel, and develops recursive inference framework.
result Matches SOTA offline GPSSMs in accuracy with 1/100 runtime, and outperforms SOTA online GPSSMs by 70% in accuracy under noise with 1/20 runtime.
New GNN method detects money laundering in diverse customer relationships.
problem Insufficient precision and efficiency of current AML systems.
method Heterogeneous Graph Neural Network (GNN) approach.
result Great potential for enhancing electronic surveillance systems for money laundering.
Two novel methods identify influential features in CMABs for better reward distribution.
problem Suboptimal features degrade rewards, interpretability, and efficiency in CMABs.
method Heterogeneous Incremental Effect (HIE) and Heterogeneous Distribution Divergence (HDD) methods.
result Consistent ability to identify influential HTE features, enhancing CMAB performance.
Paper uses machine learning to model travel mode switching under a new transit system.
problem Modeling individual travel mode preferences and response to new mobility options.
method Interpretable machine learning approach to predict and interpret mode-switching behavior.
result Machine learning captures individual heterogeneity in travel mode choice.
We consider a model of contagion in financial networks recently introduced in the literature, and we characterize the effect of a few features empirically observed in real networks on the stability of the system. Notably, we consider the effect of heterogeneous degree distributions, heterogeneous balance sheet size and…
A new tensor model captures complex structures in heterogeneous data.
problem Complex joint and discriminative structures in heterogeneous datasets.
method Double core tensor factorization with smoothing loss functions and linearized ADMM.
result The model accurately estimates factors even with missing entries.
Improves search performance by transferring knowledge from recommender system.
problem Cold start and feedback loop problems in search retrieval.
method Zero-Shot Heterogeneous Transfer Learning framework.
result Significant improvements in relevance and user interactions over production system.
Distributed learning adapts to diverse devices, improving performance.
problem Training neural networks on devices with varying capabilities and resources.
method Each device trains a customized neural network, sharing parameters with others.
result Achieves higher rewards on more powerful devices without sacrificing weaker ones.
The dynamics of many socioeconomic systems is determined by the decision making process of agents. The decision process depends on agent's characteristics, such as preferences, risk aversion, behavioral biases, etc.. In addition, in some systems the size of agents can be highly heterogeneous leading to very different i…
Improved time complexity for parallel stochastic optimization in heterogeneous systems.
problem Time complexity in parallel stochastic optimization for large-scale machine learning models.
method Proposes Rennala MVR, a variance-reduced extension of Rennala SGD based on momentum-based variance reduction.
result Variance reduction improves time complexity in relevant parameter regimes for parallel stochastic optimization in heterogeneous systems.
Energy distance measures feature heterogeneity in federated learning.
problem Heterogeneity across data sources hinders model aggregation in federated learning.
method Introduced Taylor approximations of energy distance for efficient computation.
result Taylor approximations accurately capture feature discrepancies, improving convergence.
Paper learns interaction laws from multiple trajectories of heterogeneous systems.
problem Estimating unknown interaction laws from multiple trajectories of heterogeneous systems.
method Nonparametric learning of interaction kernels based on pairwise distances, with convergence guarantees in L2 space. result Estimators converge at optimal min-max rate for 1-dimensional nonparametric regression.
This paper optimizes cybersecurity resource allocation in networks with heterogeneous attacker and defender valuations.
problem Optimizing cybersecurity resource allocation in networks with heterogeneous attacker and defender valuations.
method Combining strategic behavior of players with contagion dynamics, a method is extended to determine optimal resource allocation based on simple network metrics weighted by risk profiles.
result The asymmetry between attacker and defender valuations drives optimal attack and defense strategies, shaping system resilience.
SUOD accelerates OD for large, diverse models.
problem Training and scoring new samples with many unsupervised, heterogeneous OD models.
method Data reduction, model approximation, and taskload optimization.
result SUOD accelerates OD for over 20 benchmark datasets and a real-world case.
Robot learns from human demonstrations to work autonomously.
problem Leveraging human and robotic strengths in human-robot systems.
method Bayesian inference for detecting and classifying human heterogeneity.
result Bayesian approach outperforms conventional methods by up to 12.8. Ringmaster LMO accelerates training in distributed systems by asynchronously updating neural networks.
problem Asynchronous training in distributed systems where workers compute gradients at different speeds.
method Introduces an asynchronous LMO-based momentum method for unconstrained stochastic nonconvex optimization.
result Establishes convergence guarantees and time complexity bounds for asynchronous LMO-based updates.
Study shows how diverse investors' learning and preferences shape financial markets.
problem Understanding how diverse investor behaviors and preferences affect market dynamics.
method Developed a multi-agent reinforcement learning framework with heterogeneous preferences and learning mechanisms.
result Diverse investors develop differentiated strategies through interaction, leading to realistic market dynamics.
New method learns from subgroup feedback in complex systems.
problem Optimizing complex systems with heterogeneous components.
method Decomposed Gaussian Process (GP) regression and optimization algorithm.
result Proved lower variance and improved accuracy in subgroup feedback.
GeMA learns latent manifolds to benchmark complex systems.
problem Benchmarking complex systems like rail networks and economies with classical methods.
method Geometric Manifold Analysis (GeMA) using a productivity-manifold variational autoencoder (ProMan-VAE).
result GeMA provides more nuanced efficiency evaluations in complex systems.
In market modeling, one often treats buyers as a homogeneous group. In this paper we consider buyers with heterogeneous preferences and products available in many variants. Such a framework allows us to successfully model various market phenomena. In particular, we investigate how is the vendor's behavior influenced by…
We analyze the stability properties of equilibrium solutions and periodicity of orbits in a two-dimensional dynamical system whose orbits mimic the evolution of the price of an asset and the excess demand for that asset. The construction of the system is grounded upon a heterogeneous interacting agent model for a singl…
Study quantifies impacts of heterogeneity in FL on smartphone data.
problem Heterogeneity in FL devices causes performance degradation.
method Collected 136k smartphone data, built heterogeneity-aware FL platform, conducted extensive experiments.
result Heterogeneity causes up to 9.2% accuracy drop and 2.32x training time increase.
This study presents an ANWSER model (asset network systemic risk model) to quantify the risk of financial contagion which manifests itself in a financial crisis. The transmission of financial distress is governed by a heterogeneous bank credit network and an investment portfolio of banks. Bankruptcy reproductive ratio …
Study on evolving interfaces with complex curvature and density effects.
problem Understanding the dynamics of evolving heterogeneous elastic interfaces.
method Modeling an evolving curve with a density function, analyzing the associated gradient flow evolution.
result Analysis of the preservation and asymptotic behavior of geometric properties in the evolving system.
Extracts intrinsic spatial coordinates for complex agent systems to learn PDEs.
problem Modeling collective dynamics of heterogeneous agents.
method Data-driven extraction of intrinsic spatial coordinates, learning PDEs in emergent space.
result Collective dynamics can be approximated through learned PDEs in emergent coordinates.
A new federated learning method speeds up training by selecting faster nodes first.
problem System heterogeneity and stragglers slow down federated learning.
method Adaptive selection of nodes based on data statistical characteristics.
result Significant speedup in wall-clock time compared to standard federated learning.
Identifying behavior that is relatively invariant under different conditions is a challenging task in far-from-equilibrium complex systems. As an example of how the existence of a semi-invariant signature can be masked by the heterogeneity in the properties of the components comprising such systems, we consider the exc…