New measure of interference helps understand and mitigate learning issues in reinforcement learning.
problem Understanding and mitigating interference in reinforcement learning.
method Defined a new measure of interference, evaluated it, and identified key factors contributing to interference.
result Target network frequency and updates on the last layer are significant factors in interference.
DN estimator mitigates network interference in experiments.
problem Network interference biases naive experiment designs.
method Differences-in-Neighbors (DN) estimator designed to mitigate interference.
result DN achieves bias second order in interference effect, with exponentially smaller variance.
Deep learning (DL) based autoencoder has shown great potential to significantly enhance the physical layer performance. In this paper, we present a DL based autoencoder for interference channel. Based on a characterization of a k-user Gaussian interference channel, where the interferences are classified as different le…
A neural-network-based approach is presented to efficiently implement digital backpropagation (DBP). For a 32x100 km fiber-optic link, the resulting "learned" DBP significantly reduces the complexity compared to conventional DBP implementations.
Optimizes wireless power control using graph neural networks and counterfactual optimization.
problem Mitigating interference in wireless networks with multiple transmitter-receiver pairs.
method Graph neural network architecture combined with unsupervised primal-dual counterfactual optimization.
result Guarantees a minimum rate constraint that adapts to network size, balancing user rates.
A new method for reinforcement learning scales errors without tuning.
problem Error scaling varies across reinforcement learning tasks and stages.
method A simple scaling mechanism for temporal-difference learning.
result The method effectively mitigates interference between learning tasks.
A deep RL framework optimizes resource allocation in wireless networks.
problem Optimizing resource allocation and interference in wireless networks.
method Multi-agent deep reinforcement learning for distributed decision-making.
result Our approach outperforms decentralized and centralized baselines in terms of user rates.
New method removes interference bias in causal models.
problem Interference bias impedes causal effect identification in real-world settings.
method Novel definition of causal models with local interference, semi-parametric assumptions.
result True Average Causal Effect can be identified in certain semi-parametric models with local interference.
Study identifies and mitigates causes of image misclassifications in CNN models.
problem Improving model interpretability and accuracy in image classification.
method Trained six CNN architectures on CIFAR-10, used conditional confusion matrices and misclassification networks to identify morphological similarity and non-essential information interference as causes of misclassification. Developed a method to reduce misclassifications by erasing pixels within top 5% saliency map bounding boxes.
result Identified two causes of misclassification: morphological similarity and non-essential information interference, and developed a method to reduce misclassifications caused by the latter.
Study finds reinforcement learning performance plateaus due to environmental interference.
problem Catastrophic interference hinders sample efficiency in reinforcement learning.
method Empirical study in ALE, controlled experiments, analysis of prediction errors.
result Interference causes performance plateaus and degrades policies used to reach them.
Estimates causal effects in networks with varying interference.
problem Estimating causal effects in settings with network interference.
method Proposes neighborhood adaptive estimators for average direct treatment effect on the treated.
result Establishes rates of convergence and distributional results for proposed estimators.
TD learning reduces interference, leading to better generalization.
problem Understanding and reducing interference in TD learning for better generalization.
method Analyzing the inner product of gradients as interference, comparing TD and supervised learning, and examining the dynamics of interference and bootstrapping.
result TD learning leads to low-interference, under-generalizing parameters, while supervised learning does the opposite.
Sparse representations have been shown to be useful in deep reinforcement learning for mitigating catastrophic interference and improving the performance of agents in terms of cumulative reward. Previous results were based on a two step process were the representation was learned offline and the action-value function w…
Lifelong learning is the problem of learning multiple consecutive tasks in a sequential manner, where knowledge gained from previous tasks is retained and used to aid future learning over the lifetime of the learner. It is essential towards the development of intelligent machines that can adapt to their surroundings. I…
The paper addresses Qini curve estimation under clustered network interference.
problem Qini curves can be biased when interference is ignored in clustered network settings.
method Proposes three estimation strategies for clustered network interference.
result Identifies the most appropriate approach based on bias-variance trade-offs.
Paper predicts interference for better LA in URLLC.
problem Improving LA for URLLC with strict latency and reliability.
method Exploits time correlation of interference for prediction.
result Predicted interference improves LA for URLLC.
This work addresses causal inference challenges in networked interference and proposes GNN-based estimators for individual treatment effects.
problem Estimating individual treatment effects in randomized experiments with networked interference.
method Uses Graph Neural Networks (GNNs) to capture network dependencies and derive causal effect estimators.
result Provides policy regret bounds and heuristic error bounds for GNN-based causal estimators under network interference and treatment capacity constraints.
New learning-based methods improve spectral efficiency in mmWave full-duplex systems.
problem Residual self-interference and high pathloss in mmWave full-duplex systems.
method Proposed two learning schemes (ELM-HBF and CNN-HBF) using ADMM and MM algorithms for SI cancellation and joint HBF optimization.
result Learning-based schemes achieve at least 22.1% higher spectral efficiency and faster online prediction and training times.
Study efficient inference for network quantile causal effects with partial interference.
problem Estimating network causal effects on outcome quantiles with partial interference.
method Developed a nonparametric efficiency theory and a nonparametrically efficient estimator using a three-way cross-fitting procedure.
result Proposed estimator is consistent, asymptotically normal, and allows flexible estimation of nuisance functions.
Spatial Deconfounder tackles interference and confounding in spatial data.
problem Interference and unmeasured spatial factors confound causal inference in spatial domains.
method Two-stage method using CVAE with spatial prior to reconstruct confounder, then estimate causal effects.
result Nonparametric identification of direct and spillover effects under weak assumptions.
Algorithm learns interference network and optimizes treatment allocation for unknown network effects.
problem Adaptive experimentation under unknown network interference.
method Thompson sampling algorithm with Gibbs sampler for joint learning of interference network and treatment allocation.
result Proves a Bayesian regret bound and achieves sublinear regret in real-world applications.
Bayesian method estimates causal effects with proxy networks.
problem Estimating causal effects with only proxy measurements of a latent interference network.
method Structural causal model with Block Gibbs sampler and Locally Informed Proposals.
result Accurately estimates causal effects even with noisy proxy networks.
Machine learning method characterizes network interference in A/B tests.
problem Compromised A/B test reliability due to network interference.
method Causal network motifs and machine learning models.
result Outperforms conventional methods in characterizing network interference.
FRONT optimizes decisions with interference, reducing regret over time.
problem Short-sighted policies in online decision-making due to ignoring interference.
method FRONT considers long-term impacts of decisions, using exploratory and exploitative strategies.
result FRONT achieves sublinear regret in both immediate and consequential impacts.
The paper tackles adaptive targeting in networks with interference effects.
problem Adaptive targeting under network interference in a bandit setting.
method Linear model in a sparse regime, analyzing different levels of knowledge of the interference structure.
result Unified view of how knowledge of the interference structure affects online learning efficiency.
This article proposes and evaluates a technique to predict the level of interference in wireless networks. We design a recursive predictor that estimates future interference values by filtering measured interference at a given location. The predictor's parameterization is done offline by translating the autocorrelation…
New algorithm optimizes interventions under network interference, scaling to large networks.
problem Optimal policy learning under network interference where one individual's treatment affects others.
method Developed a scalable Thompson sampling algorithm for dynamic networks.
result Proved a Bayesian regret bound that is sublinear in network size and rounds.
A new method reduces task interference in model merging.
problem Model merging overlooks structural information and is susceptible to task interference.
method Task Singular Vectors (TSV) and TSV-Compress for compression and interference reduction.
result TSV-Merge significantly outperforms existing methods.
Interference effects of tall buildings have attracted numerous studies due to the boom of clusters of tall buildings in megacities. To fully understand the interference effects of buildings, it often requires a substantial amount of wind tunnel tests. Limited wind tunnel tests that only cover part of interference scena…
New algorithm minimizes regret in multi-armed bandits with network interference.
problem Minimizing regret in online experiments with network interference.
method Sparse network interference model, discrete Fourier analysis, linear regression-based algorithms.
result Provable low regret algorithms for sparse interference networks.
New method improves causal inference by estimating complex treatment effects with active learning.
problem Traditional causal inference frameworks ignore interference and assume independent treatment effects.
method Active Learning in Causal Inference with Interference (ACI) using Gaussian process and genetic algorithms.
result ACI achieves accurate effects estimation with reduced data requirements in complex interference scenarios.
New framework for estimating treatment effects in experiments with network interference.
problem Network interference biases traditional treatment effect estimations in randomized experiments.
method Causal message-passing framework based on high-dimensional approximate message passing.
result Practical algorithm to estimate total treatment effect in multi-period experiments.
New estimator reduces bias in interference studies on content marketplaces.
problem Interference bias in experiments on content marketplaces like Douyin.
method Developed a Monte-Carlo estimator based on DQ techniques.
result Achieved bias second-order in treatment effect with low variance.
New method HNCI for evaluating treatment effects in network interference.
problem Evaluating the effectiveness of treatments or policies under network interference.
method High-dimensional network causal inference (HNCI) using linear regression with latent homogeneity.
result Valid confidence intervals and sets for average direct treatment effect and neighborhood size.
New model tackles interference in online experiments.
problem Understanding cumulative performance in interference experiments.
method Introduces Multi-Armed Bandits with Interference (MABI) model.
result Cluster randomization policy achieves optimal expected regret and high probability bound.
An intervention may have an effect on units other than those to which it was administered. This phenomenon is called interference and it usually goes unmodeled. In this paper, we propose to combine Lauritzen-Wermuth-Frydenberg and Andersson-Madigan-Perlman chain graphs to create a new class of causal models that can re…
Current training regimes for deep learning usually involve exposure to a single task / dataset at a time. Here we start from the observation that in this context the trained model is not given any knowledge of anything outside its (single-task) training distribution, and has thus no way to learn parameters (i.e., featu…
Estimates treatment effects in bipartite systems with partial eligibility and interference.
problem Randomized experiments in bipartite systems with partial treatment eligibility and interference.
method Formalizes eligibility-constrained bipartite experiments, defines PTTE and STTE, identifies conditions, develops ensemble estimators, introduces projection.
result Proposed estimators recover PTTE and STTE with low bias and variance, corrects interference bias in field experiments.
New method estimates treatment effects in complex interference settings.
problem Challenges in estimating treatment effects due to unknown interference.
method Higher-order causal message passing for non-linear feature learning.
result Effective estimation of treatment effect dynamics in complex interference.
Paper uses SC to estimate hidden interference for WSRM.
problem Maximizing sum-rate with hidden interfering sources.
method Synthetic control (SC) for estimating counterfactual interference in WMMSE.
result SC-WMMSE outperforms original WMMSE in convergence and objective.
The paper proposes an evolution-based approach to estimate causal effects in interference networks without fully observing the network structure.
problem Estimating causal effects in complex systems with unobserved interaction pathways.
method An evolution-based approach that characterizes how outcomes change across observation rounds in response to interventions, using an exposure-mapping perspective.
result The approach identifies minimal structural conditions under which evolution mappings exist, enabling consistent learning about heterogeneous spillover effects.
U-Net trained to recover acoustic interference striations from distorted data.
problem Recovering acoustic interference striations from distorted signals.
method Training a U-Net using a random mode-coupling matrix model to generate training data.
result U-Net successfully recovers AISs under various conditions.
New framework minimizes interference and selection bias in network A/B testing.
problem Interference and selection bias in network A/B testing.
method Proposes a principled framework that jointly minimizes interference and selection bias using edge spillover probability and cluster matching.
result Significantly lower error in causal effect estimation compared to existing solutions.
The successful application of general reinforcement learning algorithms to real-world robotics applications is often limited by their high data requirements. We introduce Regularized Hierarchical Policy Optimization (RHPO) to improve data-efficiency for domains with multiple dominant tasks and ultimately reduce require…
A new causal deepset framework improves off-policy evaluation under complex interference.
problem Handling spatio-temporal interference in off-policy evaluation.
method Permutation invariance assumption and novel algorithms incorporating it.
result Significantly more precise estimations than existing methods.
Researchers develop a method to measure treatment effects in settings with shared states.
problem Measuring treatment effects in settings with shared states like prices, recommendations, or social signals.
method Double machine learning (DML) theorem with conditions for efficient inference under shared-state interference.
result Efficient estimation of average direct effect (ADE) and global average treatment effect (GATE) in various models.
New framework validates counterfactual estimations in network interference settings.
problem Challenges in causal effect estimation and validation in network interference settings.
method Introduces a distribution-preserving network bootstrap and counterfactual cross-validation procedure.
result Validates counterfactual estimations in diverse network interference settings.
New insights into continual learning with task similarity.
problem Challenges in learning similar tasks without interference.
method Linear teacher-student model with latent structure.
result High input feature similarity with low readout similarity is catastrophic.