Proposes CNN-based analog CSI feedback for FDD MIMO-OFDM systems.
problem High CSI feedback overhead in FDD MIMO systems.
method AnalogDeepCMC: maps downlink CSI to uplink channel input, reconstructs channel estimate.
result Significantly improves downlink spectral efficiency and simplifies operation.
Optimizing over-the-air convex optimization, analog schemes are nearly optimal at low SNR.
problem Optimizing over-the-air convex optimization with coded gradients.
method Analyzes coded gradients over an additive Gaussian noise channel, considers analog coding schemes.
result Analog coding schemes nearly match the optimal convergence rate at low SNR, but a slowdown is inevitable.
This paper interprets Dropout as creating an equiangular tight frame in autoencoders.
problem Understanding the success of Dropout in deep learning.
method Connecting Dropout to analog channel coding and equiangular tight frames (ETF).
result Optimizing autoencoders with dropout leads to an equiangular tight frame structure.
Deep JSCC maps images directly to channel symbols for wireless transmission.
problem Efficient image transmission in noisy wireless channels.
method Joint source and channel coding using CNNs trained jointly.
result Deep JSCC outperforms traditional JPEG/2000 + channel codes at low SNR.
Jointly learns encoding and decoding for noisy channels.
problem Asymptotic optimality of source and channel separation in finite bit-length regimes.
method Discrete variational autoencoder model with noise simulation.
result Jointly learned codes are competitive and learn robust representations.
Deepcode codes outperform traditional ones by 3 orders of magnitude.
problem Designing reliable codes for feedback channels with Gaussian noise.
method Integrating deep learning with information theory for novel codes.
result Deepcode codes outperform known codes by 3 orders of magnitude in reliability.
DeepJSCC-f uses feedback to improve image transmission quality.
problem Improve image transmission quality in feedback channels.
method Autoencoder-based joint source-channel coding (DeepJSCC-f) exploiting feedback.
result Improves reconstruction quality for fixed-length or variable-length transmission.
While the channel capacity reflects a theoretical upper bound on the achievable information transmission rate in the limit of infinitely many bits, it does not characterise the information transfer of a given encoding routine with finitely many bits. In this note, we characterise the quality of a code (i. e. a given en…
Two new coding schemes improve the efficient communication of noisy data.
problem Efficient communication of noisy data in machine learning.
method Ordered Random Coding (ORC) and Hybrid Coding Scheme.
result Improved coding schemes over existing approaches.
Paper proposes IABF to improve NECST robustness.
problem Limited robustness of NECST learned coding networks.
method Infomax Adversarial-Bit-Flip (IABF) to improve stability and robustness.
result IABF achieves state-of-the-art performances on compression and error correction benchmarks.
Derives metrics for DeFi vaults, addressing credit risk.
problem Credit risk in DeFi lending vaults.
method Three-level decomposition of vault risk; six structural features identified.
result Estimation architecture for credit risk metrics.
A-FADMM improves FL scalability and privacy via wireless channel perturbations and interference.
problem Challenges in model training due to wireless channel randomness and interference.
method Formulated a novel constrained optimization problem and proposed A-FADMM framework.
result Proves convergence and privacy guarantees for A-FADMM under time-varying channels.
New method uses VAEs for blind channel equalization and decoding.
problem Blind channel equalization and decoding without pilot symbols.
method Variational autoencoders (VAEs) for blind channel equalization and decoding.
result Significant improvement in error rate compared to existing methods.
Study neural communication systems with bandwidth-limited channels.
problem Reliable message transmission despite noisy channels.
method Jointly model compression and error correction with neural networks; introduce prior for missing information; use auxiliary latent variables.
result Joint neural communication systems outperform separate models under expected information loss.
End-to-end learning of codes for secure BPSK communication in Gaussian wiretap channel.
problem Secure communication in the presence of an adversary for BPSK modulation.
method Learning finite-length codes using deep neural networks (DNNs) with mutual information estimation.
result Learned codes achieve near-optimal security performance, as demonstrated by numerical results.
Paper uses RNNs to design LDPC codes for binary erasure channels.
problem Designing capacity-approaching LDPC codes for binary erasure channels.
method Model Density Evolution using RNNs to determine LDPC code coefficients and structure.
result NDE improves LDPC design performance and complexity compared to differential evolution.
Paper uses RL to optimize bit-flipping decoding for binary codes.
problem Improving bit-flipping decoding for binary linear codes.
method Mapped iterative decoding algorithms to MDPs for reinforcement learning.
result Learned BF decoders offer performance-complexity trade-offs and near-optimal performance.
Paper introduces SCP to measure classifier distortion and optimized coding strategies.
problem Noise impacts binary classifier performance; goal is to minimize distortion.
method Developed a low-complexity estimate of SCP using quantization and polynomial multiplication. Also studied replication error-correcting codes for maximizing SCP.
result Introduced optimized coding strategies that specifically aim to maximize classification probability (minimizing distortion) for the same redundancy overhead.
A privacy-preserving method for transmitting data over a wiretap channel using generative networks.
problem Privacy protection in communication over a wiretap channel.
method Data-driven approach using variational autoencoder (VAE)-based joint source channel coding (JSCC).
result The approach provides high reconstruction quality at the receiver while confusing the eavesdropper about the latent sensitive attribute.
A novel Gradient-Based Multiple Access algorithm for distributed learning over fading channels.
problem Distributed learning over multiple access fading channels.
method Gradient-Based Multiple Access (GBMA) algorithm, using analog gradients and common shaping waveforms.
result GBMA can approach the convergence rate of centralized gradient descent in large networks.
Two coding schemes designed for different settings are compared.
problem Comparing two coding schemes designed for different communication settings.
method Demonstrated through evaluation of Deepcode and Modulo-SK on the AWGN channel with coded feedback and unit delay.
result Deepcode outperforms Modulo-SK in settings with coded feedback and noisy feedback.
New algorithm for active learning from feedback coding.
problem Efficiently selecting examples for labeling in active machine learning.
method Formalized structural similarities between active learning and feedback channel coding, developed an optimal transport-based algorithm called Approximate Posterior Matching (APM).
result Learning performance comparable to existing methods at reduced computational cost.
Study investigates FL performance over a noisy downlink, showing analog approach outperforms digital.
problem Impact of bandwidth-limited downlink on federated learning performance.
method Modelled downlink and uplink channels; proposed digital and analog downlink approaches; analyzed convergence behavior.
result Analog downlink approach provides significant improvement over digital approach, especially with biased data distribution.
New scheme optimizes BMI through probabilistic and geometric shaping.
problem Optimizing bit-wise mutual information (BMI) for coded modulation.
method Joint optimization of BMI through probabilistic and geometric shaping.
result Joint optimization enables a continuum of constellation geometries and probability distributions.
The possibility of latency arbitrage in financial markets has led to the deployment of high-speed communication links between distant financial centers. These links are noisy and so there is a need for coding. In this paper, we develop a gametheoretic model of trading behavior where two traders compete to capture laten…
This paper considers a transmission control problem in network-coded two-way relay channels (NC-TWRC), where the relay buffers random symbol arrivals from two users, and the channels are assumed to be fading. The problem is modeled by a discounted infinite horizon Markov decision process (MDP). The objective is to find…
We study a new class of codes for lossy compression with the squared-error distortion criterion, designed using the statistical framework of high-dimensional linear regression. Codewords are linear combinations of subsets of columns of a design matrix. Called a Sparse Superposition or Sparse Regression codebook, this s…
The paper optimizes querying schemes for crowdsourced classification using XOR queries.
problem Optimizing querying schemes for crowdsourced classification.
method Modeling crowdsourced labeling/classification as source coding problem, leveraging connections to channel coding.
result Provides querying schemes with almost optimal number of queries, each involving a constant number of labels.
Deep learning optimizes polar codes for better performance.
problem Designing efficient polar codes for error correction.
method Representing polar code indices as neural network weights, optimizing through gradient descent.
result Significant performance improvements over existing methods.
Iterative BP-CNN improves channel decoding under correlated noise.
problem Channel decoding under correlated noise.
method Concatenates CNN with BP decoder, iteratively improving SNR.
result Iterative BP-CNN achieves better BER with lower complexity.
A deep learning autoencoder improves error correction for one-bit quantization.
problem Improving error correction for one-bit quantization in AWGN channels.
method Proposes a novel autoencoder-based coding scheme using turbo codes as implicit regularization.
result Empirically and theoretically shows nearly optimal performance of the proposed coding scheme.
Massive MIMO is a variant of multiuser MIMO where the number of base-station antennas M is very large (typically 100), and generally much larger than the number of spatially multiplexed data streams (typically 10). Unfortunately, the front-end A/D conversion necessary to drive hundreds of antennas, with a signal band…
CN normalizes channels for better time series model performance.
problem Improper channel identification in time series models.
method Channel Normalization (CN) and its variants (ACN, PCN) using distinct affine transformations.
result Significant performance gains across various time series models.
A new algorithm reduces regret in multi-player bandits without collision info.
problem Decentralized multi-player multi-armed bandits with no collision info.
method EC-SIC algorithm using optimal error correction coding for reward statistics.
result Regret approaches that of centralized with collision info.
Sparse superposition codes were recently introduced by Barron and Joseph for reliable communication over the AWGN channel at rates approaching the channel capacity. The codebook is defined in terms of a Gaussian design matrix, and codewords are sparse linear combinations of columns of the matrix. In this paper, we prop…
This paper finds the noise threshold for learning Gaussian mixture models equals channel capacity.
problem Learning Gaussian mixture models with noisy data.
method Bayesian formulation with uniformly distributed centers on a sphere, analyzing the large system limit.
result The maximal noise level σ2 for which GMM learning is as easy as labeled observations is the channel capacity. SOR-Mamba improves Mamba for robust time series forecasting by minimizing channel order bias.
problem Robust time series forecasting with Mamba's sequential order bias.
method SOR-Mamba incorporates regularization to minimize channel order discrepancy and introduces CCM for channel correlation preservation.
result SOR-Mamba enhances robustness to channel order and improves forecasting accuracy.
New CPWL functions for deep neural networks with practical applications in coding.
problem Expressivity of deep ReLU neural networks in high dimensions.
method Developed new families of CPWL functions and showed they can be computed by ReLU networks.
result Proved approximation error of CPWL functions by shallower networks and separation result.
Optical DNNet boosts accuracy with multiple frequency-channels.
problem Improving the accuracy of optical neural networks.
method Developed a novel optical diffractive deep neural network with multiple frequency-channels.
result Multiple frequency-channels significantly increase network accuracy.
BottleNet++ compresses deep learning features for efficient mobile inference.
problem Balancing computation and communication in mobile devices with deep learning models.
method End-to-end architecture with encoder, non-trainable channel layer, and decoder.
result Achieves high compression ratio and bandwidth reduction with minimal accuracy loss.
Proposes GPCA module for channel attention in CNNs using Gaussian processes.
problem Improving performance in visual tasks through effective channel selection.
method Integrates Gaussian processes into channel attention mechanisms for probabilistic modeling of channel correlations.
result Demonstrates improved performance of GPCA module in end-to-end CNN training.
Enhances Transformer models for multivariate time series with dataset-specific channel masks.
problem Capturing channel dependency in multivariate time series models.
method Introduces partial channel dependence and channel masks to refine channel dependency in Transformers.
result Improves model performance across diverse tasks and datasets.
Fault-tolerant neural networks inspired by biological error correction codes.
problem Achieving reliable computation with unreliable neurons.
method Using biological error correction codes from grid cells in the mammalian cortex to develop a fault-tolerant neural network.
result Noisy biological neurons operate below a fault-tolerance threshold, suggesting a mechanism for reliable computation in the brain.
Study on statistical estimation over Gaussian MAC, comparing analog and digital schemes.
problem Distributed minimax statistical estimation over a Gaussian MAC.
method Developed analog joint estimation-communication schemes and derived information-theoretic lower bounds.
result Achieved risk within a logarithmic factor of information-theoretic lower bounds.
Relationships that exist between the classical, Shannon-type, and geometric-based approaches to sampling are investigated. Some aspects of coding and communication through a Gaussian channel are considered. In particular, a constructive method to determine the quantizing dimension in Zador's theorem is provided. A geom…
Paper tackles federated linear bandit learning with AirComp for noisy channels.
problem Minimize cumulative regret in federated linear bandit learning.
method Proposes a federated linear bandits scheme using over-the-air computation (AirComp) over noisy fading channels.
result Determines the regret bound of the proposed scheme.
Study improves efficiency of MIMO systems' sum rate estimation.
problem Maximizing sum rate in MIMO systems with PAPC constraints.
method Proposes two new low-complexity approaches: alternating optimization and machine learning.
result Demonstrates superior performance compared to existing methods.
In this paper we consider the problem of transmitting a continuous alphabet discrete-time source over an AWGN channel. The design of good curves for this purpose relies on geometrical properties of spherical codes and projections of N-dimensional lattices. We propose a constructive scheme based on a set of curves on …