CHOOSE enhances shallow Transformers for wireless symbol detection.
problem Improving wireless symbol detection with shallow Transformers.
method Introducing autoregressive latent reasoning steps within hidden space.
result Lightweight Transformers achieve comparable performance to deep models.
DeepSIC learns to detect multiple symbols in MIMO systems without assuming a specific channel model.
problem Challenges in multiuser MIMO detection due to non-linear channels and lack of accurate channel state information.
method Integrates machine learning into iterative soft interference cancellation (SIC) algorithm to learn from limited training samples.
result Significantly outperforms conventional methods in linear and non-linear channels, even with CSI uncertainty.
Model-based machine learning improves communication systems.
problem Improving symbol detection in communication receivers.
method Review and comparison of model-based and deep learning approaches, focusing on deep unfolding and DNN-aided hybrid algorithms.
result Different strategies of conventional deep architectures and hybrid algorithms show advantages and drawbacks.
Symbol detection plays an important role in the implementation of digital receivers. In this work, we propose ViterbiNet, which is a data-driven symbol detector that does not require channel state information (CSI). ViterbiNet is obtained by integrating deep neural networks (DNNs) into the Viterbi algorithm. We identif…
DEFINED improves wireless symbol detection with limited pilot data.
problem Efficient symbol detection over block-fading channels with scarce pilot data.
method In-context learning with decision feedback mechanism.
result Significant performance improvements, often needing only a single pilot pair.
DEFINED uses decision feedback ICL to detect symbols with minimal pilot data.
problem Limited pilot data in wireless receivers.
method In-context learning with decision feedback mechanism.
result Small Transformer trained with DEFINED achieves significant performance improvements.
Data-driven symbol detection improves performance in complex channels.
problem Designing robust symbol detectors in systems with poorly understood channels.
method Hybrid approach combining model-based algorithms with machine learning.
result Near-optimal performance of model-based algorithms achieved without channel model knowledge.
Data-driven factor graphs improve BCJR detection robustness.
problem Implementing BCJR detection with accurate channel model knowledge.
method Learn factor graph using machine learning from labeled data.
result BCJRNet learns to implement BCJR detection from small training sets.
Conventional multiuser detection techniques either require a large number of antennas at the receiver for a desired performance, or they are too complex for practical implementation. Moreover, many of these techniques, such as successive interference cancellation (SIC), suffer from errors in parameter estimation (user …
ABBA creates a new symbolic time series representation based on Brownian bridge.
problem Representing time series data in a compact, symbolic form.
method Adaptive polygonal chain approximation followed by mean-based clustering.
result ABBA outperforms other representations in preserving time series shape information.
Deep learning finds mathematical equations from data.
problem Discovering underlying mathematical expressions from datasets.
method Uses a recurrent neural network to search for mathematical expressions and optimizes using a risk-seeking policy gradient.
result Outperforms existing methods in recovering exact symbolic expressions.
Paper presents a novel neural network for MIMO symbol detection.
problem Handling a variable number of users in MIMO systems.
method Recurrent and permutation equivariant neural network architecture with iterative decoding.
result The neural detector outperforms existing methods in accuracy and efficiency.
Extract symbolic models from deep learning with inductive biases.
problem Interpreting and discovering physical principles from deep neural networks.
method Introduce strong inductive biases in GNNs, encourage sparse latent representations, apply symbolic regression.
result Extracted symbolic equations from neural networks, including known force laws and new analytic formulas.
Automated melodic phrase detection and segmentation is a classical task in content-based music information retrieval and also the key towards automated music structure analysis. However, traditional methods still cannot satisfy practical requirements. In this paper, we explore and adapt various neural network architect…
Deep neural network generates symbolic equations from data.
problem Lack of insight into underlying mappings from traditional deep learning.
method Combines deep learning flexibility with symbolic solutions.
result Accurately generates governing equations for dynamical systems.
Neuro-symbolic agent learns systematic generalisation from formal instructions.
problem Achieving zero-shot generalisation of formally specified tasks.
method Combines deep reinforcement learning with temporal logic.
result Systematic learning emerges with convolutional layers and abstract operators.
Neuro-symbolic traders suppress market prices, highlighting risks to stability.
problem Understanding and quantifying the influence of AI-generated financial models on markets.
method Developed virtual neuro-symbolic traders using deep generative models and tested them in a virtual market.
result Neuro-symbolic traders suppress market prices compared to historical data, indicating potential market instability.
This paper develops novel deep learning-based architectures and design methodologies for an orthogonal frequency division multiplexing (OFDM) receiver under the constraint of one-bit complex quantization. Single bit quantization greatly reduces complexity and power consumption, but makes accurate channel estimation and…
ARTEMIS combines deep learning and symbolic reasoning for financial predictions.
problem Lack of interpretability and economic principles in deep learning models in finance.
method Neuro-symbolic framework combining neural operators, stochastic differential equations, and symbolic distillation.
result ARTEMIS achieves state-of-the-art directional accuracy, outperforming all baselines on synthetic crash regime.
DILP improves fraud detection explainability without significant performance boost.
problem Improving fraud detection explainability in machine learning.
method Differentiable Inductive Logic Programming (DILP) for fraud detection with data curation.
result DILP provides comparable results to traditional methods but lacks significant advantage.
A new method for spotting symbols in CAD images reduces annotation costs and improves accuracy.
problem Challenging task of labeling symbols from CAD drawings.
method Pixel-wise point location via Progressive Gaussian Kernels (PGK) and local offset.
result The proposed method achieves good generalization on real-world CAD images.
Symbolic knowledge in neural models can inadvertently make them more vulnerable to adversarial attacks.
problem Symbolic knowledge in neural models can make models more susceptible to adversarial attacks.
method Investigated deep probabilistic graphical models that incorporate symbolic knowledge and neural nets.
result Symbolic knowledge can propagate the negative effects of adversarial examples, making models more vulnerable.
GFN-SR uses deep learning to generate diverse mathematical expressions.
problem Symbolic regression to find best mathematical expressions.
method Traversing a DAG to generate expression trees sequentially with GFlowNet.
result GFN-SR outperforms other SR algorithms in noisy data.
This paper develops a novel methodology for using symbolic knowledge in deep learning. From first principles, we derive a semantic loss function that bridges between neural output vectors and logical constraints. This loss function captures how close the neural network is to satisfying the constraints on its output. An…
AI agents beat previous best on NetHack, but symbolic bots still outperform.
problem Developing AI agents that can ascend in the NetHack game.
method Used a procedurally generated NetHack Learning Environment for reinforcement learning.
result Symbolic bots outperform neural approaches on NetHack.
Deep Reinforcement Learning (deep RL) has made several breakthroughs in recent years in applications ranging from complex control tasks in unmanned vehicles to game playing. Despite their success, deep RL still lacks several important capacities of human intelligence, such as transfer learning, abstraction and interpre…
EPSTE: A geometric token and deep learning approach to estimating transfer entropy in neuroimaging time series
problem Inferring directed interactions between neural systems from EEG and MEG
method Reframing TE estimation as a learnable problem operating on structured symbolic representations
result EPSTE achieves near-perfect recovery of ground-truth directed structure and significantly lower absolute error than the baseline
Symbol detection for Massive Multiple-Input Multiple-Output (MIMO) is a challenging problem for which traditional algorithms are either impractical or suffer from performance limitations. Several recently proposed learning-based approaches achieve promising results on simple channel models (e.g., i.i.d. Gaussian). Howe…
Bayesian symbolic regression automates model discovery from data.
problem Learning closed-form mathematical models from data using heuristic methods.
method Probabilistic approach to symbolic regression, connecting to information theory and statistical physics.
result Probabilistic approach provides model plausibility and performance guarantees.
Neural network learns equations from data, improving interpretability and extrapolation.
problem Combining neural networks and symbolic regression for better model interpretability and extrapolation.
method Integrating a neural network-based Equation Learner (EQL) network with other deep learning architectures.
result The EQL-based architecture can extrapolate well outside of the training data set.
NeSS combines neural and symbolic approaches for better compositional generalization.
problem Lack of compositional generalization in deep learning models.
method NeSS uses a neural network to generate traces, executed by a symbolic stack machine with sequence manipulation.
result Achieves 100% generalization performance across multiple domains.
FIGARO generates symbolic music with fine-grained control.
problem Minimal control over generated music sequences.
method Description-to-sequence task, learning conditional distribution of sequences given high-level descriptions.
result State-of-the-art controllable symbolic music generation.
Neural-symbolic model improves link prediction in knowledge graphs.
problem Effective relational learning and reasoning for AI systems.
method Neural-symbolic graph neural network that learns over all paths in knowledge graphs.
result Neural-symbolic model outperforms path-based approaches in link prediction.
Enhances safety of 3D object detection neural networks.
problem Ensuring robustness and safety of 3D object detection systems.
method Symbolic error propagation, specialized loss function, safety-aware non-max-inclusion algorithm.
result Improved safety and robustness of 3D object detection neural networks.
QABBA improves time series storage efficiency while preserving shape information.
problem Efficient storage and shape preservation of time series data.
method Quantized symbolic time series approximation (QABBA) using ABBA technique.
result QABBA achieves a new state-of-the-art on Monash regression dataset.
Process Monitoring involves tracking a system's behaviors, evaluating the current state of the system, and discovering interesting events that require immediate actions. In this paper, we consider monitoring temporal system state sequences to help detect the changes of dynamic systems, check the divergence of the syste…
Many real-world domains can be expressed as graphs and, more generally, as multi-relational knowledge graphs. Though reasoning and learning with knowledge graphs has traditionally been addressed by symbolic approaches, recent methods in (deep) representation learning has shown promising results for specialized tasks su…
Explores tensor products in hyperdimensional computing.
problem Understanding tensor products in hyperdimensional computing.
method Generalized results from graph embeddings to vector symbolic architectures and hyperdimensional computing.
result Tensor product is the most general and expressive representation with errorless unbinding and detection.
This paper offers a general and comprehensive definition of the day-of-the-week effect. Using symbolic dynamics, we develop a unique test based on ordinal patterns in order to detect it. This test uncovers the fact that the so-called "day-of-the-week" effect is partly an artifact of the hidden correlation structure of …
Transformer models can solve complex math problems with less data.
problem Solving complex symbolic mathematics problems with limited data.
method Pretrain transformer models on language translation tasks and fine-tune for symbolic math.
result Pretrained transformer models achieve comparable accuracy to state-of-the-art models with less data.
CSML learns causal structures for few-shot learning.
problem Spurious correlations limit deep learning generalization.
method CSML combines perception, causal induction, and reasoning modules.
result CSML achieves superior few-shot learning across tasks.
In order to build efficient deep recurrent neural architectures, it is essential to analyze the complexityof long distance dependencies (LDDs) of the dataset being modeled. In this paper, we presentdetailed analysis of the dependency decay curve exhibited by various datasets. The datasets sampledfrom a similar process …
This study examines deep hedging for S&P 500 options, revealing systematic delta corrections and fragility.
problem Understanding and validating deep hedging strategies for financial options.
method Compared TD3 agents with a Black-Scholes delta hedge, using walk-forward tests and symbolic regression.
result Deep hedging agents learn systematic delta corrections, which can improve performance but are regime-fragile.
PDE-NetGen converts physical equations to neural networks for various scientific problems.
problem Bridging physics and deep learning for efficient neural network architectures.
method Combines symbolic calculus and neural network generation to translate PDEs into NN architectures.
result Generates compact, computationally-efficient physics-informed NN architectures.
SATNet solves the Symbol Grounding Problem, enabling self-supervised learning.
problem Mapping visual inputs to symbolic variables without explicit supervision.
method Self-supervised pre-training pipeline and proofreading method.
result SATNet achieves full accuracy with no label leakage, surpassing state-of-the-art.
ECSEL learns signomial equations for explainable classification.
problem Creating interpretable models for classification.
method ECSEL constructs signomial equations directly for classification and explanation.
result ECSEL outperforms state-of-the-art methods in interpretability and efficiency.
Network node embedding is an active research subfield of complex network analysis. This paper contributes a novel approach to learning network node embeddings and direct node classification using a node ranking scheme coupled with an autoencoder-based neural network architecture. The main advantages of the proposed Dee…
Existing automatic music generation approaches that feature deep learning can be broadly classified into two types: raw audio models and symbolic models. Symbolic models, which train and generate at the note level, are currently the more prevalent approach; these models can capture long-range dependencies of melodic st…