Paper closes neural-symbolic learning loop with grammar model and back-search algorithm.
problem Slow convergence in neural-symbolic learning due to error propagation issues.
method Introduces grammar model as symbolic prior and back-search algorithm for efficient error propagation.
result Significantly outperforms RL methods in performance, converging speed, and data efficiency.
Symbolic knowledge in neural models can inadvertently make them more vulnerable to adversarial attacks.
problem Symbolic knowledge in neural models can make models more susceptible to adversarial attacks.
method Investigated deep probabilistic graphical models that incorporate symbolic knowledge and neural nets.
result Symbolic knowledge can propagate the negative effects of adversarial examples, making models more vulnerable.
Bayesian symbolic regression automates model discovery from data.
problem Learning closed-form mathematical models from data using heuristic methods.
method Probabilistic approach to symbolic regression, connecting to information theory and statistical physics.
result Probabilistic approach provides model plausibility and performance guarantees.
NeSS combines neural and symbolic approaches for better compositional generalization.
problem Lack of compositional generalization in deep learning models.
method NeSS uses a neural network to generate traces, executed by a symbolic stack machine with sequence manipulation.
result Achieves 100% generalization performance across multiple domains.
Transformer models can solve complex math problems with less data.
problem Solving complex symbolic mathematics problems with limited data.
method Pretrain transformer models on language translation tasks and fine-tune for symbolic math.
result Pretrained transformer models achieve comparable accuracy to state-of-the-art models with less data.
SE-RRMs solve structured problems like Sudoku and ARC-AGI by enforcing symbol equivariance.
problem Structured reasoning problems like Sudoku and ARC-AGI.
method Symbol-equivariant recurrent reasoning models enforcing permutation equivariance.
result SE-RRMs outperform prior RRMs on 9x9 Sudoku and generalize to larger and smaller instances.
Hybrid model learns novel handwritten characters better than neural or symbolic models alone.
problem Generating novel yet structured concepts.
method Neuro-symbolic model combining neural networks and probabilistic programs.
result Hybrid model outperforms alternative models in learning and generalizing novel handwritten characters.
Enhances speech quality in noisy environments using symbolic sequential modeling.
problem Improving speech quality in noisy conditions.
method Incorporates symbolic sequential modeling into speech enhancement framework.
result Significant improvement in speech quality metrics (PESQ, STOI) on TIMIT dataset.
Neural-symbolic model improves link prediction in knowledge graphs.
problem Effective relational learning and reasoning for AI systems.
method Neural-symbolic graph neural network that learns over all paths in knowledge graphs.
result Neural-symbolic model outperforms path-based approaches in link prediction.
Symbolic regression improved by incorporating prior knowledge.
problem Insufficient guidance from training data alone for model accuracy.
method Multi-objective symbolic regression combining training data and prior constraints.
result Models that fit training data well and comply with prior knowledge.
Paper proposes a bijective approach for signal/symbol translation using variational auto-encoders.
problem Extracting symbolic information from signals, especially in music, is challenging and non-generic.
method Turned into a density estimation task, using two variational auto-encoders with additive constraint.
result Bijective signal/symbol translation achieved, allowing both signal-to-symbol and symbol-to-signal inference.
VaSST uses soft symbolic trees for probabilistic symbolic regression.
problem Efficiently recover symbolic expressions from noisy data.
method Variational inference with soft symbolic trees.
result Superior performance in structural recovery and predictive accuracy.
The symbolic dynamics technique is well-known for low-dimensional dynamical systems and chaotic maps, and lies at the roots of the thermodynamic formalism of dynamical systems. Here we show that this technique can also be successfully applied to time series generated by complex systems of much higher dimensionality. Ou…
Symbolic neural network for analyzing and patching complex systems.
problem Analyzing and verifying complex neural networks.
method Symbolic representation of piecewise-linear neural networks for efficient computation.
result Demonstrated applications in weakest preconditions, strongest postconditions, and patching.
Bayesian symbolic regression uncovers missing physics from data with uncertainty quantification.
problem Incomplete knowledge of physical laws from experimental data.
method Bayesian symbolic regression using Reversible Jump Markov Chain Monte Carlo.
result Uncertainty quantification in recovered model structures.
Shape-constrained symbolic regression improves model extrapolation with prior knowledge.
problem Improving model extrapolation with prior knowledge in symbolic regression.
method Shape-constrained symbolic regression using evolutionary algorithms with interval arithmetic.
result Models with shape constraints have improved extrapolation but lower accuracy on test sets.
OccamNet finds interpretable symbolic fits to data efficiently.
problem Complex neural models extrapolate poorly and are hard to interpret.
method Samples functions, biases towards better fits, and uses cross-entropy matching.
result Outperforms state-of-the-art symbolic regression methods on real-world datasets.
Extract symbolic models from deep learning with inductive biases.
problem Interpreting and discovering physical principles from deep neural networks.
method Introduce strong inductive biases in GNNs, encourage sparse latent representations, apply symbolic regression.
result Extracted symbolic equations from neural networks, including known force laws and new analytic formulas.
Neural networks learn symbolic structure to perform compositional tasks.
problem How neural networks perform well on compositional tasks without explicit representations.
method ROLE analysis to uncover symbolic structure in recurrent neural networks.
result Neural networks converge to solutions that implicitly represent symbolic structure.
S2KAN integrates symbolic primitives into neural network activations for improved interpretability.
problem Training activations in KANs often lack symbolic fidelity, leading to unintelligible models.
method Softly Symbolified Kolmogorov-Arnold Networks (S2KAN) integrates symbolic primitives into training with learnable gates and a Minimum Description Length objective.
result S2KAN discovers interpretable forms when symbolic terms suffice, gracefully degrading to dense splines when necessary.
PySR method automates discovering equations from data in chaotic dynamics and epidemics.
problem Discovering equations from complex data in dynamical systems.
method Symbolic regression methods, focusing on PySR.
result PySR method efficiently infers equations from chaotic dynamics and epidemic models, matching original forms.
CSML learns causal structures for few-shot learning.
problem Spurious correlations limit deep learning generalization.
method CSML combines perception, causal induction, and reasoning modules.
result CSML achieves superior few-shot learning across tasks.
Study shows how transformers classify symbols without naming them, proving a margin-versus-collision criterion.
problem How transformers classify symbols without naming them.
method Logistic classification analysis of transformer-kernel regime, colored collision graph.
result Decomposes learned predictor into ideal template-level classifier and finite-sample perturbation.
Meta-learning symbolic default hyperparameters from dataset properties.
problem Empirical hyperparameter optimization is slow and requires manual configuration.
method Evolutionary algorithm to learn symbolic hyperparameter formulas from dataset properties.
result Meta-learning finds viable symbolic defaults for ML algorithms.
R2T hybrid model improves robust regression for asymmetric noise.
problem Least-squares regression fails with asymmetric structured noise.
method Transformer encoder, compression NN, fixed symbolic equation.
result Median regression MSE of 6e-6 to 3.5e-5 on synthetic data.
Generative Neuro-Symbolic model learns from raw data with rich conceptual representations.
problem Learning rich, general-purpose conceptual representations from raw perceptual inputs.
method Generative Neuro-Symbolic (GNS) model combining symbolic and neural network approaches.
result Model learns from raw data and generalizes to 4 unique tasks.
Neuro-symbolic traders suppress market prices, highlighting risks to stability.
problem Understanding and quantifying the influence of AI-generated financial models on markets.
method Developed virtual neuro-symbolic traders using deep generative models and tested them in a virtual market.
result Neuro-symbolic traders suppress market prices compared to historical data, indicating potential market instability.
Deep learning finds mathematical equations from data.
problem Discovering underlying mathematical expressions from datasets.
method Uses a recurrent neural network to search for mathematical expressions and optimizes using a risk-seeking policy gradient.
result Outperforms existing methods in recovering exact symbolic expressions.
Data-driven symbol detection improves performance in complex channels.
problem Designing robust symbol detectors in systems with poorly understood channels.
method Hybrid approach combining model-based algorithms with machine learning.
result Near-optimal performance of model-based algorithms achieved without channel model knowledge.
QABBA improves time series storage efficiency while preserving shape information.
problem Efficient storage and shape preservation of time series data.
method Quantized symbolic time series approximation (QABBA) using ABBA technique.
result QABBA achieves a new state-of-the-art on Monash regression dataset.
We propose a new class of probabilistic neural-symbolic models, that have symbolic functional programs as a latent, stochastic variable. Instantiated in the context of visual question answering, our probabilistic formulation offers two key conceptual advantages over prior neural-symbolic models for VQA. Firstly, the pr…
We describe dimensionally constrained symbolic regression which has been developed for mass measurement in certain classes of events in high-energy physics (HEP). With symbolic regression, we can derive equations that are well known in HEP. However, in problems with large number of variables, we find that by constraini…
MARLeME extracts MARL models into symbolic models for better interpretability.
problem Improving interpretability and explainability of MARL systems.
method Develops a MARL model extraction library that approximates MARL systems with symbolic models.
result Enhanced understanding and inspection of MARL systems and agents.
Symbolic data analysis (SDA) is an emerging area of statistics concerned with understanding and modelling data that takes distributional form (i.e. symbols), such as random lists, intervals and histograms. It was developed under the premise that the statistical unit of interest is the symbol, and that inference is requ…
Reinforcement learning and symbolic planning have both been used to build intelligent autonomous agents. Reinforcement learning relies on learning from interactions with real world, which often requires an unfeasibly large amount of experience. Symbolic planning relies on manually crafted symbolic knowledge, which may …
It is known that every ribbon category with unimodality allows symmetrized 6j-symbols with full tetrahedral symmetries while a spherical category does not in general. We give an explicit counterexample for this, namely the category E. We define the mirror conjugate symmetry of 6j-symbols instead and sho…
For an arbitrary Riemannian manifold X and Hermitian vector bundles E and F over X we define the notion of the normal symbol of a pseudodifferential operator P from E to F. The normal symbol of P is a certain smooth function from the cotangent bundle T∗X to the homomorphism bundle Hom(E,F) and dep…
Secure Multiparty Computation protects data privacy in Symbolic Regression.
problem Data privacy in Symbolic Regression models.
method Secure Multiparty Computation for vertical partitioning.
result Comparable performance to centralized model while preserving privacy.
CHOOSE enhances shallow Transformers for wireless symbol detection.
problem Improving wireless symbol detection with shallow Transformers.
method Introducing autoregressive latent reasoning steps within hidden space.
result Lightweight Transformers achieve comparable performance to deep models.
Graph networks learn symbolic physics laws from simulations.
problem Learning interpretable physics laws from simulations.
method Inductive biases on graph networks for symbolic regression.
result Graph networks can learn symbolic laws of physics.
Based on the ideas of Optimal Control, we introduce the new basic characteristic of a bracket generating distribution, the Jacobi symbol. In contrast to the classical Tanaka symbol, the set of Jacobi symbols is discrete and classifiable. We give an explicit and unified algebraic procedure for the construction of the ca…
Develops a Bayesian framework for symbolic regression of scientific expressions.
problem Lack of principled uncertainty quantification and interpretability in existing symbolic regression methods.
method Hierarchical Bayesian framework with tree-structured symbolic expressions and Markov chain Monte Carlo inference.
result Robust performance on various datasets, including single-atom catalysis.
Efficient algorithm for identifying causal effects in linear models.
problem Determining causal effects from observational data under latent confounding.
method Symbolic computation and efficient algorithm for finding identifying formulas.
result Proves the existence of identifying formulas of a specified degree in quasi-polynomial time.
The seemingly infinite diversity of the natural world arises from a relatively small set of coherent rules, such as the laws of physics or chemistry. We conjecture that these rules give rise to regularities that can be discovered through primarily unsupervised experiences and represented as abstract concepts. If such r…
FIGARO generates symbolic music with fine-grained control.
problem Minimal control over generated music sequences.
method Description-to-sequence task, learning conditional distribution of sequences given high-level descriptions.
result State-of-the-art controllable symbolic music generation.
Develops experimental design for discovering missing physics in bioreactors.
problem Discovering missing physics in incomplete model structures of process systems.
method Combines universal differential equations and symbolic regression with sequential experimental design.
result Successfully recovered true model structure of a bioreactor using machine learning techniques.
Study develops supervised algorithm for symbolic music style translation.
problem Transforming musical style while maintaining original content.
method Synthetic data generation for aligned training data, encoder-decoder model.
result Trained models produce meaningful accompaniments for real MIDI recordings.
This work identifies and mitigates reasoning shortcuts in Neuro-Symbolic models.
problem Neuro-Symbolic models can achieve high accuracy by using unintended concepts.
method Characterized reasoning shortcuts as unintended optima of the learning objective and identified four key conditions.
result Reasoning shortcuts are difficult to mitigate, casting doubt on NeSy solutions' trustworthiness and interpretability.