Neural networks struggle with abstract patterns, new RBP structures improve performance.
problem Neural networks fail to learn abstract patterns based on identity rules.
method Proposed Relation Based Pattern (RBP) extensions to neural network structures.
result Neural networks with RBP structures achieve perfect performance on synthetic and real-world sequence prediction tasks.
For using neural networks in safety critical domains, it is important to know if a decision made by a neural network is supported by prior similarities in training. We propose runtime neuron activation pattern monitoring - after the standard training process, one creates a monitor by feeding the training data to the ne…
NHC learns scalable algorithmic solutions from diverse tasks.
problem Neural networks struggle to learn algorithmic strategies.
method Memory-augmented network with abstraction mechanism and evolutionary training.
result Reliable learning of robust and scalable algorithmic solutions.
DARec adapts rating patterns across domains without auxillary info.
problem Cross-domain recommendation challenges.
method Deep domain adaptation model (DARec) that transfers rating patterns.
result Best performance on public datasets.
Cognitive abstraction metrics predict deep neural networks' generalization ability.
problem Understanding deep neural networks' generalization ability.
method Defined Cognitive Neural Activation (CNA) metric based on information complexity and activation patterns.
result CNA is highly predictive of generalization ability, outperforming other metrics.
Improved few-shot visual reasoning with image preprocessing.
problem Few-shot classifiers struggle with abstract visual reasoning tasks.
method Spectral feature removal to emphasize unique image parts.
result Combining spectral preprocessing with Relational Networks improves accuracy nearly 40%.
A Delaunay cell decomposition of a surface with constant curvature gives rise to a circle pattern, consisting of the circles which are circumscribed to the facets. We treat the problem whether there exists a Delaunay cell decomposition for a given (topological) cell decomposition and given intersection angles of the ci…
Automated discovery of diverse self-organized patterns in complex systems.
problem Automated identification of interesting spatially localized patterns in self-organizing systems.
method Intrinsically motivated machine learning algorithms (POP-IMGEPs) combined with deep auto-encoders and CPPN primitives.
result Efficiency and effectiveness of the proposed method in discovering diverse patterns compared to baselines.
Equivariant cohomology simplifies symplectic manifold integrals with group actions.
problem Complex integrals on symplectic manifolds with Lie group actions.
method Atiyah-Bott Localization Theorem
result Simplifies integrals by revealing hidden structure.
ActiLabel learns activity patterns across diverse sensor devices.
problem Limited adoption of activity recognition models across different domains due to diverse sensor devices.
method Combination of graph model and optimal tiered mapping for learning activity labels.
result Superior performance compared to state-of-the-art methods on public datasets.
Word embeddings are a powerful approach for unsupervised analysis of language. Recently, Rudolph et al. (2016) developed exponential family embeddings, which cast word embeddings in a probabilistic framework. Here, we develop dynamic embeddings, building on exponential family embeddings to capture how the meanings of w…
Bayesian weight priors improve neural network learning of identity relations.
problem Neural networks struggle to learn abstract and systematic relations, especially identity relations.
method Extended RBP approach using Bayesian weight priors as a regularization term.
result Bayesian weight priors lead to perfect generalization for identity relations and do not hinder standard neural network learning.
Machine Learning has become very famous currently which assist in identifying the patterns from the raw data. Technological advancement has led to substantial improvement in Machine Learning which, thus helping to improve prediction. Current Machine Learning models are based on Classical Theory, which can be replaced b…
Abstracts index for ML4H workshop at NeurIPS 2019.
problem No specific problem stated; index of accepted abstracts.
method Not specified; index of accepted abstracts.
result No specific result stated.
The paper explores how to make neural networks extrapolate longer sequences.
problem Neural networks struggle to extrapolate beyond seen data, especially for longer sequences.
method The authors propose a model with separate content- and location-based attention mechanisms.
result Models with the proposed attention mechanisms are better at extrapolating longer sequences.
Abstraction is a fundamental part when learning behavioral models of systems. Usually the process of abstraction is manually defined by domain experts. This paper presents a method to perform automatic abstraction for network protocols. In particular a weakly supervised clustering algorithm is used to build an abstract…
The paper aims to mathematically define and learn abstractions from data.
problem Defining and learning abstractions from data.
method Characterize abstractions as summaries for answering queries, define leakiness as a loss function, and generalize classical statistics.
result A mathematical theory of abstraction can be learned from data.
Unified framework for causal models at different levels of abstraction.
problem Relating causal models at varying levels of abstraction.
method Categorical framework using natural transformations between Markov functors.
result Generalized and unified causal abstractions with categorical proofs.
Abstract MDPs enable strategic exploration and fast reward transfer in complex environments.
problem Challenging to learn accurate MDPs for high-dimensional states.
method Learn an abstract MDP over low-dimensional coarse states, using an abstraction function.
result Achieves superhuman performance on Pitfall! and higher reward with fewer samples.
Bayesian method detects mesoscale structures in pathway data networks.
problem Mesoscale structures in pathway data networks are hard to detect due to dependencies between interactions.
method Bayesian approach modeling optimal partitioning and higher-order dynamics.
result Method can recover both proximity-based and role-based groupings of nodes.
PALM learns abstract models for efficient planning and task transfer.
problem Efficiently learning and transferring hierarchical models for planning.
method PALM uses a new formal structure (L-AMDP) to learn independent, modular models at multiple levels of abstraction.
result PALM integrates planning and execution, facilitating rapid learning of abstract models.
Tabular Q-Learning with learned state abstractions solves continuous control tasks.
problem Challenging reinforcement learning problems in continuous control.
method Learned state abstraction to transform continuous state-space into discrete.
result Tabular Q-Learning with learned abstractions achieves efficient learning in unseen tasks.
Generative Link Sequence Modeling predicts future links in evolving networks.
problem Predicting future links in networks with evolving structures.
method Sequence modeling framework with self-tokenization to capture temporal link formation patterns.
result GLSM achieves best performance on AUC metrics compared to existing methods.
New approach to abstract neural network representations using renormalization group.
problem Developing truly abstract representations in neural networks.
method Renormalization group approach to expand representations to encompass broader data sets.
result Representations in neural networks become more abstract as data breadth increases and depth increases.
Study investigates how simple speech sounds can form abstract categories.
problem How do abstract categories like phonemes emerge from speech exposure?
method Used modeling techniques to test Memory-Based Learning and Error-Correction Learning.
result Error-Correction Learning models can learn abstractions, identifying phone inventory and grouping.
Abstract Neural Networks (ANNs) improve DNN verification efficiency.
problem Efficiently verify safety-critical DNNs without slowing exponentially.
method Introduces ANNs that use abstract domains and activation functions to overapproximate DNNs.
result ANNs can soundly overapproximate DNNs with fewer nodes, improving verification efficiency.
Algorithm finds latent structure in value functions for improved reinforcement learning.
problem Finding latent structure in value functions for efficient reinforcement learning.
method Proposes a practical algorithm using two posterior distributions over state abstractions and abstract-state values.
result Substantial performance gains in multi-task settings where tasks share a common, low-dimensional representation.
A distinctive property of human and animal intelligence is the ability to form abstractions by neglecting irrelevant information which allows to separate structure from noise. From an information theoretic point of view abstractions are desirable because they allow for very efficient information processing. In artifici…
New algorithm learns abstractions from experience to simplify complex tasks.
problem Solving complex problems in environments with continuous state spaces.
method Uses MDP homomorphisms to find abstract MDPs and guides exploration.
result Demonstrates task transfer method outperforms deep Q-networks.
Proves embedding theorem for definable manifolds.
problem Embedding abstract-definable Cp manifolds into Euclidean space. method Proves Whitney embedding theorem for definable manifolds.
result Abstract-definable Cp manifolds are Cp embedded into RN. D-ETM models document topics over time using embeddings and variational inference.
problem Capturing evolving topic patterns in sequential documents.
method Combines D-LDA and word embeddings, using random walk priors and variational inference.
result D-ETM outperforms D-LDA on document completion tasks, learning more diverse and coherent topics.
Product Kanerva Machines dynamically combine smaller models for better memory organization.
problem Limited organization in the Kanerva Machine.
method Introducing Product Kanerva Machines that dynamically combine multiple smaller Kanerva Machines.
result Product Kanerva Machines can discover spatial tunings that approximately factorize simple images by object.
Abstraction plays a key role in concept learning and knowledge discovery; this paper is concerned with computational abstraction. In particular, we study the nature of abstraction through a group-theoretic approach, formalizing it as symmetry-driven---as opposed to data-driven---hierarchical clustering. Thus, the resul…
Abstract operator calculus solves fermionic quantum harmonic oscillator problems.
problem Eigenvalue problems of fermionic quantum harmonic oscillators.
method Abstract operator calculus using homotopy operator.
result Formulated eigenvalue problem resembling fermionic quantum harmonic oscillator.
Develops a framework for decision-making abstractions under computational limitations.
problem Decision-making by agents with limited computational resources.
method Information-theoretic signal compression and optimization problem formulation.
result Generates a hierarchy of abstractions for a non-trivial environment.
The paper proposes a principle for dynamically adjusting the granularity of reinforcement learning abstractions.
problem Lack of general principles for dynamically adjusting the granularity of reinforcement learning abstractions.
method The paper proposes a principle based on rate-distortion theory, formalized through a performance certificate decomposing value error into learning and abstraction error bounds.
result Soft state-action abstractions can achieve near-optimal performance under substantial lossy compression of state and action information.
We present PubMed 200k RCT, a new dataset based on PubMed for sequential sentence classification. The dataset consists of approximately 200,000 abstracts of randomized controlled trials, totaling 2.3 million sentences. Each sentence of each abstract is labeled with their role in the abstract using one of the following …
DoPa detects various physical adversarial attacks on CNNs.
problem Vulnerability of CNNs to physical adversarial attacks.
method Interprets CNN's vulnerability, adds self-verification stage.
result Achieves 90% success rate for image attacks and 92% for audio attacks.
New system defends deep neural networks like ResNet-34.
problem Training deep neural networks like ResNet-34 is challenging.
method Differentiable abstract interpretation and a DSL for training objectives.
result Can defend significantly larger networks than before.
Model for directed synthesis of audio textures using multi-scale RNNs.
problem Challenges in modeling complex audio textures with traditional methods.
method Combining multi-scale RNNs with a conditioning strategy for user-directed synthesis.
result Demonstrated improved performance on various audio texture datasets.
This paper simplifies OPE in large state spaces using state abstractions.
problem Accurately evaluating policies offline in large state spaces.
method Developed a backward-model-irrelevance condition and an iterative state abstraction procedure.
result Deeply-abstracted states substantially simplify OPE sample complexity.
CIB compresses variables causally, preserving key causal interactions.
problem Constructing causal variable abstractions in complex systems.
method Causal Information Bottleneck (CIB) method, extending IB to include causal structures.
result CIB produces causally interpretable abstractions that accurately capture causal relations.
Influence functions help study large language model generalization, revealing surprising decay patterns.
problem Understanding and mitigating risks in large language models (LLMs).
method Eigenvalue-corrected Kronecker-Factored Approximation (EK-FAC) to scale influence functions to LLMs.
result Influences decay to near-zero when key phrases order is flipped, revealing a surprising limitation.
Constellation learns group-level visual relationships for abstract reasoning.
problem Learning configurational properties of entire groups of objects.
method Introduces Constellation, a network that learns relational abstractions over static visual scenes.
result Offers a basis for abstract relational reasoning and sensory imagination.
Word embeddings are a powerful approach for analyzing language, and exponential family embeddings (EFE) extend them to other types of data. Here we develop structured exponential family embeddings (S-EFE), a method for discovering embeddings that vary across related groups of data. We study how the word usage of U.S. C…
Abstract discusses different corks.
problem None specified in abstract.
method None specified in abstract.
result None specified in abstract.
Deep neural network learns discrete state abstractions for efficient planning.
problem Efficient sequential decision making in large state spaces.
method Information bottleneck method for learning approximate bisimulations using deep neural encoders and action-conditioned HMM.
result Trained method efficiently plans for unseen goals in multi-goal reinforcement learning.
moment maps arise as a generalization of genuine moment maps on symplectic manifolds when the symplectic structure is discarded, but the relation between the mapping and the action is kept. Particular examples of abstract moment maps had been used in Hamiltonian mechanics for some time, but the abstract notion originat…