Abstraction is a fundamental part when learning behavioral models of systems. Usually the process of abstraction is manually defined by domain experts. This paper presents a method to perform automatic abstraction for network protocols. In particular a weakly supervised clustering algorithm is used to build an abstract…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “behavioral abstractions”
A method uses RL to learn abstractions for planning, improving robot navigation and manipulation tasks.
problem Planning requires suitable abstractions for states and transitions, which RL struggles with for temporally extended tasks.
method Goal-conditioned policies learned with RL are incorporated into planning, with a latent variable model representing valid states.
result Our method significantly outperforms prior work on image-based robot navigation and manipulation tasks.
Enhances BO with expert preferences about abstract properties.
problem Lack of expert knowledge in BO for black-box experimental design.
method Human-AI collaboration to incorporate expert preferences into surrogate modeling.
result Superior performance compared to baselines in synthetic and real-world datasets.
Abstract Neural Networks (ANNs) improve DNN verification efficiency.
problem Efficiently verify safety-critical DNNs without slowing exponentially.
method Introduces ANNs that use abstract domains and activation functions to overapproximate DNNs.
result ANNs can soundly overapproximate DNNs with fewer nodes, improving verification efficiency.
Algorithm finds latent structure in value functions for improved reinforcement learning.
problem Finding latent structure in value functions for efficient reinforcement learning.
method Proposes a practical algorithm using two posterior distributions over state abstractions and abstract-state values.
result Substantial performance gains in multi-task settings where tasks share a common, low-dimensional representation.
A new algorithm discovers useful reinforcement learning options by focusing on termination compressibility.
problem Discovering useful reinforcement learning options.
method Proposes an algorithm that focuses on the termination condition, using a critic to learn the option transition model and optimize compressibility.
result The resulting options are non-trivial, meaningful, and useful for learning and planning.
The paper proposes a method to transfer knowledge across different settings using causal theory.
problem Learning transfer across similar but different settings.
method Bayesian perspective of causal theory induction, integrating instance-level associative learning and abstract-level structural causal knowledge.
result The proposed model achieved transfer behavior across trials and learning situations, unlike RL algorithms.
Paper uses social norms to teach robots human behavior.
problem Teaching robots to behave like humans in society.
method Captured social norms guide reinforcement learning towards normative behavior.
result Robots can learn normative behavior through automatic norm reward system.
Novel neural computer learns algorithmic solutions for symbolic tasks.
problem Learning abstract strategies for unfamiliar problems.
method Memory-augmented neural network architecture with Evolution Strategies.
result Strong generalization and abstraction across various tasks.
A mathematical theory for understanding when abstract representations emerge in neural networksq-bio.NC
Math theory explains how neural networks learn abstract representations.
problem Understanding how neural networks learn abstract representations.
method Mathematical theory reformulating network optimization into mean field optimization over neural preactivations.
result Abstract representations of latent variables are guaranteed to appear in neural networks trained on tasks that depend on these variables.
This work abstracts deep neural networks into concept graphs for better interpretability in medical tasks.
problem Lack of interpretability in deep learning models, especially in medical domains.
method Developed a graphical representation of medical image processing models to understand concept-based reasoning.
result Extracted a concept-level graph that reveals the decision-making process of deep learning models.
A new method shapes reinforcement learning environments by abstracting large state spaces.
problem Learning in large, noisy environments with sparse feedback.
method Environment shaping using state abstraction.
result Agent's policy in shaped environment preserves near-optimal behavior in original environment.
Describes explaining neurons in deep representations using compositional logical concepts.
problem Interpreting neuron behavior in deep neural networks.
method Identifying compositional logical concepts that closely approximate neuron behavior.
result Compositional explanations provide insights into model performance and allow for adversarial example creation.
Language helps RL agents learn complex tasks by composing sub-skills.
problem Solving complex, temporally-extended tasks in RL.
method Using language as an abstraction to learn and reuse sub-skills.
result Agents can learn and solve diverse, temporally-extended tasks.
Framework detects novel inputs in neural networks by monitoring hidden layers.
problem Novel inputs not classified by neural networks during training.
method Abstraction-based monitoring of hidden layers using 'boxes' to identify novel behaviors.
result Framework efficiently detects novel inputs with a balance between false warnings and true positives.
Abstract perspective on quadratic programming for optimal portfolio allocation.
problem Optimal allocation problems in long portfolio theory.
method Using maximum principles and distinguished boundaries in reproducing kernel Hilbert spaces.
result Support of an optimal distribution lies in a variety intersecting a distinguished boundary.
New probabilistic approach to neural network robustness.
problem Challenges in verifying neural network robustness.
method Probabilistic robustness approach, abstract interpretation, importance sampling.
result Practical algorithm for checking probabilistic robustness of neural networks.
HHAR-net uses neural networks to recognize human activities at different levels of abstraction.
problem Recognizing different layers of human activities concealed in behavior.
method Hierarchical classification with Neural Networks.
result 95.8% accuracy for low-level activities and 92.8% overall accuracy.
The method approximates stationary distributions of Markov models by truncating irrelevant states.
problem Computing the stationary distribution of complex Markov models is computationally challenging.
method A state-space lumping scheme that aggregates states in a grid structure, iteratively refining the state-space.
result The method provides a well-justified finite-state projection tailored to the stationary behavior of Markov models.
A new method learns object hierarchies from images to reason about physical interactions.
problem Learning about the interactions of complex objects and their dynamics.
method Unsupervised learning of object hierarchies from raw visual images.
result Improves over a strong baseline at modeling synthetic and real-world videos.
RecSim creates customizable simulation environments for RSs.
problem Creating realistic simulation environments for RSs.
method Configurable platform for authoring simulation environments.
result Enables pushing the limits of RL and RS techniques.
ART trains neural nets to be both accurate and safe.
problem Ensuring neural nets are both accurate and safe during training.
method Integrates an optimization-based abstraction refinement loop into the learning process.
result Enables training provably correct networks with respect to safety properties.
Neural networks improve scalability for agent-based modeling demonstrations.
problem Scalability issues in training models of dynamic systems from demonstrations.
method Use of neural networks to reduce the search space for agent-level parameters.
result More scalable architecture for reproducing emergent behavior from demonstrations.
Investigates optimal strategies for behavioral control problems with finite variation controls.
problem Behavioral singular stochastic control problems with finite variation controls.
method Abstract framework, applied to storage management and portfolio investment problems, using CPT preferences and Skorokhod representation theorem.
result Existence of optimal strategies for various goal functionals, including CPT preferences.
Interprets how intrinsic motivation shapes behavior in RL agents.
problem Understanding how intrinsic motivation influences behavior in reinforcement learning agents.
method Analyzed five RL agents in procedurally generated environments using various interpretability techniques.
result Curiosity-driven agents exhibit broader and more dynamic attention than extrinsically motivated agents.
Abstract result on correlations of pairs in exponentially growing discrete subsets.
problem Pair correlations in exponentially growing discrete subsets with weight functions.
method Proved abstract result on correlations of pairs of elements in an exponentially growing discrete subset with a weight function.
result Distribution function of unscaled differences is , and pair correlation exhibits Poissonian behavior under certain conditions.
Abstracts index for ML4H workshop at NeurIPS 2019.
problem No specific problem stated; index of accepted abstracts.
method Not specified; index of accepted abstracts.
result No specific result stated.
New methods predict language model out-of-distribution behaviors using causal mechanisms.
problem Predicting how language models behave on unseen data.
method Two methods: counterfactual simulation and value probing.
result Both methods achieve high AUC-ROC and outperform causal-agnostic approaches in out-of-distribution settings.
The paper aims to mathematically define and learn abstractions from data.
problem Defining and learning abstractions from data.
method Characterize abstractions as summaries for answering queries, define leakiness as a loss function, and generalize classical statistics.
result A mathematical theory of abstraction can be learned from data.
Unified framework for causal models at different levels of abstraction.
problem Relating causal models at varying levels of abstraction.
method Categorical framework using natural transformations between Markov functors.
result Generalized and unified causal abstractions with categorical proofs.
Abstract MDPs enable strategic exploration and fast reward transfer in complex environments.
problem Challenging to learn accurate MDPs for high-dimensional states.
method Learn an abstract MDP over low-dimensional coarse states, using an abstraction function.
result Achieves superhuman performance on Pitfall! and higher reward with fewer samples.
Improved scalability and interpretability in training data attribution.
problem Identifying which training data drives specific behaviors, especially unintended ones.
method Leveraging interpretable structures within the model to attribute model behavior to semantic directions, not individual test examples.
result Simple probe-based attribution methods are first-order approximations of Concept Influence that achieve comparable performance while being over an order-of-magnitude faster.
Proves efficient learning of hierarchical structure in meta-reinforcement learning.
problem Lack of provable guarantees for learning hierarchical structures in reinforcement learning.
method Analyzed HRL in meta-RL setting with tabular transition dynamics, providing diversity conditions and regret bounds.
result Sample-efficient recovery of natural hierarchical structure with provable guarantees.
Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcs.LG
Learning goal-directed behavior in environments with sparse feedback is a major challenge for reinforcement learning algorithms. The primary difficulty arises due to insufficient exploration, resulting in an agent being unable to learn robust value functions. Intrinsically motivated agents can explore new behavior for …
PALM learns abstract models for efficient planning and task transfer.
problem Efficiently learning and transferring hierarchical models for planning.
method PALM uses a new formal structure (L-AMDP) to learn independent, modular models at multiple levels of abstraction.
result PALM integrates planning and execution, facilitating rapid learning of abstract models.
In the age of globalization, it is natural that the stock market of each country is not independent form the other markets. In this case, collective behavior could be emerged form their dependency together. This article studies the collective behavior of a set of forty influential markets in the world economy with the …
Tabular Q-Learning with learned state abstractions solves continuous control tasks.
problem Challenging reinforcement learning problems in continuous control.
method Learned state abstraction to transform continuous state-space into discrete.
result Tabular Q-Learning with learned abstractions achieves efficient learning in unseen tasks.
New approach to abstract neural network representations using renormalization group.
problem Developing truly abstract representations in neural networks.
method Renormalization group approach to expand representations to encompass broader data sets.
result Representations in neural networks become more abstract as data breadth increases and depth increases.
Study investigates how simple speech sounds can form abstract categories.
problem How do abstract categories like phonemes emerge from speech exposure?
method Used modeling techniques to test Memory-Based Learning and Error-Correction Learning.
result Error-Correction Learning models can learn abstractions, identifying phone inventory and grouping.
A distinctive property of human and animal intelligence is the ability to form abstractions by neglecting irrelevant information which allows to separate structure from noise. From an information theoretic point of view abstractions are desirable because they allow for very efficient information processing. In artifici…
Proves embedding theorem for definable manifolds.
problem Embedding abstract-definable manifolds into Euclidean space.
method Proves Whitney embedding theorem for definable manifolds.
result Abstract-definable manifolds are embedded into .
A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clusteringcs.LG
Abstraction plays a key role in concept learning and knowledge discovery; this paper is concerned with computational abstraction. In particular, we study the nature of abstraction through a group-theoretic approach, formalizing it as symmetry-driven---as opposed to data-driven---hierarchical clustering. Thus, the resul…
Abstract operator calculus solves fermionic quantum harmonic oscillator problems.
problem Eigenvalue problems of fermionic quantum harmonic oscillators.
method Abstract operator calculus using homotopy operator.
result Formulated eigenvalue problem resembling fermionic quantum harmonic oscillator.
Statistical and Multifractal Properties of the Time Series Generated by a Modified Minority Gamephysics.soc-ph
In this paper it was developed a modification of the known multiagent model Minority Game, designed to simulate the behavior of traders in financial markets and the resulting price dynamics on the abstract resource. The model was implemented in the form of software. The modified version of Minority Game was investigate…
Develops a framework for decision-making abstractions under computational limitations.
problem Decision-making by agents with limited computational resources.
method Information-theoretic signal compression and optimization problem formulation.
result Generates a hierarchy of abstractions for a non-trivial environment.
The paper proposes a principle for dynamically adjusting the granularity of reinforcement learning abstractions.
problem Lack of general principles for dynamically adjusting the granularity of reinforcement learning abstractions.
method The paper proposes a principle based on rate-distortion theory, formalized through a performance certificate decomposing value error into learning and abstraction error bounds.
result Soft state-action abstractions can achieve near-optimal performance under substantial lossy compression of state and action information.
We present PubMed 200k RCT, a new dataset based on PubMed for sequential sentence classification. The dataset consists of approximately 200,000 abstracts of randomized controlled trials, totaling 2.3 million sentences. Each sentence of each abstract is labeled with their role in the abstract using one of the following …
The paper proposes an algorithm to learn causal state representations for partially observable environments.
problem Learning task-agnostic state abstractions in partially observable environments.
method The approach involves learning approximate causal state representations from RNNs trained to predict observations given the history.
result The learned state representations are useful for efficient policy learning in reinforcement learning problems with rich observation spaces.