Aims to create a world model without baggage, achieving good performance.
problem Creating world models without baggage and limitations.
method Self-supervised representation learning, frame and action stacking, data augmentation.
result Good performance on the Atari 100k benchmark.
New model learns causal world dynamics from state space models.
problem Lack of causal world models in neural world modeling.
method State Space Models (SSM) with attention mechanisms.
result SSM can learn causal models of environments with equivalent performance.
This work designs an active world model learning system with progress-based curiosity.
problem Learning compact world models from visual exploration.
method Constructs a curious agent in a 3D environment, using γ-Progress as a curiosity signal. result The γ-Progress-driven controller outperforms state-of-the-art exploration strategies. DreamerV2 learns Atari game behaviors from a world model, achieving human-level performance.
problem Learning complex behaviors in Atari games from limited data.
method DreamerV2 uses a world model with discrete representations to predict behaviors in a compact latent space.
result Achieves human-level performance on 55 Atari tasks.
Agents need world models to generalize multi-step tasks.
problem The necessity of world models for flexible, goal-directed behavior.
method Formal analysis and demonstration of the necessity of world models for agents to generalize multi-step tasks.
result World models are necessary for agents to generalize to multi-step goal-directed tasks.
OpenHAIV integrates OOD detection and incremental learning for open-world models.
problem Challenges in open-world recognition, especially in model knowledge updates and OOD detection.
method Unified pipeline combining OOD detection, new class discovery, and incremental fine-tuning.
result Models can autonomously acquire and update knowledge in open-world environments.
Transformer learns long-term dependencies from real-world data.
problem Sample inefficiency in deep reinforcement learning.
method Transformer architecture applied to autoregressive real-world episodes.
result Transformer-based world model generates meaningful experience.
Dreamer 4 learns Minecraft tasks from videos alone.
problem Accurately predicting object interactions in complex environments.
method Reinforcement learning inside a fast, accurate world model.
result Dreamer 4 outperforms previous models in Minecraft, learning from only offline data.
New method accelerates MBRL by 10x for complex quadrotor tasks.
problem Inefficient training of world models in MBRL for complex robotic tasks.
method Parallelized state-space models and privileged information for training.
result Significant speedup in world model and MBRL training times.
Curiosity-Critic improves world model training by focusing on cumulative prediction error.
problem Training world models with intrinsic rewards that consider cumulative prediction error.
method Curiosity-Critic uses a surrogate reward based on the difference between current and asymptotic prediction errors, estimated online by a co-trained critic.
result Curiosity-Critic outperforms other methods in training speed and final world model accuracy.
FOCUS improves offline RL by incorporating causal structure into world-models.
problem Learning effective policies from historical data without interaction.
method FOCUS proposes a practical algorithm that learns and leverages causal structure in offline RL.
result FOCUS outperforms plain model-based offline RL algorithms and other causal model-based RL algorithms.
Unified model improves object-centric world modeling with new abilities.
problem Integration of recent advances and temporal imagination abilities.
method Generative Structured World Models (G-SWM) framework.
result G-SWM achieves best or comparable performance in temporal generation.
New model detects crying in real-world settings with improved accuracy.
problem Generalization of cry detection models to real-world environments.
method Evaluated machine learning approaches on a novel dataset of real-world infant crying.
result Improved F1 score of 0.613 for crying event recognition in real-world settings.
We explore building generative neural network models of popular reinforcement learning environments. Our world model can be trained quickly in an unsupervised manner to learn a compressed spatial and temporal representation of the environment. By using features extracted from the world model as inputs to an agent, we c…
Unified definition of hallucinations in language models.
problem Persistent hallucinations despite mitigation efforts.
method Unified definition of hallucination as inaccurate world modeling.
result Unified framework distinguishes hallucinations from other errors.
ReCoRe learns invariant features for world navigation using contrastive learning and regularizers.
problem Limited sample efficiency and overfitting to training scenarios in RL for visual navigation.
method Contrastive unsupervised learning and intervention-invariant regularizer.
result Significantly improves sample efficiency and generalization in out-of-distribution point navigation tasks.
This paper evaluates knowledge graph completion models under the open-world assumption, revealing unexpected behavior of metrics.
problem Evaluation of knowledge graph completion models often assumes a closed-world assumption, which can lead to misleading results.
method The paper studies KGC evaluation under the open-world assumption, analyzing the behavior of metrics like MRR and Hits@K.
result Metrics like MRR and Hits@K can show significant degradation under the open-world assumption, leading to incorrect model comparisons.
Paper tackles continual reinforcement learning by forgetting, proposing a planning method with online world models.
problem Catastrophic forgetting in reinforcement learning when learning new tasks.
method Planning with an online world model using model predictive control.
result The proposed FTL Online Agent (OA) learns new tasks without forgetting old skills.
WMPG reduces policy gradient variance using world models.
problem Reducing variance in policy gradient estimates.
method Trains a world model online to estimate policy gradients and uses imagined trajectories as a baseline.
result WMPG achieves better sample efficiency compared to AC and MAC.
LeJEPA learns latent variables from nonlinear observations.
problem Learning latent variables from nonlinear observations.
method Proves linear identifiability of Gaussian latent distributions.
result Gaussian distribution uniquely guarantees linear identifiability.
A new RL algorithm POWR learns world models to estimate action-values.
problem Inaccessibility of explicit action-value functions in RL.
method Learning a world model using conditional mean embeddings and deriving action-value function via matrix operations.
result POWR algorithm converges to global optimum with proven rates.
SPARTAN learns sparse interaction graphs between objects in scenes.
problem Capturing structured interactions between entities in complex settings remains challenging.
method SPARTAN is a Transformer-based world model that learns sparse, context-dependent interaction graphs through sparsity regularization on attention patterns.
result SPARTAN achieves significantly improved few-shot adaptation to dynamics changes and robustness against distractors.
Improved tabular models learn better from real-world data.
problem Tabular models perform poorly on real-world datasets when trained only on synthetic data.
method Continued pre-training on a curated set of real-world datasets.
result Real-TabPFN achieves superior predictive accuracy on 29 datasets.
The SIR model and machine learning predict pandemic inflection and end times.
problem Forecasting the end of the COVID-19 pandemic.
method SIR model and machine learning techniques.
result Predicted end times for various countries.
As humans we are driven by a strong desire for seeking novelty in our world. Also upon observing a novel pattern we are capable of refining our understanding of the world based on the new information---humans can discover their world. The outstanding ability of the human mind for discovery has led to many breakthroughs…
A new neural network model improves reinforcement learning efficiency.
problem Improving sample efficiency in reinforcement learning.
method Proposes a neural network architecture using VQ-VAE and convolutional LSTM for world modeling.
result Shows comparable performance to SimPLe with significantly smaller model.
Some of the most important tasks take place in environments which lack cheap and perfect simulators, thus hampering the application of model-free reinforcement learning (RL). While model-based RL aims to learn a dynamics model, in a more general case the learner does not know a priori what the action space is. Here we …
Paper presents a world model that learns invariant causal features using contrastive unsupervised learning.
problem Learning invariant causal features in unsupervised settings.
method Contrastive unsupervised learning with intervention invariant auxiliary task.
result Significantly outperforms state-of-the-art methods on out-of-distribution point navigation tasks.
A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into compact and simple policies trained by evolution, achieving state of the art resul…
HalluWorld benchmarks hallucinations in language models across diverse tasks.
problem Inconsistent benchmarks of hallucination in language models.
method Explicit reference-world formulation, synthetic and semi-synthetic environments, controlled variation of world complexity.
result Models struggle with perceptual hallucination but not multi-step state tracking.
Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take significant time. In this paper, we focus on learning a realistic world model capturi…
Empirical model tackles decision problems without specifying states of the world.
problem Decision problems under uncertainty with inaccessible states of the world.
method Empirical approach using observed act--consequence pairs as model primitives.
result Optimality in empirical decision problems addressed using protocol-based empirical choice functions.
This work improves AI's ability to solve physical tasks by optimizing world models in abstracted spaces.
problem Developing AI agents capable of solving diverse physical tasks and generalizing to new environments.
method Investigates and optimizes a family of joint-embedding predictive world models (JEPA-WMs) for efficient planning in abstracted spaces.
result Proposes a model that outperforms two established baselines in both navigation and manipulation tasks.
This work studies reinforcement learning in the Sim-to-Real setting, in which an agent is first trained on a number of simulators before being deployed in the real world, with the aim of decreasing the real-world sample complexity requirement. Using a dynamic model known as a rich observation Markov decision process (R…
In the Minkowski space-time, a world hyper-sheet is a timelike hypersurface consisting of a one-parameter family of spacelike submanifolds. Recently, Bousso and Randall introduced the notion of caustics of world hyper-sheets in order to define the notion of holographic domains in space-time. Here, we give a mathematica…
Develops a binary tree model for option pricing with skew dynamics.
problem Option pricing in incomplete markets with skew dynamics.
method Binary tree model with skew Brownian motion dynamics.
result Model preserves skewness under both discrete and continuous time limits.
Symbolic grounding in causal dynamics achieves near-infinite temporal consistency.
problem Achieving linear identifiability in non-Gaussian physical systems.
method Physics-Grounded Symbolic Architecture (PGSA)
result PGSA achieves exact linear identifiability for all physical regimes.
GPT learns a causal world model from token predictions, validated in game sequences.
problem Does GPT implicitly learn a causal world model from token predictions?
method Derived a causal interpretation of GPT's attention mechanism and proposed zero-shot causal structure learning.
result GPT can generate legal next moves with high confidence for sequences with encoded causal structures, but fails for illegal moves.
This study applies EMD to MSCI World index and converts IMFs into graphs for GNN modeling.
problem Modeling financial time series with GNNs.
method EMD, CEEMDAN, graph transformations (natural visibility, horizontal visibility, recurrence, transition graphs), topological analysis.
result High-frequency IMFs yield dense, highly connected small-world graphs; low-frequency IMFs produce sparser networks.
Unified framework models multiple financial and insurance term structures.
problem Modeling multiple term structures in various markets.
method Extended Heath-Jarrow-Morton (HJM) approach under real-world probability.
result Characterization of local martingale deflators and existence of affine realizations.
Study compares Interval Regression models and their performance.
problem Regression models struggle with interval target values.
method Comprehensive review and comparative analysis of existing Interval Regression models.
result No single model is universally optimal for all scenarios.
A structured understanding of our world in terms of objects, relations, and hierarchies is an important component of human cognition. Learning such a structured world model from raw sensory data remains a challenge. As a step towards this goal, we introduce Contrastively-trained Structured World Models (C-SWMs). C-SWMs…
We propose a probabilistic model to aggregate the answers of respondents answering multiple-choice questions. The model does not assume that everyone has access to the same information, and so does not assume that the consensus answer is correct. Instead, it infers the most probable world state, even if only a minority…
In this paper, we investigate the statistical features of the weighted international-trade network. By finding the maximum weight spanning trees for this network we make the extraction of the truly relevant connections forming the network's backbone. We discuss the role of large-sized countries (strongest economies) in…
GANs can learn hierarchical distributions in real-world images efficiently.
problem Understanding and efficiently learning complex, real-world distributions with GANs.
method Formally studying how GANs can learn hierarchically generated distributions close to real-life image distributions using SGDA.
result Training GANs via SGDA can efficiently learn distributions with a 'forward super-resolution' structure, both in sample and time complexities.
The paper provides guidelines for choosing between SBI methods in complex biological models.
problem Choosing appropriate SBI methods for real-world biological data.
method Comprehensive guidelines and application to agent-based models.
result Statistical SBI methods outperform neural SBI methods with sufficient computational resources.
Study finds real-world datasets contain natural experiments that can improve model performance.
problem Detecting natural experiments in real-world datasets for causal inference.
method Synthetic graph simulation and feature selection based on causal links.
result Real-world datasets contain natural experiments that can be exploited for improved model performance.
Benchmark tests LLMs on discovering physics laws in unconventional worlds.
problem Difficulties in distinguishing genuine reasoning from recall in LLMs across physics evaluations.
method Interactive benchmark with 22 worlds governed by various unconventional physics laws, requiring agents to design experiments and revise hypotheses.
result Strongest agents fail on worlds requiring latent structure discovery, highlighting limitations in long-term reasoning.