Enhances speech recognition in new environments by embedding noise and scaling training data.
problem Improving speech recognition in unseen noisy environments.
method Embedding noise from unseen environments and scaling training data to 16,784 environments.
result Reduced word error rate from 34.04% to 15.46% on enhanced speech.
Paper tackles efficient exploration of unseen graph-structured environments.
problem Efficient exploration of unseen graph-structured environments.
method Learning to explore framework using reinforcement learning and graph-structured memory.
result Approach outperforms hand-engineered methods in software testing and real-world applications.
Paper shows regularization improves robustness in domain generalization.
problem Improving robustness in domain generalization.
method Derives novel theoretical analysis to control representation smoothness and proposes a regularization method.
result Regularization improves robustness in domain generalization.
Algorithm improves continuous control with context, achieving provable efficiency.
problem Building an agent that generalizes to unseen environments in continuous control.
method Uses upper confidence bound (UCB) to refine decoder estimates and balance exploration-exploitation.
result Proves $\widetilde{O}\left(\sqrt{T}
ight)$ regret bound and ε-suboptimal policy transfer. New model-based methods adapt pre-trained policies to unseen environments efficiently.
problem High sample complexity in reinforcement learning limits practical applications.
method Combines online learning and adaptive control to adapt policies in unseen environments.
result Proves policies can quickly recover trajectories from source to target environments.
LEAPS uses semantic models to improve reinforcement learning in diverse environments.
problem Generalizing and adapting to unseen environments in reinforcement learning.
method Hybrid model-based and model-free approach with a multi-target sub-policy and a Bayesian semantic model.
result LEAPS outperforms baselines in visual navigation tasks using diverse indoor scenes.
In this work we present a technique to use natural language to help reinforcement learning generalize to unseen environments. This technique uses neural machine translation, specifically the use of encoder-decoder networks, to learn associations between natural language behavior descriptions and state-action informatio…
New method improves RL/IL agents' adaptability to unseen environments.
problem Current RL/IL techniques struggle with generalizing to unseen environments.
method Zero-shot compositional policy learning with multi-modal fusion and attention mechanism.
result Language grounding enhances generalization across varied environments.
Mixreg improves RL generalization by mixing diverse training environments.
problem Overfitting in RL agents trained in limited environments.
method Trains on a mixture of diverse observations and imposes linearity constraints.
result Mixreg outperforms baselines on unseen testing environments.
ICIL learns policies invariant to multiple environments, improving generalization.
problem Learning policies from multiple environments leads to spurious correlations.
method ICIL learns invariant feature representations and a matching imitation policy.
result ICIL policies generalize better to unseen environments.
New algorithms improve multi-task learning across different environments.
problem Learning across multiple tasks and adapting to unseen environments.
method Learning common representations, dynamic feature weighting via attention mechanism.
result Significant performance improvement on new environments, 1.5x faster.
RL agents fail to generalize to unseen environments, even when dynamics are similar.
problem RL agents fail to generalize to unseen environments despite similar dynamics.
method Analyzed policy learning in POMDPs, formalized training dynamics as instances, and introduced a shared belief representation over an ensemble of specialized policies.
result Maximizing rewards induces instance-specific policies that are suboptimal on the training set.
Deep RL strategies outperform traditional methods in cryptocurrency trading.
problem Designing profitable trading strategies for cryptocurrency markets.
method Applied Proximal Policy Optimization, Soft Actor-Critic, and Generative Adversarial Imitation Learning to a Gym environment based on cryptocurrency markets.
result Highest gain of 4850 US dollars per 10000 US dollars investment on unseen data.
New method ISR improves domain generalization with provable guarantees.
problem Achieving reliable performance across unseen environments.
method Invariant-feature Subspace Recovery (ISR) algorithms.
result ISR can achieve provable domain generalization with fewer training environments.
Improves deep RL agents' generalization to unseen environments.
problem Deep RL agents struggle to adapt to new environments.
method Information Bottleneck regularization and annealing-based optimization.
result Agents can generalize to test parameters more than 10 standard deviations away from training.
New symmetries improve meta-reinforcement learning's generalization.
problem Black-box meta reinforcement learning struggles with generalization.
method Introduce symmetries to a black-box meta RL system.
result Incorporating symmetries improves generalization to new environments.
Paper introduces effect-invariance for better policy generalization.
problem Adapting policies to unseen environments efficiently.
method Introduces effect-invariance, a relaxation of full invariance, and develops testing procedures to test e-invariance directly from data.
result Effect-invariance enables zero-shot and few-shot policy generalization without assuming a causal graph.
New algorithms identify invariant features for domain generalization.
problem Achieving robust models across unseen environments.
method Invariant-Feature Subspace Recovery (ISR) algorithms.
result ISR algorithms achieve provable domain generalization with fewer training environments.
Researchers use DT to transfer policies from one environment to another using causal reasoning.
problem Adapting to changes in environmental dynamics in reinforcement learning.
method Applying causal counterfactual reasoning to Decision Transformer (DT) architecture for policy transfer.
result DT successfully transfers a learned policy to new environments while retaining most of the reward.
New method learns robust representations by modeling environment variation.
problem Learning invariant representations across varying environments.
method Explicitly modeling variation across environments and marginalizing it out.
result Proposed method outperforms invariant-learning methods in various settings.
LEXA learns to discover and achieve goals in unseen environments.
problem Learning to solve diverse tasks in complex visual environments without supervision.
method LEXA learns a world model from image inputs and uses it to train an explorer and an achiever policy from imagined rollouts.
result LEXA solves tasks specified as goal images zero-shot without additional learning.
Relational Structural Causal Models enable causal reasoning about unseen object combinations.
problem Developing a model that can reason about causal and combinatorial aspects of unseen object combinations.
method Relational Structural Causal Models extend structural causal models to include relational variables and define identification criteria.
result Proposed relational neural causal models outperform non-relational baselines on simulated traffic scenes.
The success of automated driving deployment is highly depending on the ability to develop an efficient and safe driving policy. The problem is well formulated under the framework of optimal control as a cost optimization problem. Model based solutions using traditional planning are efficient, but require the knowledge …
Improved acoustic scene classification with factorized CNN.
problem Acoustic scene classification in varying environments.
method Large-margin factorized CNN with triplet loss.
result Improved performance and better generalization on unseen data.
Improves speech recognition in noisy environments using robust acoustic models.
problem Adverse environments with significant mismatch between training and test conditions.
method Theoretical analysis of data augmentation as vicinal risk minimization, using mixture of Gaussians to incorporate robust inductive bias.
result Waveform-based approach shows 150% relative improvement in out-of-distribution generalization.
New method uses unlabeled data to improve model robustness across different environments.
problem Learning robust models for new, unseen environments when labeled data are scarce.
method Regularizes model sensitivity to perturbations in covariate means and covariances without requiring labels.
result Empirically validated on physical and physiological datasets, demonstrating improved robustness.
New algorithm guarantees domain generalization with few environments.
problem Performing well on unseen environments with limited training data.
method Iterative feature matching algorithm with theoretical guarantees.
result Guaranteed domain generalization with logarithmic environments.
Modular method predicts motion in crowded scenes using learned environment models.
problem Predicting motion in dynamic, crowded environments.
method Modular model of spatial and dynamic aspects, unsupervised adaptation to new tasks.
result Comparable performance to state-of-the-art, transferable across tasks.
MAOP learns object dynamics from raw visual data.
problem Efficient learning of dynamics from raw visual data for multiple objects.
method Three-level learning architecture with spatial-temporal relational reasoning.
result Significantly outperforms previous methods in sample efficiency and generalization.
This paper introduces CENIE to quantify environment novelty for better UED.
problem Challenges in measuring environment novelty for effective UED.
method CENIE framework using state-action space coverage and Gaussian Mixture Models.
result CENIE improves UED performance across multiple benchmarks.
Robotic grasping system learns to target objects from a single image.
problem Robotic grasping in unstructured environments.
method Distributed reinforcement learning, active vision, synchronous SGD.
result System learns to grasp unseen objects without retraining.
GIB improves neural network generalization by dynamically selecting task-relevant features across different sequential environments.
problem Poor generalization of deep neural networks to unseen environments.
method Proposes a gated information bottleneck (GIB) approach that dynamically drops spurious correlations and selects task-relevant features.
result GIB outperforms other IB approaches in adversarial robustness and OOD detection.
The paper investigates how to ensure safety-critical reinforcement learning agents perform well in novel situations.
problem Ensuring safety-critical reinforcement learning agents perform well in unseen test environments.
method Investigates safety and generalization from a limited number of training environments, using gridworld and CoinRun settings.
result Simple modifications like ensemble model averaging and blocking classifier can reduce catastrophes in gridworld, but not in CoinRun.
Effective implementations of sampling-based probabilistic inference often require manually constructed, model-specific proposals. Inspired by recent progresses in meta-learning for training learning agents that can generalize to unseen environments, we propose a meta-learning approach to building effective and generali…
SUMER updates deployed models with new data, improving performance.
problem Updating deployed machine learning models with new data is difficult.
method SUMER uses semi-supervised learning and noise remediation to iteratively retrain models.
result SUMER improves model performance, especially with limited initial training data.
CARL controls a quadruped to move naturally in complex environments.
problem Motion synthesis in dynamic environments with complex constraints.
method CARL uses GANs to adapt high-level controls to action distributions and deep reinforcement learning for dynamic recovery.
result CARL can be controlled with high-level directives and react naturally to dynamic environments.
Proposes learning task-agnostic dynamics priors for faster RL.
problem Challenges in learning accurate dynamics models for RL.
method Pre-training a frame predictor on physics videos to initialize and fine-tune dynamics models.
result Improves policy learning and convergence, outperforming competitors.
New framework improves model robustness by focusing on stable relations across environments.
problem Standard supervised learning fails under data distribution shift.
method Gradient-based learning framework derived from the principle of independent causal mechanisms (ICM).
result Models generalize well to unseen scenarios, ignoring unstable relations.
Meta-learning adapts models for unseen tasks across AI, robotics, and NLP.
problem Adapting models to unseen tasks efficiently and accurately.
method Black-box, metric-based, layered, and Bayesian approaches.
result Meta-learning enhances model generalization and adaptation to unseen tasks.
Fast and efficient motion planning algorithms are crucial for many state-of-the-art robotics applications such as self-driving cars. Existing motion planning methods become ineffective as their computational complexity increases exponentially with the dimensionality of the motion planning problem. To address this issue…
MaxRM uses random forests to minimize maximum risk across different environments.
problem Designing methods that generalize better to test environments with different distributions.
method Introducing variants of random forests based on the principle of MaxRM (Maximum Risk Minimization).
result Proved statistical consistency for the proposed method and provided an out-of-sample guarantee for MaxRM with regret.
The paper explores how agents can generalize to new environments with unseen variables.
problem Generalizing to new environments with unseen variables.
method Investigates and proposes a method for efficient re-use of past marginal information to achieve out-of-variable generalization.
result The residual distribution after fitting a classifier reveals partial derivatives of the true generating function with respect to unobserved causal parents.
In this paper, we train a recurrent neural network to learn dynamics of a chaotic road environment and to project the future of the environment on an image. Future projection can be used to anticipate an unseen environment for example, in autonomous driving. Road environment is highly dynamic and complex due to the int…
VNLA uses vision and language to guide agents in finding objects in indoor environments.
problem Guiding agents in finding objects in indoor environments via language.
method Developed I3L framework for imitation learning with indirect intervention.
result Significantly improved success rate of learning agents over baselines.
Paper tackles zero-shot policy learning for agents in new environments.
problem Learning in one environment and generalizing to unseen environments without additional data.
method Decomposes sparse rewards into spatial-temporal regions and uses Model Predictive Control (MPC).
result Method achieves natural generalization to new environments, demonstrated on various tasks.
An important property for lifelong-learning agents is the ability to combine existing skills to solve unseen tasks. In general, however, it is unclear how to compose skills in a principled way. We provide a "recipe" for optimal value function composition in entropy-regularised reinforcement learning (RL) and then exten…
Meta-learning improves drone trajectory design for dynamic wireless networks.
problem Designing optimal trajectories for energy-constrained drones in dynamic network environments.
method Proposes a meta-learning algorithm to adaptively tune a reinforcement learning solution for trajectory design.
result Meta-tuned RL yields faster convergence and improved communication performance compared to baseline algorithms.
In many real-world scenarios, rewards extrinsic to the agent are extremely sparse, or absent altogether. In such cases, curiosity can serve as an intrinsic reward signal to enable the agent to explore its environment and learn skills that might be useful later in its life. We formulate curiosity as the error in an agen…