Improved RL for 3D games with concurrent actions.
problem Training complex behaviors in 3D games.
method Deep reinforcement learning architecture with concurrent actions.
result 4x improvement in training time and 2.5x in performance.
Google Research Football: A new 3D physics-based game for reinforcement learning.
problem Training reinforcement learning algorithms in complex, realistic environments.
method Developed a new 3D physics-based football simulator environment.
result Reported baseline results for various reinforcement algorithms.
High-throughput 3D control training system achieves 100,000 FPS.
problem Lack of efficient, single-machine reinforcement learning systems.
method Sample Factory combines asynchronous sampling and off-policy correction.
result Achieves 100,000 FPS on 3D control problems without sacrificing sample efficiency.
A number of recent approaches to policy learning in 2D game domains have been successful going directly from raw input images to actions. However when employed in complex 3D environments, they typically suffer from challenges related to partial observability, combinatorial exploration spaces, path planning, and a scarc…
WILD-SCAV benchmarks AI in complex 3D FPS environments.
problem Lack of complexity and diversity in RL environments.
method Developed a 3D open-world FPS game environment.
result Demonstrates effectiveness in benchmarking RL algorithms.
ViZDoom competition tests AI in Doom using only visual input.
problem Creating AI bots that play Doom effectively from raw visual data.
method Multi-player deathmatch in Doom; bots make decisions based on screen buffer.
result Reinforcement learning can produce capable bots but not competitive against humans.
Hypernom is a virtual reality game. The cells of a regular 4D polytope are radially projected to S^3, the sphere in 4D space, then stereographically projected to 3D space where they are viewed in the headset. The orientation of the headset is given by an element of the group SO(3), which is also a space that is double …
Develops game theory framework for UAS integration into NAS.
problem Predicting outcomes of UAS integration into NAS.
method Game theory, reinforcement learning, level-k reasoning.
result Proposes a modeling framework for human pilot behavior.
A new RL method boosts exploration efficiency in Atari games and driving simulators.
problem Efficient exploration in reinforcement learning environments.
method A two-component approach: decaying schedule and upper quantile bonus.
result Significantly outperforms QR-DQN in Atari games and near-optimal safety in CARLA.
PolyGen models 3D meshes directly, predicting vertices and faces sequentially.
problem Efficiently modeling 3D geometry for computer graphics, robotics, and games.
method Transformer-based autoregressive model for predicting mesh vertices and faces.
result PolyGen produces high-quality, usable 3D meshes and competitive conditional performance.
Paper proposes efficient UAV placement for aerial base stations.
problem Efficient placement of UAVs as aerial base stations to serve varying traffic demand.
method Modeling UAV deployment as a non-cooperative game and using a learning-based algorithm to update UAV locations.
result Significant performance gains up to 52% and 74% in terms of throughput and dropped users compared to an optimized baseline algorithm.
Models that can simulate how environments change in response to actions can be used by agents to plan and act efficiently. We improve on previous environment simulators from high-dimensional pixel observations by introducing recurrent neural networks that are able to make temporally and spatially coherent predictions f…
Agents learn to play a first-person multiplayer game at human level performance.
problem Training AI agents for complex, multi-agent, real-time environments.
method Population-based deep reinforcement learning with concurrent training of multiple agents.
result Achieved human-level performance in a first-person multiplayer game.
LeagueAI generates synthetic data for better object detection in video games.
problem Laborious work of gathering large amounts of hand-labeled data for machine vision applications.
method Automatic synthetic dataset generation using game 3D models and background.
result Models trained on synthetic data outperformed those on hand-labeled data in precision and reliability.
Director learns hierarchical behaviors from pixels, outperforming exploration methods.
problem Challenges in learning long-term hierarchical behaviors from pixels.
method Directly learns hierarchical behaviors from pixels using a latent space world model.
result Director outperforms exploration methods on various tasks.
New method describes entanglement of straight lines in 3D space.
problem Tackles the geometry and topology of configurations of straight lines.
method Introduces direction matrices and a discrete motion principle.
result Shows n-crosses as links of pairwise connected unknots.
AppStreamer reduces mobile game storage by predicting needed files.
problem Expanding storage needs of mobile games and apps.
method Predictive streaming of app files from cloud or edge servers.
result Reduces storage by 87% for Dead Effect 2 and 86% for Fire Emblem Heroes.
VaST maps complex environments to simpler models for faster learning.
problem Sample inefficiency in deep reinforcement learning.
method Variational State Tabulation (VaST) and prioritized sweeping planning.
result VaST enables rapid learning and adaptation in complex tasks.
A scalable framework for continual learning that preserves skills while accelerating progress.
problem Learning new tasks sequentially without forgetting previous ones.
method Two-component network: Knowledge base for previously learned tasks and active column for current task.
result The method achieves faster learning on new tasks while retaining previously learned skills.
A method to learn multiple Atari games with a single agent.
problem Balancing multiple tasks in reinforcement learning.
method Adaptive task contribution to learning dynamics.
result Single agent surpasses human performance on 57 Atari games.
Paper proposes a more robust deep reinforcement learning agent.
problem Creating more robust reinforcement learning agents.
method Modified A3C algorithm with dual input streams.
result Significant reduction in training parameters (30%) with improved robustness.
We study knots in 3d Chern-Simons theory with complex gauge group SL(N,C), in the context of its relation with 3d N=2 theory (the so-called 3d-3d correspondence). The defect has either co-dimension 2 or co-dimension 4 inside the 6d (2,0) theory, which is compactified on a 3-manifold M^. …
Study of 3d-3d correspondence involving q-Weyl algebra and 3d-index.
problem Understanding the action of a q-Weyl algebra on the 3d-index of knots. method Investigation of the q-Weyl algebra's module action on the 3d-index, conjecturing structural properties. result Bilinear factorization, pair of linear q-difference equations, and rational function matrix for the 3d-index determination. 3D Adversarial Autoencoder learns compact binary descriptors from 3D point clouds.
problem Learning meaningful representations of 3D shapes for various tasks.
method End-to-end Adversarial Autoencoder model trained on 3D input and output.
result 3D Adversarial Autoencoder (3dAAE) generates state-of-the-art results for 3D points clustering and retrieval.
We explore the use of Evolution Strategies (ES), a class of black box optimization algorithms, as an alternative to popular MDP-based RL techniques such as Q-learning and Policy Gradients. Experiments on MuJoCo and Atari show that ES is a viable solution strategy that scales extremely well with the number of CPUs avail…
Flexible pipeline for 3D vehicle detection from 2D images.
problem Current methods lack 3D perception of vehicles and other objects.
method Adopt any 2D detection network, fuse with 3D point cloud, develop model fitting algorithm, refine with CNN.
result 3D detection results rank second among algorithms, demonstrating competencies.
3D dual field theories for Virasoro minimal models constructed using Seifert fiber spaces.
problem Constructing 3D dual field theories for Virasoro minimal models.
method 3D-3D correspondence and Seifert fiber spaces.
result 3D dual field theories constructed for Virasoro minimal models.
3D flying wings created for any angle asymptotic cones.
problem Creating 3D steady gradient Ricci solitons with any angle asymptotic cones.
method Constructing 3D flying wings for any angle asymptotic cones.
result 3D flying wings constructed for any angle asymptotic cones.
RECODE uses clustering and embedding to track state visitation counts in RL.
problem Efficient novelty-based exploration in nonstationary RL environments.
method Non-parametric clustering, online density estimation, inverse dynamics loss.
result RECODE achieves state-of-the-art performance in challenging RL tasks.
Proposes a new effective central charge for 3d N=2 theories.
problem Understanding the effective central charge in 3d N=2 theories.
method Analyzes the superconformal index to propose a new quantity and discusses its properties and computation.
result Proposes a new effective central charge for 3d N=2 theories.
3D-CNN method visualizes localized geometric features for manufacturability analysis.
problem Interpreting 3D-CNN decisions for complex geometries.
method 3D-CNN with surface normals, 3D-GradCAM for feature visualization.
result Identifies critical local features for manufacturability.
Smooth 3D flows from non-smooth starting points.
problem Creating smooth Ricci flows from non-smooth initial conditions.
method Generalized singular Ricci flow applied to 3D complete manifolds.
result Existence of smooth Ricci flows starting from non-smooth initial conditions.
3D Axial-Attention improves lung nodule classification accuracy.
problem Limited 3D attention in existing methods.
method Proposes 3D Axial-Attention network with 3D positional encoding.
result 3D Axial-Attention achieves state-of-the-art performance.
The paper tackles mapping tori by proposing a new approach to 3d-3d correspondence.
problem No existing approach fully describes 3d N=2 SCFTs for all types of 3-manifolds. method Systematic study of 3d N=2 gauge theories with non-linear matter fields. result Recovery of 3-manifold invariants from T[M3] indices and proposal of new q-series invariants. Novel method REACH-3D reconstructs 3D chromatin structure from HiC data.
problem Understanding the 3D structure of the genome and its temporal behavior.
method Autoencoders with recurrent neural units for manifold learning.
result REACH-3D outperforms existing methods in reconstructing chromatin structure and dynamics.
DreamFusion uses text-to-image diffusion models to create 3D images efficiently.
problem Lack of large-scale 3D datasets and efficient architectures for 3D synthesis.
method Adapting a 2D diffusion model to 3D synthesis using a loss based on probability density distillation.
result A 3D model can be optimized from a 2D diffusion model, allowing for text-to-3D synthesis.
3D steady gradient Ricci solitons are all O(2)-symmetric.
problem Characterizing 3D steady gradient Ricci solitons.
method Analyzing asymptotic behavior and using O(2) symmetry.
result All 3D steady gradient Ricci solitons are O(2)-symmetric.
Proposes a new layer for efficient 3D shape discrimination.
problem Irregular structure and redundancy in 3D point clouds hinder efficient inter-class discrimination.
method Integrates Blended Convolution and Synthesis layer that projects and synthesizes 3D point clouds, followed by 3D convolution in the unit ball.
result End-to-end architecture achieves compelling results on 3D shape recognition and retrieval.
Diffusion models mimic human actions in sequential tasks.
problem Cloning human behavior in dynamic environments is challenging.
method Adapting diffusion models to handle stochastic, multimodal, and correlated actions.
result Diffusion models closely replicate human behavior in robotic and gaming tasks.
By generalizing the measurements on the game experiments of mixed strategy Nash equilibrium, we study the dynamical pattern in a representative dynamic stochastic general equilibrium (DSGE). The DSGE model describes the entanglements of the three variables (output gap [y], inflation [π] and nominal interest rate [$…
Improved 3D scene understanding from partial point sets using multiview fusion.
problem Challenging task of 3D scene semantic understanding from partial point clouds.
method Multiview representation of 360° point clouds and fusion with original data.
result Overall increase of 31.9% and 4.3% in segmentation accuracy for partial and complete scenes.
Visual analogies help transfer knowledge between Atari games.
problem Can visual analogies transfer knowledge between Atari games?
method Created visual analogies between pairs of Atari games and used them to train policies for one game using data from another.
result Visual analogies can be used to transfer knowledge between Atari games.
Paper presents content-based models for game recommendation in cold start scenarios.
problem Cold start problem in game recommendation where new games and players have no historical data.
method Uses survey data to develop content-based interaction models that generalize to new games, players, and both.
result Content models outperform collaborative filtering in predicting new interactions.
DepthNets learns 3D face geometry and transformations without supervision.
problem Learning 3D face geometry and transformations from a single image.
method Unsupervised learning of facial keypoints depth, using backpropable loss for 3D transformations.
result DepthNets can predict 3D transformations and re-target faces to new poses or geometries.
Generative model disentangles 3D shapes into independent factors.
problem Learning rich representations of deformable 3D shapes.
method Supervised 3D mesh-convolutional Variational AutoEncoder with latent feature disentanglement.
result Explicit disentanglement of latent factors improves shape generation and downstream tasks.
3D point cloud attacks examine how neural networks can be fooled.
problem Understanding how 3D neural networks can be exploited by attackers.
method Examined two categories of attacks: distributional and shape attacks.
result Some shape attacks can fool 3D point cloud classification models even after preprocessing.
BYOL-Explore learns to explore visually-rich environments by predicting world dynamics.
problem Exploration in visually complex environments.
method Optimizes a single prediction loss in latent space to learn world representation, dynamics, and exploration policy.
result Achieves superhuman performance on Atari games with simpler design.
Graph Neural Networks improve 3D object detection in LiDAR point clouds.
problem Challenges in processing LiDAR data due to its 3D geometry and massive volume.
method Proposes a Graph Neural Network (GNN) based framework for 3D object detection.
result GNNs successfully identify objects in 3D LiDAR point clouds.