Paper proposes DEMER to reconstruct hidden confounders for better reinforcement learning in recommendation.
problem Reinforcement learning in real-world applications is costly due to exploration in the environment.
method DEMER uses a multi-agent generative adversarial imitation learning framework to learn the environment and hidden confounder.
result DEMER effectively reconstructs hidden confounders and improves recommendation policy performance.
Autoencoder neural networks reconstruct missing indoor environment data.
problem Missing data in building operation data sets.
method Three different autoencoder neural networks trained to reconstruct missing data.
result Reconstructing variables with average RMSEs of 0.42 °C, 1.30 % and 78.41 ppm.
MLPF uses graph neural networks to improve particle-flow reconstruction in high-pileup conditions.
problem Improving particle-flow reconstruction in high-pileup conditions at high-luminosity LHC.
method End-to-end trainable machine-learned particle-flow algorithm based on graph neural networks.
result MLPF improves physics response and demonstrates scalable reconstruction in high-pileup environments.
Novel path planning improves UAV detection of extreme anomalies.
problem Improper criteria for UAV anomaly detection.
method Mathematical criteria guiding UAV towards strong anomalies.
result Proposed approach outperforms traditional methods in various applications.
Model based predictions of future trajectories of a dynamical system often suffer from inaccuracies, forcing model based control algorithms to re-plan often, thus being computationally expensive, suboptimal and not reliable. In this work, we propose a model agnostic method for estimating the uncertainty of a model?s pr…
MIRO learns robust latent spaces by maximizing mutual information with future information.
problem Robust perception in complex, unstructured environments with low sample complexity.
method MIRO maximizes mutual information in a latent space for model-based reinforcement learning.
result MIRO outperforms reconstruction objectives in cluttered scenes.
Predicting movement of objects while the action of learning agent interacts with the dynamics of the scene still remains a key challenge in robotics. We propose a multi-layer Long Short Term Memory (LSTM) autoendocer network that predicts future frames for a robot navigating in a dynamic environment with moving obstacl…
In this paper we continue the study of the simulated stock market framework defined by the driving sentiment processes. We focus on the market environment driven by the buy/sell trading sentiment process of the Markov chain type. We apply the methodology of the Hidden Markov Models and the Recurrent Neural Networks to …
Study complex-valued VAEs for radar OOD detection.
problem Detecting out-of-distribution signals in complex radar environments.
method Proposed and compared several detection metrics for CVAE.
result CVAE-MSE and latent-based scores outperform ANMF-Tyler.
Study proposes CNN for reconstructing high-res urban DEMs.
problem Lack of high-res urban DEM datasets for flood modeling.
method Multi-scale CNN model trained on urban DEMs of varying resolutions.
result CNN-based method produces superior high-res urban DEMs.
IMPACT optimizes LLM compression by focusing on activation importance, reducing model size up to 55.4%.
problem Resource constraints in deploying large language models (LLMs).
method IMPACT integrates activation importance into low-rank compression, optimizing for both size and accuracy.
result IMPACT achieves up to 55.4% greater model size reduction while maintaining comparable or better accuracy.
Magnetic particle imaging (MPI) data is commonly reconstructed using a system matrix acquired in a time-consuming calibration measurement. The calibration approach has the important advantage over model-based reconstruction that it takes the complex particle physics as well as system imperfections into account. This be…
UAV uses RL to navigate, map, and detect targets in unknown environments.
problem Optimizing UAV trajectory for accurate mapping and target detection in unknown environments.
method Formulated as an MDP, UAV uses RL to infer navigation policy.
result UAV autonomously explores high target detection areas while reconstructing the environment.
Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model-free and learn to act effectively across a wide range of environments such as Atari games, but requ…
C-SWMs learn structured world models from raw data.
problem Learning structured world models from raw sensory data.
method Contrastive learning with graph neural networks.
result C-SWMs outperform typical models in structured environments.
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
problem 6-DoF localisation and dense 3D reconstruction in spatial environments.
method Approximate Bayesian inference in a deep state-space model combining learning and domain knowledge.
result Near state-of-the-art performance on UAV flight data.
A new distortion measure optimizes function approximations in vector quantization.
problem Measuring the quality of vector quantization points for natural signals.
method A canonical distortion measure (CDM) is introduced, induced by an environment of functions on input space.
result Optimizing reconstruction error with respect to CDM yields optimal piecewise constant approximations.
Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine interface, where decoding incoming stimulus is highly demanded for better performance of physical de…
Proposes CWAE-IRL for efficient IRL in complex environments.
problem Learning reward functions from expert actions in MDPs.
method Variational inference with CVAE and Wasserstein loss.
result CWAE-IRL learns reward functions efficiently in complex environments.
Agents learn to draw with human-like abstraction and realism.
problem Training generative models to produce realistic images without supervision.
method Reinforcement learning agents in a simulated painting environment, trained with a discriminator network.
result Generative agents can produce images with visual abstraction and realism.
BCAE-2D compresses 3D data from a time projection chamber at high speed.
problem Compressing high-speed, sparse 3D data from a time projection chamber.
method 2D Bicephalous Convolutional Autoencoder (BCAE-2D) approach.
result 3x speedup in compression throughput with improved reconstruction accuracy.
Identifying the flavour of neutral B mesons production is one of the most important components needed in the study of time-dependent CP violation. The harsh environment of the Large Hadron Collider makes it particularly hard to succeed in this task. We present an inclusive flavour-tagging algorithm as an upgrade of…
OpFlow predicts robust OD flows by learning choice potentials conditioned on spatial exposures.
problem Deep models trained on raw counts are vulnerable to distribution shift.
method OpFlow learns row-centered choice potentials and reconstructs flows by combining them with a calibrated origin scale.
result OpFlow improves robustness under environment shifts, as shown by controlled synthetic shifts and a real-world experiment.
Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities of corresponding ground truth depth data for training. Just recording quality d…
learn2mix trains neural nets faster by adjusting class proportions dynamically.
problem Training neural nets efficiently with limited resources and imbalanced classes.
method Adaptive class proportion adjustment during training.
result Neural nets trained with learn2mix converge faster than static methods.
Deep reinforcement learning techniques have demonstrated superior performance in a wide variety of environments. As improvements in training algorithms continue at a brisk pace, theoretical or empirical studies on understanding what these networks seem to learn, are far behind. In this paper we propose an interpretable…
One of the biggest challenges in the field of biomedical imaging is the comprehension and the exploitation of the photon scattering through disordered media. Many studies have pursued the solution to this puzzle, achieving light-focusing control or reconstructing images in complex media. In the present work, we investi…
Proposes a new method to learn representations directly optimized for a task.
problem Learning representations optimized for unrelated tasks.
method Jointly learns representation and prediction function for a specific task.
result Learned representations outperform pre-trained ones and are more sample-efficient.
Representation learning is a central challenge across a range of machine learning areas. In reinforcement learning, effective and functional representations have the potential to tremendously accelerate learning progress and solve more challenging problems. Most prior work on representation learning has focused on gene…
Origami uses SGX enclaves and blinding to protect deep neural network inference privacy.
problem Protecting deep neural network inference privacy in machine learning services.
method Combines enclave execution, cryptographic blinding, and accelerator-based computation.
result Demonstrates improved privacy-preserving inference performance compared to prior work.
Learning representations with diversified information remains as an open problem. Towards learning diversified representations, a new approach, termed Information Competing Process (ICP), is proposed in this paper. Aiming to enrich the information carried by feature representations, ICP separates a representation into …
An axiomatic approach to signal reconstruction is formulated, involving a sample consistent set and a guiding set, describing desired reconstructions. New frame-less reconstruction methods are proposed, based on a novel concept of a reconstruction set, defined as a shortest pathway between the sample consistent set and…
This paper proposes a novel optimization principle and its implementation for unsupervised anomaly detection in sound (ADS) using an autoencoder (AE). The goal of unsupervised-ADS is to detect unknown anomalous sound without training data of anomalous sound. Use of an AE as a normal model is a state-of-the-art techniqu…
XPDNet wins MRI reconstruction challenge with neural network.
problem MRI reconstruction from under-sampled data.
method Inspired by MRI and computer vision best practices, XPDNet uses a neural network.
result XPDNet achieved state-of-the-art results in the 2020 fastMRI challenge.
Spiking neural networks (SNNs) offer a promising alternative to current artificial neural networks to enable low-power event-driven neuromorphic hardware. Spike-based neuromorphic applications require processing and extracting meaningful information from spatio-temporal data, represented as series of spike trains over …
We focus on an interpolation method referred to Bayesian reconstruction in this paper. Whereas in standard interpolation methods missing data are interpolated deterministically, in Bayesian reconstruction, missing data are interpolated probabilistically using a Bayesian treatment. In this paper, we address the framewor…
New method reconstructs moving parts of proteins in cryo-EM.
problem Reconstructing non-rigid molecules with moving parts in cryo-EM.
method Graph Laplacian construction from multiple projection images, followed by spectral volume expansion.
result High-resolution visualization of molecular dynamics using spectral volumes.
In this paper, we address the problem of reconstructing a time-domain signal (or a phase spectrogram) solely from a magnitude spectrogram. Since magnitude spectrograms do not contain phase information, we must restore or infer phase information to reconstruct a time-domain signal. One widely used approach for dealing w…
The paper discusses algorithms for reconstructing curves with given Euclidean or affine curvatures.
problem Reconstructing planar curves with specified Euclidean or affine curvatures.
method The paper presents algorithms for curve reconstruction under the special Euclidean and equi-affine groups.
result The reconstructed curves are close to the original curves in terms of the specified curvatures.
IAGAN method improves medical image reconstruction by incorporating adaptive GAN priors.
problem Reconstructing high-fidelity medical images from incomplete data.
method Image-adaptive GAN-based reconstruction method (IAGAN).
result IAGAN can recover fine structures relevant for medical diagnosis.
Proposes learning latent reward model for planning from rewards.
problem Planning in high-dimensional state spaces with limited reward information.
method Directly learns a latent dynamics model from rewards, planning in latent state-space.
result Successfully learns accurate latent reward prediction model, achieving strong performance and high sample efficiency.
This work improves understanding of neural network reconstruction attacks and distillation.
problem Understanding and mitigating reconstruction attacks on neural networks.
method Developed a stronger dataset reconstruction attack and studied its characteristics.
result Reconstruction attacks can recover entire training sets in the infinite width regime.
GCVAE improves disentanglement in VAEs while balancing reconstruction error.
problem Improving disentanglement in VAEs while maintaining low reconstruction error.
method Introduces three controllable Lagrangian hyperparameters to optimize reconstruction and KL divergence loss.
result GCVAE outperforms state-of-the-art models in disentanglement while balancing reconstruction.
PC-RNN reconstructs MRI images from undersampled data with more details.
problem Recovering fine details from undersampled MRI data.
method Pyramid Convolutional RNN (PC-RNN) with three ConvRNN modules for multi-scale reconstruction.
result PC-RNN outperforms other methods in recovering more details from MRI images.
Paper proposes RAN for better anomaly detection in time series data.
problem Anomaly detection algorithms often fail to accurately detect anomalies due to incomplete reconstruction of anomaly data.
method RAN uses adversarial learning and latent vector-constrained Autoencoder to ensure consistent reconstruction of anomaly data.
result RAN outperforms other algorithms in detecting meaningful anomalies with higher AUC-ROC scores.
This work improves data reconstruction methods by ensuring unique solutions and refining optimization.
problem Ensuring unique solutions and optimizing reconstruction from KKT conditions.
method Discussion of sufficient conditions for unique solutions and introduction of sample splitting for optimization.
result Sample splitting improves reconstruction performance across various methods.
New condition for reconstructing Morse functions on 3D manifolds.
problem Reconstructing Morse functions with specific level sets.
method Studied a necessary and sufficient condition for reconstruction.
result New condition strengthens previous sufficient conditions.
DCAE learns compact latent representations for one-class novelty detection.
problem Learning compact latent representations for one-class novelty detection.
method DCAE learns compact and collapse-free latent representations through internal discriminative layers of GANs, reconstructing in-class data finely and exclusively.
result DCAE achieves state-of-the-art performance on novelty and adversarial example detection.