Framework learns image dynamics between time steps using latent variables.
problem Challenges in capturing evolving image patterns and temporal information.
method Estimates intermediary image stages using a physical latent variable model.
result Demonstrates robustness and effectiveness in geoscientific imagery.
End-to-end framework for static image generation from dynamic content.
problem Generating static images from dynamic content with occluded backgrounds.
method Conditional GAN for static image generation, convolutional network for dynamic object detection.
result Generated static images are realistic and can be used for augmented reality and robot localization.
Model learns Lagrangian dynamics from images for better prediction and control.
problem Lack of interpretability and applicability to high-dimensional data like images.
method Unsupervised neural network model that learns Lagrangian dynamics from images using a coordinate-aware VAE.
result Model infers interpretable Lagrangian dynamics, enabling long-term prediction and synthesis of controllers.
OnAIR reconstructs dynamic images from sparse measurements online.
problem Reconstructing dynamic images from limited or corrupted measurements.
method Online adaptive reconstruction using sparsity and low-rank models with dictionary learning.
result Memory-efficient online algorithms for sequential estimation of dictionary and images.
LASSI models improve dynamic imaging from sparse data.
problem Efficiently reconstruct dynamic images from limited data.
method Data-adaptive decomposition of dynamic signals into low-rank and sparse components.
result LASSI models outperform existing methods in dynamic MRI reconstruction.
Learn object dynamics from unlabeled images.
problem Unsupervised learning of multiple object dynamics from unlabeled video sequences.
method Probabilistic model generating noisy positions, followed by non-linear rendering. Efficient inference method for querying the model.
result Efficient inference of object dynamics from unlabeled images.
Intratumor heterogeneity is often manifested by vascular compartments with distinct pharmacokinetics that cannot be resolved directly by in vivo dynamic imaging. We developed tissue-specific compartment modeling (TSCM), an unsupervised computational method of deconvolving dynamic imaging series from heterogeneous tumor…
A dynamic ResNet model learns different routes for images from different classes.
problem Fixed structure in ResNet-like architectures limits their adaptability to diverse inputs.
method Develops a ResNet-based model that dynamically selects Computational Units for each input image.
result Achieves better results on CIFAR-10 test set compared to the original ResNet-38 architecture.
New unsupervised learning method for fast imaging metal dendrites.
problem Fast imaging of metal dendrites in materials science.
method Unsupervised learning using Hierarchical Gaussian Mixture Models (HGMM) for dynamic sampling.
result Dynamic sampling of metal dendrites can be achieved efficiently using HGMM.
Proposes DLGPD model to learn dynamics from images for planning.
problem Planning in unknown, indirectly observable environments.
method Deep latent Gaussian process dynamics model trained jointly with neural networks.
result Demonstrates improved data efficiency and transfer learning.
We introduce Embed to Control (E2C), a method for model learning and control of non-linear dynamical systems from raw pixel images. E2C consists of a deep generative model, belonging to the family of variational autoencoders, that learns to generate image trajectories from a latent space in which the dynamics is constr…
PlaNet learns latent dynamics from images for better planning in unknown environments.
problem Leveraging planning in unknown environments with accurate dynamics models.
method Deep Planning Network (PlaNet) learns dynamics from images using latent space and multi-step variational inference.
result PlaNet achieves high performance in continuous control tasks with contact dynamics and sparse rewards.
Neural Physicist learns physical dynamics from images.
problem Learning meaningful physical state representations and accurate state transitions from image sequences.
method Neural Physicist uses VAE for state extraction, NP for parameters, and SSM for dynamics.
result Achieves long-term predictions and identifies system degrees of freedom.
A dataset of 10 molecule types for machine learning studies.
problem Lack of suitable datasets for machine learning in molecular imaging.
method Generated 2D cross-sectional projections of 10 molecule types from Molecular Dynamics trajectories.
result Benchmark dataset for machine learning, deep learning, and image processing in scattering, imaging, and microscopy.
MDGCN improves hyperspectral image classification by dynamically updating graphs.
problem Traditional CNNs struggle with irregular image regions and class boundaries.
method MDGCN uses dynamic graph convolution on hyperspectral images, adapting to local regions.
result MDGCN outperforms state-of-the-art methods on benchmark datasets.
New algorithms extract features from light waveforms, improving image quality.
problem Extracting features from digital images efficiently and accurately.
method Dispersive propagation of light followed by phase detection.
result Superior dynamic range and energy efficiency compared to conventional methods.
Factor analysis improves PET image interpretation by considering non-standard noise distributions.
problem Improving interpretation of dynamic PET images with non-standard noise distributions.
method Proposes using β-divergence to fit factor models for different noise distributions. result Improves factor analysis results for various noise types in PET images.
Dynamic neural networks route inputs differently, improving classification performance.
problem Improving classification performance in neural networks.
method Three strategies for training dynamically-routed neural networks.
result Dynamically-routed networks perform better than statically-routed networks.
Dynamic memory prevents forgetting in continuous learning of medical images.
problem Catastrophic forgetting in machine learning models over time due to domain shifts.
method Dynamic memory to store and replay diverse training data subsets.
result Dynamic memory mitigates forgetting without knowing when shifts occur.
SyMetric evaluates learned Hamiltonian dynamics from images, improving model stability and interpretability.
problem Lack of reliable metrics to assess learned Hamiltonian dynamics from images.
method Developed SyMetric, a binary indicator based on Hamiltonian dynamics properties.
result SyMetric identifies architectural improvements for better dynamics learning.
SOLAR learns efficient representations for RL in complex image domains.
problem Efficient model-based reinforcement learning in domains with complex observations like images.
method Optimizes structured representations for inferring simple dynamics and cost models from data.
result Substantially better final performance than other model-based RL methods, more efficient than model-free RL.
Estimation of response functions is an important task in dynamic medical imaging. This task arises for example in dynamic renal scintigraphy, where impulse response or retention functions are estimated, or in functional magnetic resonance imaging where hemodynamic response functions are required. These functions can no…
Langevin Dynamics speeds up mixing time with manifold hypothesis and multi-scale approach.
problem Langevin Dynamics struggles in high dimensions and nonconvex landscapes.
method Utilizes manifold hypothesis to reduce mixing time and employs multi-scale approach to improve image generation quality.
result Mixing time depends on intrinsic dimension rather than ambient dimension, significantly reducing computational complexity.
Proposes a neural network for dynamic risk prediction of AMD using longitudinal fundus images.
problem Dynamic risk prediction for progressive eye disorders like AMD.
method tdCoxSNN, a time-dependent Cox survival neural network integrating CNN.
result Demonstrates commendable predictive performance in AMD and PBC datasets.
Paper proposes using DMD for feature extraction in image classification.
problem Lack of labelled data for machine learning.
method Dynamic Mode Decomposition (DMD) for feature extraction.
result DMD features with RKS give competitive results.
AIR-Net adapts low-rank regularization dynamically for better image completion.
problem Fixed low-rank regularization limits adaptability to different images.
method AIR-Net uses adaptive and implicit regularization parameterized by a dynamic Laplacian matrix.
result AIR-Net enhances implicit regularization and outperforms fixed methods in non-uniform missing data scenarios.
An unsupervised learning algorithm trains capsule networks for generating realistic images.
problem Training capsule networks for generating realistic images without labeled data.
method Developed an unsupervised learning algorithm using dynamic routing and an energy function for capsule networks.
result The algorithm successfully generates realistic looking images from a learned distribution.
Tensor methods improve image classification performance.
problem Improving image classification accuracy using tensor-based machine learning.
method Two novel tensor-based approaches: MANDy kernel reformulation and alternating ridge regression in tensor-train format.
result Tensor-based methods are competitive with state-of-the-art neural networks.
Research aims to explain how ResNets' stability improves image classification performance.
problem Understanding why ResNets enhance image classification performance.
method Examines batch normalization and the dynamical systems view of ResNets to understand stability and smoothness.
result Stability of inter-layer propagation in ResNets contributes to enhanced performance.
TMTF improves time series visualization by separating dynamic regimes.
problem Misleading global transition matrix in time series analysis.
method Temporal chunking, local transition matrices, and image assembly.
result Temporal segmentation reveals distinct transition dynamics.
Area attention allows dynamic area-based attention in memory.
problem Fixed attention granularity limits model performance.
method Area attention dynamically determines area shape and size via learning.
result Area attention improves performance on neural machine translation and image captioning.
New method reconstructs signals and images from periodic nonlinearities.
problem Reconstructing signals and images from periodic nonlinearities.
method Design of measurement scheme for efficient reconstruction, adaptable to compressive sensing.
result Effective reduction in measurement complexity for HDR imaging with minimal quality loss.
Paper analyzes ResNets from dynamical systems perspective and proposes a faster training method.
problem Understanding and optimizing the design and training of ResNets.
method Dynamical systems view and lesioning properties analysis, followed by a novel training acceleration method.
result Training ResNets and Wide ResNets is accelerated by more than 40% with superior or equivalent accuracy.
Study analyzes inference dynamics in deep generative models to improve concept formation.
problem Understanding the mechanism of inference in deep generative models.
method Numerical analysis of a VAE model with added noise, focusing on latent space activity patterns and concept formation.
result Inference dynamics in VAEs approach a concept as input data noise increases, enhancing generalization ability.
Dynamic steerable blocks improve deep networks by learning filter invariances.
problem Pixel-based filters ignore image properties, leading to suboptimal performance.
method Developed frame-based ResNets and Densenets, which are steerable under predefined transformations.
result Dynamic steerable blocks outperform other approaches on contour detection datasets.
We present a general theory of fractal transformations and show how it leads to a new type of method for filtering and transforming digital images. This work substantially generalizes earlier work on fractal tops. The approach involves fractal geometry, chaotic dynamics, and an interplay between discrete and continuous…
Improves asynchronous federated learning with queuing dynamics.
problem Asynchronous federated learning with varying node computational speeds.
method Proposes a non-uniform sampling scheme for the central server.
result Significant improvement over current algorithms on image classification.
DistillKac generates images quickly using damped wave equations.
problem Generating high-quality images efficiently.
method Uses damped wave equations and Kac dynamics for finite speed transport.
result Fast image generation with high quality and numerical stability.
Dynamic defense against Byzantine poisoning in federated learning.
problem Byzantine poisoning attacks on federated learning models.
method Dynamic federated aggregation operator to filter out adversarial clients.
result Dynamic selection of clients improves global learning model performance.
EnSF uses image inpainting to handle partial observations in data assimilation.
problem Data assimilation challenges with partial observations.
method EnSF integrates image inpainting with diffusion models to predict unobserved states.
result EnSF successfully tracks SQG dynamics with partial observations.
Bayesian approach uses deep learning for seismic imaging and uncertainty quantification.
problem Uncertainty in seismic imaging due to nonuniqueness and noise.
method Implicit structured prior from randomly initialized convolutional neural network, combined with Bayesian model averaging and stochastic gradient Langevin dynamics.
result Deep priors reduce imaging artifacts and overfitting in noisy conditions.
DGE learns event representations from image sequences without manual annotations.
problem Data hunger and domain adaptation issues in self-supervised learning for temporal segmentation.
method Dynamic Graph Embedding (DGE) learns event representations by iteratively updating a graph and its embedding.
result DGE achieves robust temporal segmentation on benchmark datasets, outperforming state-of-the-art methods.
Study finds physical priors don't significantly improve ML models for learning latent dynamics.
problem Learning latent dynamics from visual observations without access to the underlying state.
method Benchmarked 17 datasets with visual observations of physical systems using various physically inspired methods alongside baselines.
result Physical priors do not significantly improve standard techniques for learning latent dynamics.
This paper shows that explicitly learning motion improves reinforcement learning in dynamic environments.
problem Learning controllers for dynamic environments without explicit motion representation.
method Explicitly learning motion representation using image difference or temporal stacks of frames.
result Explicit motion learning improves the quality of learned controllers in dynamic scenarios.
Bayesian deep learning improves seismic imaging uncertainty.
problem Uncertainty in seismic imaging due to data noise and linearization errors.
method Combines Bayesian inference and deep neural networks to quantify uncertainty in horizon tracking.
result Uncertainty in automatically tracked horizons can be quantified and visualized.
Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional observations. In these cases, system identification, i.e., finding the measurement map…
Capsule networks improve with dynamic routing using Wasserstein objective.
problem Capsule networks struggle to consistently outperform traditional neural networks.
method Dynamic routing scheme using approximate Wasserstein objective to select capsules.
result Capsule network achieves over 1.2% improvement on CIFAR-10 with fewer parameters.
Proposes ACLAE-DT for unsupervised anomaly detection in multivariate time series.
problem Challenges in building anomaly detection frameworks for multivariate time series data.
method Attention-based ConvLSTM Autoencoder with Dynamic Thresholding.
result Demonstrates superior performance over state-of-the-art methods.