Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

126252377503 · Jun 202019922001200920172026
48 results for image dynamics

Model learns Lagrangian dynamics from images for better prediction and control.

problem Lack of interpretability and applicability to high-dimensional data like images.
method Unsupervised neural network model that learns Lagrangian dynamics from images using a coordinate-aware VAE.
result Model infers interpretable Lagrangian dynamics, enabling long-term prediction and synthesis of controllers.

In this paper we present an end-to-end deep learning framework to turn images that show dynamic content, such as vehicles or pedestrians, into realistic static frames. This objective encounters two main challenges: detecting all the dynamic objects, and inpainting the static occluded background with plausible imagery. …

2018-09-20abs ↗pdf ↗

Novel data acquisition schemes have been an emerging need for scanning microscopy based imaging techniques to reduce the time in data acquisition and to minimize probing radiation in sample exposure. Varies sparse sampling schemes have been studied and are ideally suited for such applications where the images can be re…

2018-07-06abs ↗pdf ↗

Neural Physicist learns physical dynamics from images.

problem Learning meaningful physical state representations and accurate state transitions from image sequences.
method Neural Physicist uses VAE for state extraction, NP for parameters, and SSM for dynamics.
result Achieves long-term predictions and identifies system degrees of freedom.

Sparsity and low-rank models have been popular for reconstructing images and videos from limited or corrupted measurements. Dictionary or transform learning methods are useful in applications such as denoising, inpainting, and medical image reconstruction. This paper proposes a framework for online (or time-sequential)…

2018-09-06abs ↗pdf ↗

Dynamic memory prevents forgetting in continuous learning of medical images.

problem Catastrophic forgetting in machine learning models over time due to domain shifts.
method Dynamic memory to store and replay diverse training data subsets.
result Dynamic memory mitigates forgetting without knowing when shifts occur.

We propose and systematically evaluate three strategies for training dynamically-routed artificial neural networks: graphs of learned transformations through which different input signals may take different paths. Though some approaches have advantages over others, the resulting networks are often qualitatively similar…

2017-03-17abs ↗pdf ↗

SyMetric evaluates learned Hamiltonian dynamics from images, improving model stability and interpretability.

problem Lack of reliable metrics to assess learned Hamiltonian dynamics from images.
method Developed SyMetric, a binary indicator based on Hamiltonian dynamics properties.
result SyMetric identifies architectural improvements for better dynamics learning.

Factor analysis has proven to be a relevant tool for extracting tissue time-activity curves (TACs) in dynamic PET images, since it allows for an unsupervised analysis of the data. Reliable and interpretable results are possible only if considered with respect to suitable noise statistics. However, the noise in reconstr…

2018-07-30abs ↗pdf ↗

Langevin Dynamics speeds up mixing time with manifold hypothesis and multi-scale approach.

problem Langevin Dynamics struggles in high dimensions and nonconvex landscapes.
method Utilizes manifold hypothesis to reduce mixing time and employs multi-scale approach to improve image generation quality.
result Mixing time depends on intrinsic dimension rather than ambient dimension, significantly reducing computational complexity.

Proposes a neural network for dynamic risk prediction of AMD using longitudinal fundus images.

problem Dynamic risk prediction for progressive eye disorders like AMD.
method tdCoxSNN, a time-dependent Cox survival neural network integrating CNN.
result Demonstrates commendable predictive performance in AMD and PBC datasets.

AIR-Net adapts low-rank regularization dynamically for better image completion.

problem Fixed low-rank regularization limits adaptability to different images.
method AIR-Net uses adaptive and implicit regularization parameterized by a dynamic Laplacian matrix.
result AIR-Net enhances implicit regularization and outperforms fixed methods in non-uniform missing data scenarios.

We present an approach to learn the dynamics of multiple objects from image sequences in an unsupervised way. We introduce a probabilistic model that first generate noisy positions for each object through a separate linear state-space model, and then renders the positions of all objects in the same image through a high…

2019-07-20abs ↗pdf ↗

Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models that are accurate enough for planning has been a long-standing challenge, especiall…

2018-11-12abs ↗pdf ↗

We present a general theory of fractal transformations and show how it leads to a new type of method for filtering and transforming digital images. This work substantially generalizes earlier work on fractal tops. The approach involves fractal geometry, chaotic dynamics, and an interplay between discrete and continuous…

2011-02-15abs ↗pdf ↗

EnSF uses image inpainting to handle partial observations in data assimilation.

problem Data assimilation challenges with partial observations.
method EnSF integrates image inpainting with diffusion models to predict unobserved states.
result EnSF successfully tracks SQG dynamics with partial observations.

Study finds physical priors don't significantly improve ML models for learning latent dynamics.

problem Learning latent dynamics from visual observations without access to the underlying state.
method Benchmarked 17 datasets with visual observations of physical systems using various physically inspired methods alongside baselines.
result Physical priors do not significantly improve standard techniques for learning latent dynamics.

Bayesian deep learning improves seismic imaging uncertainty.

problem Uncertainty in seismic imaging due to data noise and linearization errors.
method Combines Bayesian inference and deep neural networks to quantify uncertainty in horizon tracking.
result Uncertainty in automatically tracked horizons can be quantified and visualized.

Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional observations. In these cases, system identification, i.e., finding the measurement map…

2014-10-28abs ↗pdf ↗

Proposes ACLAE-DT for unsupervised anomaly detection in multivariate time series.

problem Challenges in building anomaly detection frameworks for multivariate time series data.
method Attention-based ConvLSTM Autoencoder with Dynamic Thresholding.
result Demonstrates superior performance over state-of-the-art methods.

High-quality image synthesis with diffusion models, achieving state-of-the-art FID score.

problem Generating high-quality images from latent variables.
method Training diffusion probabilistic models with a weighted variational bound, inspired by denoising score matching and Langevin dynamics.
result State-of-the-art FID score of 3.17 on CIFAR10 dataset.

Study uncovers uncertainty in traffic prediction models across cities.

problem Lack of interpretability in deep learning models for traffic prediction.
method Investigated uncertainty quantification methods for image-based traffic prediction.
result Meaningful uncertainty estimates can be recovered for traffic prediction.

New metric compares noisy neural trajectories using optimal transport.

problem Existing metrics fail to capture differences in noisy, dynamic neural responses.
method Proposed an optimal transport distance metric for Gaussian processes.
result Metric effectively compares neural dynamics in different systems.

Study analyzes bias interactions in multimodal models using simulation-based methods.

problem Analyzing dynamic bias interactions in multimodal models to ensure fairness and equity.
method Simulation-based heuristic approach to compute bias scores for text-only, image-only, and multimodal embeddings.
result Multimodal bias interactions can be amplification, mitigation, or neutral, with text bias often dominant.

The interest in machine learning with tensor networks has been growing rapidly in recent years. We show that tensor-based methods developed for learning the governing equations of dynamical systems from data can, in the same way, be used for supervised learning problems and propose two novel approaches for image classi…

2019-10-04abs ↗pdf ↗

Paper proposes a CNN model for improved multi-asset portfolio risk prediction.

problem Challenges in risk management of multi-asset portfolios due to limited correlation capture.
method Uses CNN and image processing to convert financial data into images for enhanced feature extraction.
result CNN model significantly outperforms traditional methods in risk prediction accuracy.

Improved diffusion models for image synthesis with better training dynamics.

problem Uneven and ineffective training in diffusion models.
method Redesigned network layers to preserve activation, weight, and update magnitudes.
result Significantly better networks at equal computational complexity, improving FID to 1.81.

Perception technologies in Autonomous Driving are experiencing their golden age due to the advances in Deep Learning. Yet, most of these systems rely on the semantically rich information of RGB images. Deep Learning solutions applied to the data of other sensors typically mounted on autonomous cars (e.g. lidars or rada…

2018-08-28abs ↗pdf ↗

Proposes RPG-RT for red-teaming T2I models without internal access.

problem Evaluating T2I models' security through red-teaming is challenging due to their closed-source nature and unknown defense mechanisms.
method Integrates LLM and rule-based preference modeling to dynamically adapt to unknown defense mechanisms.
result Demonstrates superior and practical approach for red-teaming T2I models.