Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

57114170227 · May 202619922001200920172026
48 results for Image-based Control

CURL uses contrastive learning to improve reinforcement learning performance.

problem Improving reinforcement learning performance on complex tasks.
method Contrastive learning to extract high-level features from raw pixels, followed by off-policy control.
result CURL outperforms prior methods on DeepMind Control Suite and Atari Games.

Paper proposes tensor-based method for semiconductor manufacturing process control.

problem Challenges of traditional process control methods in high-dimensional image-based overlay errors.
method Builds a high-dimensional process model, proposes tensor-on-vector regression algorithms, designs EWMA controller for tensor data.
result The method reduces overlay errors using limited control recipes and is superior especially when disturbances are not stable.

Framework improves agent's ability to learn from noisy images.

problem Agents tend to focus on distracting regions in unsupervised image-based goal exploration.
method Proposes a novel framework combining absolute Learning Progress with unsupervised image-based goal exploration.
result Agents successfully identify and ignore distracting regions, improving overall performance.

Model learns Lagrangian dynamics from images for better prediction and control.

problem Lack of interpretability and applicability to high-dimensional data like images.
method Unsupervised neural network model that learns Lagrangian dynamics from images using a coordinate-aware VAE.
result Model infers interpretable Lagrangian dynamics, enabling long-term prediction and synthesis of controllers.

Paper introduces SALE for better state-action learning in RL.

problem Challenges in representation learning for low-level states in RL.
method Introduces SALE, a novel approach for learning embeddings of state-action interactions.
result TD7 algorithm significantly outperforms existing continuous control algorithms.

Convolutional autoencoders improve personalized recommendations from image-based data.

problem Lack of personalized recommendations in gastronomic platforms using image data.
method Used convolutional autoencoders to extract features from images and improve personalized recommendations.
result Convolutional autoencoders outperform standard deep features in image-based personalized recommendation systems.

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each policy from different high-level tasks and compose them to perform novel ones. E…

2018-03-02abs ↗pdf ↗

A neural network approach to compute stable metrics for numerical simulation data.

problem Computing stable and generalizing metrics for diverse numerical simulation data.
method A Siamese neural network architecture with a specialized loss function trained on a controlled data generation setup.
result LSiM outperforms existing metrics for vector spaces and image-based metrics.

Reinforcement learning algorithms struggle when the reward signal is very sparse. In these cases, naive random exploration methods essentially rely on a random walk to stumble onto a rewarding state. Recent works utilize intrinsic motivation to guide the exploration via generative models, predictive forward models, or …

2018-10-02abs ↗pdf ↗

Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models that are accurate enough for planning has been a long-standing challenge, especiall…

2018-11-12abs ↗pdf ↗

Study uncovers uncertainty in traffic prediction models across cities.

problem Lack of interpretability in deep learning models for traffic prediction.
method Investigated uncertainty quantification methods for image-based traffic prediction.
result Meaningful uncertainty estimates can be recovered for traffic prediction.

Paper uses CNN to predict process parameters from molten pool data in WLAM.

problem Achieving high quality in WLAM through real-time process control.
method Proposes a multi-modality CNN architecture to predict process parameters from molten pool sensor data.
result Improved prediction performance of multi-modal CNN compared to uni-modal approach.

In this paper, we consider the problem of malware detection and classification based on image analysis. We convert executable files to images and apply image recognition using deep learning (DL) models. To train these models, we employ transfer learning based on existing DL models that have been pre-trained on massive …

2019-01-21abs ↗pdf ↗

Reinforcement Learning(RL) with sparse rewards is a major challenge. We propose \emph{Hindsight Trust Region Policy Optimization}(HTRPO), a new RL algorithm that extends the highly successful TRPO algorithm with \emph{hindsight} to tackle the challenge of sparse rewards. Hindsight refers to the algorithm's ability to l…

2019-07-29abs ↗pdf ↗

A key challenge in complex visuomotor control is learning abstract representations that are effective for specifying goals, planning, and generalization. To this end, we introduce universal planning networks (UPN). UPNs embed differentiable planning within a goal-directed policy. This planning computation unrolls a for…

2018-04-02abs ↗pdf ↗

Imitation learning is the problem of recovering an expert policy without access to a reward signal. Behavior cloning and GAIL are two widely used methods for performing imitation learning. Behavior cloning converges in a few iterations but doesn't achieve peak performance due to its inherent iid assumption about the st…

2020-01-21abs ↗pdf ↗

Twin-to-twin transfusion syndrome treatment requires fetoscopic laser photocoagulation of placental vascular anastomoses to regulate blood flow to both fetuses. Limited field-of-view (FoV) and low visual quality during fetoscopy make it challenging to identify all vascular connections. Mosaicking can align multiple ove…

2019-07-15abs ↗pdf ↗

Labels distilled from images improve model training efficiency and flexibility.

problem Creating synthetic labels for a small set of real images to train models effectively.
method Introduce a more robust and flexible meta-learning algorithm for distillation and an effective first-order strategy based on convex optimization layers.
result Label distillation leads to improved results and greater flexibility in neural architectures.

Personalizes query completion in digital commerce with image-based vectors.

problem High bounce rate and low recurring users in query completion.
method Injects dense vectors from product images into a noisy channel model.
result Image-based personalization improves query completion and user experience.

DeepAveragers solves offline RL by solving derived MDPs from static data.

problem Offline reinforcement learning with limited data.
method Solves derived non-parametric MDPs (DAC-MDPs) using deep representations and costs for under-represented parts.
result The approach can lower-bound performance and scale to complex offline RL problems.

BCRL learns a Bellman complete representation for offline RL policy evaluation.

problem Learning a Q-function efficiently from offline data.
method BCRL learns a linear Bellman complete representation directly from data, enabling efficient OPE.
result BCRL achieves competitive OPE error and outperforms FQE in certain scenarios.

ContraBAR uses contrastive learning to learn Bayes-optimal policies in RL.

problem Learning optimal policies for unknown tasks sampled from a known distribution.
method Proposes ContraBAR, a meta RL algorithm using contrastive predictive coding (CPC) for belief inference.
result ContraBAR achieves comparable performance to state-of-the-art methods and is computationally efficient.

Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combinatio…

2019-03-26abs ↗pdf ↗

Ano-SuPs detects anomalies in images of manufactured products by identifying suspected patches.

problem Challenges in detecting anomalies in image-based manufacturing systems, including complexity of background and various anomaly patterns.
method Two-stage strategy anomaly detection method: first, remove suspected patches; second, refine anomaly identification using normal patches.
result Demonstrated effectiveness through simulation and case studies, identifying key parameters and steps impacting model performance and efficiency.

In image-based camera localization systems, information about the environment is usually stored in some representation, which can be referred to as a map. Conventionally, most maps are built upon hand-crafted features. Recently, neural networks have attracted attention as a data-driven map representation, and have show…

2019-02-18abs ↗pdf ↗

Study finds visual explanations do not significantly improve human accuracy or trust in model predictions.

problem Measuring the impact of visual explanations on human accuracy and trust in model predictions.
method Randomized controlled trial with image-based age prediction task, varying levels of explanation quality.
result Visual explanations do not significantly alter human accuracy or trust in the model.

A counterexample disproves the unknotting number conjecture for a specific knot combination.

problem Disproving the unknotting number conjecture for a particular knot combination.
method Used Snappy to discover and verify a counterexample.
result A counterexample showing u(71#71)5u(7_1\#\overline{7_1})\leq 5 disproves the conjecture.

A CNN-based method detects and counts corn kernels from images.

problem Manual counting of corn kernels is labor-intensive and prone to error.
method Sliding window approach with CNN for detection and NMS for overlapping removal.
result The method successfully detects and counts kernels with low error.

Numerous important problems can be framed as learning from graph data. We propose a framework for learning convolutional neural networks for arbitrary graphs. These graphs may be undirected, directed, and with both discrete and continuous node and edge attributes. Analogous to image-based convolutional networks that op…

2016-05-17abs ↗pdf ↗

Deep learning ensemble improves Alzheimer vs. Mild Cognitive Impairment diagnosis.

problem Differentiating Alzheimer Disease from Mild Cognitive Impairment.
method Hybrid deep learning ensemble framework using MRI slices, pretrained models, and stacked ensemble learning.
result State-of-the-art accuracy (99.21%) for Alzheimer vs. Mild Cognitive Impairment classification.