Graph neural network predicts grasp stability from tactile sensor data.
problem Predicting grasp stability from tactile sensor data.
method Graph Convolutional Network (GCN) trained on tactile sensor data.
result Graph neural network effectively predicts grasp stability.
DIGIT is a low-cost tactile sensor for in-hand manipulation.
problem Difficulty in sensing contact forces limits robotic manipulation.
method DIGIT miniaturizes and improves a vision-based tactile sensor.
result DIGIT enables better control of interactions with the environment.
Tactile information is important for gripping, stable grasp, and in-hand manipulation, yet the complexity of tactile data prevents widespread use of such sensors. We make use of an unsupervised learning algorithm that transforms the complex tactile data into a compact, latent representation without the need to record g…
Robotic grasp stability improved with fingertip slippage detection.
problem Improving grasp stability in robotic manipulation.
method Task-relevant feature extraction and efficient classifier design for fingertip slippage detection.
result The proposed method effectively detects object slippage with fingertips in an online fashion.
TACTO simulates high-resolution touch sensing for robotics.
problem Accurate simulation of touch sensing in robotics.
method Fast, flexible, open-source simulator for vision-based tactile sensors.
result Demonstrated TACTO's effectiveness in grasping stability prediction and marble manipulation control.
For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact. In this paper, we investigate how a robot can learn to use tactile information to…
A successful grasp requires careful balancing of the contact forces. Deducing whether a particular grasp will be successful from indirect measurements, such as vision, is therefore quite challenging, and direct sensing of contacts through touch sensing provides an appealing avenue toward more successful and consistent …
Proposes a deep Auto-Encoder-like framework for visual-tactile fusion object clustering.
problem Combining visual and tactile information for better object clustering.
method Deep Auto-Encoder-like Non-negative Matrix Factorization framework, graph regularizer, modality-level consensus regularizer, alternating minimization strategy.
result Improves object clustering performance by leveraging both visual and tactile modalities.
Emotion classification improved using brain signals from tactile enhanced multimedia.
problem Classifying viewer emotions in tactile enhanced multimedia.
method Frequency domain features from EEG data analyzed using SVM.
result Increased accuracy (76.19%) compared to time domain features (63.41%).
This work builds a sensor graph from DC sensors for anomaly detection.
problem Anomaly detection in data centers with complex sensor relationships.
method Data-driven pipeline (ts2graph) to build a sensor graph from sensor time series.
result Graph neural network (GNN) outperforms existing methods by 2-3 times in anomaly detection.
Improved robustness in multi-modal sensor fusion with deep learning.
problem Inconsistency in fusion weights leading to poor performance under sensor failures.
method Proposes deep multi-modal sensor fusion architectures with fusion weight regularization and target learning.
result Proposed architectures outperform existing deep learning methods under sensor failures.
Proposes a neural network for handling multi-sensor time series with varying input dimensions.
problem Handling multi-sensor time series with varying input dimensions.
method Graph neural network conditioning vectors for zero-shot transfer learning.
result Better generalization in activity recognition and equipment prognostics datasets.
RESPIRE calibrates low-cost air-quality sensors for CO levels, resistant to outliers.
problem Calibrating LCAQ sensors against regulatory-grade monitors is expensive and time-consuming.
method PROvably outlier-resistant semi-parametric regression technique.
result RESPIRE offers improved prediction in cross-site, cross-season, and cross-sensor settings.
Paper proposes a method to reduce sensor drift in electronic noses.
problem Sensor drift in electronic noses.
method Discriminative subspace projection approach.
result The method minimizes within-class variance and maximizes between-class variance using label information.
Method learns behavioral states from wearable sensor data.
problem Understanding behavioral patterns from sensor data.
method Non-parametric Bayesian approach to model sensor data.
result Learned behavioral states cluster participants into meaningful groups and predict psychological states.
Framework fuses RGB images and depth maps for self-driving car control.
problem Fault tolerance in self-driving cars with sensor failures.
method Deep neural network architecture for sensor fusion.
result Framework can learn to use relevant sensor information even when one fails.
Low-cost sensors improve air quality prediction accuracy significantly.
problem Improving air quality monitoring networks with affordable sensors.
method Developed a high-resolution air quality prediction engine using low-cost sensors and official data.
result The use of low-cost sensors improves prediction accuracy by 25% and 15% for PM2.5 and PM10 respectively in densely monitored areas.
Adversarial approach enhances sensor fusion for robust target detection.
problem Improving target detection and classification using multi-modal sensor fusion.
method Generative network learns latent space from various sensor modalities, then detects damaged sensors and safeguards performance.
result Automatic robustness against noisy/damaged sensors achieved.
Improved DOA estimation with distributed sensors across multiple frequencies.
problem Sensor gain uncertainties and directional perturbations in multi-frequency scenarios.
method Distributed optimization with local coherence models and iterative exchange of information.
result Advantages in statistical and computational efficiency through parallel iterative technique.
Paper presents a WiFi-based indoor sensor localization technique.
problem Indoor localization in wireless sensor networks.
method Zoning-based localization using statistical learning.
result Efficient sensor zone determination in indoor environments.
We address the two fundamental problems of spatial field reconstruction and sensor selection in heterogeneous sensor networks: (i) how to efficiently perform spatial field reconstruction based on measurements obtained simultaneously from networks with both high and low quality sensors; and (ii) how to perform query bas…
Regularized recurrent attention filter combines sensor inputs.
problem Combining information from different sensor modalities.
method Regularized recurrent attention filter, co-learning mechanism, probabilistic graphical model.
result Dynamic sensor fusion and latent representation recovery.
FATHOM model improves sensor data analysis with attention and LSTM.
problem Scarcity of training data from multiple sensors.
method Federated multi-task hierarchical attention model (FATHOM) with attention mechanism and LSTM.
result FATHOM outperforms baselines in sensor data classification and regression.
ConvGNP improves sensor placement for climate monitoring.
problem Maximizing informativeness of environmental sensor placements in remote regions.
method Convolutional Gaussian neural processes (ConvGNP) for non-stationary spatial predictions.
result ConvGNP outperforms traditional GP models in predicting sensor performance and reducing uncertainty.
This paper designs sensor arrays for estimating unsteady flows efficiently.
problem Estimating high-dimensional unsteady flow fields with limited sensor placement.
method Combines data-driven modeling, Kalman Filter design, and sparsification for sensor selection.
result Proposed sensor arrays are highly effective for flow-field estimation across various conditions.
Adaptive activity monitoring framework for wearable sensors.
problem Efficiently monitor human activities with low power consumption.
method Switching Gaussian process model with block circulant embedding and FFT for inference.
result Optimized trade-off between sensor power consumption and prediction performance.
Optimizes seismic monitoring networks using Bayesian OED.
problem Improve seismic event identification and location.
method Bayesian optimal experimental design (OED) to configure sensor networks.
result Optimized sensor network improves seismic event identification and location.
Robots rely on sensors to provide them with information about their surroundings. However, high-quality sensors can be extremely expensive and cost-prohibitive. Thus many robotic systems must make due with lower-quality sensors. Here we demonstrate via a case study how modeling a sensor can improve its efficacy when em…
With the rising number of interconnected devices and sensors, modeling distributed sensor networks is of increasing interest. Recurrent neural networks (RNN) are considered particularly well suited for modeling sensory and streaming data. When predicting future behavior, incorporating information from neighboring senso…
AutoEncoder smooths noisy sensor data and interpolates missing values.
problem Noisy sensor data and missing timepoints require interpolation.
method Uses AutoEncoder to denoise and interpolate data.
result AutoEncoder improves data quality and reveals dynamics.
Self-attention model improves HAR from wearable sensors.
problem Capturing spatio-temporal context from sensor data.
method Proposes a self-attention based neural network model.
result Significant performance improvement over state-of-the-art models.
Adversarial perturbations fool wearable sensor systems, showing transferability across different systems.
problem Adversarial examples fool wearable sensor systems, showing transferability across different systems.
method Study of adversarial transferability in wearable sensor systems from four perspectives: systems, subjects, sensor body locations, and datasets.
result Strong untargeted transferability in most cases, targeted attacks less successful.
Predicts traffic flow using reinforcement learning and sensor data.
problem Accurately predict expanding and evolving long-term streaming traffic networks.
method Formulates the problem as a continuous reinforcement learning task, where the agent predicts future traffic based on sensor data.
result The approach improves accuracy in predicting traffic flow by updating the agent's state representation over time.
Deep RL optimizes sensor placement in digital twins for dynamic data acquisition.
problem Limited applicability of traditional sensor placement techniques for online applications.
method Formulates sensor placement as a Markov decision process and uses deep reinforcement learning.
result Improves predictive accuracy and reliability of digital twins through adaptive sensor repositioning.
Weather balloons deploy sensors to collect stratospheric data.
problem Limited data collection in the stratosphere.
method Modeling forecast deviation as a Gaussian process to determine sensor release times; novel hardware system for optimal sensor release.
result Data engineering framework effectively collects stratospheric data through real flights and simulations.
The paper optimizes sensor selection for network time series data.
problem Optimizing sensor selection for network time series data with minimal error.
method Data-driven strategies to turn off sensors or select a sampling set of nodes.
result Proposes and compares various data-driven strategies for sensor selection.
Paper proposes methods to localize sources in WSNs without knowing sensor parameters.
problem Source localization in WSNs without sensor parameter knowledge.
method Hitting set approach and feature selection method.
result Effective source localization methods validated through simulations.
Improved sleep apnea detection using sensor fusion and backward shortcut connections.
problem Untreated sleep apnea leads to severe health consequences; automated detection is needed.
method Late sensor fusion using backward shortcut connections to improve deep learning models.
result Significant improvement in predictive performance over single sensor methods.
The problem of information fusion from multiple data-sets acquired by multimodal sensors has drawn significant research attention over the years. In this paper, we focus on a particular problem setting consisting of a physical phenomenon or a system of interest observed by multiple sensors. We assume that all sensors m…
VIDON learns operators with variable sensors, overcoming sensor limitations.
problem Fixed sensor locations restrict operator learning applicability.
method Variable-Input Deep Operator Network (VIDON) with random, varying sensors.
result VIDON efficiently approximates operators in PDEs and is robust to sensor permutations.
Deep RL predicts equipment maintenance from sensor data.
problem Equipment downtime due to sensor data overload.
method Model-free Deep Reinforcement Learning for optimal maintenance policy.
result Automatic maintenance policy learning from sensor data.
In this paper, we propose a general collaborative sparse representation framework for multi-sensor classification, which takes into account the correlations as well as complementary information between heterogeneous sensors simultaneously while considering joint sparsity within each sensor's observations. We also robus…
Graph autoencoders enable ML across diverse sensor networks.
problem Deploying ML across different sensor networks with varying types or layouts.
method Graph Autoencoders for activity recognition across heterogeneous sensor networks.
result Transferable activity classifiers achieve 75% accuracy on unseen sensor layouts.
Predicting the health of components in complex dynamic systems such as an automobile poses numerous challenges. The primary aim of such predictive systems is to use the high-dimensional data acquired from different sensors and predict the state-of-health of a particular component, e.g., brake pad. The classical approac…
Deep learning improves sensor performance optimization.
problem Optimizing sensor performance based on key metrics.
method Re-approach non-linear regression using deep learning with Keras and Tensorflow.
result Deep learning models improve sensor performance optimization.
RL automates sensor configuration for energy harvesting IoT nodes.
problem Manual or heuristic configuration of energy harvesting sensors is inefficient and requires domain expertise.
method Reinforcement Learning (RL) to automate and optimize sensor configuration.
result RL can effectively learn and configure sensor sampling rates for optimal energy use and node operation.
Surveying low-cost sensors for air quality monitoring and calibration.
problem Limited spatial resolution due to expensive environmental monitoring stations.
method Low-cost sensors with machine learning for calibration.
result Machine learning improves sensor accuracy over time.
With automobiles becoming increasingly reliant on sensors to perform various driving tasks, it is important to encode the relevant CAN bus sensor data in a way that captures the general state of the vehicle in a compact form. In this paper, we develop a deep learning-based method, called Drive2Vec, for embedding such s…