Paper explores the impact of training data size on eating gesture recognition.
problem Uncertainty in recognition accuracy with larger data sets in natural settings.
method Collection and annotation of 51,614 eating gestures from 269 subjects; experiments with hidden Markov models (HMMs).
result HMMs need 13 states and 5 Gaussians to reach plateau in accuracy; 65 samples per gesture type are needed for optimal recognition.
Smart watches can identify smoking gestures with high accuracy.
problem Identifying smoking gestures to prevent relapses.
method Used accelerometer sensors in smart watches and Artificial Neural Networks (ANNs).
result 85%-95% success rates in identifying smoking gestures.
Tiny Eats GRU detects eating episodes on a microcontroller.
problem Automatic dietary monitoring on low-power devices.
method Shallow gated recurrent unit (GRU) architecture on Arm Cortex M0+.
result Tiny Eats GRU achieves 95.15% accuracy with 4% memory usage and 6 ms latency.
Technical report predicts eating and food purchasing behaviors of free-living individuals.
problem Predicting eating and food purchasing behaviors of free-living individuals.
method Applied multiple machine learning algorithms (Logistic Regression, RBF-SVM, Random Forest, Gradient Boosting) to minute-level features from sensors and environmental context.
result Gradient Boosting model had the highest mean accuracy score (0.7289) for predicting eating events before 0 to 4 minutes.
ED-Filter improves eating disorder classification on Twitter.
problem High dimensionality and extensive feature sets in Twitter data for ED classification.
method Informed branch and bound search technique with hybrid greedy-based deep learning.
result Significant improvements in classification accuracy and efficiency.
Paper explores using hand gestures to type English letters.
problem Creating easy-to-remember, non-cumbersome gestures for typing.
method Statistical approach to handle randomness in hand movements.
result Achieved 97.33% accuracy with entire English alphabet.
New dataset for UAV gesture recognition in outdoor settings.
problem Lack of public outdoor UAV gesture recognition datasets.
method Recorded 13 gestures in an outdoor setting, created 119 HD video clips, annotated with body joints and gesture classes.
result Baseline gesture recognition performance of 91.9% using P-CNN.
Improved gesture recognition using compressed domain signals.
problem Efficient gesture recognition in compressed domain.
method Direct gesture feature extraction from compressed measurements, improved DTW-based K-NN classifiers.
result Strong support for the proposed algorithm in simulations and hardware.
Wi-Fringe recognizes named gestures using WiFi CSI without training data.
problem Lack of training data for WiFi-based gesture recognition.
method WiFi CSI values paired with activity names for recognition.
result Wi-Fringe detects activities with or without training data.
Modified EAT method improves Poisson gradient estimation.
problem Challenging differentiation through Poisson-distributed latent variables.
method Exponential Arrival Time (EAT) simulation with modifications and Gumbel-SoftMax relaxation.
result Modified EAT method provides unbiased first moment and reduced second-moment bias.
Traditional vision-based hand gesture recognition systems is limited under dark circumstances. In this paper, we build a hand gesture recognition system based on microwave transceiver and deep learning algorithm. A Doppler radar sensor with dual receiving channels at 5.8GHz is used to acquire a big database of hand ges…
We propose a fully automatic method for learning gestures on big touch devices in a potentially multi-user context. The goal is to learn general models capable of adapting to different gestures, user styles and hardware variations (e.g. device sizes, sampling frequencies and regularities). Based on deep neural networks…
We provide a benchmark dataset for hand gesture recognition using force myography.
problem Lack of publicly available benchmark data for force myography hand gesture recognition.
method Collected data from 20 persons covering 18 unique gestures using a commercially available sensor setup.
result Improved gesture recognition accuracy through transfer learning.
FineHand learns hand shapes for better ASL recognition.
problem Difficult ASL recognition due to fast, articulate gestures.
method Combines manual and deep learning for hand shape embeddings, uses RNN for sequential gestures.
result Improved video gesture recognition accuracy on GMU-ASL51 benchmark.
A framework for real-time gesture recognition in tomato grafting.
problem Efficiently recognizing and tracking hand gestures for manual tasks.
method Sliding window filtering and decision tree model for real-time recognition.
result Average accuracy of 91% in recognizing gestures in real time.
Neuro-robotics model shows gestures improve counting ability.
problem Improving counting ability in robots and children.
method Introduces a neuro-robotics model trained with pointing data, tests various model and training conditions.
result Model's performance aligns with human children's learning to count.
In this report, an automated bartender system was developed for making orders in a bar using hand gestures. The gesture recognition of the system was developed using Machine Learning techniques, where the model was trained to classify gestures using collected data. The final model used in the system reached an average …
Study shows context-specific models improve swipe gesture authentication for smartphone users.
problem Improving swipe gesture-based continuous authentication for smartphones.
method Conducted experiments on HMOG dataset with 100 subjects, analyzing authentication error in different scenarios.
result Context-specific models are needed for different smartphone usage and human activity scenarios.
Deep-learning method improves sEMG-based gesture recognition accuracy.
problem Inter-session and inter-subject variances in sEMG-based gesture recognition.
method Recurrent Neural Networks and Domain Adaptation method.
result Our approach outperforms state-of-the-art methods in recognition accuracy.
This paper explores supervised techniques for continuous anomaly detection from biometric touch screen data. A capacitive sensor array used to mimic a touch screen as used to collect touch and swipe gestures from participants. The gestures are recorded over fixed segments of time, with position and force measured for e…
New metric and method for sEMG-based gesture recognition under domain shifts.
problem Measuring and adapting to domain divergence in sEMG-based gesture recognition.
method Probability distribution-based metric, 2-stage autoregressive RNN architecture.
result Improved autoregressive, RNN-based architecture enhances performance.
Paper introduces a method for generating interlocutor-aware facial gestures in dyadic settings.
problem Generating appropriate non-verbal behavior for conversational agents in dyadic settings.
method Probabilistic method using multi-modal cues from the interlocutor to synthesize facial gestures.
result The model successfully leverages multi-modal input from the interlocutor to generate more appropriate behavior.
Deep neural networks improve sEMG-based hand gesture classification.
problem Accurate classification of hand gestures from sEMG signals.
method Master-slave architecture with DNNs and synthetic feature data.
result Up to 9% improvement in accuracy with synthetic data.
Human computer interaction facilitates intelligent communication between humans and computers, in which gesture recognition plays a prominent role. This paper proposes a machine learning system to identify dynamic gestures using tri-axial acceleration data acquired from two public datasets. These datasets, uWave and So…
Deep neural network improves hand gesture classification from wearable IMUs.
problem Classifying hand gestures from wearable IMUs using conventional methods.
method Deep Neural Network (DNN) with optimization objective for signal fitting.
result 3-5% improvement in classification accuracy compared to SVM and kNN.
Enhances hand gesture recognition with separate networks and shared features.
problem Improving recognition accuracy of unimodal 3D-CNNs for dynamic hand gestures.
method Separate networks for each modality, collaborative learning, spatiotemporal semantic alignment loss, focal regularization.
result Improves test time recognition accuracy and state-of-the-art performance.
Recent studies have demonstrated the power of recurrent neural networks for machine translation, image captioning and speech recognition. For the task of capturing temporal structure in video, however, there still remain numerous open research questions. Current research suggests using a simple temporal feature pooling…
Game aims to improve social interactions for teenagers with ASD.
problem Improving social interactions for teenagers with ASD.
method Presentation of game structure, skeleton detection, and imitation learning methods.
result Game structure and support tools for skeleton detection and imitation learning presented.
Dual-stage sEMG classification improves gesture recognition accuracy.
problem Improving accuracy in hand gesture recognition from sEMG signals.
method Dual-stage classification approach: first stage groups similar activities, second stage classifies within groups.
result Dual-stage classification yields significantly higher accuracy than single-stage approach.
New dataset improves EMG gesture recognition accuracy.
problem Discrepancy between offline and online EMG gesture recognition accuracy.
method Recorded dynamic dataset using virtual reality and EMG-independent controller.
result TADANN algorithm consistently outperforms fine-tuning for long-term gesture recognition.
Designing of touchless user interface is gaining popularity in various contexts. Using such interfaces, users can interact with electronic devices even when the hands are dirty or non-conductive. Also, user with partial physical disability can interact with electronic devices using such systems. Research in this direct…
Hidden Markov Models detect hand gestures from wearable sEMG signals.
problem Detecting activity regions in continuous sEMG signals.
method Hidden Markov Models applied to sEMG signals for gesture recognition.
result Average accuracy of 96.25% for activity onsets and 87.5% for activity terminations.
Study provides long-term EMG data for multi-day biometric authentication.
problem Limited long-term EMG data for multi-day biometric authentication.
method Collected EMG data from 43 participants over three days.
result Multi-day biometric authentication results in low error rates.
Game teaches ASD teenagers to imitate gestures.
problem Improving social interactions of ASD teenagers.
method Adapted robot-based imitation game with machine learning for pose detection.
result Preliminary results show game can elicit expected responses.
Many real-valued stochastic time-series are locally linear (Gassian), but globally non-linear. For example, the trajectory of a human hand gesture can be viewed as a linear dynamic system driven by a nonlinear dynamic system that represents muscle actions. We present a mixed-state dynamic graphical model in which a hid…
Hypernom is a virtual reality game. The cells of a regular 4D polytope are radially projected to S^3, the sphere in 4D space, then stereographically projected to 3D space where they are viewed in the headset. The orientation of the headset is given by an element of the group SO(3), which is also a space that is double …
In recent years, deep learning algorithms have become increasingly more prominent for their unparalleled ability to automatically learn discriminant features from large amounts of data. However, within the field of electromyography-based gesture recognition, deep learning algorithms are seldom employed as they require …
Master thesis applies deep learning to sEMG hand gesture recognition, improving accuracy.
problem Reliability issues in sEMG-based hand gesture recognition due to motion artefacts and variability.
method Used deep learning on Unibo-INAIL dataset, collecting data over 8 sessions of 7 subjects.
result Deep learning architecture yields 81.2% inter-posture test accuracy and 75.9% inter-day test accuracy.
XceptionTime improves hand gesture recognition accuracy using novel deep learning.
problem Improving hand gesture recognition from sparse sEMG signals.
method Depthwise separable convolutions, adaptive pooling, non-linear normalization.
result Significantly improved accuracy (5.71% improvement) in hand gesture recognition.
Model classifies hand gestures with low EMG samples augmented with noise.
problem Classify hand gestures with limited EMG data.
method Random variance Gaussian noise augmentation, Random Forest, XGBoost.
result High accuracy model for six hand gestures.
Efficient SNN on Loihi achieves high gesture recognition accuracy.
problem Real-time gesture recognition using event-based sensors.
method Design and training of SNN, conversion from DNN, pre-processing of DVS data.
result 89.64% classification accuracy with 37 Loihi cores.
New method estimates treatment effects in network data, accounting for spillover effects.
problem Treatment effect estimation in networks with spillover effects.
method Augmented inverse probability weighting (AIPW) with cross-fitting and machine learning.
result Semiparametric treatment effect estimator converges at parametric rate and follows Gaussian distribution.
Based on a faithful representation of the heavy tail multivariate distribution of asset returns introduced previously (Sornette et al., 1998, 1999) that we extend to the case of asymmetric return distributions, we generalize the return-risk efficient frontier concept to incorporate the dimensions of large risks embedde…
Simple attention model outperforms complex sEMG classifiers.
problem Improving myoelectric control for robotic prosthetics.
method Attention-based model for sEMG signal classification.
result Simple model achieves benchmark results on multiple datasets.
Study uses non-invasive sensors to assess microbial contamination in green salads.
problem Assessing microbial contamination in ready-to-eat green salads.
method Unified spectra analysis workflow with data normalization, feature selection, and partial least squares regression.
result Unified workflow provides efficient estimation of microbial contamination and shelf life.
Proposes CVKT to complete missing kernel matrices across multiple views.
problem Missing data in multiple views of kernel matrices.
method Cross-View Kernel Transfer (CVKT) with kernel alignment.
result Predicts missing values in kernel matrices using other views' data.
BERT improves machines' ethical and moral decision-making.
problem Teaching machines ethical and moral choices.
method Applying BERT to human texts to extract moral bias scores.
result BERT improves the moral compass of machines.
First ABAW 2020 Competition analyzes affective behavior tasks.
problem Automatic analysis of valence-arousal, basic expressions, and action units in real-world scenarios.
method Provided Aff-Wild2 database, described Challenges, evaluation metrics, and top-performing systems.
result Demonstrated the feasibility of automatic affective behavior analysis in real-world settings.