Gait patterns reveal emotions, offering a non-invasive method for automated recognition.
problem Automated emotion recognition from gait patterns.
method Data collection, preprocessing, and classification techniques.
result Gait patterns can indicate different emotion states, making them a promising source for emotion detection.
Compared to other biometrics, gait is difficult to conceal and has the advantage of being unobtrusive. Inertial sensors, such as accelerometers and gyroscopes, are often used to capture gait dynamics. These inertial sensors are commonly integrated into smartphones and are widely used by the average person, which makes …
Deep learning identifies unique walking patterns from pressure data.
problem Tackling the challenge of accurately identifying individuals based on their walking style.
method Used deep learning, specifically convolutional neural networks (CNNs), to analyze the center-of-pressure trajectory of 36 adults walking on a treadmill.
result CNNs achieved 99.9% accuracy in classifying 2,250 segments and 100% accuracy in fine-tuning a subset of 4,500 segments, suggesting unique pressure patterns for each person.
Gait is a person's natural walking style and a complex biological process that is unique to each person. Recently, the channel state information (CSI) of WiFi devices have been exploited to capture human gait biometrics for user identification. However, the performance of existing CSI-based gait identification systems …
In quadruped gait learning, policy search methods that scale high dimensional continuous action spaces are commonly used. In most approaches, it is necessary to introduce prior knowledge on the gaits to limit the highly non-convex search space of the policies. In this work, we propose a new approach to encode the symme…
Phone sensors could be useful in assessing changes in gait that occur with alcohol consumption. This study determined (1) feasibility of collecting gait-related data during drinking occasions in the natural environment, and (2) how gait-related features measured by phone sensors relate to estimated blood alcohol concen…
Study investigates XAI methods in clinical gait analysis.
problem Limited understanding of machine learning models in healthcare.
method XAI methods, specifically Layer-wise Relevance Propagation (LRP), to explain ML predictions.
result Explanations from LRP show promising statistical and clinical relevance.
Machine learning improves accuracy of running gait event detection from tibial acceleration.
problem Accurate detection of running gait events from tibial acceleration data.
method Structured machine learning models compared to heuristic methods.
result Structured recurrent neural network model offers most accurate estimation of gait events.
Paper predicts TUG score from gait characteristics using machine learning.
problem Assessing fall risk in the elderly.
method 3D pose estimation, gait characteristics computation, copula entropy selection, predictive models.
result Effectiveness of the proposed method demonstrated on real-world data.
Machine learning (ML) techniques such as (deep) artificial neural networks (DNN) are solving very successfully a plethora of tasks and provide new predictive models for complex physical, chemical, biological and social systems. However, in most cases this comes with the disadvantage of acting as a black box, rarely pro…
ES-VAE models skeletal pose trajectories by removing nuisance factors.
problem Handling camera orientation, subject scale, viewpoint, and execution speed in skeletal data.
method ES-VAE uses TSRVF representation on Kendall's shape manifold to isolate shape dynamics.
result ES-VAE outperforms standard VAEs and sequence modeling baselines in gait cycle prediction and action recognition.
New approach improves human activity recognition with wearables.
problem Improving human activity recognition with wearables.
method Exploiting latent relationships between multi-channel sensor modalities, data-agnostic augmentation, and a classification loss criterion.
result Achieves new state-of-the-art performance on four diverse activity recognition benchmarks.
Study uses GMM-UBM and i-vectors to assess Parkinson's patients via speech, handwriting, and gait.
problem Assessing neurological state of Parkinson's disease patients using speech, handwriting, and gait signals.
method GMM-UBM and i-vectors applied to speech, handwriting, and gait signals.
result Different feature sets from each signal are crucial for assessing Parkinson's patients.
GAIT-prop derives a biologically plausible learning rule from backpropagation.
problem Biological implausibility in traditional backpropagation for neural networks.
method GAIT-prop uses a top-down model to convert output error into plausible targets for weight updates.
result GAIT-prop and backpropagation give identical weight updates under certain conditions.
This study compares different data preprocessing methods for gait analysis.
problem Improving the generalizability of machine learning models in gait analysis.
method Compared various data preprocessing steps including filtering, time derivative, normalization, and scaling.
result Different preprocessing combinations affect gait classification performance.
New system uses wearable bio-signals for easy authentication.
problem Security of private information on wearables is a concern.
method Context-dependent soft-biometric authentication using heart rate, gait, and breathing audio.
result Binary SVM with RBF kernel achieves high accuracy and low EER.
The design of gaits for robot locomotion can be a daunting process which requires significant expert knowledge and engineering. This process is even more challenging for robots that do not have an accurate physical model, such as compliant or micro-scale robots. Data-driven gait optimization provides an automated alter…
New gait segmentation method identifies users and adversaries with high accuracy.
problem Simultaneous identification of users and adversaries from accelerometer data.
method Geometric features and a new similarity metric for time series analysis.
result 98.79% accuracy for 6 classes (user-adversary identification) and 99.06% for binary (user only identification).
Deep RNN detects FoG episodes in Parkinson's disease with high accuracy.
problem Detecting freezing episodes in Parkinson's disease patients.
method Deep Recurrent Neural Network (RNN) with Long Short-Term Memory cells on 3D-accelerometer measurements.
result Frequency domain features from trunk sensor achieve an AUC score of 93% in subject-independent method.
Pre-trained model from healthy ADLs improves gait pattern classification for Parkinson's disease.
problem Limited training data for deep learning models in healthcare applications.
method Used convolutional autoencoder to extract features from healthy ADLs data and trained a multi-layer perceptron model for Parkinson's disease classification.
result Features extracted from healthy ADLs data can be used to train an effective classification model for Parkinson's disease.
Wi-Fi signals-based person identification attracts increasing attention in the booming Internet-of-Things era mainly due to its pervasiveness and passiveness. Most previous work applies gaits extracted from WiFi distortions caused by the person walking to achieve the identification. However, to extract useful gait, a p…
Machine learning classifies Parkinson's Disease stages from walker sensors data.
problem Limited cost-effective methods for quantitatively assessing Parkinson's Disease stages.
method Machine learning applied to walker-mounted sensors data, feature selection methods compared.
result Feature selection method using ANOVA provides similar accuracy to full feature set and is clinically interpretable.
PerCDL learns personalized dictionaries for physiological signals combining global and local structures.
problem Representing datasets with both global and local structures in human physiological signals.
method Personalized Convolutional Dictionary Learning (PerCDL) that combines a global and personalized local dictionary.
result PerCDL effectively learns interpretable representations for human locomotion data.
Bayesian model predicts circular data with fast Gibbs sampling.
problem Predicting circular data in scientific fields.
method Expressive von Mises quasi-processes with Stratonovich augmentation for posterior inference.
result Fast Gibbs sampling for posterior inference.
Model uses smartphone data to assess MS trajectories.
problem Personalized longitudinal MS assessment.
method Imputation, generalized estimation equation, ensemble learning, fine-tuning.
result Promising model for predicting MS over time.
Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning locomotion skills with minimal engineering and without an explicit model of the robot…
Study shows not all ML models are uniquely identifiable from data.
problem Identifiability issues in machine learning models.
method Investigated through a case study on gait dynamics using a bipedal-spring mass model.
result Some parameters can be identified, but others remain unidentifiable.
The Poincaré map is widely used to study the qualitative behavior of dynamical systems. For instance, it can be used to describe the existence of periodic solutions. The Poincaré map for dynamical systems with impulse effects was introduced in the last decade and mainly employed to study the existence of limit cycles (…
TEASER improves early time series classification accuracy and speed.
problem Early and accurate classification of time series data.
method TEASER models eTSC as a two-tier classification problem, using a first-tier classifier to assess class probabilities and a second-tier to decide reliability.
result TEASER is two to three times faster at predictions than competitors while maintaining or improving accuracy.
We advocate the use of a notion of entropy that reflects the relative abundances of the symbols in an alphabet, as well as the similarities between them. This concept was originally introduced in theoretical ecology to study the diversity of ecosystems. Based on this notion of entropy, we introduce geometry-aware count…
We use reinforcement learning (RL) to learn dexterous in-hand manipulation policies which can perform vision-based object reorientation on a physical Shadow Dexterous Hand. The training is performed in a simulated environment in which we randomize many of the physical properties of the system like friction coefficients…
Improved speech recognition using EEG and video.
problem Enhancing continuous speech recognition systems.
method Implemented a CTC-based ASR model using EEG features.
result EEG features improve continuous visual speech recognition.
Study shows emotion affects speaker recognition and vice versa.
problem Dependencies between emotion and speaker recognition.
method Transfer learning and fine-tuning for emotion classification.
result Fine-tuning improves emotion recognition performance by 30.40% on IEMOCAP, 7.99% on MSP-Podcast, and 8.61% on Crema-D.
With the recent renaissance of deep convolution neural networks, encouraging breakthroughs have been achieved on the supervised recognition tasks, where each class has sufficient training data and fully annotated training data. However, to scale the recognition to a large number of classes with few or now training samp…
New proof for sphere recognition algorithm.
problem Sphere recognition algorithm proof.
method New proof of a lemma in Abigail Thompson's algorithm.
result New proof of a lemma in Abigail Thompson's proof of the Recognition Algorithm for 3-spheres.
Continuous speech recognition from brain activity without vocalization.
problem Recognizing silent speech from EEG signals.
method Implemented a CTC ASR model using EEG signals.
result Demonstrated feasibility of EEG for continuous silent speech recognition.
VoxCeleb 2019 challenge assesses speaker recognition in uncontrolled settings.
problem Evaluate speaker recognition technology in unconstrained data.
method Public dataset, challenge, and workshop at Interspeech 2019.
result Baseline results and discussions provided.
Paper proposes Roweisposes for 3D action recognition using generalized eigenvalue problem.
problem Need for basic methods in 3D action recognition.
method Roweisposes uses Roweis discriminant analysis for generalized subspace learning.
result Roweisposes is effective for 3D action recognition.
This is a survey article on recognition problem of frontal singularities. We specify geometrically several frontal singularities and then we solve the recognition problem of such singularities, giving explicit normal forms. We combine the recognition results by K. Saji and several arguments on openings, which was perfo…
Paper tackles zero-shot activity recognition using video features and text embeddings.
problem Zero-shot activity recognition with videos.
method Auto-encoder model for multimodal joint embedding, 3D convolutional action recognition for visual features, GloVe word embeddings for textual features.
result Improved zero-shot recognition results with top-n accuracy and mean Nearest Neighbor Overlap.
A new deep neural network improves short-speech recognition.
problem Improving speaker recognition for short-duration speech segments.
method Proposes UtterIdNet, a novel deep neural network architecture.
result Consistent and stable performance for short segments, especially sub-second durations.
Paper explores EEG-based speech recognition using transformers, showing faster training and better performance for smaller vocabularies.
problem Continuous speech recognition using EEG features.
method Transformer-based ASR model compared to RNN-based models.
result Transformer models perform better for smaller vocabularies but RNN models outperform them for larger vocabularies.
EmbraceNet fusion model for multi-sensor activity recognition.
problem Human activity recognition using multiple sensors is challenging.
method Independent processing of each sensor, feature fusion with EmbraceNet, post-processing, and additional processes.
result Improved performance in SHL recognition challenge.
Paper improves EEG-based speech recognition using CTC and beam search.
problem Improving continuous speech recognition from EEG signals.
method Implemented CTC-based ASR system, initialized weights, used external language model, studied articulatory feature prediction.
result Enhanced performance of EEG-based speech recognition systems.
In this paper we demonstrate end-to-end continuous speech recognition (CSR) using electroencephalography (EEG) signals with no speech signal as input. An attention model based automatic speech recognition (ASR) and connectionist temporal classification (CTC) based ASR systems were implemented for performing recognition…
TransFall uses transfer learning to improve activity recognition from mobile sensors.
problem Performance degradation due to platform and user movement differences.
method Two-tier data transformation, label estimation, and model generation layers.
result TransFall enhances activity recognition accuracy for new scenarios.
AV-CPL uses continuous pseudo-labels for AVSR combining labeled and unlabeled data.
problem Improving AVSR performance with labeled and unlabeled data.
method Semi-supervised method using continuous pseudo-labels generated by the same AVSR model.
result Significant improvements in VSR performance on LRS3 dataset.
Neural network framework for language recognition considers sequence information and improves accuracy.
problem Challenging task of automatic language identification in noisy conditions.
method Proposes a neural network framework with bidirectional LSTM and attention modeling for relevance weighting.
result Significant improvements over conventional methods in noisy conditions and multi-speaker speech.