Extracts behavioral features from smartphone and wearable data.
problem Processing raw data streams from smartphones and wearables for human behavior analysis.
method Generic framework for processing raw data streams and extracting behavioral features.
result Extracts useful features related to non-verbal human behavior from raw data streams.
Guidelines for deploying deep learning models on smartphones are developed.
problem Lack of unified guidelines for real-time deployment of deep learning solutions on smartphones.
method Unified flow of implementation for Android and iOS, use of multi-threading, benchmarking framework.
result Developed deployment approach allows easy conversion of deep learning models into real-time smartphone apps.
Study uses Android smartphones to measure road roughness, finds ML better than RMS.
problem Measuring road roughness using smartphones.
method Three smartphones, Android OS, RMS and ML methods, comparison with IRI.
result ML method outperforms RMS in detecting road roughness.
Study shows context-specific models improve swipe gesture authentication for smartphone users.
problem Improving swipe gesture-based continuous authentication for smartphones.
method Conducted experiments on HMOG dataset with 100 subjects, analyzing authentication error in different scenarios.
result Context-specific models are needed for different smartphone usage and human activity scenarios.
Deep learning diagnoses MS from smartphone data.
problem Diagnosing MS with complex clinical assessments and tests.
method Deep-learning approach using smartphone-derived digital biomarkers.
result Deep-learning models distinguish MS with 88% accuracy.
CalBehav models individual smartphone user behavior for calendar events.
problem Static calendar models do not reflect individual user behavior.
method Machine learning, context-aware, personalized model using time-series smartphone data.
result Data-driven model more effective for managing incoming mobile communications.
AppsPred predicts smartphone app usage based on context.
problem Predicting personalized usage behavior of smartphone apps based on contexts.
method Random Forest machine learning technique considering multi-dimensional contexts.
result AppsPred significantly outperforms other machine learning approaches in predicting smartphone apps.
Model predicts cognitive health risks based on smartphone usage patterns.
problem Identifying cognitive health risks through smartphone usage.
method Structured models of smartphone interactions analyzed over 12 weeks.
result AUROC of 0.79 in discriminating between healthy and symptomatic subjects.
Deep belief network improves smartphone activity recognition.
problem Activity recognition on mobile devices.
method Categorization through deep belief network.
result 98.25% correct diagnosis in training data, 93.01% in test data.
Deep learning gait recognition from smartphone data in unconstrained settings.
problem Gait recognition in unconstrained environments using smartphones.
method Hybrid deep neural network combining convolutional and recurrent neural networks for gait feature extraction.
result Achieves over 93% accuracy in person identification and authentication.
Smartphone app counts grapes for accurate yield estimation.
problem Accurate yield estimation at minimal cost.
method Adapted Deep Learning algorithms for crowd counting to fruit counting.
result Demonstrated smartphone app for grape yield estimation.
Smartphones can estimate heart rate from other sensor data.
problem Gaps in heart rate data from wearable sensors.
method Regression, SVM, and random forest algorithms to estimate heart rate from smartphone data.
result Smartphone data can improve heart rate estimation from wearable sensors.
Ensemble CNNs improve mode classification in smartphone travel surveys.
problem Classifying transportation modes from smartphone travel survey data.
method Developed an ensemble of CNN models with different architectures and hyper-parameters, combined using average voting, majority voting, optimal weights, and a Random Forest meta-learner.
result The ensemble method with Random Forest as meta-learner achieved 91.8% accuracy, surpassing other methods.
Study on hyperparameter optimization for smartphone-based HAR.
problem Maintaining stable classification accuracy in HAR systems with mobile devices.
method Semi-supervised classifier and study on hyperparameter configuration.
result Adjusting hyperparameters can maintain classification accuracy.
Semi-supervised GANs improve travel mode inference from GPS data.
problem Travel mode inference from GPS trajectories.
method Developed semi-supervised GANs and compared them with CNNs on a large-scale smartphone dataset.
result Best semi-supervised GAN model achieved 83.4% prediction accuracy.
Smartphone data shows promise but accuracy issues remain.
problem Inaccurate travel surveys from smartphone data.
method Training algorithms on data quality and validating labels.
result Machine learning methods are limited by data quality.
Model uses smartphone data to assess MS trajectories.
problem Personalized longitudinal MS assessment.
method Imputation, generalized estimation equation, ensemble learning, fine-tuning.
result Promising model for predicting MS over time.
This study uses smartphone data to predict when mood interventions are needed for bipolar disorder.
problem Chronic mental illness with extreme mood changes that lead to personal or social consequences.
method Anomaly detection framework using Temporal Normalization to predict mood anomalies from natural speech data.
result A framework for real-world speech-focused mood monitoring using deep learning.
The behaviors of patients with depression are usually difficult to predict because the patients demonstrate the symptoms of a depressive episode without a warning at unexpected times. The goal of this research is to build algorithms that detect signals of such unusual moments so that doctors can be proactive in approac…
Smartphone app diagnoses pulmonary diseases from chest X-rays.
problem Scarcity of training data and class imbalance issues.
method Data Augmentation Generative Adversarial Network (DAGAN) and Convolutional Siamese Network with attention mechanism.
result Achieved 99.30% and 98.40% testing accuracy on Binary/Multiclass scenarios.
As part of daily monitoring of human activities, wearable sensors and devices are becoming increasingly popular sources of data. With the advent of smartphones equipped with acceloremeter, gyroscope and camera; it is now possible to develop activity classification platforms everyone can use conveniently. In this paper,…
This paper discusses issues in mining user behavioral rules for context-aware mobile apps.
problem Mining contextual behavioral rules from smartphone data.
method Addressing quality of data, relevancy of contexts, discretization, rule discovery, semantic understanding, and dynamic rule updating.
result Potential solutions for mining user behavioral rules for context-aware mobile apps.
Study quantifies impacts of heterogeneity in FL on smartphone data.
problem Heterogeneity in FL devices causes performance degradation.
method Collected 136k smartphone data, built heterogeneity-aware FL platform, conducted extensive experiments.
result Heterogeneity causes up to 9.2% accuracy drop and 2.32x training time increase.
A two-layer classifier improves smartphone transportation mode recognition.
problem Improving accuracy of transportation mode classification.
method Two-layer hierarchical classifier combining time and frequency domain features.
result Maximum classification accuracy of 97.02%.
Machine learning detects road anomalies and aggressive driving from smartphone data.
problem Road quality assessment and aggressive driving detection.
method Machine learning techniques applied to smartphone acceleration data.
result Robust platform for road transport evaluation.
Study provides guidelines for smartphone-based transportation mode detection.
problem Developing a reliable transportation mode detection system using smartphone sensors.
method Detailed dataset construction, sensor relevance analysis, and unknown user detection.
result Demonstrated the feasibility and effectiveness of smartphone-based TMD.
Deep learning improves skin cancer detection.
problem Early detection of skin cancer is challenging due to lack of professionals and instruments.
method Overview of recent deep learning models applied to skin cancer detection.
result Deep learning models enhance skin cancer detection accuracy.
There is an increasing interest in exploiting mobile sensing technologies and machine learning techniques for mental health monitoring and intervention. Researchers have effectively used contextual information, such as mobility, communication and mobile phone usage patterns for quantifying individuals' mood and wellbei…
Proposes BehavDT model for context-aware user behavior prediction.
problem Building a context-aware predictive model based on diverse user behavioral activities.
method Introduces BehavDT, a behavioral decision tree that considers user behavior-oriented generalization.
result BehavDT model outperforms traditional machine learning approaches in predicting user diverse behaviors considering multi-dimensional contexts.
CADNN optimizes DNN execution on smartphones for real-time inference.
problem Executing Deep Neural Networks on mobile devices with low latency and high accuracy.
method Advanced model compression and architecture-aware optimization.
result CADNN outperforms state-of-the-art frameworks in DNN execution on mobile devices.
System recommends workouts and predicts success rates using RNNs.
problem Promoting healthy lifestyles through personalized exercise recommendations.
method Two interconnected recurrent neural networks (RNNs) using historical workout data.
result Interconnected-RNN model predicts exercise success rates with improved accuracy.
This paper addresses the problem of change-point detection on sequences of high-dimensional and heterogeneous observations, which also possess a periodic temporal structure. Due to the dimensionality problem, when the time between change-points is on the order of the dimension of the model parameters, drifts in the und…
Deep learning identifies smartphone users from motion sensor data.
problem Smartphone user identification using motion sensor signals.
method Transformed motion signals into images, trained CNN for classification, used SVM for few-shot identification.
result CNN achieved 89.75% multi-class user classification and 96.72% few-shot user identification accuracy.
Federated learning for data streams tackles real-time learning from IoT devices.
problem Efficiently learn from data streams generated by IoT devices and smartphones.
method Proposes a general federated learning algorithm for data streams using weighted empirical risk minimization.
result Demonstrates improved performance on various machine learning tasks compared to static dataset approaches.
DataLearner simplifies data mining on Android devices.
problem Lack of general-purpose data-mining tools for mobile devices.
method Augments Weka engine with Charles Sturt University algorithms, providing 40 mining algorithms.
result Delivers classification accuracy similar to PCs/laptops with acceptable speed and battery life.
Study integrates diverse data sources to predict mental health conditions.
problem Predict individuals' mental health conditions using a heterogeneous network approach.
method Leverage a heterogeneous information network (HIN) to model social interaction, health data, and survey data. Apply recommender system (RS) and node classification (NC) paradigms to predict mental health states.
result RS and NC methods outperform traditional logistic regression models in predicting mental health conditions.
An empirical investigation of active/continuous authentication for smartphones is presented in this paper by exploiting users' unique application usage data, i.e., distinct patterns of use, modeled by a Markovian process. Variations of Hidden Markov Models (HMMs) are evaluated for continuous user verification, and chal…
This paper evaluates features for assessing digital ophthalmoscopy image quality.
problem Accurate teleophthalmology requires high-quality ophthalmoscopic imagery.
method Statistical metrics, gradient-based metrics, and wavelet transform coefficient derived indicators were tested using machine learning.
result Suitability of features for image quality assessment confirmed, though on a small data set.
We utilize Wi-Fi communications from smartphones to predict their mobility mode, i.e. walking, biking and driving. Wi-Fi sensors were deployed at four strategic locations in a closed loop on streets in downtown Toronto. Deep neural network (Multilayer Perceptron) along with three decision tree based classifiers (Decisi…
ECC compresses DNNs for energy-constrained devices like UAVs and smartphones.
problem Energy-constrained deep neural networks in vision applications.
method ECC uses a bilinear regression model to estimate DNN energy consumption and optimizes compression to meet energy constraints.
result ECC achieves higher accuracy under the same or lower energy budget compared to state-of-the-art techniques.
Adaptive activity monitoring framework for wearable sensors.
problem Efficiently monitor human activities with low power consumption.
method Switching Gaussian process model with block circulant embedding and FFT for inference.
result Optimized trade-off between sensor power consumption and prediction performance.
Efficiently samples from large resolution images for faster inference.
problem Inferential and memory costs for large resolution images.
method Proposes a smaller proxy distribution to learn co-ordinates for regions of interest.
result Produces comparable results with ~10x faster inference and lower memory consumption.
Trans-Sense uses smartphones to predict public transit wait times and schedules.
problem Traffic congestion and lack of public transportation in developing countries.
method Crowdsourced mobile phones to estimate waiting times and transit schedules.
result Achieves high accuracy in predicting passenger arrival times and station dimensions.
Every year, 3 million newborns die within the first month of life. Birth asphyxia and other breathing-related conditions are a leading cause of mortality during the neonatal phase. Current diagnostic methods are too sophisticated in terms of equipment, required expertise, and general logistics. Consequently, early dete…
Federated learning framework extended for personalizing global models.
problem Evaluate personalization strategies for global models on-device.
method Extend federated learning framework, develop tools for analysis and evaluation.
result Personalization yields significant benefits for a large user population.
Self-supervised learning boosts HAR performance with minimal labeled data.
problem Lack of labeled data for HAR.
method Multi-task temporal convolutional network for feature learning.
result Self-supervised features improve HAR performance significantly with minimal labeled data.
Lung cancer continues to be a major healthcare challenge with high morbidity and mortality rates among both men and women worldwide. The majority of lung cancer cases are of non-small cell lung cancer type. With the advent of targeted cancer therapy, it is imperative not only to properly diagnose but also sub-classify …
We present and evaluate Deep Private-Feature Extractor (DPFE), a deep model which is trained and evaluated based on information theoretic constraints. Using the selective exchange of information between a user's device and a service provider, DPFE enables the user to prevent certain sensitive information from being sha…