Many methods have been used to recognize author personality traits from text, typically combining linguistic feature engineering with shallow learning models, e.g. linear regression or Support Vector Machines. This work uses deep-learning-based models and atomic features of text, the characters, to build hierarchical, …
Research has proven that stress reduces quality of life and causes many diseases. For this reason, several researchers devised stress detection systems based on physiological parameters. However, these systems require that obtrusive sensors are continuously carried by the user. In our paper, we propose an alternative a…
A new method reduces redundancy in multimodal data for improved inference.
problem Understanding and optimizing the contribution of each modality in multimodal tasks.
method Modality-based Tensor Factorization (MRRF) for multimodal fusion.
result Improves multimodal inference tasks by 1% to 4% compared to state-of-the-art.
Study reveals LLM personality patterns but lacks behavioral consistency.
problem Understanding and validating personality traits in LLMs.
method Characterized LLM personality across three dimensions: training dynamics, self-report validity, and intervention effects.
result Self-reported traits do not reliably predict behavior, and instructional alignment affects trait expression but not behavior.
Background doesn't affect personality predictions in deep networks.
problem Understanding how background images influence personality attribution in deep learning models.
method Explicitly studied the effect of background images on personality prediction in deep residual networks, controlling for confounds.
result Adding background information to input decreases model performance for personality trait prediction.
Study identifies personality traits from dance movements in music.
problem Predicting individual differences from music-induced movement.
method Identified Big Five personality traits and EQ/SQ scores from dance movements.
result Successfully explored unseen space for personality and EQ/SQ.
Model predicts personality traits from Facebook Likes.
problem Predicting personality traits from social media data.
method Mapped Facebook Likes to page categories, used machine learning.
result 83% accuracy distinguishing religious vs non-religious.
PerSense assesses personality traits from text for commonsense reasoning.
problem Estimating human personality traits from text for mental health analysis.
method Aggregated Probability Density Functions (PDF) and Machine Learning (ML) models.
result PerSense algorithms achieve comparable results to ground truth data, with high accuracy for personality assessment and commonsense prediction.
Neural network predicts nonlinear safety behavior based on personality traits.
problem Predicting construction workers' unsafe behaviors based on personality traits.
method Developed a forecasting model using neural network algorithms.
result Nonlinear relationship exists between personality traits and safety behavior.
LLMs can simulate human investment attitudes based on personality traits.
problem Investigating how LLMs mimic human investment behaviors.
method Simulated investment task using LLM personas with specific Big Five personality profiles.
result LLMs can produce meaningful behavioural differences in investment tasks that align with human traits.
Privacy-preserving method protects user speech data from cloud services.
problem Privacy compromise in cloud-based speech analysis.
method Collects and sanitizes speech data before sharing, using transformation functions and voice conversion.
result Identification of sensitive emotional state reduced by ~96%.
New game design method for better trait inference.
problem Inferring latent psychological traits from human behavior.
method Formulated as a mutual information maximization problem, solved using variational lower bound optimization.
result Designed games successfully distinguish among players with different traits, outperforming traditional methods.
IPGP framework improves psychological assessment by integrating shared and unique traits.
problem Tackles the debate on shared vs unique personality traits across individuals.
method Uses Gaussian process coregionalization model for non-Gaussian ordinal data, with stochastic variational inference for scalability.
result Improves prediction and estimation of individualized factor structures compared to existing methods.
Genome-wide association studies have proven to be essential for understanding the genetic basis of disease. However, many complex traits---personality traits, facial features, disease subtyping---are inherently high-dimensional, impeding simple approaches to association mapping. We developed a nonparametric Bayesian re…
Personalized activity recognition improves performance for diverse users.
problem Poor performance of impersonal algorithms for individual users.
method Personalized activity recognition using deep embeddings from a fully convolutional neural network with triplet loss.
result Novel subject triplet loss provides the best performance overall.
Paper uses language models to predict MBTI personality types with high accuracy.
problem Predicting Myers-Briggs personality types from text.
method Fine-tuned BERT model for predicting MBTI types and generating personality-specific language.
result BERT model achieves high accuracy in predicting MBTI types and personality-specific language generation.
We propose a tri-modal architecture to predict Big Five personality trait scores from video clips with different channels for audio, text, and video data. For each channel, stacked Convolutional Neural Networks are employed. The channels are fused both on decision-level and by concatenating their respective fully conne…
Mobile training improves speech recognition for users with unique speech characteristics.
problem Limited generalization of speaker-independent speech recognition models for users with very different speech characteristics.
method Securely training personalized end-to-end speech recognition models on mobile devices, splitting gradient computation to reduce memory usage.
result On-device personalization achieved 58.1% relative word error rate reduction compared to 63.7% in a server environment, with 18.7% performance degradation.
Mobile app improves speech recognition of names with user feedback.
problem Improving speech recognition of proper names on mobile devices.
method Data synthesis and user feedback for keyword-dependent metrics.
result User feedback can significantly improve speech recognition of names.
Machine learning improves predicting species interactions based on traits.
problem Variability in empirical trait-matching studies for ecological networks.
method Compared conventional GLMs with ML models (Random Forest, Boosted Regression Trees, etc.) on simulated and real data.
result ML models outperform GLMs in predicting species interactions and identifying trait-matching combinations.
PSI-KT improves KT accuracy and interpretability in learning materials.
problem Optimizing learning materials selection and timing for understanding and retention.
method Hierarchical generative approach using Bayesian inference.
result Superior multi-step predictive accuracy and scalable inference.
Real-time personalization for HAR models learns from new users without prior data.
problem Poor performance of HAR models on new users without labeled data.
method Incremental online domain adaptation using batch normalization.
result Personalized HAR models adapt to new users in real-time.
Although highly correlated, speech and speaker recognition have been regarded as two independent tasks and studied by two communities. This is certainly not the way that people behave: we decipher both speech content and speaker traits at the same time. This paper presents a unified model to perform speech and speaker …
Study predicts social relationships using triadic influence from social networks.
problem Difficulty in quantifying social relationships and their dynamics.
method Real social networks of 13 schools, neural networks, high-dimensional embedding.
result Triadic influence achieves highest accuracy in predicting student relationships.
This paper addresses the problem of emotion recognition from physiological signals. Features are extracted and ranked based on their effect on classification accuracy. Different classifiers are compared. The inter-subject variability and the personalization effect are thoroughly investigated, through trial-based and su…
Person recognition aims at recognizing the same identity across time and space with complicated scenes and similar appearance. In this paper, we propose a novel method to address this task by training a network to obtain robust and representative features. The intuition is that we directly compare and optimize the cosi…
Deep learning gait recognition from smartphone data in unconstrained settings.
problem Gait recognition in unconstrained environments using smartphones.
method Hybrid deep neural network combining convolutional and recurrent neural networks for gait feature extraction.
result Achieves over 93% accuracy in person identification and authentication.
Personal VAD detects target speaker voice activity efficiently.
problem Efficiently detect target speaker voice activity for reduced computational cost and battery usage.
method Trains a neural network conditioned on speaker embedding or verification score, outputs probabilities for three speech classes.
result Trained model with 130K parameters outperforms combined standard VAD and speaker recognition networks.
We study the dynamics of co-evolution of producers and customers described by bit-strings representing individual traits. Individual ''size-like'' properties are controlled by binary encounters which outcome depends upon a recognition process. Depending upon the parameter set-up, mutual selection of producers and custo…
We design, conduct and present the results of a highly personalized baseline emotion recognition experiment, which aims to set reliable ground-truth estimates for the subject's emotional state for real-life prediction under similar conditions using a small number of physiological sensors. We also propose an adaptive st…
We build CSI-Net, a unified Deep Neural Network~(DNN), to learn the representation of WiFi signals. Using CSI-Net, we jointly solved two body characterization problems: biometrics estimation (including body fat, muscle, water, and bone rates) and person recognition. We also demonstrated the application of CSI-Net on tw…
Paper proposes a method to encrypt faces while maintaining visual similarity.
problem Protecting personal data from unauthorized face recognition.
method Targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks.
result TIP-IM provides 95%+ protection success rate against face recognition models.
Study provides long-term EMG data for multi-day biometric authentication.
problem Limited long-term EMG data for multi-day biometric authentication.
method Collected EMG data from 43 participants over three days.
result Multi-day biometric authentication results in low error rates.
Transfer learning improves activity recognition accuracy on smartwatches.
problem Inconsistent activity recognition accuracy across different users.
method On-device calibration of GBM by tuning parameters without retraining.
result Significant improvement in user-based accuracy for activity recognition.
New method identifies rare genetic markers for Alzheimer's disease using MRI and genomics.
problem Identifying rare genetic markers for Alzheimer's disease.
method Combining MRI data with genome sequencing, using CNNs for brain traits, and kernel-based tests for rare variants.
result CNNs provide precise brain traits and novel kernels identify rare genetic markers.
We provide a benchmark dataset for hand gesture recognition using force myography.
problem Lack of publicly available benchmark data for force myography hand gesture recognition.
method Collected data from 20 persons covering 18 unique gestures using a commercially available sensor setup.
result Improved gesture recognition accuracy through transfer learning.
FMP improves personalized ASR models on private devices.
problem Limited accuracy and privacy in federated fine-tuning of ASR models.
method FMP estimates global and personalized marginal distributions and adjusts NNLM probabilities.
result FMP achieves modest WER reductions on ASR rescoring tasks.
New approach uses graphs for sign language recognition.
problem Challenges in recognizing sign language for deaf individuals.
method Spatial-Temporal Graph Convolutional Network.
result Improved sign language recognition using human skeletal movements.
Proposes a neural network for recognizing 3D skeleton-based interactions.
problem Recognizing two-person interactions from 3D skeleton sequences.
method Uses Gaussian distributions and Riemannian geometry of SPD matrices and matrix groups.
result Achieves competitive results on three benchmarks for 3D human activity understanding.
Noise makes data unlearnable by tricking models.
problem Unauthorized exploitation of personal data by deep learning models.
method Error-minimizing noise to reduce training examples' learnability.
result Error-minimizing noise can make training examples unlearnable by deep learning models.
Study shows semi-supervised learning improves human activity recognition with minimal user input.
problem Improving human activity recognition models using incremental learning.
method Three approaches: non-supervised, semi-supervised, and supervised learning were compared.
result Semi-supervised learning achieves similar accuracy to supervised learning with minimal user input.
Paper tackles activity recognition from body-worn video footage.
problem Classifying frames of body-worn video footage according to the wearer's activity.
method Extract motion features and semi-supervised classification.
result Method achieves comparable results to supervised and deep learning methods using less training data.
Method distinguishes genetic correlations from causation in GWAS.
problem Identifying causal relationships among genetically correlated traits.
method Mixed fourth moments to quantify causal relationships.
result Identified 30 putative genetically causal relationships across 52 traits.
Many complex disease syndromes such as asthma consist of a large number of highly related, rather than independent, clinical phenotypes, raising a new technical challenge in identifying genetic variations associated simultaneously with correlated traits. In this study, we propose a new statistical framework called grap…
Improved action detection for multi-person videos using attention filtering.
problem Difficulty in distinguishing relevant parts of multi-person videos for action detection.
method Fovea attention filtering and generalized binary loss function.
result 20% relative improvement in mAP over baseline in AVA dataset.
RLMM extends psychometric models to larger tasks.
problem Sequential process data from interactive assessments are not well handled by conventional models.
method RLMM decouples person-level choice sensitivity from task-level value representation through a shared parametric action-value function.
result RLMM achieves higher estimation accuracy and lower runtime than MDP-MM in peg-solitaire simulations and AQUALAB gameplay logs.
A novel tracking method for dense honeybee colonies using pixel personality.
problem Tracking large numbers of densely-arranged, interacting objects in a 2D environment.
method Segmentation-based object detection followed by adaptive object recognition through visual appearance.
result Reconstructed ~46% of trajectories in 5 minutes and 71% of tracks for at least 2 minutes.
Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the interactions within each modality (intra-modal interactions) but more importantly the in…