Wearable devices have the potential to enhance sports performance, yet they are not fulfilling this promise. Our previous studies with 6 professional tennis coaches and 20 players indicate that this could be due the lack of psychological or mental state feedback, which the coaches claim to provide. Towards this end, we…
A new method combines human feedback with deep learning for faster policy learning.
problem Training deep neural networks for complex decision-making problems is data-intensive and time-consuming.
method Deep COACH (D-COACH) integrates human corrective feedback with deep learning models.
result The D-COACH framework can learn policies for continuous action spaces faster than traditional deep reinforcement learning.
Deep COACH learns complex tasks from human feedback in Minecraft.
problem Learning complex behaviors from human feedback efficiently.
method Deep reinforcement learning with policy updates based on human critiques.
result Demonstrated effectiveness in Minecraft with reduced sample complexity.
Modeling investor behavior from financial advisor notes using NLP.
problem Identifying behavioral coaching opportunities for financial advisors.
method Topic modeling and supervised classification model.
result Predicting investor needs during adverse market conditions.
TacticAI helps football coaches improve tactics by analyzing corner kicks.
problem Developing effective responses to rival teams' tactics algorithmically.
method TacticAI combines predictive and generative components to suggest player setups and position adjustments.
result TacticAI's model suggestions are favored over existing tactics 90% of the time by football domain experts.
Framework analyzes physical metrics in soccer to link performance with value.
problem Understanding and quantifying the value of physical performance in soccer.
method Estimating physical indicators from tracking data, contextualizing runs, linking with possession-value model.
result Physical performance correlates with value generation in soccer.
Paper simplifies complex sports analytics models for better understanding.
problem Difficulty in interpreting deep learning models for sports analytics.
method Developed a linear model tree that mimics deep learning models and explains its knowledge.
result The linear model tree achieves high accuracy and provides actionable insights.
New method learns text generation orders without pre-specification.
problem Generating text in arbitrary orders without manual specification.
method Generates text in non-monotonic orders using a binary tree structure and imitation learning.
result Models can generate text without pre-specifying an order, achieving competitive performance.
New algorithm learns Gaussian policies from corrective human feedback, outperforming current methods.
problem Learning from corrective human feedback for complex systems.
method Gaussian Process Coach (GPC) that uses Gaussian Processes and policy uncertainty for optimal feedback selection and learning rate adaptation.
result Demonstrated superior performance in OpenAI Gym benchmarks compared to COACH.
Improves AI system's understanding of human inputs by creating better examples.
problem AI systems misinterpret human inputs, leading to inefficiencies.
method Developed a conditional convolutional autoencoder (CCAE) to generate better examples.
result Generated examples lead to lower error rates and require less effort to create.
Improved trajectory prediction for team sports using sparse outputs.
problem Challenging to train deep learning models for player trajectory prediction.
method Sparse trajectory prediction and constant acceleration interpolation.
result Interpolation improves performance for all tested models.
In order to alleviate data sparsity and overfitting problems in maximum likelihood estimation (MLE) for sequence prediction tasks, we propose the Generative Bridging Network (GBN), in which a novel bridge module is introduced to assist the training of the sequence prediction model (the generator network). Unlike MLE di…
A conceptor-based approach helps robots recognize human internal states.
problem Recognizing human internal states for diagnostic purposes in autism therapy.
method A conceptor-based classifier to classify internal states.
result Initial results show potential for detailed diagnostic information.
The paper proposes a method to align surgical videos using kinematic data.
problem Difficulty in learning from comparing novice to expert surgical videos due to variability in gesture duration and execution.
method A novel technique using Dynamic Time Warping to synchronize videos of the same gesture at different speeds.
result The proposed approach allows for the alignment of surgical videos, enabling better learning for novice trainees.
FST.ai 2.0 improves Taekwondo decision-making with AI, reducing review time and increasing trust.
problem Fair, transparent, and explainable decision-making in Taekwondo.
method Pose-based action recognition, epistemic uncertainty modeling, interactive dashboards.
result 85% reduction in decision review time, 93% referee trust in AI-assisted decisions.
Bayesian model improves win probability estimates in soccer.
problem Technical challenges in estimating win probability for soccer.
method Bayesian statistical framework using contextual game state features.
result Well-calibrated win, tie, and loss probabilities demonstrated.
Project uses machine learning to identify skiers' techniques from power meter data.
problem Identifying skiers' techniques from power meter data.
method Machine learning, specifically LSTM neural networks, applied to time-series data.
result 95% accuracy in classifying skiers' techniques with a subset of data.
The paper proposes geometrizing deep networks to improve deep learning system interpretability.
problem Improving the interpretability of deep learning systems.
method Proposes geometrization of deep networks as a solution.
result Geometrization of deep networks can help understand existing deep learning systems and solve interpretability issues.
Probabilistic deep learning uses neural networks and models to handle uncertainty.
problem Handling uncertainty in deep learning models.
method Two approaches: probabilistic neural networks and deep probabilistic models.
result TensorFlow Probability library supports both approaches.
Improves deep learning robustness by considering task and model.
problem Adversarial attacks on deep learning systems.
method Binary and interval label encoding strategy to redefine classification tasks and design corresponding loss functions.
result Our method enhances robustness without sacrificing accuracy.
Deep-RLS uses deep learning to improve PCA for better source separation.
problem Improving PCA for better source separation in nonlinear systems.
method Inspired by RLS, Deep-RLS unfolds RLS iterations into a deep neural network.
result Deep-RLS significantly improves accuracy in recovering source signals.
Paper interprets deep learning using decision trees and Haar wavelets.
problem Understanding the function approximation capabilities of ReLU deep learning.
method Constructing a deep learning structure equivalent to a forest and approximating Haar wavelet functions with ReLU deep learning.
result ReLU deep learning can be considered as decision trees and approximates Haar wavelet functions with arbitrary precision.
DEEP-BO optimizes hyperparameters of deep networks, outperforming existing methods.
problem Hyperparameter optimization of deep networks is challenging due to the complexity and sensitivity of DNN performance.
method Enhanced Bayesian Optimization (DEEP-BO) specifically designed for deep networks, incorporating diversification, early termination, and parallelism.
result DEEP-BO outperforms or matches other state-of-the-art methods on six DNN benchmarks.
Deep learning models can discriminate against certain groups, requiring computational methods to ensure fairness.
problem Algorithmic discrimination in deep learning models affecting protected groups.
method Interpretability and mitigation approaches at different stages of deep learning lifecycle.
result Interpretability aids in diagnosing and mitigating algorithmic discrimination in deep learning.
Deep learning methods improve overlapping speaker separation across languages and noise.
problem Overlapping speaker separation in realistic scenarios.
method Deep clustering and deep attractor networks.
result Deep learning methods are effective for a broad range of languages and can handle untrained languages with common features.
SDF adapts Deep Forest for evolving data streams with active learning.
problem Adapting Deep Forest for evolving data streams.
method Streaming Deep Forest (SDF) with Augmented Variable Uncertainty (AVU) active learning.
result SDF with AVU outperforms other methods trained with all instances by 70% labeling budget.
Deep SSMs use neural networks to identify complex systems.
problem Identifying nonlinear systems with high uncertainty.
method Deep state space models with neural networks.
result Deep SSMs outperform traditional methods on benchmarks.
Deep RL combines deep learning and RL for complex decision-making.
problem Complex decision-making tasks that were previously unsolvable by machines.
method Combining deep learning and reinforcement learning.
result Deep RL can solve complex tasks and has practical applications.
Integrates deep learning and logic reasoning for intelligent agents.
problem Combining deep learning and logic reasoning for robust decision-making.
method Deep Logic Models integrating deep learners and logic reasoning.
result Proposed models outperform other approaches in joint learning and inference.
The great success of deep learning shows that its technology contains profound truth, and understanding its internal mechanism not only has important implications for the development of its technology and effective application in various fields, but also provides meaningful insights into the understanding of human brai…
Deep Confidence provides efficient error estimation for deep neural networks.
problem Estimating the reliability of predictions from deep learning models.
method Snapshot Ensembling and conformal prediction.
result Deep Confidence generates narrower confidence intervals than alternative methods.
DSCF-Net learns deep features for clustering with robustness and locality preservation.
problem Unsupervised deep representation learning for clustering.
method Integrates robust deep concept factorization, deep self-expressive representation, and adaptive locality preserving feature learning.
result Delivers state-of-the-art performance on public databases.
Deep learning improves crime prediction accuracy.
problem Improving crime prediction accuracy using deep learning.
method Comparative study of 10 deep learning methods on crime data.
result Deep learning methods outperform existing methods in crime prediction.
Bayesian methods enhance deep learning models by improving reliability and uncertainty.
problem Improving reliability and uncertainty awareness in deep learning models.
method Approximate Bayesian inference techniques, including SG-MCMC and VI, applied to deep learning models.
result Enhanced posterior inference for deep learning models, particularly in neural networks and generative models.
Deep nets outperform shallow nets in complex feature realization.
problem Realizing complex data features with deep nets.
method Refined covering number estimates and analysis of approximation rates.
result Deep nets can improve performance without additional capacity costs for complex features.
NeurIPS 2020 competition seeks to predict deep learning generalization.
problem Understanding and predicting generalization in deep learning models.
method Propose complexity measures to accurately predict generalization performance.
result A robust complexity measure could improve deep learning reliability.
This paper analyzes generalization issues in deep reinforcement learning.
problem Understanding and improving generalization capabilities of deep reinforcement learning policies.
method Formalizing and categorizing solutions to address overfitting in deep reinforcement learning.
result A comprehensive analysis of generalization challenges and solutions in deep reinforcement learning.
Deep sparse coding models resist adversarial examples.
problem Adversarial examples can fool deep learning models.
method Used deep sparse coding models to resist adversarial examples.
result Deep sparse coding models are robust to adversarial examples.
This paper explains why ResNets generalize better than FFNets using neural tangent kernels.
problem Understanding why deep ResNets generalize better than deep FFNets.
method Using neural tangent kernels to compare the learnability of functions induced by the kernels of ResNets and FFNets.
result The kernel of ResNets does not exhibit degeneracy as depth increases, unlike FFNets.
This paper provides an overview of deep semi-supervised learning methods.
problem Reducing the need for large annotated datasets in deep learning.
method Summarizes dominant semi-supervised approaches in deep learning.
result Provides a comprehensive overview of deep semi-supervised learning.
Paper proposes a quantum deep clustering framework with improved performance.
problem Improving clustering performance in quantum machine learning.
method Quantum deep SVM, deep convolutional neural networks, and quantum K-Means clustering.
result The proposed quantum deep clustering framework shows significant performance gains over classical methods.
With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem about the induced networks of connected directed acyclic graphs. Then, we set up a …
Deep active inference learns policies from sensory inputs.
problem Learning policies in partially observable domains.
method Optimizes expected free energy with a variational autoencoder.
result Comparable or better performance than deep Q-learning.
Deep learning aids causal inference in complex settings.
problem Estimating heterogeneous treatment effects in non-linear, time-varying, and encoded confounders.
method Intuitive introduction to deep learning and causal inference, focusing on observational data.
result Maximizes accessibility to causal inference through deep learning.
Deep learning is viewed differently by various disciplines.
problem Understanding deep learning across different fields.
method Synthesizing perspectives from neuroscience, physics, math, and computation.
result Different disciplines offer unique insights into deep learning.
Deep image clustering improved with STN and DAC.
problem Challenges in clustering images, especially with spatial transformations.
method Combining DAC with STN to reduce spatial transformation issues.
result The combined model outperformed baseline models on MNIST and FashionMNIST.
This paper introduces Deep Incremental Boosting, a new technique derived from AdaBoost, specifically adapted to work with Deep Learning methods, that reduces the required training time and improves generalisation. We draw inspiration from Transfer of Learning approaches to reduce the start-up time to training each incr…
Proposes model-based robust deep learning to handle natural variation in data.
problem Deep learning's fragility to natural variation in data.
method Develops model-based robust training algorithms using deep generative models to learn natural variation.
result Deep neural networks trained with model-based algorithms outperform standard and norm-bounded robust algorithms.