Recognizes collective sheep movement activities online.
problem Recognizing collective animal movement activities.
method Discriminative framework for tracking flock positions and velocities online.
result Good accuracy in learning skewed collective activities.
Survey reviews machine learning for automatic movement generation.
problem Need for automatic movement animation in interactive media.
method Machine learning techniques and motion capture data.
result Discussion of research gaps and challenges for future work.
Bayesian method infers local rules for collective animal movement.
problem Learn local rules governing long-term group behaviors.
method Bayesian Inverse Reinforcement Learning with Linearly-Solvable Markov Decision Process.
result Recover true costs and find value of collective movement.
We introduce a new graphical model for tracking radio-tagged animals and learning their movement patterns. The model provides a principled way to combine radio telemetry data with an arbitrary set of userdefined, spatial features. We describe an efficient stochastic gradient algorithm for fitting model parameters to da…
Improved animated faces using audiovisual and modality dropout.
problem Creating realistic animated faces using speech and visual cues.
method Training a deep learning model with modality dropout to balance audio and visual inputs.
result Modality dropout improves viewer preference for audiovisual-driven animation.
Visualizes movement control optimization landscapes to understand why it's hard and how to make it easier.
problem Understanding and optimizing movement control problems in animation research.
method Novel visualizations of high-dimensional control optimization landscapes.
result Trajectory optimization becomes increasingly ill-conditioned with longer trajectories, while parameterizing control as partial target states can act as an efficient preconditioner.
Most animals possess the ability to actuate a vast diversity of movements, ostensibly constrained only by morphology and physics. In practice, however, a frequent assumption in behavioral science is that most of an animal's activities can be described in terms of a small set of stereotyped motifs. Here we introduce a m…
New framework learns interaction rules from animal trajectories.
problem Challenges in extracting interaction rules from animal movement data.
method Augmented behavioral models with neural networks and theory-guided regularization.
result Improved performance over baselines and novel biological insights.
Generically learns movement control policies from exploration data.
problem Movement optimization in physically based characters.
method Parameterizes actions as target states, learns low-level control policy.
result Improves movement optimization across multiple tasks and algorithms.
A two-variable model is developed to forecast the probability of recession in the U.S. economy. Like many others, the model uses data a year or more old to explain movements of a dichotomous dependent variable for recession. The innovation of the present effort is the introduction of a confidence variable, which appear…
RTN generates realistic character transitions from context.
problem Manual transition animation creation is tedious and time-consuming.
method Recurrent Neural Network (RNN) with LSTM architecture trained on past context.
result RTN produces realistic transitions that rival motion capture.
Framework infers coordination strategies from movement data.
problem Inferring individual movement strategies from group data.
method Formalizes Coordination Strategy Inference Problem; provides methodology to infer strategies.
result Framework accurately infers strategies in simulated and real-world datasets.
AR app enhances young children's understanding of Wudhu.
problem Teaching Wudhu to young children is challenging.
method Needs analysis, system design, implementation, testing (Black Box Testing).
result AR technology improves children's learning interest and understanding of Wudhu.
This paper uses ML to identify prey handling in seals.
problem Automatically classify prey handling activity in seals for monitoring.
method Developed and compared three ML algorithms: Input Delay Neural Networks, Support Vector Machines, and Echo State Networks.
result Echo State Networks outperformed other algorithms in terms of accuracy and F1score.
New AI tools generate and vary dance choreographies.
problem Creating original and customizable dance choreographies.
method Recurrent neural networks and autoencoders trained on movement data.
result Generated and varied dance sequences using machine learning.
A neural network model mimics body functions for movement tasks.
problem Solving inverse and forward kinematics, dynamics for a redundant manipulator.
method Recurrent neural network with Mean of Multiple Computations principle, dynamic extension.
result Neural network solves inverse tasks and shows prototypical population-coding.
NeuroPaint infers missing brain area dynamics from multi-animal datasets.
problem Leveraging multi-animal datasets to understand interactions between brain areas.
method Masked autoencoding approach trained across animals with partial observations.
result Models can successfully reconstruct dynamics of unrecorded brain areas.
Robot learns agile leg movements from simulations to real robots.
problem Training legged robots for dynamic maneuvers is challenging and expensive.
method Simulation-based reinforcement learning for real legged systems.
result ANYmal robot can follow high-level commands, run faster, and recover from falls.
Study improves animal audio classification using data augmentation.
problem Improving automated animal audio classification accuracy.
method Exploits different data augmentation techniques for training CNNs.
result Best recognition rates on animal audio classification datasets.
Shape analysis methods have in the past few years become very popular, both for theoretical exploration as well as from an application point of view. Originally developed for planar curves, these methods have been expanded to higher dimensional curves, surfaces, activities, character motions and many other objects. In …
Deep learning animates objects from input images and videos.
problem Animating arbitrary objects from input images and videos.
method A deep learning framework with three modules: Keypoint Detector, Dense Motion prediction network, and Motion Transfer Network.
result Our method outperforms state-of-the-art image animation and video generation methods.
In this article, we will formulate a mathematical framework that allows us to treat character animations as points on infinite dimensional Hilbert manifolds. Constructing geodesic paths between animations on those manifolds allows us to derive a distance function to measure similarities of different motions. This appro…
Emergenet predicts animal influenza strain emergence, outperforming current methods.
problem Limited ability to quantitatively assess animal influenza strain emergence.
method Infer digital twin of sequence evolution using 220,151 HA sequences.
result Emergenet predictions outperform WHO seasonal vaccine recommendations and CDC IRAT scores.
DIFNET tackles the suspended animation problem in deep graph neural networks.
problem Deep graph neural networks suffer from the suspended animation problem.
method DIFNET uses neural gates and graph residual learning for node hidden state modeling, and includes an attention mechanism for node neighborhood information diffusion.
result DIFNET effectively addresses the suspended animation problem and improves learning performance.
We present an instance segmentation algorithm trained and applied to a CCTV recording of beef cattle during a winter finishing period. A fully convolutional network was transformed into an instance segmentation network that learns to label each instance of an animal separately. We introduce a conceptually simple framew…
Polynomial fusion layer improves speech-driven facial animation.
problem Recent facial synthesis relies on low-dimensional representations and concatenation, ignoring higher-order interactions.
method Proposes a polynomial fusion layer to model higher-order interactions of facial encodings.
result Demonstrates improved video quality, audiovisual synchronisation, and blink generation.
GResNet tackles suspended animation in deep GNNs by adding extensive connections.
problem Performance degradation of deep GNNs, especially spectral-based models.
method Introducing GResNet framework with extensively connected highways.
result Avoids dramatic changes to node representations between layers, enhancing learnability.
Deep learning classifies animal behavior from wearable accelerometers.
problem Classifying animal behavior from accelerometer data.
method End-to-end deep neural network with IIR and FIR filters.
result Outperforms state-of-the-art algorithms in real-time classification.
Classical topological concepts are applied to understand high performance computing simulations of molecules writhing in three dimensional space. These simulations produce peta-bytes of floating point data, to describe 3 dimensional changes in molecular structure. A zero-th order analysis is achieved by viewing a compu…
Tensor variable elimination for plated factor graphs enables exact inference in models with repeated structure.
problem Efficient inference in models with repeated structure.
method Generalized variable elimination to tensor variable elimination on plated factor graphs.
result Tractable inference for a class of plated factor graphs.
New method ranks competitors from multiple types of comparisons.
problem Ranking individuals or teams from multiple conflicting comparison types.
method Combination of expectation-maximization algorithm and modified Bradley-Terry model.
result A ranking can be computed from multiple conflicting comparison types.
LISBET automates social behavior analysis using machine learning.
problem Manual annotation of social behaviors is time-consuming, biased, and misses subtle interactions.
method Self-supervised learning on body tracking data.
result Automated detection and segmentation of social interactions.
A new framework uses pixel-based images for realistic cloth animations.
problem Creating virtual cloth deformations that closely match real clothing.
method Reinterpreting cloth deformation as a 2D pattern space and using CNNs.
result Our approach achieves realistic cloth animations without accurate body shapes.
Online Multi-Object Tracking (MOT) from videos is a challenging computer vision task which has been extensively studied for decades. Most of the existing MOT algorithms are based on the Tracking-by-Detection (TBD) paradigm combined with popular machine learning approaches which largely reduce the human effort to tune a…
FEAFA dataset annotates facial expressions with high detail.
problem Lack of detailed facial expression annotations in existing datasets.
method Manual annotation of 122 participants' facial expressions.
result FEAFA dataset provides detailed annotations for facial expressions.
Paper uses RL for high-level character control in 3D environments.
problem Creating intelligent characters with generalizable behavior.
method Combines traditional animations, heuristics, and reinforcement learning.
result Demonstrates learning of complex behaviors in a 3D environment.
Item cold-start is a classical issue in recommender systems that affects anime and manga recommendations as well. This problem can be framed as follows: how to predict whether a user will like a manga that received few ratings from the community? Content-based techniques can alleviate this issue but require extra infor…
Style generators can invertibly generate images, useful for image enhancement and animation.
problem Generating all possible images and maintaining invertibility are challenging for GANs.
method Proposed style generators are invertible and can generate all possible images.
result Style generators outperform other GANs and Deep Image Prior as image priors.
This paper develops a method for estimating animal motion submanifolds using distribution-free learning.
problem Estimating submanifold models of animal motion supported on a configuration manifold.
method Formulates a novel method based on distribution-free learning over the manifold of measurements.
result Derives approximations of the unknown mapping that converge with rates dependent on sample size and dimensionality.
Generative AI reduces herd behavior in trading, but can also lead to optimal herding.
problem Impact of generative AI on financial stability and herd behavior.
method Laboratory experiments with large language models replicating human trading behavior.
result AI agents make more rational decisions than humans, reducing herd behavior but also potentially leading to optimal herding.
Paper introduces method to estimate animal motion on unknown submanifolds using Koopman operator.
problem Estimating animal motion on unknown submanifolds in high-dimensional space.
method Data-dependent approximation of Koopman operator in RKHS over ambient space.
result Strong rates of convergence derived for estimates in terms of fill distance.
Wearable smart suit tracks infant movements with high accuracy.
problem Early detection of atypical motor development in infants.
method Developed a multi-sensor smart suit for data collection, trained a deep CNN algorithm for automatic posture and movement classification.
result Setup achieves human equivalent accuracy in infant posture and movement classification.
Paper reduces movement primitive dimensionality in parameter space.
problem High dimensionality of movement primitives makes policy optimization expensive.
method Investigates dimensionality reduction in parameter space, identifying principal movements.
result Dimensionality reduction in parameter space is more effective than in configuration space.
Quantifying behavior is crucial for many applications in neuroscience. Videography provides easy methods for the observation and recording of animal behavior in diverse settings, yet extracting particular aspects of a behavior for further analysis can be highly time consuming. In motor control studies, humans or other …
CARL controls a quadruped to move naturally in complex environments.
problem Motion synthesis in dynamic environments with complex constraints.
method CARL uses GANs to adapt high-level controls to action distributions and deep reinforcement learning for dynamic recovery.
result CARL can be controlled with high-level directives and react naturally to dynamic environments.
Deep convolutional architecture identifies eye movements for biometric faster and more accurately.
problem Biometric identification of eye movements for authentication.
method Developed a deep convolutional architecture to process raw eye-tracking signals.
result Achieved a lower error rate by one order of magnitude and faster identification time by two orders of magnitude.
AHA model mimics animal episodic learning without labels.
problem Machine learning's slow, statistical learning vs. animals' fast episodic learning.
method Biologically-plausible computational model of the Hippocampus trained without labels.
result AHA model performs image classification comparably to deep ANNs.
We recast the Calabi flow in DeGiorgi's language of minimizing movements. We establish the long time existence of minimizing movements for K-energy with arbitrary initial condition. Furthermore we establish some a priori regularity of these solutions, and that sufficiently regular minimizing movements are smooth soluti…