We present a model for the joint estimation of disparity and motion. The model is based on learning about the interrelations between images from multiple cameras, multiple frames in a video, or the combination of both. We show that learning depth and motion cues, as well as their combinations, from data is possible wit…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “motion cues”
This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation. Specifically, we use unsupervised motion-based segmentation on videos to obtain segme…
Proposes MSFCN and RFCN for video semantic segmentation improving accuracy by 9-15%.
problem Lack of temporal information in semantic segmentation algorithms for videos.
method Integrates motion cues and temporal consistency using recurrent and multi-stream FCN architectures.
result MSFCN-3 achieves significant accuracy improvements in various datasets.
Study reveals DNNs prefer easy-to-learn cues over essential ones in image recognition.
problem DNNs learn easy-to-learn features that aren't essential to the task.
method WCST-ML training setup with shortcut cues on synthetic and face datasets.
result DNNs converge to solutions focusing on preferred cues, leading to flat minima.
We propose a recurrent extension of the Ladder networks whose structure is motivated by the inference required in hierarchical latent variable models. We demonstrate that the recurrent Ladder is able to handle a wide variety of complex learning tasks that benefit from iterative inference and temporal modeling. The arch…
Expands sparse disparity cues from LiDAR to improve stereo matching performance.
problem Improving stereo estimation performance with limited dense data.
method Proposes a sparsity expansion technique to enhance local features from sparse disparity cues.
result Significantly boosts stereo algorithms with sparse cues, outperforming previous methods.
Automatically differentiable estimation for BLP model reduces bias in demand estimation.
problem Estimating the BLP model with reduced bias and improved performance.
method Phrasing BLP as an automatically differentiable moment function, using CUE for estimation, and incorporating MCMC credible intervals.
result CUE estimation shows lower bias but higher MAE compared to 2S-GMM, with MCMC providing closest empirical coverage.
A new framework enhances binaural audio for moving talkers.
problem Real-time binaural audio enhancement for moving sound sources.
method Mixture-of-experts framework combining multiple binaural filters.
result Dynamic spatial audio rendering adapts to moving talkers.
New method separates music vocals from accompaniment without labeled data.
problem Separating music sources without isolated recordings.
method Bootstrapping deep model using primitive auditory cues.
result Trained deep model separates vocals from accompaniment in unlabeled music.
Deep learning detects protective movement behavior in chronic pain patients.
problem Detecting protective movement behavior in chronic pain patients for intervention.
method End-to-end deep learning architecture named BodyAttentionNet (BANet) that learns temporal and bodily parts.
result Statistically significant improvements in detecting protective behavior using attention mechanisms.
Optical flow enhances semantic segmentation for automated driving.
problem Improving semantic segmentation for automated driving systems.
method Constructed four architectures using RGB, flow, RGBF, and two-stream RGB + flow.
result Two-stream architecture achieves best results with 4% IoU improvement.
Paper introduces a method for generating interlocutor-aware facial gestures in dyadic settings.
problem Generating appropriate non-verbal behavior for conversational agents in dyadic settings.
method Probabilistic method using multi-modal cues from the interlocutor to synthesize facial gestures.
result The model successfully leverages multi-modal input from the interlocutor to generate more appropriate behavior.
Visually predicting the stability of block towers is a popular task in the domain of intuitive physics. While previous work focusses on prediction accuracy, a one-dimensional performance measure, we provide a broader analysis of the learned physical understanding of the final model and how the learning process can be g…
Multimodal analysis assesses job interview performance and provides feedback.
problem Assessing candidate performance in interviews for professional roles.
method Multimodal analytical framework using video, audio, and text data.
result The proposed methodology achieved promising results in predicting behavioral cues.
Enhances SSL methods with depth cues for better image understanding.
problem Lack of depth cues in 2D image pixel maps limits SSL performance.
method Integrates depth signals from a pretrained monocular RGB-to-depth model into contrastive learning frameworks.
result Improves SSL methods' robustness and generalization with depth signals.
AR-GANs learn depth and DoF from unlabeled images using aperture rendering and focus cues.
problem Learning depth and DoF from unlabeled natural images with diverse viewpoints and shapes.
method Aperture rendering and focus cues to learn depth and DoF from unlabeled images.
result AR-GANs effectively learn depth and DoF from various datasets, including flower, bird, and face images.
This work improves medical image segmentation with limited annotations using contrastive learning.
problem Lack of labeled data for medical image segmentation.
method Contrastive learning framework for semi-supervised segmentation with domain-specific and problem-specific cues.
result Significant improvements in segmentation performance compared to other methods.
Framework improves CT image segmentation robustness with domain-specific cues.
problem Challenges in CT image segmentation by deep learning models.
method Combines domain-specific preprocessing and augmentation with CNN architectures.
result Framework stabilizes prediction performance on varying CT volumes.
Co-PLNet combines point and line predictions to improve wireframe parsing accuracy and efficiency.
problem Separate line and point predictions lead to inconsistent wireframes.
method Co-PLNet uses a Point-Line Prompt Encoder to convert early point detections into spatial prompts, which guide line refinement.
result Co-PLNet achieves better accuracy and robustness in wireframe parsing compared to existing methods.
Exploiting Human Social Cognition for the Detection of Fake and Fraudulent Faces via Memory Networkscs.CV
HMN detects fake faces using memory networks and visual cues.
problem Detecting fake faces from unseen manipulation types.
method Hierarchical Memory Network (HMN) architecture.
result Superior performance in fake and fraudulent face detection.
Machine learning assesses group collaboration in classrooms.
problem Assess student group collaboration in large classrooms.
method Deep learning models using Mixup data augmentation and ordinal-cross-entropy loss function.
result Improved assessment of group collaboration quality.
VCML learns concepts and metaconcepts from images and questions.
problem Learning concepts and metaconcepts from visual data.
method Bidirectional connection between visual concepts and metaconcepts.
result VCML can generalize from limited data and noisy inputs.
Paper addresses shortcomings in pointer generator networks for summarization.
problem Extractive summaries and factual inaccuracies in generated text.
method Appends traditional linguistic information to teach networks on text structure.
result Feasibility and potential of additional cues for improved generation.
A new algorithm efficiently partitions images without seeds or thresholds.
problem Efficiently partitioning images without explicit seeds or thresholds.
method Mutex Watershed algorithm that incorporates both attractive and repulsive cues.
result Determines optimal segments without seeds or thresholds, solving NP-hard problem.
We augment the nonnegative matrix factorization method for audio source separation with cues about directionality of sound propagation. This improves separation quality greatly and removes the need for training data, with only a twofold increase in run time. This is the first method which can exploit directional inform…
A movie multilayer network model captures narration from script, subtitles, and content.
problem Discovering content and stories in movies using network models.
method Developed a multilayer network model using visual and textual semantic cues.
result Demonstrated the effectiveness of the model on the Star Wars saga.
Paper proposes a new method for learning compact representations of sequential data.
problem Learning compact representations of sequential data capturing spatio-temporal cues.
method Contrastive representation learning via adversarial optimal transport on the Grassmann manifold.
result Empirical results show competitive performance in human action recognition.
New corpus improves coreference resolution by removing gender and number cues.
problem Challenges in resolving ambiguous pronoun references.
method Developed a new annotated corpus, introduced antecedent switching technique.
result Models perform poorly on ambiguous pronoun references, but antecedent switching improves performance.
Agents learn social skills from each other, improving performance.
problem Independent RL agents fail to use social learning.
method Imposed constraints, model-based auxiliary loss, mixed training.
result Agents trained with social learning outperform solo-trained agents.
New method separates audio sources without needing known decompositions.
problem Difficulty in training source separation models on real-world mixtures.
method Generates estimated decompositions from stereo mixtures and trains a deep learning model.
result Trained model can separate single-channel audio sources effectively.
Long-term human motion can be represented as a series of motion modes---motion sequences that capture short-term temporal dynamics---with transitions between them. We leverage this structure and present a novel Motion Transformation Variational Auto-Encoders (MT-VAE) for learning motion sequence generation. Our model j…
Introduces Motion Programs for better video analysis of human motion.
problem Current video analysis focuses on raw pixels or keypoints, missing higher-level motion primitives.
method Introduces Motion Programs as a neuro-symbolic representation of motions as a composition of high-level primitives.
result Motion Programs accurately describe diverse human motions and improve downstream tasks.
Study motion planning for points avoiding obstacles in a plane.
problem Avoiding collisions for multiple points in a plane with unknown obstacles.
method Algebraic and topological tools for motion planning.
result New topological complexity for planar motion planning.
Paper introduces new motion synthesis model using normalizing flows.
problem Data-driven motion synthesis with probabilistic and controllable models.
method Probabilistic, generative, autoregressive model using normalizing flows and LSTMs.
result Randomly sampled motion from the model outperforms task-agnostic baselines.
Programmatic Motion Concepts learn human actions from paired videos.
problem Learning motion concepts from paired video and action sequences.
method Semi-supervised learning architecture for hierarchical motion representation.
result Outperforms established baselines, especially in small data settings.
Unified framework for human motion generation on Riemannian manifolds.
problem Learning valid human motion in Euclidean spaces.
method Riemannian Motion Generation (RMG) on product manifolds, Riemannian flow matching.
result Achieves state-of-the-art FID (0.043) on HumanML3D and surpasses strong baselines on MotionMillion.
Asymptotic windings of the block determinants of a unitary Brownian motion and related diffusionsmath.PR
Study on determinants of unitary Brownian motion and their asymptotic laws.
problem Understanding determinants of unitary Brownian motion and their behavior over time.
method Using Stiefel fibration and skew-product decomposition of the Stiefel Brownian motion.
result Prove asymptotic laws for determinants of block entries of unitary Brownian motion.
New framework predicts diverse, contextually plausible 3D human motions.
problem Predicting multiple plausible future 3D poses given observed poses.
method Developed a new variational framework that conditions latent variable on past observation to encourage relevant information.
result Our approach generates motions of higher quality and preserves contextual information.
The ungrammatical sentence "The key to the cabinets are on the table" is known to lead to an illusion of grammaticality. As discussed in the meta-analysis by Jaeger et al., 2017, faster reading times are observed at the verb are in the agreement-attraction sentence above compared to the equally ungrammatical sentence "…
Study refracted skew Brownian motion, find densities and asymptotics.
problem Modeling and analyzing refracted skew Brownian motion.
method Perturbation approach to find potential densities, transition density, and asymptotic behaviors.
result Expressions and asymptotic behaviors of refracted skew Brownian motion.
Neural network predicts vessel motions with high accuracy.
problem Real-time prediction of heave and surge motions for improved performance and safety.
method Developed an LSTM-based machine learning model trained on measured waves and motion data.
result The model predicts vessel motions up to 46.5 seconds into the future with an average accuracy of 90%.
Study fractal dimension for motion without crossing a subset.
problem Fractal dimension of a subset X in R^n for motion without crossing.
method Analyzes fractal dimension of subset X in R^n.
result Determines conditions for motion without crossing a subset.
Let be a closed set in the Riemann sphere . We consider a holomorphic motion of over a complex manifold , that is, a holomorphic family of injections on parametrized by . It is known that if is the unit disk in the complex plane, then any holomorphic motion of ove…
Neural network estimates rigid motion in stroke imaging to improve image quality.
problem Rigid patient motion during C-arm CBCT imaging reduces image quality.
method Neural network trained to regress reprojection error based on image information.
result Neural network outperforms entropy-based method in motion estimation.
Study cohomological equation for robotic screw motions on SE(3).
problem Understanding obstruction phenomena in robotic rigid-body motion.
method Combining Fourier analysis and Peter-Weyl theory, reduce to finite-dimensional linear transport systems.
result Explicit screw motion illustrates resonance conditions and finite-dimensional obstructions.
New approach for obstacle avoidance in robotics using learned representations.
problem Challenges in sensor-based motion planning for new and dynamic environments.
method Proposes a new obstacle representation using PointNet architecture trained jointly with policies for obstacle avoidance.
result Significant improvements in accuracy and efficiency compared to state of the art.
The paper presents a method to reduce arm motion complexity for prosthetics and robotics.
problem Reducing the complexity of human arm motions for robotic and prosthetic control.
method Data-driven techniques including DTW, DBA, Ward's distance, batch-DTW, and fPCA.
result Representative motion clusters and averages for different arm DOF levels.
Paper defines multi-dimensional fractional Brownian motion under volatility uncertainty.
problem Volatility uncertainty in fractional Brownian motion.
method Definition and study of multi-dimensional fractional Brownian motion (G-fBm) with Hurst index.
result First results on stochastic calculus for G-fBm with Hurst index > 0.5.