DSA improves sentence embedding by dynamically attending to words.
problem Efficiently capturing the importance of words in sentences for embedding.
method DSA modifies dynamic routing from capsule networks for self-attention in sentences.
result DSA achieves state-of-the-art results in SNLI with fewer parameters.
Paper presents a method to diagnose schizophrenia using fMRI dynamics from healthy controls.
problem Early diagnosis of mental disorders like schizophrenia using fMRI.
method Self-supervised pre-training on fMRI dynamics of healthy controls for transfer learning.
result Effective classification of schizophrenia using fMRI dynamics with small datasets.
A dataset of 10 molecule types for machine learning studies.
problem Lack of suitable datasets for machine learning in molecular imaging.
method Generated 2D cross-sectional projections of 10 molecule types from Molecular Dynamics trajectories.
result Benchmark dataset for machine learning, deep learning, and image processing in scattering, imaging, and microscopy.
NeuroPaint infers missing brain area dynamics from multi-animal datasets.
problem Leveraging multi-animal datasets to understand interactions between brain areas.
method Masked autoencoding approach trained across animals with partial observations.
result Models can successfully reconstruct dynamics of unrecorded brain areas.
The study examines dataset usage patterns in machine learning research.
problem Lack of attention to dataset dynamics in machine learning research.
method Analysis of dataset usage patterns across machine learning subcommunities and time periods (2015-2020).
result Increasing concentration on fewer and fewer datasets, significant adoption from other tasks, and concentration across the field on datasets introduced by elite institutions.
Proposes a new model for better speech segmentation.
problem Improving speech segmentation accuracy.
method Integrates recurrent explicit duration variables into rSLDS and uses Pólya-gamma augmentation for inference.
result Demonstrates improved segmentation on various datasets.
D2PCCA integrates deep learning and probabilistic modeling for nonlinear dynamical systems.
problem Analyzing nonlinear dynamical systems with probabilistic understanding.
method Combines deep learning and probabilistic modeling, using KL annealing and normalizing flows.
result Captures latent dynamics in sequential datasets with improved convergence and flexibility.
Quantum dynamics reveals hidden geometric structure in data.
problem Understanding complex, high-dimensional datasets through geometric structure.
method Introducing semiclassical and microlocal analysis to data analysis.
result First tractable algorithm for approximating wave dynamics and geodesics on data manifolds.
Deep Autoencoder using GANs detects faults in closed loop systems without labeled data.
problem Fault detection in closed loop uncertain dynamical systems.
method Generative Adversarial Network (GAN) based Autoencoder.
result The proposed method significantly outperforms traditional classifier-based methods.
GDM models time series with smoother transitions and interpretable states.
problem Capturing smooth, variable-speed transitions and stochastic mixtures of states.
method Introduces a continuous relaxation of discrete states and a Gumbel noise model.
result Models real-world datasets more faithfully with smoother dynamics and interpretable states.
New method for Bayesian learning on large datasets using replica-exchange Nosé-Hoover dynamics.
problem Bayesian learning on complex posterior distributions with multiple isolated modes and mini-batch noise.
method Simulating replicas in parallel with different temperatures, applying Nosé-Hoover dynamics, and developing a noise-aware exchange protocol.
result Significant improvements over strong baselines in deep Bayesian neural networks on large-scale datasets.
This paper analyzes dynamic ensemble selection and preprocessing for multi-class imbalanced datasets.
problem Class imbalance in multi-class datasets where majority classes have more instances.
method Examined dynamic selection techniques and data preprocessing methods for multi-class imbalanced problems.
result Dynamic ensemble improves AUC and G-mean compared to static ensemble.
New method learns dynamic brain communication patterns across regions.
problem Current methods struggle with time-varying brain communications and scalability.
method Adaptive Delay Model (ADM) using Markovian Gaussian Processes.
result Captures dynamic neural communication patterns over time.
The paper analyzes the dynamics of a simple neural network using a mean-field approach.
problem Understanding the training dynamics of neural networks, especially in classification tasks.
method Developed an analytic theory using a mean-field limit for a simple neural network.
result Explicitly solved the dynamics of a linearly separable dataset with a linear hinge loss.
VTIRT speeds up IRT inference for dynamic learner proficiency.
problem Expensive and slow inference algorithms for dynamic IRT models.
method Variational Temporal IRT (VTIRT) for fast, accurate inference.
result Orders of magnitude speedup in inference runtime with accurate results.
A machine learning system identifies dynamic gestures from accelerometer data.
problem Identifying dynamic gestures from accelerometer data.
method Machine learning approach using tri-axial acceleration data from uWave and Sony datasets.
result The system can classify gestures at varying speeds with minimal preprocessing and runs on a low-cost platform.
SyMetric evaluates learned Hamiltonian dynamics from images, improving model stability and interpretability.
problem Lack of reliable metrics to assess learned Hamiltonian dynamics from images.
method Developed SyMetric, a binary indicator based on Hamiltonian dynamics properties.
result SyMetric identifies architectural improvements for better dynamics learning.
RNNs classify text by accumulating evidence on a low-dimensional manifold.
problem Understanding how RNNs solve text classification tasks.
method Dynamical systems analysis applied to trained RNNs.
result RNNs use a low-dimensional attractor manifold to classify text.
SGLD improves sampling for Bayesian models on large datasets.
problem Poor convergence and mixing times in SGLD for models with scale and correlation variations.
method Preconditioning noise vector, comparing normalization approaches.
result Preconditioning improves mixing times and regularization effects.
Neural M3 model adapts to diverse user behaviors over short and long timeframes.
problem Adapting to diverse user behaviors over short and long timeframes.
method Neural Multi-temporal-range Mixture Model (M3) combining short-term and long-term models with a learned gating mechanism.
result M3 consistently outperforms state-of-the-art sequential recommendation methods.
Dynamic sample pruning speeds up spatio-temporal forecasting models.
problem Training deep learning models on large, redundant datasets is computationally expensive.
method Dynamic sample pruning based on real-time learning state.
result Significant acceleration of training speed with improved performance.
Quantum dynamics algorithm learns manifold from data.
problem Learning manifolds from high-dimensional datasets.
method Simulation of quantum dynamics on a graph embedding of data.
result Algorithm reveals connections between data sampling and quantization.
SaMbaTen efficiently maintains tensor decompositions for growing datasets.
problem Maintaining tensor decompositions for dynamic, growing datasets.
method Sampling-based batch incremental tensor decomposition algorithm.
result SaMbaTen achieves comparable accuracy to state-of-the-art techniques but is significantly faster and scalable.
The paper proposes a method to assess and improve data quality using GBDT training dynamics.
problem Improving data quality in datasets with noisy labels and varying contributions.
method Metrics computed from training dynamics of Gradient Boosting Decision Trees (GBDTs).
result The method achieved the best results compared to other approaches.
New dataset improves EMG gesture recognition accuracy.
problem Discrepancy between offline and online EMG gesture recognition accuracy.
method Recorded dynamic dataset using virtual reality and EMG-independent controller.
result TADANN algorithm consistently outperforms fine-tuning for long-term gesture recognition.
VIND infers smooth nonlinear dynamics from electrophysiology data.
problem Analyzing smooth, nonlinear time series data from neuroscience experiments.
method Variational Inference for Nonlinear Dynamics (VIND) with structured approximate posterior and fixed-point iteration.
result VIND reconstructs 5D latent space variables similar to Hodgkin-Huxley models, and excels in predicting future neural activity.
Paper models Bitcoin market dynamics using 1+1D field theory.
problem Understanding stylized facts in Bitcoin markets.
method Collects order-book datasets, applies KPZ-like stochastic equations.
result Predicts order book dynamics with high precision.
New method for Bayesian inference on large datasets.
problem Scalable sampling for Bayesian generalized linear mixed models on large datasets.
method Mirror Langevin dynamics with data subsampling, post-processing for variance estimation.
result Asymptotic, order-wise correct estimation of posterior variance.
dCMF models evolving patterns in multiway data with temporal dynamics.
problem Capturing evolving patterns in multiway datasets with temporal dependencies.
method Time-aware coupled factorization model constrained by LDS structure.
result dCMF outperforms alternatives in capturing complex dynamics.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
Dynamic ensemble active learning tackles non-stationary criteria in active learning.
problem Active learning's effectiveness varies across datasets and sessions, leading to suboptimal results.
method Developed a dynamic ensemble active learner based on a non-stationary multi-armed bandit with expert advice.
result Dynamic ensemble selects the best criteria at each step, improving overall performance.
We introduce a machine learning approach for extracting fine-grained representations of protein evolution from molecular dynamics datasets. Metastable switching linear dynamical systems extend standard switching models with a physically-inspired stability constraint. This constraint enables the learning of nuanced repr…
EvoNet predicts the evolution of dynamic graphs using a graph neural network and recurrent architecture.
problem Predicting the evolution of dynamic graphs is challenging and underexplored.
method EvoNet uses a graph neural network and recurrent architecture to predict the evolution of dynamic graphs.
result EvoNet effectively predicts the evolution of dynamic graphs on both artificial and real-world datasets.
Model learns disentangled static and dynamic data representations.
problem Learning disentangled representations from unordered data.
method Factorized graphical model exploiting sequential data regularities.
result Well-organized latent space for data dynamics.
PhysicsFormer improves TSF models for GSWF with WEATHER-5K dataset.
problem Lack of comprehensive datasets for GSWF.
method PhysicsFormer combines dynamic core and Transformer, enforcing physical consistency.
result PhysicsFormer outperforms TSF models in operational forecasting.
Paper proposes active learning for mining conflict dynamics from textual data.
problem Lack of detailed information on conflict dynamics in existing datasets.
method Active learning with a large, encoder-only language model.
result Performance similar to human coding with reduced human annotation.
New test uncovers causal links in rare event dynamics.
problem Causal discovery for rare event phenomena in dynamic systems.
method Nonparametric conditional independence test on time-invariant data.
result Validated across simulated and real-world datasets.
Foundational brain dynamics model using stochastic optimal control.
problem Complex and noisy fMRI signals in brain dynamics.
method Continuous-discrete state space model with amortized inference and locally linear approximations.
result State-of-the-art results across various downstream tasks.
ACSSM models irregular time series with continuous dynamics.
problem Modeling irregular time series data.
method ACSSM uses a multi-marginal Doob's h-transform and variational inference with stochastic optimal control.
result ACSSM outperforms in tasks like classification, regression, interpolation, and extrapolation.
Paper presents a self-adaptive learning model for robust classification and regression.
problem Dealing with various datasets of different complexity.
method Combines DNDN and DSP, an end-to-end training approach with multiple randomly initialized softmax layers and adaptive soft pruning.
result The model demonstrates no performance loss compared with unpruned models and higher robustness over different data and feature distributions.
Analyzes symmetries in neural networks to predict learning dynamics.
problem Understanding the dynamics of neural network parameters during training.
method Unified theoretical framework based on symmetries and conservation laws.
result Symmetries impose geometric constraints on gradients and Hessians, leading to conservation laws.
New method predicts graph structure changes over time.
problem Existing graph prediction methods assume static vertices, limiting their applicability.
method Combines time series prediction with adapted FBA for growing graphs.
result Efficacy demonstrated on synthetic and real datasets.
Paper models market dynamics using bull and bear forces.
problem Complex market dynamics influenced by biases and narratives.
method Bias to Behavior from Bull-Bear Dynamics (B4) model.
result Model predicts market trends with superior performance and interpretable insights.
Model captures system input variations in latent space for actionable dynamics.
problem Learning dynamical systems from data without prescribing a mathematical model.
method Structured latent ODE model with stochastic factors of variation for each input.
result Improves generation of time-series data and inference of system inputs over baselines.
A new method selects variables efficiently for fast and accurate dynamic system identification.
problem Efficiently selecting variables for scalable Gaussian processes.
method Forward variable selection using Karhunen-Loève decomposition and Gibbs sampling.
result Method yields competitive accuracies and inference times for dynamic systems.
Improved accuracy in dynamic response variation analysis using multi-fidelity data fusion.
problem Inefficient characterization of dynamic response variation due to limited high-fidelity data.
method Composite Neural Network fusion approach for multi-level, heterogeneous datasets.
result Improved accuracy in frequency response variation characterization.
Proposes a neural network for dynamic risk prediction of AMD using longitudinal fundus images.
problem Dynamic risk prediction for progressive eye disorders like AMD.
method tdCoxSNN, a time-dependent Cox survival neural network integrating CNN.
result Demonstrates commendable predictive performance in AMD and PBC datasets.
The paper explores how complex models can improve system identification beyond traditional limits.
problem Balancing model richness and spurious learning in system identification.
method Investigates the double-descent phenomenon in the context of dynamic systems.
result Complex models can improve system identification performance beyond the point of interpolation.