Breiman's data analysis dichotomy is outdated, offering a third approach: mechanistic models.
problem Data analysis dichotomy between data modelers and algorithmic modelers.
method Interpolating between simple interpretable models and flexible function approximations using mechanistic models.
result Flexible, interpretable, and scientifically-informed hybrids can provide accurate and robust predictions.
Interactive DR framework for comparing datasets.
problem Limited flexibility in existing DR methods for comparative analysis.
method Unified linear comparative analysis (ULCA) with interactive optimization and visualization.
result ULCA and optimization algorithm improve comparative analysis efficiency and flexibility.
Proposes a flexible feature allocation model for sparse factor analysis.
problem Sparse data and rigid assumptions in traditional exploratory tools.
method Adaptive latent feature sharing with control over feature sparsity.
result Derives a novel adaptive Factor analysis (aFA) and aPPCA for flexible dimensionality reduction.
A new robust and flexible classification method for non-Gaussian data.
problem Robustness to scale changes and non-Gaussian distributions in classical discriminant analysis.
method FEMDA uses arbitrary Elliptically Symmetrical distributions and scale parameters for each data point.
result FEMDA is robust to scale changes and outperforms other methods.
New method analyzes knots and links using multiscale Gauss link integral.
problem Lack of localization and quantization in knot theory applications.
method Integrates curve segmentation and multiscale analysis into the Gauss link integral.
result Significantly outperforms other methods in protein flexibility analysis.
Flexible framework assesses multilevel data group heterogeneity.
problem Multilevel data structure complicates model selection.
method Flexible framework for assessing differences between levels of grouping variables.
result Framework reliably identifies relevant multilevel components.
Copula-based normalizing flows improve flexibility and stability for heavy-tailed data.
problem Limited expressive power of vanilla normalizing flows.
method Generalize base distribution to copula for more accurate representation of target distribution.
result Copula-based normalizing flows improve flexibility, stability, and effectiveness for heavy-tailed data.
New clustering algorithm for time series data using RNN and variational Bayes.
problem Lack of generative model-based clustering methods for time series data.
method Recurrent Neural Network (RNN) with variational Bayes method.
result Robustness against phase shift, amplitude, and signal length variations.
We introduce a copula mixture model to perform dependency-seeking clustering when co-occurring samples from different data sources are available. The model takes advantage of the great flexibility offered by the copulas framework to extend mixtures of Canonical Correlation Analysis to multivariate data with arbitrary c…
Near-convex archetypal analysis improves interpretability and fitting error in NMF.
problem High data fitting error in traditional archetypal analysis.
method Introduces near-convex archetypal analysis (NCAA) that combines AA and NMF.
result NCAA achieves lower data fitting error than state-of-the-art methods.
Proposes a flexible neural model for multi-state survival analysis.
problem Limited applicability of Cox models for multi-state and competing events.
method Uses neural ordinary differential equations to solve Kolmogorov forward equations.
result Demonstrates state-of-the-art performance and interpretability.
Tensor models improve joint EEG and fMRI analysis.
problem Jointly analyzing EEG and fMRI for brain function studies.
method Soft and flexible coupling of tensor decompositions for EEG and fMRI.
result Tensorial methods outperform ICA in multi-modal analysis.
Paper improves matrix-valued data classification using nonparametric LDA.
problem Classification of matrix-valued data in neuroimaging and signal processing.
method Nonparametric LDA based on NPMLE for vectorized and scaled matrices.
result Improves classification performance across various data structures.
Develops flexible non-parametric ACFs using B-spline kernels.
problem Flexible modelling of the autocovariance function (ACF) in time-series, spatial, and spatio-temporal analysis.
method Derives the inverse Fourier transform of B-spline spectral bases to create a general class of non-parametric ACFs.
result Provides a provably dense, flexible, and general class of non-parametric ACFs for various types of processes.
DNAMite creates interpretable, calibrated survival analysis models.
problem Limited interpretability in survival analysis models, especially for healthcare applications.
method Feature discretization and kernel smoothing in embedding module for flexible shape functions.
result DNAMite produces calibrated shape functions interpretable as contributions to cumulative incidence function.
Semiparametric Bayesian networks combine parametric and nonparametric models for flexible data analysis.
problem Combining the advantages of parametric and nonparametric models for flexible data analysis.
method Semiparametric Bayesian networks combining parametric and nonparametric conditional probability distributions. Modifications of two algorithms for structure learning from data.
result Accurately learns the combination of parametric and nonparametric components, comparable to state-of-the-art methods.
Proposes flexible auto-encoders for varying data dimensions.
problem Fixed latent dimensions limit data flexibility.
method Stochastic bottleneck with weighted dropouts.
result Seamless variable dimensionality reduction with high performance.
Flexible DNN for survival data, avoiding proportional hazards assumption.
problem Survival analysis with complex interactions and non-proportional hazards.
method Partially linear DNN model with a flexible nonparametric component.
result FLEXI-Haz achieves optimal convergence rates and asymptotic efficiency.
Flexible device participation improves federated learning convergence.
problem Strict device participation limits federated learning reach.
method Analytical results and new aggregation scheme for flexible participation.
result Convergence improved with flexible device participation.
Improved analysis for nonconvex SGD methods with flexible sampling.
problem Finding approximately stationary points of nonconvex functions with gradient evaluations.
method Generalized SPIDER and PAGE algorithms with flexible sampling mechanisms.
result Sharper complexity bounds for optimal SGD methods in smooth nonconvex settings.
Proposes a flexible method for learning latent causal representations.
problem Limited applicability of existing causal representation learning methods.
method Imposes constraints on function classes and relaxes identifiability conditions.
result Establishes partial identifiability results under weaker conditions.
A new model uses Toeplitz matrices to analyze time-series data transitions.
problem Analyzing transitions in time-series data from nonautonomous systems.
method Deep Koopman-layered models with learnable Toeplitz matrices, leveraging Toeplitz matrices' universal property.
result The model demonstrates universality and generalization, outperforming existing methods.
We present a new mixture model-based discriminant analysis approach for functional data using a specific hidden process regression model. The approach allows for fitting flexible curve-models to each class of complex-shaped curves presenting regime changes. The model parameters are learned by maximizing the observed-da…
New robust discriminant analysis for non-Gaussian data.
problem Classical discriminant analysis struggles with non-Gaussian distributions and contaminated datasets.
method Each data point follows its own ES distribution with arbitrary scale, leading to robust classification.
result Maximum-likelihood estimation and classification are simple, fast, and robust.
We show that surface groups are flexibly stable in permutations. This is the first non-trivial example of a non-amenable flexibly stable group. Our method is purely geometric and relies on an analysis of branched covers of hyperbolic surfaces. Along the way we establish a quantitative variant of the LERF property for s…
One-Class Boundary Peeling detects outliers efficiently and robustly.
problem Unsupervised outlier detection in diverse data distributions.
method One-Class Boundary Peeling uses flexible boundaries generated by one-class SVMs and iteratively peels them.
result One-Class Boundary Peeling outperforms state-of-the-art methods in synthetic data simulations.
In the following short article we adapt a new and popular machine learning model for inference on medical data sets. Our method is based on the Variational AutoEncoder (VAE) framework that we adapt to survival analysis on small data sets with missing values. In our model, the true health status appears as a set of late…
Flexible multi-task learning framework using summary statistics.
problem Data-sharing constraints in healthcare settings.
method Proposes a flexible multi-task learning framework utilizing summary statistics and adaptive parameter selection.
result Systematic non-asymptotic analysis and simulations demonstrate the method's performance.
PoPPy is a Point Process toolbox based on PyTorch, which achieves flexible designing and efficient learning of point process models. It can be used for interpretable sequential data modeling and analysis, e.g., Granger causality analysis of multi-variate point processes, point process-based simulation and prediction of…
New Shapley values reveal non-linear feature dependencies.
problem Understanding non-linear dependencies in machine learning models.
method Model-independent Shapley values using non-parametric measures of dependence.
result Model-independent Shapley values can uncover non-linear dependencies.
New framework quantifies uncertainty in flexible density-based clustering.
problem Uncertainty quantification in clustering with non-parametric density estimation.
method Martingale posterior distributions and density-based clustering.
result Efficient GPU-compatible inference on clustering structures with uncertainty.
A new survival analysis method eliminates hyperparameter tuning.
problem Survival analysis model hyperparameters are difficult to tune.
method Flexible survival density estimation with importance sampling.
result Matches or outperforms existing methods on real-world datasets.
Developed a flexible Bayesian g-formula for causal survival analysis with time-dependent confounding.
problem Estimating causal survival curves in longitudinal observational studies with time-varying treatments and confounding.
method Incorporated Bayesian Additive Regression Trees (BART) into the g-formula to model time-evolving generative components and mitigate bias due to model misspecification.
result Demonstrated improved empirical performance and practical utility of the proposed method through simulations and real-world data analysis.
Flexible inference model for multilayer networks with heterogeneous data.
problem Complexity of heterogeneous data in networked datasets.
method Probabilistic generative model using Bayesian framework and Laplace matching.
result Effective detection of overlapping community structures and prediction tasks.
Deep learning improves analysis of complex natural processes.
problem Simplistic dynamics in regression analyses of complex natural processes.
method Flexible function approximation using deep learning, relaxing standard assumptions.
result Substantial improvements in behavioral and neuroimaging data.
The paper defines flexible domains for minimal surfaces in Euclidean spaces and explores their properties.
problem Understanding the flexibility of domains in Euclidean spaces for minimal surfaces.
method Investigates the concept of flexibility in terms of minimal surfaces contained in domains.
result Defines flexible domains and shows how they can be approximated by minimal immersions.
Flexible models cluster RNA sequencing data.
problem Clustering discrete data from RNA sequencing studies.
method Finite mixtures of multivariate Poisson-log normal factor analyzers with constraints.
result Models give favorable clustering performance on real and simulated data.
Flexible spatial models improve predictive performance over nonstationary alternatives.
problem Improving predictive performance in nonstationary spatial modeling.
method Introduces a modular parametric covariance function that extends nonstationary spatial models.
result The proposed covariance function outperforms nonparametric methods in predictive performance.
Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating between distinct time scales. We demonstrate a robust and scalable SPCA algorithm b…
A novel online framework for analyzing multidimensional functional data.
problem Analysis of multidimensional functional data streams poses significant challenges.
method Online functional principal component analysis using tensor product splines on a Stiefel manifold with Riemannian stochastic gradient descent.
result Efficient and scalable modeling of multidimensional functional data.
Making sense of a dataset in an automatic and unsupervised fashion is a challenging problem in statistics and AI. Classical approaches for {exploratory data analysis} are usually not flexible enough to deal with the uncertainty inherent to real-world data: they are often restricted to fixed latent interaction models an…
New framework for Adam-type algorithms with constant β1, improving regret analysis.
problem Theoretical vs. practical use of Adam and variants with constant β1.
method Proposed a novel framework to derive optimal, data-dependent regret bounds with constant β1.
result Optimal, data-dependent regret bounds with constant β1 are achievable without further assumptions.
Matrix factorization methods are extensively employed to understand complex data. In this paper, we introduce the cross-product penalized component analysis (XCAN), a sparse matrix factorization based on the optimization of a loss function that allows a trade-off between variance maximization and structural preservatio…
Factor analysis provides linear factors that describe relationships between individual variables of a data set. We extend this classical formulation into linear factors that describe relationships between groups of variables, where each group represents either a set of related variables or a data set. The model also na…
Bayesian model tackles spatial count data issues with flexible non-parametric techniques.
problem Challenges in traditional parametric models for spatial count data with unbalanced distributions and complex dependencies.
method Bayesian semi-parametric spatial dispersed count model combining non-parametric techniques and adapted count models.
result Demonstrates superior performance in managing dispersion and capturing intricate spatial patterns.
Proposes a new method for analyzing multimodal neuroimaging data.
problem Combining interpretability and flexibility in multimodal data analysis.
method Orthogonalized kernel debiased machine learning approach.
result Established consistency and asymptotic normality of the estimated primary parameter.
Bayesian models offer great flexibility for clustering applications---Bayesian nonparametrics can be used for modeling infinite mixtures, and hierarchical Bayesian models can be utilized for sharing clusters across multiple data sets. For the most part, such flexibility is lacking in classical clustering methods such a…
Safe imitation learning with a safety layer for flexible training.
problem Flexible yet safe imitation learning for complex tasks.
method Theory and modular method with a safety layer for continuous policy, adversarial training, and worst-case safety guarantees.
result Robustness advantage of safety layer during training compared to test time.