A new measure of model complexity based on Fisher Information.
problem Model complexity measurement in statistical models.
method Effective dimension defined by the number of cubes needed to cover the model space.
result The effective dimension is scale-dependent and measures model complexity.
New method identifies cause and effect using complexity of autoencoders.
problem Identifying cause and effect in complex systems.
method Adversarial training method to capture disentangled structure of causal models.
result Method identifies cause and effect based on complexity, not causality.
Measures neural network complexity via effective degrees of freedom.
problem Challenges in quantifying neural network complexity.
method Adapts generalized degrees of freedom (GDF) for binary outcomes and compares with cross-validation and null degrees of freedom.
result GDF provides a robust measure of model complexity for neural networks.
New method estimates causal effects in complex spaces using topological structures.
problem Challenges in estimating causal effects in non-Euclidean spaces.
method Developed a topological causal inference framework using power-weighted silhouette functions of persistence diagrams.
result Successfully quantifies topological treatment effects across various complex outcomes.
Advances combinatorial complexes for better modeling of hierarchical and set-type relations.
problem Lack of effective modeling for complex hierarchical and set-type relations in high-dimensional data.
method Introduces combinatorial complexes as a bridge between cell complexes and hypergraphs, emphasizing their different types of relations.
result Combining set-type and hierarchical relations in a single model can be advantageous in learning tasks.
Model complexity is an important factor to consider when selecting among graphical models. When all variables are observed, the complexity of a model can be measured by its standard dimension, i.e. the number of independent parameters. When hidden variables are present, however, standard dimension might no longer be ap…
XTNet estimates complex cross-treatment effects in multi-category, multi-valued settings.
problem Challenges in estimating causal effects for multi-category, multi-valued treatments.
method Dynamic Neural Masking for capturing treatment interactions without restrictive assumptions.
result XTNet consistently outperforms state-of-the-art baselines in multi-category, multi-valued treatment effect estimation.
Neural models improve GLMMs for complex data.
problem Nonlinear relationships in grouped data.
method Replaced linear function with neural networks.
result Improved performance on synthetic and real-world data.
Deep learning models can initially degrade in performance as they grow larger, then improve.
problem Performance degradation of larger models and more data.
method Defined effective model complexity and identified double descent phenomenon.
result Increasing model size and data can initially hurt performance, contrary to intuition.
NGD models have higher effective dimension than SGD models.
problem Measuring model complexity accurately.
method Comparison of NGD and SGD models using effective dimension measures.
result NGD models have a higher effective dimension than SGD models.
Proposes a novel method to identify complex effects in multi-view datasets.
problem Challenges in analyzing multi-view biomedical datasets with complex interactions.
method Generalized kernel machine approach considering marginal and joint effects of features from different views.
result Effective identification of higher-order composite effects in multi-view datasets.
Frugal Flows learn complex data and infer marginal causal effects.
problem Challenges in estimating marginal causal effects from complex data.
method Frugal Flows use normalizing flows to flexibly learn data and infer causal quantities.
result Frugal Flows can generate synthetic data that closely matches real-world data and exactly parameterize causal quantities.
The link between different psychophysiological measures during emotion episodes is not well understood. To analyse the functional relationship between electroencephalography (EEG) and facial electromyography (EMG), we apply historical function-on-function regression models to EEG and EMG data that were simultaneously r…
GTMs model complex multivariate data with varying conditional independencies.
problem Modeling multivariate data with intricate marginals and complex dependency structures.
method Semiparametric approach using penalized splines and lasso regularization.
result GTMs accurately learn complex dependencies and identify conditional independencies.
The paper uses model-based trees to create interpretable surrogate models for complex machine learning models.
problem Interpreting complex machine learning models.
method Using model-based trees to partition feature space and create interpretable models.
result Model-based trees generate optimal surrogate models that balance interpretability and performance.
SGMs fail to generate samples from complex distributions even when the score function is learned well.
problem Score-based Generative Models fail to produce high-quality samples from complex distributions.
method Score-based Generative Models (SGMs) are evaluated under conditions where the score function is learned well.
result SGMs can only generate Gaussian blurring of training data points, not complex distributions.
gKRLS accelerates KRLS estimation for complex models.
problem Limited flexibility and high computation for KRLS.
method Re-formulate KRLS as a hierarchical model and implement random sketching.
result gKRLS can fit models on large datasets in minutes.
Ablation studies show BCF model's propensity score is not essential for treatment effect estimation.
problem Understanding the necessity of propensity score in nonparametric treatment effect estimation.
method Partial ablation studies of Bayesian Causal Forest (BCF) model.
result Excluding estimated propensity score does not affect treatment effect estimation or uncertainty quantification.
Paper uses ML to improve A/B testing for complex treatment effects.
problem Detecting treatment effects in A/B experiments with complex variables.
method Combines ML models with randomization tests for better detection of treatment effects.
result ML-assisted tests improve detection of complex treatment effects.
DREAM model improves computational efficiency for non-linear effects in relational event models.
problem Efficiently modeling non-linear effects in dynamic relational networks.
method Introduces Deep Relational Event Additive Model (DREAM) using Neural Additive Models.
result Demonstrates superior computational efficiency compared to traditional REM approaches.
PWSHAP provides targeted explanations for complex models.
problem Inability of black-box models to explain targeted effects in sensitive domains.
method Augments model with DAG, uses Shapley values for causal pathway identification.
result Establishes error bounds and demonstrates resolution, interpretability, and locality.
A new method combines machine learning with mixed-effects models for better repeated measurement analysis.
problem Inference of linear coefficients in partially linear mixed-effects models with complex interactions and high-dimensional variables.
method Double machine learning approach to estimate nonparametrically nonlinear variables, then use standard linear mixed-effects techniques to estimate the linear coefficient.
result The estimated fixed effects coefficient converges at the parametric rate and is semiparametrically efficient.
The paper shows how certain complex projective varieties can be broken down into simpler types.
problem Understanding the structure of complex projective varieties with pseudo-effective tangent sheaves.
method Developed a theory of pseudo-effective sheaves and applied the minimal model program.
result Projective klt varieties with pseudo-effective tangent sheaves can be decomposed into Fano varieties and Q-abelian varieties.
New method improves cause-effect identification using neural networks.
problem Identifying cause and effect from observational data.
method Variational Bayesian learning of neural networks.
result Improves model fitness and codelengths succinctness.
DCMA uses generative models to analyze complex treatment effects on outcome distributions.
problem Analyzing complex and nonlinear causal mechanisms through outcome-level summary contrasts.
method Generative learning framework for identifying and estimating treatment effects on entire outcome distributions.
result Reconstructs interventional outcome distributions via Monte Carlo forward simulation, capturing both summary and distributional contrasts.
Proposes a tabular transformer model to maintain feature effect intelligibility.
problem Losing marginal feature effects in deep tabular transformer networks.
method Adapts tabular transformer networks to identify marginal feature effects.
result The model accurately identifies marginal feature effects, matching black-box performance while maintaining intelligibility.
ConDiSim uses diffusion models to approximate complex system posteriors efficiently.
problem Simulation-based inference of systems with intractable likelihoods.
method Conditional diffusion model with forward and reverse processes.
result Effective posterior approximation across various benchmark and real-world problems.
hyperSBINN improves drug cardiosafety assessment by efficiently modeling cardiac action potentials.
problem Complexity and limited data in modeling cardiac effects of drugs.
method Combining meta-learning with SBINNs to solve parameterized cardiac action potential models.
result hyperSBINN outperforms traditional solvers in speed and accuracy for predicting APD90 values.
Bayesian method for semi-structured models accounts for both types of uncertainty.
problem Lack of work on epistemic uncertainty in semi-structured regression models.
method Bayesian approximation with subspace inference for joint posterior sampling.
result Validated approach recovers structured effect posteriors and approaches full-space posterior.
Generative models speed up complex system simulations.
problem Accurately forecasting the dynamics of complex systems at reduced cost.
method Generative Learning of Effective Dynamics (G-LED) using auto-regressive attention and Bayesian diffusion models.
result Generative models can accurately forecast complex system dynamics at lower computational cost.
A method to assess variable importance in complex predictive models.
problem Assessing the importance of variables in complex predictive models.
method Assigning relevance measures to each variable by comparing predictions with a ghost variable and analyzing joint effects.
result The method provides insights into variable importance and joint effects not available with other methods.
Background: For complex financial systems, the negative and positive return-volatility correlations, i.e., the so-called leverage and anti-leverage effects, are particularly important for the understanding of the price dynamics. However, the microscopic origination of the leverage and anti-leverage effects is still not…
We prove an effective version of a theorem relating curve complex distance to electric distance in hyperbolic 3-manifolds, up to errors that are polynomial in the complexity of the underlying surface. We use this to give an effective proof of a result regarding maps between curve complexes of surfaces induced by finite…
Proposes a model to estimate treatment effects in complex multiagent systems over time.
problem Challenges in evaluating interventions in multiagent systems, especially with time-varying relationships and covariates.
method Interpretable counterfactual recurrent network leveraging graph variational recurrent neural networks and domain knowledge.
result Achieved lower estimation errors and more effective treatment timing than baselines in simulated and real-world scenarios.
Deep learning improves causal effect estimation from complex observational data.
problem Estimating causal effects from complex observational data with low bias.
method Unified deep learning framework using multitask recurrent neural networks.
result Deep learning estimator shows lower bias in causal effect estimates.
Post-hoc model-agnostic interpretation methods such as partial dependence plots can be employed to interpret complex machine learning models. While these interpretation methods can be applied regardless of model complexity, they can produce misleading and verbose results if the model is too complex, especially w.r.t. f…
New tools quantify deep generative models' performance.
problem Measuring the quality-diversity trade-off in deep generative models.
method Established non-asymptotic bounds on sample complexity and introduced frontier integrals.
result Smoothed estimators improve convergence rates of divergence frontiers.
New insights into neural network complexity reveal better generalization performance.
problem Mysterious generalization in deep models despite high parameter counts.
method Effective dimensionality as a measure of parameter space complexity.
result Double descent behavior in generalization as a function of parameters explained.
The use of drug combinations, termed polypharmacy, is common to treat patients with complex diseases and co-existing conditions. However, a major consequence of polypharmacy is a much higher risk of adverse side effects for the patient. Polypharmacy side effects emerge because of drug-drug interactions, in which activi…
Introduces LLC, a new complexity measure for DNNs based on SLT.
problem Lack of effective complexity measures for DNNs.
method Uses Singular Learning Theory to define LLC and proposes scalable estimator.
result Empirical evidence shows LLC provides valuable insights into DNN complexity.
Transformer model handles causal inference with DAG integration.
problem Complex causal structures and adaptability across various scenarios.
method Integrates DAGs into transformer's attention mechanism.
result Surpasses existing methods in estimating causal effects.
New copula-based models for binary outcomes capture complex interactions.
problem Complex interaction effects in binary outcome models.
method Additive models with copula-based components, no discretization required.
result Better or comparable predictive performance compared to other methods.
LMLFM tackles predictive modeling from longitudinal data with mixed correlations.
problem Learning predictive models from longitudinal data with complex correlations and non-linear interactions.
method Longitudinal Multi-Level Factorization Machine (LMLFM) that selects predictive fixed and random effects.
result LMLFM outperforms state-of-the-art methods in predictive accuracy, variable selection, and scalability.
New method uses SEMs to uncover cause-effect in manufacturing processes.
problem Complex cause-and-effect relationships in manufacturing processes.
method Using Structural Equation Models with non-linear relationships.
result More informative cause-effect relationships derived from data.
Proposes a new method to estimate continuous treatment policies and match treatments effectively.
problem Current methods struggle with continuous treatment policies and complex matching.
method Formulates treatment effectiveness as a parametrizable model, using deep learning for optimization.
result Significant improvement in treatment effectiveness and matching efficiency.
Develops scalable model for learning velocity fields in complex traffic scenarios.
problem Learning heterogeneous and dynamic velocity fields in complex traffic scenarios.
method Nonparametric Bayesian modeling with hierarchical Dirichlet process and infinite hidden Markov model, Gaussian process prior, and scalable approximate inference.
result Demonstrates effective scalability and applicability to real-world traffic data.
Deep learning predicts contagion dynamics on complex networks.
problem Forecasting contagion dynamics on complex networks is challenging.
method Graph neural network learns local mechanisms from time series data.
result Deep learning offers new and accurate models of contagion dynamics.
Regularization effect found in neural feature alignment.
problem Implicit regularization in deep learning models.
method Geometrical viewpoint and analysis of Rademacher complexity.
result Neural features align along task-relevant directions, leading to regularization.