Proposes a method for modeling random objects in metric spaces using random effects.
problem Modeling random objects in non-Euclidean spaces with random effects.
method Nonlinear Fréchet-based algorithm for M-estimation.
result Consistent estimation of prediction target under random-effects formulation.
New method combines randomization tests and flexible models for valid inference without splitting data.
problem Valid inference in randomized panel experiments with complex effect heterogeneity.
method Model-assisted randomization tests that estimate unsigned CATE from residualized outcomes.
result CATE-assisted tests control Type I error and achieve higher power than alternatives.
New Krylov subspace methods speed up mixed-effects models with crossed random effects.
problem Slow computations for high-dimensional crossed random effects in mixed-effects models.
method Krylov subspace-based methods for generalized mixed-effects models with cross effects.
result Speedups by factors of up to 10,000 in computations for mixed-effects models.
The paper improves bandit algorithms by incorporating random-effect models.
problem Improving statistical efficiency in multi-armed bandit problems with misspecified priors.
method Introduces a random-effect model to bandits, estimating arm means and designing a UCB algorithm ReUCB.
result Derives an upper bound on the Bayes regret of ReUCB, showing improved performance over Thompson sampling.
This study compares machine learning methods for high-cardinality categorical variables.
problem Machine learning struggles with high-cardinality categorical variables.
method Empirical comparison of tree-boosting, deep neural networks, and linear mixed effects models.
result Tree-boosting with random effects outperforms deep neural networks with random effects.
Study asset price bubbles using random matching and stochastic factors.
problem Understanding and modeling asset price bubbles through investor contagion.
method Developed a stochastic model of liquidity-based asset price bubbles using random matching mechanism.
result Derived conditions for arbitrage-free financial market models.
An algorithm finds optimal covariates for blocking in randomized experiments.
problem Minimizing variance in causal effect estimates from heterogeneous data.
method Using causal graphs, an algorithm identifies optimal covariates for blocking.
result An efficient algorithm reduces variance in causal effect estimates.
New method for inference on covariates in NMF with random effects.
problem Formal inference for covariate effects in NMF with non-negativity constraints.
method NMF-RE model with random effects, ridge updates, df-based cap, asymptotic linearization, wild bootstrap.
result Valid inference on covariates with non-negativity constraint, avoiding degeneracy.
NoLimits.jl: Flexible and Composable Nonlinear Mixed-Effects Modeling in Julia
problem Flexible and composable nonlinear mixed-effects modeling
method Macro-based modeling language and unified interface
result Substantially expand the range of nonlinear mixed-effects models
Paper extends LME models to allow sign constraints on coefficients with SDTN random effects.
problem Inference with sign constraints on random effects in LME models.
method Proposes SDTN distribution for random effects and develops likelihood-based approaches for estimation.
result Proposed constrained model improves real-world interpretations and achieves satisfactory performance.
In this paper, we focus on quantifying model stability as a function of random seed by investigating the effects of the induced randomness on model performance and the robustness of the model in general. We specifically perform a controlled study on the effect of random seeds on the behaviour of attention, gradient-bas…
Paper uses ML to improve A/B testing for complex treatment effects.
problem Detecting treatment effects in A/B experiments with complex variables.
method Combines ML models with randomization tests for better detection of treatment effects.
result ML-assisted tests improve detection of complex treatment effects.
OMERF extends random forest for hierarchical data and ordinal responses.
problem Analyzing hierarchical data and ordinal responses using tree-based methods.
method Ordinal Mixed-Effects Random Forest (OMERF) that preserves flexibility and hierarchical structure.
result OMERF identifies discriminating student characteristics and estimates school effects.
MOMENT selects and estimates mixed-effects models using moment identities.
problem Selecting and estimating random-effects covariance matrix and fixed-effects coefficients in multiresponse linear mixed-effects models.
method MOMENT is a stage-wise moment-based framework that reduces the random-effects selection problem to a smooth constrained convex optimization problem.
result MOMENT performs competitively and can outperform separate univariate analyses for correlated responses.
GBMixed boosts mixed models for clustered data, estimating mean and variance flexibly.
problem Flexible estimation of mean and variance components in clustered data.
method Gradient Boosting framework for linear mixed models with likelihood-based gradients.
result GBMixed accurately recovers complex nonlinear fixed effects and covariances.
Study loop corrections in random feature models affecting training and test errors.
problem Analyzing loop corrections in random feature models to understand training and test errors.
method Statistical physics and effective field theory approach to study loop corrections.
result Derived loop corrections to training error, test error, and generalization gap.
gKRLS accelerates KRLS estimation for complex models.
problem Limited flexibility and high computation for KRLS.
method Re-formulate KRLS as a hierarchical model and implement random sketching.
result gKRLS can fit models on large datasets in minutes.
A new method for efficient inference in sequential latent-variable models.
problem Computational challenges in integrating subject-specific random effects.
method Anchored variational inference framework to approximate posterior distributions.
result The method achieves accurate estimation with significant computational gains.
Study compares Islamic banks' accounting and market performance.
problem Assessing the relationship between Islamic banks' accounting and market performance.
method Selected six Islamic banks, collected data from 2009-2013, used random-effect models.
result Superior accounting performance does not correlate with superior market performance.
Forest-based methods estimate heterogeneous treatment effects, blending strengths for better performance.
problem Estimating heterogeneous treatment effects in randomized and observational studies.
method Causal forests and model-based forests, blending strengths for better performance.
result Local centering of treatment indicator and propensities is crucial for good performance in randomized trials.
Machine learning models predict depression risk based on various factors.
problem Identifying individuals at greatest risk for depression.
method Random Effects/Expectation Maximization (RE-EM) trees and Mixed Effects Random Forest (MERF) algorithms.
result Machine learning models accurately predict depression severity and identify key predictors.
A new meta-analysis model detects and accommodates outliers.
problem Outliers in meta-analysis studies can skew results.
method Proposes a novel tMeta model using the t distribution for robustness. result Demonstrates superior performance in detecting and accommodating outliers.
A generalized continuous economic model is proposed for random markets. In this model, agents interact by pairs and exchange their money in a random way. A parameter controls the effectiveness of the transactions between the agents. We show in a rigorous way that this type of markets reach their asymptotic equilibrium …
Develops RF-GLS for binary geospatial data.
problem Challenges in extending RF to binary geospatial data.
method Proposes RF-GLS for binary data, embedding it in generalized mixed effects models.
result Establishes consistency of RF-GP for mean function and covariate effect estimation.
ARMED models improve deep learning interpretability and generalize better on clustered data.
problem Clustered data leads to spurious associations and poor model fitting.
method Adversarial regularization and mixed effects subnetworks.
result ARMED models outperform conventional methods in accuracy and generalization.
Method improves treatment effect estimation in randomized experiments.
problem Estimating distributional treatment effects in randomized experiments.
method Distributional regression framework with machine learning for variance reduction.
result The proposed method reduces variance of distributional treatment effect estimators.
The study analyzes deep linear networks from random initialization, capturing dynamics and hyperparameter effects.
problem Understanding training dynamics in deep linear networks from random initialization.
method Theoretical analysis of gradient descent dynamics in deep linear networks with random initialization and large data.
result Captures the 'wider is better' effect and hyperparameter transfer effects, contrasting with neural-tangent parameterization.
This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response distributions. In particular, the analysis provides sharp results on the ``out-of-sample'' prediction error, as opposed to…
The Tweedie Compound Poisson-Gamma model is routinely used for modeling non-negative continuous data with a discrete probability mass at zero. Mixed models with random effects account for the covariance structure related to the grouping hierarchy in the data. An important application of Tweedie mixed models is pricing …
Combines observational and randomized data to estimate treatment effects.
problem Estimating heterogeneous treatment effects using only observational data is biased.
method Two-step framework: learn shared structure from observational data, then data-specific structures from randomized data.
result Combining observational and randomized data improves treatment effect estimation.
Study improves maize yield prediction using BNs with mixed-effects models.
problem Limited causal inference in agronomic data models.
method Integrates random effects into Bayesian networks, leveraging hierarchical data structure.
result Significantly reduces maize yield prediction error from 28% to 17%.
Deep-SITAR uses autoencoders to predict growth patterns.
problem Predicting individual growth trajectories from population data.
method Deep learning framework integrating autoencoders and B-spline models.
result Deep-SITAR predicts individual growth without full model re-estimation.
Proposes integrating random effects into deep neural networks for better predictive performance.
problem Correlated data in real-life applications are not handled well by traditional deep neural networks.
method Uses mixed models with random effects to handle correlations in deep neural networks, minimizing Gaussian negative log-likelihood with SGD.
result Improves predictive performance over natural competitors in various correlation scenarios.
Develops statistical inference for ML-discovered heterogeneous treatment effects.
problem ML algorithms may fail to accurately ascertain heterogeneous treatment effects in practical settings.
method Neyman's repeated sampling framework, dividing sample into groups, estimating average treatment effects, constructing confidence intervals.
result Valid methodology for estimating and testing heterogeneous treatment effects without relying on ML algorithm properties.
The link between different psychophysiological measures during emotion episodes is not well understood. To analyse the functional relationship between electroencephalography (EEG) and facial electromyography (EMG), we apply historical function-on-function regression models to EEG and EMG data that were simultaneously r…
New confidence intervals improve treatment effect estimation in randomized experiments.
problem Improving confidence intervals for treatment effects in randomized experiments.
method Systematic exploitation of negative dependence or variance adaptivity.
result Achieved nonasymptotic confidence intervals with the same effective sample size as asymptotic ones.
We study the problem of treatment effect estimation in randomized experiments with high-dimensional covariate information, and show that essentially any risk-consistent regression adjustment can be used to obtain efficient estimates of the average treatment effect. Our results considerably extend the range of settings …
GNNs with random node initialization are shown to be universally expressive.
problem Limitations of standard GNNs in distinguishing graphs.
method Random node initialization (RNI) to enhance GNNs' expressive power.
result GNNs with RNI are proven to be universally expressive.
Study relaxes identification assumptions for natural direct effects in non-randomized settings.
problem Identifying causal direct effects under unmeasured confounding.
method Developed relaxed conditions for identifying natural direct effects in non-randomized settings.
result Identified natural direct effect under unmeasured confounding conditions.
Paper introduces a novel method for dynamic covariance estimation with random forests.
problem Estimating high-dimensional dynamic covariance matrices with multiple covariates.
method Nonparametric approach using random forests.
result Uniform consistency theory and error rates established for high-dimensional scenarios.
Random orthogonalization improves FL in massive MIMO systems without CSI.
problem Efficient model aggregation in FL with minimal channel estimation overhead.
method Combining FL with massive MIMO's channel hardening and favorable propagation, random orthogonalization reduces channel estimation overhead.
result Achieves model aggregation without CSI, significantly reducing channel estimation overhead.
The paper compares methods for estimating heterogeneous treatment effects using multiple randomized trials.
problem Estimating heterogeneous treatment effects reliably and precisely with a single dataset is challenging.
method Non-parametric approaches for estimating heterogeneous treatment effects using data from multiple trials.
result Methods that directly allow for heterogeneity of the treatment effect across trials perform better than those that do not.
In this paper, making use of recent statistical physics techniques and models, we address the specific role of randomness in financial markets, both at the micro and the macro level. In particular, we review some recent results obtained about the effectiveness of random strategies of investment, compared with some of t…
We review recent advances on the record statistics of strongly correlated time series, whose entries denote the positions of a random walk or a Lévy flight on a line. After a brief survey of the theory of records for independent and identically distributed random variables, we focus on random walks. During the last few…
Enhances uncertainty modeling in random PDEs using PINNs and generative models.
problem Uncertainty in complex systems modeled by random PDEs.
method Combines Physics-Informed Neural Networks (PINNs) with generative modeling techniques.
result Systematic control of uncertainty with maintained predictive accuracy.
We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC) (correlations among observations for each individual over time), {\em cluster correlation…
QR-learner estimates individual treatment effects using external data.
problem Limited power to detect individual treatment effects in randomized trials.
method Model-agnostic learner that estimates conditional average treatment effects (CATE) using external data.
result QR-learner reduces mean squared error and can recover true CATE.
Customer scoring models are the core of scalable direct marketing. Uplift models provide an estimate of the incremental benefit from a treatment that is used for operational decision-making. Training and monitoring of uplift models require experimental data. However, the collection of data under randomized treatment as…