GAMformer bridges tabular models and interpretability, offering a single-pass approach.
problem Lack of interpretability in tabular foundation models like TabPFN.
method In-context learning for GAM shape functions, training on synthetic data.
result GAMformer performs comparably to other leading GAMs across various classification benchmarks.
In this article we study the right-angled Artin subgroups of a given right-angled Artin group. Starting with a graph $\gam$, we produce a new graph through a purely combinatorial procedure, and call it the extension graph $\gam^e$ of $\gam$. We produce a second graph $\gam^e_k$, the clique graph of $\gam^e$, by adding …
New research finds tree-based GAMs are most trustworthy and fair.
problem Variability in GAM algorithms leads to inconsistent models.
method Quantitative and qualitative analysis of various GAM algorithms.
result Tree-based GAMs are the most trustworthy and fair.
RAMs improve GAMs' accuracy by fitting components to subregions of feature space.
problem Subpar accuracy in GAMs due to inability to capture feature interactions.
method Identify subregions of feature space where interactions are minimized, fitting one component per subregion.
result RAMs offer improved expressiveness compared to GAMs while maintaining interpretability.
GAM generates global explanations of neural networks by mapping prediction landscapes.
problem Lack of interpretability in neural networks.
method GAM (Global Explanations Mapping) method that explains neural network predictions across subpopulations.
result GAM's global explanations match feature weights of interpretable models and are intuitive to practitioners.
GAM(L)A model improves interpretability of machine learning models.
problem Interpretable machine learning models for high predictive performance.
method Combines partial linear models with variable selection for accurate prediction and interpretability.
result GAM(L)A outperforms parametric models and is comparable to black-box models like random forest and gradient boosting.
Scalable GAMs using sparse variational Gaussian processes.
problem Flexible modeling of data beyond linear models.
method Bayesian treatment of GAMs using Gaussian processes (GPs) with sparse representation and additive structure.
result Efficient and well-calibrated Bayesian treatment of GAMs.
This review compares GAMs and neural networks on real-world tabular data.
problem Comparing the performance and characteristics of GAMs and neural networks in tabular data applications.
method Systematic review following PRISMA guidelines, extracting and analysing key attributes from 143 papers and 430 datasets.
result No consistent evidence of superiority for either GAMs or neural networks, with performance trade-offs depending on dataset characteristics.
Paper introduces GAMs for interpretable learning-to-rank models.
problem Need for transparent ranking models in legal or policy scenarios.
method Developed generalized additive models (GAMs) for ranking tasks using neural networks.
result Neural ranking GAMs achieve better performance than traditional GAMs while maintaining interpretability.
API technique improves multiclass GAM interpretability.
problem Interpretability breakdown in multiclass GAMs.
method Developed two axioms and API technique for multiclass GAMs.
result API technique transforms multiclass GAMs to be visually interpretable.
F-GAM improves clinical prediction models for OR outcomes.
problem Limited expressive capability of logistic regression for clinical predictions.
method Factored generalized additive model (F-GAM) that extends GAM with feature interactions.
result F-GAM outperforms other models in AUPRC and AUROC for predicting OR outcomes.
New method for automatically smoothing GAMs in large datasets.
problem Lack of reliable and fast methods for automatic smoothing in large datasets of GAMs.
method Empirical Bayes approach with an approximate expectation-maximization algorithm involving double Laplace approximation.
result The method achieves state-of-the-art accuracy and is faster than existing methods.
New model captures complex relationships from experimental data.
problem Capturing intricate feature interactions in empirical data.
method Shape Arithmetic Expressions (SHAREs) combining GAMs and mathematical expressions.
result SHAREs model captures complex feature interactions.
Regularizes GAMs to improve interpretability by reducing concurvity.
problem Susceptibility of GAMs to concurvity reduces interpretability.
method Proposes a regularizer to penalize pairwise correlations of non-linearly transformed features.
result Improves interpretability and reduces concurvity without sacrificing prediction quality.
For every orientable surface of finite negative Euler characteristic, we find a right-angled Artin group of cohomological dimension two which does not embed into the associated mapping class group. For a right-angled Artin group on a graph $\gam$ to embed into the mapping class group of a surface S, we show that the …
GAMs combine autoregressive and log-linear components for data-efficient sequence learning.
problem Poor performance of standard autoregressive models under small-data conditions.
method Introduce Global Autoregressive Models (GAMs) combining autoregressive and log-linear components, trained in two steps.
result GAMs show a strong perplexity reduction over standard models in language modelling.
Bayesian GAMs improve predictive performance for high-dimensional data.
problem Sparse regularization in GAMs leads to excess shrinkage and difficulty in selecting nonlinear effects.
method Developed a novel spike-and-slab LASSO prior and scalable EM-Coordinate Descent algorithm.
result Improved predictive and computational performance compared to existing models.
A new knot selection method for GAMs reduces model complexity.
problem Choosing optimal knots for B-spline regression in GAMs.
method Adaptive splines combined with Fellner-Schall tuning for automatic knot selection.
result Comparable performance with P-splines but using fewer knots.
Hedonic models predict 84-92% of U.S. real estate prices, highlighting environmental factors' impact.
problem Predicting real estate prices using hedonic models with environmental factors.
method P-spline generalized additive models for real estate prices, contrasting with linear and polynomial models.
result GAM models explain 84-92% of U.S. real estate price variance, with environmental factors contributing minimally.
AutoML improves electricity demand forecasting models.
problem Optimizing GAM and state-space model parameters for short-term forecasting.
method Automated online generalized additive model selection using DRAGON package.
result The approach enhances predictive performance of adaptive models.
Improved portfolio optimization using GAM factor models.
problem Enhancing CVaR portfolio optimization performance.
method Combines autoregressive filters with factor regressions to predict stock returns.
result Substantial improvement in portfolio performances with GAM models.
ProtoNAM models tabular data with neural networks, making predictions transparent.
problem Tabular data analysis using neural networks lacks transparency and accuracy compared to tree-based methods.
method ProtoNAM introduces prototypes into neural networks to model tabular data while maintaining explainability.
result ProtoNAM outperforms existing NN-based GAMs and provides insights into learned feature patterns.
Instantly interprets black-box models using additive models.
problem Efficiency and representation power of SHAP explanations.
method Variational perspective linking GAM models and SHAP explanations; InstaSHAP method.
result Automatic computation of Shapley values in a single forward pass.
Paper analyzes privacy-aware mobility behavior using entropy metrics.
problem Intrusive user location tracking makes it easy to identify users.
method Proposes spatio-temporal entropy to quantify mobility, uses GAMs to study effects of variables.
result Global GAM provides more accurate predictions of spatio-temporal entropy.
A new approach to distill unnormalized EBM for energy-based seq2seq models.
problem Training unnormalized EBM for energy-based seq2seq models is challenging.
method Relating the problem to distributional RL, proposing a general distillation approach.
result General approach applicable to any sequential EBM, illustrated on GAM experiments.
LLMs excel at summarizing and repairing complex models without needing full models.
problem Understanding and repairing complex models like GAMs.
method Hierarchical reasoning and extensive background knowledge.
result LLMs can detect anomalies, describe reasons, and suggest repairs.
Study integrates ESG factors into home price predictions for U.S. cities.
problem Predicting average annual home prices using ESG factors.
method Used P-spline GAM and GLM models, transformed time series data.
result ESG factors influence home prices differently by city.
RGAM builds more accurate models by preferring linear features over non-linear ones.
problem Building accurate models when linearity assumption is poor.
method Multi-stage algorithm guided by the principle of preferring linear features.
result RGAM can fit sparse generalized additive models at scale for various data types.
The paper analyzes the statistical learnability of GAMs using TV regularization.
problem Statistical learnability of generalized additive models with TV regularization.
method Total variation (TV) as a complexity measure for functions in Lmc1(R)-space, and Rademacher complexity analysis. result Generalization error bounds for finite samples are derived, showing tight complexity in terms of m and p. Study predicts droughts 1 month ahead using neural networks and reduces model complexity.
problem Increasing frequency of droughts affecting livelihoods and economies.
method Mixed model approach using artificial neural networks (ANN) with GAM space search.
result 1-month lagged variables are most predictive, with ANN model achieving R2=0.78.
ParamBoost uses gradient boosting to create interpretable non-linear models with constraints.
problem Creating interpretable non-linear models with expert knowledge constraints.
method Gradient Boosting of cubic polynomials with specified constraints.
result ParamBoost outperforms state-of-the-art GAMs in real-world datasets.
SurvNAM explains survival model predictions using machine learning.
problem Explaining predictions of black-box survival models.
method SurvNAM is a modified Neural Additive Model (NAM) trained with a specific loss function based on Cox model and GAM.
result SurvNAM allows local and global explanation of survival model predictions.
We derive a new radial link for binary classification under shared elliptical distributions.
problem Binary classification under shared-generator elliptical class-conditional distributions.
method We derive the Bayes radial-link family from the within-class radius law and estimate it by a finite fractional-power stochastic-polynomial projection.
result The derived link is asymptotically Bayes-optimal and significantly better than QDA on various benchmarks.
New work shows FP potential monotonicity equals low-degree polynomial estimators limits.
problem Establishing a precise mathematical relationship between statistical physics and polynomial estimators limits.
method Analyzing Gaussian additive models (GAMs) to show FP potential monotonicity equals low-degree polynomial estimators limits.
result For a broad family of Gaussian additive models, the power of low-degree polynomials is equivalent to the monotonicity of the annealed FP potential.
Paper proposes combining GAM and DNN for accurate peak demand estimation from lower-resolution data.
problem Predicting high-resolution peak demand from limited lower-resolution data.
method Combines generalized additive models (GAM) and deep neural networks (DNN) for half-hourly load forecasting.
result Proposed method reduces out-of-sample RMSE by 57.4% compared to benchmark.
Robust model detects outliers in spatiotemporal epidemic data.
problem Outliers in epidemic data can mislead public health decisions.
method RST-GAM with mean-shift, adaptive Lasso, splines, and proximal algorithm.
result Demonstrates effectiveness in real-world COVID-19 data analysis.
Model uses GAMs to forecast hourly electricity load weeks to one year ahead.
problem Accurate mid-term hourly load forecasting for power plant operation and energy management.
method Generalized Additive Models (GAMs) with P-splines and autoregressive post-processing.
result Significantly enhanced forecasting accuracy compared to state-of-the-art methods.
Machine learning models outperform traditional methods in predicting forest disease distribution.
problem Unbiased performance estimation and hyperparameter tuning of machine learning models for spatial data.
method Nested cross-validation, hyperparameter tuning, spatial partitioning.
result GAM and RF models outperform traditional methods in predictive accuracy.
KAPLAN-HR models survival data without manual interactions, outperforming existing methods.
problem Survival analysis challenges with complex covariates and time-varying effects.
method Kolmogorov-Arnold Networks (KAN) for nonparametric hazard estimation.
result KAPLAN-HR matches or exceeds existing methods in clinical survival data.
Climate models predict dengue risk in Costa Rican municipalities.
problem Predicting dengue incidence in diverse micro-climates of Costa Rica.
method Used GAM and RF approaches on climate and dengue data.
result Retrospectively predicted dengue risk in five municipalities.
mcanalysis quantifies menstrual cycle effects in health data.
problem Lack of standardised statistical methods for menstrual cycle research.
method Fourier-basis generalised additive model (GAM) pipeline.
result Nine out of 15 health outcomes showed significant association with menstrual cycle.
Study predicts stream turbidity using surrogate data and meta-model.
problem Costly turbidity sensor deployment limits monitoring networks.
method Dynamic regression (ARIMA), LSTM, GAM models; surrogate covariates (rainfall, water level, temperature, solar exposure); meta-model combining strengths of individual models.
result ARIMA and GAM models with all covariates outperform single models; meta-model yields highest accuracy.
Study analyzes Airbnb lead-time distributions for Nights Booked and Gross Booking Value, finding divergent shapes and tail behavior.
problem Analyzing lead-time distributions for Airbnb demand metrics.
method Compositional analysis of daily lead-time vectors, fitting Gamma, Weibull, and Lognormal distributions, using generalized Pareto for tail inference.
result Lead-time distributions for Nights Booked and Gross Booking Value diverge, with GBV concentrating more in mid-range horizons.
A winning method for day-ahead electricity demand forecasting during and after the COVID-19 pandemic.
problem Day-ahead electricity demand forecasting during and after the COVID-19 pandemic.
method Online forecast combination of multiple point prediction models with a holiday adjustment procedure and smoothed Bernstein Online Aggregation (BOA).
result Excellent forecasting performance, particularly due to the holiday adjustment procedure and fully adaptive smoothed BOA approach.
The paper explores machine learning methods for proxy modeling in life insurance solvency capital requirements.
problem Life insurance companies need to estimate solvency capital requirements from full loss distributions, but computational limitations restrict full simulations.
method The paper presents various adaptive machine learning approaches to approximate the risk-dependent proxy function using least-squares Monte Carlo.
result The machine learning methods significantly improve the accuracy and efficiency of proxy modeling compared to traditional regression techniques.
Modeling volatility with Chained Gamma Distributions for financial time series.
problem Volatility clustering in financial time series, especially in estimating temporal autocorrelation of logarithmic variance of returns.
method Dynamic Bayesian Network with conjugate prior relation of normal-gamma and gamma-gamma, using variational methods for quick approximate solutions.
result The model can express heavier tails than Gaussians, achieving positive excess kurtosis, and runs faster than Monte Carlo methods.
Proposes a new model for high-dimensional data analysis with unknown link function.
problem Estimating link function, component functions, and variable interactions in high-dimensional data.
method Generalized Sparse Additive Model with Unknown Link Function (GSAMUL) using B-spline basis and MLP network for link estimation, with ℓ2,1-norm regularizer for variable selection. result Can realize both variable selection and hidden interaction.
Paper proposes an alternative to MLE for GLMs with non-canonical link functions.
problem Challenges in MLE for GLMs with non-canonical link functions.
method Variational Inequality (VI) estimation framework.
result Established finite-sample error bounds and asymptotic normality for VI estimator.