Random forest model predicts sewer pipe deterioration with high accuracy.
problem Challenges in predicting and scheduling sewer pipe inspections.
method Random forest classification model for sewer pipe condition prediction.
result Model achieved excellent AUC of 0.81 in a case study for City of LA.
The paper monitors model deterioration using uncertainty estimation.
problem Challenges in monitoring deployed machine learning models.
method Non-parametric bootstrapped uncertainty estimates and SHAP values.
result The approach detects model deterioration and uncertainty effectively.
Novel framework identifies pump-specific deterioration rates using Bayesian hierarchical hazard modeling and causal discovery.
problem Challenges in asset management due to heterogeneous deterioration rates in pump equipment.
method Bayesian hierarchical hazard modeling with causal discovery, GPU-accelerated No-U-Turn Sampling (NUTS), and DirectLiNGAM.
result Identified striking heterogeneity in deterioration rates, with negative effects 400 times larger than positive effects.
Machine learning for healthcare often trains models on de-identified datasets with randomly-shifted calendar dates, ignoring the fact that data were generated under hospital operation practices that change over time. These changing practices induce definitive changes in observed data which confound evaluations which do…
The U.S. water distribution system contains thousands of miles of pipes constructed from different materials, and of various sizes, and age. These pipes suffer from physical, environmental, structural and operational stresses, causing deterioration which eventually leads to their failure. Pipe deterioration results in …
The paper develops a method to predict the latent deterioration phase in limit order books before stress is observed.
problem Limit order books can transition rapidly from stable to stressed conditions, making it difficult to detect the latent deterioration phase.
method The paper formalizes a three-regime causal data-generating process and proposes a trigger-based detector combining MAX aggregation of complementary signal channels, a rising-edge condition, and adaptive thresholding.
result The proposed method achieves mean lead-time of +18.6 timesteps with perfect precision and moderate coverage, outperforming classical change-point and microstructure baselines.
The Lasso is a computationally efficient regression regularization procedure that can produce sparse estimators when the number of predictors (p) is large. Oracle inequalities provide probability loss bounds for the Lasso estimator at a deterministic choice of the regularization parameter. These bounds tend to zero if …
Theoretical and empirical taxonomy of imbalance in binary classification.
problem Class imbalance degrades binary classification performance.
method Proposed a principled framework based on three scales: imbalance coefficient, sample-dimension ratio, and intrinsic separability. Derived closed-form Bayes errors and analyzed degradation across models.
result The triplet (η, κ, Δ) provides a model-agnostic explanation of imbalance-induced deterioration.
Neural network-based post-processing improves ensemble forecast sharpness
problem Reducing the width of central prediction intervals in ensemble forecasts
method Extending loss function with a penalty term
result 8.2%-12.5% reduction in width of central prediction interval
Proposes a framework to explain KS deterioration in credit risk models.
problem Inconsistent and ad hoc diagnosis of KS decline in credit risk models.
method Counterfactual diagnostic framework attributing KS decline to sampling variability, portfolio composition, covariate shift, and residual deterioration.
result The proposed approach provides more interpretable and governance-relevant explanations than threshold-based review alone.
Machine learning improves early detection of patient deterioration in Brazilian hospitals.
problem Challenges in recognizing clinical deterioration in hospital settings.
method Application of machine learning to analyze EHR data from multiple hospitals.
result Machine learning models outperformed traditional protocols by 25 percentage points in AUC.
Neural networks learn clean data patterns first, then noisy data, leading to improved performance initially but deteriorating later.
problem Improvement in prediction error on clean data during early training of neural networks with noisy labels.
method Theoretical analysis and experiments to explore the dynamics of gradient descent and the impact of clean and noisy data.
result Neural networks prioritize learning clean data patterns first, leading to improved performance initially but deteriorating later due to diminishing gradient dominance of clean samples over noisy ones.
Proposes efficient algorithm for system-level I&M decisions under uncertainty.
problem Optimal management strategies for deteriorating civil engineering systems.
method Factored partially observable Markov decision process with Bayesian networks and DDMAC reinforcement learning.
result DDMAC policies offer substantial benefits over heuristic approaches in system-level cost optimization.
Robust policies improve ICU transfer outcomes by predicting patient deterioration.
problem Higher mortality rates for unplanned ICU transfers.
method Markov Decision Process model to predict patient severity and optimize transfer policies.
result Robust policies are more aggressive in transferring patients than nominal policies, improving overall patient care.
Narrative disclosures in 10-K filings improve bankruptcy prediction beyond accounting ratios.
problem Traditional bankruptcy prediction models rely on accounting ratios, which may not capture early warning signals.
method Developed a PB Stress Score based on distress-specific language in 10-K narratives, evaluated against accounting and dictionary benchmarks.
result Adding the PB Stress Score increases AUC from 0.8323 to 0.9019 and improves top-decile bankruptcy capture from 44.12% to 64.71%.
After admission to emergency department (ED), patients with critical illnesses are transferred to intensive care unit (ICU) due to unexpected clinical deterioration occurrence. Identifying such unplanned ICU transfers is urgently needed for medical physicians to achieve two-fold goals: improving critical care quality a…
Improves model predictability by mixing forecasts and orthogonalizing models.
problem Redundant models contaminate model space and degrade predictive performance.
method Principal Component Analysis for model orthogonalization in Bayesian forecast mixing.
result Better prediction accuracy and excellent uncertainty quantification.
Economics tool predicts failure times in reliability systems.
problem Predicting optimal failure times in weighted k-out-of-n reliability systems with heterogeneous component failure.
method Using rational expectations to analyze and predict failure times in reliability systems with heterogeneous component failure.
result Different measures are optimal for predicting system failure depending on component failure distributions.
Accelerated gradient method's stability deteriorates exponentially with steps.
problem Algorithmic stability of Nesterov's accelerated gradient method.
method Analysis of two notions of algorithmic stability for Nesterov's accelerated gradient method.
result Stability of Nesterov's accelerated method deteriorates exponentially with the number of gradient steps.
Develops a minimax optimal estimator for system stability under distribution shift.
problem Ensuring system reliability under changes in the underlying environment.
method Minimax optimal estimation of stability defined in terms of acceptable performance degradation.
result Characterizes the minimax convergence rate and demonstrates practical utility.
Federated CTMC model estimates bridge deterioration hazards without sharing raw data.
problem Bridge inspection data privacy and cross-organizational data sharing constraints.
method Federated CTMC hazard model with local optimization and FedAvg aggregation.
result Federated model converges on global benchmark parameters without data transfer.
This research examines how model explanations change under distribution shifts in tabular data.
problem Detecting distribution shifts in tabular data affecting model performance and explanations.
method Investigates the relationship between model performance and explanation characteristics under distribution shifts.
result Explanation shifts are a better indicator for detecting predictive performance changes than traditional distribution shift techniques.
Study optimizes inspection and monitoring of deteriorating structures using POMDPs.
problem Optimizing decision-making for deteriorating engineering systems with uncertain observations.
method Developed theoretical and computational foundations for Value of Information (VoI) and Value of Structural Health Monitoring (VoSHM) in POMDPs.
result POMDP policies inherently leverage VoI to guide optimal observational actions, improving long-term cost.
CP2 uses geometric information to improve conformal prediction robustness.
problem CP fails under geometric data shifts, losing coverage guarantees.
method Integrates geometric pose information into CP via canonicalization.
result Integrating geometric information with CP ensures robustness under geometric shifts.
We consider convex SGD updates with a block-cyclic structure, i.e. where each cycle consists of a small number of blocks, each with many samples from a possibly different, block-specific, distribution. This situation arises, e.g., in Federated Learning where the mobile devices available for updates at different times d…
Training on some out-of-distribution data improves generalization error before it deteriorates.
problem Generalization error improves with some out-of-distribution data but deteriorates with more.
method Synthetic datasets and deep networks on computer vision benchmarks.
result Non-monotonic trend in generalization error with OOD samples.
Intensive care clinicians are presented with large quantities of patient information and measurements from a multitude of monitoring systems. The limited ability of humans to process such complex information hinders physicians to readily recognize and act on early signs of patient deterioration. We used machine learnin…
AI system predicts acute critical illness from EHRs with explainability.
problem Lack of clinical interpretability in AI predictions for acute critical illness.
method Developed an explainable AI early warning score (xAI-EWS) system.
result System provides clinicians with insights into EHR data explaining predictions.
To meet the standard of differential privacy, noise is usually added into the original data, which inevitably deteriorates the predicting performance of subsequent learning algorithms. In this paper, motivated by the success of improving predicting performance by ensemble learning, we propose to enhance privacy-preserv…
Shorter time windows and carefully selected features outperform longer periods and extra features in mortgage default prediction.
problem The paradox of increased training data and features leading to worse model performance in time series prediction.
method Empirical study using Fannie Mae's mortgage data, comparing different time window lengths and feature combinations.
result Shorter time windows and carefully selected features yield superior prediction results in mortgage default prediction.
Quantile gradient boosted trees outperform other models in predicting NO2 concentration distributions.
problem Forecasting high NO2 concentration episodes for effective air quality management.
method Compared 10 probabilistic forecasting models for NO2 concentration prediction.
result Quantile gradient boosted trees model outperformed others in predicting NO2 concentration distributions.
PoGDiff improves diffusion models on imbalanced datasets.
problem Diffusion models struggle with imbalanced text-image pairs.
method PoGDiff replaces ground-truth with a Product of Gaussians.
result PoGDiff enhances generation accuracy and quality on imbalanced datasets.
This paper improves QoS metric prediction in DTNs using diffusion models.
problem Improving QoS metric prediction in Delay-Tolerant Networks (DTNs) to enhance network performance.
method Formulates QoS metric prediction as a probabilistic forecasting problem on multivariate time series, incorporating latent temporal dynamics.
result The proposed approach outperforms traditional methods in QoS metric prediction for DTNs.
Proposes a new method to improve regression models with reweighted samples.
problem Improves regression models' performance under low sample sizes and covariate perturbations.
method Reparametrizes sample weights using a doubly non-negative matrix and solves the reweighted estimate efficiently.
result Adversarial reweighting strategy delivers promising results on various datasets.
Develops a new fuzzy model using QPs and ewl2 regularization to improve local region behavior.
problem Inability of constant and linear functions to accurately describe local regions in fuzzy models.
method Applied Fuzzy C-Means for structure identification, used QPs as consequents, introduced ewl2 regularization.
result Improved model's ability to describe local regions without overfitting.
Improves Lasso's stability in correlated predictor settings.
problem Lasso's selection stability deteriorates with correlated predictors.
method Integrates a weighting scheme into the Lasso penalty function, using a correlation-adjusted ranking.
result Demonstrates improved selection stability on simulated and real-world datasets.
Study quantifies firm risks from nature decline, showing significant equity losses.
problem Estimating the financial impact of nature deterioration on companies.
method Developed metrics (Country Degradation Index, Nature Risk Score) and assessed five environmental hazards.
result Global equities lose 26.8% in a nature decline scenario, with worst firms losing 75%.
Improved Gaussian process inference for spatio-temporal data.
problem Cubic computational costs in Gaussian process inference, especially in spatio-temporal settings.
method Proposes the Vanilla-SPDE Exchange, leveraging an equivalence between standard and SPDE formulations to achieve improved computational cost.
result Demonstrates improved computational efficiency through complexity analysis and numerical experiments.
Mixup technique improved, reducing manifold mismatch for better calibration.
problem Improving calibration of models using Mixup.
method Dynamic adjustment of interpolation coefficients based on sample similarity.
result Improved predictive performance and calibration with reduced manifold mismatch.
Model predicts Mozambique bank failures, aiding risk management.
problem Lack of bankruptcy prediction model in Mozambique banking sector.
method Linear Discriminant Analysis method, using financial indicators.
result Model accurately predicted 84% of bank failures 1 year before Central Bank intervention.
Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by matching marginal feature distributions through deep transformations on the inpu…
Researchers develop a method to interpret GNNs by identifying unnecessary edges in NLP models.
problem Understanding which parts of graphs contribute to NLP model predictions.
method A post-hoc method using differentiable edge masking to identify and drop unnecessary edges.
result Large proportions of edges can be dropped without affecting model performance, providing insights into model predictions.
Combines Gaussian processes and polynomial chaos for stochastic control.
problem Uncertainties in dynamic models lead to performance issues in predictive control.
method Combines Gaussian processes with polynomial chaos expansions to estimate probability distributions of nonlinear functions.
result Demonstrates accurate approximation and closed-loop performance in stochastic nonlinear model predictive control.
Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting in the deterioration of the predictive performance of these models. This paper …
Study on neural networks' performance in sequential task learning.
problem Understanding the performance of neural networks in sequential task learning.
method Theoretical analysis of generalization performance in continual learning using statistical mechanical analysis of kernel ridge-less regression.
result Characteristic transitions from positive to negative transfer observed in neural networks.
New method removes bias from data while maintaining accuracy.
problem Reduces bias in machine learning models while maintaining accuracy.
method Geometric method that removes correlations between data and protected variables.
result Debiased features are more accurate and fair than state-of-the-art algorithms.
New monitoring method detects ML risk models' performance changes in medical interventions.
problem Monitoring ML risk models in healthcare is complicated by confounding medical interventions.
method Developed a new score-based CUSUM monitoring procedure with dynamic control limits.
result Valid inference is possible if conditional exchangeability or time-constant selection bias hold.
Much work aims to explain a model's prediction on a static input. We consider explanations in a temporal setting where a stateful dynamical model produces a sequence of risk estimates given an input at each time step. When the estimated risk increases, the goal of the explanation is to attribute the increase to a few r…