Proposes a method to create shorter, more accurate prediction intervals.
problem Challenges in achieving both conditional validity and interval efficiency in complex settings.
method Uses a conformal-style calibration method for neural network responses, adjusting to empirical PIT distribution.
result Demonstrates better conditional calibration and shorter intervals than existing methods.
Proposes a framework for partially fair machine learning models.
problem Achieving full fairness across all score ranges compromises predictive performance.
method Formulates model training as constrained optimization with difference-of-convex constraints, solvable by IDCA.
result Demonstrates high predictive performance while enforcing partial fairness in specific percentile intervals.
Methods for prediction and tolerance intervals in non-normal models.
problem Constructing prediction and tolerance intervals for non-normal data.
method Two approaches: pivotal quantity approximation and confidence interval for mean.
result Intuitive, simple, efficient methods with proper operating characteristics.
The paper proposes a method to calibrate evidential clustering using bootstrapped finite mixture models.
problem Representing uncertainty in cluster membership using Dempster-Shafer mass functions.
method Constructing Dempster-Shafer mass functions by bootstrapping finite mixture models, computing confidence intervals, and calibrating the evidential partition.
result The proposed method calibrates the evidential partition such that the belief and plausibility degrees approximate the true probabilities with high confidence.
New algorithms optimize a soft-robust criterion in reinforcement learning, reducing conservatism.
problem Computing robust policies for high-stakes decisions with limited data.
method Soft-robust criterion using risk measures, two algorithms for optimization.
result Our algorithms produce less conservative solutions than existing methods.
A perturbative approach is used to derive approximations of arbitrary order to estimate high percentiles of sums of positive independent random variables that exhibit heavy tails. Closed-form expressions for the successive approximations are obtained both when the number of terms in the sum is deterministic and when it…
Bootstrap method for Markov chains in reinforcement learning.
problem Distributional consistency in finite controlled Markov chains with unknown control policies.
method Model-based bootstrap with novel LLN and CLT for visitation counts and transition increments.
result Asymptotically valid confidence intervals for value and Q-functions in offline RL. Optimizes policies for reinforcement learning with limited data.
problem Computing reliable policies with high confidence in reinforcement learning problems.
method Robust MDPs (RMDPs) with weighted L1 and L∞ norms to minimize ambiguity set spans.
result Optimized ambiguity sets improve policy performance significantly.
This note displays an interesting phenomenon for percentiles of independent but non-identical random variables. Let X1,⋯,Xn be independent random variables obeying non-identical continuous distributions and X(1)≥⋯≥X(n) be the corresponding order statistics. For any p∈(0,1), we investig…
Interference among concurrent transmissions in a wireless network is a key factor limiting the system performance. One way to alleviate this problem is to manage the radio resources in order to maximize either the average or the worst-case performance. However, joint consideration of both metrics is often neglected as …
Non-parametric bootstrap improves robust portfolio and trading strategy optimization.
problem Mitigating uncertainty in expected returns and covariances in financial decision-making.
method Non-parametric bootstrap framework for robust optimization without distributional assumptions.
result Improved out-of-sample performance with smoother, more stable results.
We propose a novel non-parametric adaptive anomaly detection algorithm for high dimensional data based on rank-SVM. Data points are first ranked based on scores derived from nearest neighbor graphs on n-point nominal data. We then train a rank-SVM using this ranked data. A test-point is declared as an anomaly at alpha-…
We propose a non-parametric anomaly detection algorithm for high dimensional data. We score each datapoint by its average K-NN distance, and rank them accordingly. We then train limited complexity models to imitate these scores based on the max-margin learning-to-rank framework. A test-point is declared as an anomaly…
We propose a non-parametric anomaly detection algorithm for high dimensional data. We first rank scores derived from nearest neighbor graphs on n-point nominal training data. We then train limited complexity models to imitate these scores based on the max-margin learning-to-rank framework. A test-point is declared as…
Locally adaptive interpretable regression improves linear regression's predictability.
problem Linear regression's predictability is limited; it lacks adaptability.
method Locally adaptive interpretable regression (LoAIR) uses neural networks to predict percentile of a Gaussian distribution for regression coefficients.
result LoAIR achieves comparable or better predictive performance than state-of-the-art baselines.
A deep RL framework optimizes resource allocation in wireless networks.
problem Optimizing resource allocation and interference in wireless networks.
method Multi-agent deep reinforcement learning for distributed decision-making.
result Our approach outperforms decentralized and centralized baselines in terms of user rates.
Novel loss functions improve decision tree learning from noisy data.
problem Training decision trees with noisy labels.
method Introducing distribution losses and a new negative exponential loss.
result The negative exponential loss leads to efficient and robust decision tree learning.
Neural network predicts short rate model steps accurately.
problem Predicting intractable short rate model steps.
method Proposes an algorithm using neural networks.
result Achieves superior outcomes compared to unbiased estimate.
The paper tackles fVaR prediction methods in finance.
problem Predicting future values at risk (fVaR) in finance.
method Various methods including Nested MC-empirical quantile, percentiles from distributions, quantile regressions, and limited inner simulations.
result Improved methods for predicting fVaRs, including those that are computationally efficient.
New model predicts financial transaction durations using quantiles.
problem Modeling financial transaction durations using traditional mean duration.
method Proposes a new autoregressive conditional duration model based on log-symmetric distributions reparametrized by quantiles.
result Proposed model allows for modeling different percentiles of financial transaction durations.
This paper presents a novel scaling method for unbiased risk estimation.
problem Challenges in risk assessment due to limited data, non-stationarity, and heavy tails.
method Develops a statistical framework for efficient risk scaling, extending beyond the square-root-of-time rule.
result Ensures robust and conservative risk estimation, applicable to small sample settings.
In this paper we discuss a general methodology to compute the market risk measure over long time horizons and at extreme percentiles, which are the typical conditions needed for estimating Economic Capital. The proposed approach extends the usual market-risk measure, ie, Value-at-Risk (VaR) at a short-term horizon and …
Hydropower reduces system electricity price and volatility, especially at extreme levels.
problem Impact of hydropower on system electricity price and volatility.
method Robust statistical analysis using multiple linear regression and quantile regression.
result Hydropower reduces system electricity price and volatility, especially at extreme levels.
In this paper, we present iPrescribe, a scalable low-latency architecture for recommending 'next-best-offers' in an online setting. The paper presents the design of iPrescribe and compares its performance for implementations using different real-time streaming technology stacks. iPrescribe uses an ensemble of deep lear…
Machine Learning techniques have become pervasive across a range of different applications, and are now widely used in areas as disparate as recidivism prediction, consumer credit-risk analysis and insurance pricing. The prevalence of machine learning techniques has raised concerns about the potential for learned algor…
We study cross-country GDP losses due to financial crises in terms of frequency (number of loss events per period) and severity (loss per occurrence). We perform the Loss Distribution Approach (LDA) to estimate a multi-country aggregate GDP loss probability density function and the percentiles associated to extreme eve…
We extend the Vasiček loan portfolio model to a setting where liabilities fluctuate randomly and asset values may be subject to systemic jump risk. We derive the probability distribution of the percentage loss of a uniform portfolio and analyze its properties. We find that the impact of liability risk is ambiguous and …
Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We name such intervals predictive intervals. This work presents a new method to fi…
Optimizes wireless power control using graph neural networks and counterfactual optimization.
problem Mitigating interference in wireless networks with multiple transmitter-receiver pairs.
method Graph neural network architecture combined with unsupervised primal-dual counterfactual optimization.
result Guarantees a minimum rate constraint that adapts to network size, balancing user rates.
Prediction intervals are a valuable way of quantifying uncertainty in regression problems. Good prediction intervals should be both correct, containing the actual value between the lower and upper bound at least a target percentage of the time; and tight, having a small mean width of the bounds. Many prior techniques f…
New methods for ordinal classification of interval-valued data and functional data.
problem Ordinal classification of interval-valued data and functional data.
method Six ordinal classifiers are proposed, including parametric, binary decomposition, logistic regression, distance-based, k-nearest-neighbor, kernel PCA, and random forest methods.
result Considering ordering and interval-valued information improves the accuracy of ordinal classification.
Develops active intervals for geodesics in Teichmüller space.
problem Understanding geodesics in Teichmüller space with no backtracking.
method Defines active intervals for subsurfaces along geodesics in Thurston metric.
result Active intervals represent reparametrized quasi-geodesics in curve graphs with bounded movement outside.
Confidence intervals based on penalized maximum likelihood estimators such as the LASSO, adaptive LASSO, and hard-thresholding are analyzed. In the known-variance case, the finite-sample coverage properties of such intervals are determined and it is shown that symmetric intervals are the shortest. The length of the sho…
CONTINA provides adaptive confidence intervals for traffic demand prediction.
problem Uncertainty in future traffic demand predictions and the need for valid confidence intervals.
method Adaptive confidence interval method that adjusts based on deployment errors.
result Valid confidence intervals with shorter lengths and theoretical coverage guarantee.
Proposes a method to create prediction intervals for neural networks using cross-validation.
problem Lack of prediction intervals for neural networks.
method k-fold cross-validation to construct conformal prediction intervals.
result Proposed method produces narrower intervals with similar coverage compared to SC method.
The statistical properties of the return intervals τq between successive 1-min volatilities of 30 liquid Chinese stocks exceeding a certain threshold q are carefully studied. The Kolmogorov-Smirnov (KS) test shows that 12 stocks exhibit scaling behaviors in the distributions of τq for different thresholds q. …
The paper presents a method for generating well-calibrated prediction intervals using quality-driven deep ensembles.
problem Generating reliable prediction intervals for regression analysis.
method A multi-objective loss function combining quality measures for prediction intervals and point estimates, with a penalty function to ensure semantic integrity and stability.
result The method produces well-calibrated prediction intervals and point estimates, capturing both aleatoric and epistemic uncertainty.
Constructs tail-specific prediction intervals for financial applications
problem Financial applications require strict control on the left tail
method Extends classical conformal frameworks to provide explicit tail-specific guarantees
result Improved directional calibration in skewed data
Analyzes biased random walks and corrupted intervals in adversarial settings.
problem Learning thresholds and intervals in adversarial conditions.
method Analyzes biased random walks and corrupted intervals under adversarial design.
result Analyzes the expected behavior of biased random walks and corrupted intervals.
Paper introduces a new method for classifying interval-valued time series.
problem Classification of interval-valued time series.
method Extends point-valued time series imaging methods to interval-valued scenarios using DK-distance and employs deep learning for classification. result Proposed method achieves superior classification performance compared to existing methods.
Extends Fisher's Discriminant Analysis for interval-valued data.
problem Classifying entities represented by intervals and histograms.
method Adapts Fisher's Discriminant Analysis using Moore's interval arithmetic and Mallows' distance.
result Discriminant directions for interval-valued data are numerically maximized.
Energy markets and the associated energy futures markets play a crucial role in global economies. We investigate the statistical properties of the recurrence intervals of daily volatility time series of four NYMEX energy futures, which are defined as the waiting times τ between consecutive volatilities exceeding a gi…
This work challenges the assumption that shorter conformal prediction intervals are always better.
problem The conventional evaluation of conformal prediction metrics (coverage and interval length) may not fully capture the quality of predictions.
method The Prejudicial Trick (PT) is introduced, which probabilistically returns either a null interval or a longer one to maintain valid coverage while potentially reducing interval length.
result The Prejudicial Trick can yield deceptively shorter intervals without compromising coverage, but introduces practical vulnerabilities.
Study optimality conditions for interval-valued optimization problems on Riemannian manifolds.
problem Optimizing interval-valued functions on Riemannian manifolds under a total order relation.
method Generalized Hukuhara directional differentiability to derive KKT-type optimality conditions.
result Derives optimality conditions for interval-valued optimization problems on Riemannian manifolds.
Boosted conformal procedure improves prediction intervals.
problem Enhancing prediction interval properties like coverage and length.
method Gradient boosting to optimize conformity score function.
result Significant improvements in interval length and coverage.
We investigate scaling and memory effects in return intervals between price volatilities above a certain threshold q for the Japanese stock market using daily and intraday data sets. We find that the distribution of return intervals can be approximated by a scaling function that depends only on the ratio between the …
Machine Learning models are often composed of pipelines of transformations. While this design allows to efficiently execute single model components at training time, prediction serving has different requirements such as low latency, high throughput and graceful performance degradation under heavy load. Current predicti…
Paper simulates LR fuzzy intervals with interval-valued cores.
problem Generating random fuzzy intervals with interval-valued cores.
method Developed algorithms for simulating LR fuzzy numbers with interval-valued cores.
result Numerically efficient algorithm for simulating fuzzy values.