We analyze general model selection procedures using penalized empirical loss minimization under computational constraints. While classical model selection approaches do not consider computational aspects of performing model selection, we argue that any practical model selection procedure must not only trade off estimat…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,786 papers · 148 categories
Trend · papers per month
48 results for “empirical selection”
A new feature selection method using attention for neural networks.
problem Feature selection for neural networks with a budget constraint.
method Sequential Attention: greedy forward selection with attention weights.
result Achieves state-of-the-art results for neural networks.
Efficiently selects important variables in high-dimensional logistic regression.
problem Variable selection in high-dimensional logistic regression with binary responses.
method Developed a variational empirical Bayes approach for efficient model space marginal distribution.
result The variational approximation inherits strong selection consistency from the posterior distribution.
Machine learning selects the best prediction rules from noisy data.
problem Selection under uncertainty in machine learning.
method Statistical tools and inequalities to control noise in empirical estimates.
result Theoretical guarantees on selection outcomes under uncertainty.
Paper proposes adaptive parameter selection for KGD algorithms.
problem Improving parameter selection for kernel-based gradient descent.
method Integrates bias-variance analysis with splitting method, introduces empirical effective dimension.
result Adaptive parameter selection strategy achieves optimal generalization error bound.
A new method sorts models to find the best one with minimal risk.
problem Finding the best model with minimal risk among nested models.
method Nested Empirical Risk (NER) and Sorted NER (S-NER) methods.
result The S-NER method selects the true model order and the most parsimonious model.
Investigates model selection challenges in heterogeneous treatment effect estimation.
problem Lack of validation metrics for choosing the best model in treatment effect estimation.
method Empirical investigation of different model selection criteria.
result Complex interplay between selection strategies, estimators, and data.
Markowitz (1952, 1959) laid down the ground-breaking work on the mean-variance analysis. Under his framework, the theoretical optimal allocation vector can be very different from the estimated one for large portfolios due to the intrinsic difficulty of estimating a vast covariance matrix and return vector. This can res…
A new two-step MH method for Bayesian EL computation.
problem Complex likelihood support in Bayesian EL.
method Hierarchical Metropolis Hastings with reversible jump MCMC.
result Improved sampling from BayesEL posteriors.
Study compares mutation validation and cross-validation for model selection.
problem Comparing model selection methods for generalization performance and computational efficiency.
method Empirical comparison using benchmark and real-world datasets with Bayesian tests.
result Both methods select models with equivalent generalization performance but MV selects simpler models and is computationally cheaper.
Benchmarking 18 deep neural network selective classification models on various datasets.
problem Designing a model that can abstain from making predictions when there's high risk of error.
method Evaluation of 18 selective classification models using multiple criteria.
result No single model is the clear winner; best model depends on objectives.
The paper examines domain generalization algorithms and finds empirical risk minimization performs well.
problem Comparing domain generalization algorithms is difficult due to inconsistent experimental conditions.
method Implemented DomainBed, a testbed for domain generalization with seven datasets and model selection criteria.
result Empirical risk minimization shows state-of-the-art performance across all datasets.
Beyond the Selected Completely At Random Assumption for Learning from Positive and Unlabeled Datacs.LG
Most positive and unlabeled data is subject to selection biases. The labeled examples can, for example, be selected from the positive set because they are easier to obtain or more obviously positive. This paper investigates how learning can be ena BHbled in this setting. We propose and theoretically analyze an empirica…
A new method for selective classification trades off accuracy for coverage.
problem Selective classification allows a classifier to abstain from predicting some instances.
method Optimizes a collection of class-wise decoupled one-sided empirical risks.
result The method achieves near-optimal coverage in high target accuracy regimes.
Parameter selection in Gaussian process interpolation: an empirical study of selection criteriastat.ME
The study evaluates different parameter selection methods for Gaussian process interpolation.
problem Choosing optimal parameters for Gaussian process interpolation.
method Empirical study using scoring rules and leave-one-out selection criteria.
result The choice of model family is often more important than the selection criterion.
We test three common information criteria (IC) for selecting the order of a Hawkes process with an intensity kernel that can be expressed as a mixture of exponential terms. These processes find application in high-frequency financial data modelling. The information criteria are Akaike's information criterion (AIC), the…
Study evaluates model selection methods for time series forecasting.
problem Evaluating which model is best for time series forecasting.
method Compared various estimation methods for selecting the best model.
result Accuracy of model selection estimators is low, and performance loss is significant.
RL approach for continuous-time mean-variance portfolio selection with empirical validation.
problem Continuous-time mean-variance portfolio selection in unknown market coefficients.
method Reinforcement learning for diffusion processes, sublinear regret bound derivation.
result RL strategy consistently outperforms model-based counterparts, especially in volatile markets.
Time series forecasting models fail to consistently select the best model across different datasets.
problem Inconsistency in model selection for time series forecasting across varying data regimes.
method Characterized time series using descriptors like trend strength, seasonality, noise level, and temporal dependence. Developed a rule-based selection mechanism to map data regimes to candidate models.
result Rule-based model selection achieves low accuracy, with correct model identification occurring in only a small fraction of cases.
Solar improves variable selection in high-dimensional data with complicated dependence structures.
problem Variable selection in ultrahigh dimensional data with severe multicollinearity and grouping effect issues.
method Subsample-ordered least angle regression (Solar) for ultrahigh dimensional data.
result Solar yields substantial improvements in sparsity, stability, and accuracy of variable selection compared to traditional methods.
Greedy selection finds smaller, more accurate subnetworks.
problem Finding smaller, accurate subnetworks in large neural networks.
method Greedy forward selection starting from an empty network.
result Theoretical guarantee of finding subnetworks with lower loss.
SPOT uses optimal transport to select important prototypes.
problem Summarizing datasets for better understanding and decision making.
method Modeling prototype selection as a submodular optimization problem and using a greedy algorithm.
result Our approach efficiently selects prototypes with optimal transport that best represent the target dataset.
The paper explores how to select data points for optimal learning performance.
problem Optimizing data selection for empirical risk minimizers.
method Fixing a learning rule and focusing on optimizing the training data selection.
result Achieving performance comparable to training on the entire population with a small subset of data points.
Tree tensor networks balance model complexity and empirical risk for high-dimensional function approximation.
problem Selecting optimal tree structure and ranks for high-dimensional function approximation.
method Proposes a complexity-based model selection method for tree tensor networks in empirical risk minimization.
result Demonstrates near-minimax adaptive performance across various smoothness classes.
Null-Calibrated Conformal Selection via Target-Membership Scores
problem Identifying test candidates whose unknown responses fall in a target region while controlling the false discovery rate
method Membership-score-based conformal selection
result Finite-sample valid null p-values
New method approximates CV for model assessment and selection.
problem Efficient model assessment and selection with large number of folds.
method Approximates expensive refitting with a single Newton step warm-started from full training set optimizer.
result Uniform non-asymptotic, deterministic model assessment guarantees for approximate CV.
Weighted Empirical Risk Minimization: Sample Selection Bias Correction based on Importance Samplingstat.ML
Corrects sample selection bias in empirical risk minimization using importance sampling.
problem Statistical learning with biased training data.
method Weighted empirical risk minimization using importance sampling.
result Generalization capacity preserved with estimated importance weights.
Paper introduces a new IV estimator using ridge regression for better performance.
problem Improving IV estimator performance in linear models with endogeneity.
method Uses ridge regression with an empirically selected regularization parameter.
result The ridge estimator outperforms two-stage least squares under certain conditions.
Bayesian principles improve neural additive models for better feature selection and uncertainty.
problem Lack of calibrated uncertainties and feature selection in neural additive models.
method Augmenting NAMs with Bayesian principles to provide credible intervals, feature selection, and interaction ranking.
result Improved performance on tabular datasets and real-world medical tasks.
The paper explores how smaller data sets can lead to better model selection decisions.
problem Model selection in small data regimes.
method Empirical study of generalization performance with varying training set sizes.
result Training on smaller subsets of data can lead to more reliable model selection decisions.
The paper explores effective data selection methods for weakly supervised learning.
problem Efficiently selecting a subset of unlabeled data for weakly supervised learning.
method Using a surrogate model to predict labels and selecting a subset of samples for training.
result Data selection can significantly improve model performance over training on the full dataset.
Deep learning methods improve time series forecasting by optimizing lag selection.
problem Optimizing the number of lags for accurate univariate time series forecasting.
method Empirical analysis of deep learning methods trained on multiple time series datasets.
result Excessively small or large lag sizes negatively impact forecasting performance.
Estimates true Sharpe ratio of selected assets with various methods.
problem Estimating the true Sharpe ratio of a selected asset with high in-sample ratio.
method Polyhedral lemma, James Stein shrinkage, debiasing, thresholding, empirical Bayes.
result James Stein estimator performs best across various parameter values.
A Stable Lassostat.ME
Improves Lasso's stability in correlated predictor settings.
problem Lasso's selection stability deteriorates with correlated predictors.
method Integrates a weighting scheme into the Lasso penalty function, using a correlation-adjusted ranking.
result Demonstrates improved selection stability on simulated and real-world datasets.
mRMR method selects relevant features for marketing models without redundancy.
problem Selecting relevant features from large feature spaces in machine learning.
method Extends mRMR framework with non-linear redundancy and model-based relevance measures.
result Implemented mRMR method in production for Uber's marketing machine learning platform.
Top Two Algorithms Revisitedstat.ML
Improved theoretical guarantees for Top Two algorithms.
problem Theoretical support for best arm identification with bounded distributions.
method General analysis of Top Two methods, identifying desirable properties and replacing sampling step.
result Theoretical support for Top Two algorithms with bounded distributions.
Given a set of possible models (e.g., Bayesian network structures) and a data sample, in the unsupervised model selection problem the task is to choose the most accurate model with respect to the domain joint probability distribution. In contrast to this, in supervised model selection it is a priori known that the chos…
The Minimal Learning Machine improves regression performance with reference point selection.
problem Improving the performance of the Minimal Learning Machine (MLM) in regression tasks.
method Developed theoretical guarantees for MLM's interpolation and approximation capabilities. Proposed clustering-based methods for selecting reference points to enhance MLM's generalization.
result Clustering-based methods for reference point selection outperform random selection, especially with a small number of points.
Develops a faster model selection method using influence functions.
problem Time-consuming and computationally inefficient model selection.
method Model-specific data subsampling guided by influence functions.
result Empirically shows improved selection of high-quality models.
Used to estimate the risk of an estimator or to perform model selection, cross-validation is a widespread strategy because of its simplicity and its apparent universality. Many results exist on the model selection performances of cross-validation procedures. This survey intends to relate these results to the most recen…
Counterfactual Cross-Validation: Stable Model Selection Procedure for Causal Inference Modelsstat.ML
A new metric for stable model selection in CATE prediction.
problem Model selection in conditional average treatment effect (CATE) prediction.
method Analysis of model performance ranking and formulation of a novel metric.
result Our metric outperforms existing metrics in model selection and hyperparameter tuning.
Myopic procedures are shown to be asymptotically optimal in ranking and selection problems.
problem Selecting the best design from a set with unknown mean performance.
method Myopic procedures that iteratively improve an approximation of the objective measure.
result Myopic procedures satisfy optimality conditions of ranking and selection problems.
Deep learning has become increasingly popular in both supervised and unsupervised machine learning thanks to its outstanding empirical performance. However, because of their intrinsic complexity, most deep learning methods are largely treated as black box tools with little interpretability. Even though recent attempts …
We explore the problem of learning under selective labels in the context of algorithm-assisted decision making. Selective labels is a pervasive selection bias problem that arises when historical decision making blinds us to the true outcome for certain instances. Examples of this are common in many applications, rangin…
On-line portfolio selection has attracted increasing interests in machine learning and AI communities recently. Empirical evidences show that stock's high and low prices are temporary and stock price relatives are likely to follow the mean reversion phenomenon. While the existing mean reversion strategies are shown to …
Empirical study shows Randomized Signature Methods improve portfolio optimization in financial markets.
problem Drift estimation in non-linear, non-parametric financial markets is challenging.
method Applied Randomized Signature Methods for non-linear, non-parametric drift estimation in multi-variate financial markets.
result Randomized Signature Methods provide features on the same scale and improve portfolio optimization in real-world settings.
Framework for assessing fairness across similar predictive models.
problem Fairness in predictive models across different groups.
method Develops a framework for characterizing fairness over the set of good models under selective labels.
result Framework can replace or audit models for better fairness properties.
Nonparametric undirected graphical model selection using diffusion models
problem Undirected graphical model selection
method Diffusion models
result Model selection consistency