New method finds optimal hyperparameters for multiple tasks and criteria.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Stress, edge crossings, and crossing angles play an important role in the quality and readability of graph drawings. Most standard graph drawing algorithms optimize one of these criteria which may lead to layouts that are deficient in other criteria. We introduce an optimization framework, Stress-Plus-X (SPX), that sim…
New framework for resilient bi-criteria optimization under noisy feedback.
New algorithms minimize risk in MNL bandits, achieving near-optimal performance.
A game-theoretic approach to multi-criteria ranking from ordinal data.
Unified perspective unites Bayesian optimization and active learning for efficient goal-oriented optimization.
This paper optimizes stock portfolios considering ESG criteria using Bayesian optimization.
New method for dynamic valuation in markets with random endowments.
Bayesian optimization has been proposed as a practical and efficient tool through which to tune parameters in many difficult settings. Recently, such techniques have been combined with real-time fMRI to propose a novel framework which turns on its head the conventional functional neuroimaging approach. This closed-loop…
Study tackles criterion collapse in learning criteria, showing conditions for loss minimization.
Extends ML fairness to handle minority groups over time.
New methods ensure fairness in noisy protected groups.
AutoML systems are currently rising in popularity, as they can build powerful models without human oversight. They often combine techniques from many different sub-fields of machine learning in order to find a model or set of models that optimize a user-supplied criterion, such as predictive performance. The ultimate g…
We consider the problem of identifying patterns in a data set that exhibit anomalous behavior, often referred to as anomaly detection. In most anomaly detection algorithms, the dissimilarity between data samples is calculated by a single criterion, such as Euclidean distance. However, in many cases there may not exist …
Framework benchmarks optimizers on multiple criteria.
This paper considers the problem of choosing a good classifier. For each problem there exist an optimal classifier, but none are optimal, regarding the error rate, in all cases. Because there exists a large number of classifiers, a user would rather prefer an all-purpose classifier that is easy to adjust, in the hope t…
The ultimate goal of optimization is to find the minimizer of a target function.However, typical criteria for active optimization often ignore the uncertainty about the minimizer. We propose a novel criterion for global optimization and an associated sequential active learning strategy using Gaussian processes.Our crit…
New algorithm solves phase retrieval with adaptive stopping criteria.
Optimizes decision-making with uncertain variables using auxiliary observations.
In this paper we consider the problem of Gaussian process classifier (GPC) model selection with different Leave-One-Out (LOO) Cross Validation (CV) based optimization criteria and provide a practical algorithm using LOO predictive distributions with such criteria to select hyperparameters. Apart from the standard avera…
Managing risk in dynamic decision problems is of cardinal importance in many fields such as finance and process control. The most common approach to defining risk is through various variance related criteria such as the Sharpe Ratio or the standard deviation adjusted reward. It is known that optimizing many of the vari…
Assume (1) asset returns follow a stochastic multi-factor process with time-varying conditional expectations; (2) investments are linear functions of factors. This paper calculates asymptotic joint moments of the logarithm of investor's wealth and the factors. These formulas enable fast computation of a wide range of i…
The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to resolve the tradeoff by using a fixed exploration mechanism, such as -greedy ex…
The purpose of this study is to introduce new design-criteria for next-generation hyperparameter optimization software. The criteria we propose include (1) define-by-run API that allows users to construct the parameter search space dynamically, (2) efficient implementation of both searching and pruning strategies, and …
We prove some criteria for uniform K-stability of log Fano pairs. In particular, we show that uniform K-stability is equivalent to -invariant having a positive lower bound. Then we study the relation between optimal destabilization conjecture and the conjectural equivalence between uniform K-stability and K-stabilit…
A usual reinsurance policy for insurance companies admits one or two layers of the payment deductions. Under optimal criterion of minimizing the conditional tail expectation (CTE) risk measure of the insurer's total risk, this article generalized an optimal stop-loss reinsurance policy to an optimal multi-layer reinsur…
In experimental design, we are given vectors in dimensions, and our goal is to select of them to perform expensive measurements, e.g., to obtain labels/responses, for a linear regression task. Many statistical criteria have been proposed for choosing the optimal design, with popular choices including A…
New method speeds up model selection for complex scientific tasks.
Unified framework for risk-aware policy learning in contextual bandits.
In a Markovian stochastic volatility model, we consider financial agents whose investment criteria are modelled by forward exponential performance processes. The problem of contingent claim indifference valuation is first addressed and a number of properties are proved and discussed. Special attention is given to the c…
The construction of efficient and effective decision trees remains a key topic in machine learning because of their simplicity and flexibility. A lot of heuristic algorithms have been proposed to construct near-optimal decision trees. ID3, C4.5 and CART are classical decision tree algorithms and the split criteria they…
Inference-aware meta-alignment of LLMs reduces computational cost.
This work explores alternative learning criteria beyond traditional risk.
The experimental design problem concerns the selection of k points from a potentially large design pool of p-dimensional vectors, so as to maximize the statistical efficiency regressed on the selected k design points. Statistical efficiency is measured by optimality criteria, including A(verage), D(eterminant), T(race)…
In many sequential decision-making problems we may want to manage risk by minimizing some measure of variability in rewards in addition to maximizing a standard criterion. Variance related risk measures are among the most common risk-sensitive criteria in finance and operations research. However, optimizing many such c…
The paper optimizes designs for distinguishing between Gaussian process models.
Model selection based on classical information criteria, such as BIC, is generally computationally demanding, but its properties are well studied. On the other hand, model selection based on parameter shrinkage by -type penalties is computationally efficient. In this paper we make an attempt to combine their st…
We introduce the concept of forward rank-dependent performance processes, extending the original notion to forward criteria that incorporate probability distortions. A fundamental challenge is how to reconcile the time-consistent nature of forward performance criteria with the time-inconsistency stemming from probabili…
We consider a discrete-time, generically incomplete market model and a behavioural investor with power-like utility and distortion functions. The existence of optimal strategies in this setting has been shown in a previous paper under certain conditions on the parameters of these power functions. In the present paper w…
Paper introduces new evaluation criteria for feature-based model explanations.
Feature selection aims to select the smallest feature subset that yields the minimum generalization error. In the rich literature in feature selection, information theory-based approaches seek a subset of features such that the mutual information between the selected features and the class labels is maximized. Despite …
Efficiency criteria improve conformal predictors' performance.
Transforms game optimization dynamics into frequency domain for precise hyperparameter analysis.
vsOED optimizes experiment design with reinforcement learning for Bayesian models.
Innovative game theory approach optimizes survival analysis metrics.
Proposes SNML for selecting word2vec Skip-gram dimensionality.
By reducing optimization to a sequence of smaller subproblems, working set algorithms achieve fast convergence times for many machine learning problems. Despite such performance, working set implementations often resort to heuristics to determine subproblem size, makeup, and stopping criteria. We propose BlitzWS, a wor…
The paper integrates statistical significance and discriminative power in pattern discovery.