A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Calibrating classifiers reduces grouping loss using sufficiency criteria.
The performance of standard learning procedures has been observed to differ widely across groups. Recent studies usually attribute this loss discrepancy to an information deficiency for one group (e.g., one group has less data). In this work, we point to a more subtle source of loss discrepancy---feature noise. Our mai…
New method estimates grouping loss in neural networks to improve confidence scores.
Though machine learning algorithms excel at minimizing the average loss over a population, this might lead to large discrepancies between the losses across groups within the population. To capture this inequality, we introduce and study a notion we call maximum weighted loss discrepancy (MWLD), the maximum (weighted) d…
Deep metric learning has yielded impressive results in tasks such as clustering and image retrieval by leveraging neural networks to obtain highly discriminative feature embeddings, which can be used to group samples into different classes. Much research has been devoted to the design of smart loss functions or data mi…
We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse regularization. In particular, we consider the L1 norm on the coefficients, its sorted Slope…
Loss minimization leads to multicalibration for neural networks.
Overparameterized neural networks can be highly accurate on average on an i.i.d. test set yet consistently fail on atypical groups of the data (e.g., by learning spurious correlations that hold on average but not in such groups). Distributionally robust optimization (DRO) allows us to learn models that instead minimize…
Machine learning models (e.g., speech recognizers) are usually trained to minimize average loss, which results in representation disparity---minority groups (e.g., non-native speakers) contribute less to the training objective and thus tend to suffer higher loss. Worse, as model accuracy affects user retention, a minor…
Many practical applications such as gene expression analysis, multi-task learning, image recognition, signal processing, and medical data analysis pursue a sparse solution for the feature selection purpose and particularly favor the nonzeros \emph{evenly} distributed in different groups. The exclusive sparsity norm has…
Most systems and learning algorithms optimize average performance or average loss -- one reason being computational complexity. However, many objectives of practical interest are more complex than simply average loss. This arises, for example, when balancing performance or loss with fairness across people. We prove tha…
Methodology measures financial impacts using existing credit loss infrastructure.
Causal machine-learning is about predicting the net-effect (true-lift) of treatments. Given the data of a treatment group and a control group, it is similar to a standard supervised-learning problem. Unfortunately, there is no similarly well-defined loss function due to the lack of point-wise true values in the data. M…
New loss function improves classification for imbalanced and sensitive groups.
This research tackles group fairness in predictive process monitoring by ensuring predictions are independent of sensitive group membership.
In genomic analysis, biomarker discovery, image recognition, and other systems involving machine learning, input variables can often be organized into different groups by their source or semantic category. Eliminating some groups of variables can expedite the process of data acquisition and avoid over-fitting. Research…
New method reduces privacy impact on model accuracy for underrepresented groups.
This paper develops a dynamic internal fraud model for operational losses in retail banking. It considers public operational losses arising from internal fraud in retail banking within a group of international banks. Additionally, the model takes into account internal factors such as the ethical quality of workers and …
Paper introduces a new robust method for estimating Pareto tail index from grouped data.
New method approximates curvature from symmetries in deep networks.
This paper improves operational risk modeling by selecting better loss severity distributions.
New risk control method for non-monotonic losses in complex parameters.
This work classifies SOC loss functions based on their gradient properties.
The paper decomposes probabilistic scores into reliability, uncertainty, and information loss.
The paper analyzes and proposes methods for privately sharing individual privacy losses using per-instance differential privacy.
Current methods to interpret deep learning models by generating saliency maps generally rely on two key assumptions. First, they use first-order approximations of the loss function neglecting higher-order terms such as the loss curvatures. Second, they evaluate each feature's importance in isolation, ignoring their int…
We present a new machine learning approach to estimate personalized treatment effects in the classical potential outcomes framework with binary outcomes. To overcome the problem that both treatment and control outcomes for the same unit are required for supervised learning, we propose surrogate loss functions that inco…
Proposes a method to ensure low losses across all subpopulations in large datasets.
In this paper, we propose an auto-encoder based generative neural network model whose encoder compresses the inputs into vectors in the tangent space of a special Lie group manifold: upper triangular positive definite affine transform matrices (UTDATs). UTDATs are representations of Gaussian distributions and can strai…
New guarantees for Group LASSO in sparse convex optimization.
ABM automates feature engineering and variable selection for loss-based models.
Study achieves fairness without demographic info, improving regression tasks.
It has been shown that dimension reduction methods such as PCA may be inherently prone to unfairness and treat data from different sensitive groups such as race, color, sex, etc., unfairly. In pursuit of fairness-enhancing dimensionality reduction, using the notion of Pareto optimality, we propose an adaptive first-ord…
New machine learning paradigm ignores loss function until action time.
The study quantifies decision-making risks from suboptimal classifiers and proposes methods to reduce these risks.
We study the impact of contagion in a network of firms facing credit risk. We describe an intensity based model where the homogeneity assumption is broken by introducing a random environment that makes it possible to take into account the idiosyncratic characteristics of the firms. We shall see that our model goes behi…
Paper analyzes trade-offs in top-k classification accuracies and proposes a new loss function.
Paper estimates differences in multi-attribute Gaussian graphical models using non-convex penalties.
A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better accuracy. These advances come with practical challenges: for instance, batch normalization ties the prediction of individual examples with o…
We study channel number reduction in combination with weight binarization (1-bit weight precision) to trim a convolutional neural network for a keyword spotting (classification) task. We adopt a group-wise splitting method based on the group Lasso penalty to achieve over 50% channel sparsity while maintaining the netwo…
Discover conservation laws from trajectories using a neural network.
We introduce a representation theory for risk operations on locally compact groups in a partition of unity on a topological manifold for Markowitz-Tversky-Kahneman (MTK) reference points. We identify (1) risk torsion induced by the flip rate for risk averse and risk seeking behaviour, and (2) a structure constant or co…
FedCBO solves clustered federated learning by optimizing groups of users without knowing their structure.
Background: Fluctuating hearing loss is characteristic of Meniere's Disease (MD) during acute episodes. However, no reliable audiometric hallmarks are available for counselling the hearing recovery possibility. Aims/Objectives: To find parameters for predicting MD hearing outcomes. Material and Methods: We applied mach…
Study shows sudden loss of balance in stock market networks after 2011, reducing predictability.
A new subdivision scheme for Heisenberg group values with central smoothness loss.
Significant progress has been made using fMRI to characterize the brain changes that occur in ASD, a complex neuro-developmental disorder. However, due to the high dimensionality and low signal-to-noise ratio of fMRI, embedding informative and robust brain regional fMRI representations for both graph-level classificati…
Let E be the Engel group and D be a rank 2 bracket generating left invariant distribution with a Lorentzian metric, which is a nondegenerate metric of index 1. In this paper, we first prove that timelike normal extremals are locally maximizing. Second, we obtain a parametrization of timelike, spacelike, lightlike norma…