This study compares machine learning methods for high-cardinality categorical variables.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
CardiCat generates synthetic data for high-cardinality tabular datasets.
Paper solves high-order portfolio optimization with cardinality constraint.
Structured high-cardinality data arises in many domains, and poses a major challenge for both modeling and inference. Graphical models are a popular approach to modeling structured data but they are unsuitable for high-cardinality variables. The count-min (CM) sketch is a popular approach to estimating probabilities in…
Novel GLMMNet model tackles high-cardinality categorical features in actuarial applications.
Quantum computing tackles non-convex portfolio optimization with cardinality constraints.
Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is well-understood, with efficient computations taking O(DlogD) time. Yet efficient marginalizat…
Proposes a new DNN framework for count data with high-cardinality features.
Regularized target encoding beats traditional methods for high cardinality features in ML.
MMbeddings reduces categorical embeddings by treating them as latent effects, significantly decreasing parameters and mitigating overfitting.
Statistical models usually require vector representations of categorical variables, using for instance one-hot encoding. This strategy breaks down when the number of categories grows, as it creates high-dimensional feature vectors. Additionally, for string entries, one-hot encoding does not capture information in their…
Study improves top-k set prediction with low cardinality.
A cardinality-constrained portfolio caps the number of stocks to be traded across and within groups or sectors. These limitations arise from real-world scenarios faced by fund managers, who are constrained by transaction costs and client preferences as they seek to maximize return and limit risk. We develop a new appro…
We study the cardinality of the set of manifolds homotopy equivalent to a given manifold M and compare it to the cardinality of the structure set of M.
Study on loops on non-orientable surfaces, determining cardinality and order.
In this paper we address cardinality estimation problem which is an important subproblem in query optimization. Query optimization is a part of every relational DBMS responsible for finding the best way of the execution for the given query. These ways are called plans. The execution time of different plans may differ b…
The cardinality constraint is an intrinsic way to restrict the solution structure in many domains, for example, sparse learning, feature selection, and compressed sensing. To solve a cardinality constrained problem, the key challenge is to solve the projection onto the cardinality constraint set, which is NP-hard in ge…
Sparse methods for supervised learning aim at finding good linear predictors from as few variables as possible, i.e., with small cardinality of their supports. This combinatorial selection problem is often turned into a convex optimization problem by replacing the cardinality function by its convex envelope (tightest c…
Learning rule consistency tied to non-existence of real-valued measurable cardinals.
We determine the rank of the fundamental group of those hyperbolic 3-manifolds fibering over the circle whose monodromy is a sufficiently high power of a pseudo-Anosov map. Moreover, we show that any two generating sets with minimal cardinality are Nielsen equivalent.
A new algorithm tackles submodular bandit problems with multiple constraints.
Combines boosting with Gaussian process and mixed effects models.
Homotopy cardinality counts augmentations of Legendrian knots.
The paper optimizes asset selection for index trackers and enhanced trackers with varying cardinality constraints.
We introduce a notion of cardinality for the augmentation category associated to a Legendrian knot or link in standard contact R^3. This `homotopy cardinality' is an invariant of the category and allows for a weighted count of augmentations, which we prove to be determined by the ruling polynomial of the link. We prese…
Improved classification model for high-cardinality categorical predictors.
The aim of this paper is a characterization of great antipodal sets of complex Grassmannian manifolds as certain designs with the smallest cardinalities.
Novel approximation hierarchy for sparse quadratic programs.
Paper develops a high-order recombination algorithm for financial modeling.
Quandles can be regarded as generalizations of symmetric spaces. Among symmetric spaces, two-point homogeneous Riemannian manifolds would be the most fundamental ones. In this paper, we define two-point homogeneous quandles analogously, and classify those with prime cardinality.
For statistical learning, categorical variables in a table are usually considered as discrete entities and encoded separately to feature vectors, e.g., with one-hot encoding. "Dirty" non-curated data gives rise to categorical variables with a very high cardinality but redundancy: several categories reflect the same ent…
Study on top- classification with new loss functions and algorithms.
Random shuffle method boosts HF dataset size 10-21 times.
We propose a stochastic variance reduced optimization algorithm for solving sparse learning problems with cardinality constraints. Sufficient conditions are provided, under which the proposed algorithm enjoys strong linear convergence guarantees and optimal estimation accuracy in high dimensions. We further extend the …
Study shows mapping class groups differ for -cobordant manifolds.
Unified comparison of gradient boosting algorithms for insurance claims.
HNHN learns from hypergraphs with hyperedge neurons for better classification.
We present a study on reinforcement learning (RL) from human bandit feedback for sequence-to-sequence learning, exemplified by the task of bandit neural machine translation (NMT). We investigate the reliability of human bandit feedback, and analyze the influence of reliability on the learnability of a reward estimator,…
This work restricts hidden cardinality in causal models to infer causal relations.
In this paper we propose and discuss different 0-1 linear models in order to solve the cardinality constrained portfolio problem by using factor models. Factor models are used to build portfolios to track indexes, together with other objectives, also need a smaller number of parameters to estimate than the classical Ma…
Develops a new model for RLHF accounting for partially observed states and intermediate feedback.
We introduce the notion of a positive opetope and positive opetopic cardinals as certain finite combinatorial structures. The positive opetopic cardinals to positive-to-one polygraphs are like simple graphs to free omega-categories over omega-graphs, c.f. [MZ]. In particular, they allow us to give an explicit combinato…
We study and classify topologically invariant -ideals with a Borel base on the Hilbert cube and evaluate their cardinal characteristics. One of the results of this paper solves (positively) a known problem whether the minimal cardinalities of the families of Cantor sets covering the unit interval and the Hilbert cub…
New algorithm solves large cardinality-constrained clustering problems.
Improves treatment effect estimation by reducing sample size needed.
Plain vanilla K-means clustering has proven to be successful in practice, yet it suffers from outlier sensitivity and may produce highly unbalanced clusters. To mitigate both shortcomings, we formulate a joint outlier detection and clustering problem, which assigns a prescribed number of datapoints to an auxiliary outl…
Paper proposes a uniqueness Shapley measure to compare variable importance.
New approach to sparse optimal transport for matching tokens with experts.