New IRT method identifies useful datasets for ML classifier evaluation.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
5 results for “OpenML-CC18”
problem Lack of standard evaluation strategy for ML benchmarks.
method Applied Item Response Theory (IRT) to OpenML-CC18 benchmark.
result Not all datasets are useful for evaluating classifiers.
OpenML Benchmarking Suitesstat.ML
Machine learning research depends on objectively interpretable, comparable, and reproducible algorithm benchmarks. We advocate the use of curated, comprehensive suites of machine learning tasks to standardize the setup, execution, and reporting of benchmarks. We enable this through software tools that help to create an…
Chameleon learns model initializations across tasks with different schemas.
problem Meta-learning parameter initialization across tasks with varying predictor schemas.
method Chameleon aligns different predictor schemas to a common representation.
result Chameleon successfully learns parameter initializations across tasks with different schemas.
Generative model improves tabular data density estimation.
problem Challenges in estimating tabular data distribution.
method Tensor contraction layers and transformers in VAEs.
result Embedding representations improve density estimation metrics.
TabPFN quickly classifies small tabular data without tuning.
problem Efficiently classifying small tabular datasets.
method Transformer-based model that learns in-context.
result Competitive performance with state-of-the-art methods.