We explain SSL objectives as log-likelihoods in a data curation model.
problem Lack of understanding of SSL objectives as log-likelihoods.
method Formulate SSL objectives as a log-likelihood in a generative model of data curation.
result SSL methods can be understood as lower-bounds on a principled log-likelihood.
The paper resolves the paradox of using less data in machine learning.
problem The paradox of using less data in machine learning.
method Theoretical framework and data curation strategies.
result Small curated datasets can outperform full datasets under certain conditions.
Method curates cost-effective, high-quality datasets using AI models.
problem Costly manual labeling of datasets.
method Probably Approximately Correct Labels (PACL) method.
result Curates high-quality datasets with low overall labeling error.
DataRater learns which data points are most valuable for training models.
problem Training model efficiency depends on high-quality training data.
method Meta-learning to estimate the value of data points for training.
result Meta-learning improves compute efficiency by filtering data effectively.
The recent advances in Natural Language Processing have been a boon for well-represented languages in terms of available curated data and research resources. One of the challenges for low-resourced languages is clear guidelines on the collection, curation and preparation of datasets for different use-cases. In this wor…
The paper shows how curated synthetic data can optimize human preferences in generative models.
problem Contamination of web-scale datasets by synthetic data affects future model training.
method Theoretical study of iterated retraining of generative models with curated synthetic data.
result Data curation can be seen as an implicit preference optimization mechanism, maximizing expected reward.
Cold posteriors in BNNs harm performance, likely due to incorrect likelihood.
problem Cold posteriors in Bayesian neural networks degrade performance.
method Developed a generative model explaining cold posteriors and matched it to the tempered likelihoods.
result Cold posteriors are a result of using the wrong likelihood for image classification datasets.
The paper investigates ethical issues in large image datasets, focusing on pornographic content.
problem Ethical issues in large-scale computer vision datasets, particularly concerning pornographic content.
method Cross-sectional model-based quantitative census covering various factors in the ImageNet-ILSVRC-2012 dataset.
result The dataset contains verifiably pornographic images, including non-consensual and voyeuristic content.
CrossFilter tackles noisy labels in audio tagging.
problem Noisy labels in large audio datasets.
method CrossFilter framework using multiple representations and multi-task learning.
result Improves audio tagging performance on FSDKaggle2018 and FSDKaggle2019 datasets.
SubseasonalClimateUSA dataset improves subseasonal weather forecasting.
problem Challenges in subseasonal weather forecasting, especially skill of physics-based models and integration of local and global variables.
method Curated dataset for training and benchmarking subseasonal forecasting models, including various methods.
result Benchmarking suggests simple and effective ways to improve current operational models.
Machine learning research depends on objectively interpretable, comparable, and reproducible algorithm benchmarks. We advocate the use of curated, comprehensive suites of machine learning tasks to standardize the setup, execution, and reporting of benchmarks. We enable this through software tools that help to create an…
ConCuR generates high-quality CUDA kernels with concise reasoning traces.
problem Scarce high-quality data for kernel generation.
method Developed a pipeline to generate and curate high-quality CUDA kernels with reasoning traces.
result Our model achieves significant improvements in KernelBench setup.
The paper examines how decentralized credit curators have taken over risk management from traditional protocols.
problem Risk management in decentralized credit has shifted from centralized protocols to decentralized curators.
method Analysis of ERC 4626 vaults and third-party curators, focusing on capital utilization, concentration, and fee margins.
result Curators have a significant impact on the risk profile of decentralized credit systems, with a small set of curators handling a disproportionate share of system TVL.
We envision AI marketplaces to be platforms where consumers, with very less data for a target task, can obtain a relevant model by accessing many private data sources with vast number of data samples. One of the key challenges is to construct a training dataset that matches a target task without compromising on privacy…
InvestLM is a financial domain LLM tuned on LLaMA-65B for investment advice.
problem Improving financial text understanding and advice generation for investment.
method Curated financial instruction dataset, LLaMA-65B, less-is-more-for-alignment approach.
result InvestLM provides comparable responses to state-of-the-art commercial models.
FinSphere improves stock analysis quality with AI and expert-curated data.
problem Lack of objective evaluation metrics and depth in stock analysis by FinLLMs.
method Developed AnalyScore, curated Stocksis dataset, and FinSphere AI agent.
result FinSphere outperforms general and domain-specific LLMs in generating high-quality stock analysis reports.
New insights into bias mitigation show DRO isn't a complete solution.
problem Bias in machine learning systems across different data subsets.
method Theoretical analysis of Distributionally Robust Optimization (DRO) and data curation.
result Neither DRO nor data curation alone can fully address bias issues.
The paper compares aggregated data labels in curated and random bags for machine learning models.
problem Protecting user privacy in machine learning systems with aggregated data.
method Examined curated and random bags for training machine learning models and compared their performance.
result Gradient-based learning can be performed on aggregated data without performance degradation.
Data-driven approach discovers molecular photoswitches with separated electronic absorption bands.
problem Engineering photoswitchable molecules with specific electronic absorption bands remains challenging.
method Data-driven discovery pipeline using Gaussian processes for multitask learning.
result Multioutput Gaussian process (MOGP) trained on four photoswitch transition wavelengths outperforms single-task models and TD-DFT.
Improved tabular models learn better from real-world data.
problem Tabular models perform poorly on real-world datasets when trained only on synthetic data.
method Continued pre-training on a curated set of real-world datasets.
result Real-TabPFN achieves superior predictive accuracy on 29 datasets.
For a social networking service to acquire and retain users, it must find ways to keep them engaged. By accurately gauging their preferences, it is able to serve them with the subset of available content that maximises revenue for the site. Without the constraints of an appropriate regulatory framework, we argue that a…
WILDS 2.0 expands benchmark datasets for unsupervised adaptation.
problem Leveraging unlabeled data for distribution shifts in real-world applications.
method Curated unlabeled data across various applications, tasks, and modalities.
result State-of-the-art methods perform poorly on WILDS datasets.
CAI automates extraction and validation of corporate GHG emission metrics.
problem Manual extraction of corporate GHG emission metrics is labor-intensive and error-prone.
method CAI uses LLMs to automate extraction and validation of metrics from corporate disclosures.
result CAI improves data collection efficiency and accuracy by automating the process.
Study on self-consuming generative models with diverse human curation, focusing on convergence and stability.
problem Analyzing self-consuming generative models with heterogeneous human curation.
method Investigates the asymptotic behavior of retraining dynamics using nonlinear Perron--Frobenius theory and Banach contraction mapping.
result Improves convergence results and provides stability and non-stability analyses for the model.
DeepVir uses deep matrix factorization to predict antivirals for COVID-19.
problem Predicting effective antivirals for COVID-19 using known drug-virus associations.
method Graphical deep matrix factorization with HyPALM optimization.
result DeepVir outperforms state-of-the-art techniques in predicting antivirals for COVID-19.
Quantum SVM improves financial data classification.
problem Classifying financial data using quantum machine learning.
method Application of quantum kernels to financial data, specifically DSEx Broad Index.
result Empirical quantum advantage demonstrated for financial data classification.
This work simplifies data valuation for LLMs using Shapley value computation.
problem How to fairly distribute benefits from training superior LLMs with multiple data owners' resources.
method We leverage the specific mathematical structure of DPO to enable scalable Shapley value computation for LLMs.
result We demonstrate that Shapley value computation for LLMs trained with DPO is significantly simplified.
Dataset of Bose-Einstein condensates images aids ML in many-body physics.
problem Understanding solitons in Bose-Einstein condensates.
method Machine learning (ML) framework with convolutional neural networks and physics-informed classifiers.
result Automatic labeling of solitonic excitations in experimental images.
FLAME improves privacy in federated learning without trusted parties.
problem Ensuring privacy in federated learning without trusted parties.
method FLAME uses the shuffle model of differential privacy to achieve better accuracy and privacy.
result FLAME protocols improve testing accuracy by 60.7% compared to local model FL.
We introduce two challenging datasets that reliably cause machine learning model performance to substantially degrade. The datasets are collected with a simple adversarial filtration technique to create datasets with limited spurious cues. Our datasets' real-world, unmodified examples transfer to various unseen models …
In machine learning the best performance on a certain task is achieved by fully supervised methods when perfect ground truth labels are available. However, labels are often noisy, especially in remote sensing where manually curated public datasets are rare. We study the multi-modal cadaster map alignment problem for wh…
For statistical learning, categorical variables in a table are usually considered as discrete entities and encoded separately to feature vectors, e.g., with one-hot encoding. "Dirty" non-curated data gives rise to categorical variables with a very high cardinality but redundancy: several categories reflect the same ent…
Radio emitter recognition in dense multi-user environments is an important tool for optimizing spectrum utilization, identifying and minimizing interference, and enforcing spectrum policy. Radio data is readily available and easy to obtain from an antenna, but labeled and curated data is often scarce making supervised …
NIFTY dataset for financial forecasting models.
problem Improving financial market forecasting with LLMs.
method Two datasets for supervised and reinforcement learning.
result Demonstrates applications in stock price prediction.
Many of the recent approaches to polyphonic piano note onset transcription require training a machine learning model on a large piano database. However, such approaches are limited by dataset availability; additional training data is difficult to produce, and proposed systems often perform poorly on novel recording con…
Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for discovery of hidden semantic architecture of text datasets, and plays a fundamental role in many machine learning applications. However, like many other machine learning algorithms, the process of training a LDA model may leak the sensitive inf…
Survey on using large models to train smaller datasets in NLP.
problem Lack of large datasets and computing resources for NLP tasks.
method Analysis of recent transfer learning approaches in NLP.
result Increased demand for transfer learning in NLP due to large models.
Dynamic pricing improves DeFi lending efficiency by reducing regret to logarithmic levels.
problem Static pricing mechanisms in DeFi lending protocols lead to suboptimal welfare and revenue.
method Online learning model for static and dynamic pricing models in DeFi lending.
result Adaptive supply models achieve logarithmic regret, outperforming static models.
Modeling incentives for content creators on algorithm-curated platforms.
problem Maximizing exposure for content creators on algorithmic platforms.
method Formalized exposure game model, proving effects of algorithmic choices on equilibria, proposing tools for finding equilibria.
result Algorithmic choices significantly affect content exposure and creator behavior.
For an unknown (new) classification dataset, choosing an appropriate deep learning architecture is often a recursive, time-taking, and laborious process. In this research, we propose a novel technique to recommend a suitable architecture from a repository of known models. Further, we predict the performance accuracy of…
Unsupervised method detects earthquakes from raw waveforms, generalizing across datasets.
problem Lack of labeled data for earthquake detection.
method Uses deep autoencoders with cross-covariance triggering at bottleneck.
result Performance comparable to supervised methods, with strong cross-dataset generalization.
ProductNet is a collection of high-quality product datasets for better product understanding. Motivated by ImageNet, ProductNet aims at supporting product representation learning by curating product datasets of high quality with properly chosen taxonomy. In this paper, the two goals of building high-quality product dat…
We report the first, to the best of our knowledge, hand-in-hand collaboration between human rights activists and machine learners, leveraging crowd-sourcing to study online abuse against women on Twitter. On a technical front, we carefully curate an unbiased yet low-variance dataset of labeled tweets, analyze it to acc…
FINCH dataset enables financial Text-to-SQL tasks, improving model evaluation.
problem Lack of a large-scale financial dataset for Text-to-SQL tasks.
method Curated financial dataset (FINCH), benchmarking reasoning and language models.
result Proposed FINCH Score for more accurate financial model evaluation.
FLAIR dataset for federated learning benchmarks.
problem Lack of suitable federated learning datasets.
method Curated large-scale annotated image dataset for multi-label classification.
result FLAIR captures real-world federated learning challenges.
Molecular machine learning has been maturing rapidly over the last few years. Improved methods and the presence of larger datasets have enabled machine learning algorithms to make increasingly accurate predictions about molecular properties. However, algorithmic progress has been limited due to the lack of a standard b…
Recent developments in Neural Relation Extraction (NRE) have made significant strides towards Automated Knowledge Base Construction (AKBC). While much attention has been dedicated towards improvements in accuracy, there have been no attempts in the literature to our knowledge to evaluate social biases in NRE systems. W…
Cross-lingual document alignment aims to identify pairs of documents in two distinct languages that are of comparable content or translations of each other. In this paper, we exploit the signals embedded in URLs to label web documents at scale with an average precision of 94.5% across different language pairs. We mine …