Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

127254381508 · Jun 202019922001200920172026
48 results for costly feature collection

Study optimizes data collection from biased, costly sources to minimize risk.

problem Estimating population means and group-conditional means from multiple sources with varying costs and biases.
method Develops a sampling plan that maximizes effective sample size, paired with a post-stratification estimator.
result Achieves budgeted minimax optimal risk for estimating population means and group-conditional means.

LLMs help less-resourced researchers access costly data.

problem Unequal access to costly datasets limits research contributions.
method RAG framework with GPT-4o-mini for automated data collection.
result LLMs can collect CEO pay ratios and CAMs from corporate disclosures with high accuracy and low cost.

In most real-world settings such as recommender systems, finance, and healthcare, collecting useful information is costly and requires an active choice on the part of the decision maker. The decision-maker needs to learn simultaneously what observations to make and what actions to take. This paper incorporates the info…

2016-02-11abs ↗pdf ↗

New methods prioritize acquiring confounding features for efficient treatment effect estimation.

problem Efficient treatment effect estimation from observational data with missing confounding information.
method Proposes two acquisition strategies: covariate balancing and reducing factual outcome error.
result Our proposed methods, especially reducing factual outcome error, improve sample efficiency for treatment effect estimation.

Previous work shows that adversarially robust generalization requires larger sample complexity, and the same dataset, e.g., CIFAR-10, which enables good standard accuracy may not suffice to train robust models. Since collecting new training data could be costly, we focus on better utilizing the given data by inducing t…

2019-05-25abs ↗pdf ↗

Simplifies decision-making during medical exams with cost-efficient feature acquisition.

problem Guiding physicians during examination acquisition for accurate and efficient diagnosis.
method Dropout at input layer and integrated gradients at test-time for dynamic feature importance.
result More cost- and feature-efficient than prior approaches, achieving higher overall accuracy.

SYNC generates synthetic data from aggregated sources using Gaussian copulas.

problem Creating synthetic datasets from aggregated sources.
method SYNC uses Gaussian copula models to infer high-resolution data from low-resolution sources.
result SYNC successfully merges sampled subsets into a single synthetic dataset.

Supervised randomization makes randomized experiments more cost-effective for uplift modeling.

problem Costly randomized experiments for uplift modeling.
method Integrates existing scoring models into randomized trials to target relevant customers while correcting for selection bias.
result Cost-efficient data collection under supervised randomization with competitive uplift model performance.

Meta-learning improves model performance by optimizing data acquisition.

problem Lack of operationally realistic data limits model performance.
method Gaussian process surrogate fit to metadata-driven training data variations.
result Meta-learning enhances model performance compared to random data acquisition.

Machine learning automates digitization of historical data.

problem Manual transcription is costly and difficult for large, detailed datasets.
method Apply machine learning techniques for unsupervised layout classification and attention-based neural networks.
result Machine learning can automate the digitization process for historical data.

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel approach that utilizes confidence scores, which describe the quality of demonstrat…

2019-01-27abs ↗pdf ↗

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A complementary label specifies a class that a pattern does not belong to. Collecting compl…

2017-05-22abs ↗pdf ↗

Graph Neural Networks improve machine learning on relational databases.

problem Training machine learning models on relational databases requires costly data extraction and feature engineering.
method Uses Graph Neural Networks to extract features from relational databases.
result Outperforms state-of-the-art automatic feature engineering methods.

This paper uses bandit theory and Thompson Sampling to optimize protein sequences.

problem Optimizing protein sequences using machine learning and directed evolution.
method Proposes a Thompson Sampling-guided Directed Evolution (TS-DE) framework.
result TS-DE achieves a nearly optimal Bayesian regret of order ildeO(d2MT) ilde O(d^{2}\sqrt{MT}).

New RL algorithm reduces deployment cost for linear function approximations.

problem Efficiently deploying new policies in RL with unknown rewards.
method Proposes an algorithm that minimizes trajectories needed for identifying optimal policies.
result Achieves optimal deployment complexity and sample complexity.

ComEx protocol reduces communication costs in cooperative bandits.

problem Minimizing communication costs in cooperative bandits while maintaining optimal performance.
method Developed ComEx protocol to reduce communication from Θ(T)Θ(T) to O(logT)O(\log T) messages.
result Achieves state-of-the-art performance with significantly reduced communication cost.

Clarinet uses complementary labels to train classifiers with less source data.

problem Training classifiers with true-label data from source domain is costly.
method Proposes CLARINET to train classifiers with complementary-label source data and unlabeled target data.
result CLARINET significantly outperforms baselines in unsupervised domain adaptation.

This paper considers the problem of removing costly features from a Bayesian network classifier. We want the classifier to be robust to these changes, and maintain its classification behavior. To this end, we propose a closeness metric between Bayesian classifiers, called the expected classification agreement (ECA). Ou…

2018-05-29abs ↗pdf ↗

This paper proposes a new VoI analysis framework for complex decision problems.

problem Optimizing resource allocation for information collection in decision-making under uncertainty.
method Surrogate-based framework for Value of Information analysis, integrating knowledge sharing and adaptive training.
result Accurate and robust estimates of VoI with fewer model evaluations compared to state-of-the-art methods.

Compressive Sensing (CS) theory asserts that sparse signal reconstruction is possible from a small number of linear measurements. Although CS enables low-cost linear sampling, it requires non-linear and costly reconstruction. Recent literature works show that compressive image classification is possible in CS domain wi…

2018-10-15abs ↗pdf ↗

Few-shot models detect tweets in emerging disasters efficiently.

problem Detecting relevant tweets in emerging disaster events is challenging.
method Few-shot models (matching networks and prototypical networks) are used to detect tweets in emerging disaster events.
result Few-shot models can generalize to unseen classes with a small amount of examples.

CUDC collects diverse data for offline RL by predicting future states.

problem Challenges in collecting task-agnostic data for offline RL.
method Adaptive temporal distances for curiosity-driven data collection.
result CUDC outperforms existing unsupervised methods in offline RL tasks.

We study the problem of structured prediction under test-time budget constraints. We propose a novel approach applicable to a wide range of structured prediction problems in computer vision and natural language processing. Our approach seeks to adaptively generate computationally costly features during test-time in ord…

2016-02-28abs ↗pdf ↗

We introduce a novel apprenticeship learning algorithm to learn an expert's underlying reward structure in off-policy model-free \emph{batch} settings. Unlike existing methods that require a dynamics model or additional data acquisition for on-policy evaluation, our algorithm requires only the batch data of observed ex…

2019-03-24abs ↗pdf ↗

Fair active learning selects data points to balance model accuracy and fairness.

problem Ensuring fairness in machine learning models used in high-stakes applications.
method Designing algorithms for fair active learning that select data points to balance model accuracy and fairness.
result Demonstrated the effectiveness and efficiency of fair active learning algorithms over benchmark datasets.

Fair active learning selects data points to balance model accuracy and fairness.

problem Ensuring fairness in machine learning models used in high-stakes applications.
method Designing algorithms for fair active learning that select data points to balance model accuracy and fairness, focusing on demographic parity.
result Demonstrated the effectiveness of the proposed fair active learning approach over benchmark datasets.

We study a classification problem where each feature can be acquired for a cost and the goal is to optimize a trade-off between the expected classification error and the feature cost. We revisit a former approach that has framed the problem as a sequential decision-making problem and solved it by Q-learning with a line…

2017-11-20abs ↗pdf ↗

New feature selection methods improve uplift modeling accuracy.

problem Overfitting and poor interpretability in feature selection for uplift models.
method Explicitly designed feature selection methods inspired by statistics and information theory.
result Proposed methods outperform traditional feature selection methods in uplift modeling.

Patent lawsuits are costly and time-consuming. An ability to forecast a patent litigation and time to litigation allows companies to better allocate budget and time in managing their patent portfolios. We develop predictive models for estimating the likelihood of litigation for patents and the expected time to litigati…

2016-03-23abs ↗pdf ↗

This paper proposes a multi-head attention model for predicting RUL in IIoT environments.

problem Estimating RUL for complex industrial equipment using IIoT data.
method Multi-Head Attention Mechanism combined with LSTM for multi-dimensional time-series data.
result The proposed model outperforms state-of-the-art models on benchmark datasets.

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of handcrafting, or acquiring costly labelled datasets to solve a statistical learning pr…

2016-04-15abs ↗pdf ↗

New framework selects key features for better query performance prediction.

problem Predict query performance without relevance judgments.
method Step-wise forward and backward feature selection approach.
result Model with selected features performs as well as complex models and better than non-selective models.

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's predictions is interpreted as its epistemic uncertainty. The appeal of ensembling…

2018-11-27abs ↗pdf ↗