Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

59119178237 · Jun 202019922001200920172026
48 results for crowd labeling

Max-MIG tackles crowdsourced label learning without knowing crowd information structure.

problem Learning from crowds without knowing the information structure among crowds.
method Max-MIG is an information theoretic approach that simultaneously aggregates crowdsourced labels and learns a data classifier.
result Max-MIG achieves state-of-the-art results in most settings, including real-world data.

Crowdsourcing has become very popular among the machine learning community as a way to obtain labels that allow a ground truth to be estimated for a given dataset. In most of the approaches that use crowdsourced labels, annotators are asked to provide, for each presented instance, a single class label. Such a request c…

2018-04-26abs ↗pdf ↗

Paper tackles representation learning from inconsistent crowdsourced labels.

problem Limited and inconsistent crowdsourced labels hinder representation learning.
method Proposes RLL framework to learn representation from limited crowdsourced labels.
result RLL outperforms state-of-the-art baselines in learning from limited labeled data.

Over the last few years, deep learning has revolutionized the field of machine learning by dramatically improving the state-of-the-art in various domains. However, as the size of supervised artificial neural networks grows, typically so does the need for larger labeled datasets. Recently, crowdsourcing has established …

2017-09-06abs ↗pdf ↗

Integrates multiple datasets to solve open set crowdsourcing problems.

problem Crowdsourcing with unknown label space and unfamiliar tasks.
method Integrates multiple crowdsourced datasets, weights them based on category correlation, and uses open set transfer learning.
result Proves OSCrowd solves open set crowdsourcing problems and outperforms related solutions.

Crowd opinions in microblogs can predict event outcomes, matching with expert opinions.

problem Utilizing crowd wisdom for event outcome prediction in microblogs.
method Multi-label sentiment classification of tweets to gauge crowd opinion and compare with expert predictions.
result Crowd opinions in microblogs often match with expert opinions, especially in non-debate events.

Due to concerns about human error in crowdsourcing, it is standard practice to collect labels for the same data point from multiple internet workers. We here show that the resulting budget can be used more effectively with a flexible worker assignment strategy that asks fewer workers to analyze easy-to-label data and m…

2019-01-11abs ↗pdf ↗

The unprecedented demand for large amount of data has catalyzed the trend of combining human insights with machine learning techniques, which facilitate the use of crowdsourcing to enlist label information both effectively and efficiently. The classic work on crowdsourcing mainly focuses on the label inference problem …

2018-06-23abs ↗pdf ↗

Paper tackles noisy annotations by considering workers' attention levels.

problem Noisy annotations from workers with varying expertise.
method Proposes a probabilistic model that incorporates workers' attention for accurate label quality estimation.
result Improves aggregated labels by quantifying the relationship between workers' attention and label quality.

Noisy labeled data is more a norm than a rarity for crowd sourced contents. It is effective to distill noise and infer correct labels through aggregation results from crowd workers. To ensure the time relevance and overcome slow responses of workers, online label aggregation is increasingly requested, calling for solut…

2018-07-19abs ↗pdf ↗

We introduce an unsupervised approach to efficiently discover the underlying features in a data set via crowdsourcing. Our queries ask crowd members to articulate a feature common to two out of three displayed examples. In addition we also ask the crowd to provide binary labels to the remaining examples based on the di…

2015-03-31abs ↗pdf ↗

Crowdsourcing has become a popular method for collecting labeled training data. However, in many practical scenarios traditional labeling can be difficult for crowdworkers (for example, if the data is high-dimensional or unintuitive, or the labels are continuous). In this work, we develop a novel model for crowdsourcin…

2017-12-13abs ↗pdf ↗

Adapts AUM to identify ambiguous tasks in crowdsourced learning, improving generalization.

problem Discerning ambiguous tasks in crowdsourced labels to prevent mislabeling.
method Introduces Weighted Areas Under the Margin (WAUM) to average AUMs weighted by task-specific scores.
result Improves generalization performance by discarding ambiguous tasks.

ProbE model improves relational implication detection to 0.8143.

problem Improving inference of relational data to extract more useful information.
method Formal probabilistic model of relational implication using estimators based on empirical distribution.
result ProbE model outperforms existing approaches, achieving 0.8143 AUC on evaluation dataset.

Machine-generated interpretations do not improve users' guessing accuracy in image classifiers.

problem Determining the usefulness of machine-generated explanations for deep neural networks.
method Human evaluation of crowd workers guessing incorrectly predicted labels with and without visual interpretations.
result Showing machine-generated visual interpretations decreased average guessing accuracy by about 10%.

Crowdsourcing utilizes the wisdom of crowds for collective classification via information (e.g., labels of an item) provided by labelers. Current crowdsourcing algorithms are mainly unsupervised methods that are unaware of the quality of crowdsourced data. In this paper, we propose a supervised collective classificatio…

2015-07-23abs ↗pdf ↗

Modular method predicts motion in crowded scenes using learned environment models.

problem Predicting motion in dynamic, crowded environments.
method Modular model of spatial and dynamic aspects, unsupervised adaptation to new tasks.
result Comparable performance to state-of-the-art, transferable across tasks.

MRCNet tackles crowd counting and density mapping in aerial imagery.

problem Accurate crowd counting and density estimation in aerial imagery.
method MRCNet is a novel encoder-decoder CNN that combines VGG-16 with FPN-inspired lateral connections.
result MRCNet outperforms state-of-the-art methods in aerial and CCTV-based crowd counting.

Bayesian algorithms improve crowdsourcing with label and instance constraints.

problem Efficiently labeling large datasets with additional human annotator information.
method Developed Bayesian algorithms for semi-supervised crowdsourced classification under label and instance constraints.
result Improved performance compared to unsupervised crowdsourcing on various datasets.

It is common for CCTV operators to overlook inter- esting events taking place within the crowd due to large number of people in the crowded scene (i.e. marathon, rally). Thus, there is a dire need to automate the detection of salient crowd regions acquiring immediate attention for a more effective and proactive surveil…

2014-10-14abs ↗pdf ↗

We found that factors decay over time, with momentum fitting best.

problem Understanding how factors decay over time and their impact on performance.
method Derived a hyperbolic decay model for factors, tested against linear and exponential alternatives.
result Momentum exhibits hyperbolic decay, outperforming linear and exponential models.

Wisdom of the crowd, the collective intelligence derived from responses of multiple human or machine individuals to the same questions, can be more accurate than each individual, and improve social decision-making and prediction accuracy. This can also integrate multiple programs or datasets, each as an individual, for…

2017-11-28abs ↗pdf ↗

Study shows how 'crowding' in equity trading affects performance and costs.

problem Deterioration of strategy performance, increased trading costs, and systemic risk due to equity factor crowding.
method Direct metrics of crowding based on imbalances of trades executed on the market, analyzing U.S. equity market data.
result Significant signs of crowding in well-known equity signals, especially Momentum, affecting order flow and portfolio rebalancing.

MTCNet uses MTL to estimate crowd density and count.

problem Crowd count estimation challenges due to scale variations and perspective.
method MTL deep neural network architecture with two tasks: density estimation and count classification.
result Achieves lower MAE than state-of-the-art methods on multiple datasets.

Machine learning outperforms crowd investors in predicting loan defaults and investment returns.

problem Determining if machine learning can outperform human decision-making in crowd lending.
method Using data from Prosper.com, a sophisticated ML algorithm was trained to predict loan defaults and investment returns.
result The ML algorithm outperforms crowd investors in predicting loan defaults and investment returns, especially for risky loans.

A model-free hedging method using stock crowding scores.

problem Designing costless portfolio strategies to hedge market risk.
method Network analysis of fund holdings to compute crowding scores, constructing long-short portfolios without numerical optimization.
result Long-short portfolios provide protection against both small and large market price fluctuations.

In this paper we address a classification problem where two sources of labels with different levels of fidelity are available. Our approach is to combine data from both sources by applying a co-kriging schema on latent functions, which allows the model to account item-dependent labeling discrepancy. We provide an exten…

2018-09-13abs ↗pdf ↗

Traffic flow prediction is crucial for urban traffic management and public safety. Its key challenges lie in how to adaptively integrate the various factors that affect the flow changes. In this paper, we propose a unified neural network module to address this problem, called Attentive Crowd Flow Machine~(ACFM), which …

2018-09-01abs ↗pdf ↗

Investment herding can reduce household consumption, a phenomenon called crowding-out effect.

problem Investment herding's impact on household consumption.
method Optimal control theory to model and solve for household investment and consumption decisions.
result Existence of crowding-out effect due to investment herding.

The average portfolio structure of institutional investors is shown to have properties which account for transaction costs in an optimal way. This implies that financial institutions unknowingly display collective rationality, or Wisdom of the Crowd. Individual deviations from the rational benchmark are ample, which il…

2017-03-06abs ↗pdf ↗

This paper evaluates a method to improve representations using incomplete external evidence across tasks.

problem Increasing labelled data quality and quantity is challenging due to manual labelling errors and noise.
method Evidence Transfer method using incomplete categorical external evidence.
result Evidence Transfer proves effective and robust against different levels of incompleteness.