Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3876114152 · Oct 201919922001200920172026
48 results for human subjects

Paper introduces ρρ-Perfect to estimate model-human correlation in subjective datasets.

problem Inherent noise in subjective ratings limits model-human correlation quantification.
method Defines ρρ-Perfect as highest achievable correlation between perfect predictor and human ratings. Estimates based on heteroscedastic noise scenarios.
result Demonstrates ρρ-Perfect can distinguish model limitations from data quality issues.

Examines parallels between human subjects and texts for causal inference.

problem Ambiguity and fallacies in causal inference using textual data.
method Two strategies: shifting from traits to perceptions and from concepts to parts.
result Highlights the importance of clarifying fundamental concepts.

Machine learning uses crowdworkers; determining their status as human subjects is tricky.

problem Determining the appropriate status of ML crowdworkers as human subjects.
method Investigation of natural language processing studies to expose challenges and propose solutions.
result Potential loophole in the U.S. Common Rule for ML research oversight.

Subjective expected utility theory assumes that decision-makers possess unlimited computational resources to reason about their choices; however, virtually all decisions in everyday life are made under resource constraints - i.e. decision-makers are bounded in their rationality. Here we experimentally tested the predic…

2016-10-06abs ↗pdf ↗

K-fold Cross Validation is commonly used to evaluate classifiers and tune their hyperparameters. However, it assumes that data points are Independent and Identically Distributed (i.i.d.) so that samples used in the training and test sets can be selected randomly and uniformly. In Human Activity Recognition datasets, we…

2019-04-04abs ↗pdf ↗

Digital personas improve survey results for stable attributes but fail for subjective responses.

problem When can digital personas reliably approximate human survey findings?
method Using LISS panel, constructed personas from background variables and survey histories, tested against held-out post-cutoff answers.
result Digital personas improve alignment with human response distributions for stable attributes but fail for subjective responses.

Embodied cognition states that semantics is encoded in the brain as firing patterns of neural circuits, which are learned according to the statistical structure of human multimodal experience. However, each human brain is idiosyncratically biased, according to its subjective experience history, making this biological s…

2019-06-20abs ↗pdf ↗

Bayesian framework evaluates predictors of subjective visual tasks.

problem Evaluating uncertainty in machine learning predictors for tasks with subjective annotations.
method Bayesian framework to estimate epistemic uncertainty from human labels.
result Framework successfully applied to four image classification tasks.

We construct a financial "Turing test" to determine whether human subjects can differentiate between actual vs. randomized financial returns. The experiment consists of an online video-game (http://arora.ccs.neu.edu) where players are challenged to distinguish actual financial market returns from random temporal permut…

2010-02-24abs ↗pdf ↗

A significant challenge for a supervised learning approach to inertial human activity recognition is the heterogeneity of data between individual users, resulting in very poor performance of impersonal algorithms for some subjects. We present an approach to personalized activity recognition based on deep embeddings der…

2020-01-15abs ↗pdf ↗

Conformal prediction sets improve human decision making by quantifying model uncertainty.

problem Humans signal uncertainty and offer alternatives when unsure, but machine learning models often lack this feature.
method Conducted a randomized controlled trial with human subjects given conformal prediction sets.
result Human accuracy improves when given conformal prediction sets compared to fixed-size prediction sets.

AI enhances financial services but humans are irreplaceable for empathy, presence, and ethics.

problem AI's limitations in financial services, especially with small datasets and human judgment.
method EPOCH framework highlighting five irreplaceable human capabilities: Empathy, Presence, Opinion, Creativity, and Hope.
result Humans are essential for trust, innovation, and consumer experience in financial services.

AI benchmarks evaluate football team performance using generative models.

problem Evaluating human performance in complex interactive tasks is error-prone and unreliable.
method Trained Conditional VRNN Model on player and ball tracking data to imitate and predict team interactions.
result Trained model as a useful benchmark for evaluating team performance in football.

Deep learning model classifies concurrent human interactions from WiFi data with high accuracy.

problem Classifying concurrent human interactions from WiFi data with high accuracy.
method Attention-BiGRU deep learning model using Multiple Input Multiple Output radio link.
result Maximum benchmark accuracy of 94% for a single subject-pair, 88% for ten subject pairs.

We often desire our models to be interpretable as well as accurate. Prior work on optimizing models for interpretability has relied on easy-to-quantify proxies for interpretability, such as sparsity or the number of operations required. In this work, we optimize for interpretability by directly including humans in the …

2018-05-29abs ↗pdf ↗

The construction of artificial general intelligence (AGI) was a long-term goal of AI research aiming to deal with the complex data in the real world and make reasonable judgments in various cases like a human. However, the current AI creations, referred to as "Narrow AI", are limited to a specific problem. The constrai…

2019-09-09abs ↗pdf ↗

Multi-subject fMRI data analysis is an interesting and challenging problem in human brain decoding studies. The inherent anatomical and functional variability across subjects make it necessary to do both anatomical and functional alignment before classification analysis. Besides, when it comes to big data, time complex…

2018-07-07abs ↗pdf ↗

The tremendous success of deep learning for imaging applications has resulted in numerous beneficial advances. Unfortunately, this success has also been a catalyst for malicious uses such as photo-realistic face swapping of parties without consent. Transferring one person's face from a source image to a target image of…

2019-09-10abs ↗pdf ↗

New decision support systems use prediction sets to help experts update their predictions, improving performance.

problem Challenges in explaining and updating predictions from decision support systems.
method Developed a methodology leveraging nested structure of prediction sets and counterfactual monotonicity to improve performance.
result Limiting experts' agency leads to better performance in decision support systems based on prediction sets.

Finding the most effective way to aggregate multi-subject fMRI data is a long-standing and challenging problem. It is of increasing interest in contemporary fMRI studies of human cognition due to the scarcity of data per subject and the variability of brain anatomy and functional response across subjects. Recent work o…

2016-08-17abs ↗pdf ↗

Proposes a probabilistic method for generating semantically-aware adversarial examples.

problem Generating adversarial examples that are difficult for humans to detect while preserving semantics.
method Embeds subjective understanding of semantics as a distribution into adversarial example generation.
result Achieves higher success rates in circumventing adversarial defense mechanisms.

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains poorly understood. This work advances our understanding of what makes explanations …

2019-01-31abs ↗pdf ↗

A novel validation method improves feature importance analysis in subject-specific ML models.

problem Limited effectiveness of general ML models trained on large datasets for individual patient outcomes.
method A novel validation approach using a general ML model with repeated trials and random seed variation.
result Consistent identification of key features at the subject level and improved group-level feature importance analysis.

Study subjective perception of low light restored images and develop an unsupervised QA model.

problem Lack of subjective QA for low light restored images and challenges in collecting human opinion scores.
method Create a dataset, conduct subjective QA study, develop self-supervised contrastive learning technique to extract features.
result Unsupervised NR QA model achieves state-of-the-art performance for low light restored images.

Human-machine interaction is increasingly dependent on speech communication. Machine Learning models are usually applied to interpret human speech commands. However, these models can be fooled by adversarial examples, which are inputs intentionally perturbed to produce a wrong prediction without being noticed. While mu…

2020-01-23abs ↗pdf ↗

One typical assumption in inverse reinforcement learning (IRL) is that human experts act to optimize the expected utility of a stochastic cost with a fixed distribution. This assumption deviates from actual human behaviors under ambiguity. Risk-sensitive inverse reinforcement learning (RS-IRL) bridges such gap by assum…

2019-09-14abs ↗pdf ↗