Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

134268401535 · Jun 202019922001200920182026
48 results for human-subject experiments

Examines parallels between human subjects and texts for causal inference.

problem Ambiguity and fallacies in causal inference using textual data.
method Two strategies: shifting from traits to perceptions and from concepts to parts.
result Highlights the importance of clarifying fundamental concepts.

Machine learning uses crowdworkers; determining their status as human subjects is tricky.

problem Determining the appropriate status of ML crowdworkers as human subjects.
method Investigation of natural language processing studies to expose challenges and propose solutions.
result Potential loophole in the U.S. Common Rule for ML research oversight.

Study improves understanding of what makes machine learning explanations human-interpretable.

problem Understanding what makes explanations human-interpretable in machine learning systems.
method Controlled human-subject experiments to identify regularizers for interpretability across three tasks.
result Cognitive chunks affect performance more than variable repetitions, suggesting common design principles.

We construct a financial "Turing test" to determine whether human subjects can differentiate between actual vs. randomized financial returns. The experiment consists of an online video-game (http://arora.ccs.neu.edu) where players are challenged to distinguish actual financial market returns from random temporal permut…

2010-02-24abs ↗pdf ↗

This article outlines a method for automatically generating models of dynamic decision-making that both have strong predictive power and are interpretable in human terms. This is useful for designing empirically grounded agent-based simulations and for gaining direct insight into observed dynamic processes. We use an e…

2016-03-26abs ↗pdf ↗

New decision support systems use prediction sets to help experts update their predictions, improving performance.

problem Challenges in explaining and updating predictions from decision support systems.
method Developed a methodology leveraging nested structure of prediction sets and counterfactual monotonicity to improve performance.
result Limiting experts' agency leads to better performance in decision support systems based on prediction sets.

There is a consensus that human and non-human subjects experience temporal distortions in many stages of their perceptual and decision-making systems. Similarly, intertemporal choice research has shown that decision-makers undervalue future outcomes relative to immediate ones. Here we combine techniques from informatio…

2016-04-18abs ↗pdf ↗

Unsupervised model predicts facial attractiveness with high accuracy.

problem Capturing the complexity of facial attractiveness through machine learning.
method Infer probabilistic models of facial preferences using Maximum Entropy and neural networks.
result High prediction accuracy in gender classification of sculpting subjects.

We often desire our models to be interpretable as well as accurate. Prior work on optimizing models for interpretability has relied on easy-to-quantify proxies for interpretability, such as sparsity or the number of operations required. In this work, we optimize for interpretability by directly including humans in the …

2018-05-29abs ↗pdf ↗

The study examines price formation in complex networks and finds efficiency varies by network structure.

problem Understanding price formation and efficiency in complex networks.
method Price formation experiments with human subjects in large networks, agent-based model construction.
result Prices are higher and trade less efficient in small-world networks compared to random networks.

How can we correlate neural activity in the human brain as it responds to words, with behavioral data expressed as answers to questions about these same words? In short, we want to find latent variables, that explain both the brain activity, as well as the behavioral responses. We show that this is an instance of the C…

2013-02-28abs ↗pdf ↗

Can an algorithm create original and compelling fashion designs to serve as an inspirational assistant? To help answer this question, we design and investigate different image generation models associated with different loss functions to boost creativity in fashion generation. The dimensions of our explorations include…

2018-04-03abs ↗pdf ↗

Subjective expected utility theory assumes that decision-makers possess unlimited computational resources to reason about their choices; however, virtually all decisions in everyday life are made under resource constraints - i.e. decision-makers are bounded in their rationality. Here we experimentally tested the predic…

2016-10-06abs ↗pdf ↗

While invasively recorded brain activity is known to provide detailed information on motor commands, it is an open question at what level of detail information about positions of body parts can be decoded from non-invasively acquired signals. In this work it is shown that index finger positions can be differentiated fr…

2015-12-14abs ↗pdf ↗

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of handcrafting, or acquiring costly labelled datasets to solve a statistical learning pr…

2016-04-15abs ↗pdf ↗

This paper provides lower bounds on the convergence rate of Derivative Free Optimization (DFO) with noisy function evaluations, exposing a fundamental and unavoidable gap between the performance of algorithms with access to gradients and those with access to only function evaluations. However, there are situations in w…

2012-09-11abs ↗pdf ↗

Conformal prediction sets improve human decision making by quantifying model uncertainty.

problem Humans signal uncertainty and offer alternatives when unsure, but machine learning models often lack this feature.
method Conducted a randomized controlled trial with human subjects given conformal prediction sets.
result Human accuracy improves when given conformal prediction sets compared to fixed-size prediction sets.

Clarifies the confidence interval approach for bioequivalence testing.

problem Ensuring the reliability of bioequivalence testing methods.
method Clarifies the conditions under which a 100(1-2α)% confidence interval yields a size-α test.
result A 100(1-2α)% confidence interval approach for bioequivalence testing yields a size-α test only when the two one-sided tests are 'equal-tailed'.

Program synthesis struggles with complex spatial relationships in image classification.

problem Challenges in solving Synthetic Visual Reasoning Test problems.
method Quantitative reanalysis of human and machine performance, improved program synthesis classifier, categorization of SVRT problems.
result Program synthesis is constrained by spatial relationships in images, not just shape specification.

Prices in financial markets exhibit extreme jumps far more often than can be accounted for by external news. Further, magnitudes of price changes are correlated over long times. These so called stylized facts are quantified by scaling laws similar to, for example, turbulent fluids. They are believed to reflect the comp…

2013-03-08abs ↗pdf ↗

Bardo Composer generates tabletop RPG music based on player speech.

problem Creating immersive background music for tabletop RPGs.
method Speech recognition, emotion classification, and music generation using a novel beam search algorithm.
result Generated music pieces can be accurately identified by human subjects as conveying the intended emotion.

Deep learning takes advantage of large datasets and computationally efficient training algorithms to outperform other approaches at various machine learning tasks. However, imperfections in the training phase of deep neural networks make them vulnerable to adversarial samples: inputs crafted by adversaries with the int…

2015-11-24abs ↗pdf ↗

GAN-based data augmentation can perpetuate biases in synthetic data.

problem Biases in synthetic data generated by GANs.
method Used a dataset of engineering researchers' head-shots to demonstrate how GANs can reinforce and amplify biases.
result GAN-based data augmentation can amplify biases in synthetic data.

New estimator improves statistical validity of synthetic data integration.

problem Combining synthetic data generated by large language models with real data for valid inference.
method Generalized method of moments estimator with theoretical guarantees.
result Improves estimates of target parameter through interactions between synthetic and real data.

Paper develops a method to generate discrete adversarial attacks on text classification models using submodular optimization.

problem Generating adversarial examples for discrete structures like text is challenging.
method Formulated adversarial attacks as an optimization task on submodular set functions, guided by gradient information.
result Achieved a 1-1/e approximation factor for attacks using the greedy algorithm.

This research converts visual information into audio for users to perceive.

problem Brevity in conveying visual information through spoken language.
method Pretrained image embedding network, GAN for metric space mapping, human subject testing.
result Users can accurately classify audio sonifications of faces.

Paper uses TDA for automated Parkinson's disease classification and severity assessment.

problem Manual diagnosis of neurological diseases is time-consuming and inaccurate.
method Combines Topological Data Analysis (TDA) with machine learning on postural shift data.
result Proposes a stable and accurate method for classifying Parkinson's disease.