Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

5.8%11.5%17.3%23.0% · Jan 202019922001200920172026
48 results for human vs. machine

Study benchmarks automated sleep staging against human scorers, achieving human-level performance.

problem Lack of standardized comparison between human and automated sleep staging.
method Developed multi-scored datasets and a framework to compare multiple human scorers' consensus.
result Many automated methods can match human scorers' performance, with SimpleSleepNet achieving high F1 scores.

The step of expert taxa recognition currently slows down the response time of many bioassessments. Shifting to quicker and cheaper state-of-the-art machine learning approaches is still met with expert scepticism towards the ability and logic of machines. In our study, we investigate both the differences in accuracy and…

2017-08-23abs ↗pdf ↗

Visual Human Activity Recognition (HAR) and data fusion with other sensors can help us at tracking the behavior and activity of underground miners with little obstruction. Existing models, such as Single Shot Detector (SSD), trained on the Common Objects in Context (COCO) dataset is used in this paper to detect the cur…

2019-05-02abs ↗pdf ↗

Machine Learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption by the level of trust that models afford users. Human vs. machine performance is commonly compared empirically to decide whether a certain task should be per…

2019-03-22abs ↗pdf ↗

When machine predictors can achieve higher performance than the human decision-makers they support, improving the performance of human decision-makers is often conflated with improving machine accuracy. Here we propose a framework to directly support human decision-making, in which the role of machines is to reframe pr…

2019-05-29abs ↗pdf ↗

Many supervised learning tasks are emerged in dual forms, e.g., English-to-French translation vs. French-to-English translation, speech recognition vs. text to speech, and image classification vs. image generation. Two dual tasks have intrinsic connections with each other due to the probabilistic correlation between th…

2017-07-03abs ↗pdf ↗

Autonomous systems can substantially enhance a human's efficiency and effectiveness in complex environments. Machines, however, are often unable to observe the preferences of the humans that they serve. Despite the fact that the human's and machine's objectives are aligned, asymmetric information, along with heterogene…

2017-05-26abs ↗pdf ↗

Graphs model human mobility patterns, reducing errors in data matching.

problem Lack of high-quality data and computational resources for graph-based mobility analysis.
method Embedding graphs into a continuous space to address matching, modeling, and visualization challenges.
result Approx 40% decrease in error on average in matched graphs vs unmatched ones.

We construct a financial "Turing test" to determine whether human subjects can differentiate between actual vs. randomized financial returns. The experiment consists of an online video-game (http://arora.ccs.neu.edu) where players are challenged to distinguish actual financial market returns from random temporal permut…

2010-02-24abs ↗pdf ↗

Extends PCVM for multi-class classification with improved accuracy.

problem Lack of probabilistic outputs and contradictory predictions in multi-class classification.
method Proposes mPCVM with two learning algorithms: top-down and bottom-up.
result Superior performance, especially with many classes, validated on synthetic and benchmark data.

This work aims to reduce inexplicable errors in deep neural networks by obtaining class-level semantics and penalizing misclassifications.

problem Deep neural networks misclassify images, leading to inexplicable errors that can harm trust and societal impact.
method Obtain class-level semantics, propose Weighted Loss Functions (WLFs), and train classifiers with these methods.
result Trained networks have more explicable failure modes and comparable accuracy to existing methods.

The paper introduces a new framework for making machine learning explanations more understandable to humans.

problem Making machine learning explanations comprehensible and aligned with human preferences.
method Inspired by philosophy, cognitive science, and social sciences, the paper formalizes a framework using the concept of 'weight of evidence' from information theory.
result The framework produces intuitive and comprehensible explanations that align with human preferences.

CPR models complex decision processes by breaking them into context-specific policies, improving interpretability and accuracy.

problem Interpreting dynamic human decision-making processes in medical contexts.
method Develops Contextualized Policy Recovery (CPR) framework for multi-task learning, modeling each context-specific policy as a linear map.
result Achieves state-of-the-art performance in predicting medical decisions, closing the gap between interpretable and black-box methods.

XGL uses global explanations to guide human supervision in machine learning.

problem Improving model quality through human-machine interaction.
method XGL employs global explanations to guide human selection of informative examples.
result XGL avoids overselling the model's quality and performs comparably to other strategies.

Have you ever looked at a machine learning classification model and thought, I could have made that? Well, that is what we test in this project, comparing XGBoost trained on human engineered features to training directly on data. The human engineered features do not outperform XGBoost trained di- rectly on the data, bu…

2016-09-04abs ↗pdf ↗

Conformal prediction sets improve human decision making by quantifying model uncertainty.

problem Humans signal uncertainty and offer alternatives when unsure, but machine learning models often lack this feature.
method Conducted a randomized controlled trial with human subjects given conformal prediction sets.
result Human accuracy improves when given conformal prediction sets compared to fixed-size prediction sets.

Paper examines how adversarial ML attacks and defenses impact civil liberties and human rights.

problem Impact of adversarial machine learning on civil liberties and human rights.
method Uses insights from STS, anthropology, and human rights literature.
result Adversarial defenses can be used to suppress dissent and limit investigation of ML systems.

RS-NN predicts belief functions for classification, improving accuracy and uncertainty estimation.

problem Improving confidence in machine learning predictions for safety-critical applications.
method Random-Set Neural Network (RS-NN) using random set mathematics.
result RS-NN outperforms state-of-the-art methods in accuracy, uncertainty estimation, and OoD detection.

New research shows machine-assisted decisions can still be unfair even when the algorithm is fair.

problem Ensuring fairness in decisions made with machine-assisted human input.
method Formal model and lab experiment to analyze how machine predictions affect human decisions.
result Excluding information about protected groups from machine predictions can increase disparities.

High-dimensional neural network manifolds misalign with human perception, causing adversarial examples.

problem Adversarial attacks fool neural networks, but their origin is unclear.
method Defined and analyzed a network's perceptual manifold (PM) for a class concept.
result Neural network PMs have orders of magnitude higher dimensions than natural human concepts, suggesting exponential misalignment.

Machine learning models are increasingly used to automate decisions that affect humans - deciding who should receive a loan, a job interview, or a social service. In such applications, a person should have the ability to change the decision of a model. When a person is denied a loan by a credit score, for example, they…

2018-09-18abs ↗pdf ↗

Study human-machine interaction with private info using offline RL.

problem Confounding bias and distributional mismatch in offline RL for human-guided interaction.
method Developed a novel identification result and OPE method to address confounding bias, and used pessimism to tackle distributional mismatch.
result Policy pair converges to optimal one at satisfactory rate under mild assumptions.

Study shows Elo models fail to accurately measure transitive strength in competitive games.

problem Elo models fail to correctly identify the transitive component in real-world competitive games.
method Investigated the challenge of identifying the transitive component in games, proposed an extension of the Elo score.
result Disc ranking system assigns two scores: skill and consistency.

MCAL reduces labeling costs by 6x for auto-labeling data sets.

problem Expensive human annotation for ground-truth data sets.
method Iterative approach that trains a classifier to auto-label part of the data set, determining which samples to label using humans and which to label using the classifier at each step.
result 6x lower overall cost compared to human labeling the entire data set, always cheaper than competing strategies.

A model for human-machine decision-making with private info and opacity.

problem Optimizing decisions in a human-machine system with private info and opacity.
method Formulated as a two-player learning problem, proved lower and upper bounds on optimality.
result Simple coordination strategy is nearly minimax optimal, efficient learning possible under certain assumptions.

AutoML frameworks outperform human data scientists on 7 out of 12 OpenML tasks.

problem Evaluating if AutoML can outperform human data scientists.
method Comparison of four AutoML frameworks on 12 popular OpenML datasets (6 supervised classification, 6 supervised regression).
result AutoML frameworks perform better or equal to human data scientists in 7 out of 12 tasks.

The paper proposes a new framework to generate synthetic data with human-like imperfections to prevent model collapse.

problem Model collapse due to statistical optimization of synthetic data.
method Introduces Prompt-driven Cognitive Computing Framework (PMCSF) with Cognitive State Decoder (CSD) and Cognitive Text Encoder (CTE).
result The framework generates text with cognitive imperfections, reducing maximum drawdown and delivering defensive alpha.