Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4487131174 · May 202619922001200920172026
48 results for automated scoring

Study benchmarks automated sleep staging against human scorers, achieving human-level performance.

problem Lack of standardized comparison between human and automated sleep staging.
method Developed multi-scored datasets and a framework to compare multiple human scorers' consensus.
result Many automated methods can match human scorers' performance, with SimpleSleepNet achieving high F1 scores.

Unified scoring model improves efficiency and performance across multiple tasks.

problem Efficient and resource-efficient automated scoring for diverse tasks.
method Knowledge-distilled multi-task Mixture-of-Experts (MoE) approach.
result Comparable performance to task-specific models with significantly less storage and training resources.

Paper proposes efficient cost functions for automated market makers in DeFi.

problem Inefficient and computationally complex cost functions in DeFi.
method Proposes and analyzes constant circle/ellipse based cost functions.
result Proposed cost functions are computationally efficient and robust against attacks.

Automated scoring prioritizes risky driving behavior in telematic auto insurance policies.

problem Identifying risky driving behavior in telematic auto insurance policies using machine learning.
method Bayesian approach using MCMC to model propensity of policyholders to undertake trips resulting in positive classification.
result The approach improves efficiency of human resource allocation in identifying risky driving behavior.

System tackles indeterminacies in automated audio captioning.

problem Word selection and sentence length indeterminacies in automated audio captioning.
method Solves caption generation and sub-indeterminacy problems through multi-task learning to estimate keywords and sentence length.
result Model achieved 20.7 SPIDEr score, significantly outperforming baseline.

Automation engineering is the task of integrating, via software, various sensors, actuators, and controls for automating a real-world process. Today, automation engineering is supported by a suite of software tools including integrated development environments (IDE), hardware configurators, compilers, and runtimes. The…

2019-09-06abs ↗pdf ↗

CAI automates extraction and validation of corporate GHG emission metrics.

problem Manual extraction of corporate GHG emission metrics is labor-intensive and error-prone.
method CAI uses LLMs to automate extraction and validation of metrics from corporate disclosures.
result CAI improves data collection efficiency and accuracy by automating the process.

The paper automates policy learning for nonlinear welfare criteria using machine learning and debiasing techniques.

problem Learning optimal policies from observational data with nonlinear welfare criteria.
method Modeling a nonlinear welfare criterion with a utility function, estimating propensity scores with machine learning, and using sieve approximations and cross-validation for model selection.
result The proposed policy learning method satisfies oracle inequalities, providing theoretical guarantees on performance.

VLM judges rank well but score poorly; task difficulty and annotation quality affect interval width.

problem VLMs as judges lack reliability indicators in multimodal evaluations.
method Conformal prediction using score-token log-probabilities.
result Evaluation uncertainty is task-dependent, affecting interval width and reliability.

Improves reliability diagrams for probabilistic forecasts.

problem Lack of stability in reliability diagrams hampered their use.
method CORP approach using non-parametric isotonic regression and PAV algorithm.
result Improved reliability diagrams with statistical consistency and reproducibility.

Automates debiasing for large language model evaluations through Fisher random walk.

problem Rigorous and scalable evaluation of large language models.
method Semiparametric efficient estimator using Fisher random walk for weighted residual balancing.
result Efficient estimation of contextual preference scores for large language models.

Brain cancer can be very fatal, but chances of survival increase through early detection and treatment. Doctors use Magnetic Resonance Imaging (MRI) to detect and locate tumors in the brain, and very carefully analyze scans to segment brain tumors. Manual segmentation is time consuming and tiring for doctors, and it ca…

2018-10-27abs ↗pdf ↗

Operations is a key challenge in the domain of machine learning pipeline deployments involving monitoring and management of real-time prediction quality. Typically, metrics like accuracy, RMSE etc., are used to track the performance of models in deployment. However, these metrics cannot be calculated in production due …

2019-02-22abs ↗pdf ↗

Algorithm reduces audit costs by identifying best service configurations from biased textual evidence.

problem Designing service systems from textual evidence requires accurate selection despite biased automated scoring.
method Developed PP-LUCB algorithm combining LLM scores and selective audits to minimize costs.
result Correctly identified the best model in 40/40 trials with 90% cost reduction.

Accurate estimation of the positions and shapes of microscale objects is crucial for automated imaging-guided manipulation using a non-contact technique such as optical tweezers. Perception methods that use traditional computer vision algorithms tend to fail when the manipulation environments are crowded. In this paper…

2019-07-03abs ↗pdf ↗

In this paper, we present a new comparative study on automatic essay scoring (AES). The current state-of-the-art natural language processing (NLP) neural network architectures are used in this work to achieve above human-level accuracy on the publicly available Kaggle AES dataset. We compare two powerful language model…

2019-09-18abs ↗pdf ↗

Lung segmentation from abnormal CXRs using data imputation.

problem Segmenting lungs from CXRs with high opacity caused by respiratory ailments.
method Modified CNN-based segmentation network with deep generative model for data imputation.
result The model can segment lungs from abnormal CXRs, extending to cases with extreme abnormalities.

Patient summarization is essential for clinicians to provide coordinated care and practice effective communication. Automated summarization has the potential to save time, standardize notes, aid clinical decision making, and reduce medical errors. Here we provide an upper bound on extractive summarization of discharge …

2018-10-26abs ↗pdf ↗

To be effective, state of the art machine learning technology needs large amounts of annotated data. There are numerous compelling applications in healthcare that can benefit from high performance automated decision support systems provided by deep learning technology, but they lack the comprehensive data resources req…

2018-01-03abs ↗pdf ↗

Deep CNN-RNN model classifies breathing sounds for respiratory disease diagnosis.

problem Automated diagnosis of respiratory diseases using wearable devices.
method Patient-specific model tuning and local log quantization of weights.
result 71.81% accuracy on leave-one-out validation with patient-specific data.

This paper uses natural language processing to create the first machine-coded democracy index, which I call Automated Democracy Scores (ADS). The ADS are based on 42 million news articles from 6,043 different sources and cover all independent countries in the 1993-2012 period. Unlike the democracy indices we have today…

2015-02-22abs ↗pdf ↗

Deep object detection improves mitotic nucleus detection in breast cancer biopsies.

problem Challenges in automated mitotic nucleus detection in breast cancer histopathological images.
method Adapted Mask R-CNN for deep object detection, initially selects candidate regions with maximum recall, refines them with multi-object loss function.
result Improved discrimination ability (F-score of 0.86) and significant precision (0.86) for mitotic nuclei compared to two-stage models.

Study uses topic modeling and sentiment analysis to uncover hedge fund performance insights.

problem Hedge fund opacity and limited disclosure make them hard to analyze.
method Applied topic modeling and sentiment analysis to hedge fund documents using DistilBERT and Top2Vec.
result Automated topic modeling and sentiment analysis can predict hedge fund performance.

The paper proposes a machine learning framework for detecting DeFi fraud across multiple blockchain chains.

problem Early detection of financial crimes in decentralized finance (DeFi) ecosystems.
method Extracting features from different blockchain chains, employing XGBoost and Neural Network for fraud detection.
result Introduction of novel DeFi-related features significantly improves fraud detection accuracy.

Automated road infrastructure mapping using connected vehicle data and deep learning.

problem Manual identification of intersections is laborious and time-consuming.
method Geohashing, YOLOv5 algorithm for classification of road segments and intersections.
result Overall classification accuracy of 95%, with high F1 scores for straight roads and intersections.

Bird sounds possess distinctive spectral structure which may exhibit small shifts in spectrum depending on the bird species and environmental conditions. In this paper, we propose using convolutional recurrent neural networks on the task of automated bird audio detection in real-life environments. In the proposed metho…

2017-03-07abs ↗pdf ↗

ADReSS Challenge at INTERSPEECH 2020 benchmarks speech recognition for Alzheimer's dementia.

problem Automated recognition of Alzheimer's dementia from spontaneous speech.
method Provides a benchmark speech dataset, defines two tasks (classification and regression), and presents baseline models.
result Demonstrates the feasibility of automated speech recognition for Alzheimer's dementia.

Automated multi-task learning algorithm that optimizes network topology.

problem Over-sharing in multi-task learning leads to over-generalization and suboptimal performance.
method Tree-structured design space with gumbel-softmax sampling for differentiable network splitting.
result End-to-end trainable algorithm that optimizes network topology for multiple objectives across tasks.

Methods for automated discovery of causal relationships from non-interventional data have received much attention recently. A widely used and well understood model family is given by linear acyclic causal models (recursive structural equation models). For Gaussian data both constraint-based methods (Spirtes et al., 199…

2012-05-09abs ↗pdf ↗

AI tool automates blood segmentation from head CT scans after SAH.

problem Accurate volumetric assessment of SAH patients for clinical and prognostic implications.
method Transformer-based Swin UNETR architecture for noncontrast CT scans.
result High accuracy and robust performance across internal and external validation cohorts.