Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4181122162 · May 202619922001200920172026
48 results for Heidke Skill Score

Paper uses polar field data to improve solar flare prediction accuracy.

problem Improving solar flare prediction accuracy using machine learning.
method Incorporates polar field data into machine learning models for solar flare classification.
result Improves solar flare prediction performance by up to 10.1% using a novel probabilistic mixture of experts model.

We present a novel algorithm that predicts the probability that the time derivative of the horizontal component of the ground magnetic field dB/dtdB/dt exceeds a specified threshold at a given location. This quantity provides important information that is physically relevant to Geomagnetically Induced Currents (GIC), whic…

2019-12-02abs ↗pdf ↗

CNNs improve wind speed forecasts in the Netherlands.

problem Limited spatial patterns in current post-processing methods.
method Convolutional Neural Networks (CNNs) for spatial wind speed information.
result CNNs produce better probabilistic forecasts with higher Brier skill scores.

Three methods detect informed trading on prediction markets, each focusing on different aspects.

problem Detecting informed trading in decentralized prediction markets.
method Composite screen, event-level sign-randomization test, and Information Leakage Score (ILS) framework.
result Different methods detect informed trading on prediction markets, each focusing on different aspects.

New metrics fail adversarial tests, with some more robust than others.

problem Evaluation metrics for time-series anomaly detection were improved but not fully robust.
method Adversarial stress-testing of 12 adopted metrics on real benchmarks.
result Some metrics are more robust than others, with ROC-based metrics being gamed more often.

MOVDA improves skill ratings by considering margin of victory deviations.

problem Traditional rating systems discard valuable performance data.
method Margin of Victory Differential Analysis (MOVDA) learns a non-linear function to predict expected MOV and uses the difference between true and expected MOV for rating updates.
result MOVDA significantly outperforms standard ELO and Bayesian baselines in NBA basketball data.

Study compares two methods for predicting extreme atmospheric events.

problem Forecasting threshold exceedances of atmospheric variables like temperature and wind speed.
method Direct vs. full distribution probabilistic methods for rare events.
result Full distribution approach outperforms direct method for extreme events.

Study compares different scoring rules for machine-learned weather forecasts, finding scale-awareness improves forecast realism.

problem Improving the accuracy of machine-learned probabilistic weather forecasts.
method Comparison of scoring rules (CRPS, fair global energy score, graph energy score) and analysis of their impact on forecast field spectra.
result Scale-awareness improves forecast realism, particularly in the tropics.

Paper develops a framework to optimize neural networks using weighted metrics.

problem Discrepancy between maximizing weighted classification scores and minimizing loss function.
method Formalizes weighted classification metrics and constructs corresponding losses.
result Framework includes well-established approaches like cost-sensitive learning and weighted cross entropy.

Employers actively look for talents having not only specific hard skills but also various soft skills. To analyze the soft skill demands on the job market, it is important to be able to detect soft skill phrases from job advertisements automatically. However, a naive matching of soft skill phrases can lead to false pos…

2018-07-20abs ↗pdf ↗

Deep learning model forecasts PV power production with high accuracy.

problem Accurate forecasting of photovoltaic power production is needed for electricity infrastructure.
method Sequence to sequence model with attention mechanism using weather predictions and historical data.
result The model outperforms existing methods in forecast skill score.

We introduce the Adaptive Skills, Adaptive Partitions (ASAP) framework that (1) learns skills (i.e., temporally extended actions or options) as well as (2) where to apply them. We believe that both (1) and (2) are necessary for a truly general skill learning framework, which is a key building block needed to scale up t…

2016-02-10abs ↗pdf ↗

The paper explains how language models acquire complex skills through scaling laws and statistical analysis.

problem Understanding how language models acquire new skills as their size and training data increase.
method Statistical framework and mathematical analysis of scaling laws.
result Language models can learn complex skills efficiently due to a strong inductive bias.

PredictaBoard benchmarks LLM score predictors to assess their ability to anticipate errors.

problem Inconsistent performance of LLMs in common sense reasoning tasks.
method Collaborative benchmarking framework evaluating pairs of LLMs and assessors using rejection rate at different tolerance errors.
result Highlights the need to evaluate predictability alongside performance for safer AI systems.

This paper combines and improves probabilistic forecasts of wind speeds using advanced statistical methods.

problem Improving accuracy and reliability of probabilistic forecasts in wind speed prediction.
method Adapting prediction with expert advice theory to probabilistic forecasts, combining raw or post-processed ensembles, and using CRPS and Jolliffe-Primo tests.
result Combining probabilistic forecasts can lead to more reliable and skillful predictions, as shown by the Jolliffe-Primo test.

Researchers study how skills are learned in neural networks using physics principles.

problem Understanding how skills are sequentially learned in neural networks.
method Abstract and simplify the problem using physics principles, proposing three models: Geometry, Resource, and Domino.
result Models reveal insights into neural scaling laws, learning dynamics, and the benefits of modularity.

A study shows that a fine-tuned model's directional accuracy in financial forecasting is largely due to chance, not skill.

problem Misleading directional accuracy in financial forecasting models.
method A reproducible, frozen-data benchmark with paired significance tests to separate skill from base-rate artifact.
result Fine-tuned models do not show significant directional skill over a base rate of 70% in financial forecasting.

The paper examines skill estimation and variance under model misspecification in IRT.

problem Underestimation and overestimation of skills when non-compensatory model is misspecified as compensatory.
method Theoretical approach to analyze underestimation and overestimation of skills and variance.
result Overestimation of skills occurs around the origin and asymptotic variance differs under model misspecification.

Acquiring new robot motor skills is cumbersome, as learning a skill from scratch and without prior knowledge requires the exploration of a large space of motor configurations. Accordingly, for learning a new task, time could be saved by restricting the parameter search space by initializing it with the solution of a si…

2019-08-11abs ↗pdf ↗

Quantifying behavior is crucial for many applications in neuroscience. Videography provides easy methods for the observation and recording of animal behavior in diverse settings, yet extracting particular aspects of a behavior for further analysis can be highly time consuming. In motor control studies, humans or other …

2018-04-09abs ↗pdf ↗

A planning approach learns skills from interactions, balancing exploration and exploitation.

problem Learning robust high-level skills in noisy environments with unknown pre-conditions.
method Formulates skills as high-level policies, learns plans via bandit problems, balances exploration and exploitation.
result A planner capable of learning robust high-level skills in high-dimensional state spaces.

Unified scoring model improves efficiency and performance across multiple tasks.

problem Efficient and resource-efficient automated scoring for diverse tasks.
method Knowledge-distilled multi-task Mixture-of-Experts (MoE) approach.
result Comparable performance to task-specific models with significantly less storage and training resources.

New algorithm trains neural nets on simple skills to learn complex tasks faster.

problem Learning complex tasks through simple imitation.
method Train neural networks on simple, easy-to-learn skills to accelerate learning of complex, hard-to-learn tasks.
result Consistently outperforms state-of-the-art baseline in training speed and performance.

Sloth predicts LLM performance using latent skills across families.

problem Variations in benchmark performance due to differences in training configurations and data processing across model families.
method Sloth uses publicly available benchmark data and assumes LLM performance is driven by latent skills influenced by model size and training tokens. It exploits correlations across benchmarks to provide accurate predictions.
result Sloth predicts LLM performance accurately and offers insights into scaling behaviors for complex tasks.

The paper presents a method for personalized exercise recommendations that improves learner skill gain.

problem Adapting to individual needs in large, diverse groups of learners in digital environments.
method Contextual Thompson Sampling to select exercises that advance learner skill.
result The method recommends exercises associated with greater skill improvement and adapts to learner differences.

Study shows Elo models fail to accurately measure transitive strength in competitive games.

problem Elo models fail to correctly identify the transitive component in real-world competitive games.
method Investigated the challenge of identifying the transitive component in games, proposed an extension of the Elo score.
result Disc ranking system assigns two scores: skill and consistency.

We introduce a method for constructing skills capable of solving tasks drawn from a distribution of parameterized reinforcement learning problems. The method draws example tasks from a distribution of interest and uses the corresponding learned policies to estimate the topology of the lower-dimensional piecewise-smooth…

2012-06-27abs ↗pdf ↗

Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a higher level that controls the skills in a new task. Leaving the skills fixed can le…

2019-06-13abs ↗pdf ↗

Foresight Arena benchmarks AI forecasting on real-world markets, isolating predictive edge.

problem Evaluating AI forecasting ability in real-world markets is challenging due to overfitting, centralized trust, and conflated metrics.
method Permissionless, on-chain benchmark using probabilistic forecasts, commit-reveal protocol, and smart contracts.
result Demonstrates the need for 350 predictions to reliably distinguish agents of different skill levels.

Enhances solar flare prediction with advanced preprocessing and contrastive learning.

problem Accurate prediction of solar flares to mitigate risks to astronauts and equipment.
method Advanced data preprocessing pipeline and contrastive learning with GRU regression model.
result Exceptional True Skill Statistic (TSS) scores, surpassing previous methods.