Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

124248372496 · Jun 202019922001200920172026
48 results for system validation

Adversarial validation detects concept drift in user targeting systems.

problem Concept drift in user targeting automation systems deteriorates model performance over time.
method Adversarial validation approach to detect and adapt to concept drift.
result Adversarial validation effectively addresses concept drift in user targeting systems.

The paper introduces sanity tests to detect spurious correlations in AI-guided radiology systems.

problem Detecting when AI systems perform well on development data for the wrong reasons.
method Design and implementation of sanity tests to identify spurious correlations.
result Sanity tests can identify spurious correlations in AI-guided radiology systems.

New findings show AI models can't be validated in complex social systems.

problem AI models in complex social systems can't be validated due to data collection practices.
method Formal impossibility results using the MovieLens benchmark.
result AI models in complex social systems are invalid under current data collection practices.

A new model validation framework for agentic AI systems based on POMDPs.

problem Model validation of agentic AI systems.
method A POMDP-based framework for belief-state, forecast, and policy validation.
result The framework decomposes autonomous decision making into information, beliefs, forecasts, actions, and utility.

This paper elaborates on the validation requirements for rating systems and probabilities of default (PDs) which were introduced with the New Capital Standards (Basel II). We start in Section 2 with some introductory remarks on the topics and approaches that will be discussed later on. Then we have a view on the develo…

2006-06-07abs ↗pdf ↗

In the modern era, abundant information is easily accessible from various sources, however only a few of these sources are reliable as they mostly contain unverified contents. We develop a system to validate the truthfulness of a given statement together with underlying evidence. The proposed system provides supporting…

2018-02-15abs ↗pdf ↗

This work improves safety validation of autonomous vehicles by finding interpretable failures.

problem Finding interpretable failures of autonomous systems in simulation.
method Signal temporal logic expressions optimized for high likelihood and human interpretability.
result Our methodology finds more interpretable failures with higher likelihood compared to baseline approaches.

Automatically identifies geometric flat outputs for robotic systems.

problem Lack of systematic and practical means to identify flat outputs for arbitrary robotic systems.
method Casts the search for a globally valid, equivariant flat output as an optimization problem using Riemannian geometry, Lie group theory, and differential forms.
result Approximate transcription of continuum formulation to a quadratic program achieves precise agreement with known closed-form flat outputs.

New framework ensures valid uncertainty estimates for any data stream changes.

problem Challenges of distribution shifts and adversarial actors in real-world data streams.
method Leveraging Blackwell approachability from game theory, the framework guarantees calibrated uncertainties for any compact space.
result Improves calibration and decision-making for energy systems.

We provide a rigorous numerical computation method to validate periodic, homoclinic and heteroclinic orbits as the continuation of singular limit orbits for the fast-slow system x=f(x,y,ε),y=εg(x,y,ε)x' = f(x,y,ε), y' = εg(x,y,ε) with one-dimensional slow variable yy. Our validation procedure is based on topological tools called isolatin…

2015-07-06abs ↗pdf ↗

Bayesian method synthesizes barrier certificates for unknown systems with latent states.

problem Certifying safety in systems with unknown dynamics and latent states.
method Bayesian inference with Metropolis-Hastings sampler and sum-of-squares program.
result Probabilistic validity of barrier certificates for unknown systems.

Cross-validation (CV) is a technique for evaluating the ability of statistical models/learning systems based on a given data set. Despite its wide applicability, the rather heavy computational cost can prevent its use as the system size grows. To resolve this difficulty in the case of Bayesian linear regression, we dev…

2016-10-25abs ↗pdf ↗

Develops a validated trading framework for market microstructure signals.

problem Overfitting and lookahead bias in algorithmic trading.
method Interpretable hypothesis-driven signal generation, reinforcement learning, strict out-of-sample testing.
result Modest annualized returns with strong downside protection and market-neutral characteristics.

Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In this paper we develop split-conformal and cross-conformal predictive systems tha…

2019-02-18abs ↗pdf ↗

Statistical physics of complex systems exploits network theory not only to model, but also to effectively extract information from many dynamical real-world systems. A pivotal case of study is given by financial systems: market prediction represents an unsolved scientific challenge yet with crucial implications for soc…

2017-10-30abs ↗pdf ↗

The paper extends IPC framework to stationary physical systems and validates it with a photonic system.

problem Characterizing the computational capabilities of stationary physical systems in a principled, data-efficient way.
method Extended IPC framework, established fundamental results, derived asymptotic bias, introduced data-efficient estimation methods.
result IPC strongly correlates with machine-learning performance and provides a reliable estimate of system dimensionality.

Common asset holding by financial institutions, namely portfolio overlap, is nowadays regarded as an important channel for financial contagion with the potential to trigger fire sales and thus severe losses at the systemic level. In this paper we propose a method to assess the statistical significance of the overlap be…

2016-03-18abs ↗pdf ↗

FunCLBM clusters time series data for autonomous driving validation.

problem Validation of autonomous driving systems using large amounts of data.
method FunCLBM model for co-clustering high-dimensional time series data.
result FunCLBM provides structured partition and clustering views of datasets.

RoyalFlush system improves multi-speaker ASR in M2MeT challenge.

problem Improving multi-speaker automatic speech recognition in noisy environments.
method Front-end processing with WPE and beamforming, data augmentation, and fusion of two ASR models.
result 12.22% absolute CER reduction on validation set and 12.11% on test set compared to baseline.

Modern online platforms rely on effective rating systems to learn about items. We consider the optimal design of rating systems that collect binary feedback after transactions. We make three contributions. First, we formalize the performance of a rating system as the speed with which it recovers the true underlying ran…

2018-06-18abs ↗pdf ↗

Extends method for solving certain hydrodynamic systems.

problem Solving non-diagonalisable integrable systems of hydrodynamic type.
method Generalised hodograph method applied to F-manifolds with compatible connections.
result Provides general solution under certain assumptions.

K-fold Cross Validation is commonly used to evaluate classifiers and tune their hyperparameters. However, it assumes that data points are Independent and Identically Distributed (i.i.d.) so that samples used in the training and test sets can be selected randomly and uniformly. In Human Activity Recognition datasets, we…

2019-04-04abs ↗pdf ↗