Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

96192287383 · Jun 202019922001200920172026
48 results for Holistic evaluation

Bayesian active learning improves holistic educational assessments.

problem Gap between holistic CJ and criterion-based rubrics in education.
method Extends Bayesian CJ to handle multiple LO components, using entropy-based active learning.
result Enhanced predictive rankings with uncertainty estimates and quantified assessor agreement.

Paper assesses holistic risks of inference attacks on ML models.

problem Lack of comprehensive risk assessment of inference attacks on ML models.
method Presented a threat model taxonomy for four inference attacks on five model architectures and four image datasets.
result Complexity of training dataset influences attack performance; model stealing and membership inference attacks are negatively correlated.

Framework audits synthetic datasets for trustworthiness across various use cases.

problem Assessing the trustworthiness of synthetic datasets and models.
method Holistic auditing framework focusing on bias, fidelity, utility, robustness, and privacy.
result Introduces a trustworthiness index and model selection process for controllable trade-offs.

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching source and target holistic feature distributions, without considering local feature…

2018-11-12abs ↗pdf ↗

New holistic approach measures sample-level adversarial vulnerability for trustworthy systems.

problem Inherent bias in adversarial attacks across subgroups.
method Combining high-frequency feature reliance and sample-distance to decision boundary.
result Holistic approach improves adversarial vulnerability estimation and system trustworthiness.

We propose a new scalable algorithm for holistic linear regression building on Bertsimas & King (2016). Specifically, we develop new theory to model significance and multicollinearity as lazy constraints rather than checking the conditions iteratively. The resulting algorithm scales with the number of samples nn in th…

2019-02-08abs ↗pdf ↗

The paper introduces ESE scores for farmers to assess climate change risks.

problem Assessing climate change risks in individual farmers' credit evaluations.
method Integrating ESG variables into joint liability models and using a mean-variance utility function.
result Optimal group sizes and individual-ESE score relationships under various climatic conditions.

This paper proposes a new approach to RL by focusing on the value-improvement path.

problem Value prediction problems in RL are sequence-dependent and require holistic approach.
method Characterize and approximate the value-improvement path holistically.
result A representation that spans the value-improvement path provides accurate value approximations for future policy improvements.

MARS-Gym framework for marketplaces to train and evaluate recommender systems.

problem Challenges in designing, training, and evaluating recommender systems in marketplaces.
method Open-source framework for Reinforcement Learning agents in marketplaces.
result Empowers researchers and engineers to quickly build and evaluate agents for recommendations.

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are dynamically controlled by learning disentangled latent representations with designated…

2017-03-02abs ↗pdf ↗

Paper proposes a holistic optimization for civil structures considering uncertainties.

problem Designing civil structures requires integration of material and structural design.
method Holistic optimization combining concrete mixture design and structural simulations.
result Inverted workflow allows consideration of new mixtures and uncertainties.

This paper presents the first use of graph neural networks (GNNs) for higher-order proof search and demonstrates that GNNs can improve upon state-of-the-art results in this domain. Interactive, higher-order theorem provers allow for the formalization of most mathematical theories and have been shown to pose a significa…

2019-05-24abs ↗pdf ↗

Paper tackles leverage effect estimation from noisy data.

problem Estimating leverage effect from high-frequency data with microstructure noise.
method Holistic multi-scale framework operating directly on leverage effect, using Subsampling-and-Averaging Leverage Effect (SALE) and Multi-Scale Leverage Effect (MSLE) estimators.
result Holistic multi-scale framework achieves substantial efficiency gains over existing benchmarks.

FinReflectKG - EvalBench benchmarks financial KG extraction from SEC 10-K filings.

problem Lack of universal benchmark and evaluation framework for financial KG construction.
method Agentic and holistic evaluation principles, deterministic commit-then-justify judging protocol, binary and ordinal evaluations.
result Reflection-based extraction outperforms single-pass extraction in comprehensiveness, precision, and relevance.

The current Deep Learning (DL) landscape is fast-paced and is rife with non-uniform models, hardware/software (HW/SW) stacks, but lacks a DL benchmarking platform to facilitate evaluation and comparison of DL innovations, be it models, frameworks, libraries, or hardware. Due to the lack of a benchmarking platform, the …

2019-11-19abs ↗pdf ↗

FinReflectKG builds a comprehensive financial knowledge graph from SEC filings, improving extraction quality.

problem Lack of large-scale, open-source financial knowledge graph datasets.
method Intelligent document parsing, table-aware chunking, schema-guided iterative extraction, reflection-driven feedback loop.
result Reflection-agent-based mode achieves best balance of efficiency, accuracy, and reliability.

This study optimizes quantized neural networks by considering model architecture and quantization types.

problem Optimizing quantized neural networks for low-power, high-throughput applications.
method Holistic approach including training methods and quantization-friendly architecture design.
result Deeper models are more sensitive to activation quantization, while wider models improve resilience to both weight and activation quantization.

New approach to fairness in machine learning models using conformal prediction.

problem Fairness in machine learning models' downstream decision-making.
method Theoretical derivation and empirical evaluation of label-clustered conformal prediction.
result Label-clustered conformal prediction often provides a favorable balance between utility and substantive fairness.

Translating renderings (e. g. PDFs, scans) into hierarchical document structures is extensively demanded in the daily routines of many real-world applications. However, a holistic, principled approach to inferring the complete hierarchical structure of documents is missing. As a remedy, we developed "DocParser": an end…

2019-11-05abs ↗pdf ↗

Designs a robust data-driven decision-making model to handle multiple overfitting sources.

problem Overfitting in data-driven models due to statistical error, data noise, and data misspecification.
method Holistic distributionally robust optimization formulation combining Kullback-Leibler and Lévy-Prokhorov approaches.
result Guaranteed holistic protection against statistical error, data noise, and data misspecification.

The paper proposes a method to calibrate healthcare AI models for reliability and interpretability.

problem Characterizing model reliability and enabling introspection of model behavior in clinical decision making.
method A calibration-driven learning method combined with interpretability techniques based on counterfactual reasoning.
result Demonstrates the effectiveness of the proposed approach using a lesion classification problem with dermoscopy images.

We give a short, simple and conceptual proof, based on spin structures, of sphere eversion: an embedded 2-sphere in R3R^3 can be turned inside out by regular homotopy. Ingredients of this eversion are seamlessly connected. We also give the mathematical origins of the proof: the Hopf fibration, and the topological struc…

2010-08-05abs ↗pdf ↗

Proposes a method for ranking items across multiple aspects based on user feedback.

problem No principled solution exists for generating multiple item rankings over different aspects.
method Developed a directional multi-aspect ranking criterion using probabilistic multivariate tensor factorization.
result Demonstrated effectiveness of the proposed method through comprehensive experiments on real datasets.

New method adapts to user preferences dynamically, improving recommendation models.

problem Current recommendation models lack dynamic adaptation to changing user preferences.
method Preference Discerning with LLM-Enhanced Generative Retrieval
result Mender achieves state-of-the-art performance in adapting to evolving user preferences.

Recent advances in visual tracking are based on siamese feature extractors and template matching. For this category of trackers, latest research focuses on better feature embeddings and similarity measures. In this work, we focus on building holistic object representations for tracking. We propose a framework that is d…

2019-07-21abs ↗pdf ↗

Proposes training neural networks to predict uncertainty for out-of-distribution inputs.

problem Poor uncertainty predictions for out-of-distribution inputs limit model robustness.
method Generates pseudo-inputs in low-density regions and trains a Bayesian framework.
result Yields robust and interpretable uncertainty predictions.

A model integrates CNN and LSTM with LLM for better stock forecasting.

problem Complex stock market prediction with volatile patterns and multifaceted data.
method Two-Level Conv-LSTM Neural Network with LLM for holistic stock advising.
result Improved prediction accuracy and contextual insights.

This work shifts focus from prediction to intervention in social systems.

problem The limitations of focusing solely on prediction in automated decision systems.
method Shift from prediction-focused paradigm to intervention-oriented approach.
result A new perspective unifies statistical frameworks and tools for ADS design, implementation, and evaluation.

PaRCE estimates model confidence for CNNs across various uncertainties.

problem Limited holistic approach to estimating perception model confidence in CNNs.
method Probabilistic and reconstruction-based competency estimation.
result PaRCE best distinguishes between various types of samples and regions.

FinMaster benchmarks LLMs in financial tasks, revealing gaps in reasoning.

problem Challenges in financial tasks, including labor-intensive processes and low error tolerance.
method Developed a comprehensive financial benchmark (FinMaster) with three modules: FinSim, FinSuite, and FinEval.
result LLMs struggle with complex financial reasoning, showing significant accuracy drops.

We take the holistic approach of computing an OTC claim value that incorporates credit and funding liquidity risks and their interplays, instead of forcing individual price adjustments: CVA, DVA, FVA, KVA. The resulting nonlinear mathematical problem features semilinear PDEs and FBSDEs. We show that for the benchmark v…

2016-02-18abs ↗pdf ↗