New CV method reduces bias in spatial prediction models.
problem Bias in standard cross-validation due to uneven sampling.
method Target-Weighted Cross-Validation (TWCV) framework.
result Weighted CV approaches reduce bias in prediction error.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “deployment bias”
Financial LLMs need explicit bias consideration to avoid invalid results.
problem Finance-specific biases inflate performance and contaminate backtests.
method Identified five recurring biases and proposed a Structural Validity Framework.
result Explicit bias consideration is necessary for valid deployment claims.
Edge language models show bias over time, especially on resource-constrained devices.
problem Bias in edge language models on resource-constrained devices.
method Comparative analysis of text-based bias across edge, cloud, and desktop environments; optimized Llama-2 model on Raspberry Pi 4; feedback loop mechanism to correct bias.
result Llama-2 on Raspberry Pi 4 shows 43.23% and 21.89% more bias over time compared to cloud and desktop models.
Low-precision representation of deep neural networks (DNNs) is critical for efficient deployment of deep learning application on embedded platforms, however, converting the network to low precision degrades its performance. Crucially, networks that are designed for embedded applications usually suffer from increased de…
This research secures deployed sentiment analysis models by identifying and defending against attack vectors.
problem Securing deployed machine learning models, particularly sentiment analysis systems, from adversarial attacks.
method BAD (Build, Attack, Defend) Architecture, evaluating two implementations.
result Demonstrated a viable methodology for securing machine learning models in production.
Unified framework for intersectionally fair AI models using MIO.
problem Bias in AI models for high-risk domains.
method Mixed-Integer Optimization (MIO) for fairness and interpretability.
result Improved performance in detecting and mitigating bias at intersections.
The paper introduces Relative Bias to quantify LLM bias systematically.
problem Quantifying bias in LLMs is challenging due to ambiguity and rapid model emergence.
method Relative Bias framework using Embedding Transformation and LLM-as-a-Judge methodologies.
result The two scoring methods show strong alignment, providing a systematic approach.
New method to evaluate visual explanations from neural networks.
problem Lack of consensus on measuring effectiveness of visual explanations.
method Proposed a new procedure for evaluating explanations using a range of sources.
result Demonstrated the benefit of combining different sources and the impact of bias parameters.
New active learning method uses combinatorial coverage to improve data transfer and reduce bias.
problem Inability to transfer sampled data to new models and sampling bias issues.
method Data-centric active learning methods utilizing combinatorial coverage.
result Sampling data with coverage leads to better data transfer and competitive sampling bias.
Study detects and explains positional bias in financial LLMs.
problem Positional bias in financial decision-making using LLMs.
method Unified framework and benchmark for detecting and quantifying bias in Qwen2.5 models.
result Positional bias is pervasive, scale-sensitive, and resurfaces under nuanced prompt designs.
Picket guards against corrupted data in machine learning models.
problem Data corruption biases models and invalidates predictions.
method PicketNet detects corrupted data using self-supervised deep learning; flags corrupted queries online.
result Picket consistently protects models from corrupted data during training and deployment.
Beyond the Training Distribution: Evaluating Predictions Under Distribution Shift and Selection Biasstat.ML
Evaluating prediction models under covariate shift and selective labels
problem Model performance evaluation under distribution shift and selection bias
method Double machine learning
result Accurate estimation of target risk
Paper discusses challenges in deploying ML models for structural engineering.
problem Challenges in deploying machine learning models for structural engineering applications.
method Illustrates challenges through two examples, focusing on model overfitting, underspecification, training data representativeness, variable omission bias, and cross-validation.
result Highlights the importance of rigorous model validation techniques.
The paper tackles fairness and accuracy in ML models under domain shifts.
problem Designing fair and accurate ML models that perform well in unseen domains.
method Theoretical bounds and sufficient conditions for fairness and accuracy transfer under domain generalization.
result A learning algorithm that ensures fair and accurate models even when deployment environments change.
Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are minorities within the training set and ultimately present higher risks to them. We pr…
New method predicts model performance under selection bias in healthcare.
problem Selection bias limits model generalizability in healthcare.
method Proposes a novel upper bound method for estimating model performance.
result Validates and demonstrates the practical utility of the method.
Method learns representation invariant to subgroup support using adversarial matching.
problem Representational bias in training data leads to spurious correlations.
method Adversarial support-matching using semi-supervised clustering.
result Improves generalizability to unseen sources.
Look-Ahead-Bench: a Standardized Benchmark of Look-ahead Bias in Point-in-Time LLMs for Financecs.AI
Look-Ahead-Bench evaluates financial LLMs for lookahead bias, revealing significant differences in model performance.
problem Measuring and mitigating lookahead bias in financial LLMs.
method Standardized benchmark evaluating model behavior in practical financial scenarios, analyzing performance decay across market regimes.
result Standard LLMs exhibit significant lookahead bias, while Pitinf models show improved generalization and reasoning abilities.
Uncovering Representation Bias for Investment Decisions in Open-Source Large Language Modelsq-fin.CP
This study examines representation bias in open-source Qwen models for investment decisions.
problem Representation bias in financial applications of large language models.
method Balanced round-robin prompting over 150 U.S. equities, constrained decoding, token-logit aggregation.
result Firm size and valuation increase model confidence, while risk factors decrease it.
Model predicts political ideology using context vectors to mitigate bias and scarcity.
problem Scarcity and selection bias in political ideology prediction.
method Proposes a statistical model decomposing embeddings into context and position vectors, training an end-to-end model for deployment.
result Model can predict ideological labels even with minimal biased data, outperforming state-of-the-art methods.
This thesis tackles bias in AI decision-making in banking.
problem Bias in AI-driven banking decisions.
method Understanding, mitigating, and accounting for bias in AI systems.
result Establishment of Responsible AI practices for fair decision-making.
Decomposes bias in linear models under demographic parity constraints.
problem Understanding and quantifying bias in linear models under fairness constraints.
method Post-processing framework to decompose bias into direct and indirect components.
result Analytical characterization of how demographic parity reshapes model coefficients.
The paper addresses bias in visual recognition models by reweighting observations.
problem Bias in deep neural networks trained on biased image databases.
method Reweighting observations based on known biasing mechanisms to form a nearly debiased estimator.
result The approach can remedy representativeness issues in visual recognition systems.
Modeling bias in evaluation processes using optimization.
problem Bias in evaluation processes based on socially-salient attributes.
method Optimization-based model with two parameters: resource-information trade-off and risk-averseness.
result Characterization of distributions and effect of parameters on observed distributions.
There is a growing body of work that proposes methods for mitigating bias in machine learning systems. These methods typically rely on access to protected attributes such as race, gender, or age. However, this raises two significant challenges: (1) protected attributes may not be available or it may not be legal to use…
Amazon SageMaker Model Monitor detects drift in deployed ML models.
problem Ensuring high performance of ML models in production environments.
method Automatically detects data, concept, bias, and feature attribution drift in real-time.
result Maintains high quality models by providing alerts and corrective actions.
Improves model fairness under changing bias between labels and sensitive groups.
problem Fairness of models deteriorates when bias between labels and sensitive groups changes.
method Introduces correlation shifts to explicitly capture bias changes and proposes a pre-processing step to adjust data ratios.
result Our approach effectively improves model accuracy and fairness, both synthetic and real datasets.
Infrastructure monitors AI/ML radiology models across multiple sites.
problem Monitoring and improving AI/ML radiology models across multiple sites.
method Interactive radiology reporting, centralized cloud system, post-marketing surveillance.
result Efficient monitoring and iterative development of AI/ML models without radiologist burden.
Deployment-complete benchmarking assesses if evidence leads to consistent deployment actions.
problem Lack of clear evidence leading to consistent deployment actions.
method Introduces deployment-complete benchmarking to test if benchmark evidence determines deployment actions.
result Benchmark evidence must be complete for a claim to lead to a consistent deployment action.
Estimates treatment effects in bipartite systems with partial eligibility and interference.
problem Randomized experiments in bipartite systems with partial treatment eligibility and interference.
method Formalizes eligibility-constrained bipartite experiments, defines PTTE and STTE, identifies conditions, develops ensemble estimators, introduces projection.
result Proposed estimators recover PTTE and STTE with low bias and variance, corrects interference bias in field experiments.
New framework for fairness in machine learning models using SHAP values and adversarial learning.
problem Fairness of model predictions, especially for unprivileged groups.
method Develops a new fairness definition and a framework using SHAP values and adversarial learning to mitigate bias.
result Models produced are fairer and performant, demonstrating the approach on various datasets.
Paper establishes lower bounds and optimal algorithms for deployment-efficient RL.
problem Deployment efficiency in reinforcement learning.
method Optimization with constraints, lower bounds, algorithms.
result Established optimal algorithms for deployment-efficient RL.
DUPLE tackles cross-deployment recognition in fiber-optic perimeter security with meta-learning.
problem Cross-deployment recognition challenges in fiber-optic perimeter security due to label scarcity and distribution shifts.
method DUPLE employs statistically guided meta-learning to enhance recognition robustness across unseen deployments.
result DUPLE consistently outperforms traditional and meta-learning baselines in cross-deployment DFOS benchmarks.
Machine learning (ML), especially deep learning is made possible by the availability of big data, enormous compute power and, often overlooked, development tools or frameworks. As the algorithms become mature and efficient, more and more ML inference is moving out of datacenters/cloud and deployed on edge devices. This…
A new property fixes look-ahead bias in backtesting and trading pipelines.
problem Fixing look-ahead bias in backtesting and trading pipelines.
method Developed a pipeline calculus separating availability from reference time, and a type-and-effect system for the value-independent fragment.
result The check scales linearly and catches all leaks, including those missed by differential and tiling detectors.
Improved RL policies from offline data with relaxed BC constraints.
problem Overestimation bias in offline RL due to lack of interaction with environment.
method Introducing a policy constraint via behavioural cloning (BC) and adjusting the balance between RL and BC.
result Refined policies outperform baseline and match/exceed complex alternatives.
PBC improves AI and dynamical subseasonal forecasts by reducing biases.
problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.
Study reveals AI skin cancer classifiers underperform for darker skin phototypes, advocating for fairness auditing.
problem AI bias in dermatology, particularly for darker skin phototypes.
method Predictive Representativity (PR) framework, evaluating classifiers on HAM10000 and BOSQUE Test sets.
result Substantial performance disparities by skin phototype, highlighting AI bias.
This paper improves indoor positioning accuracy by deploying reference nodes to ensure Line-of-Sight.
problem Systematic bias errors in indoor positioning due to non-LoS propagation.
method Model indoor service area as a graph, partition into cliques for reference nodes, set minimum distance and angle parameters.
result Guaranteed LoS to reference nodes improves indoor positioning accuracy and precision.
Framework for responsible LLM deployment with human involvement and decentralized technologies.
problem Challenges in deploying LLMs for high-stakes decisions, including data security and accountability.
method Interactive human involvement through multiple iterations, decentralized technologies, and automated auditing.
result Enhanced security and accountability in LLM deployment for financial decisions.
Financial fraud detection in digital banking requires reasoning over multiple heterogeneous event streams.
problem Financial fraud detection in digital banking requires reasoning over multiple heterogeneous event streams.
method Multi-Stream Fraud Transformer (MSFT) architecture that encodes each event stream with independent Transformer encoders and fuses their representations through configurable mechanisms.
result Sequence models significantly outperform gradient-boosted trees operating on aggregated features.
New method improves fairness of facial recognition systems.
problem Facial recognition systems exhibit bias across different demographic groups.
method Optimizes centroid-based scores to reduce bias in pre-trained models.
result Demonstrates significant improvement in fairness with minimal loss in accuracy.
Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational formulation of black-box interpretation, general interpretability research rely hea…
Study shows privacy and utility trade-offs in synthetic data models, impacting fairness and real-world performance.
problem Understanding the impact of differential privacy on fairness and model performance in synthetic data.
method Systematic analysis of differentially private synthetic datasets on classification models, measuring utility and bias using fairness metrics.
result More privacy does not necessarily mean more bias, but it can affect model performance when deployed on real data.
This paper tackles hidden technical debts in fair ML systems for Fintech.
problem Building fair machine learning systems in financial services.
method Examining key stages of ML system development and deployment.
result Technical debts exist in deploying fair ML systems in Fintech.
A method for quickly determining deployment schedules that meet a given fuel cycle demand is presented here. This algorithm is fast enough to perform in situ within low-fidelity fuel cycle simulators. It uses Gaussian process regression models to predict the production curve as a function of time and the number of depl…
The paper develops methods to reduce deployment risk under dynamic covariate shifts.
problem Reduction of deployment risk under dynamic covariate shifts.
method Time-domain Poincare inequality and Jacobian-velocity theorem to identify and control directional tangent energy.
result Drift-aligned tangent regularization (DTR) reduces risk volatility and directional gain in low-rank drift regimes.
Packaging of Thick Membranes using a Multi-Spiral Folding Approach: Flat and Curved Surfacescond-mat.soft
New multi-spiral approach improves packaging of thick membranes.
problem Deploying thick membranes on curved surfaces efficiently.
method Multi-spiral folding approach with prismatic folding lines.
result Improved deployment performance of thick membranes on curved surfaces.