AI updates can disrupt human-AI teams; new objective improves compatibility.
problem AI updates can disrupt human-AI team performance.
method Introduce compatibility concept, propose re-training objective.
result Current machine learning algorithms do not produce compatible updates.
Experiment shows cognitive biases impact human-AI collaboration, highlighting the need for diverse evaluator samples.
problem Cognitive biases affect human-AI collaboration, leading to suboptimal outcomes.
method Randomized experiment with 2,784 participants, manipulating AI suggestion quality, task burden, and financial incentives.
result Individual attitudes toward AI are the strongest predictor of performance, influencing accuracy and overcorrection.
New AI error correctors improve classifier performance with provable guarantees.
problem Improving AI classifier performance with scarce training data.
method Weakly supervised AI error correctors with performance guarantees.
result Provable performance guarantees for AI error correction.
The paper highlights AI brittleness and the need for robust testing out-of-distribution performance.
problem The brittleness of AI systems, especially Deep Neural Networks, limits their reliability and certification.
method Analysis of AI brittleness and OOD performance, emphasizing the need for resilience and improved evaluation methods.
result AI systems are more failure-prone than certified in critical systems, and OOD performance falls off gradually.
The DoD needs a robust process to evaluate AI/ML model performance and robustness.
problem AI/ML models are brittle and nonrobust, posing risks in national security.
method Reviews AI/ML development process and best practices for evaluation.
result Recommendations for DoD evaluators to ensure robust AI/ML capabilities.
New AI stock indices classify firms' AI engagement using 10-K filings.
problem Opaque AI selection criteria in existing ETFs.
method NLP analysis of 10-K filings to classify AI stocks.
result Companies with higher AI engagement have greater positive returns.
FST.ai 2.0 improves Taekwondo decision-making with AI, reducing review time and increasing trust.
problem Fair, transparent, and explainable decision-making in Taekwondo.
method Pose-based action recognition, epistemic uncertainty modeling, interactive dashboards.
result 85% reduction in decision review time, 93% referee trust in AI-assisted decisions.
Active learning method improves AI performance by balancing exploration and exploitation.
problem Efficiently acquiring samples for supervised learning in streaming data.
method Ensemble active learning by contextual bandits.
result Improved AI modeling performance through better sample acquisition.
Gen AI improves document understanding but not data analysis in public sector tasks.
problem Understanding the impact of Gen AI on public sector tasks.
method Pre-registered field experiment comparing Gen AI to control group performance.
result Mixed results: Gen AI improves document understanding but not data analysis.
AI's high performance is linked to its vulnerability due to data geometry.
problem Vulnerability of AI systems to adversarial attacks.
method Simple geometric argument based on high-dimensional data sets.
result High performance and vulnerability are intrinsically coupled.
AlphaZero reveals new chess concepts learnable by top experts.
problem Extracting and understanding hidden knowledge from AI systems.
method Proposed method to extract new chess concepts from AlphaZero.
result Top chess grandmasters show improvements in learning new concepts.
AI agent improves performance attribution analysis with high accuracy.
problem Improving accuracy in performance attribution analysis.
method Leveraging large language models and advanced prompt engineering techniques.
result Achieves accuracy rates exceeding 93% in analyzing performance drivers.
This paper compares AI performance in native vs. browser-based implementations.
problem Performance demands in AI applications, especially client-side.
method Comparison study between native code and browser-based (JS, ASM.js, WebAssembly) implementations.
result Current runtime optimizations push browser performance close to native binary.
AI threatens financial stability through misuse and stealth adoption.
problem Misuse and stealth adoption of AI in financial regulations.
method Analysis of AI's potential risks and criteria for AI suitability.
result AI will likely become widely used by stealth, affecting high-level financial functions.
The study evaluates AI model performance measures for medical use.
problem Selecting appropriate performance measures for AI models in medical practice.
method Assessed 32 performance measures across five domains for binary outcomes.
result 17 measures are both proper and reflect decision-analytic performance.
Adversarial policies beat superhuman Go AI systems.
problem Vulnerability of superhuman AI systems to adversarial attacks.
method Training adversarial policies to trick KataGo into making blunders.
result Adversarial policies achieve >97% win rate against KataGo at superhuman settings.
Optimal allocation of human effort to correct AI assessments in decision-making.
problem How to allocate costly human effort to correct noisy or biased AI-generated assessments.
method Decision-theoretic framework treating AI assessments as signals and human judgments as costly information. Developed estimation procedures under nonparametric and linear models.
result Our approach substantially outperforms LLM-only predictions and achieves performance comparable to full human review while using only 20-30% of the human information.
AlphaX uses AI to outperform Brazilian stock market benchmarks.
problem AI strategies often overperform in backtests but underperform in real markets due to lookahead bias.
method Controlled simulations to mitigate lookahead bias, using Value Investing principles.
result AlphaX strategy outperforms major benchmarks and technical indicators.
Optimizes AIS hyperparameters for efficient marginal likelihood estimation.
problem Limited computation budget affects AIS performance.
method Flexible intermediary distributions defined by residual density, parameter sharing, and fix linear schedule.
result Optimized-Path AIS reduces sampling iterations and improves performance.
Ray is a distributed system for AI applications that learn from continuous interactions.
problem Demanding systems requirements for next-gen AI applications.
method Unified interface for task-parallel and actor-based computations, distributed scheduler, fault-tolerant store.
result Demonstrated scaling beyond 1.8 million tasks per second and better performance for reinforcement learning.
Qlib aims to integrate AI into quantitative investment.
problem Challenges in applying AI to quantitative investment.
method Design and develop Qlib to accommodate AI-driven workflow.
result Qlib realizes the potential of AI technologies in quantitative investment.
A machine learning environment for detecting autonomous vehicle corner cases.
problem Testing autonomous driving software in the real world is difficult.
method Connecting CARLA simulation software to TensorFlow and custom AI client software.
result The system can identify situations where AI software fails to understand the scenario.
Paper proposes a new AI design philosophy for distributed learning.
problem Designing AI systems that mimic human cognitive capabilities.
method Democratized learning (Dem-AI) with self-organized hierarchical agents.
result Self-organized learning systems can perform complex tasks more efficiently.
AI-driven investment strategies self-defeat at scale due to signal crowding and erosion.
problem Excess returns from AI-driven investment strategies diminish at scale due to signal crowding and erosion.
method Theoretical model and empirical validation using SEC Form 13F filings and hedge fund return dynamics.
result The alpha half-life of signals decreases significantly with AI adoption, leading to diminishing returns.
AI systems need reliable testing to ensure safety and trustworthiness.
problem Current AI Act lacks functional trustworthiness for AI systems.
method Define technical application distribution, set risk-based performance, and conduct statistically valid testing.
result Reliable functional trustworthiness is essential for AI systems.
Do-AIQ framework evaluates AI algorithms' quality using DOE.
problem Quality evaluation of AI mislabel detection algorithms.
method Design-of-experiment approach with high-dimensional constraint space design and surrogate modeling.
result Established framework for evaluating AI algorithm quality robustly.
AI triage and diagnostic system performs similarly to human doctors, with safer triage advice.
problem Improving patient care through more reliable symptom checkers.
method Prospective validation study comparing AI system to human doctors.
result AI system's accuracy in identifying conditions comparable to human doctors, with safer triage advice.
Designing AI market for content creation
problem Balancing technological progress and individual incentives for content creation
method Dynamic Stackelberg game model
result Inducing greater reliance on AI-assisted creation
AI methods often fail to outperform classical CPU-based solvers on Maximum Independent Set problems.
problem Comparing AI methods with classical CPU-based solvers on Maximum Independent Set problems.
method Comparison of AI methods (e.g., generative models, reinforcement learning) with classical CPU-based solvers (e.g., KaMIS) on Maximum Independent Set problem.
result AI-inspired methods are often outperformed by classical CPU-based solvers, even with post-processing techniques.
Improves AI-prior reliability for Bayesian inference.
problem Error propagation from predictive models into posterior inference.
method Rectified AI-informed prior elicitation framework.
result Significant reduction in bias and improvement in predictive performance.
New framework replicates private equity performance using AI and liquid strategies.
problem Inadequate trust and transparency in private equity markets.
method Advanced graphical models and asymmetric risk adjustments.
result Liquid, scalable solution that closely mimics private equity performance.
AI pipeline simplifies AI deployment on embedded devices.
problem Training and deployment of custom AI solutions on embedded devices requires expertise and integration barriers.
method Modular AI pipeline integrating data, algorithms, and deployment tools.
result LPDNN consistently outperforms other deployment frameworks on embedded platforms.
CAT framework improves AI medical screening fairness and reliability.
problem Imbalanced data, varying performance across cohorts, and patient-level inconsistencies in traditional metrics.
method CAT framework introduces patient-level assessment, entropy-based distribution weighting, and cohort-weighted sensitivity and specificity.
result Enhanced predictive reliability, fairness, and interpretability of AI-driven medical screening models.
AI learns to adapt driving behavior based on human interest.
problem Adapting AI behavior to individual human preferences for trust and comfort.
method Hybrid brain-computer interface (hBCI) detects human interest, which is used to adapt AI behavior in a virtual vehicle.
result AI agent slows down when passengers encounter objects of interest, increasing viewing time for subjects.
Study uses AI agents to improve equity portfolio management.
problem Improving stock selection and portfolio management efficiency.
method Role-based multi-agent systems for equity research.
result Multi-agent approach outperforms benchmarks in stock selection.
AI-driven tax policies improve economic equality and productivity.
problem Lack of appropriate economic data and limited opportunity to experiment.
method Two-level deep reinforcement learning approach to learn dynamic tax policies from observational data.
result AI-driven tax policies improve the trade-off between equality and productivity by 16%.
The paper tackles AI advice giving by considering adherence levels and defer options.
problem Inadequate consideration of human adherence to AI recommendations.
method Sequential decision-making model that considers adherence levels and incorporates a defer option.
result Specialized learning algorithms provide better convergence and empirical performance.
The paper investigates AI robustness through experiments and statistical analysis.
problem Inaccurate AI predictions can lead to safety and adoption issues.
method Design of experiments framework to study AI classification robustness.
result AI algorithms' robustness is influenced by various factors.
Paper tackles unobserved confounding in human-AI collaborations.
problem Unobserved confounding undermines human-AI collaboration effectiveness.
method Combines sensitivity analysis from causal inference with AI-driven statistical modeling.
result Enhances robustness and reliability of collaborative outcomes.
AI beats 95% of humans in Rock-Paper-Scissors.
problem Predicting and modeling human behavior in strategic games.
method Used Markov Models of varying memory lengths to compete against humans, introducing a 'focus length' parameter.
result Multi-AI strategy wins over 95% of human opponents in continuous 300-round games.
A new AI framework reduces costs and improves performance.
problem High costs and over-confidence in AI models.
method Entropy-optimizing reformulation of Boltzmann machines.
result Cheaper, more performant AI models with validated reliability.
AI agents learn to cooperate with users of unknown type.
problem Designing AI agents that can cooperate with new users effectively.
method Modeling user behavior as parameters, observing user actions to infer type, and adapting policies.
result Adaptive AI agents perform significantly better than non-adaptive ones in real scenarios.
CoCoPIE shows AI can run on regular devices without special hardware.
problem Real-time AI on mobile devices without special hardware.
method Compression-compiler co-design using CoCoPIE framework.
result Real-time AI applications on off-the-shelf mobile devices.
AI can identify simple groups and match algebraic tables, even with limited training.
problem Can AI learn algebraic structures?
method Machine learning techniques (SVM, neural classifiers) applied to finite groups and rings.
result AI can correctly identify simple groups and match algebraic tables for small structures.
Study compares AI and static analysis for detecting buffer overflows.
problem Detecting buffer overflows in code.
method Developed s-bAbI to generate code samples, compared AI with static analysis tools.
result AI system requires extensive training data to match static analysis precision and recall.
The paper integrates AI and expert knowledge to optimize radiotherapy decisions.
problem Optimizing radiation dose planning considering patient-specific information.
method Integrating Gaussian process models with deep neural networks to quantify uncertainty.
result Improves AI model performance and guides clinical decision making.
ProEval efficiently estimates AI performance and discovers failures using pre-trained Gaussian Processes.
problem Resource-intensive evaluation of generative AI models.
method ProEval uses pre-trained Gaussian Processes and Bayesian quadrature to estimate performance and discover failures.
result ProEval requires significantly fewer samples to achieve accurate performance estimates and reveals more diverse failure cases.
Optimizes AI learning with limited human feedback budgets.
problem Optimizing allocation of a fixed annotation budget for AI learning.
method Preference-Calibrated Active Learning (PCAL) using semi-parametric inference.
result Proves asymptotic optimality and robustness of the PCAL estimator.