Adversarial policies beat superhuman Go AI systems.
problem Vulnerability of superhuman AI systems to adversarial attacks.
method Training adversarial policies to trick KataGo into making blunders.
result Adversarial policies achieve >97% win rate against KataGo at superhuman settings.
Paper examines Go AI robustness against adversarial attacks.
problem Superhuman Go AIs are vulnerable to simple adversarial strategies.
method Three defenses tested: adversarial training, iterated adversarial training, and changing network architecture.
result No defense is robust against newly trained adversaries, and attacks are similar to cyclic attacks.
AI systems that explain their decisions can be monitored for harmful intentions.
problem Monitoring AI systems' decision-making processes for harmful intentions is imperfect and can miss some misbehavior.
method Monitoring the chain of thought (CoT) of AI systems that communicate in human language.
result CoT monitoring is a promising but fragile approach to AI safety.
The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy. However, many obstacles remain in the understanding of and usability of these prom…
Clarifies the scope of 'reproducibility' in AI and ML.
problem Unclear meaning of 'reproducibility' in AI and ML.
method Analyzes the community's works on reproducibility.
result Identifies eight general topic areas of reproducibility.
The paper integrates AI and expert knowledge to optimize radiotherapy decisions.
problem Optimizing radiation dose planning considering patient-specific information.
method Integrating Gaussian process models with deep neural networks to quantify uncertainty.
result Improves AI model performance and guides clinical decision making.
Data science principles enhance AI interpretability for better user control.
problem Risks from opaque AI models without clear impacts.
method Synthesizes principles from interpretability literature, emphasizing audience goals.
result Illustrates basic techniques and criteria for evaluating interpretability.
Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods have enjoyed huge success in challenging domains, such as chess and Go, where a perfect simulator is available. However, in real-world problems the dynamics gove…
AI random forest model improves credit risk scoring for Azerbaijani SMEs.
problem Improving accuracy in identifying defaulters for SME loans.
method Used Python to compare a Delphi model with a random forest model, measuring accuracy, precision, recall, and F-1 scores.
result Significant improvements in model performance (e.g., from 0.69 to 0.83 in accuracy).
Paper proposes AI for stock market forecasting using external knowledge.
problem Forecasting stock prices influenced by external factors.
method Learning from historical data and external temporal knowledge graphs modeled as Hawkes processes.
result Dynamic representations effectively rank stocks based on returns.
AI methods are energy-intensive, but efficiency alone isn't enough for sustainability.
problem AI methods are energy-intensive and contribute to climate change.
method Critically examines the limitations of efficiency in improving environmental sustainability of AI.
result Efficiency alone is insufficient to address the environmental impacts of AI.
Corner cases are the main bottlenecks when applying Artificial Intelligence (AI) systems to safety-critical applications. An AI system should be intelligent enough to detect such situations so that system developers can prepare for subsequent planning. In this paper, we propose semi-supervised anomaly detection conside…
Deep learning excels in AI but struggles with causal physics.
problem Deep learning struggles with causal relationships in physical sciences.
method Combining Bayesian methods, physical constraints, and causal models.
result Deep learning can mislead in systems with unclear causal relationships.
Artificial intelligence (AI) generally and machine learning (ML) specifically demonstrate impressive practical success in many different application domains, e.g. in autonomous driving, speech recognition, or recommender systems. Deep learning approaches, trained on extremely large data sets or using reinforcement lear…
This paper is an attempt to explain all the matrix calculus you need in order to understand the training of deep neural networks. We assume no math knowledge beyond what you learned in calculus 1, and provide links to help you refresh the necessary math where needed. Note that you do not need to understand this materia…
FGNNs improve game-playing AI by exploiting symmetries.
problem Symmetrical game states are not exploited by current AI.
method Introduces FGNNs for creating group-equivariant neural networks.
result FGNNs improve performance in games like checkers and image segmentation.
New attacks improve privacy audits by analyzing model updates.
problem Improving privacy audits of AI models through sequence analysis.
method Developed SeMI attacks to identify target insertions in model sequences.
result SeMI attacks achieve higher power and tighter privacy audits.
Reinforcement learning has exceeded human-level performance in game playing AI with deep learning methods according to the experiments from DeepMind on Go and Atari games. Deep learning solves high dimension input problems which stop the development of reinforcement for many years. This study uses both two techniques t…
The study develops a machine learning system for credit scoring and default prediction.
problem Developing a robust credit rating and default prediction system.
method Combines NLP, AE, GBM, DE, and SHAP/LIME for model interpretability.
result Obtained excellent out-of-sample performance in credit rating and default prediction.
Transformers learn chain-of-thought reasoning for longer problems, proving length generalization.
problem Challenging problems require deeper reasoning, but how do models generalize this to longer tasks?
method Theoretical analysis of transformers on synthetic state-tracking tasks, proving length generalization through attention concentration.
result Transformers can learn chain-of-thought reasoning for longer problems, proving length generalization.
AI stocks hedge against AI singularity's economic impact.
problem AI singularity's displacement of consumption.
method Developed an asset pricing model with incomplete markets.
result AI stocks command a premium due to market incompleteness.
Study analyzes AI's impact on firms, markets, and workers using large language model data.
problem Understanding AI's effect on firms, markets, and workers.
method Used 380 trillion tokens from 400+ large language models to analyze AI's impact.
result Firms with higher AI exposure earn higher returns, creating an AI premium.
New AI stock indices classify firms' AI engagement using 10-K filings.
problem Opaque AI selection criteria in existing ETFs.
method NLP analysis of 10-K filings to classify AI stocks.
result Companies with higher AI engagement have greater positive returns.
The paper analyzes risk spillovers between AI ETFs, AI tokens, and green markets.
problem Risk spillovers among AI ETFs, AI tokens, and green markets.
method R2 decomposition method
result AI ETFs and clean energy act as risk transmitters, while AI tokens and green assets act as receivers.
A new unbiased Hessian estimator for expectation-based objectives.
problem Estimating Hessian for objectives with non-reparameterizable nodes.
method GO Hessian estimator for expectation-based objectives.
result GO Hessian provides unbiased and low-variance estimation of Hessian.
This review covers AI in finance, challenges, techniques, and opportunities.
problem Challenges and opportunities in AI applications in finance.
method Comprehensive categorization and overview of AI research in finance over decades.
result A dense roadmap of AI challenges, techniques, and opportunities in finance.
Explainable AI improves human decision accuracy but does not enhance it significantly.
problem Improving human decision-making through explainable AI.
method Comparing human decision accuracy with and without AI predictions, including or excluding explanations.
result Providing AI predictions improves human decision accuracy, but explanations do not significantly enhance it.
The paper explores AI in finance, focusing on XAI's role in enhancing interpretability and trust.
problem The need for AI in finance and the importance of XAI for better decision-making.
method Tracing AI's evolution in finance, highlighting XAI's role, and demonstrating through simulations.
result XAI enhances trust in AI systems, leading to more responsible decision-making.
Paper defines AI-specific loss reconstruction problem and introduces CER framework.
problem Reconstructing AI-generated losses, especially in agentic systems.
method CER framework: C (control boundary), E (evidence reconstruction), R (insurance response).
result Defines AI-specific reconstruction problem and operationalizes it.
Experiment shows cognitive biases impact human-AI collaboration, highlighting the need for diverse evaluator samples.
problem Cognitive biases affect human-AI collaboration, leading to suboptimal outcomes.
method Randomized experiment with 2,784 participants, manipulating AI suggestion quality, task burden, and financial incentives.
result Individual attitudes toward AI are the strongest predictor of performance, influencing accuracy and overcorrection.
AI enhances financial forecasting with challenges in regulation and privacy.
problem Challenges in integrating AI with financial services and regulations.
method Integration of AI technologies like deep learning and reinforcement learning.
result AI improves financial forecasting but faces regulatory and privacy issues.
AI+MPS workshop aims to strengthen AI's role in science.
problem AI's potential to enhance scientific discovery and education.
method Proposes activities and strategic priorities to strengthen AI-MPS link.
result AI and science are becoming increasingly intertwined.
Improved AI patent classifier measures U.S. and China's AI patenting.
problem Measuring AI patents with high precision and generalization.
method Fine-tuning PatentSBERTa on manually labeled data from USPTO's AI Patent Dataset.
result Rapid growth in AI patenting in both countries, but different organizational patterns.
A geodesic orbit manifold (GO manifold) is a Riemannian manifold (M,g) with the property that any geodesic in M is an orbit of a one-parameter subgroup of a group G of isometries of (M,g). The metric g is then called a G-GO metric in M. For an arbitrary compact homogeneous manifold M=G/H, we simplify the general proble…
FST.ai 2.0 improves Taekwondo decision-making with AI, reducing review time and increasing trust.
problem Fair, transparent, and explainable decision-making in Taekwondo.
method Pose-based action recognition, epistemic uncertainty modeling, interactive dashboards.
result 85% reduction in decision review time, 93% referee trust in AI-assisted decisions.
This report aims to improve trust in AI by explaining machine learning models.
problem Understanding and trusting automated decision-making systems.
method Survey and distillation of literature on explainable machine learning.
result Survey findings help practitioners understand and apply explainable methods.
Article evaluates AI security threats and proposes multiple measures.
problem Threats to AI integrity and security.
method Literature review, analysis of AI supply chain, discussion of mitigations.
result Multiple protective measures are necessary for AI security.
AI threatens financial stability through misuse and stealth adoption.
problem Misuse and stealth adoption of AI in financial regulations.
method Analysis of AI's potential risks and criteria for AI suitability.
result AI will likely become widely used by stealth, affecting high-level financial functions.
The DoD needs a robust process to evaluate AI/ML model performance and robustness.
problem AI/ML models are brittle and nonrobust, posing risks in national security.
method Reviews AI/ML development process and best practices for evaluation.
result Recommendations for DoD evaluators to ensure robust AI/ML capabilities.
Paper tackles AI risks by customizing metrics and models.
problem AI risks are multidimensional and immaturely managed.
method Decomposes AI risks into data protection, fairness, etc., and develops metrics and models.
result Customized metrics and models reduce AI risk uncertainty.
Qlib aims to integrate AI into quantitative investment.
problem Challenges in applying AI to quantitative investment.
method Design and develop Qlib to accommodate AI-driven workflow.
result Qlib realizes the potential of AI technologies in quantitative investment.
Open AI models affect bond yields differently than closed ones.
problem Understanding how market reactions to AI releases impact bond yields.
method Analyzed US bond yields before and after the release of open and closed AI models.
result Open AI models shift bond yields in the opposite direction of closed models.
AI systems are being deployed to support human decision making in high-stakes domains. In many cases, the human and AI form a team, in which the human makes decisions after reviewing the AI's inferences. A successful partnership requires that the human develops insights into the performance of the AI system, including …
Do-AIQ framework evaluates AI algorithms' quality using DOE.
problem Quality evaluation of AI mislabel detection algorithms.
method Design-of-experiment approach with high-dimensional constraint space design and surrogate modeling.
result Established framework for evaluating AI algorithm quality robustly.
AI enhances ESG practices in finance, but requires careful consideration.
problem Regulatory pressures and stakeholder awareness drive ESG adoption.
method Industrial survey categorizing AI applications in ESG.
result AI improves analytical capabilities, risk assessment, and customer engagement.
Generative AI boosts analyst reports but increases forecast errors.
problem Improving financial analyst reports with AI.
method Natural experiment using FactSet's AI platform.
result AI-assisted reports are more comprehensive but lead to higher forecast errors.
Recent breakthroughs in AI for multi-agent games like Go, Poker, and Dota, have seen great strides in recent years. Yet none of these games address the real-life challenge of cooperation in the presence of unknown and uncertain teammates. This challenge is a key game mechanism in hidden role games. Here we develop the …
Improves AI-prior reliability for Bayesian inference.
problem Error propagation from predictive models into posterior inference.
method Rectified AI-informed prior elicitation framework.
result Significant reduction in bias and improvement in predictive performance.