Alpha-GPT 2.0 integrates human insights into AI-driven investment research.
problem Efficiency and precision in quantitative investment research.
method Iterative Human-AI interaction using large language models.
result Enhanced efficiency and precision in quantitative investment research.
Framework adds human knowledge to AI decisions to improve outcomes.
problem Conflict between AI recommendations and human insights.
method Develops a framework for integrating human knowledge as a guardrail for AI decisions.
result Human knowledge can improve AI decisions, especially in specific pitfalls.
LLM extracts actionable insights from customer reviews.
problem Extracting actionable insights from customer reviews.
method Large language model approach distinguishing perceptual attributes from actionable features.
result High consistency and predictive validity of LLM insights compared to human coders.
Bayesian nonparametric models, such as Gaussian processes, provide a compelling framework for automatic statistical modelling: these models have a high degree of flexibility, and automatically calibrated complexity. However, automating human expertise remains elusive; for example, Gaussian processes with standard kerne…
Paper presents a novel framework for OOD learning with human feedback.
problem Multifaceted challenges of OOD generalization and detection.
method Selective human feedback for labeling a small number of informative samples from wild data distribution.
result Enhanced robustness and precision in handling OOD scenarios.
Unified model of urban consumer behavior and mobility patterns.
problem Understanding the lifestyles and infrastructure of urban regions.
method Collective matrix factorization for dual view modeling of consumer behavior and mobility.
result Unified model reveals deeper insights into consumer behavior and mobility patterns.
Study models human investors' sub-rational behavior in financial markets.
problem Lack of a comprehensive model for human sub-rationality in financial markets.
method Flexible reinforcement learning model incorporating five human sub-rational aspects.
result Model accurately reproduces human behavior and reveals insights into market dynamics.
Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components, unimportant sensor modalities, etc.). Besides, it is difficult to interpret the r…
AI systems are being deployed to support human decision making in high-stakes domains. In many cases, the human and AI form a team, in which the human makes decisions after reviewing the AI's inferences. A successful partnership requires that the human develops insights into the performance of the AI system, including …
Research aims to distinguish machine learning from human learning by studying tasks under human-created rules.
problem Understanding the difference between machine learning and human learning.
method Developing a novel approach to study learning under human-created rules.
result Found interesting groundtruth rule pairs to distinguish AI from human learning.
Survey on making machine learning models more understandable.
problem Making predictions from machine learning models transparent and understandable for humans.
method Conducts a survey on explainable supervised machine learning approaches.
result Classifies explainable SML approaches and discusses future directions.
This work advances collaborative decision making by combining human and AI strengths in uncertainty quantification.
problem Current AI lacks robust decision-making capabilities under uncertainty, especially in high-stakes contexts.
method Introduces Human AI Collaborative Uncertainty Quantification (HACUQ) framework, formalizing AI-human collaboration and developing calibration algorithms.
result Optimal collaborative prediction sets follow a two-threshold structure, and online adaptation algorithms can adapt to evolving human behavior.
Paper proposes a new RLHF framework for human preference learning.
problem Handling dependent online human preference outcomes with dynamic contexts.
method Two-stage algorithm with ε-greedy followed by exploitation; anti-concentration inequalities and matrix martingale concentration techniques. result Our method achieves optimal regret bound and asymptotic normality of estimators.
Humans prove theorems by relying on substantial high-level reasoning and problem-specific insights. Proof assistants offer a formalism that resembles human mathematical reasoning, representing theorems in higher-order logic and proofs as high-level tactics. However, human experts have to construct proofs manually by en…
Paper examines how adversarial ML attacks and defenses impact civil liberties and human rights.
problem Impact of adversarial machine learning on civil liberties and human rights.
method Uses insights from STS, anthropology, and human rights literature.
result Adversarial defenses can be used to suppress dissent and limit investigation of ML systems.
We conduct a large-scale, systematic study to evaluate the existing evaluation methods for natural language generation in the context of generating online product reviews. We compare human-based evaluators with a variety of automated evaluation procedures, including discriminative evaluators that measure how well machi…
Study uses LLMs to automate data insights discovery.
problem Extracting relevant insights from large data sets.
method Capture the Flag principle, LLMs, reasoning, code generation.
result LLMs can recognize meaningful data insights.
Efficiently evaluate generative models at the prompt level using tensor factorization.
problem Fine-grained evaluations of generative models are costly and often misaligned with human judgment.
method Tensor factorization model that merges cheap autorater data with a small set of human gold-standard labels.
result The method provides accurate and tight confidence intervals for model performance.
Fine-tunes language models with captions for differential equation solving.
problem Overreliance on function data in operator learning.
method Integrates human knowledge through captions and fine-tunes language models.
result Significantly enhanced performance and reduced function data requirements.
IDS improves RLHF by smoothing reward data, enhancing model performance.
problem Reward model performance degrades and overoptimization hinders true objective.
method Iterative Data Smoothing (IDS) updates model and data labels during each epoch.
result IDS outperforms traditional methods in RLHF.
Alpha-GPT mines new trading signals with human-AI interaction.
problem Mining new alphas for effective trading signals.
method Human-AI interaction and prompt engineering algorithmic framework.
result Demonstrates Alpha-GPT's effectiveness in generating creative, insightful, and effective alphas.
Framework uses human judgment to distinguish algorithmically indistinguishable cases.
problem Clarifying human-AI collaboration in prediction and decision tasks.
method Integrates human judgment to distinguish algorithmically indistinguishable cases.
result Improves performance of any feasible algorithmic predictor.
Subjective expected utility theory assumes that decision-makers possess unlimited computational resources to reason about their choices; however, virtually all decisions in everyday life are made under resource constraints - i.e. decision-makers are bounded in their rationality. Here we experimentally tested the predic…
Automatic human affect recognition is a key step towards more natural human-computer interaction. Recent trends include recognition in the wild using a fusion of audiovisual and physiological sensors, a challenging setting for conventional machine learning algorithms. Since 2010, novel deep learning algorithms have bee…
Explainable AI improves human decision accuracy but does not enhance it significantly.
problem Improving human decision-making through explainable AI.
method Comparing human decision accuracy with and without AI predictions, including or excluding explanations.
result Providing AI predictions improves human decision accuracy, but explanations do not significantly enhance it.
This work develops a high precision fault diagnosis classifier using XAI insights.
problem Fault diagnosis of steel plates in manufacturing industry.
method Incorporation of XAI insights into Data Science process using SMOTE and medoids.
result 10 fold cross validated performance of 94% achieved.
Paper reviews the evolution of alpha from human insight to AI-powered systems.
problem Exceeding market benchmarks in finance.
method Five-stage taxonomy integrating representation learning, multimodal data fusion, and LLM agents.
result Unified framework for evaluating and developing next-gen alpha systems.
CoExBO optimizes lithium-ion batteries with user input, enhancing trust and efficiency.
problem User distrust in Bayesian optimization due to opacity and lack of user input.
method Preference learning and iterative explanation to integrate user insights.
result Algorithm converges to optimal solution even with adversarial user inputs.
FinRobot AI agent for equity research provides comprehensive insights.
problem Narrow focus and limited discretion in AI solutions for equity research.
method Multi-agent Chain of Thought system integrating quantitative and qualitative analyses.
result FinRobot delivers insights comparable to major brokerage firms.
Bayesian models explain human time perception biases.
problem Understanding human time perception using Bayesian inference.
method Agent-based machine learning models and empirical data analysis.
result Bayesian models can replicate human time estimation biases.
Machine learning workflow development is anecdotally regarded to be an iterative process of trial-and-error with humans-in-the-loop. However, we are not aware of quantitative evidence corroborating this popular belief. A quantitative characterization of iteration can serve as a benchmark for machine learning workflow d…
New approach improves human activity recognition with wearables.
problem Improving human activity recognition with wearables.
method Exploiting latent relationships between multi-channel sensor modalities, data-agnostic augmentation, and a classification loss criterion.
result Achieves new state-of-the-art performance on four diverse activity recognition benchmarks.
New method uses explicit human demonstrations to teach missing features in reward learning.
problem Reward learning methods rely on handcrafted features, limiting their ability to adapt to new or unexplained corrections.
method Introduces human input guiding the robot from states with missing features to states without, teaching the feature explicitly and integrating it into the reward function.
result Decreases sample complexity and improves generalization of the learned reward over deep IRL baseline.
This research improves interpretability in sequential explanations using mental models.
problem Improving interpretability in sequential explanations between two parties.
method A reinforcement learning framework that selects explanations based on the explainee's mental model.
result Mental model-based policies increase interpretability over random selection in multiple sequential explanations.
The paper analyzes RLHF with human feedback and provides convergence results for MLE and pessimistic MLE.
problem Improving RLHF with human feedback from pairwise or K-wise comparisons. method Theoretical framework for RLHF with convergence analysis of MLE and pessimistic MLE.
result MLE fails but pessimistic MLE provides improved policies under certain coverage assumptions.
TBAL reduces manual annotation but requires validated data.
problem Creating large, high-quality labeled datasets.
method Threshold-based auto-labeling using human validation data.
result Sample complexity bounds on validation data needed.
New method for efficient online exploration in RLHF reduces regret.
problem Efficiently collecting new preference data in RLHF to refine reward model and policy.
method Proposes a new exploration scheme that directs preference queries toward reducing uncertainty in reward differences most relevant to policy improvement.
result Establishes regret bounds of order T(β+1)/(β+2) for online RLHF, with polynomial scaling in all model parameters. The study of hierarchy in networks of the human brain has been of significant interest among the researchers as numerous studies have pointed out towards a functional hierarchical organization of the human brain. This paper provides a novel method for the extraction of hierarchical connectivity components in the human …
New models predict mobility flows as well as complex machine learning but are simpler and interpretable.
problem Incomplete understanding and modeling of human mobility flows.
method Developed simple machine-learned, closed-form models of mobility.
result These models predict mobility flows more accurately than gravity or complex machine/deep learning models.
We provide a novel notion of what it means to be interpretable, looking past the usual association with human understanding. Our key insight is that interpretability is not an absolute concept and so we define it relative to a target model, which may or may not be a human. We define a framework that allows for comparin…
In this paper, we present a Bayesian view on model-based reinforcement learning. We use expert knowledge to impose structure on the transition model and present an efficient learning scheme based on variational inference. This scheme is applied to a heteroskedastic and bimodal benchmark problem on which we compare our …
This paper formalizes reward training in RLHF and provides theoretical guarantees.
problem Costly human feedback collection in RLHF.
method Linear contextual dueling bandit method for regret minimization.
result Derives bounds on simple regret for offline reward training.
Deep Reinforcement Learning (DRL) has become a powerful strategy to solve complex decision making problems based on Deep Neural Networks (DNNs). However, it is highly data demanding, so unfeasible in physical systems for most applications. In this work, we approach an alternative Interactive Machine Learning (IML) stra…
New method for explaining dialogue response generation models.
problem Interpreting sequence generation models, especially dialogue response generation.
method Local Explanation of Response Generation (LERG) method.
result LERG improves dialogue response generation explanations compared to existing methods.
This article outlines a method for automatically generating models of dynamic decision-making that both have strong predictive power and are interpretable in human terms. This is useful for designing empirically grounded agent-based simulations and for gaining direct insight into observed dynamic processes. We use an e…
The dearth of prescribing guidelines for physicians is one key driver of the current opioid epidemic in the United States. In this work, we analyze medical and pharmaceutical claims data to draw insights on characteristics of patients who are more prone to adverse outcomes after an initial synthetic opioid prescription…
Batteryless or so called passive wearables are providing new and innovative methods for human activity recognition (HAR), especially in healthcare applications for older people. Passive sensors are low cost, lightweight, unobtrusive and desirably disposable; attractive attributes for healthcare applications in hospital…
Today's densely instrumented world offers tremendous opportunities for continuous acquisition and analysis of multimodal sensor data providing temporal characterization of an individual's behaviors. Is it possible to efficiently couple such rich sensor data with predictive modeling techniques to provide contextual, and…