AI-assisted interviews allow respondents to describe experiences naturally, but mapping those accounts into structured survey variables is fallible.
problem Mapping AI-assisted interview responses into structured survey variables is fallible.
method Adaptive Matrix Validation (AMV) is proposed, which involves mapping responses into tabular data and using a small set of structured questions for statistical adjustment.
result The estimator calibrates mapped values using validation answers from other respondents and corrects remaining error with validation answers observed for the target respondent.
Former physicists share insights on derivatives in interviews.
problem Understanding physics in finance interview questions.
method Interviews with former physicists in finance.
result Compilation of physics-related interview answers.
Study uses interviews to automatically detect BD and BPD with good accuracy.
problem Challenges in distinguishing BD and BPD from clinical interviews.
method Developed a multi-modal dataset and used a linear classifier with selected features from interviews.
result Different sets of features characterize BD and BPD, providing insights into their differences.
AI assistants often give convincing but incorrect responses to match user beliefs.
problem Sycophancy in AI assistants that use human feedback.
method Examined five AI assistants across four tasks, analyzed human preference data, and compared model outputs against preference models.
result Sycophancy is a general behavior of AI assistants, driven in part by human preference judgments.
Model detects depression from transcribed interviews using affective language.
problem Detecting depression from transcribed clinical interviews.
method Hierarchical Attention Network with affective conditioning.
result Model achieves state-of-the-art F1 scores in depression detection.
Interview study reveals considerations for designing semi-automated bias detection tools.
problem Detecting and mitigating machine learning biases.
method Interview study with 11 machine learning practitioners.
result Four considerations identified for tool design.
Multimodal analysis assesses job interview performance and provides feedback.
problem Assessing candidate performance in interviews for professional roles.
method Multimodal analytical framework using video, audio, and text data.
result The proposed methodology achieved promising results in predicting behavioral cues.
Given a huge set of applicants, how should a firm allocate sequential resume screenings, phone interviews, and in-person site visits? In a tiered interview process, later stages (e.g., in-person visits) are more informative, but also more expensive than earlier stages (e.g., resume screenings). Using accepted hiring mo…
Generative AI boosts productivity and improves customer service quality.
problem Productivity and quality of customer support agents.
method Staggered introduction of a generative AI-based conversational assistant in customer support.
result AI increases productivity by 15% on average, with significant heterogeneity across workers.
New AI assistant for power grid operators simplifies complex decision-making.
problem Complexity and uncertainty in power grid operations.
method Unified human-machine interface and AI integration.
result Development of a new assistant framework for power grid operators.
Study blockchain's impact on primary financial market challenges.
problem Challenges of blockchain in securities issuance and trading.
method Hybrid method combining interviews and surveys.
result Complex due diligence, mismatch, and difficult monitoring are significant challenges.
The paper addresses the difficulty of decision makers trusting AI-assisted predictions and proposes a method to improve confidence values.
problem Decision makers struggle to trust AI-assisted predictions based on confidence values.
method The paper investigates why decision makers have difficulties and proposes a method to construct more useful confidence values.
result Multicalibration with respect to the decision maker's confidence on her own predictions is a sufficient condition for alignment, leading to better decisions.
Optimal allocation of human effort to correct AI assessments in decision-making.
problem How to allocate costly human effort to correct noisy or biased AI-generated assessments.
method Decision-theoretic framework treating AI assessments as signals and human judgments as costly information. Developed estimation procedures under nonparametric and linear models.
result Our approach substantially outperforms LLM-only predictions and achieves performance comparable to full human review while using only 20-30% of the human information.
Based on interviews with 28 organizations, we found that industry practitioners are not equipped with tactical and strategic tools to protect, detect and respond to attacks on their Machine Learning (ML) systems. We leverage the insights from the interviews and we enumerate the gaps in perspective in securing machine l…
Based on 46 in-depth interviews with scientists, engineers, and CEOs, this document presents a list of concrete machine research problems, progress on which would directly benefit tech ventures in East Africa.
This work facilitates ensuring fairness of machine learning in the real world by decoupling fairness considerations in compound decisions. In particular, this work studies how fairness propagates through a compound decision-making processes, which we call a pipeline. Prior work in algorithmic fairness only focuses on f…
In this paper we present the Warm-starting Dynamic Thresholding algorithm, developed using dynamic programming, for a variant of the standard online selection problem. The problem allows job positions to be either free or already occupied at the beginning of the process. Throughout the selection process, the decision m…
Young investors, especially students, dominate Indonesian stock exchanges.
problem Investment behavior of young and rookie investors in the stock market.
method Qualitative approach with descriptive analysis and interviews.
result Perception of behavioral control influences investment decisions.
A new framework uses text descriptions to improve protein design.
problem Lack of effective methods to incorporate textual descriptions in protein design.
method ProteinDT framework that combines text and protein structural information.
result ProteinDT significantly improves protein design accuracy and performance.
New method improves active statistical inference by reducing noise.
problem Inaccurate uncertainty estimates in active sampling lead to noisy results.
method Robust sampling strategies that interpolate between uniform and active sampling based on uncertainty scores.
result The robust sampling ensures that the estimator is never worse than uniform sampling and usually outperforms active inference.
The paper studies how to allocate human validation in AI-assisted tasks to minimize errors.
problem Heterogeneous reliability of AI-generated signals across tasks, products, and customer segments.
method Tuned prediction-powered inference, upper confidence bounds policy, Neyman square-root rule.
result The proposed policy outperforms uniform and epsilon-greedy allocation, closing most of the gap to the oracle when reliability is heterogeneous.
To relieve the pain of manually selecting machine learning algorithms and tuning hyperparameters, automated machine learning (AutoML) methods have been developed to automatically search for good models. Due to the huge model search space, it is impossible to try all models. Users tend to distrust automatic results and …
Note on subgaussian bounds for sign-quantized linear maps.
problem Understanding subgaussian behavior of sign-quantized linear maps.
method Developed a dimension-independent subgaussian concentration bound for Gaussian vectors under nonlinear mappings.
result Answered a question about sign-quantized linear maps using a new subgaussian bound.
TacticAI helps football coaches improve tactics by analyzing corner kicks.
problem Developing effective responses to rival teams' tactics algorithmically.
method TacticAI combines predictive and generative components to suggest player setups and position adjustments.
result TacticAI's model suggestions are favored over existing tactics 90% of the time by football domain experts.
Procedure verifies if machine learning models assign fixed predictions that preclude access.
problem Models assign fixed predictions that preclude access to credit and employment.
method Model-agnostic recourse verification with reachable sets.
result Models can inadvertently preclude access by assigning fixed predictions.
AI-assisted framework detects and predicts rare extreme events.
problem Detecting rare extreme events in complex systems.
method Combining BED with DNOs for active learning and forecasting.
result Framework outperforms GPs and uncovers extremes without initial data.
Machine learning and AI-assisted trading have attracted growing interest for the past few years. Here, we use this approach to test the hypothesis that the inefficiency of the cryptocurrency market can be exploited to generate abnormal profits. We analyse daily data for 1,681 cryptocurrencies for the period between N…
This thesis evaluates text-based vs audio-based classification of mental health interviews.
problem Classifying psychiatric illness using text-based methods.
method Design and evaluate a text classification network on mental health interviews, using belabBERT.
result Text-based classification is a strong alternative to audio-based methods.
Imagine a large firm with multiple departments that plans a large recruitment. Candidates arrive one-by-one, and for each candidate the firm decides, based on her data (CV, skills, experience, etc), whether to summon her for an interview. The firm wants to recruit the best candidates while minimizing the number of inte…
EduQG generates better educational questions by pre-training on scientific text.
problem Improving the quality of educational questions for scalable self-assessment.
method Adapting a large language model for educational question generation, pre-trained on scientific text.
result EduQG produces superior educational questions compared to baseline models.
NFTs raise concerns like scams, racism, and sexism; centralization vs decentralization debate.
problem Concerns and value judgments of stakeholders in NFT market.
method Mixed quantitative and qualitative methods: social media analysis and interviews.
result Identified financial scams, counterfeit NFTs, hacking, and unethical NFTs as major issues.
These are the lecture notes for an advanced Ph.D. level course I taught in Spring'02 at the C.N. Yang Institute for Theoretical Physics at Stony Brook. The course primarily focused on an introduction to stochastic calculus and derivative pricing with various stochastic computations recast in the language of path integr…
Paper develops a method for valid inference using language model predictions from verbal autopsy narratives.
problem Valid inference from verbal autopsy narratives for public health decision-making.
method Develops multiPPI++ method for valid inference using NLP techniques for COD prediction.
result Demonstrates the effectiveness of multiPPI++ in handling transportability issues and recovering ground truth estimates.
This essay reviews human observer-based methods employed in shark spotting in Muizenberg Beach. It investigates Machine Learning methods for automated shark detection with the aim of enhancing human observation. A questionnaire and interview were used to collect information about shark spotting, the motivation of the a…
Generative AI boosts analyst reports but increases forecast errors.
problem Improving financial analyst reports with AI.
method Natural experiment using FactSet's AI platform.
result AI-assisted reports are more comprehensive but lead to higher forecast errors.
In some speaker recognition scenarios we find conversations recorded simultaneously over multiple channels. That is the case of the interviews in the NIST SRE dataset. To take advantage of that, we propose a modification of the PLDA model that considers two different inter-session variability terms. The first term is t…
New arithmetic phenomenon 'murmurations' detected using AI.
problem Detecting new arithmetic patterns in large datasets.
method Machine learning interpretability tools (PCA, saliency, convolutional filters).
result Murmurations encode Frobenius traces and connect to number theory.
Depression is a common mental disorder worldwide which causes a range of serious outcomes. The diagnosis of depression relies on patient-reported scales and psychiatrist interview which may lead to subjective bias. In recent years, more and more researchers are devoted to depression recognition in speech , which may be…
Framework enhances AI explainability by aligning with human cognitive models.
problem Lack of explainability in AI models hinders trust and accountability.
method Integrates explainability techniques with Malle's five category model of behavior explanation.
result Demonstrates practical relevance in credit risk assessment and regulatory analysis.
Classification tasks are common across many fields and applications where the decision maker's action is limited by resource constraints. In direct marketing only a subset of customers is contacted; scarce human resources limit the number of interviews to the most promising job candidates; limited donated organs are pr…
Recently, along with the emergence of food scandals, food supply chains have to face with ever-increasing pressure from compliance with food quality and safety regulations and standards. This paper aims to explore critical factors of compliance risk in food supply chain with an illustrated case in Vietnamese seafood in…
AI-assisted heart disease diagnosis reduces misdiagnosis and saves lives.
problem Misdiagnosis of heart disease leads to unnecessary deaths.
method Developed an AI application using ML and DNN algorithms on a dataset from the Cleveland Clinic Foundation.
result DNN model achieved a 92% accuracy rate, reducing misdiagnosis.
AI helps build particle physics theories more efficiently.
problem Building viable particle physics theories requires extensive effort and intuition.
method Developed AMBer, a reinforcement learning framework interacting with physics software.
result AMBer constructs viable models with fewer parameters, validating in neutrino theories.
Financial planners helped preserve and increase household net financial assets during the Great Recession.
problem Impact of financial planners on household net financial assets during the Great Recession.
method Utilized 2007-2009 Survey of Consumer Finances (SCF) panel dataset, analyzed 3,862 respondents.
result Starting to use a financial planner during the Great Recession had a positive impact on preserving and increasing household net financial assets.
Perceived personality traits attributed to an individual do not have to correspond to their actual personality traits and may be determined in part by the context in which one encounters a person. These apparent traits determine, to a large extent, how other people will behave towards them. Deep neural networks are inc…
We explore trust in a relatively new area of data science: Automated Machine Learning (AutoML). In AutoML, AI methods are used to generate and optimize machine learning models by automatically engineering features, selecting models, and optimizing hyperparameters. In this paper, we seek to understand what kinds of info…
Designing AI market for content creation
problem Balancing technological progress and individual incentives for content creation
method Dynamic Stackelberg game model
result Inducing greater reliance on AI-assisted creation
Corporate venture capital is in the midst of a renaissance. The end of 2015 marked all-time highs both in the number of corporate firms participating in VC deals and in the amount of capital being deployed by corporate VCs. This paper explores, rather than defines, how these firms find success in the wake of this sudde…