"AI enhances our performance, I have no doubt this one will do the same": The Placebo effect is robust to negative descriptions of AI

• DOI: 10.48550/arxiv.2309.16606
• Publication Date: 2024-05-11
• Authors: Agnes Mercedes Kloft; Robin Welsch; Thomas Kosch; Steeven Villa
• Keywords: FOS: Computer and information sciences; Artificial Intelligence (cs.AI); Artificial Intelligence; Computer Science - Artificial Intelligence; 05 social sciences; Computer Science - Human-Computer Interaction; Performance expectation; 0501 psychology and cognitive sciences; 16. Peace & justice; Placebo; Decision-making; Human-Computer Interaction (cs.HC)

Heightened AI expectations facilitate performance in human-AI interactions through placebo effects. While lowering expectations to control for placebo effects is advisable, overly negative expectations could induce nocebo effects. In a letter discrimination task, we informed participants that an AI would either increase or decrease their performance by adapting the interface, but in reality, no AI was present in any condition. A Bayesian analysis showed that participants had high expectations and performed descriptively better irrespective of the AI description when a sham-AI was present. Using cognitive modeling, we could trace this advantage back to participants gathering more information. A replication study verified that negative AI descriptions do not alter expectations, suggesting that performance expectations with AI are biased and robust to negative verbal descriptions. We discuss the impact of user expectations on AI interactions and evaluation and provide a behavioral placebo marker for human-AI interaction