Funded by Microsoft
This research project explores the dynamics of human-AI collaboration in problem-solving and creative thinking tasks. We will extend prior Human-Autonomy Teaming research that studies human-AI teams with the Wizard-of-Oz methodology’s help by replacing a human confederate with an LLM-powered AI teammate. The experiment involves manipulating task types and AI teammate functions to examine how people orient themselves toward intelligent machine teammates and how technology can be designed to be a collaborator, not a chatbot. Participants will communicate in a group chat environment while conducting tasks, and their experiences, performance, and social interactions will be surveyed, analyzed, and compared to identify the mechanisms of high-performing Human-AI teams.
Suschevskiy, V., Javalagi, A., Sean, F., Hoshi, F., Cueva, X. L., Garcia, J., DeChurch, L., & Contractor, N. (2023, November). Approaches to Investigating Human-AI Teams: Transition from the Wizard of Oz to LLM-Powered Agents. Presented at 2023 Conference on Digital Experimentation @ MIT (CODE@MIT).