Evidence validity of multiple-choice questions designed with Microsoft Bing (Copilot)
- ,
- Ramón Ruesta-Bermejo,
- Carlos Gutierrez-Rios,
- Carlos Ramos-Godoy,
- Brayan Miranda-Chávez,
- Cesar Copaja-Corzo
- ,
- Usamedic SCRL,
- Universidad Privada San Juan Bautista,
- Universidad Privada de Tacna,
- Universidad San Ignacio de Loyola,
- Hospital Nacional Edgardo Rebagliati Martins, EsSalud
Open access
Publication Information
Output type
Original language
EnglishArticle number
100950Journal (Volume, Issue Number)
Educacion Medica (Volume 25, Issue 6)Publication milestones
- Published - 01/11/2024
Publication status
ISSN
1575-1813Publication IDs
- Scopus: 85196497818
Abstract
Introduction: To design multiple-choice questions (MCQs) using Microsoft Bing (Copilot) and evaluate their quality and psychometric indices in medical education. Materials and methods: A 180-question exam was designed using Microsoft Bing. It was evaluated by medical educators in terms of relevance and distractor quality. After administering the exam to students, difficulty and discrimination indices were calculated. Results: Most questions were highly relevant, and the distractors were of high quality. The discrimination and difficulty indices were acceptable for the majority of the questions. Conclusion: Microsoft Bing (Copilot) could be used as a substitute for ChatGPT in designing MCQs, given the evidence of validity collected in the study.