DIGITAL LIBRARY
ASSESSING THE IMPACT OF PROMPTING TECHNIQUES ON SHORT-TERM CURRICULUM DESIGN: A COMPARATIVE APPROACH
1 Scheer School of Digital Sciences at Saarland University GmbH (GERMANY)
2 August-Wilhem Scheer Institut GmbH (GERMANY)
About this paper:
Appears in: ICERI2024 Proceedings
Publication year: 2024
Pages: 4865-4872
ISBN: 978-84-09-63010-3
ISSN: 2340-1095
doi: 10.21125/iceri.2024.1202
Conference name: 17th annual International Conference of Education, Research and Innovation
Dates: 11-13 November, 2024
Location: Seville, Spain
Abstract:
Since the public release of Large Language Models (LLMs) such as ChatGPT, the education landscape has witnessed groundbreaking innovations in personalized learning, automated content creation, and improved accessibility. Although previous research has explored generating curricula with GPT models, the methodology in AI-based curriculum generation remains insufficiently scientific. Therefore, this study explores the efficacy of two prompting techniques—Zero-Shot Role and Zero-Shot Chain-of-Thought (CoT)—in producing educationally sound curricula by comparing the time and iterations needed to create them. To determine curriculum quality, expert reviewers provided feedback using a curriculum evaluation rubric and semi-structured interviews. The CoT technique demonstrated greater efficiency, likely due to its step-by-step reasoning process, while the Role technique yielded more creative solutions but required more time and revisions. It is crucial to understand that the usefulness of both techniques varies depending on their context of use. Nevertheless, it is recommended that the design process be accompanied by an expert to enhance the quality of AI-generated curricula.
Keywords:
Learning plans Design, Curriculum Design, ChatGPT for Education Design, educational technology.