Transforming Student Revision: The Pedagogical Potential of Generative AI

Fergus, Suzanne and Flanagan, Campbell (2026) Transforming Student Revision: The Pedagogical Potential of Generative AI. Journal of Chemical Education. ISSN 0021-9584
Copy

The ability and pedagogical potential of ChatGPT, Google Gemini, and Claude AI to create study notes and practice questions were evaluated using undergraduate pharmaceutical science lecture content. A mixed methods approach examined quantitative metrics such as comprehensiveness scores as well as qualitative aspects including accuracy and clarity. Both basic and complex input prompts were used, and a measure of how these models processed different data formats in the form of visual lectures, statistical content, and descriptive teaching formats was also included. All demonstrated potential, yet their performance differed depending on the specific task and type of content. Claude AI produced study notes that were highly reliable, showed high comprehensiveness scores between 0.75 and 1.0. ChatGPT demonstrated exceptional ability to create practice questions at multiple cognitive levels whereas Google Gemini performed better with detailed prompts but faced difficulties with mathematical questions. The study demonstrated that detailed prompting led to higher output quality across all systems especially in generating practice questions at higher cognitive levels. Generative AIs prove to be beneficial educational resource creation tools when their specific attributes and constraints are considered. Their effectiveness depends on the task and subject matter, demonstrating that they work best when used as supplementary tools instead of standalone solutions. This research study advances knowledge about successful Generative AI integration in higher education and identifies areas needing additional development.

mail Request Copy

picture_as_pdf
GenAI_JCE_paper_Final.pdf
subject
Submitted Version
lock_clock
Restricted to Repository staff only until 2 September 2027
copyright
Available under Unspecified

Request Copy

EndNote BibTeX Reference Manager Refer Atom Dublin Core Data Cite XML HTML Citation MPEG-21 DIDL OpenURL ContextObject in Span OpenURL ContextObject ASCII Citation METS OPENAIRE RIOXX2 XML MODS
Export

Downloads