摘要
Instructors' speech and gestures are tightly integrated. However, little is known about the neural mechanisms by which different types of gestures affect learning. We conducted two experiments on the effects of gestures in video lectures that included an instructor and slides, with English vocabulary as the topic. In Experiment 1, we manipulated the instructor's gestures (beat gestures vs. pointing gestures vs. depictive gestures) on neural oscillations and learning performance. The electroencephalogram results showed that students had higher alpha power and higher beta power when the instructor used pointing gestures, suggesting lower sensorimotor involvement in processing. Pointing gestures produced lower learning performance than beat gestures and depictive gestures. In Experiment 2, we manipulated the instructor's pointing gestures and the richness of visual materials in video lectures. The results showed that the effectiveness of pointing gestures was moderated by the richness of the visual materials on the slide. Specifically, pointing gestures were more effective for complex versus simple learning materials. The findings suggest that electroencephalogram oscillations and learning performance vary with the type of gesture the instructor uses and the richness of visual materials in video lectures. This study has applied value for designing effective video lectures in many disciplines: (1) When a video lecture includes simple visual materials, a beat gesture and depictive gesture would be better; (2) when a video lecture includes complex visual materials, the instructor can produce pointing gestures to single out the learning content they are talking about. Practitioner notes What is already known about this topic Instructors commonly produce gestures while they teach, and their gestures and speech are tightly integrated. Instructors often use three types of gestures: beat gestures, pointing gestures and depictive gestures. Different types of gestures influence learning via different neural mechanisms. What this paper adds Students' alpha power and beta power had lower amplitudes when observing an instructor's beat gestures, compared to pointing and depictive gestures. Students showed higher learning performance after viewing the video lectures with the instructor's beat and depictive gestures. An instructor's pointing gestures facilitated learning performance primarily in video lectures with complex visual materials (CVM) rather than simple visual material (SVM). Implications for practice and/or policy When a video lecture includes SVM, the instructor is encouraged to produce beat gestures and depictive gestures rather than pointing gestures. When a video lecture includes CVM, the instructor is encouraged to produce pointing gestures to single out the learning content they are talking about.
学科与关键词
- Complexity of visual learning material moderates the effects of instructor's beat gestures and head nods in video lecturesPi, Zhongling; Zhu, Fangfang; Zhang, Yi; Chen, Louqi; Yang, Jiumin*Learning and Instruction, 2022, 77: 101520.被引 10
- An instructor's beat gestures facilitate second language vocabulary learning from instructional videos: Behavioral and neural evidencePi, Zhongling; Zhu, Fangfang; Zhang, Yi; Yang, Jiumin*Language Teaching Research, 2021, 13621688211039023.被引 8
- Do adults and children learn differently from video lectures with an instructor's deictic gestures?Yang, Jiumin; Zhu, Fangfang; Jiang, Yirui; Pi, Zhongling*Education and Information Technologies, 2023, 28(7): 8377-8400.被引 1
