Welcome to Scholar Publishing Group

International Journal of Educational Curriculum Management and Research, 2023, 4(3); doi: 10.38007/IJECMR.2023.040309.

Multimodal Music Teaching Mode Based on Human-computer Interaction Technology


Yanfang Ou

Corresponding Author:
Yanfang Ou

Philippine Christian University, Manila, Philippines


Music teaching is an activity completed by both "teaching" and "learning". Therefore, whether the two sides of the teaching can achieve close communication and cooperation has become a very important factor in determining the quality and efficiency of music course teaching. The multi-modal teaching mode integrates multiple modes, fully mobilizes students' various senses, attracts students' attention, makes students more relaxed and easy to grasp and understand the knowledge they have learned, and achieves better teaching effects. In the multimodal music teaching class, teachers make full use of ppt courseware to play audio and video, display pictures and tables, use artistic words, font colors and underlines, and use rich body language to enable students to learn language and music knowledge in vivid teaching activities. Human-Computer Interaction is a key technology in the field of virtual reality. Its main purpose is to improve the interaction between the user and the computer from the user's point of view, thereby increasing the immersion and authenticity of the system. In human-computer interaction, human behavior recognition is a very critical technology, which helps human beings to achieve a natural and harmonious state of human-computer interaction. This paper studied the multimodal music teaching model based on Kinect somatosensory technology. It was found that most of the indicators of the experimental class using the multimodal music teaching model are better than the control class, and the average scores of the experimental class are all more than 85.5. It showed that the use of multimodal teaching mode to teach can enhance students' classroom participation, help students understand and memorize knowledge, and stimulate students' interest in learning.


Multimodal Teaching Mode, Human-Computer Interaction Technology, Music Teaching, Kinect Somatosensory Technology

Cite This Paper

Yanfang Ou. Multimodal Music Teaching Mode Based on Human-computer Interaction Technology. International Journal of Educational Curriculum Management and Research (2023), Vol. 4, Issue 3: 83-97. https://doi.org/10.38007/IJECMR.2023.040309.


[1] Fortuna S. Embodiment, sound and visualization: A multimodal perspective in music education. Zbornik Akademije umetnosti, 2017, 2017(5):120-131.

[2] Huang R. A Study on Multimodal Teaching Mode for Adult English Learners under Epidemic Situation. Open Journal of Modern Linguistics, 2020, 10(4):366-374.

[3] Lin W. Design research of english multimodal teaching system based on "internet". Revista de la Facultad de Ingenieria, 2017, 32(13):406-411.

[4] Shustrova E V., Checkletsova E I., Volkova L E. Teaching English by means of comic multimodal texts. XLinguae, 2017, 10(4):34-47.

[5] Yu F X., Suo Y N. Application of gesture recognition based on the somatosensory kinect sensor in human-computer interaction framework. Revista de la Facultad de Ingenieria, 2017, 32(10):580-585.

[6] Liang W. Scene art design based on human-computer interaction and multimedia information system: an interactive perspective. Multimedia Tools and Applications, 2019, 78(4):4767-4785.

[7] GAO, Yongqiang, LU. Vision-Based Hand Gesture Recognition for Human-Computer Interaction——A Survey. Wuhan University Journal of Natural Sciences, 2020, v.25; No. 130(02):82-97.

[8] Chen, Minghui. Multimodal Analysis in Academic Settings: From Research to Teaching. VISUAL COMMUNICATION, 2018, 17(4):475-478.

[9] Liu H., Jiang Y. Study on the multimodal teaching exploration of English and American literature course based on the internet plus background. Boletin Tecnico/Technical Bulletin, 2017, 55(19):110-116.

[10] Huang S Y. A critical multimodal framework for reading and analyzing pedagogical materials. English Teaching: Practice and Critique, 2019, 18(1):52-69.

[11] Kong W. Digital media art design based on human-computer interaction technology in the background of big data. Revista de la Facultad de Ingenieria, 2017, 32(14):485-489.

[12] Jing Y. Research on fuzzy English automatic recognition and human-computer interaction based on machine learning. Journal of Intelligent and Fuzzy Systems, 2020, 39(4):5809-5819.

[13] Hamond L., Himonides E., Welch G. The nature of feedback in higher education studio-based piano learning and teaching with the use of digital technology1. Journal of Music Technology and Education, 2020, 13(1):33-56.

[14] Jing C. Application and research on computer aided technology in the new music teaching method. IPPTA: Quarterly Journal of Indian Pulp and Paper Technical Association, 2018, 30(7):301-306.

[15] Arc S. Computer-Assisted Musicteachingin Music Teacher Education Departments: Marmara University Sample. Educational Policy Analysis and Strategic Research, 2018, 13(1):71-80.

[16] Moore D. Supporting students in music technology higher education to learn computer programming. Journal of Music, 2017, 7(1):75-92(18).

[17] Li F. Study on the interactive creation of computer assisted music teaching. Boletin Tecnico/Technical Bulletin, 2017, 55(14):685-691.

[18] Jin C. Analysis of music teaching mode innovation based on intelligent classroom and multimedia system. Revista De La Facultad De Ingenieria, 2017, 32(1):534-543.

[19] Chi X. Study on vocal music teaching innovation mode based on computer simulation and voice spectrogram analysis. Revista de la Facultad de Ingenieria, 2017, 32(16):400-406.

[20] Jing Y., Guo S., Wu X. Vocal music teaching mode based on a computer platform. Agro Food Industry Hi Tech, 2017, 28(1):2200-2204.

[21] Kuang H. Research on Multimedia Music Teaching Based on Modern Multimedia Equipment. Revista De La Facultad De Ingenieria, 2017, 32(3):166-172.