CCESK: A Chinese Character Educational System Based on Kinect

Yang Yang, Howard Leung, Hubert P. H. Shum, Jiao Li, Lanling Zeng, Nauman Aslam and Zhigeng Pan
IEEE Transactions on Learning Technologies (TLT), 2018

 Impact Factor: 3.7 Top 25% Journal in Education & Educational Research

CCESK: A Chinese Character Educational System Based on Kinect


In this paper, a Chinese character educational system based on Kinect is proposed for guiding beginners to learn the basics of Chinese characters in a more intuitive way. It extracts 19 common components, denoted as alphabets, from Chinese characters. 19 postures were designed according to the shapes of these alphabets. Instead of memorizing Chinese characters through repetitive copying, students can first associate an alphabet with the corresponding designed posture. Then they break down a Chinese character into a set of alphabets in order to perform the sequence of corresponding postures so that they can easily remember the whole character. Our proposed system contains 2 major functions: 1) the learning function that is responsible for delivering the courseware, and 2) the testing function that is used to let students acquire their learning progress through some tests. A rule-based algorithm is designed to recognize the students' input postures captured from the Kinect motion sensor so as to determine whether the students have performed the correct postures. We conducted a survey which involved 90 students to try our proposed system as well as two other learning modes for comparison. Moreover, we have interviewed those 30 students who had tried our proposed system with some open-ended questions. The positive results show that the proposed system can promote students' experiences in learning Chinese characters.





 author={Yang, Yang and Leung, Howard and Shum, Hubert P. H. and Li, Jiao and Zeng, Lanling and Aslam, Nauman and Pan, Zhigeng},
 journal={IEEE Transactions on Learning Technologies},
 title={CCESK: A Chinese Character Educational System Based on Kinect},


AU  - Yang, Yang
AU  - Leung, Howard
AU  - Shum, Hubert P. H.
AU  - Li, Jiao
AU  - Zeng, Lanling
AU  - Aslam, Nauman
AU  - Pan, Zhigeng
T2  - IEEE Transactions on Learning Technologies
TI  - CCESK: A Chinese Character Educational System Based on Kinect
PY  - 2018
VL  - 11
IS  - 3
SP  - 342
EP  - 347
DO  - 10.1109/TLT.2017.2723888
SN  - 1939-1382
ER  - 

Plain Text

Yang Yang, Howard Leung, Hubert P. H. Shum, Jiao Li, Lanling Zeng, Nauman Aslam and Zhigeng Pan, "CCESK: A Chinese Character Educational System Based on Kinect," IEEE Transactions on Learning Technologies, vol. 11, no. 3, pp. 342-347, IEEE, 2018.

Supporting Grants

The Royal Society
An Affective Smart Environment for Personalized Learning and Teaching
Royal Society International Exchanges (Ref: IE160609): £11,841, Principal Investigator ()
Received from The Royal Society, UK, 2017-2019
Project Page

Similar Research

Meng Li, Howard Leung and Hubert P. H. Shum, "Human Action Recognition via Skeletal and Depth Based Feature Fusion", Proceedings of the 2016 ACM International Conference on Motion in Games (MIG), 2016
Shanfeng Hu, Worasak Rueangsirarak, Maxime Bouchee, Nauman Aslam and Hubert P. H. Shum, "A Motion Classification Approach to Fall Detection", Proceedings of the 2017 International Conference on Software, Knowledge, Information Management and Applications (SKIMA), 2017
Zhengzhi Lu, He Wang, Ziyi Chang, Guoan Yang and Hubert P. H. Shum, "Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed Gradient", Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023



Last updated on 4 June 2024
RSS Feed