Motion capture-based virtual reality sign language learning, testing and evaluating method

Abstract

The invention provides a motion capture-based virtual reality sign language learning, testing and evaluating method. According to the method, a motion comparison device is adopted to carry out datamation processing on a sign language session scene. The action comparison device comprises inertia action capture equipment, a data collector and a data comparison device. The inertial motion capture equipment comprises a plurality of data sensors. Each data sensor is bound and attached to a human body part of a session participant. When the sign language conversation scene is carried out, the data sensor records human body space movement information of the conversation participant to form conversation scene data and establishes a virtual reality scene by using the session scene data through a three-dimensional scene development platform. A sign language learner learns the sign language through the virtual reality scene. According to the invention, the action capture technology can be used torecord the sign language session scene and form the virtual scene. Therefore, the related functions of sign language learning, testing and sign language action evaluation are carried out by using thevirtual scene.

Description

technical field [0001] The invention relates to the technical field of teaching facilities, in particular to a virtual reality sign language learning, testing and evaluation method based on motion capture. Background technique [0002] Existing sign language teaching is mainly used to help the deaf to communicate, without using motion capture technology, and there is no related functions of sign language learning, testing and sign language movement evaluation. [0003] If language teaching can be carried out in conjunction with dialogue scenes, the quality of teaching will be effectively improved. Contents of the invention [0004] The present invention proposes a virtual reality sign language learning, testing and evaluation method based on motion capture, which can use motion capture technology to record sign language conversation scenes and form a virtual scene, thereby using the virtual scene to perform related functions of sign language learning, testing and sign lang...

AI Technical Summary

Problems solved by technology

[0002] Existing sign language teaching is mainly used to help the deaf to communicate, without the use of motion capture technology, and there is no related functions of sign language learning, testing and sign language movement evaluation

Images