Emotion interaction based Peking Opera teaching system

A teaching system and Beijing opera technology, applied in the field of somatosensory interaction, can solve problems such as reduced matching accuracy, inability to filter, and rigid model movement, so as to reduce the probability of misidentification, improve user experience, and improve accuracy.

Inactive Publication Date: 2016-10-12
XIDIAN UNIV
View PDF0 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The amount of data per second of the existing skeletal joint point capture technology is constant. When the user’s limbs move too fast, the received skeletal joint point data jumps greatly in the three-dimensional space, and some model rendering and smoothing algorithms cannot quickly Handle this well, resulting in stiff model motion or frame skipping
The main disadvantage of existing gesture recognition algorithms is that the recognition success rate and accuracy are low. When the user's gestures are too complex or have a high similarity, the existing algorithms cannot distinguish the differences between different g

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion interaction based Peking Opera teaching system
  • Emotion interaction based Peking Opera teaching system
  • Emotion interaction based Peking Opera teaching system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] figure 1 It is a structural diagram of the system module of the present invention, such as figure 1 As shown, the present invention relates to a Peking Opera teaching system based on somatosensory interaction, including a data collection module, a data processing module and a user interface interaction module. Data communication between somatosensory interactive software loaded on Windows or Microsoft XBOX platform;

[0043] The data processing module realizes the user's logical control of the system through the gesture recognition algorithm; in the performance scene, obtains the user's joint data, displays the user model synchronized with the user's action, and performs the matching and feedback between the Peking Opera standard model and the user model; obtains the user's voice Data, for matching and feedback of standard vocals and user audio;

[0044] The user interface interaction module performs operation interface display and switching, Peking Opera teaching vid...

Embodiment 2

[0050] figure 2 Scoring flowchart for the matching of action performance and audio, such as figure 2 As shown, in the data acquisition module, the user's joint information and voice information are obtained through hardware devices for subsequent data processing.

[0051] Obtaining joint information: Through the Kinect somatosensory interaction system, 20 joint positions and rotation parameters of the user's human body can be obtained in real time.

[0052] Obtain audio information: wear a wireless headset for the user, and install an audio receiver on the PC to obtain the user's singing voice data.

[0053] In the data processing module, the data obtained by the data acquisition module is processed, and the user's logic control of the system is realized through the gesture recognition algorithm. In the performance scene, the system automatically obtains the user's joint data and displays the Peking Opera model synchronized with the human body model. , while performing the...

Embodiment 3

[0112] In the user interface interaction module of the present invention, the calculation result of the data processing module is obtained, and the corresponding interaction information is displayed on the screen. Includes the following functions (a) to (h).

[0113] (a) Interface display and switching

[0114] When the user enters the system, the interface is switched through the judgment result of gesture recognition to complete the logical control of the system. The system has single-person mode, double-person mode, etc.

[0115] (b) Simultaneous display of Peking Opera models

[0116] Through the motion rendering and smoothing of Peking Opera models, the Peking Opera models are displayed in real-time synchronization with the user.

[0117] (c) Model Correction Tips

[0118] The feedback vector is obtained through the matching result of the standard model and the user model, and the feedback vector is drawn in the three-dimensional space and displayed on the screen.

[01...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A Peking Opera teaching system based on somatosensory interaction, including a data acquisition module, a data processing module and a user interface interaction module. The data acquisition module obtains the user's joint information and sound data through the somatosensory interaction device; the data processing module realizes the user's logical control of the system Display the user model synchronized with the user's actions, perform matching and feedback between the Peking Opera standard model and the user model, obtain user voice data, and perform matching and feedback between the standard singing voice and the user's audio; the user interface interaction module performs the operation interface through the recognition of user gestures Display and switching, Peking Opera teaching video display, action performance evaluation display and audio scoring display. The Beijing opera teaching system of the present invention operates through somatosensory operation throughout, has a high recognition rate, and does not need a keyboard or a mouse as inputs. The user model has a high synchronization rate with the actual user posture, and there is no jitter, frame skipping phenomenon, and it is not affected by the hardware limitation of sensory capture and the environmental noise during bone tracking.

Description

technical field [0001] The invention relates to the field of somatosensory interaction, in particular to a Beijing opera teaching system based on somatosensory interaction. Background technique [0002] Peking Opera is the quintessence of China and represents the traditional culture of the Chinese nation. It is of far-reaching significance to inherit and carry forward Peking Opera. However, the teaching process of Peking Opera is relatively complicated. Each link of singing, reciting, sitting, and playing requires corresponding special teaching steps. Many factors lead to the high cost of teaching Peking Opera, which is not conducive to the inheritance and development of traditional culture such as Peking Opera in the younger generation. [0003] The Peking Opera teaching system is mainly divided into two parts: body posture teaching and singing tone teaching. The related technologies mainly include 3D model rendering and smoothing technology, gesture recognition technology...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06Q50/20
CPCG06F3/011G06F3/017G06Q50/205
Inventor 王佳悦郭宗义黄辉煌范友强
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap