Stage performance assisted training method and system based on augmented reality technology

A technology of augmented reality and technology, applied in the input/output process of data processing, input/output of user/computer interaction, instruments, etc., can solve problems such as unfavorable correction of user actions

Active Publication Date: 2016-03-16
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF6 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing multi-view tracking display system lacks real-time detection of motion standards, which is not conducive to correcting the user's motion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stage performance assisted training method and system based on augmented reality technology
  • Stage performance assisted training method and system based on augmented reality technology
  • Stage performance assisted training method and system based on augmented reality technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the Some, but not all, embodiments are invented. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0021] see figure 1 , this embodiment discloses a stage performance auxiliary training method based on augmented reality technology, including:

[0022] S1. Use the first camera and the second camera to respectively collect real scene images within the field of view of the left and right eyes of the user wearing the wearable display helmet, and use the infrared depth c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a stage performance assisted training method and system based on augmented reality technology, which are able to detect the standard of an action of a user. The method comprises: respectively acquiring real scene images within view field ranges of a left eye and a right eye of a user wearing a wearable display helmet by using a first camera and a second camera, and acquiring depth image data of the user by using an infrared depth camera for fixing a third view angle; extracting the image data of the user and position data of skeleton joint points of the user; fusing the real scene image with the image data and a preset image of an operator to obtain a fusion image; by utilizing preset position data of skeleton joint points of the operator and the position data of the skeleton joint points of the user, detecting whether the action of the user is standard, and when the action of the user is nonstandard, carrying out marking on a corresponding position of the fusion image; and synchronously displaying the fusion image in a first eyepiece and a second eyepiece of the wearable display helmet in modes which are respectively suitable for left and right eyes to view.

Description

technical field [0001] The present invention relates to the field of augmented reality technology, in particular to a stage performance auxiliary training method and system based on augmented reality technology. Background technique [0002] Augmented reality technology can superimpose and fuse computer-generated two-dimensional or three-dimensional digital information into the real environment, thereby enhancing the user's perception ability in the real environment and deepening the immersive experience. The main features of augmented reality technology are fixed-point tracking and capture, fusion of virtual and real objects, and real-time behavior interaction. At present, augmented reality technology is widely used in the field of motion assistance training. By moving the video display mode of the tracking camera, the user can observe the motion correction of self-training from the third perspective. This method can get rid of the limitations of self-perspective observatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/011G06F2203/012G06V40/23
Inventor 张睿闫烁关正张龙飞李红松丁刚毅黄天羽李立杰李鹏
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products