Single depth map-based human body joint point recognition method for virtual reality

A technology of human body joints and virtual reality, applied in the field of human-computer interaction, can solve the problems of a large amount of memory and time, occupy a large amount, and the application program is not practical, and achieve the effect of ensuring the recognition rate, improving the real-time speed, and overcoming the difficulty of recognition.

Active Publication Date: 2018-11-02
ZHEJIANG UNIV OF TECH
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, using multiple ConvNets requires a lot of memory and time, which is not practical for applications, especially virtual reality applications that require a lot of computer resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single depth map-based human body joint point recognition method for virtual reality
  • Single depth map-based human body joint point recognition method for virtual reality
  • Single depth map-based human body joint point recognition method for virtual reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The present invention will be further elaborated and illustrated below in conjunction with the accompanying drawings.

[0041] like figure 1 As shown in Fig. 1, the human body joint point recognition method based on a single depth image for virtual reality includes two stages: the human body joint point detection stage and the human body pose recognition stage.

[0042] The human joint point detection stage includes the following steps:

[0043] Step 1: Use kinectV2 depth camera to capture depth image frame D 1 (resolution is

[0044]512×424), specifies the time to wait for the next frame of depth image data, according to the binary image detection of the human body, if there is a human body, enter step 2, otherwise transfer to the next frame.

[0045] Step 2: To Image D 1 Perform a median filter D 2 (x,y)=med{D 1 (x-k,y-l)}(k,l∈W), where W represents the two-dimensional filter template, k represents the length of the template, l represents the width of the templ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a single depth map-based human body joint point recognition method for virtual reality. The method comprises: training a gesture public data set NYU in an offline manner by using a convolutional network to obtain a model with good robustness, high accuracy and a fast recognition speed; and capturing a depth image in real time by using a depth camera, after performing a series of preprocessing on the image, transmitting the preprocessed image to a human bone recognition module and a gesture recognition module respectively, returning recognized joint point three-dimensional information, and mapping a three-dimensional human body model. The method disclosed by the present invention has good interactive functions in the virtual reality environment, and has goodperformance in the recognition rate, the operation speed, universality, accuracy, and the like.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a virtual reality-oriented human body joint point recognition method based on a single depth map. Background technique [0002] Virtual reality is a computer system that can create and experience a virtual world, providing users with highly immersive human-computer interaction and image presentation. Since the experience of immersive virtual reality needs to wear a head-mounted display device (HMD), the line of sight is blocked, so the traditional keyboard and mouse interaction is no longer applicable. The new form of human-computer interaction is one of the core technologies of virtual reality. It is still human body posture and gestures. Existing hardware devices on the market include leap motion, handles, gloves and other devices. Additional interactive devices not only increase the hardware cost, but also increase the connection line to further...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06K9/46G06K9/00G06N3/04
CPCG06V40/10G06V10/443G06N3/045G06F18/24G06F18/214
Inventor 卢书芳蔡历丁雪峰高飞毛家发
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap