Method and system for visualizing real hand of participant in helmet-type virtual reality environment

A virtual reality, helmet-like technology, applied in mechanical mode conversion, user/computer interaction input/output, image data processing, etc. Achieve the effect of efficient and stable image segmentation algorithm and realistic stereo vision images

Active Publication Date: 2010-06-09
CHINA SIMULATION SCI CO LTD
View PDF1 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] 1. The shape of the real hand is complex, and it is difficult to achieve accurate geometric modeling. With the improvement of the fidelity of the model, the number of polygons will also increase, the burden on the system will increase, and the real-time performance will also decrease
[0004] 2. It is difficult to achieve the texture characteristics consistent with the real hand, and the visual effect is not good
[0005] 3. The difference in human hands is not considered. The general three-dimensional hand model represents the hands of different people, and the visual effect is not good
[0006] 4. Due to the errors of virtual peripherals such as data gloves and hardware delays, it is impossible to completely match the movements of the real hand and the virtual hand, and the hardware cost is also very high
[0007] 5. Virtual reality peripherals such as data gloves have a sense of foreign body and restraint, etc.
[0009] In the augmented reality flight simulator based on multiple fixed cameras (application number: 200710303603.9), what the head-mounted display shows is also the image after virtual-real fusion, but in its system, multiple cameras fixed above the head are used to shoot the real scene, and The image taken is directly integrated into the virtual environment, so it is different from the layout scheme and technical scheme of the camera of the present invention

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for visualizing real hand of participant in helmet-type virtual reality environment
  • Method and system for visualizing real hand of participant in helmet-type virtual reality environment
  • Method and system for visualizing real hand of participant in helmet-type virtual reality environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Below in conjunction with accompanying drawing, the technical scheme of invention is described in detail:

[0026] Such as figure 1 As shown, the visualization system of the actual hand of the participant in the helmet-mounted virtual reality environment includes a computer, a helmet-mounted display, a camera and a video acquisition device, where the camera is set on the helmet-mounted display, such as figure 2 As shown, the output end of the camera is connected to the input end of the computer after being connected to the video acquisition device in series, and the output end of the computer is connected to the input end of the head-mounted display.

[0027] Taking the semi-virtual reality cockpit system as an example, the present invention constructs a virtual hand visualization example. The semi-virtual reality cockpit system consists of a helmet display, a semi-physical cockpit, a computer and video acquisition equipment. The system composition and principle are a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for visualizing a real hand of a participant in a helmet-type virtual reality environment. The method comprises the following steps of: initializing and realizing virtual and real rectification; calibrating a real camera to obtain real camera parameters comprising a real camera space position, a horizontal viewing field angle and a vertical viewing field angle, and maintaining a virtual camera of a viewpoint position in the virtual environment to be consistent with the real camera parameters; partitioning a hand image, wherein video acquisition equipment acquires a video image shot by the real camera, and a computer carries out skin color detection on each frame of the acquired video image to realize separation of the hand image and the background; fusing virtuality and reality; and fusing the separated hand image into the virtual environment in real time by a dynamic vein mapping method to realize the seamless fusion of a virtual image. The system comprises a computer, a helmet display, the camera and the video acquisition equipment. The invention is efficient and stable and can obtain a vivid stereoscopic vision image.

Description

technical field [0001] The present invention relates to a method and system for visualizing the actual hand of a participant in a helmet-mounted virtual reality system. In the method, a camera is installed in the helmet-mounted display, and video image processing technology and virtual reality graphics technology are comprehensively used to realize real-time segmentation of hand images and Integrating into the virtual environment, it can provide users with realistic and three-dimensional virtual hand visualization images to meet the requirements of human-computer interaction. Background technique [0002] In the closed virtual reality system based on the head-mounted display, the visualization of the virtual hand is an important factor to ensure the user's immersion. Foreign experiments show that the most concerned question of novice users in the virtual environment is: "Where is my hand?" [1]. The quality of the visualization effect will also directly affect the user's vis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T7/00
Inventor 顾宏斌汤勇吴东苏
Owner CHINA SIMULATION SCI CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products