Somatosensory operation method and system based on virtual reality

An operation method and technology of an operating system, applied in the field of somatosensory operation methods and systems based on virtual reality, can solve problems such as the uselessness of three-dimensional gestures and the lack of a complete definition.

Inactive Publication Date: 2011-10-26
BEIJING NUFRONT MOBILE MULTIMEDIA TECH
View PDF0 Cites 66 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the tracking and detection technology for the main parts of people is developing, and there are preliminary results in the detection of basic human body movements. However, there is no complete definition of gestures in three-dimensional space, and this three-dimensional gestures have not been used in virtual reality.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Somatosensory operation method and system based on virtual reality
  • Somatosensory operation method and system based on virtual reality
  • Somatosensory operation method and system based on virtual reality

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0109] Users control outside the virtual scene, such as watching artworks, electronic maps, and industrial equipment simulation under virtual reality.

[0110] The definition of 3D gesture action and the operation on the virtual scene are as follows:

[0111] 1. Raise the hand: the control is activated, and the virtual scene changes with the gesture.

[0112] 2. Palm zooming in: Zooming in with the palm along the line of sight, the scene is zoomed in at this time, zooming in on an object, that is, the vision is zoomed in, and the field of view becomes smaller at this time, which is suitable for observing a certain detail. Gestures and scene changes such as figure 2 shown.

[0113] 3. Palm zooming out: Pushing the palm along the direction of the line of sight, the scene zooms out, the field of vision expands, and the object shrinks. Gestures and scene changes such as figure 2 shown.

[0114] 4. Palm translation: move the palm in any direction on the plane perpendicular t...

specific Embodiment 2

[0122] The user is in the virtual scene, and any operation is centered on the user's eyes. Such as browsing bedrooms, playing virtual tourist attractions, 3D online games, etc. The definition of 3D gesture action and the operation on the virtual scene are as follows:

[0123] 1. Initialization, the user's perspective is at a certain position in the virtual scene. Lift your hand to activate the virtual scene controls. The scene seen is as Figure 8 shown.

[0124] 2. Pull the palms closer and push the palms farther away, and perform zoom-in and push-out operations on the virtual scene, that is, people move forward and backward along the line of sight at a certain position. Such as Figure 9 shown.

[0125] 3. The hand translates in a plane perpendicular to the line of sight. Gestures and scene changes such as Figure 10 shown.

[0126] 4. Move the hand in an arc on the plane perpendicular to the line of sight, and perform two-dimensional rotation on the virtual scene, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a somatosensory operation method and system based on virtual reality, wherein the various operations of hands in a three-dimensional space are detected by a three-dimensional gesture detection technology, thereby designing the mappings between the three-dimensional gestures and three-dimensionally displayed virtual reality changes; the method and system aim at causing people to execute various three-dimensional gesture actions in a real space, and the three-dimensionally displayed virtual reality correspondingly changes according to the actions so that people can feel an effect of having a first-hand experience to the virtual reality.

Description

technical field [0001] The invention belongs to the field of electronic equipment operation control technology and human-computer interaction technology, and in particular relates to a somatosensory operation method and system based on virtual reality. Background technique [0002] The iPoint3D system developed by the Heinrich-Hertz Institute of the Fraunhofer Institute for Communication in Germany, its function is to use gestures to operate the 3D image on the 3D display that displays the 3D image stereoscopically. For the iPoint3D system in Germany, it mainly uses 3D gestures to manipulate 3D displayed pictures. There are some problems in it. These pictures have no 3D relationship with each other. Gesture operations on pictures include simple 2D operations such as zooming in, zooming out, and moving. Some actions require both hands to complete. [0003] At present, the tracking and detection technology for the main parts of people is developing, and there are preliminary ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
Inventor 程懿远胡洪磊颜世聪王嘉鲍东山
Owner BEIJING NUFRONT MOBILE MULTIMEDIA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products