Real time human-machine interaction method and system based on augmented virtual reality and anomalous screen

A method of human-computer interaction and enhanced virtual technology, which is applied in the field of real-time human-computer interaction to achieve a strong real-time effect

CN101539804AInactive Publication Date: 2009-09-23SHANGHAI UNIV
6 Cites 76 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2009-09-23
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a real time human-machine interaction method and a system based on augmented virtual reality and anomalous screen. The method comprises the following operation steps: 1) modeling is carried out on virtual objects to be interacted and statistical average hand model ; 2) video acquisition is carried out on hand by N cameras to obtain original image; 3) processing is carried out in a computer. The system comprises a system for realizing real time transparent strengthened display, algorithm and system of real time false or true grasping and parabolic motion detection and real time parabolic animation generating , and real time multi-anomalous screens interactive system. A whole set of large special effect is constructed by various false or true conversion in large anomalous screen scene, three-dimensional animation or three-dimensional image of interactive content expressed in solid spectacles, additionally, video / audio devices, light control devices and the like.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to a real-time human-computer interaction method and system of virtual reality, in particular to a real-time human-computer interaction technology method and system of augmented virtual reality and a special-shaped screen. Background technique

[0002] Augmented Reality (AR---Augmented Reality) system is to put VR in the real environment to check. Judging from the current development trend, this virtual experience combined with the actual environment is one of the most effective implementation technologies for the development of virtual reality technology. Foreign countries are still leading in the research and application of AR technology, and have a number of intellectual property rights and technical standards in technology. Countries such as the United States, Europe, and Japan have made many breakthroughs in the key technologies of AR, and have design and manufacturing capabilities in key equipment, and have achieved expecte...

Examples

Embodiment Construction

[0039] A preferred embodiment of the present invention is: with reference to figure 1 The operation steps of this real-time human-computer interaction method based on augmented virtual reality and special-shaped screen are as follows:

[0040] 1 Realize real-time light transmission enhanced display: After the original image of the human hand is segmented, three-dimensional reconstruction is performed, converted to the same coordinate system as the virtual object, and collision detection is performed; firstly, the bounding box method is used for rough detection, If there is a collision, it will be accurately detected, and the artificial immune system method will be used for accurate detection to achieve fast virtual and real collision detection; the virtual model after the collision will be deformed, registered and displayed on the light-transmitting helmet-mounted display;

[0041] 2 Real-time virtual and real grasping, parabolic motion detection and real-time parabolic anima...