Remote live-action augmented reality method based on VR head-mounted display device

A display device and augmented reality technology, applied in the field of virtual reality, can solve the problems of inability to superimpose virtual models, limited effective transmission distance, weak immersion, etc., to enhance user immersion, improve clarity, and have broad application prospects. Effect

Active Publication Date: 2021-07-09
QINGDAO RES INST OF BEIHANG UNIV
View PDF15 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a remote real scene augmented reality method based on a VR head-mounted display device, which overcomes the fact that the existing VR live broadcast software can only passively watch the pushed live broadcast images , Inability to superimpose virtual models, low image quality, poor sense of immersion, limited effective transmission distance, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote live-action augmented reality method based on VR head-mounted display device
  • Remote live-action augmented reality method based on VR head-mounted display device
  • Remote live-action augmented reality method based on VR head-mounted display device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The technical characteristics of the present invention will be further elaborated below in conjunction with specific embodiments.

[0058] see figure 1 As shown, the present invention proposes a remote real-scene augmented reality method based on a VR head-mounted display device, and the hardware for realizing the remote real-scene augmented reality method based on a VR head-mounted display device of the present application mainly includes a remote end, a client, and a cloud server. The major components are described in turn below.

[0059] At the remote end, the external camera robot is used for real-time acquisition of real-scene video, depth calculation, scene construction, virtual-real fusion and wireless transmission, which is responsible for completing image 3 Step S100, step S200 and step S300. For the structural diagram of the peripheral robot, see figure 2 As shown, it is composed of a binocular camera, a two-degree-of-freedom platform, a computing communi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a remote live-action augmented reality method based on VR head-mounted display equipment, and the method comprises the following steps: S100, collecting a remote live-action video in real time at a far end through employing camera equipment, and obtaining the remote live-action video of a far-end scene, performing depth calculation on the obtained remote live-action video to obtain depth information of the remote live-action video; S200, constructing a scene structure according to the depth information of the remote live-action video obtained in the step S100, and fusing a virtual object with the remote live-action video to obtain image data after virtual-real fusion; S300, intercepting the image data after virtual-real fusion, and sending the image data after virtual-real fusion to a client in real time through a network. The method has the advantage of overcoming the defects that the existing VR live broadcast software can only passively watch the pushed live broadcast picture, cannot superpose a virtual model, is low in picture quality, is not strong in immersion, is limited in effective transmission distance and the like.

Description

technical field [0001] The invention relates to a remote real-scene augmented reality method based on a VR head-mounted display device, belonging to the field of virtual reality. Background technique [0002] With the popularization of virtual reality technology and 5G network, VR+ live broadcast, a novel live broadcast method, has gradually become a new media application trend. Live broadcast based on VR technology can provide users with high-quality live broadcast images, immerse users in realistic scenes, make live broadcast more realistic and three-dimensional, bring users a strong visual impact, and thus stimulate users' interest. The 2020 Mount Everest Elevation Measurement Mountaineering Team successfully climbed to the summit of Mount Everest, which used VR+5G technology for panoramic live broadcast, so that ordinary people can travel to the top of the world in the snow-covered plateau, breaking time and space constraints, and enjoying the experience The immersive e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/239H04N13/271H04N13/275H04N13/344
CPCH04N13/239H04N13/344H04N13/275H04N13/271
Inventor 郝爱民张素梅李如意郭日俊李帅
Owner QINGDAO RES INST OF BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products