Unlock instant, AI-driven research and patent intelligence for your innovation.

Augmented reality display method and device, electronic equipment and storage medium

A display method and augmented reality technology, applied in the field of computers, to achieve the effect of improving efficiency and accuracy, efficient and accurate augmented reality display

Pending Publication Date: 2021-03-30
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF4 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the embodiment of the present application provides an augmented reality display method, device and electronic equipment to solve the problem of how to efficiently and accurately realize augmented reality display in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality display method and device, electronic equipment and storage medium
  • Augmented reality display method and device, electronic equipment and storage medium
  • Augmented reality display method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] figure 1 It shows a schematic flowchart of an augmented reality display method provided by an embodiment of the present application. The execution body of the augmented reality display method is an electronic device, and the electronic device includes but is not limited to a computer, a server, a projection device, a head-mounted display, etc. . The augmented reality display method is described in detail as follows:

[0055] In S101, acquire a target environment image, and determine point cloud data of the target environment; wherein the target environment image includes a two-dimensional image and a depth image obtained by shooting the target environment.

[0056] In this embodiment of the present application, the target environment is a physical environment in the real world that currently needs to be displayed in augmented reality. The target environment image is an image obtained by capturing the target environment by the camera. Specifically, the camera may be a...

Embodiment 2

[0124] figure 2 It shows a schematic structural diagram of an augmented reality display device provided by the embodiment of the present application. For the convenience of description, only the parts related to the embodiment of the present application are shown:

[0125] The augmented reality display device includes: an acquisition unit 21 , a two-dimensional target area determination unit 22 , a target three-dimensional point cloud data determination unit 23 , a registration unit 24 and a mapping unit 25 . in:

[0126] The acquisition unit 21 is configured to acquire an image of the target environment and determine point cloud data of the target environment; wherein the target environment image includes a two-dimensional image and a depth image obtained by shooting the target environment.

[0127] A two-dimensional target area determining unit 22, configured to determine a two-dimensional target area corresponding to a target object from the two-dimensional image; the tar...

Embodiment 3

[0153] image 3 It is a schematic diagram of an electronic device provided by an embodiment of the present application. like image 3 As shown, the electronic device 3 of this embodiment includes: a processor 30, a memory 31, and a computer program 32 stored in the memory 31 and operable on the processor 30, such as an augmented reality display program. When the processor 30 executes the computer program 32, it realizes the steps in the above embodiments of the augmented reality display method, for example figure 1 Steps S101 to S105 are shown. Alternatively, when the processor 30 executes the computer program 32, it realizes the functions of the modules / units in the above-mentioned device embodiments, for example figure 2 Function of units 21 to 25 shown.

[0154] Exemplarily, the computer program 32 can be divided into one or more modules / units, and the one or more modules / units are stored in the memory 31 and executed by the processor 30 to complete this application. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is suitable for the technical field of computers, and provides an augmented reality display method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a target environment image, and determining the point cloud data of a target environment; wherein the target environment image comprises a two-dimensional image and a depth image obtained by shooting the target environment; determining a two-dimensional target area corresponding to a target object from the two-dimensional image; segmenting target three-dimensional point cloud data corresponding to the target object from point cloud data of the target environment according to the two-dimensional coordinate information of the two-dimensional target area and the information of the depth image; performing three-dimensional registration on the target three-dimensional point cloud data and preset point cloud data of a virtual model, and determining a transformation matrix between the virtual model and the target object; and mapping the virtual model to an area corresponding to the target object for display according to the transformation matrix. According to the embodiment of the invention, augmented reality display can be efficiently and accurately realized.

Description

technical field [0001] The present application belongs to the field of computer technology, and in particular relates to an augmented reality display method, device, electronic equipment and storage medium. Background technique [0002] Augmented reality (Augmented Reality, AR) technology is a technology that ingeniously integrates virtual information with the real world. It has more and more applications in surgical navigation, intelligent transportation, entertainment games and other fields. Augmented reality technology specifically superimposes the virtual information content generated by the computer on the real environment, so that the virtual model and the real objects in the real environment can exist in the same picture or space at the same time. This process can be perceived by human senses, thus achieving beyond Realistic sensory experience to achieve "augmentation" of the real world. [0003] However, it is difficult for the existing technology to efficiently and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06T17/00G06T7/30G06T7/10
CPCG06T19/006G06T17/00G06T7/30G06T7/10G06T2207/10012
Inventor 王琼张英奎廖祥云钱银玲孙寅紫王平安
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI