Light and shadow effect displaying method and device of augmented reality (AR) and electronic equipment

A technology of augmented reality and display method, which is applied in the processing of 3D images, details related to processing steps, image data processing, etc. It can solve the problems of single lighting effect, increase the workload of lighting design, and cannot provide users with sufficient virtual experience. , to achieve the effect of enhancing the virtual experience and improving the display effect

Pending Publication Date: 2018-09-28
XINHUANET CO LTD
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Such AR interaction cannot provide users with a sufficient virtual experience, especially when AR technology is applied to u

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Light and shadow effect displaying method and device of augmented reality (AR) and electronic equipment
  • Light and shadow effect displaying method and device of augmented reality (AR) and electronic equipment
  • Light and shadow effect displaying method and device of augmented reality (AR) and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0078] Embodiment 1 of the present invention provides a light and shadow effect display method for augmented reality AR, such as figure 1 shown, including

[0079] Step 110: Acquire the captured image of the target template, and determine each characteristic object in the image.

[0080] Wherein, the target template is any scene object in the real world that needs to be fused with AR content. As an example, if Embodiment 1 of the present invention provides users with virtual scenes such as commercial tours, tourism, exhibitions, municipal construction planning, audio-visual, etc., some similar environments are simulated through target templates, such as building models, real estate models, and military terrains through sand tables. models, industrial models, etc. In practical applications, the target template can use a planar sand table plan, which saves the cost of making the target template and facilitates the expansion of more virtual scenes.

[0081] Further, determinin...

Embodiment 2

[0127] Another possible implementation of the present invention, on the basis of the first embodiment, also includes the operations shown in the second embodiment, wherein,

[0128] Before step 130, a step is also included: acquiring a preset 3D dynamic model in the AR 3D virtual scene.

[0129] For the second embodiment of the present invention, it is applicable to the case where an independent database is established for all the three-dimensional models required by a virtual scene in the above example. After the corresponding database is determined according to each characteristic object, the corresponding virtual scene can be determined. 3D dynamic model.

[0130] Similarly, the relevant 3D dynamic model can be queried from the database in real time according to the user's shooting content for real-time display, or all the 3D dynamic models can be obtained, loaded into the memory all at once, and displayed accordingly according to the user's shooting content .

[0131] Wh...

Embodiment 3

[0141] Another possible implementation of the present invention, on the basis of Embodiment 1 and Embodiment 2, also includes the operations shown in Embodiment 3, wherein,

[0142] After step 140, further steps are included: determining the light intensity information and / or hue information in the AR three-dimensional virtual scene according to the virtual sunshine information; superimposing the light intensity information and / or hue information in the AR three-dimensional virtual scene Combined display in the scene.

[0143] Specifically, according to the spectral changes of the virtual light corresponding to different time information through atmospheric refraction, the corresponding hue information is matched in the database, and the hue in the AR three-dimensional virtual scene is adjusted.

[0144] According to the change of light intensity corresponding to different time information, the corresponding light intensity information is matched in the database, and the light...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a light and shadow effect displaying method and device of augmented reality (AR) and electronic equipment. The method comprises the following steps of: obtaining an image of a photographed target template and determining characteristic objects in the image; obtaining pre-stored three-dimensional models corresponding to the characteristic objects according to the characteristic objects; generating an AR three-dimensional virtual scene on the basis of the three-dimensional models; obtaining virtual sunshine information in the AR three-dimensional virtual scene; determiningshadow displaying information of the three-dimensional models according to the virtual sunshine information; and superimposing the shadow displaying information of the three-dimensional models into the AR three-dimensional virtual scene to carry out combined display. The method provided by the invention has the advantages that the change of shadows corresponding to the three-dimensional models can be simulated according to the position change of a virtual sun in the AR three-dimensional virtual scene to dynamically change the display of the shadows, so that the display effect is greatly improved and the virtual experience of users is enhanced.

Description

technical field [0001] The present invention relates to the field of augmented reality technology, in particular, to a method, device and electronic equipment for displaying light and shadow effects of augmented reality AR. Background technique [0002] Augmented Reality (AR, Augmented Reality) is a technology that integrates the real world and the virtual world. It can use multimedia, display and control, multi-sensors, tracking and registration, scene fusion, 3D engine, 3D software and other means. The virtual information is simulated and then superimposed on the real world to enrich the real world and be perceived by human senses, so as to achieve a beautiful experience beyond reality. [0003] For the loading of the 3D model during the AR interaction process, the 3D model corresponding to the real scene is directly placed in the virtual scene. When rendering the lighting effect of the 3D model in the virtual scene, since the light source, light intensity, and light colo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T19/00G06T15/06
CPCG06T15/06G06T19/006G06T2200/08
Inventor 张祺李峰李桦轶
Owner XINHUANET CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products