Method and device for displaying virtual object based on illumination intensity

Abstract

The invention relates to the technical field of AR, and provides a method and device for displaying a virtual object based on illumination intensity, and specifically, the method comprises the steps: obtaining the position information of the virtual object in a real scene image, and intercepting a local image of the virtual object; determining the illumination intensity of the real scene according to preset channel data in the real scene image, and determining the illumination intensity of the virtual object according to preset channel data in the local image; determining target illumination intensity of the virtual object according to the illumination intensity of the real scene and the illumination intensity of the virtual object; adjusting the illumination intensity of the virtual object to the target illumination intensity, displaying the adjusted real scene image, and determining the target illumination intensity of the virtual object jointly by the illumination intensity of the real scene and the illumination intensity of the virtual object, so that the illumination intensity of the virtual object is consistent with the illumination intensity of the real scene; and improving the reality sense of fusion of the virtual object and the real scene.

Description

technical field [0001] The present application relates to the technical field of augmented reality (Augmented Reality, AR), and in particular to a method and device for displaying virtual objects based on light intensity. Background technique [0002] AR technology is a technology that ingeniously integrates virtual objects and real scenes. It widely uses various technical means such as multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, and sensing to combine computer-generated text, 3D models, After the virtual objects such as audio are simulated, they are applied to the real scene. The two kinds of information complement each other, so as to realize the "enhancement" of the real scene and achieve the AR effect. [0003] The authenticity of AR effects is mainly reflected in geometric consistency, temporal consistency, and lighting consistency. Among them, geometric consistency refers to the accuracy of the position, perspective and occlu...

AI Technical Summary

Problems solved by technology

[0004] In the AR experience, the user has a subtle feeling for the lighting of the real scene. When the displayed virtual object has no light and shadow or the light and shadow do not reflect the light intensity in the real scene, it will cause the visual effect that the virtual object does not belong to the real environment, which is serious. Affect the user's real experience

[0005] At present, there are mainly two ways to determine the light intensity of a virtual object. One is to use a light sensor to obtain the light intensity of the real scene where the virtual object is located, but the cost of the equipment is high; the other is to set the light intensity of the virtual object to a Fixed value, which will cause the surface brightness of the virtual object to not match the brightness of the real scene. When users watch the enhanced picture, they can see which one is the virtual object at a glance, and the picture is not realistic enough.

Images