Virtual object light and shadow effect generation method and apparatus in video

Abstract

Embodiments of the invention provide a virtual object light and shadow effect generation method and an apparatus in a video, and electronic equipment and belong to the augmented reality technology field. The method comprises the following steps of identifying a video scene included in a video and extracting an index frame corresponding to the video scene; analyzing a target object in the index frame, and according to the target object, determining light source information of the index frame; and according to the light source information, generating a light and shadow effect of a virtual objectin the video scene. In the embodiments, fusion of the light and shadow effect of the virtual object and a real content in the video is realized, a stronger sense of reality is provided for a user, simultaneously, frame-by-frame determination of light source information is avoided and generation efficiency is increased.

Description

technical field [0001] The invention relates to the field of augmented reality technology, in particular to a method and device for generating light and shadow effects of virtual objects in videos. Background technique [0002] Augmented Reality (AR for short) enables computer-generated virtual objects and objectively existing real environments to coexist in the same augmented reality system through the use of hardware and software devices. For example, when a user uses a head-mounted AR device, the real environment data is collected through the camera device in the device, and then the virtual effect generated by the computer is fused with the real environment data. The specific application scenarios are diverse. For example, in your own home, you can wear an AR helmet to integrate the virtual decoration effect with the real home environment. In fact, the above-mentioned AR helmets can adopt a similar design structure to the common VR helmets on the market. When a smartpho...

AI Technical Summary

Problems solved by technology

[0004] Since the virtual objects are all pre-generated by computer, the information of the real environment in the video cannot be obtained, and the scene switching in the video is relatively frequent, so the light and shadow effects of the virtual object cannot be integrated and matched with the real environment in the video, which is easy for users. An unreal feeling, greatly reducing the realism of virtual object lighting effects;

[0005] The existing AR helmet is inconvenient to install and take out the mobile phone, and it is easy to scratch the surface of the mobile phone when installing and taking it out, and the splint presses the back shell of the mobile phone for a long time, which is not conducive to the heat dissipation of the mobile phone. For mobile phones with different screen sizes and thicknesses, the settings are complicated. Adaptive adjustment of the structure of the mobile phone, the structure can not adjust the strength of the clamping mobile phone, and it is also not conducive to the heat dissipation of the mobile phone, and it is prone to shaking, shaking and other phenomena during use, which affects the user's sense of immersion in the use process , and may even cause discomfort such as dizziness to the user

Images