Virtual-real fusion display method and device, wearable device and readable storage medium

By recognizing the location marker images of mobile terminals through the environmental perception camera of wearable devices, generating and weighting the fused virtual screen images, the problems of blurry images, flickering and occlusion conflicts when using mobile terminals with head-mounted display devices are solved, and the efficiency and accuracy of virtual-real fusion interaction are improved.

CN122131920APending Publication Date: 2026-06-02VIVO MOBILE COMM CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
VIVO MOBILE COMM CO LTD
Filing Date
2026-03-20
Publication Date
2026-06-02

AI Technical Summary

Technical Problem

In existing technologies, head-mounted display devices require users to remove their devices to operate them when using mobile terminals, which makes the process cumbersome and interrupts the immersive experience. Furthermore, when displaying through a camera, there are issues such as blurry images, flickering, and conflicts between virtual and real objects, which reduce the efficiency of virtual-real fusion interaction.

Method used

By using the environmental sensing camera of a wearable device to identify the location marker image of the mobile terminal, obtain the operation interface data, generate a virtual screen image, and perform weighted fusion display, the device avoids camera parameter limitations and conflicts between virtual and real occlusion.

Benefits of technology

It improves the clarity and accuracy of virtual screen images, solves the flicker problem, and achieves precise positioning and tracking and virtual-real occlusion conflict, thereby improving the display effect and interaction efficiency of virtual-real fusion scenes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122131920A_ABST
    Figure CN122131920A_ABST
Patent Text Reader

Abstract

This application discloses a virtual-real fusion display method and apparatus, a wearable device, and a readable storage medium, belonging to the field of extended reality technology. The virtual-real fusion display method is executed by a wearable device, which includes an environmental sensing camera. The method includes: establishing a connection with the mobile terminal and acquiring the mobile terminal's user interface data when a virtual-real interaction scenario with the mobile terminal is triggered; wherein the mobile terminal displays a positioning marker image, which is used to locate the mobile terminal; identifying the positioning marker image based on a real-world scene image captured by the environmental sensing camera to obtain the mobile terminal's position coordinates in the virtual scene; generating a virtual screen image of the mobile terminal based on the position coordinates and the user interface data; and performing a weighted fusion of the virtual screen image and the real-world scene image containing the positioning marker image, and displaying the fused image.
Need to check novelty before this filing date? Find Prior Art