A method, device, electronic device and medium for fusion of three-dimensional virtual and real video streams

Through the three-dimensional virtual and real fusion method of video streaming, feature point matching and matrix update technology are used to solve the problem of insufficient realism in the digital twin system, dynamic adjustment of virtual scenes and accurate superposition of real scenes, and improved the realness of the scenes and A sense of nature.

CN118521745BActive Publication Date: 2024-11-01中电信数字城市科技有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410970235.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-01
Estimated Expiration
2044-07-19

Smart Images

  • Figure CN118521745B_ABST
    Figure CN118521745B_ABST
Patent Text Reader

Abstract

The present application provides a method, device, electronic device and medium for fusion of three-dimensional virtual and real video streams, and relates to the field of video virtual and real fusion. The method includes: matching feature points of the scene image corresponding to the scene video and the virtual scene of the target area to determine the target matching point group; determining the projection matrix and the model view matrix according to the coordinates of each first feature point and the coordinates of the corresponding second feature point; screening the second feature points in multiple target matching point groups to determine the second target feature points; rendering the color of the second target feature points according to the color value of the first feature point corresponding to the second target feature point to obtain the target virtual scene. The scene video captured by the surveillance camera is registered and superimposed with the virtual scene in spatial position, so that the scene video is displayed at the accurate coordinate position in the three-dimensional space, avoiding the dislocation caused by the fusion process, and improving the sense of reality of the key focus area in the digital twin scene.
Need to check novelty before this filing date? Find Prior Art