A method, device, electronic device and medium for fusion of three-dimensional virtual and real video streams
Through the three-dimensional virtual and real fusion method of video streaming, feature point matching and matrix update technology are used to solve the problem of insufficient realism in the digital twin system, dynamic adjustment of virtual scenes and accurate superposition of real scenes, and improved the realness of the scenes and A sense of nature.
CN118521745BActive Publication Date: 2024-11-01中电信数字城市科技有限公司
View PDF 0 Cites 0 Cited by
Patent Information
- Application Number
- CN202410970235.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2044-07-19
Smart Images

Figure CN118521745B_ABST
Abstract
The present application provides a method, device, electronic device and medium for fusion of three-dimensional virtual and real video streams, and relates to the field of video virtual and real fusion. The method includes: matching feature points of the scene image corresponding to the scene video and the virtual scene of the target area to determine the target matching point group; determining the projection matrix and the model view matrix according to the coordinates of each first feature point and the coordinates of the corresponding second feature point; screening the second feature points in multiple target matching point groups to determine the second target feature points; rendering the color of the second target feature points according to the color value of the first feature point corresponding to the second target feature point to obtain the target virtual scene. The scene video captured by the surveillance camera is registered and superimposed with the virtual scene in spatial position, so that the scene video is displayed at the accurate coordinate position in the three-dimensional space, avoiding the dislocation caused by the fusion process, and improving the sense of reality of the key focus area in the digital twin scene.
Need to check novelty before this filing date? Find Prior Art
