Image monitoring system, method and computer readable medium using digital twin model

Abstract

This invention discloses an image surveillance system, method, and computer-readable medium using a digital avatar model. A data link module creates a digital avatar model based on camera information. A simulation rendering module calculates the camera's illumination polygon range based on the attributes of the digital avatar model. Then, based on the camera's illumination polygon range, image width, and image height, it calculates the UV mapping coordinates used for rendering on the digital avatar platform. The camera's image stream is then projected onto the 3D model of the digital avatar platform using these UV mapping coordinates for overlay rendering, simulating the overlay effect of the camera's real image onto the digital avatar platform. When the spatial positioning module receives an alarm point for an event of interest, it can notify the digital avatar platform of the alarm and activate nearby cameras to obtain relevant surveillance information.

Claims

1. A video surveillance system using a digital clone model, comprising: A data link module creates a digital clone model of the camera based on camera information; a simulation rendering module and a digital clone platform are connected to the data link module and the digital clone platform respectively. The simulation rendering module calculates the digital array of the camera's illumination polygon range based on the attributes of the digital clone model. Then, based on the digital array of the camera's illumination polygon range, the camera's image width, and the camera's image height, the simulation rendering module calculates the UV mapping coordinates used for rendering in the digital clone platform. The simulation rendering module then uses these UV mapping coordinates to create image textures from the camera's image stream and projects them onto the 3D model of the digital clone platform for overlay rendering, thus simulating... The camera's actual image is overlaid on the digital doppelganger platform; and a spatial positioning module is communicatively connected to the digital doppelganger platform. When the spatial positioning module receives a push notification of an alarm point related to an event of interest to the user, the spatial positioning module notifies the digital doppelganger platform of an alarm, allowing the spatial positioning module to activate nearby available cameras based on the alarm point of the event of interest to obtain monitoring information of the event of interest to the user. Furthermore, the spatial positioning module provides or calculates a three-tiered list of recommended cameras based on the effectiveness of the cameras, including a first-tier list of low-effective cameras, a second-tier list of medium-effective cameras, and a third-tier list of high-effective cameras.

2. The video surveillance system as described in claim 1 further includes a spatial index database, wherein, The data linking module further calculates a spatial index structure based on the minimum bounding rectangle of the illuminated polygon range of the camera. The data linking module then uses this spatial index structure to insert information about the camera's description, position, orientation, and illuminated polygon range into the spatial index database for storage.

3. The video surveillance system as described in claim 1 further includes a spatial index database, wherein, The simulation rendering module further uses homography to calculate the UV mapping coordinates used for rendering in the digital avatar platform by using the data linking module to store the illumination polygon range of the camera and the connection of the camera in the spatial index database.

4. The video surveillance system as described in claim 1, wherein, The simulation rendering module further checks the update of the image stream of the projected camera during each rendering process. If the image stream of the camera has been updated, the simulation rendering module updates the image texture of the camera, but does not recalculate the UV mapping coordinates.

5. The video surveillance system as described in claim 1, wherein, The spatial positioning module further verifies the viewing distance and azimuth of the multiple cameras listed in the first-level low-efficiency camera recommendation list. The spatial positioning module calculates the multiple numbered cameras within a predetermined positive and negative degree range of the viewing distance and azimuth of the multiple cameras, so that the spatial positioning module can use the numbered list of the multiple numbered cameras as the second-level effective camera recommendation list and send it back to the digital clone platform.

6. The video surveillance system as described in claim 1, wherein, The spatial positioning module further performs spatial geometric calculations on the illumination polygon range of the multiple numbered cameras listed in the second-level effective camera suggestion list and the location information of the alarm point of the event of concern, so that the spatial positioning module can use the numbered cameras included in the result of the spatial geometric calculation as the third-level high-effective camera suggestion list and send it back to the digital clone platform.

7. The video surveillance system as described in claim 1, wherein, The spatial positioning module calculates the minimum bounding rectangle as the positioning range according to the camera coordinates of the specified low-efficiency camera suggestion list of the first level, the medium-efficiency camera suggestion list of the second level, or the high-efficiency camera suggestion list of the third level. The spatial positioning module then transmits the positioning range back to the digital clone platform.

8. The video surveillance system as described in claim 1, wherein, The spatial positioning module further uses a spatial indexing method to search for a list of low-efficiency cameras in the first level within a specified alarm range. Then, the spatial positioning module calculates based on the visible distance and azimuth of the cameras in the first level low-efficiency camera suggestion list to filter out the list of medium-efficiency cameras in the second level. Finally, the spatial positioning module performs spatial geometric calculations based on the illumination polygon range of the cameras in the second level medium-efficiency camera suggestion list to retain the list of high-efficiency cameras in the third level that meet the range conditions.

9. A method for image surveillance using a digital clone model, comprising: A data linking module creates a digital clone model of the camera based on the camera information. A simulation rendering module calculates a digital array of the camera's illumination polygon range based on the attributes of the digital clone model. Then, the simulation rendering module calculates UV mapping coordinates used for rendering in the digital clone platform based on the digital array of the camera's illumination polygon range, the camera's image width, and the camera's image height. The simulation rendering module then uses these UV mapping coordinates to create image textures from the camera's image stream and projects them onto the 3D model of the digital clone platform for overlay rendering, simulating the overlay effect of the camera's real image being presented on the digital clone platform. When a spatial positioning module receives a push notification about an alarm point related to an event of interest to the user, the spatial positioning module notifies the digital clone platform of an alarm. The spatial positioning module then activates nearby cameras based on the alarm point of the event of interest to obtain monitoring information about the event of interest to the user. The spatial positioning module provides or calculates a three-tiered list of recommended cameras based on their effectiveness: a first-tier list of low-effective cameras, a second-tier list of medium-effective cameras, and a third-tier list of high-effective cameras.

10. The image monitoring method as described in claim 9 further includes having the data linking module calculate a spatial index structure based on the minimum bounding rectangle of the illumination polygon range of the camera, and having the data linking module use the spatial index structure to insert information about the camera description, camera position, camera orientation and illumination polygon range of the camera into a spatial index database for storage.

11. The image monitoring method as described in claim 9 further includes using homography to calculate the UV mapping coordinates used for rendering in the digital avatar platform by the analog rendering module through the data linking module storing the illumination polygon range of the camera and the connection of the camera in a spatial index database.

12. The image monitoring method as described in claim 9 further includes, during each rendering, the simulation rendering module performing an update determination on the image stream of the camera that is turned on for projection; if the image stream of the camera has been updated, the simulation rendering module updates the image texture of the camera, but does not recalculate the UV mapping coordinates.

13. The image monitoring method as described in claim 9 further includes verifying the viewing distance and azimuth of the plurality of cameras listed in the low-efficiency camera suggestion list of the first level by the spatial positioning module, and calculating the plurality of numbered cameras within a predetermined positive and negative degree range of the viewing distance and azimuth of the plurality of cameras by the spatial positioning module, so that the spatial positioning module uses the number list of the plurality of numbered cameras as the effective camera suggestion list of the second level to be transmitted back to the digital clone platform.

14. The image monitoring method as described in claim 9 further includes the spatial positioning module performing spatial geometric calculations on the illumination polygon range of the multiple numbered cameras listed in the effective camera suggestion list of the second level and the location information of the alarm point of the event of concern, so that the spatial positioning module uses the numbered cameras included in the result of the spatial geometric calculation as the high-effectiveness camera suggestion list of the third level to be transmitted back to the digital clone platform.

15. The image monitoring method as described in claim 9 further includes having the spatial positioning module calculate the minimum bounding rectangle as the positioning range according to the camera coordinates of the specified first-level low-efficiency camera suggestion list, the second-level medium-efficiency camera suggestion list, or the third-level high-efficiency camera suggestion list, and then having the spatial positioning module transmit the positioning range back to the digital clone platform.

16. The image monitoring method as described in claim 9 further includes the spatial positioning module searching for a list of low-efficiency cameras in the first level within a specified alarm and a specified range using a spatial indexing method; the spatial positioning module then calculating based on the visible distance azimuth angle of the camera according to the list of low-efficiency cameras in the first level to filter out a list of medium-efficiency cameras in the second level; and the spatial positioning module then performing spatial geometric calculations based on the illumination polygon range of the camera according to the list of medium-efficiency cameras in the second level to retain a list of high-efficiency cameras in the third level that meet the range conditions.

17. A computer-readable medium, applied in a computing device or computer, storing instructions and executing the computer-readable medium via a processor and memory, so as to perform, when executing the computer-readable medium, the image monitoring method using a digital clone model as described in any one of claims 9 to 16.

Images