Monitoring display method, device, electronic device and storage medium

Abstract

The present application provides a monitoring display method, device, electronic device, and storage medium. The method includes: obtaining a pixel coordinate set corresponding to a target object in a monitoring image, wherein the pixel coordinates in the pixel coordinate set are used to determine the outline of the target object in the monitoring image; drawing a symbol for marking the target object based on the pixel coordinates in the pixel coordinate set; displaying a real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol follows the movement of the target object in real time. This method can draw a symbol for highlighting the target object when playing a real-time monitoring video stream containing a user-specified target object, and display the symbol in the video screen that follows the movement of the target object in real time. On the one hand, this allows the user to intuitively see the target object in the screen, enhancing the user's viewing experience; on the other hand, it achieves the purpose of monitoring the target object and realizes real-time tracking of the target object.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a monitoring display method, device, electronic device and storage medium. Background Art

[0002] Currently, with the nationwide popularity of visual networking services, the visual networking industry utilizes the world's most advanced VisionVera real-time HD video switching technology, enabling real-time transmission of HD video across the entire network, a feat currently unavailable on the internet. In the visual networking field, when users analyze target objects based on surveillance video, they are typically limited to viewing the surveillance video containing the target object on a display screen. However, this method of detecting target objects has limited performance. In some scenarios, it takes a long time for users to identify the target object in the surveillance video, resulting in reduced target object identification and analysis efficiency. Therefore, improving the efficiency of target object identification and analysis has become a pressing issue. Summary of the Invention

[0003] In view of the above problems, the present application provides a monitoring display method, device, electronic device and storage medium, which can draw a symbol for highlighting the target object when playing a real-time monitoring video stream containing a target object specified by a user, and display the symbol that moves with the target object in real time in the video screen, thereby realizing real-time tracking of the target object and improving the efficiency of identifying and analyzing the target object.

[0004] A first aspect of the present application provides a monitoring display method, comprising:

[0005] Obtaining a pixel coordinate set corresponding to a target object in a surveillance image, wherein the pixel coordinates in the pixel coordinate set are used to determine a contour of the target object in the surveillance image;

[0006] Drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;

[0007] A real-time monitoring video stream containing the monitoring image is displayed, and the symbol is displayed in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.

[0008] Optionally, drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set includes:

[0009] Determine the center coordinates of each pixel coordinate in the pixel coordinate set;

[0010] A symbol for marking the target object is drawn according to the center coordinates.

[0011] Optionally, drawing a symbol for marking the target object according to the center coordinates includes:

[0012] Connecting pixel points corresponding to respective pixel coordinates in the pixel coordinate set to obtain a curved frame of the target object in the monitoring image;

[0013] Draw a preset image frame with the central coordinates as the geometric center and including the curved frame; or

[0014] Taking the center coordinate as a starting point and following a preset direction, an identifier associated with the target object is drawn at a position in an outer area of ​​the curve frame at a preset distance from the center coordinate.

[0015] Optionally, determining the center coordinates of each pixel coordinate in the pixel coordinate set includes:

[0016] Obtaining a minimum rectangular frame containing the coordinates of each pixel in the pixel coordinate set;

[0017] The coordinates of the intersection of the diagonals of the minimum rectangular frame are determined as the center coordinates of the target object.

[0018] Optionally, obtaining a pixel coordinate set corresponding to a target object in a surveillance image includes:

[0019] Obtain monitoring equipment information and target object feature information within the target area;

[0020] Obtaining a real-time monitoring video stream within the target area based on monitoring device information within the target area;

[0021] identifying, in the real-time monitoring video stream, frames containing monitoring images of the target object based on the characteristic information of the target object;

[0022] For each frame of the surveillance image containing the target object, a pixel coordinate set corresponding to the target object is obtained.

[0023] Optionally, the method further includes:

[0024] Determine the device identifier of the target monitoring device to which the real-time monitoring video stream containing the target object belongs;

[0025] Displaying a real-time surveillance video stream containing the surveillance image, including:

[0026] According to the device identification of the target monitoring device, a real-time monitoring video stream containing the monitoring image is read from the target monitoring device and displayed.

[0027] Optionally, displaying a real-time surveillance video stream containing the surveillance image and displaying the symbol in the real-time surveillance video stream, wherein the symbol moves in real time following the target object, includes:

[0028] When there are multiple target monitoring devices, dividing the display area into multiple sub-areas corresponding to the number of the target monitoring devices;

[0029] The real-time monitoring video stream corresponding to each target monitoring device is displayed in the display area in a manner of displaying the real-time monitoring video stream of a target monitoring device in a sub-area, and the symbol is displayed in each real-time monitoring video stream respectively, and the symbol follows the movement of the target object in real time.

[0030] A second aspect of the present application provides a monitoring display device, comprising:

[0031] An acquisition module, configured to obtain a pixel coordinate set corresponding to a target object in a monitoring image, wherein the pixel coordinates in the pixel coordinate set are used to determine a contour of the target object in the monitoring image;

[0032] a drawing module, configured to draw a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;

[0033] The display module is used to display the real-time monitoring video stream containing the monitoring image and display the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.

[0034] Optionally, the drawing module includes:

[0035] A first determining submodule, configured to determine the center coordinates of each pixel coordinate in the pixel coordinate set;

[0036] The first drawing submodule is configured to draw a symbol for marking the target object according to the center coordinates.

[0037] Optionally, the first drawing submodule includes:

[0038] A connecting submodule, configured to connect the pixel points corresponding to the respective pixel coordinates in the pixel coordinate set to obtain a curved frame of the target object in the monitoring image;

[0039] A second drawing submodule is configured to draw a preset image frame having the central coordinates as the geometric center and including the curved frame; or

[0040] The third drawing submodule is configured to draw a mark associated with the target object at a position preset distance from the center coordinate in an outer area of ​​the curve frame, starting from the center coordinate and in a preset direction.

[0041] Optionally, the first determining submodule includes:

[0042] A first obtaining submodule is used to obtain a minimum rectangular frame containing the coordinates of each pixel in the pixel coordinate set;

[0043] The second determining submodule is configured to determine the coordinates of the intersection of the diagonals of the minimum rectangular frame as the center coordinates of the target object.

[0044] Optionally, the obtaining module includes:

[0045] The second acquisition submodule is used to obtain monitoring equipment information and characteristic information of the target object in the target area;

[0046] A third obtaining submodule is configured to obtain a real-time monitoring video stream within the target area based on monitoring device information within the target area;

[0047] an identification submodule, configured to identify, in the real-time monitoring video stream, monitoring images containing the target object in each frame based on the characteristic information of the target object;

[0048] The fourth obtaining submodule is configured to obtain a pixel coordinate set corresponding to the target object in each frame of the surveillance image containing the target object.

[0049] Optionally, the device further comprises:

[0050] A determination module, configured to determine a device identifier of a target monitoring device to which the real-time monitoring video stream containing the target object belongs;

[0051] The display module includes:

[0052] The first display submodule is configured to read and display the real-time monitoring video stream containing the monitoring image from the target monitoring device according to the device identification of the target monitoring device.

[0053] Optionally, the display module includes:

[0054] a division submodule, configured to divide the display area into a plurality of sub-areas corresponding to the number of the target monitoring devices when there are multiple target monitoring devices;

[0055] The second display submodule is used to display the real-time monitoring video stream of a target monitoring device in one sub-area, display the real-time monitoring video stream corresponding to each target monitoring device in the display area, and display the symbol in each real-time monitoring video stream respectively, and the symbol follows the movement of the target object in real time.

[0056] A third aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the monitoring and display method described in the first aspect of the present application.

[0057] The fourth aspect of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executed, implements the steps of the monitoring and display method described in the first aspect of the present application.

[0058] Using the monitoring display method of the present application, first obtain the pixel coordinate set corresponding to the target object in the monitoring image, and the pixel coordinates in the pixel coordinate set are used to determine the outline of the target object in the monitoring image. Then, based on the pixel coordinates in the pixel coordinate set, draw a symbol for marking the target object. Then, display the real-time monitoring video stream containing the monitoring image, and display the symbol in the real-time monitoring video stream, and the symbol follows the movement of the target object in real time. This method can draw a symbol for highlighting the target object when playing a real-time monitoring video stream containing a target object specified by the user, and display the symbol that follows the movement of the target object in real time in the video screen. On the one hand, it allows the user to intuitively see the target object in the screen, enhancing the user's viewing experience. On the other hand, it achieves the purpose of monitoring the target object, realizes real-time tracking of the target object, and improves the efficiency of identifying and analyzing the target object. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments of the present application.

[0060] Figure 1 This is a structural diagram of a visual networking system shown in one embodiment of the present application;

[0061] Figure 2 This is a flow chart of a monitoring and display method shown in one embodiment of the present application;

[0062] Figure 3 is a schematic diagram of a curve frame of a target object shown in an embodiment of the present application;

[0063] Figure 4 is a schematic diagram of a curve frame of another target object shown in an embodiment of the present application;

[0064] Figure 5 This is a schematic diagram of a monitoring video display result shown in an embodiment of the present application;

[0065] Figure 6 This is a schematic diagram of a process for obtaining a pixel coordinate set according to an embodiment of the present application;

[0066] Figure 7 This is a structural block diagram of a monitoring and display device shown in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0068] Figure 1 This is a structural diagram of a visual networking system shown in one embodiment of the present application. Figure 1 The visual networking system includes a visual networking scheduling server, an intelligent analysis server, a feature recognition server, a co-transmission server, a database, and a visual networking terminal. The visual networking scheduling server is connected to the database, the intelligent analysis server, and the visual networking terminal, respectively; the feature recognition server is connected to the intelligent analysis server; and the co-transmission server is connected to the intelligent analysis server and the visual networking terminal, respectively. The various devices in the visual networking system can communicate with each other using the visual networking protocol.

[0069] This application provides a monitoring display method, which is applied to Figure 1 The visual networking system shown. Figure 2 This is a flow chart of a monitoring display method shown in an embodiment of the present application. Figure 2 The monitoring display method of the present application may specifically include the following steps:

[0070] Step S21: obtaining a pixel coordinate set corresponding to a target object in a monitoring image, wherein the pixel coordinates in the pixel coordinate set are used to determine the contour of the target object in the monitoring image.

[0071] In this embodiment, steps S21 to S23 can be performed by Figure 1 It is executed by the visual networking terminal in the visual networking system shown.

[0072] In this embodiment, the target object can be an object pre-specified by a user, where the user is viewing the real-time surveillance video stream. The target object can be any movable physical object, including people, vehicles, animals, etc., and this embodiment does not impose any specific restrictions on this.

[0073] A surveillance image is composed of multiple pixels, each with a pixel coordinate. A target object occupies a certain pixel region in the surveillance image. The pixel coordinates of each pixel on the edge contour of this pixel region form the pixel coordinate set corresponding to the target object.

[0074] The same target object may have different sets of pixel coordinates in different surveillance images. For example, the same person may have different postures in different surveillance images, resulting in different outlines and, consequently, different sets of pixel coordinates. For example, if person 1 appears from the back in surveillance image 1, from the front in surveillance image 2, and from the side in surveillance image 3, then the pixel coordinate set A corresponding to person 1 in surveillance image 1 will be different from the pixel coordinate set B corresponding to person 1 in surveillance image 2. Therefore, the pixel coordinate set C corresponding to person 1 in surveillance image 3 will be different.

[0075] In this embodiment, the visual network terminal can obtain a pixel coordinate set corresponding to a target object in a monitoring image from the visual network scheduling server.

[0076] Step S22: drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set.

[0077] In this embodiment, the role of the symbol is to highlight the target object so that the user can better monitor the target object when watching the real-time monitoring video stream. The type of the symbol can be a pattern, text, etc., and this embodiment does not specifically limit this.

[0078] In specific implementation, step S22 may include:

[0079] A symbol for marking a target object is drawn according to a preset association relationship between pixel coordinates in the pixel coordinate set and the symbol.

[0080] In this embodiment, multiple association relationships between symbols and pixel coordinates are preset, such as the symbol being at the center of multiple pixel coordinates, the symbol being a preset distance away from a certain pixel coordinate, etc. This embodiment does not impose any specific restrictions on the association relationship.

[0081] Step S23: Display the real-time monitoring video stream containing the monitoring image, and display the symbol in the real-time monitoring video stream, and the symbol moves with the target object in real time.

[0082] In this embodiment, the visual network terminal can play a real-time monitoring video stream containing monitoring images, and display symbols that follow the movement of the target object in real time in the playback screen, so that the user can intuitively see the target object in the screen, thereby realizing real-time monitoring of the target object.

[0083] Using the monitoring display method of the present application, first obtain the pixel coordinate set corresponding to the target object in the monitoring image, and the pixel coordinates in the pixel coordinate set are used to determine the outline of the target object in the monitoring image. Then, based on the pixel coordinates in the pixel coordinate set, draw a symbol for marking the target object. Then, display the real-time monitoring video stream containing the monitoring image, and display the symbol in the real-time monitoring video stream, and the symbol follows the movement of the target object in real time. This method can draw a symbol for highlighting the target object when playing a real-time monitoring video stream containing a target object specified by the user, and display the symbol that follows the movement of the target object in real time in the video screen. On the one hand, it allows the user to intuitively see the target object in the screen, enhancing the user's viewing experience. On the other hand, it achieves the purpose of monitoring the target object, realizes real-time tracking of the target object, and improves the efficiency of identifying and analyzing the target object.

[0084] In combination with the above embodiments, in one embodiment, the present application further provides a method for drawing a symbol for marking a target object. Specifically, the above step S22 may include:

[0085] Determine the center coordinates of each pixel coordinate in the pixel coordinate set;

[0086] Draw a symbol to mark the target object based on the center coordinates.

[0087] For a frame of surveillance image, after obtaining the pixel coordinate set corresponding to the target object therein, the visual network terminal can calculate the center coordinates of each pixel coordinate in the pixel coordinate set. This embodiment does not impose any specific restrictions on the method of obtaining the center coordinates.

[0088] In a specific implementation, drawing a symbol for marking a target object according to the center coordinates may include:

[0089] A symbol for marking the target object is drawn based on the center coordinates of the target object and the preset association between the center coordinates and the symbol. For example, the visual networking terminal may draw the symbol for marking the target object at the center coordinates, or may draw the symbol for marking the target object at a location preset distance from the center coordinates. This embodiment does not specifically limit the preset association between the center coordinates and the symbol.

[0090] In this embodiment, by drawing a symbol for marking the target object on the target object in each frame of the surveillance image, the user can see the target object more intuitively when watching the real-time surveillance video stream.

[0091] In combination with the above embodiments, in one implementation, drawing a symbol for marking a target object according to the center coordinates may specifically include:

[0092] Connect the pixel points corresponding to each pixel coordinate in the pixel coordinate set to obtain the curve box of the target object in the monitoring image;

[0093] Draw a preset image frame with the center coordinates as the geometric center and containing a curved frame; or

[0094] Taking the center coordinate as the starting point and following the preset direction, draw the mark associated with the target object in the outer area of ​​the curve box at a position preset distance from the center coordinate.

[0095] In this embodiment, since the pixel coordinates in the pixel coordinate set are used to determine the outline of the target object in the monitoring image, by connecting the pixel points corresponding to each pixel coordinate in the pixel coordinate set, a curved frame of the target object in the monitoring image can be obtained, and the curved frame is the outline of the target object.

[0096] In order to better describe the monitoring and display method of the present application, it is specifically noted here that the target object in each subsequent embodiment refers to a face image. Of course, the target object can also be a complete image of a person, a complete image of a vehicle, a complete image of an animal, etc.

[0097] When the target object is a face image, the obtained contour can be as follows Figure 3 shown. Figure 3 Schematic diagram of a curve frame of a target object shown in one embodiment of the present application.

[0098] In actual implementation, if the pixel coordinate set contains more pixel coordinates, the drawn curve box will be closer to the contour of the real target object. However, it takes more time to collect a large number of pixel coordinates, and the visual network terminal also needs more time to calculate the contour of the target object based on the pixel coordinate set, which reduces the efficiency of drawing symbols. Therefore, this application also provides a simplified version of the contour, such as Figure 4 shown. Figure 4 Schematic diagram of a curve frame of another target object shown in an embodiment of the present application. Figure 4 The outer thick solid rectangle is the simplified outline of the target object. The rectangle actually contains Figure 3 As can be seen, since the simplified contour can be directly determined based on the pixel coordinates of the four pixel points A, B, C, and D, there is no need to pre-collect the pixel coordinates of all the pixel points on the true contour. Instead, it is only necessary to collect the pixel coordinates of the four vertices of the minimum rectangular box. This reduces the time required to collect pixel coordinates and calculate the contour of the target object, and improves the efficiency of drawing symbols.

[0099] On this basis, this embodiment provides two methods for drawing symbols, including:

[0100] 1. Draw a preset image frame with the center coordinates as the geometric center and containing a curve frame.

[0101] 2. Starting from the center coordinates, draw a marker associated with the target object in the outer area of ​​the curve box at a preset distance from the center coordinates in the preset direction.

[0102] The preset image frame can be a graphic frame of any shape, such as a rectangular frame or a circular frame, and the logo can be a pattern logo or a text logo. Association with the target object means that the target object can be highlighted. This embodiment does not impose any specific restrictions on the shape of the image frame, the type of logo, or the content.

[0103] For the first method, if the contour of the target object is a true contour (such as Figure 3 ), the center coordinates can be used as the geometric center to draw a preset image frame that completely contains the true contour, such as Figure 5 The rectangular frame in the monitoring image 1 is the symbol used to mark the target object. If the outline of the target object is a simplified outline (such as Figure 4 ), since the center coordinates are the coordinates of the diagonal intersection position of the simplified contour, the simplified contour can be directly used as a symbol for marking the target object, such as Figure 5 As shown in monitoring image 2. Figure 5 This is a schematic diagram of a monitoring video display result shown in an embodiment of the present application.

[0104] For the second method, if the contour of the target object is a real contour, then the center coordinate can be used as the starting point and the marker associated with the target object can be drawn at a preset distance outside the real contour and from the center coordinate according to the preset direction, such as Figure 5 The characters "target object" in the monitoring image 3 are the symbols used to mark the target object. If the outline of the target object is a simplified outline, then the mark associated with the target object can be drawn at a preset distance from the center coordinate outside the simplified outline, starting from the center coordinate, in a preset direction, such as Figure 5 The exclamation mark in surveillance image 4 is the symbol used to mark the target object.

[0105] This embodiment provides a variety of symbols that can be drawn to mark target objects, which not only allows users to focus on monitoring target objects, but also enriches the display method of monitoring time and frequency.

[0106] In combination with the above embodiments, in one implementation, determining the center coordinates of each pixel coordinate in the pixel coordinate set may specifically include the following steps:

[0107] Obtain the minimum rectangular frame containing the coordinates of each pixel in the pixel coordinate set;

[0108] The coordinates of the intersection of the diagonals of the minimum rectangular frame are determined as the center coordinates of the target object.

[0109] In this embodiment, the minimum rectangular frame containing the coordinates of each pixel in the pixel coordinate set is Figure 4 The center of the smallest rectangular box (simplified outline) can be used as the center coordinate of the target object.

[0110] In this embodiment, the visual network terminal can obtain a pixel coordinate set from the visual network scheduling server. The pixel coordinate set includes the pixel coordinates of the four vertices of the minimum rectangular box. The visual network terminal can determine the minimum rectangular box and the coordinate center based on the pixel coordinates of these four vertices.

[0111] In this embodiment, the visual networking terminal can quickly obtain the coordinate center based on the pixel coordinates of the four vertices of the minimum rectangular frame without complex calculations, further improving the efficiency of drawing symbols.

[0112] In combination with the above embodiments, in one embodiment, the present application further provides a method for obtaining a pixel coordinate set corresponding to a target object in a surveillance image. Specifically, the above step S21 may include:

[0113] Obtain monitoring equipment information and target object feature information within the target area;

[0114] According to the monitoring equipment information in the target area, obtain the real-time monitoring video stream in the target area;

[0115] According to the characteristic information of the target object, the monitoring image of each frame containing the target object is identified in the real-time monitoring video stream;

[0116] For each frame of the surveillance image containing the target object, a pixel coordinate set corresponding to the target object is obtained.

[0117] In this embodiment, a user can log in to the visual network scheduling server, select a target area on the user configuration page, and enter the characteristic information of the target object to be monitored. The target area is a pre-defined geographic area, and this embodiment does not impose specific restrictions on the size or scope of the target area. The characteristic information of the target object can be characteristic information that uniquely identifies the target object. For example, if the target object is a person, the characteristic information can be facial information. For another example, if the target object is a vehicle, the characteristic information can be the vehicle's license plate number. This embodiment does not impose specific restrictions on the target object and its characteristic information.

[0118] Based on the user's selected target area, the visual network dispatch server obtains monitoring device information within the target area and then stores the target area, target object feature information, and monitoring device information within the target area in a database. Monitoring device information refers to the device ID of each monitoring device; each device ID uniquely corresponds to a monitoring device within the target area. The visual network dispatch server then transmits the target object feature information and monitoring device information within the target area to the intelligent analysis server via the visual network protocol. The intelligent analysis server transmits the target object feature information to the feature recognition server and, based on the monitoring device information, retrieves and receives the real-time monitoring video stream from the coordination server via the visual network protocol. The real-time monitoring video stream is converted into an RTSP protocol encapsulated packet and transmitted in real time to the feature recognition server. Retrieving and receiving the real-time monitoring video stream from the coordination server via the visual network protocol includes: the intelligent analysis server transmits the monitoring device information to the coordination server; the coordination server retrieves the real-time monitoring video stream from the monitoring device corresponding to each monitoring device ID; and transmits the retrieved real-time monitoring video stream to the intelligent analysis server.

[0119] Next, the feature recognition server identifies each frame of the surveillance image containing the target object in the real-time surveillance video stream based on the feature information of the target object, and then obtains the pixel coordinate set corresponding to the target object for each frame of the surveillance image containing the target object.

[0120] When the feature recognition server obtains the pixel coordinate set corresponding to the target object, it can perform the following steps:

[0121] Obtain the farthest pixel point in the four directions of up, down, left, and right of the target object area in the monitoring image;

[0122] Determine a first horizontal line including the farthest pixel point in the upward direction and a second horizontal line including the farthest pixel point in the downward direction;

[0123] Determine a first vertical line including the farthest pixel point in the left direction and a second vertical line including the farthest pixel point in the right direction;

[0124] The border formed by the first horizontal line, the second horizontal line, the first vertical line, and the second vertical line is the minimum rectangular frame. The pixel at the intersection of the first horizontal line and the first vertical line (the upper left vertex of the minimum rectangular frame) is the first pixel, the pixel at the intersection of the first horizontal line and the second vertical line (the upper right vertex of the minimum rectangular frame) is the second pixel, the pixel at the intersection of the first horizontal line and the first vertical line (the lower left vertex of the minimum rectangular frame) is the third pixel, and the pixel at the intersection of the second horizontal line and the second vertical line (the lower right vertex of the minimum rectangular frame) is the fourth pixel.

[0125] Figure 6 This is a schematic diagram of a process for obtaining a pixel coordinate set according to an embodiment of the present application. Figure 6 In the figure, the four black dots on the outline of the target object represent the farthest pixels in the four directions of up, down, left, and right of the monitoring image. Based on the four farthest pixels, the first horizontal line, the second horizontal line, the first vertical line, and the second vertical line can be determined, and then the first pixel A, the second pixel B, the third pixel C, and the fourth pixel D can be obtained.

[0126] Next, the feature recognition server adds the first pixel point to the fourth pixel point to the pixel coordinate set, and sends the identified surveillance image containing the target object and the pixel coordinate set corresponding to the target object in each frame of the surveillance image to the intelligent analysis server, which then sends it to the visual network terminal through the visual network scheduling server.

[0127] In combination with the above embodiments, in one implementation, the method of the present application may further include:

[0128] Determine the device identifier of the target monitoring device to which the real-time monitoring video stream containing the target object belongs.

[0129] On this basis, a real-time surveillance video stream containing surveillance images is displayed, including:

[0130] According to the device identification of the target monitoring device, the real-time monitoring video stream containing the monitoring image is read from the target monitoring device and displayed.

[0131] In this embodiment, when the feature recognition server identifies each frame of the surveillance image containing the target object in the real-time surveillance video stream, it can also determine the target surveillance device to which these surveillance images belong and obtain the device identification of the target surveillance device.

[0132] Then, the feature recognition server can also send the device identification of the target monitoring device to the intelligent analysis server, which then sends it to the visual network terminal through the visual network scheduling server, so that the visual network terminal can subsequently retrieve the monitoring video stream containing the target object from the target monitoring device.

[0133] In combination with the above embodiment, in one implementation, the above step S23 may include:

[0134] When there are multiple target monitoring devices, the display,area is divided into multiple sub-areas corresponding to the number,of target monitoring devices;

[0135] The real-time monitoring video stream corresponding to each target monitoring device is displayed in the display area in the manner of displaying the real-time monitoring video stream of a target monitoring device in one sub-area, and symbols are displayed in each real-time monitoring video stream respectively, and the symbols follow the movement of the target object in real time.

[0136] In this embodiment, there may be multiple target monitoring devices containing the target object. When there are multiple target monitoring devices, the visual network terminal can divide the display area into multiple sub-areas equal to the number of target monitoring devices, and one sub-area is used to display the real-time monitoring video stream of one target monitoring device. In this way, the user can view the real-time monitoring video streams corresponding to multiple target monitoring devices at the same time in the display area, so as to better monitor the target object and realize real-time tracking of the target object.

[0137] In this embodiment, the real-time monitoring video stream can be displayed through multiple sub-areas, so that the user can better monitor the target object and achieve real-time tracking of the target object.

[0138] The following will be combined Figure 1 , the monitoring display method of the present application is described in detail with a specific embodiment.

[0139] Step 1: The user logs in to the visual network dispatch server and enters the facial information of the target person A to be monitored and the latitude and longitude information of the target geographical area on the user configuration page.

[0140] Step 2: The visual network dispatch server obtains the monitoring equipment information in the target geographical area based on the latitude and longitude information of the target geographical area, and then saves the target geographical area, the facial information of the target person A, and the monitoring equipment information in the target geographical area in the database.

[0141] Step 3: The visual network dispatch server sends the monitoring equipment information in the target geographical area and the facial information of the target person A to the intelligent analysis server through the visual network protocol.

[0142] Step 4: The intelligent analysis server sends the facial information of target person A to the feature recognition server via the IP network.

[0143] Step 5: The intelligent analysis server sends the monitoring device information to the coordination server through the visual network protocol. The coordination server retrieves the real-time monitoring video stream from the monitoring device corresponding to each monitoring device ID and transmits the retrieved real-time monitoring video stream to the intelligent analysis server.

[0144] Step 6: The intelligent analysis server converts the real-time monitoring video stream into the RTSP protocol and transmits it to the feature recognition server in real time through the IP network.

[0145] Step 7: The feature recognition server starts analyzing the real-time surveillance video stream, identifies the surveillance images containing the facial information of the target person A, and then sends these surveillance images, the device identifiers of the surveillance devices to which the surveillance images belong, and the pixel coordinate sets corresponding to the target objects in the surveillance images to the intelligent analysis server in real time.

[0146] Step 8: The intelligent analysis server transmits the monitoring image, the device identifier of the monitoring device to which the monitoring image belongs, and the pixel coordinate set corresponding to the target object in the monitoring image to the visual network scheduling server through the visual network protocol.

[0147] Step 9: The visual network scheduling server sends the monitoring image, the device identifier of the monitoring device to which the monitoring image belongs, and the pixel coordinate set corresponding to the target object in the monitoring image to the visual network terminal through the visual network protocol.

[0148] Step 10: The visual network terminal retrieves the real-time surveillance video stream from the coordination server based on the returned device ID of the monitoring device and plays the real-time surveillance video stream. During playback, the visual network terminal determines the center coordinates of each frame of the surveillance image containing target person A based on the coordinates of each pixel in the pixel coordinate set. It then draws a rectangular box to select target person A based on the center coordinates. Finally, the rectangular box is displayed in the surveillance image, moving in real time with target person A.

[0149] It should be noted that for the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0150] Based on the same inventive concept, the present application provides a monitoring display device 700 . Figure 7 This is a structural block diagram of a monitoring display device shown in an embodiment of the present application. Figure 7 The monitoring and display device 700 of the present application may include:

[0151] An obtaining module 701 is configured to obtain a pixel coordinate set corresponding to a target object in a surveillance image, wherein the pixel coordinates in the pixel coordinate set are used to determine a contour of the target object in the surveillance image;

[0152] A drawing module 702 is configured to draw a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;

[0153] The display module 703 is configured to display the real-time monitoring video stream including the monitoring image, and to display the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.

[0154] Optionally, the drawing module 702 includes:

[0155] A first determining submodule, configured to determine the center coordinates of each pixel coordinate in the pixel coordinate set;

[0156] The first drawing submodule is configured to draw a symbol for marking the target object according to the center coordinates.

[0157] Optionally, the first drawing submodule includes:

[0158] A connecting submodule, configured to connect the pixel points corresponding to the respective pixel coordinates in the pixel coordinate set to obtain a curved frame of the target object in the monitoring image;

[0159] A second drawing submodule is configured to draw a preset image frame having the central coordinates as the geometric center and including the curved frame; or

[0160] The third drawing submodule is configured to draw a mark associated with the target object at a position preset distance from the center coordinate in an outer area of ​​the curve frame, starting from the center coordinate and in a preset direction.

[0161] Optionally, the first determining submodule includes:

[0162] A first obtaining submodule is used to obtain a minimum rectangular frame containing the coordinates of each pixel in the pixel coordinate set;

[0163] The second determining submodule is configured to determine the coordinates of the intersection of the diagonals of the minimum rectangular frame as the center coordinates of the target object.

[0164] Optionally, the obtaining module 701 includes:

[0165] The second acquisition submodule is used to obtain monitoring equipment information and characteristic information of the target object in the target area;

[0166] A third obtaining submodule is configured to obtain a real-time monitoring video stream within the target area based on monitoring device information within the target area;

[0167] an identification submodule, configured to identify, in the real-time monitoring video stream, monitoring images containing the target object in each frame based on the characteristic information of the target object;

[0168] The fourth obtaining submodule is configured to obtain a pixel coordinate set corresponding to the target object in each frame of the surveillance image containing the target object.

[0169] Optionally, the apparatus 700 further includes:

[0170] A determination module, configured to determine a device identifier of a target monitoring device to which the real-time monitoring video stream containing the target object belongs;

[0171] The display module 703 includes:

[0172] The first display submodule is configured to read and display the real-time monitoring video stream containing the monitoring image from the target monitoring device according to the device identification of the target monitoring device.

[0173] Optionally, the display module 703 includes:

[0174] a division submodule, configured to divide the display area into a plurality of sub-areas corresponding to the number of the target monitoring devices when there are multiple target monitoring devices;

[0175] The second display submodule is used to display the real-time monitoring video stream of a target monitoring device in one sub-area, display the real-time monitoring video stream corresponding to each target monitoring device in the display area, and display the symbol in each real-time monitoring video stream respectively, and the symbol follows the movement of the target object in real time.

[0176] Based on the same inventive concept, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and runnable on the processor. When executed by the processor, the steps in the conference recovery method of any of the above embodiments of the present application are implemented.

[0177] Based on the same inventive concept, the present application provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the steps in the conference recovery method of any of the above embodiments of the present application are implemented.

[0178] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0179] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0180] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, apparatus, or computer program products. Thus, embodiments of the present invention may take the form of a fully hardware embodiment, a fully software embodiment, or an embodiment combining software and hardware. Furthermore, embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0181] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0182] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0183] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0184] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

[0185] The above is a detailed introduction to the monitoring and display method, device, electronic device and storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A monitoring display method, characterized in that: The method comprises: Obtaining a pixel coordinate set corresponding to a target object in a surveillance image, wherein the pixel coordinates in the pixel coordinate set are used to determine a contour of the target object in the surveillance image; the surveillance image is composed of a plurality of pixel points, each of the pixel points having a pixel coordinate; Drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set; Displaying a real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time; Drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set includes: Determine the center coordinates of each pixel coordinate in the pixel coordinate set; Drawing a symbol for marking the target object according to the center coordinates; Drawing a symbol for marking the target object according to the center coordinates includes: Connecting pixel points corresponding to respective pixel coordinates in the pixel coordinate set to obtain a curved frame of the target object in the monitoring image; Draw a preset image frame with the central coordinates as the geometric center and including the curved frame; or Taking the center coordinate as a starting point and following a preset direction, drawing a marker associated with the target object at a position at a preset distance from the center coordinate in an outer area of ​​the curved frame; Get the pixel coordinate set corresponding to the target object, including: Obtain the farthest pixel point of the area where the target object is located in the four directions of up, down, left and right of the monitoring image; determine a first horizontal line containing the farthest pixel point in the upper direction, and a second horizontal line containing the farthest pixel point in the lower direction; determine a first vertical line containing the farthest pixel point in the left direction, and a second vertical line containing the farthest pixel point in the right direction; the pixel point at the intersection of the first horizontal line and the first vertical line is a first pixel point, the pixel point at the intersection of the first horizontal line and the second vertical line is a second pixel point, the pixel point at the intersection of the first horizontal line and the first vertical line is a third pixel point, and the pixel point at the intersection of the second horizontal line and the second vertical line is a fourth pixel point; add the first pixel point, the second pixel point, the third pixel point and the fourth pixel point to the pixel coordinate set; The drawing of a preset image frame with the central coordinate as the geometric center and including the curved frame includes: The frame formed by the first horizontal line, the second horizontal line, the first vertical line and the second vertical line is a minimum rectangular frame; the minimum rectangular frame is used as a symbol for marking the target object; Obtain the pixel coordinate set corresponding to the target object in the surveillance image, including: Obtaining monitoring equipment information and characteristic information of a target object within a target area; wherein the characteristic information of the target object is characteristic information that uniquely identifies the target object; Obtaining a real-time monitoring video stream within the target area based on monitoring device information within the target area; identifying, in the real-time monitoring video stream, frames containing monitoring images of the target object based on the characteristic information of the target object; For each frame of the surveillance image containing the target object, a pixel coordinate set corresponding to the target object is obtained.

2. The method according to claim 1, characterized in that Determining the center coordinates of each pixel coordinate in the pixel coordinate set includes: Obtaining a minimum rectangular frame containing the coordinates of each pixel in the pixel coordinate set; The coordinates of the intersection of the diagonals of the minimum rectangular frame are determined as the center coordinates of the target object.

3. The method according to claim 1, characterized in that The method further comprises: Determine the device identifier of the target monitoring device to which the real-time monitoring video stream containing the target object belongs; Displaying a real-time surveillance video stream containing the surveillance image, including: According to the device identification of the target monitoring device, a real-time monitoring video stream containing the monitoring image is read from the target monitoring device and displayed.

4. The method according to claim 1, wherein Displaying a real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves with the target object in real time, includes: When there are multiple target monitoring devices to which the real-time monitoring video stream containing the target object belongs, dividing the display area into multiple sub-areas corresponding to the number of the target monitoring devices; The real-time monitoring video stream corresponding to each target monitoring device is displayed in the display area in a manner of displaying the real-time monitoring video stream of a target monitoring device in a sub-area, and the symbol is displayed in each real-time monitoring video stream respectively, and the symbol follows the movement of the target object in real time.

5. A monitoring display device, characterized in that: include: An acquisition module, configured to obtain a pixel coordinate set corresponding to a target object in a monitoring image, wherein the pixel coordinates in the pixel coordinate set are used to determine a contour of the target object in the monitoring image; The monitoring image is composed of a plurality of pixels, each of which has a pixel coordinate; Obtaining a pixel coordinate set corresponding to a target object, including: obtaining the farthest pixel point in the four directions of up, down, left, and right of the monitoring image in the area where the target object is located; determining a first horizontal line containing the farthest pixel point in the upper direction, and a second horizontal line containing the farthest pixel point in the lower direction; determining a first vertical line containing the farthest pixel point in the left direction, and a second vertical line containing the farthest pixel point in the right direction; a pixel point at the intersection of the first horizontal line and the first vertical line is a first pixel point, a pixel point at the intersection of the first horizontal line and the second vertical line is a second pixel point, a pixel point at the intersection of the first horizontal line and the first vertical line is a third pixel point, and a pixel point at the intersection of the second horizontal line and the second vertical line is a fourth pixel point; and adding the first pixel point, the second pixel point, the third pixel point, and the fourth pixel point to the pixel coordinate set; a drawing module, configured to draw a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set; The drawing module further includes: A first determining submodule, configured to determine the center coordinates of each pixel coordinate in the pixel coordinate set; A first drawing submodule, configured to draw a symbol for marking the target object according to the center coordinates; The first drawing submodule also includes: A connecting submodule, configured to connect the pixel points corresponding to the respective pixel coordinates in the pixel coordinate set to obtain a curved frame of the target object in the monitoring image; a second drawing submodule, configured to draw a preset image frame with the central coordinate as the geometric center and including the curved frame; the drawing of the preset image frame with the central coordinate as the geometric center and including the curved frame includes: a frame formed by the first horizontal line, the second horizontal line, the first vertical line, and the second vertical line as a minimum rectangular frame; and using the minimum rectangular frame as a symbol for marking the target object; or a third drawing submodule, configured to draw, with the center coordinate as a starting point and in a preset direction, a marker associated with the target object at a position at a preset distance from the center coordinate in an outer area of ​​the curved frame; A display module, configured to display a real-time monitoring video stream containing the monitoring image, and display the symbol in the real-time monitoring video stream, wherein the symbol moves in real time following the target object; The second acquisition submodule is used to obtain monitoring equipment information and characteristic information of the target object in the target area; the characteristic information of the target object is characteristic information that uniquely identifies the target object; A third obtaining submodule is configured to obtain a real-time monitoring video stream within the target area based on monitoring device information within the target area; an identification submodule, configured to identify, in the real-time monitoring video stream, monitoring images containing the target object in each frame based on the characteristic information of the target object; The fourth obtaining submodule is configured to obtain a pixel coordinate set corresponding to the target object in each frame of the surveillance image containing the target object.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the monitoring and display method according to any one of claims 1 to 4 are implemented.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When executed, the processor implements the steps in the monitoring and display method according to any one of claims 1 to 4.

Images