Data processing method, device, terminal device and storage medium

Abstract

An embodiment of the present invention provides a data processing method, apparatus, terminal device and storage medium, the method comprising: receiving an analysis request sent by a visual network monitoring network management and scheduling platform, sending analysis information of multiple target monitoring videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring video to a visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; receiving the processed monitoring video data returned by the visual network target terminal, and distributing the monitoring video to be processed to the visual network terminal for processing through the embodiment of the present invention, instead of concentrating the processing on the big data management server, thereby improving the data analysis efficiency and analysis speed.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a data processing method, apparatus, terminal equipment and storage medium. Background Art

[0002] In an era of explosive growth in video data, video big data has had a profound impact on social economy, politics, culture, and people's lives, and has also brought new challenges and opportunities to human data management capabilities.

[0003] If you want to mine useful data from massive video data, you need an independent video big data analysis server to perform a large amount of calculations. However, due to the limitations of the server hardware configuration or the network transmission capacity, the analysis efficiency and speed are slow during data processing. Summary of the Invention

[0004] In view of the above problems, embodiments of the present invention are proposed to provide a data processing method, apparatus, terminal device, and storage medium that overcome the above problems or at least partially solve the above problems.

[0005] In a first aspect, an embodiment of the present invention provides a data processing method, the method comprising:

[0006] Receive an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules;

[0007] Sending analysis information of the multiple target surveillance videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target surveillance videos to a visual network target terminal, so that the visual network target terminal processes the target surveillance video data corresponding to the basic information of the target surveillance video according to the target data analysis rule to obtain processed surveillance video data;

[0008] Receive the processed monitoring video data returned by the visual network destination terminal.

[0009] Optionally, after receiving the analysis request sent by the visual network monitoring network management and scheduling platform, the method further includes:

[0010] Obtaining the working status of the visual network terminal, the hardware resource utilization of the visual network terminal and the hardware resource utilization of the monitoring access server sent by the visual network network management server;

[0011] Load balancing calculation is performed based on the working status of the visual network terminal, the hardware resource utilization of the visual network terminal and the hardware resource utilization of the monitoring access server to obtain analysis allocation data, wherein the analysis allocation data includes the allocation data of the visual network terminal and the allocation data of the monitoring access server, the allocation data of the visual network terminal includes the visual network number of the visual network destination terminal and the processing capacity data corresponding to the visual network destination terminal, and the allocation data of the monitoring access server includes the visual network number of the destination monitoring access server and the processing capacity data corresponding to the destination monitoring access server.

[0012] Optionally, the sending of the analysis information of the plurality of target surveillance videos to a surveillance access server, so that the surveillance access server sends the analysis information of the target surveillance videos to a target terminal in the visual network, includes:

[0013] According to the size of the processing capacity data corresponding to the destination monitoring access server, the analysis information of the destination monitoring video and the allocation data of the visual network terminal are sent to the destination monitoring access server corresponding to the processing capacity data, so that the destination monitoring access server allocates the analysis information of the monitoring video according to the allocation data of the visual network terminal.

[0014] Optionally, the destination monitoring access server distributes the analysis information of the monitoring video according to the distribution data of the visual network terminal, including:

[0015] The target monitoring access server obtains target analysis video data corresponding to the basic information of the target monitoring video from the video storage server according to the analysis information of the monitoring video;

[0016] According to the working status of the visual networking terminal and the size of the processing capability data, the destination monitoring access server sends the destination analysis video data and the destination data analysis rules to the visual networking destination terminal corresponding to the processing capability data.

[0017] Optionally, the destination monitoring access server sends the destination analysis video data and the destination data analysis rule to a visual network destination terminal corresponding to the hardware resource utilization, including:

[0018] The target monitoring access server segments the target analysis video data to obtain segmented video data;

[0019] The destination monitoring access server sends the segmented video data to the visual network destination terminal corresponding to the processing capability data according to the size of the processing capability data corresponding to the visual network destination terminal.

[0020] Optionally, the destination monitoring access server fragments the destination analysis video data to obtain fragmented video data, including:

[0021] The target monitoring access server analyzes the target analysis video data to obtain an I-frame image;

[0022] The destination monitoring access server performs fragmentation according to the I-frame image to obtain video data of the fragments, wherein the video data of the fragments includes a video identifier and a fragment identifier.

[0023] Optionally, the receiving the processed surveillance video data returned by the visual network destination terminal includes:

[0024] Receive the combined processed data returned by the destination monitoring access server, wherein the combined processed data is obtained by the destination monitoring access server after receiving the processed monitoring video data sent by the visual network destination terminal, by combining the processed monitoring video data according to the video identifier and the fragment identifier.

[0025] Optionally, before receiving the analysis request sent by the visual network monitoring network management and scheduling platform, the method further includes:

[0026] Receive a monitoring device list sent by a video storage server, wherein the monitoring device list includes analysis information of the monitoring video, wherein the analysis information of the monitoring video includes basic information of the monitoring video and data analysis rules, and the basic information of the monitoring video includes monitoring video name and time period information.

[0027] In a second aspect, an embodiment of the present invention provides a data processing device, comprising:

[0028] A receiving module, configured to receive an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules;

[0029] A first distribution module is configured to send analysis information of the plurality of target surveillance videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target surveillance videos to a visual network target terminal, so that the visual network target terminal processes the target surveillance video data corresponding to the basic information of the target surveillance video according to the target data analysis rule to obtain processed surveillance video data;

[0030] The return module is used to receive the processed monitoring video data returned by the visual network destination terminal.

[0031] Optionally, the device further includes a calculation module, wherein the calculation module is configured to:

[0032] Obtaining the working status of the visual network terminal, the hardware resource utilization of the visual network terminal and the hardware resource utilization of the monitoring access server sent by the visual network network management server;

[0033] Load balancing calculation is performed based on the working status of the visual network terminal, the hardware resource utilization of the visual network terminal and the hardware resource utilization of the monitoring access server to obtain analysis allocation data, wherein the analysis allocation data includes the allocation data of the visual network terminal and the allocation data of the monitoring access server, the allocation data of the visual network terminal includes the visual network number of the visual network destination terminal and the processing capacity data corresponding to the visual network destination terminal, and the allocation data of the monitoring access server includes the visual network number of the destination monitoring access server and the processing capacity data corresponding to the destination monitoring access server.

[0034] Optionally, the first allocation module is used to:

[0035] According to the size of the processing capacity data corresponding to the destination monitoring access server, the analysis information of the destination monitoring video and the allocation data of the visual network terminal are sent to the destination monitoring access server corresponding to the processing capacity data, so that the destination monitoring access server allocates the analysis information of the monitoring video according to the allocation data of the visual network terminal.

[0036] Optionally, the destination monitoring access server includes a second allocation module, and the second allocation module is configured to:

[0037] According to the analysis information of the monitoring video, obtaining the target analysis video data corresponding to the basic information of the target monitoring video from the video storage server;

[0038] According to the working status of the visual networking terminal and the size of the processing capability data, the target analysis video data and the target data analysis rules are sent to the visual networking target terminal corresponding to the processing capability data.

[0039] Optionally, the second allocation module is used to:

[0040] Slicing the target analysis video data to obtain sliced ​​video data;

[0041] According to the size of the processing capability data corresponding to the visual network destination terminal, the segmented video data is sent to the visual network destination terminal corresponding to the processing capability data.

[0042] Optionally, the second allocation module is used to:

[0043] Parsing the target analysis video data to obtain I frame images;

[0044] Slice the image according to the I frame to obtain video data of the slices, wherein the video data of the slices includes a video identifier and a slice identifier.

[0045] Optionally, the return module is used to:

[0046] Receive the combined processed data returned by the destination monitoring access server, wherein the combined processed data is obtained by the destination monitoring access server after receiving the processed monitoring video data sent by the visual network destination terminal, by combining the processed monitoring video data according to the video identifier and the fragment identifier.

[0047] Optionally, the device further includes an acquisition module, wherein the acquisition module is configured to:

[0048] Receive a monitoring device list sent by a video storage server, wherein the monitoring device list includes analysis information of the monitoring video, wherein the analysis information of the monitoring video includes basic information of the monitoring video and data analysis rules, and the basic information of the monitoring video includes monitoring video name and time period information.

[0049] In a third aspect, an embodiment of the present invention provides a terminal device, comprising: at least one processor and a memory;

[0050] The memory stores a computer program; the at least one processor executes the computer program stored in the memory to implement the data processing method provided in the first aspect.

[0051] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed, the data processing method provided in the first aspect is implemented.

[0052] The embodiments of the present invention include the following advantages:

[0053] The data processing method, apparatus, terminal device and storage medium provided by the embodiments of the present invention are as follows: a big data management server receives an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; the analysis information of the multiple target monitoring videos is sent to the monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to the visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; the processed monitoring video data returned by the visual network target terminal is received, and the monitoring video to be processed is distributed to the visual network terminal for processing through the embodiments of the present invention, instead of being concentrated on the big data management server for processing, thereby improving data analysis efficiency and analysis speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 is a flowchart of steps of an embodiment of a data processing method of the present invention;

[0055] Figure 2 is a flowchart of steps of another data processing method embodiment of the present invention;

[0056] Figure 3 is a schematic structural diagram of a data processing system embodiment of the present invention;

[0057] Figure 4 is a flowchart of steps of another data processing method embodiment of the present invention;

[0058] Figure 5 is a structural block diagram of an embodiment of a data processing device of the present invention;

[0059] Figure 6 It is a structural schematic diagram of a terminal device of the present invention. DETAILED DESCRIPTION

[0060] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0061] The visual Internet is an important milestone in the development of the Internet. It is a real-time network that can realize real-time transmission of high-definition video, pushing many Internet applications towards high-definition video and high-definition face-to-face communication.

[0062] The visual network adopts real-time high-definition video exchange technology, which can integrate the required services such as high-definition video conferencing, video monitoring, intelligent monitoring analysis, emergency command, digital radio and television, delayed TV, online teaching, live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release and dozens of other video, voice, image, text, communication, data and other services into one system platform, and realize high-definition quality video playback through TV or computer.

[0063] The glossary is explained as follows:

[0064] Surveillance Access Service: The Visual Network Surveillance Access Service System is a core device that connects Internet surveillance resources to the Visual Network, serving as a crucial link in converged surveillance applications. It supports access to surveillance front-end equipment, video surveillance systems, and video surveillance networking platforms from various vendors. It offers low-latency audio and video protocol conversion capabilities, enabling the convergence and real-time scheduling of surveillance resources within the Visual Network.

[0065] Network Management Services: The Visual Network Management System (VMS) supports the normal operation of the visual network and is a powerful network management and maintenance system. The system coordinates and manages all devices and resources within the visual network, aligned with operational models and workflows. The system boasts operational-grade real-time HD video communication capabilities, supporting hundreds of millions of users and ensuring the stable operation of operational-grade HD video services.

[0066] Video big data analysis: Video big data analysis, also known as intelligent video analysis, refers to the use of computer algorithms to mine useful data from video data, giving computers the ability to "see" like the human eye and the "thinking" function of the human brain.

[0067] An embodiment of the present invention provides a data processing method for distributing surveillance videos to be analyzed to visual network terminals for processing. The execution subject of this embodiment is a data processing device, which is installed in a big data management server.

[0068] Reference Figure 1 , shows a flowchart of a data processing method embodiment of the present invention, which may specifically include the following steps:

[0069] S101, receiving an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules;

[0070] Specifically, if you want to analyze multiple surveillance videos, the user can select the surveillance videos to be analyzed on the visual network monitoring network management and scheduling platform. The visual network monitoring network management and scheduling platform sends an analysis request for the surveillance video to the big data management server, where the analysis request includes analysis information of multiple target surveillance videos, and the analysis information includes basic information of the target surveillance video and target data analysis rules, where the basic information includes the name and time period of the surveillance video, and the target data analysis rules include face recognition rules, license plate recognition rules or object recognition rules, etc.

[0071] S102. Sending analysis information of the multiple target surveillance videos to a surveillance access server, so that the surveillance access server sends the analysis information of the target surveillance videos to a visual network target terminal, so that the visual network target terminal processes the target surveillance video data corresponding to the basic information of the target surveillance video according to the target data analysis rule to obtain processed surveillance video data;

[0072] Specifically, the big data management server sends the analysis information of multiple target monitoring videos to the monitoring access server, and the monitoring access server then sends the analysis information of multiple target monitoring videos to the visual network target terminal. The visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain the processed monitoring video data.

[0073] For example, if the big data management server receives analysis information of 10 target surveillance videos, it sends the analysis information of these 10 target surveillance videos to 10 visual network terminals for processing. The visual network target terminals process the target surveillance video data corresponding to the basic information of the target surveillance video according to the target data analysis rules to obtain processed surveillance video data. For example, the visual network target terminals perform face recognition, license plate recognition or object recognition on the target surveillance video data to obtain processed surveillance video data.

[0074] S103: Receive the processed surveillance video data returned by the visual network destination terminal.

[0075] Specifically, the visual network destination terminal sends the processed surveillance video data to the big data management server through the monitoring access server, and the big data management server then sends the processed surveillance video data to the visual network monitoring network management and scheduling platform. In this way, users can see the processed surveillance video data on the visual network monitoring network management and scheduling platform.

[0076] The data processing method provided by the embodiment of the present invention receives an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; sends the analysis information of the multiple target monitoring videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to a visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; receives the processed monitoring video data returned by the visual network target terminal, and distributes the monitoring video to be processed to the visual network terminal for processing through the embodiment of the present invention, instead of concentrating the processing on the big data management server, thereby improving the data analysis efficiency and analysis speed.

[0077] Another embodiment of the present invention further supplements the data processing method provided in the above embodiment.

[0078] like Figure 2 FIG. 1 is a flowchart showing another data processing method embodiment of the present invention, wherein the data processing method includes:

[0079] S201. Receive a monitoring device list sent by a video storage server, wherein the monitoring device list includes analysis information of the monitoring video, wherein the analysis information of the monitoring video includes basic information of the monitoring video and data analysis rules, and the basic information of the monitoring video includes a monitoring video name and time period information.

[0080] Specifically, the big data management server obtains a monitoring device list from the video storage server in advance. The monitoring device list includes analysis information of the monitoring video, such as the monitoring video name, time period information, etc.

[0081] S202: Receive an analysis request sent by the visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules;

[0082] Since step S202 is Figure 1 The step S101 in the embodiment shown is the same. Figure 1 Step S101 has been described in detail in , so step S202 will not be described again here.

[0083] S203, obtaining the working status of the visual network terminal, the hardware resource utilization of the visual network terminal, and the hardware resource utilization of the monitoring access server sent by the visual network network management server;

[0084] Specifically, the visual network network management server is connected to the monitoring access service and the visual network terminal respectively. The visual network network management server obtains the working status sent by the visual network terminal and the hardware resource utilization of the visual network terminal, and simultaneously obtains the hardware resource utilization of the monitoring access server.

[0085] For example, the working status of the visual networking terminal is in a conference, the hardware resource utilization rate is 50%, the hardware resource utilization rate of the monitoring access server is 20%, and so on.

[0086] S204. Perform load balancing calculation based on the working status of the visual network terminal, the hardware resource utilization of the visual network terminal, and the hardware resource utilization of the monitoring access server to obtain analysis allocation data, wherein the analysis allocation data includes the allocation data of the visual network terminal and the allocation data of the monitoring access server, the allocation data of the visual network terminal includes the visual network number of the visual network destination terminal and the processing capacity data corresponding to the visual network destination terminal, and the allocation data of the monitoring access server includes the visual network number of the destination monitoring access server and the processing capacity data corresponding to the destination monitoring access server.

[0087] Specifically, the big data management server performs load balancing calculations based on the working status of the visual network terminal, the hardware resource utilization of the visual network terminal, and the hardware resource utilization of the monitoring access server to obtain analysis and allocation data. The analysis and allocation data include the allocation data of the visual network terminal and the allocation data of the monitoring access server. For example, if the system includes 2 monitoring access servers and 3 visual network terminals, and the 3 visual network terminals are in a meeting, the hardware resource utilization of terminal 1 is 100%, the hardware resource utilization of terminal 2 is 50%, and the hardware resource utilization of terminal 3 is 20%. After load calculation, the analysis and allocation data of the visual network terminals are obtained, including the visual network number of terminal 1, the corresponding processing capacity data is 0, the visual network number of terminal 2, the corresponding processing capacity data is 0.5, and the visual network number of terminal 3, the corresponding processing capacity data is 0.8.

[0088] The hardware resource utilization of monitoring access server 1 is 80%, and the hardware resource utilization of monitoring access server 2 is 30%. After load calculation, the allocation data of the monitoring access servers is obtained, including the processing capacity data of monitoring access server 1 is 0.2, and the processing capacity data of monitoring access server 2 is 0.8.

[0089] S205. According to the size of the processing capacity data corresponding to the destination monitoring access server, the analysis information of the destination monitoring video and the allocation data of the visual network terminal are sent to the destination monitoring access server corresponding to the processing capacity data.

[0090] Specifically, the big data management server sends the analysis information of the destination monitoring video and the allocation data of the visual network terminal to monitoring access server 2 first based on the size of the processing capacity data of the destination access server. For example, the processing capacity data of monitoring access server 1 is 0.2, and the processing capacity data of monitoring access server 2 is 0.8. When monitoring access server 2 is fully loaded, the analysis information of the destination monitoring video and the allocation data of the visual network terminal are sent to monitoring access server 1.

[0091] S206. The destination monitoring access server distributes the analysis information of the monitoring video according to the distribution data of the visual network terminal. The destination monitoring access server obtains the destination analysis video data corresponding to the basic information of the destination monitoring video from the video storage server according to the analysis information of the monitoring video.

[0092] Specifically, the monitoring access server 2 or the monitoring access server 1 obtains the target analysis video data corresponding to the monitoring video name and time period from the video storage server according to the received monitoring video analysis information, such as the monitoring video name and time period.

[0093] S207: The destination monitoring access server segments the destination analysis video data to obtain segmented video data.

[0094] Specifically, after obtaining the target analysis video data, the target monitoring access server segments the target analysis video data in order to increase data processing efficiency and speed. Specifically, the target analysis video data is parsed to obtain an I-frame image. Specifically, an I-frame is also called an intra picture. An I-frame is usually the first frame of each GOP (a video compression technology used by MPEG). After being moderately compressed, it can be used as a reference point for random access and can be used as an image.

[0095] The destination monitoring access server segments the destination analysis video data according to the I-frame image to obtain segmented video data, wherein the segmented video data includes a video identifier and a segment identifier.

[0096] For example, when the number of visual network terminals is large enough, 10 surveillance videos can be segmented into 20 surveillance videos, and the analysis information of the 20 surveillance videos can be sent to the 20 visual network terminals for processing. Each segmented surveillance video includes a video name and a segment identifier, such as the segment number of a certain video.

[0097] S208. The destination monitoring access server sends the segmented video data to the visual network destination terminal corresponding to the processing capability data according to the size of the processing capability data corresponding to the visual network destination terminal.

[0098] Specifically, the destination access server prioritizes sending the video data of the fragments to be processed to the visual network destination terminal corresponding to the visual network number of terminal 3 based on the size of the processing capacity data of the visual network destination terminal. For example, the visual network number of terminal 1 corresponds to a processing capacity data of 0, the visual network number of terminal 2 corresponds to a processing capacity data of 0.5, and the visual network number of terminal 3 corresponds to a processing capacity data of 0.8. If terminal 3 is fully loaded, the video data of the fragments to be processed will be sent to terminal 2. Since the processing capacity data of terminal 1 is 0, no new tasks will be assigned to terminal 1.

[0099] S209. The visual network destination terminal processes the destination monitoring video data corresponding to the basic information of the destination monitoring video according to the destination data analysis rule to obtain processed monitoring video data;

[0100] Specifically, after receiving the destination data analysis rules and destination monitoring video data sent by the monitoring access server, the destination terminal of the visual network executes the destination data analysis rules on the destination monitoring video data, such as face recognition, license plate recognition or object recognition, to obtain processed monitoring video data.

[0101] S210. Receive the combined processed data returned by the destination monitoring access server, wherein the combined processed data is obtained by the destination monitoring access server after receiving the processed monitoring video data sent by the visual network destination terminal, by combining the processed monitoring video data according to the video identifier and the fragment identifier.

[0102] Specifically, the destination terminal of the visual network sends the processed monitoring video data to the destination access server. The processed monitoring video data includes a video identifier and a fragment identifier. The monitoring access server merges the processed monitoring video data according to the video identifier and the fragment identifier, and then sends the merged combined processed data to the big data management server. The big data management server then sends the combined processed data to the visual network monitoring network management and scheduling platform.

[0103] Figure 3 Schematic diagram of the structure of the data processing system embodiment of the present invention, as shown in FIG. Figure 3As shown, the data processing system includes a visual network monitoring network management and scheduling platform, a video big data management server, a video storage server, a monitoring access server 1, a monitoring access server 2, a visual network network management server, multiple monitoring devices (e.g., monitoring devices 01 to 08), and multiple visual network terminal devices (e.g., visual network terminal devices 01 to visual network terminal devices n), wherein:

[0104] The following conditions must be met for the network monitoring and management scheduling platform to conduct intelligent analysis of video surveillance recording big data:

[0105] The monitoring equipment is connected to the video storage server;

[0106] The video storage server is connected to the monitoring access server, such as monitoring access server 1 and monitoring access server 2;

[0107] Visual Internet terminals, monitoring access servers, and video big data management servers are connected to the visual Internet network management server.

[0108] The visual network monitoring network management and scheduling platform is connected to the video big data management server.

[0109] The video big data management server is connected to the video storage server and the monitoring access server.

[0110] Figure 4 : is a flowchart of another data processing method embodiment of the present invention, such as Figure 4 As shown, the data processing method includes:

[0111] (1) The monitoring device is connected to the video storage server to store the video monitoring data in the video storage server.

[0112] (2) The monitoring access server is connected to the visual network management server for connection identity authentication.

[0113] (3) The video big data management server is connected to the visual network management server for connection identity authentication.

[0114] (4) The visual network terminal is connected to the visual network network management server for connection identity authentication.

[0115] (5) The video storage server is connected to the monitoring access server for connection identity authentication.

[0116] (6) The video big data management server is connected to the video storage server for connection identity authentication.

[0117] (7) The visual network terminal sends the current terminal service status and terminal hardware resource utilization to the visual network network manager.

[0118] (8) The visual network network manager forwards the terminal service status and terminal hardware resource utilization sent by the visual network terminal to the video big data management server.

[0119] (9) The video big data management server will save the current business status of the video network terminal and the utilization rate of hardware resources.

[0120] (10) The monitoring access server sends the current hardware resource utilization to the visual network manager.

[0121] (11) The visual network manager forwards the hardware resource utilization sent by the monitoring access server to the video big data management server.

[0122] (12) The video big data management server will save the current hardware resource utilization of the monitoring access server.

[0123] (13) The video big data management server will obtain the video surveillance recording resource list data from the video storage server.

[0124] (14) When the video big data management server obtains the video surveillance recording resource list data, it saves it.

[0125] (15) When conducting intelligent analysis of video big data, you need to log in to the video network monitoring and management scheduling platform first.

[0126] (16) When logging into the visual network monitoring network management and scheduling platform, the visual network monitoring network management and scheduling platform needs to connect to the video big data management server for connection identity authentication.

[0127] (17) After the identity authentication of the network monitoring network management and dispatching platform is successful, the monitoring video recording data analysis module is selected, that is, the analysis information of the monitoring video data to be processed.

[0128] (18) The video network monitoring network management and dispatching platform will obtain the video surveillance recording resource list data from the video big data analysis server.

[0129] (19) After the network monitoring and management scheduling platform obtains the video surveillance recording resource list data, it selects which video surveillance to analyze, selects which time period of the video surveillance recording to analyze, and selects the video intelligent analysis rules (i.e., the target data analysis rules).

[0130] (20) The selected analysis video surveillance list, the time period for video surveillance recording analysis, and the video intelligent analysis rules are sent to the video big data management service.

[0131] (21) The video big data management service receives and analyzes the video surveillance list, the time period for video surveillance recording analysis, and the video intelligent analysis rule data.

[0132] (22) The video big data management service calculates the access capacity of the monitoring access services in the monitoring access server list, that is, performs load calculation.

[0133] (23) The video big data management service calculates the data analysis capabilities of the visual network terminals in the visual network terminal list and obtains the allocation data of the visual network terminals;

[0134] (24) Video big data management services obtain data analysis and distribution data through load balancing technology.

[0135] (25) The video big data management service sends the data analysis and distribution data to each monitoring access server.

[0136] (26) The monitoring access server distributes data through data analysis and pulls the video surveillance recording data of the specified time period from the video storage server.

[0137] (27) The monitoring access server receives the video surveillance recording data and parses it to obtain the I frame data in the video surveillance recording data.

[0138] (28) The monitoring access server segments the I-frame data in the video monitoring recording data.

[0139] (29) The monitoring access server distributes data through data analysis to obtain data analysis rule data.

[0140] (30) The monitoring access server distributes data through data analysis and obtains the visual network terminal data that will be analyzed for I frame data segmentation.

[0141] (31) The monitoring access server sends the I-frame fragmentation data and the data analysis rule data to the visual network destination terminal that will analyze the I-frame data for fragmentation;

[0142] (32) After receiving the I-frame fragmentation data and the data analysis rule data, the visual network terminal performs video intelligent analysis on the I-frame fragmentation data.

[0143] (33) The visual network terminal performs video intelligent analysis on the I-frame segment data to obtain intelligent analysis result data, i.e., processed video data.

[0144] (34) The visual network terminal sends the processed video data to the monitoring access server.

[0145] (35) The monitoring access server combines the processed video data to obtain combined video data.

[0146] (36) The monitoring access server sends the combined video data to the video big data management server.

[0147] (37) After receiving the combined video data, the video big data management server forwards it to the visual network monitoring network management and scheduling platform.

[0148] The embodiments of the present invention not only improve the utilization rate of the hardware resources of the visual network, but also utilize the existing network hardware resources of the visual network to perform fast and efficient video big data intelligent analysis, and utilize the existing network hardware resources of the visual network to perform data sharding and distribution operations on video data to implement a fast and efficient video big data intelligent analysis strategy.

[0149] It should be noted that for the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0150] The data processing method provided by the embodiment of the present invention receives an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; sends the analysis information of the multiple target monitoring videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to a visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; receives the processed monitoring video data returned by the visual network target terminal, and distributes the monitoring video to be processed to the visual network terminal for processing through the embodiment of the present invention, instead of concentrating the processing on the big data management server, thereby improving the data analysis efficiency and analysis speed.

[0151] Another embodiment of the present invention provides a data processing device for executing the data processing method provided in the above embodiment.

[0152] Reference Figure 5 , shows a structural block diagram of an embodiment of a data processing device of the present invention. The device may specifically include the following modules: a receiving module 501, a first distribution module 502, and a return module 503, wherein:

[0153] The receiving module 501 is used to receive an analysis request sent by the visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules;

[0154] The first distribution module 502 is configured to send the analysis information of the plurality of target surveillance videos to the surveillance access server, so that the surveillance access server sends the analysis information of the target surveillance videos to the visual network target terminal, so that the visual network target terminal processes the target surveillance video data corresponding to the basic information of the target surveillance video according to the target data analysis rule to obtain processed surveillance video data;

[0155] The return module 503 is used to receive the processed monitoring video data returned by the visual network destination terminal.

[0156] The data processing device provided by an embodiment of the present invention receives an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; sends the analysis information of the multiple target monitoring videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to a visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; receives the processed monitoring video data returned by the visual network target terminal, and distributes the monitoring video to be processed to the visual network terminal for processing through the embodiment of the present invention, instead of concentrating the processing on the big data management server, thereby improving the data analysis efficiency and analysis speed.

[0157] Another embodiment of the present invention further supplements the data processing device provided in the above embodiment.

[0158] Optionally, the device further includes a calculation module, wherein the calculation module is configured to:

[0159] Obtaining the working status of the visual network terminal, the hardware resource utilization of the visual network terminal and the hardware resource utilization of the monitoring access server sent by the visual network network management server;

[0160] Load balancing calculation is performed based on the working status of the visual network terminal, the hardware resource utilization of the visual network terminal and the hardware resource utilization of the monitoring access server to obtain analysis allocation data, wherein the analysis allocation data includes the allocation data of the visual network terminal and the allocation data of the monitoring access server, the allocation data of the visual network terminal includes the visual network number of the visual network destination terminal and the processing capacity data corresponding to the visual network destination terminal, and the allocation data of the monitoring access server includes the visual network number of the destination monitoring access server and the processing capacity data corresponding to the destination monitoring access server.

[0161] Optionally, the first allocation module 502 is configured to:

[0162] According to the size of the processing capacity data corresponding to the destination monitoring access server, the analysis information of the destination monitoring video and the allocation data of the visual network terminal are sent to the destination monitoring access server corresponding to the processing capacity data, so that the destination monitoring access server allocates the analysis information of the monitoring video according to the allocation data of the visual network terminal.

[0163] Optionally, the destination monitoring access server includes a second allocation module, and the second allocation module is configured to:

[0164] According to the analysis information of the monitoring video, obtaining the target analysis video data corresponding to the basic information of the target monitoring video from the video storage server;

[0165] According to the working status of the visual networking terminal and the size of the processing capability data, the target analysis video data and the target data analysis rules are sent to the visual networking target terminal corresponding to the processing capability data.

[0166] Optionally, the second allocation module is used to:

[0167] Slicing the target analysis video data to obtain sliced ​​video data;

[0168] According to the size of the processing capability data corresponding to the visual network destination terminal, the segmented video data is sent to the visual network destination terminal corresponding to the processing capability data.

[0169] Optionally, the second allocation module is used to:

[0170] Parsing the target analysis video data to obtain I frame images;

[0171] Slice the image according to the I frame to obtain video data of the slices, wherein the video data of the slices includes a video identifier and a slice identifier.

[0172] Optionally, the returning module 503 is used to:

[0173] Receive the combined processed data returned by the destination monitoring access server, wherein the combined processed data is obtained by the destination monitoring access server after receiving the processed monitoring video data sent by the visual network destination terminal, by combining the processed monitoring video data according to the video identifier and the fragment identifier.

[0174] Optionally, the device further includes an acquisition module, wherein the acquisition module is configured to:

[0175] Receive a monitoring device list sent by a video storage server, wherein the monitoring device list includes analysis information of the monitoring video, wherein the analysis information of the monitoring video includes basic information of the monitoring video and data analysis rules, and the basic information of the monitoring video includes monitoring video name and time period information.

[0176] It should be noted that each implementable method in this embodiment can be implemented separately, or can be implemented in combination in any combination without conflict, and this application does not limit it.

[0177] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0178] The data processing device provided by an embodiment of the present invention receives an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; sends the analysis information of the multiple target monitoring videos to a monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to a visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; receives the processed monitoring video data returned by the visual network target terminal, and distributes the monitoring video to be processed to the visual network terminal for processing through the embodiment of the present invention, instead of concentrating the processing on the big data management server, thereby improving the data analysis efficiency and analysis speed.

[0179] Yet another embodiment of the present invention provides a terminal device for executing the data processing method provided in the above embodiment.

[0180] Figure 6 This is a schematic diagram of the structure of a terminal device of the present invention, such as Figure 6 As shown, the terminal device includes: at least one processor 601 and a memory 602;

[0181] The memory stores a computer program; and the at least one processor executes the computer program stored in the memory to implement the data processing method provided in the above embodiment.

[0182] The terminal device provided in this embodiment receives an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; sends the analysis information of the multiple target monitoring videos to the monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to the visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; receives the processed monitoring video data returned by the visual network target terminal, and distributes the monitoring video to be processed to the visual network terminal for processing through the embodiment of the present invention, instead of concentrating the processing on the big data management server, thereby improving the data analysis efficiency and analysis speed.

[0183] Yet another embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed, the data processing method provided in any of the above embodiments is implemented.

[0184] According to the computer-readable storage medium of this embodiment, by receiving an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, and the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules; the analysis information of the multiple target monitoring videos is sent to the monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to the visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rules to obtain processed monitoring video data; the processed monitoring video data returned by the visual network target terminal is received, and the monitoring video to be processed is distributed to the visual network terminal for processing through the embodiment of the present invention, instead of being concentrated on the big data management server for processing, thereby improving data analysis efficiency and analysis speed.

[0185] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0186] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, apparatus, or computer program products. Thus, embodiments of the present invention may take the form of a fully hardware embodiment, a fully software embodiment, or an embodiment combining software and hardware. Furthermore, embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0187] The embodiments of the present invention are described with reference to flowcharts and / or block diagrams of methods, electronic devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing electronic device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing electronic device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0188] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing electronic device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0189] These computer program instructions can also be loaded onto a computer or other programmable data processing electronic device so that a series of operating steps are executed on the computer or other programmable electronic device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable electronic device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0190] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic creative concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0191] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises", or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or electronic device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements that are inherent to such process, method, article, or electronic device. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of additional identical elements in the process, method, article, or electronic device that includes the element.

[0192] The data processing method and data processing device provided by the present invention are introduced in detail above. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A data processing method, characterized in that: The method comprises: Receiving an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules, the basic information includes the name and time period of the monitoring video, and the target data analysis rules include face recognition rules, license plate recognition rules or object recognition rules; Obtaining the working status of the visual networking terminal, the hardware resource utilization of the visual networking terminal and the hardware resource utilization of the monitoring access server sent by the visual networking network management server; Perform load balancing calculation according to the working state of the visual networking terminal, the hardware resource utilization of the visual networking terminal and the hardware resource utilization of the monitoring access server to obtain analysis allocation data, wherein the analysis allocation data includes allocation data of the visual networking terminal and allocation data of the monitoring access server, the allocation data of the visual networking terminal includes the visual networking number of the visual networking destination terminal and the processing capacity data corresponding to the visual networking destination terminal, and the allocation data of the monitoring access server includes the visual networking number of the destination monitoring access server and the processing capacity data corresponding to the destination monitoring access server; Sending the analysis information of the multiple target monitoring videos to the monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to the visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rule to obtain the processed monitoring video data; Receiving the processed surveillance video data returned by the visual network destination terminal; The step of sending the analysis information of the plurality of target surveillance videos to a surveillance access server so that the surveillance access server sends the analysis information of the target surveillance videos to a target terminal of the visual network includes: According to the size of the processing capacity data corresponding to the destination monitoring access server, the analysis information of the destination monitoring video and the allocation data of the visual networking terminal are sent to the destination monitoring access server corresponding to the processing capacity data, so that the destination monitoring access server allocates the analysis information of the monitoring video according to the allocation data of the visual networking terminal.

2. The method according to claim 1, characterized in that The target monitoring access server distributes the analysis information of the monitoring video according to the distribution data of the visual networking terminal, including: The target monitoring access server obtains target analysis video data corresponding to the basic information of the target monitoring video from the video storage server according to the analysis information of the monitoring video; According to the working status of the visual networking terminal and the size of the processing capability data, the destination monitoring access server sends the destination analysis video data and the destination data analysis rules to the visual networking destination terminal corresponding to the processing capability data.

3. The method according to claim 2, characterized in that The destination monitoring access server sends the destination analysis video data and the destination data analysis rule to the visual network destination terminal corresponding to the hardware resource utilization, including: The destination monitoring access server segments the destination analysis video data to obtain segmented video data; The destination monitoring access server sends the segmented video data to the visual network destination terminal corresponding to the processing capability data according to the size of the processing capability data corresponding to the visual network destination terminal.

4. The method according to claim 3, characterized in that The target monitoring access server segments the target analysis video data to obtain segmented video data, including: The target monitoring access server analyzes the target analysis video data to obtain an I frame image; The destination monitoring access server performs segmentation according to the I frame image to obtain the segmented video data, wherein the segmented video data includes a video identifier and a segment identifier.

5. The method according to claim 4, characterized in that The receiving the processed surveillance video data returned by the visual network destination terminal includes: Receive the combined processed data returned by the destination monitoring access server, wherein the combined processed data is obtained by the destination monitoring access server after receiving the processed monitoring video data sent by the visual network destination terminal, by combining the processed monitoring video data according to the video identifier and the fragment identifier.

6. The method according to claim 1, characterized in that Before receiving the analysis request sent by the visual network monitoring network management and scheduling platform, the method further includes: Receive a monitoring device list sent by a video storage server, wherein the monitoring device list includes analysis information of the monitoring video, wherein the analysis information of the monitoring video includes basic information of the monitoring video and data analysis rules, and the basic information of the monitoring video includes a monitoring video name and time period information.

7. A data processing device, characterized in that: The device comprises: A receiving module, used to receive an analysis request sent by a visual network monitoring network management and scheduling platform, wherein the analysis request includes analysis information of multiple target monitoring videos, the analysis information of the target monitoring videos includes basic information of the target monitoring videos and target data analysis rules, the basic information includes the name and time period of the monitoring video, and the target data analysis rules include face recognition rules, license plate recognition rules or object recognition rules; A calculation module, used to obtain the working status of the visual networking terminal, the hardware resource utilization of the visual networking terminal and the hardware resource utilization of the monitoring access server sent by the visual networking network management server; perform load balancing calculation according to the working status of the visual networking terminal, the hardware resource utilization of the visual networking terminal and the hardware resource utilization of the monitoring access server to obtain analysis allocation data, wherein the analysis allocation data includes the allocation data of the visual networking terminal and the allocation data of the monitoring access server, the allocation data of the visual networking terminal includes the visual networking number of the visual networking destination terminal and the processing capacity data corresponding to the visual networking destination terminal, and the allocation data of the monitoring access server includes the visual networking number of the destination monitoring access server and the processing capacity data corresponding to the destination monitoring access server; A first allocation module is used to send the analysis information of the multiple target monitoring videos to the monitoring access server, so that the monitoring access server sends the analysis information of the target monitoring videos to the visual network target terminal, so that the visual network target terminal processes the target monitoring video data corresponding to the basic information of the target monitoring video according to the target data analysis rule to obtain the processed monitoring video data; A return module, used for receiving the processed monitoring video data returned by the visual network destination terminal; Among them, the first allocation module is also used to send the analysis information of the destination monitoring video and the allocation data of the visual networking terminal to the destination monitoring access server corresponding to the processing capacity data according to the size of the processing capacity data corresponding to the destination monitoring access server, so that the destination monitoring access server allocates the analysis information of the monitoring video according to the allocation data of the visual networking terminal.

8. A terminal device, characterized in that: include: at least one processor and memory; The memory stores a computer program; The at least one processor executes the computer program stored in the memory to implement the data processing method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the data processing method according to any one of claims 1 to 6 is implemented.

Images