Data processing method and device and electronic equipment

Abstract

The embodiment of the invention discloses a data processing method and device and electronic equipment, and the method comprises the steps: obtaining an SIP data package through an SIP server side of a video monitoring system; obtaining video data to be analyzed through a streaming media server of the video monitoring system; performing SIP analysis on the SIP data packet according to an SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; according to the first analysis result and / or the second analysis result, judging whether a video processing service corresponding to the video data is abnormal or not, and when it is determined that the video processing service is abnormal, according to the first analysis result and / or the second analysis result, determining that the video processing service is abnormal. And determining an exception handling strategy for the video processing service.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and in particular, to a data processing method and device and electronic equipment. BACKGROUND

[0002] With the rapid development of computer network technology, video monitoring is widely applied due to its instantaneity and rich information content, and plays an increasingly important role in city security. The monitoring devices in the current security industry all support the GB / T28181 standard, which specifies many technical requirements in the security monitoring network system and solves the problem of system interconnection.

[0003] However, in the process of video monitoring application, it is still necessary for a person to detect whether there is an anomaly in the video monitoring scene, resulting in low anomaly detection efficiency and accuracy, and poor video monitoring effect. Therefore, a technical solution is needed to improve the anomaly detection efficiency and accuracy in the video monitoring scene and improve the video monitoring effect. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide a technical solution for improving the anomaly detection efficiency and accuracy in the video monitoring scene and improving the video monitoring effect.

[0005] To solve the above technical problems, the embodiments of the present application are implemented as follows: In a first aspect, the embodiments of the present application provide a data processing method, which comprises: acquiring a SIP data packet through a SIP server of a video monitoring system; acquiring video data to be analyzed through a streaming media server of the video monitoring system; performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; judging whether there is an anomaly in a video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and determining an anomaly processing strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that there is an anomaly in the video processing service.

[0006] In a second aspect, the embodiments of the present application provide a data processing device, which comprises: a first acquiring module configured to acquire a SIP data packet through a SIP server of a video monitoring system; a second acquiring module configured to acquire video data to be analyzed through a streaming media server of the video monitoring system; a result determination module, configured to perform SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and perform video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; a policy determination module, configured to determine whether there is an exception for the video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and determine an exception processing policy for the video processing service according to the first analysis result and / or the second analysis result when it is determined that there is an exception for the video processing service.

[0007] In a third aspect, an electronic device is provided, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor, and the computer program, when executed by the processor, implements the steps of the data processing method provided in the above-described embodiments.

[0008] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the data processing method provided in the above-described embodiments.

[0009] In a fifth aspect, a computer program product is provided, which includes a computer program, and the computer program, when executed by a processor, implements the steps of the data processing method provided in the above-described embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0011] Figure 1 a flowchart of a data processing method of the present application; Figure 2 a flowchart of a registration process of the present application; Figure 3 a flowchart of a process of starting video preview of the present application; Figure 4 a flowchart of a process of ending video preview of the present application; Figure 5 a flowchart of a process of judging service docking exception of the present application; Figure 6 a flowchart of a process of judging service docking exception of the present application; Figure 7 A flowchart of a video preview failure exception judgment of the present application; Figure 8 A flowchart of a video preview failure exception judgment of the present application; Figure 9 A flowchart of a video preview failure exception judgment of the present application; Figure 10 A flowchart of a video preview failure exception judgment of the present application; Figure 11 A flowchart of a video preview failure exception judgment of the present application; Figure 12 A flowchart of a video preview failure exception judgment of the present application; Figure 13 A flowchart of a video preview failure exception judgment of the present application; Figure 14 A flowchart of a video preview failure exception judgment of the present application; Figure 15 A structure diagram of a data processing device of the present application; Figure 16 A structure diagram of an electronic device of the present application. DETAILED DESCRIPTION

[0012] The embodiments of the present application provide a data processing method, device and electronic equipment.

[0013] In order to make the personnel in the technical field better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described in the embodiments of the present application in combination with the drawings, obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by the person skilled in the art without creative labor should belong to the scope of protection of the present application.

[0014] Embodiments of the present specification provide a data processing method, device and equipment. With the rapid development of computer network technology, video monitoring is widely applied due to its instantaneity and rich information content, and plays an increasingly important role in city security. The monitoring equipment in the current security industry supports GB / T28181 standard, which specifies many technical requirements in the security monitoring network system and solves the problem of system interconnection. However, in the process of video monitoring application, it is still necessary for manual detection of whether there is an anomaly in the video monitoring scene, resulting in low efficiency and accuracy of anomaly detection, and poor video monitoring effect. Therefore, a technical solution is needed to improve the efficiency and accuracy of anomaly detection in the video monitoring scene and improve the video monitoring effect. In the solution, the SIP data packet is obtained through the SIP server of the video monitoring system, the video data to be analyzed is obtained through the streaming media server of the video monitoring system, the SIP data packet is analyzed according to the SIP analysis protocol to obtain a first analysis result, the video data to be analyzed is analyzed according to the media analysis protocol to obtain a second analysis result, it is judged whether there is an anomaly in the video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and in the case where it is determined that there is an anomaly in the video processing service, the abnormal processing strategy for the video processing service is determined according to the first analysis result and / or the second analysis result. In this way, the SIP data packet captured by the SIP server and the video data captured by the streaming media server are associated and analyzed, which can quickly and accurately determine the anomaly, improve the efficiency and accuracy of anomaly detection, avoid the problems of low efficiency and accuracy of manual detection, and improve the video monitoring effect. Specific processing can be referred to the specific content in the following embodiments.

[0015] As Figure 1As shown, the embodiment of the present application provides a data processing method, which is applied to a video monitoring system constructed based on a preset multimedia communication protocol. The execution subject of the method can be a server in the video monitoring system. The server can be an independent server or a server cluster composed of multiple servers. The preset multimedia communication protocol can be GB / T28181 protocol. GB / T28181 protocol can be a national standard proposed by the Science and Technology Information Bureau of the Ministry of Public Security, and drafted by the National Security and Alarm System Standardization Technical Committee (SAC / TC100) and other units. The video monitoring system conforming to GB / T28181 protocol can be used for multi-level video monitoring alarm networking between cities, and can be applied to video interconnection between different regions and different platforms in the construction of safe cities in the whole country. GB / T28181 standard specifies the interconnection structure, communication protocol structure, basic requirements and security requirements of information transmission, exchange and control in the security monitoring network system, as well as control, transmission process and protocol interface and other technical requirements. The method can specifically include the following steps: In step S102, the SIP data packet is acquired by the SIP server of the video monitoring system.

[0016] Among them, the Session initialization Protocol (SIP) is a multimedia communication protocol formulated by the Internet Engineering Task Force (IETF). SIP protocol is a text-based application layer control protocol, which is used to create, modify and release a session of one or more participants, and has the characteristics of flexibility, easy implementation and easy extension.

[0017] In the implementation, the video monitoring system can include multiple video monitoring platforms of different levels. For example, the video monitoring platform B can be registered to the video monitoring platform A through SIP. Then, the video monitoring platform A can be a superior video monitoring platform of the video monitoring platform B. Similarly, the video monitoring platform B can also be a subordinate monitoring platform of the video monitoring platform A. The interaction between the superior video monitoring platform and the subordinate video monitoring platform can include registration, heartbeat keep-alive, starting video watching, ending video preview, event pushing, etc.

[0018] The SIP server in the embodiment of the present application can be a server that other SIP servers can register to, that is, the SIP server can be a superior SIP server of other SIP servers. Similarly, the streaming media server in the embodiment of the present application can also be a superior streaming media server of other streaming media servers.

[0019] A video monitoring system conforming to the GB / T28181 protocol can have two services: a SIP service and a streaming media service, that is, each level of video monitoring platform can include a SIP server and a streaming media server. The SIP server can be used for session negotiation, and the streaming media server can be used for processing of audio and video data. SIP communication can use the UDP protocol for network communication. The interfacing content of the upper and lower video monitoring platforms can include upper and lower registration interfacing, and video preview (including real-time video preview, historical playback, and video download) and event push notification after successful interfacing.

[0020] The video monitoring system can capture SIP data packets of the SIP server based on a preset data acquisition period, such as capturing SIP data packets of the SIP server in real time.

[0021] In step S104, the video data to be analyzed is acquired by the streaming media server of the video monitoring system.

[0022] In implementation, the video monitoring system can also capture video data of the streaming media server based on a preset data acquisition period, such as capturing video data of the streaming media server in real time.

[0023] In step S106, the SIP data packets are analyzed according to a SIP analysis protocol to obtain a first analysis result, and the video data to be analyzed is analyzed according to a media analysis protocol to obtain a second analysis result.

[0024] In implementation, the video monitoring system can filter SIP information, analyze SIP, and judge SIP sessions according to the SIP analysis protocol, to judge the integrity of the SIP session, and through SIP session closed loop judgment, the first analysis result can be stored in the database.

[0025] The video monitoring system can also analyze media data according to the media analysis protocol for the packet memory data of the media service environment (i.e., the video data to be analyzed). For example, the integrity of the video data, the data packet loss condition, the data out-of-order condition, etc. can be judged to obtain the second analysis result. Similarly, the video monitoring platform can also store the second analysis result in the database.

[0026] In addition, the video monitoring system can also judge whether there is useless data in the database, and if there is useless data, the useless data can be discarded in real time to ensure that the data volume of the memory data will not be too large.

[0027] In addition, the video monitoring system can also determine the analysis result through a pre-trained analysis model. For example, the video monitoring system can perform SIP analysis on the SIP data packet through a first analysis model trained according to a SIP analysis protocol to obtain a first analysis result. Meanwhile, the video monitoring system can also perform video data analysis on the video data to be analyzed through a second analysis model trained according to a media analysis protocol to obtain a second analysis result. The analysis model can be a model constructed by a deep learning algorithm.

[0028] The above-mentioned determination method of the analysis result is an optional and implementable determination method. In actual application scenarios, there can be various different determination methods, and different determination methods can be selected according to different actual application scenarios. The embodiments of the present specification do not make specific limitations in this regard.

[0029] In step S108, it is determined whether the video processing service corresponding to the video data is abnormal according to the first analysis result and / or the second analysis result, and in a case where it is determined that the video processing service is abnormal, an abnormal processing strategy for the video processing service is determined according to the first analysis result and / or the second analysis result.

[0030] In implementation, the video monitoring system can send the first analysis result and the second analysis result to a preset processing party, and receive a judgment result of the preset processing party on whether the video processing service corresponding to the video data is abnormal. According to the judgment result, it is determined whether the video processing service corresponding to the video data is abnormal.

[0031] Alternatively, the video monitoring system can also determine whether the video processing service corresponding to the video data is abnormal according to the first analysis result and / or the second analysis result according to a pre-trained abnormality detection model. The abnormality detection model can be a model constructed according to a preset neural network algorithm.

[0032] In addition, there can be various abnormality judgment methods, and different judgment methods can be selected according to different actual application scenarios. The embodiments of the present specification do not make specific limitations in this regard.

[0033] In a case where it is determined that the video processing service is abnormal, the video monitoring system can determine the type of the abnormality of the video processing service according to the first analysis result and / or the second analysis result, and determine the abnormal processing strategy for the video processing service according to a preset corresponding relationship between the type and the strategy.

[0034] Alternatively, in a case where it is determined that the video processing service is abnormal, the video monitoring system can also determine the abnormal processing strategy for the video processing service according to the first analysis result and / or the second analysis result through a preset large language model.

[0035] The determination method of the above abnormal processing strategy is an optional and implementable determination method. In actual application scenarios, there can be various different determination methods, and different determination methods can be selected according to different actual application scenarios. The embodiments of the present specification do not make specific limitations in this regard.

[0036] The embodiment of the present application provides a data processing method. The SIP data packet is acquired through the SIP server of the video monitoring system. The video data to be analyzed is acquired through the streaming media server of the video monitoring system. The SIP data packet is analyzed according to the SIP analysis protocol to obtain a first analysis result. The video data to be analyzed is analyzed according to the media analysis protocol to obtain a second analysis result. Whether the video processing service corresponding to the video data exists an abnormality is judged according to the first analysis result and / or the second analysis result. In the case where it is determined that the video processing service exists an abnormality, the abnormal processing strategy for the video processing service is determined according to the first analysis result and / or the second analysis result. In this way, the SIP data packet acquired through the SIP server and the video data acquired through the streaming media server are associated and analyzed, which can quickly and accurately perform abnormality judgment, improve the abnormality detection efficiency and accuracy, and avoid the problems of low efficiency and accuracy of manual detection, thereby improving the video monitoring effect.

[0037] In actual application, the abnormality of the video processing service can include docking abnormality between different levels of SIP servers, video preview failure abnormality, video preview freezing abnormality, video preview end abnormality, and dirty data abnormality.

[0038] The registration process can be completed by negotiation between different levels of video monitoring platforms. The registration process can be completed by the SIP server of the upper video monitoring platform and the SIP server of the lower video monitoring platform. As shown in FIG. 1, the steps of the registration process can include: Figure 2 Step 1: The lower SIP server configures registration information and sends a registration message in SIP protocol format. Step 2: The upper SIP server receives the registration without carrying verification information and replies with unauthorized. Step 3: The lower SIP server carries verification information and reinitiates registration. Step 4: The upper SIP server receives the registration information and performs verification: replies with registration success or other error codes. Step 5: If the lower SIP server is successfully registered, periodically sends a heartbeat keep-alive message to maintain the session. Step 6: If the lower SIP server fails to register, it returns to step 1.

[0039] ​In the above registration process, if there are any issues such as incorrect deployment of the lower-level SIP server, incorrect registration information entered by the lower-level SIP server, network outage at the gateway, or incorrect deployment of the network gateway to the upper-level SIP server, or if any abnormality occurs in the above registration process steps, it will lead to abnormal connection between different levels of SIP servers.

[0040] The video preview process can be divided into two sub-processes: starting video preview and ending video preview. These processes can be completed collaboratively by the upper and lower level SIP servers and streaming media servers. For each video stream with a matching SIP session, the lower level pushes the video stream upon successful negotiation of the SIP session and stops pushing the video stream when the SIP session ends.

[0041] The video preview process is primarily completed through cooperation between the upper and lower level SIP servers and the streaming media server, such as... Figure 3 As shown, the process can be divided into the following steps: Step 1: The upper-level SIP server sends SIP signaling to the lower-level SIP server, carrying negotiation information. This step tells the lower-level SIP server which video stream to preview, and pushes the encoded video stream to a specified address (which can be the receiving IP and port of the upper-level streaming media server). It also tells the lower-level video surveillance platform the unique stream ID of this encoded video stream to prevent crosstalk. Step 2: The lower-level SIP server receives the signaling and replies with a success code (such as OK) or an error code; Step 3: After receiving the success code response from the lower-level SIP server, the upper-level SIP server notifies the upper-level streaming media server to prepare to receive the video stream at the IP and port negotiated in the first step. Step 4: After the upstream streaming media server has completed the preparations, it notifies the upstream SIP server. Step 5: After the superior SIP server learns that the superior streaming media server has completed the preparations, it replies to the subordinate SIP server with an ACK confirmation message; Step 6: After receiving the ACK confirmation, the lower-level SIP server notifies the lower-level streaming media server to push the video stream to the IP and port negotiated in the first step; Step 7: The lower-level streaming media server begins pushing video streams to the IP and port negotiated in the first step.

[0042] In this way, the video preview process is completed. After receiving the video stream, the upper-level video surveillance platform can process the received video data to preview it.

[0043] The video preview process can also be terminated through cooperation between the upper and lower level SIP servers and the streaming media server, such as... Figure 4 As shown, the process can be divided into the following steps: Step 1: The upper-level SIP server sends SIP signaling to the lower-level SIP server, indicating that the video preview has ended; Step 2: The lower-level SIP server receives the signaling and replies with a success code (such as OK) or an error code; Step 3: After receiving the success code response from the lower-level SIP server, the upper-level SIP server responds with an ACK; Step 4: After receiving the ACK response, the lower-level SIP server notifies the lower-level streaming media server to stop pushing video data; Step 5: The lower-level streaming media server ends the video stream push.

[0044] This completes the process of ending the video preview.

[0045] However, if any step in the above video preview process fails, such as an abnormality in the front-end camera device or a non-standard video data encapsulation format, the video preview will fail.

[0046] Additionally, if the original audio / video data is abnormal, or if data packet loss occurs due to network gateway malfunction or insufficient network bandwidth between the lower-level and upper-level streaming media servers because video data can be transmitted via UDP, or if network packet loss occurs between the front-end video camera and the lower-level streaming media server, or if the network encapsulation format of the video data pushed by the lower-level streaming media server is not standard (e.g., because the GB / T28181 protocol requires video data to be encapsulated in PS stream format, if the video data is encapsulated in RTP format, then it can be assumed that the network encapsulation format of the video data is not specified), this will cause video preview stuttering when the lower-level streaming media server forwards the data to the upper-level streaming media server.

[0047] In cases of insufficient network bandwidth, network congestion, abnormalities in different levels of SIP servers, abnormalities in streaming media servers, or abnormalities in front-end video devices, video preview may end abnormally.

[0048] Furthermore, if the video data does not have a matching SIP session, the video data pushed by the downstream streaming media server will not be completed, resulting in dirty data anomalies due to the large amount of network bandwidth consumed.

[0049] Additionally, if the network gateway loses the BYE message when ending the video preview, the lower-level SIP server may not receive the BYE message. Even if the lower-level SIP server receives the BYE message, its internal processing may fail due to malfunctions or other reasons. This can cause the lower-level SIP server to continue pushing video streams to the upper-level SIP server after the SIP session has ended, thus consuming network bandwidth and creating dirty data anomalies.

[0050] When the video preview started, although the SIP signaling interaction between the upper and lower level SIP servers was abnormal, the internal logic of the lower level SIP server was flawed, and it continued to push video data to the upper level, thus consuming network bandwidth and causing dirty data anomalies.

[0051] In practical applications, the processing method for determining whether there are any anomalies in the video processing service for video analysis data based on the first analysis result in step S108 above can be varied. The following provides one optional processing method, such as... Figure 5 As shown, the specific process may include the following steps, S1082.

[0052] In step S1082, based on the first analysis result, it is determined whether the SIP session between the SIP server and the lower-level SIP server of the SIP server has been successfully registered. If it is determined that the SIP session has not been successfully registered, it is determined that there is an interface anomaly in the video processing service.

[0053] In implementation, a data capture service can be deployed on the SIP server to automatically capture SIP data packets in real time and filter the captured SIP data packets for SIP information.

[0054] The video surveillance system can determine whether SIP registration was successful based on the initial analysis of the SIP data packets. If registration fails, it indicates an interface anomaly in the video processing service. The video surveillance system can then send pre-set messages to third-party clients, allowing them to receive real-time processing results from the video processing service.

[0055] In addition, such as Figure 6 As shown, the video surveillance system can also provide an HTTP API to output SIP registration results (i.e., registration successful, failed, registration not received, etc.) to assist users in further troubleshooting. For example, if registration is not received, it can be checked whether there are any anomalies in the network or the downstream SIP server of the SIP server; if registration fails, it can be checked whether there are any anomalies in the downstream SIP server of the SIP server.

[0056] In addition, regardless of whether the registration is successful or not, the first analysis result can be entered into the database.

[0057] In practical applications, the processing method for determining whether there are any anomalies in the video processing service for video analysis data based on the first and second analysis results in step S108 can be varied. The following provides one optional processing method, such as... Figure 7 As shown, the specific process may include the following steps S1084 to S1088.

[0058] In step S1084, based on the first analysis result, the response status of the lower-level SIP server to the video processing service request sent by the SIP server is determined, and based on the response status, the first anomaly detection result is determined.

[0059] In step S1086, the data detection result corresponding to the video data to be analyzed is determined based on the second analysis result.

[0060] In practice, the video surveillance platform can determine whether the video data is empty, i.e., whether the streaming media server has received the video data, based on the second analysis result.

[0061] In step S1088, based on the first anomaly detection result and the data detection result, it is determined whether there is a video preview failure anomaly in the video processing service.

[0062] In implementation, such as Figure 8 As shown, the video surveillance platform can record and track captured video preview requests through the data capture service, and track the return results of the lower-level SIP servers of the SIP server. If the lower-level SIP server of the SIP server does not reply with any message or fails to reply, it can be determined that there is an anomaly in the video processing service. That is, if it is determined from the reply situation that the lower-level SIP server of the SIP server has not replied with any message or has failed to reply, the first anomaly detection result can be determined as an anomaly.

[0063] If the response indicates that the lower-level SIP server of the SIP server has successfully responded (i.e., the first anomaly detection result is that no anomaly exists), then the media packet capture and analysis service deployed on the streaming media server can be notified to begin capturing video data on the negotiated port and to verify the captured video data. In other words, the media packet capture and analysis service can determine whether the captured video data is empty based on the second analysis result.

[0064] Thus, if the first anomaly detection result indicates the presence of an anomaly, or if the first anomaly result indicates the absence of an anomaly and the captured video data is determined to be empty based on the second analysis result, it can be determined that the video processing service has a video preview failure anomaly.

[0065] By automating the analysis of SIP information and notifying the media analysis service of the SIP information analysis results (i.e., the first anomaly detection results), the two services perform a comprehensive correlation analysis to determine whether there are any video preview anomalies. This allows for rapid problem localization and assists users in quickly troubleshooting and resolving issues.

[0066] In practical applications, the processing method for determining whether there are any anomalies in the video processing service for the video analysis data based on the second analysis result in step S108 above can be varied. The following provides one optional processing method, such as...Figure 9 As shown, the processing can specifically include the following steps S10810-S10816.

[0067] In step S10810, it is determined according to the second analysis result whether the video data has packet loss.

[0068] In step S10812, in the case that the video data has packet loss, it is determined that the video processing service has video preview freezing abnormality.

[0069] In step S10814, in the case that the video data does not have packet loss, the video data is restored and the restored video data is decoded for testing.

[0070] In step S10816, in the case that the decoding test has abnormality, it is determined that the video processing service has video preview freezing abnormality.

[0071] In implementation, as shown in Figure 10 the video monitoring system can determine packet loss according to the second analysis result (e.g., according to RTP sequence number), and if it is found that the video data has packet loss, it is determined that the lower-level streaming media server or network of the streaming media server has abnormality, i.e., the video processing service has video preview freezing abnormality, and the lower-level streaming media server or network of the streaming media server can be contacted for troubleshooting and solving the abnormal problem.

[0072] If it is determined that the video data does not have packet loss, the video data can be restored to original video data and decoded for testing. If the decoding test has abnormality, it is determined that the original stream sent by the lower-level streaming media server of the streaming media server has problem, and the lower-level streaming media server of the streaming media server can be contacted for solving the abnormality, and at this time, it is also determined that the video processing service has video preview freezing abnormality.

[0073] In actual application, the processing mode of determining whether the video processing service for video analysis data has abnormality according to the first analysis result and the second analysis result in the above step S108 can be various, and one optional processing mode is provided as shown in Figure 11 The processing can specifically include the following steps S10818-S10822.

[0074] In step S10818, it is determined according to the first analysis result whether the lower-level SIP server of the SIP server actively sends a preset end message.

[0075] In step S10820, it is determined according to the second analysis result whether the video data has reception abnormality in the case that the SIP server does not actively send the preset end message.

[0076] In step S10822, it is determined that the video preview ending is abnormal in a case that the lower SIP server of the SIP server actively sends the preset ending message, and / or the video data receiving is abnormal.

[0077] In implementation, as shown in Figure 12 the SIP packet capturing and analyzing service can automatically capture data packets in real time and analyze whether the lower SIP server of the SIP server actively sends the BYE ending message (i.e., whether the preset ending message is actively sent). If it is determined according to the first analysis result that the lower SIP server of the SIP server actively sends the BYE ending message, it is determined that the lower SIP server of the SIP server is abnormal, i.e., in a case that it is determined according to the first analysis result that the lower SIP server of the SIP server actively sends the preset ending message, it is determined that the video processing service has the video preview ending abnormality.

[0078] Meanwhile, the media packet capturing and analyzing service can automatically analyze the data receiving condition. In a case that the upper SIP server (i.e., the SIP server) does not actively send the BYE ending message, if the video data receiving is abnormal, it is determined that the lower SIP server of the SIP server or the network is abnormal, i.e., in a case that the upper SIP server does not actively send the preset ending message, if the video data receiving is abnormal, it is determined that the video processing service has the video preview ending abnormality.

[0079] In this way, after the video data preview is successful, the SIP packet capturing and analyzing service and the media packet capturing and analyzing service can be performed to determine whether the video preview ending is abnormal by whether the lower SIP server of the SIP server actively sends the BYE ending message and whether the video stream receiving is abnormal, so as to quickly troubleshoot the problem.

[0080] In actual application, the processing manner of determining whether the video processing service has the abnormality according to the second analysis result in step S108 can be various, and one optional processing manner is provided as follows, as shown in Figure 13 which can specifically include the following steps S10824-S10826.

[0081] In step S10824, it is determined according to the second analysis result whether there is a SIP session matched with the video data.

[0082] In step S10826, it is determined that the video processing service has the dirty data abnormality in a case that it is determined that there is no SIP session matched with the video data, or there is a SIP session matched with the video data and the SIP session state is the closed state.

[0083] In implementation, when previewing video data, one SIP session and one audio and video stream are matched. That is, when SIP session negotiation fails, the subordinate stream media server of the stream media server cannot push stream. When SIP session negotiation succeeds, the subordinate stream media server of the stream media server can start pushing video stream, and therefore, when the SIP session ends, the subordinate stream media server of the stream media server must end pushing of the audio and video stream.

[0084] If one audio and video stream is received, but there is no matched SIP session or the matched SIP session has been closed, it can be judged that the audio and video stream is dirty data. That is, as shown in Figure 14 When it is determined that there is no SIP session matched with the video data or there is a SIP session matched with the video data and the session state of the SIP session is a closed state, it is determined that the video processing service has dirty data abnormality.

[0085] The determined dirty data source can be recorded and notified, so as to facilitate the user to solve the problem and prevent network storm.

[0086] By respectively deploying SIP network data capture and analysis services and media network data capture and analysis services on the SIP server and the stream media server, SIP protocol analysis and media protocol analysis can be respectively performed.

[0087] The captured memory data of the SIP server environment can be subjected to SIP information filtering, SIP analysis and SIP session judgment, so as to judge SIP session integrity, perform SIP session closed loop judgment, form a record in the database, and discard useless data in real time, so as to ensure that the memory data will not be too large.

[0088] The result of the SIP server capture file analysis can be notified to the media network analysis service in real time for correlation analysis, so as to solve abnormal problems such as video preview failure and dirty data generation (one SIP session start and end and media stream push start and end are matched and correlated).

[0089] The captured memory data of the media service environment can be subjected to media data analysis, and useless data can be discarded in real time. By judging data integrity, data packet loss and data out-of-order, abnormality such as lag, screen flashing and preview failure can be judged, and active recording can be performed when abnormality is determined to occur.

[0090] The http API interface is implemented, which can provide the user with the ability to obtain current information and set parameters, and implement the notification function. When SIP session abnormality occurs, media stream reception abnormality occurs, the SIP session state and the media stream push state do not match, the third party can be notified in real time to solve the abnormality.

[0091] In the cascade meeting the GB / T28181 protocol, the engineering personnel can be assisted to exclude problems, release human resources, save costs, and solve problems that cannot be solved by traditional methods. During the daily use of the customer, real-time analysis can be performed, historical data can be retained, and problems such as unclear problem positioning and unclear responsibility determination can be solved Through the above scheme, the problem of excessive manual participation can be solved, and human resources can be liberated and costs can be saved by automatically acquiring data and analyzing data. And it can work all day, real-time and automatic analysis, generate problem reports, and achieve the ability to quickly solve problems. It can also track the closed loop of SIP sessions, analyze and record key media data, analyze and record irregular and occasional problems, and determine responsibility. And it can provide external API interface to obtain specific analysis results.

[0092] The embodiment of the present specification provides a data processing method, acquiring a SIP data packet through a SIP server of a video monitoring system, acquiring video data to be analyzed through a streaming media server of the video monitoring system, performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result, determining whether there is an exception in a video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and determining an exception handling strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that the video processing service has an exception. In this way, the SIP data packet captured by the SIP server and the video data captured by the streaming media server are associated and analyzed, which can quickly and accurately determine the exception, improve the efficiency and accuracy of exception detection, avoid the low efficiency and accuracy of manual detection, and improve the video monitoring effect.

[0093] The above is the data processing method provided by the embodiment of the present specification. Based on the same idea, the embodiment of the present specification also provides a data processing device, as shown in Figure 15 .

[0094] The data processing device includes a first acquisition module 1501, a second acquisition module 1502, a result determination module 1503, and a strategy determination module 1504, wherein: The first acquisition module 1501 is configured to acquire a SIP data packet through a SIP server of a video monitoring system; The second acquisition module 1502 is configured to acquire video data to be analyzed through a streaming media server of the video monitoring system; The result determination module 1503 is configured to perform SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and perform video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result. The policy determination module 1504 is configured to determine whether the video processing service corresponding to the video data is abnormal according to the first analysis result and / or the second analysis result, and determine an abnormal processing policy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that the video processing service is abnormal.

[0095] In an embodiment of the present specification, the video processing service being abnormal includes docking abnormality between SIP service ends of different levels, video preview failure abnormality, video preview freezing abnormality, video preview end abnormality, and dirty data abnormality.

[0096] In an embodiment of the present specification, the policy determination module 1504 is configured to: determine whether a SIP session between the SIP service end and a lower-level SIP service end of the SIP service end is successfully registered according to the first analysis result, and determine that the video processing service is docking abnormal in a case where it is determined that the SIP session is not successfully registered.

[0097] In an embodiment of the present specification, the policy determination module 1504 is configured to: determine a reply condition of a processing request of the video processing service sent by the SIP service end by the lower-level SIP service end of the SIP service end according to the first analysis result, and determine a first abnormality detection result according to the reply condition; determine a data detection result corresponding to the video data to be analyzed according to the second analysis result; determine whether the video processing service is video preview failure abnormal according to the first abnormality detection result and the data detection result.

[0098] In an embodiment of the present specification, the policy determination module 1504 is configured to: determine whether the video data is packet loss according to the second analysis result; determine that the video processing service is video preview freezing abnormal in a case where the video data is packet loss; perform restoration processing on the video data in a case where the video data is not packet loss, and perform decoding testing on the video data restored; determine that the video processing service is video preview freezing abnormal in a case where the decoding testing is abnormal.

[0099] In the embodiments of the present specification, the policy determination module 1504 is configured to: determine whether a lower-level SIP server of the SIP server actively sends a preset end message according to the first analysis result; determine whether the video data has a reception exception in a case where the SIP server does not actively send the preset end message according to the second analysis result; determine that the video processing service has a video preview end exception in a case where the lower-level SIP server of the SIP server actively sends the preset end message and / or the video data has a reception exception.

[0100] In the embodiments of the present specification, the policy determination module 1504 is configured to: determine whether there is a SIP session matched with the video data according to the second analysis result; determine that the video processing service has a dirty data exception in a case where it is determined that there is no SIP session matched with the video data, or there is a SIP session matched with the video data and a session state of the SIP session is a closed state.

[0101] The embodiments of the present specification provide a data processing apparatus. The SIP server of a video monitoring system acquires a SIP data packet, the streaming media server of the video monitoring system acquires video data to be analyzed, performs SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, performs video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result, judges whether a video processing service corresponding to the video data has an exception according to the first analysis result and / or the second analysis result, and determines an exception processing policy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that the video processing service has an exception. In this way, the SIP data packet acquired by the SIP server and the video data acquired by the streaming media server are associated and analyzed, which can quickly and accurately judge the exception, improve the efficiency and accuracy of exception detection, avoid the problems of low efficiency and accuracy of manual detection, and improve the video monitoring effect.

[0102] The data processing apparatus provided by the embodiments of the present specification is based on the same idea. The embodiments of the present specification also provide a data processing device, as shown in Figure 16 .

[0103] The data processing device can be a terminal device or a server provided in the above embodiments.

[0104] Data processing devices can vary greatly in configuration or performance, and can include one or more processors 1601 and memory 1602, which can store one or more stored applications or data. The memory 1602 can be a volatile or non-volatile memory. The stored applications in the memory 1602 can include one or more modules (not shown), each of which can include a series of computer-executable instructions for the data processing device. Further, the processor 1601 can be configured to communicate with the memory 1602 to execute the series of computer-executable instructions in the memory 1602 on the data processing device. The data processing device can also include one or more power supplies 1603, one or more wired or wireless network interfaces 1604, one or more input / output interfaces 1605, and one or more keyboards 1606.

[0105] In particular embodiments, a data processing device includes memory and one or more programs, wherein one or more programs are stored in the memory and the one or more programs can include one or more modules, and each module can include a series of computer-executable instructions for the data processing device, and the one or more programs configured to be executed by one or more processors include computer-executable instructions for performing: obtaining a SIP packet via a SIP server of the video monitoring system; obtaining video data to be analyzed via a streaming media server of the video monitoring system; performing SIP analysis on the SIP packet according to a SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; determining whether there is an abnormality in a video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and determining an abnormality processing strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that there is an abnormality in the video processing service.

[0106] Each embodiment in the specification is described in a progressive manner, and the same or similar parts between each embodiment can be referred to each other. In particular, the data processing device embodiment is described simply because it is basically similar to the method embodiment, and the relevant part can be referred to the part of the method embodiment.

[0107] The embodiment of the present specification provides a data processing device, through a SIP server of a video monitoring system, acquiring a SIP data packet, through a streaming media server of the video monitoring system, acquiring video data to be analyzed, performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result, judging whether there is an exception for a video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and in the case where it is determined that the video processing service has an exception, determining an exception processing strategy for the video processing service according to the first analysis result and / or the second analysis result. In this way, the SIP data packet captured by the SIP server and the video data captured by the streaming media server are associated and analyzed, which can quickly and accurately perform exception judgment, improve the efficiency and accuracy of exception detection, avoid the problems of low efficiency and accuracy of manual detection, and improve the video monitoring effect.

[0108] Further, based on the above Figures 1 to 6 The one or more embodiments of the present specification also provide a storage medium for storing computer executable instruction information, and in a specific embodiment, the storage medium can be a U disk, an optical disk, a hard disk, etc. The computer executable instruction information stored in the storage medium can realize the following processes when executed by a processor. acquiring a SIP data packet through a SIP server of a video monitoring system; acquiring video data to be analyzed through a streaming media server of the video monitoring system; performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; judging whether there is an exception for a video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and in the case where it is determined that the video processing service has an exception, determining an exception processing strategy for the video processing service according to the first analysis result and / or the second analysis result.

[0109] Each of the embodiments in the present specification is described in a progressive manner, and the same or similar parts of each of the embodiments can be referred to each other. Each of the embodiments mainly describes the difference from other embodiments. In particular, for the above-mentioned storage medium embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the related parts can be referred to the part of the method embodiment.

[0110] The embodiment of the present specification provides a storage medium, obtaining a SIP data packet through a SIP server of a video monitoring system, obtaining video data to be analyzed through a streaming media server of the video monitoring system, performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result, judging whether a video processing service corresponding to the video data exists abnormally according to the first analysis result and / or the second analysis result, and determining an abnormal processing strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that the video processing service exists abnormally. In this way, the SIP data packet captured by the SIP server and the video data captured by the streaming media server are associated and analyzed, which can quickly and accurately perform abnormal judgment, improve the abnormal detection efficiency and accuracy, avoid the problems of low efficiency and accuracy of manual detection, and improve the video monitoring effect.

[0111] Further, based on the above Figures 1 to 6 The one or more embodiments of the present specification also provide a computer program product including a computer program, which, when executed by a processor, can implement the following flow: obtaining a SIP data packet through a SIP server of a video monitoring system; obtaining video data to be analyzed through a streaming media server of the video monitoring system; performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; judging whether a video processing service corresponding to the video data exists abnormally according to the first analysis result and / or the second analysis result, and determining an abnormal processing strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that the video processing service exists abnormally.

[0112] Each of the embodiments in the present specification is described in a progressive manner, and the same or similar parts of each of the embodiments can be referred to each other. Each of the embodiments mainly describes the difference from other embodiments. In particular, for the above-mentioned computer program product embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the related parts can be referred to the part of the method embodiment.

[0113] The embodiment of the specification provides a computer program product, obtaining a SIP data packet through a SIP server of a video monitoring system, obtaining video data to be analyzed through a streaming media server of the video monitoring system, performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result, judging whether there is an exception for a video processing service corresponding to the video data according to the first analysis result and / or the second analysis result, and determining an exception processing strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that there is an exception for the video processing service. In this way, the SIP data packet captured by the SIP server and the video data captured by the streaming media server are associated and analyzed, the exception can be quickly and accurately judged, the exception detection efficiency and accuracy are improved, the problems of low efficiency and accuracy of manual detection are avoided, and the video monitoring effect is improved.

[0114] The above describes specific embodiments of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different than the order in the embodiments and still achieve the desired result. In addition, the processes depicted in the figures do not necessarily require the particular order shown or sequential order to achieve the desired results. In certain implementations, multitasking and parallel processing can be utilized or can be advantageous.

[0115] In the 1990s, it was possible to distinguish whether an improvement in a technology was a hardware improvement (e.g., an improvement in the circuit structure of a diode, transistor, switch, etc.) or a software improvement (an improvement in a method flow). However, as technology has advanced, many improvements in method flows today can be considered as direct improvements in hardware circuit structures. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into a hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (e.g., a field programmable gate array (FPGA)) is an integrated circuit whose logic function is determined by the user programming the device. A digital system is "integrated" on a PLD by the designer programming it himself, without having to ask a chip manufacturer to design and manufacture a special integrated circuit chip. Moreover, instead of manually manufacturing an integrated circuit chip, this programming is now mostly implemented using "logic compiler" software, which is similar to the software compiler used when developing a program, and the original code before compilation must also be written in a specific programming language, which is called a hardware description language (HDL), and there are many types of HDL, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., and the most commonly used are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also be aware that it is only necessary to logically program the method flow using the above-mentioned hardware description languages and program it into an integrated circuit to easily obtain a hardware circuit that implements the logical method flow.

[0116] The controller can be implemented in any suitable way, for example, the controller can take the form of a microprocessor or processor and a computer readable medium storing computer readable program code, such as software or firmware, executable by the microprocessor, logic gates, switches, an application specific integrated circuit (ASIC), a programmable logic controller and an embedded microcontroller, examples of which include but are not limited to the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, the memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also know that, in addition to implementing the controller in pure computer readable program code, it is possible to implement the same functionality in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers and embedded microcontrollers by logically programming the method steps. Such a controller can therefore be considered to be a hardware component, and the means included therein for implementing the various functions can also be considered to be structures within the hardware component. Alternatively, or even additionally, the means for implementing the various functions can be considered to be both a software module implementing the method and a structure within the hardware component.

[0117] The systems, apparatuses, modules or units illustrated by the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0118] For the sake of description, the above apparatuses are described in various units with functions respectively. Of course, the functions of each unit can be implemented in one or more software and / or hardware in implementing one or more embodiments of the present specification.

[0119] Those skilled in the art will understand that the embodiments of the present specification can be provided as a method, a system, or a computer program product. Therefore, one or more embodiments of the present specification can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, one or more embodiments of the present specification can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0120] The embodiments of the present specification are described with reference to flowcharts and / or block diagrams of the method, device (system) and computer program product according to the embodiments of the present specification. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable electronic devices to produce a machine, so that the instructions executed by the computer or other programmable electronic devices generate a device that implements the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks. Figure 1 one or more flows and / or blocks.

[0121] These computer program instructions can also be stored in a computer readable memory capable of directing the computer or other programmable electronic devices to work in a specific way, so that the instructions stored in the computer readable memory produce a product including instruction devices, which implement the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks. Figure 1 one or more flows and / or blocks.

[0122] These computer program instructions can also be loaded into a computer or other programmable electronic devices, so that a series of operation steps are performed on the computer or other programmable electronic devices to produce a computer implemented process, so that the instructions executed on the computer or other programmable electronic devices provide steps for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks. Figure 1 one or more flows and / or blocks.

[0123] In a typical configuration, the computing device includes one or more processors (CPUs), input / output interfaces, network interfaces and memories.

[0124] The memory can include non-persistent memory in the computer readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). The memory is an example of the computer readable medium.

[0125] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0126] It should also be noted that the terms "comprising", "comprises", "including", "includes" or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or apparatus that comprises a list of elements does not include only those elements recited, but can also include other elements not expressly listed or inherent to such process, method, article or apparatus. Without further limitation, an element defined by an indefinite article "a" does not exclude the existence of additional identical elements in the process, method, article or apparatus that includes the defined element.

[0127] Those skilled in the art will appreciate that embodiments of the present specification can be provided as methods, systems or computer program products. Accordingly, one or more embodiments of the present specification can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Moreover, one or more embodiments of the present specification can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, CD-ROM, optical storage and the like) containing computer-usable program code.

[0128] One or more embodiments of the present specification can be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and the like, which perform particular tasks or implement particular abstract data types. One or more embodiments of the present specification can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

[0129] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each of the embodiments focuses on the difference from other embodiments. In particular, for the system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiments.

[0130] The above only describes the embodiments of the specification and is not used to limit the file. For those skilled in the art, the specification can have various changes and changes. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the specification shall be included in the scope of claims of the specification.

Claims

1. A data processing method, characterized by, The method is applied to a video monitoring system constructed based on a preset multimedia communication protocol, and the method comprises: obtaining a SIP data packet through a SIP server of the video monitoring system; obtaining video data to be analyzed through a streaming media server of the video monitoring system; performing SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and performing video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; determining whether a video processing service corresponding to the video data is abnormal according to the first analysis result and / or the second analysis result, and determining an abnormal processing strategy for the video processing service according to the first analysis result and / or the second analysis result in a case where it is determined that the video processing service is abnormal.

2. The method of claim 1, wherein, The video processing service being abnormal includes docking abnormality between SIP servers of different levels, video preview failure abnormality, video preview freezing abnormality, video preview end abnormality, and dirty data abnormality.

3. The method of claim 2, wherein, The determination of whether the video processing service corresponding to the video analysis data is abnormal according to the first analysis result comprises: determining whether a SIP session between the SIP server and a lower-level SIP server of the SIP server is successfully registered according to the first analysis result, and determining that the video processing service is docking abnormal in a case where it is determined that the SIP session is not successfully registered.

4. The method of claim 2, wherein, The determination of whether the video processing service corresponding to the video data is abnormal according to the first analysis result and the second analysis result comprises: determining a reply condition of a processing request of the video processing service sent by the SIP server by the lower-level SIP server of the SIP server according to the first analysis result, and determining a first abnormality detection result according to the reply condition; determining a data detection result corresponding to the video data to be analyzed according to the second analysis result; determining whether the video processing service is video preview failure abnormal according to the first abnormality detection result and the data detection result.

5. The method of claim 2, wherein, The determination of whether the video processing service corresponding to the video data is abnormal according to the second analysis result comprises: determining whether the video data has packet loss according to the second analysis result; determining that the video processing service is video preview freezing abnormal in a case where the video data has packet loss; performing restoration processing on the video data in a case where the video data does not have packet loss, and performing decoding testing on the restored video data; determining that the video processing service is video preview freezing abnormal in a case where the decoding testing is abnormal.

6. The method of claim 2, wherein, The determination of whether the video processing service corresponding to the video data is abnormal according to the first analysis result and the second analysis result comprises: determining whether the lower-level SIP server of the SIP server actively sends a preset end message according to the first analysis result; determining, according to the second analysis result, whether the video data has a receiving exception in a case that the SIP server does not actively send the preset end message; determining that the video processing service has a video preview end exception in a case that a lower-level SIP server of the SIP server actively sends the preset end message and / or the video data has a receiving exception.

7. The method of claim 2, wherein, The determining, according to the second analysis result, whether the video processing service corresponding to the video data has an exception includes: determining, according to the second analysis result, whether there is a SIP session matched with the video data; determining that the video processing service has a dirty data exception in a case that there is no SIP session matched with the video data or there is a SIP session matched with the video data and a session state of the SIP session is a closed state.

8. A data processing apparatus, characterized by, The apparatus includes: a first obtaining module configured to obtain a SIP data packet through a SIP server of the video monitoring system; a second obtaining module configured to obtain video data to be analyzed through a streaming media server of the video monitoring system; a result determining module configured to perform SIP analysis on the SIP data packet according to a SIP analysis protocol to obtain a first analysis result, and perform video data analysis on the video data to be analyzed according to a media analysis protocol to obtain a second analysis result; a strategy determining module configured to determine, according to the first analysis result and / or the second analysis result, whether a video processing service corresponding to the video data has an exception, and determine, according to the first analysis result and / or the second analysis result, an exception handling strategy for the video processing service in a case that the video processing service has an exception.

9. An electronic device, comprising: A computer program product including a processor, a memory, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor to implement the steps of the data processing method according to any one of claims 1 to 7.

10. A computer program product, characterised in that, A computer program product including a computer program executable on a processor to implement the steps of the data processing method according to any one of claims 1 to 7.

Images