Data stream quality inspection method and system

Abstract

The embodiments of the present application provide a data stream quality inspection method and system, which can be used in the field of cloud computing technology or other technical fields. The method includes: during the data stream recording process, the quality inspection terminal obtains the currently recorded data stream and sends the data stream to the quality inspection server; the quality inspection server performs a first quality inspection according to the data stream to obtain a first quality inspection result; the quality inspection terminal returns the first quality inspection result to the data stream recording terminal; the quality inspection terminal obtains an additional data stream and sends the data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, and TPU of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

Description

Technical Field

[0001] The present application relates to the field of cloud computing technology, and in particular to a data flow quality inspection method and system. Background Art

[0002] In order to protect the rights and interests of consumers, regulatory agencies such as the China Banking and Insurance Regulatory Commission and the China Securities Regulatory Commission require financial institutions to simultaneously record audio and video of the sales process (referred to as "double recording") when selling their own or agency wealth management, fund, insurance and other products to prevent misleading sales, private sales, etc. Financial institutions must ensure that the content of the double recording complies with the requirements of the regulatory agencies and their own double recording processes, such as: the account manager confirms the identity of the customer and introduces himself, introduces the product (such as: issuing entity, principal protection attributes, income level, risk situation, handling fees, etc.), the account manager and the customer are on the same screen, the key links have the customer's signature, and whether the account manager has said any prohibited words.

[0003] At present, financial institutions generally conduct inspections by manually playing back dual-recording videos. On the one hand, it is time-consuming and labor-intensive, and it is difficult to ensure that all dual-recording videos have completed quality inspection 100%. At the same time, the quality inspection standards cannot be unified, and there is a risk that the manual quality inspection passes but still does not meet the requirements of supervision or internal systems; on the other hand, only post-inspection can be adopted. For unqualified dual-recordings found, customers are required to return to the business premises for re-recording, which leads to poor customer experience and low operational efficiency. In recent years, some financial institutions have used artificial intelligence technology to automatically inspect video files stored centrally after dual-recording is completed. Although the manpower input for quality inspection has been reduced and the quality inspection standards have been unified, the timeliness of quality inspection is insufficient due to the time-consuming dual-recording, the time-consuming process of uploading, centralizing and downloading dual-recording video files into the quality inspection queue, and quality inspection. Generally, the quality inspection can only be completed several hours after the dual-recording is completed or even the next day. For those found to be unqualified by automatic quality inspection, customers are still required to return to the business premises for re-recording, which does not solve the problem of poor customer experience and operational efficiency. Summary of the invention

[0004] In response to the problems in the prior art, the present application provides a data stream quality inspection method and system, which obtains an additional data stream in the recording process for quality inspection when starting recording, and completes the quality inspection within a short period of time (for example: 1 minute) after the recording is completed. Unqualified quality inspection points can be re-recorded on site, avoiding the situation where customers need to come to the business premises for a second re-recording, thereby improving customer experience and operational efficiency.

[0005] In order to solve the above technical problems, this application provides the following technical solutions:

[0006] In a first aspect, the present application provides a data stream quality inspection method, which is performed by a quality inspection terminal, and includes:

[0007] During the data stream recording process, obtain the currently recorded data stream;

[0008] Sending the currently recorded data stream to a quality inspection server so that the quality inspection server performs a first quality inspection and obtains a first quality inspection result;

[0009] The first quality inspection result is returned to the data stream recording terminal.

[0010] Furthermore, the data stream quality inspection method further includes:

[0011] Performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0012] The second quality inspection result is returned to the data stream recording terminal.

[0013] Further, the data stream includes an audio data stream, and the step of the quality inspection server performing the first quality inspection includes performing at least a part of the quality inspection step;

[0014] Wherein, the quality inspection step includes:

[0015] Converting the audio data stream into text data;

[0016] Comparing the text data converted from the audio data stream with the data in a preset banned word database to obtain a banned word similarity, and if the banned word similarity is lower than a set threshold, judging that the audio data stream has passed the quality inspection;

[0017] The text data converted from the audio data stream is compared with a preset standard speech template to obtain speech similarity. If the speech similarity is higher than a set threshold, the audio data stream is judged to have passed the quality inspection.

[0018] Further, the data stream includes an audio data stream, and the step of the quality inspection server performing the first quality inspection includes performing a part of the quality inspection steps;

[0019] The performing a second quality check on the data stream comprises performing another part of the quality check steps;

[0020] Wherein, the quality inspection step includes:

[0021] Converting the audio data stream into text data;

[0022] Comparing the text data converted from the audio data stream with the data in a preset banned word database to obtain a banned word similarity, and if the banned word similarity is lower than a set threshold, judging that the audio data stream has passed the quality inspection;

[0023] The text data converted from the audio data stream is compared with a preset standard speech template to obtain speech similarity. If the speech similarity is higher than a set threshold, the audio data stream is judged to have passed the quality inspection.

[0024] Further, the data stream includes a video data stream, and the step of the quality inspection server performing the first quality inspection includes performing at least a part of the quality inspection step;

[0025] Wherein, the quality inspection step includes:

[0026] Performing picture detection on the picture obtained by extracting frames from the video data stream, and if the picture information is higher than a set threshold, judging that the video data stream passes the quality inspection;

[0027] The picture obtained by extracting frames from the video data stream is subjected to character action detection in the picture. If the character action information in the picture is higher than a set threshold, it is determined that the video data stream has passed the quality inspection.

[0028] Further, the data stream includes a video data stream, and the step of the quality inspection server performing the first quality inspection includes performing a part of the quality inspection steps;

[0029] The performing a second quality check on the data stream comprises performing another part of the quality check steps;

[0030] Wherein, the quality inspection step includes:

[0031] Performing picture detection on the picture obtained by extracting frames from the video data stream, and if the picture information is higher than a set threshold, judging that the video data stream passes the quality inspection;

[0032] The picture obtained by extracting frames from the video data stream is subjected to character action detection in the picture. If the character action information in the picture is higher than a set threshold, it is determined that the video data stream has passed the quality inspection.

[0033] In a second aspect, the present application provides a data stream quality inspection method, which is performed by a quality inspection server and includes:

[0034] Receiving a data stream sent by a quality inspection terminal, wherein the data stream is a currently recorded data stream obtained by the quality inspection terminal during a data stream recording process;

[0035] Perform a first quality inspection according to the data stream to obtain a first quality inspection result;

[0036] The first quality inspection result is sent to the quality inspection terminal, so that the quality inspection terminal returns the first quality inspection result to the data stream recording terminal.

[0037] Further, the data stream includes an audio data stream, and performing a first quality check according to the data stream includes:

[0038] Perform at least a portion of the quality control steps;

[0039] Wherein, the quality inspection step includes:

[0040] Converting the audio data stream into text data;

[0041] Comparing the text data converted from the audio data stream with the data in a preset banned word database to obtain a banned word similarity, and if the banned word similarity is lower than a set threshold, judging that the audio data stream has passed the quality inspection;

[0042] The text data converted from the audio data stream is compared with a preset standard speech template to obtain speech similarity. If the speech similarity is higher than a set threshold, the audio data stream is judged to have passed the quality inspection.

[0043] Further, the data stream includes a video data stream, and performing a first quality inspection according to the data stream includes:

[0044] Perform at least a portion of the quality control steps;

[0045] Wherein, the quality inspection step includes:

[0046] Performing picture detection on the picture obtained by extracting frames from the video data stream, and if the picture information is higher than a set threshold, judging that the video data stream passes the quality inspection;

[0047] The picture obtained by extracting frames from the video data stream is subjected to character action detection in the picture. If the character action information in the picture is higher than a set threshold, it is determined that the video data stream has passed the quality inspection.

[0048] In a third aspect, the present application provides a data stream quality inspection method, comprising:

[0049] During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream;

[0050] Sending the currently recorded data stream to a quality inspection server;

[0051] The quality inspection server performs a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result;

[0052] The quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal.

[0053] Furthermore, the data stream quality inspection method further includes:

[0054] The quality inspection terminal performs a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0055] The quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

[0056] In a fourth aspect, the present application provides a quality inspection terminal, including:

[0057] Data acquisition module: during the data stream recording process, obtain the currently recorded data stream;

[0058] Data transmission module: sending the currently recorded data stream to the quality inspection server, so that the quality inspection server performs a first quality inspection and obtains a first quality inspection result;

[0059] The first result returning module returns the first quality inspection result to the data stream recording terminal.

[0060] Furthermore, the quality inspection terminal also includes:

[0061] A second quality inspection module: performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0062] The second result returning module returns the second quality inspection result to the data stream recording terminal.

[0063] In a fifth aspect, the present application provides a quality inspection server, including:

[0064] Data receiving module: receiving a data stream sent by a quality inspection terminal, wherein the data stream is a currently recorded data stream obtained by the quality inspection terminal during the data stream recording process;

[0065] A first quality inspection module: performing a first quality inspection according to the data stream to obtain a first quality inspection result;

[0066] The first result sending module sends the first quality inspection result to the quality inspection terminal, so that the quality inspection terminal returns the first quality inspection result to the data stream recording terminal.

[0067] In a sixth aspect, the present application provides a data flow quality inspection system, including a quality inspection terminal and a quality inspection server;

[0068] During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream and sends the currently recorded data stream to the quality inspection server;

[0069] The quality inspection server performs a first quality inspection according to the currently recorded data stream, obtains a first quality inspection result, and sends the first quality inspection result to the quality inspection terminal;

[0070] The quality inspection terminal returns the first quality inspection result to the data stream recording terminal.

[0071] In a seventh aspect, the present application provides a data flow quality inspection system, including a quality inspection terminal and a quality inspection server;

[0072] During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream, and performs a second quality inspection on the data stream to obtain a second quality inspection result;

[0073] The quality inspection server performs a first quality inspection according to the data stream sent by the quality inspection terminal to obtain a first quality inspection result, and sends the first quality inspection result to the quality inspection terminal, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0074] The quality inspection terminal returns the first quality inspection result and the second quality inspection result to the data stream recording terminal.

[0075] In an eighth aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the data flow quality inspection method when executing the program.

[0076] In a ninth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the data flow quality inspection method when executed by a processor.

[0077] It can be seen from the above technical solution that the present application provides a data stream quality inspection method and system, the method comprising: during the data stream recording process, the quality inspection terminal obtains the currently recorded data stream, and sends the data stream to the quality inspection server; the quality inspection server performs a first quality inspection based on the data stream to obtain a first quality inspection result; the quality inspection terminal returns the first quality inspection result to the data stream recording terminal; the quality inspection terminal obtains an additional data stream, and sends the data stream to the quality inspection server, and uses the high-performance computing resources of the quality inspection server such as CPU, GPU, TPU, etc. to perform quality inspection, ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0079] Figure 1 It is a schematic diagram of the quality inspection terminal process in the data flow quality inspection method in the embodiment of the present application.

[0080] Figure 2 It is a schematic diagram of the audio data stream quality inspection process in the data stream quality inspection method in an embodiment of the present application.

[0081] Figure 3 It is a schematic diagram of the video data stream quality inspection process in the data stream quality inspection method in an embodiment of the present application.

[0082] Figure 4 It is a flow chart of the quality inspection server in the data stream quality inspection method in the embodiment of the present application.

[0083] Figure 5 It is a flow chart of the data stream quality inspection method in an embodiment of the present application.

[0084] Figure 6 It is a schematic diagram of the structure of the quality inspection terminal in the embodiment of the present application.

[0085] Figure 7 It is a schematic diagram of the structure of the quality inspection server in the embodiment of the present application.

[0086] Figure 8 It is a structural diagram of a data stream quality inspection system in an embodiment of the present application.

[0087] Fig. 9 It is a specific flow chart of the data flow quality inspection system in the embodiment of the present application.

[0088] Fig.10 It is a schematic diagram of the structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0089] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0090] It should be noted that the data flow quality inspection method and system disclosed in the present application can be used in the field of cloud computing technology, and can also be used in any field other than the field of cloud computing technology. The application field of the data flow quality inspection method and system disclosed in the present application is not limited.

[0091] In one or more embodiments of the present application, the data stream may be an audio data stream or a video data stream, or may be a mixed audio and video data stream. The quality inspection content of the audio and video data stream includes whether the account manager confirms the identity of the customer and introduces himself, introduces the product situation (such as: issuing entity, principal protection attributes, income level, risk situation, handling fee, etc.), the account manager and the customer are in the same screen, the key link has the customer's signature, whether the account manager has said any prohibited words, etc.

[0092] Taking into account that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides a data stream quality inspection method, a data stream quality inspection system, an electronic device and a computer-readable storage medium. The quality inspection terminal sends the data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU of the quality inspection server to perform quality inspection, ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0093] Based on the above content, the present application also provides a quality inspection terminal and a quality inspection server for implementing the data stream quality inspection method provided in one or more embodiments of the present application. The quality inspection terminal can be communicated with a client terminal device, and the client terminal device includes a recording peripheral, a recording terminal module, and a recording server. The recording terminal module additionally sends the data flow and quality inspection task information during the data stream recording process to the quality inspection terminal through memory copying and other methods.

[0094] Among them, the quality inspection terminal can receive the currently recorded data stream and data stream quality inspection instructions from the client terminal device, and obtain the task information required for quality inspection from the data stream quality inspection instructions, such as: product information corresponding to the data stream and items that need to be quality inspected, etc. The quality inspection terminal can transmit the data stream and quality inspection task information to the quality inspection server, and the quality inspection server will perform data stream quality inspection. It can also allocate the quality inspection task information according to its own computing performance, and retain the quality inspection items that can be supported by its own computing resources on the terminal side for execution, and deploy other quality inspection items to the quality inspection server for execution. After all quality inspection items are executed, the quality inspection terminal returns the quality inspection results to the client terminal device.

[0095] It is to be understood that the client device may include a smart phone, a tablet electronic device, a portable computer, a desktop computer, a personal digital assistant (PDA), etc.

[0096] In another practical application scenario, the quality inspection terminal can be deployed together with the recording terminal module in the client terminal device, and the part of data flow quality inspection can be performed in the quality inspection terminal as described above, or all operations can be completed in the client device. The specific selection can be based on the processing capacity of the client device and the limitations of the user's usage scenario. This application does not limit this.

[0097] The client device may have a communication module (i.e., a communication unit) that can be connected to the quality inspection terminal for communication to achieve data stream transmission. For example, the communication unit may send the data stream and the data stream quality inspection instruction to the quality inspection terminal so that the quality inspection terminal performs data stream quality inspection according to the quality inspection instruction. The communication unit may also receive the quality inspection result returned by the quality inspection terminal.

[0098] The quality inspection terminal and the client device may communicate using any suitable network protocol, including network protocols that have not yet been developed on the date of filing this application. The network protocol may include, for example, TCP / IP protocol, UDP / IP protocol, HTTP protocol, HTTPS protocol, etc. Of course, the network protocol may also include, for example, RPC protocol (Remote Procedure Call Protocol) and REST protocol (Representational State Transfer) used on top of the above protocols.

[0099] The data stream quality inspection method, data stream quality inspection system, electronic device and computer-readable storage medium provided by the present application obtain an additional data stream in the recording process for quality inspection when starting recording, and complete the quality inspection within a short period of time (for example: 1 minute) after the recording is completed. Unqualified quality inspection points can be re-recorded on site to avoid the situation where customers need to come to the business premises for a second time to re-record, thereby improving customer experience and operational efficiency.

[0100] The details are described through the following multiple embodiments and application examples.

[0101] In order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of a data stream quality inspection method, see Figure 1 , which is executed by the quality inspection terminal, the data flow quality inspection method specifically includes the following contents:

[0102] Step S100: during the data stream recording process, obtaining the currently recorded data stream;

[0103] Step S200: sending the currently recorded data stream to a quality inspection server, so that the quality inspection server performs a first quality inspection and obtains a first quality inspection result;

[0104] Step S300: Return the first quality inspection result to the data stream recording terminal.

[0105] It can be understood that during the recording process, the recording terminal sends the currently recorded data stream and quality inspection information to the quality inspection terminal at set intervals. The quality inspection terminal processes the data stream and sends the processed data stream and quality inspection information to the quality inspection server. The quality inspection server performs full or partial quality inspection on the processed data stream based on the quality inspection information. After the quality inspection is completed, the quality inspection result is transmitted to the quality inspection terminal. The quality inspection terminal returns the quality inspection result to the recording terminal and re-records the data stream that fails the quality inspection.

[0106] When the data stream is an audio data stream, the quality inspection terminal re-encodes the audio data in terms of encoding format, sampling rate, bit rate, etc. according to the needs of the speech-to-text function; when the data stream is a video data stream, the quality inspection terminal extracts frames from the video data stream at a preset frequency and converts the video data stream into a picture; when the data stream is a dual-recording video stream, the quality inspection terminal separates and pre-processes the dual-recording video stream to obtain separated audio data and separated video data, and then performs the above-mentioned processing on the separated audio data and separated video data respectively.

[0107] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream and sends the data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0108] In order to further improve the detection efficiency of data flow quality inspection, in one embodiment of the data flow quality inspection method provided in the present application, a preferred method of data flow quality inspection is provided, see Figure 1 The data flow quality inspection method specifically includes the following contents:

[0109] Step S400: performing a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0110] Step S500: Return the second quality inspection result to the data stream recording terminal.

[0111] It is understandable that some quality inspection items in the quality inspection information that can be completed quickly or have low processing performance requirements can be directly completed at the quality inspection terminal, while other quality inspection items that take a long time or have high processing performance requirements can be forwarded to the quality inspection server for quality inspection.

[0112] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream, and reasonably deploys the quality inspection function between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and utilizes the high-performance computing resources such as the CPU, GPU, and TPU of the quality inspection server to perform quality inspection on some time-consuming or high-requirement quality inspection items, while other quality inspection items that can be completed quickly or have lower processing performance requirements are executed at the quality inspection terminal, further shortening the time required for data stream quality inspection and ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0113] In order to further improve the detection efficiency of data stream quality inspection, in one embodiment of the data stream quality inspection method provided in the present application, a method for quality inspection of an audio data stream is provided, and step S200 in the data stream quality inspection method specifically includes the following contents:

[0114] The data stream includes an audio data stream, and the step of the quality inspection server performing the first quality inspection includes performing at least a part of the quality inspection step;

[0115] Among them, the quality inspection steps are as follows: Figure 2 ,include:

[0116] Step S001: converting the audio data stream into text data;

[0117] Step S002: Compare the text data converted from the audio data stream with the data in a preset banned word database to obtain banned word similarity. If the banned word similarity is lower than a set threshold, the audio data stream is judged to be qualified for quality inspection.

[0118] Step S003: Compare the text data converted from the audio data stream with a preset standard speech template to obtain speech similarity. If the speech similarity is higher than a set threshold, the audio data stream is judged to have passed the quality inspection.

[0119] It is understandable that when the performance of the quality inspection terminal is weak, the quality inspection server can perform all or part of the quality inspection steps on the audio data stream according to actual needs. For example, it can compare the similarity of the text with the standard speech template and banned words through natural language processing, keyword matching, etc., to determine whether it exceeds the preset qualified threshold. If it exceeds, it is judged as qualified in the quality inspection, and if it is below the threshold, it is judged as unqualified.

[0120] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal processes the audio data stream and sends the processed audio data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0121] In order to further improve the detection efficiency of data stream quality inspection, in one embodiment of the data stream quality inspection method provided in the present application, a method for quality inspection of an audio data stream is provided, and steps S200 and S400 in the data stream quality inspection method specifically include the following contents:

[0122] The data stream includes an audio data stream, and the step of the quality inspection server performing the first quality inspection includes performing a part of the quality inspection steps;

[0123] The performing a second quality check on the data stream comprises performing another part of the quality check steps;

[0124] Among them, the quality inspection steps are as follows: Figure 2 ,include:

[0125] Step S001: converting the audio data stream into text data;

[0126] Step S002: Compare the text data converted from the audio data stream with the data in a preset banned word database to obtain banned word similarity. If the banned word similarity is lower than a set threshold, the audio data stream is judged to be qualified for quality inspection.

[0127] Step S003: Compare the text data converted from the audio data stream with a preset standard speech template to obtain speech similarity. If the speech similarity is higher than a set threshold, the audio data stream is judged to have passed the quality inspection.

[0128] It is understandable that after receiving the audio data stream sent by the recording terminal, the quality inspection terminal can reasonably distribute the quality inspection tasks between itself and the quality inspection server according to its own performance, retain the quality inspection tasks that can be supported by its own computing resources and have large data volumes on the terminal, and deploy other quality inspection tasks to the quality inspection server, so as to reduce network transmission delays and improve the timeliness of quality inspection. For example, the quality inspection terminal converts the re-encoded audio data into text, and then compares the similarity between the text and the banned language through keyword matching and other methods to determine whether it exceeds the preset qualified threshold. If it exceeds, it is judged as qualified for quality inspection, and if it is below the threshold, it is judged as unqualified. The quality inspection server compares the similarity between the text and the standard speech template through natural language processing to determine whether it exceeds the preset qualified threshold. If it exceeds, it is judged as qualified for quality inspection, and if it is below the threshold, it is judged as unqualified.

[0129] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream, and reasonably deploys the quality inspection function between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and utilizes the high-performance computing resources such as the CPU, GPU, and TPU of the quality inspection server to perform quality inspection on some time-consuming or high-requirement quality inspection items, while other quality inspection items that can be completed quickly or have lower processing performance requirements are executed at the quality inspection terminal, further shortening the time required for data stream quality inspection, ensuring that the quality inspection is completed in a short time after the recording is completed, and avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0130] In order to further improve the detection efficiency of data stream quality inspection, in one embodiment of the data stream quality inspection method provided in the present application, a method for quality inspection of a video data stream is provided, and step S200 in the data stream quality inspection method specifically includes the following contents:

[0131] The data stream includes a video data stream, and the step of the quality inspection server performing the first quality inspection includes performing at least a part of the quality inspection step;

[0132] Among them, the quality inspection steps are as follows: Figure 3 ,include:

[0133] Step S004: performing picture detection on the picture obtained by extracting frames from the video data stream, and if the picture information is higher than a set threshold, judging that the video data stream passes the quality inspection;

[0134] Step S005: performing character action detection on the picture obtained by extracting frames from the video data stream. If the character action information in the picture is higher than a set threshold, it is determined that the video data stream has passed the quality inspection.

[0135] It is understandable that when the performance of the quality inspection terminal is weak, the quality inspection server can perform all or part of the quality inspection steps on the video data stream according to actual needs. For example, for the pictures obtained by extracting frames, the target detection algorithm based on deep learning and the behavior recognition algorithm are used to detect the facial information, certificate / product information, signature action, handwriting, etc. in the picture, so as to determine whether the account manager and the customer are in the same screen, whether the account manager shows the certificate or product information, whether the customer has a signature action, whether there is a handwritten signature, etc., and compare with the preset threshold. When the confidence of the detection result is greater than the threshold, it is judged to be qualified for quality inspection, and if it is lower than the threshold, it is unqualified. The mainstream target detection methods include R-CNN, YOLO, SSD, etc., and the behavior recognition algorithms include C3D, CNN+LSTM, Two-Stream, etc.

[0136] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal processes the video data stream and sends the processed video data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0137] In order to further improve the detection efficiency of data stream quality inspection, in one embodiment of the data stream quality inspection method provided in the present application, a method for quality inspection of a video data stream is provided, and steps S200 and S400 in the data stream quality inspection method specifically include the following contents:

[0138] The data stream includes a video data stream, and the step of the quality inspection server performing the first quality inspection includes performing a part of the quality inspection steps;

[0139] The performing a second quality check on the data stream comprises performing another part of the quality check steps;

[0140] Among them, the quality inspection steps are as follows: Figure 3 ,include:

[0141] Step S004: performing picture detection on the picture obtained by extracting frames from the video data stream, and if the picture information is higher than a set threshold, judging that the video data stream passes the quality inspection;

[0142] Step S005: performing character action detection on the picture obtained by extracting frames from the video data stream. If the character action information in the picture is higher than a set threshold, it is determined that the video data stream has passed the quality inspection.

[0143] It is understandable that after receiving the video data stream sent by the recording terminal, the quality inspection terminal can reasonably allocate the quality inspection tasks between itself and the quality inspection server according to its own performance, retaining the quality inspection tasks that can be supported by its own computing resources and have large data volumes on the terminal, and deploying other quality inspection tasks to the quality inspection server, so as to reduce network transmission delays and improve the timeliness of quality inspection. For example: the detection of whether the account manager and the customer are in the same screen is deployed on the terminal, and the others are deployed on the real-time quality inspection server.

[0144] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal additionally obtains one video data stream, and reasonably deploys the quality inspection function between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and utilizes the high-performance computing resources such as CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection on some time-consuming or high-requirement quality inspection items, while other quality inspection items that can be completed quickly or have lower requirements on processing performance are executed at the quality inspection terminal, further shortening the time required for data stream quality inspection, ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0145] In order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of a data stream quality inspection method, see Figure 4 , which is executed by the quality inspection server, the data flow quality inspection method specifically includes the following contents:

[0146] Step S600: receiving a data stream sent by a quality inspection terminal, wherein the data stream is a currently recorded data stream obtained by the quality inspection terminal during a data stream recording process;

[0147] Step S700: performing a first quality inspection according to the data stream to obtain a first quality inspection result;

[0148] Step S800: Send the first quality inspection result to the quality inspection terminal, so that the quality inspection terminal returns the first quality inspection result to the data stream recording terminal.

[0149] It can be understood that during the recording process, the recording terminal sends the currently recorded data stream and quality inspection information to the quality inspection terminal at set intervals. The quality inspection terminal processes the data stream and sends the processed data stream and quality inspection information to the quality inspection server. The quality inspection server performs full or partial quality inspection on the processed data stream based on the quality inspection information. After the quality inspection is completed, the quality inspection result is transmitted to the quality inspection terminal. The quality inspection terminal returns the quality inspection result to the recording terminal and re-records the data stream that fails the quality inspection.

[0150] The quality inspection terminal performs different processing according to different types of data streams. When the data stream is an audio data stream, the quality inspection terminal re-encodes the audio data in terms of encoding format, sampling rate, bit rate, etc. according to the needs of the speech-to-text function; when the data stream is a video data stream, the quality inspection terminal extracts frames from the video data stream at a preset frequency and converts the video data stream into a picture; when the data stream is a dual-recording video stream, the quality inspection terminal separates and pre-processes the dual-recording video stream to obtain separated audio data and separated video data, and then performs the above-mentioned processing on the separated audio data and separated video data respectively.

[0151] From the above description, it can be seen that the data stream quality inspection method provided in the embodiment of the present application is that the quality inspection server uses its own CPU, GPU, TPU and other high-performance computing resources to perform quality inspection, ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0152] In order to further improve the detection efficiency of data flow quality inspection, in one embodiment of the data flow quality inspection method provided in the present application, a preferred method of data flow quality inspection is provided, and step S700 in the data flow quality inspection method specifically includes the following contents:

[0153] The data stream includes an audio data stream, and performing a first quality check according to the data stream includes:

[0154] Perform at least a portion of the quality control steps;

[0155] Among them, the quality inspection steps are as follows: Figure 2 ,include:

[0156] Step S001: converting the audio data stream into text data;

[0157] Step S002: Compare the text data converted from the audio data stream with the data in a preset banned word database to obtain banned word similarity. If the banned word similarity is lower than a set threshold, the audio data stream is judged to be qualified for quality inspection.

[0158] Step S003: Compare the text data converted from the audio data stream with a preset standard speech template to obtain speech similarity. If the speech similarity is higher than a set threshold, the audio data stream is judged to have passed the quality inspection.

[0159] It is understandable that when the performance of the quality inspection terminal is weak, the quality inspection server can perform all or part of the quality inspection steps on the audio data stream according to actual needs. For example, it can compare the similarity of the text with the standard speech template and banned words through natural language processing, keyword matching, etc., to determine whether it exceeds the preset qualified threshold. If it exceeds, it is judged as qualified in the quality inspection, and if it is below the threshold, it is judged as unqualified.

[0160] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal processes the audio data stream and sends the processed audio data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0161] In order to further improve the detection efficiency of data stream quality inspection, in one embodiment of the data stream quality inspection method provided in the present application, a method for quality inspection of a video data stream is provided, and step S700 in the data stream quality inspection method specifically includes the following contents:

[0162] The data stream includes a video data stream, and performing a first quality inspection according to the data stream includes:

[0163] Perform at least a portion of the quality control steps;

[0164] Among them, the quality inspection steps are as follows: Figure 3 ,include:

[0165] Step S004: performing picture detection on the picture obtained by extracting frames from the video data stream, and if the picture information is higher than a set threshold, judging that the video data stream passes the quality inspection;

[0166] Step S005: performing character action detection on the picture obtained by extracting frames from the video data stream. If the character action information in the picture is higher than a set threshold, it is determined that the video data stream has passed the quality inspection.

[0167] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal processes the video data stream and sends the processed video data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0168] In order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of a data stream quality inspection method, see Figure 5 , the data flow quality inspection method specifically includes the following contents:

[0169] Step S110: During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream;

[0170] Step S120: sending the currently recorded data stream to a quality inspection server;

[0171] Step S130: the quality inspection server performs a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result;

[0172] Step S140: the quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal.

[0173] It can be understood that during the recording process, the recording terminal sends the currently recorded data stream and quality inspection information to the quality inspection terminal at set intervals. The quality inspection terminal processes the data stream and sends the processed data stream and quality inspection information to the quality inspection server. The quality inspection server performs full or partial quality inspection on the processed data stream based on the quality inspection information. After the quality inspection is completed, the quality inspection result is transmitted to the quality inspection terminal. The quality inspection terminal returns the quality inspection result to the recording terminal and re-records the data stream that fails the quality inspection.

[0174] The quality inspection terminal performs different processing according to different types of data streams. When the data stream is an audio data stream, the quality inspection terminal re-encodes the audio data in terms of encoding format, sampling rate, bit rate, etc. according to the needs of the speech-to-text function; when the data stream is a video data stream, the quality inspection terminal extracts frames from the video data stream at a preset frequency and converts the video data stream into a picture; when the data stream is a dual-recording video stream, the quality inspection terminal separates and pre-processes the dual-recording video stream to obtain separated audio data and separated video data, and then performs the above-mentioned processing on the separated audio data and separated video data respectively.

[0175] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream and sends the data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0176] In order to further improve the detection efficiency of data flow quality inspection, in one embodiment of the data flow quality inspection method provided in the present application, a preferred method of data flow quality inspection is provided, see Figure 5 The data flow quality inspection method specifically includes the following contents:

[0177] Step S150: the quality inspection terminal performs a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0178] Step S160: the quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

[0179] It is understandable that some quality inspection items in the quality inspection information that can be completed quickly or have low processing performance requirements can be directly completed at the quality inspection terminal, while other quality inspection items that take a long time or have high processing performance requirements can be forwarded to the quality inspection server for quality inspection.

[0180] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream, and reasonably deploys the quality inspection function between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and utilizes the high-performance computing resources such as the CPU, GPU, and TPU of the quality inspection server to perform quality inspection on some time-consuming or high-requirement quality inspection items, while other quality inspection items that can be completed quickly or have lower processing performance requirements are executed at the quality inspection terminal, further shortening the time required for data stream quality inspection and ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0181] From the software level, in order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of a quality inspection terminal for executing all or part of the content in the data stream quality inspection method, see Figure 6 , the quality inspection terminal specifically includes the following contents:

[0182] Data acquisition module 10: during the data stream recording process, obtain the currently recorded data stream;

[0183] Data transmission module 11: sending the currently recorded data stream to a quality inspection server, so that the quality inspection server performs a first quality inspection and obtains a first quality inspection result;

[0184] The first result returning module 12 returns the first quality inspection result to the data stream recording terminal.

[0185] It can be understood that during the recording process, the recording terminal sends the currently recorded data stream and quality inspection information to the data acquisition module 10 at set intervals, and the data transmission module 11 sends the data stream and quality inspection information to the quality inspection server. The quality inspection server performs full or partial quality inspection on the processed data stream based on the quality inspection information. After the quality inspection is completed, the quality inspection result is transmitted to the first result return module 12. The first result return module 12 returns the quality inspection result to the recording terminal, and re-records the data stream that fails the quality inspection.

[0186] From the above description, it can be seen that the quality inspection terminal provided in the embodiment of the present application obtains an additional data stream and sends the data stream to the quality inspection server, and uses the high-performance computing resources of the quality inspection server such as CPU, GPU, TPU, etc. to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0187] In order to further improve the detection efficiency of data flow quality inspection, in one embodiment of the quality inspection terminal provided in the present application, a preferred method for data flow quality inspection is provided, see Figure 6 , the quality inspection terminal specifically includes the following contents:

[0188] A second quality inspection module 13: performs a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0189] The second result returning module 14 returns the second quality inspection result to the data stream recording terminal.

[0190] It is understandable that the specific functions of the quality inspection terminal can be reasonably allocated between itself and the quality inspection server according to its own performance. Quality inspection items with large data volume and that can be supported by terminal-side computing resources can be retained on the quality inspection terminal, and other quality inspection items can be deployed on the quality inspection server, so as to reduce network transmission delay and improve the timeliness of quality inspection. The second quality inspection module 13 includes an audio quality inspection unit and a video quality inspection unit. For the audio data stream, the audio quality inspection unit converts the re-encoded audio data into text by speech conversion, and then compares the similarity of the text with the standard speech template and prohibited words through natural language processing, keyword matching, etc., to determine whether it exceeds the preset qualified threshold. If it exceeds, it is judged as qualified in the quality inspection, and if it is lower than the threshold, it is judged as unqualified. For the video data stream, the video quality inspection unit adopts the target detection algorithm and behavior recognition algorithm based on deep learning to detect the facial information, certificate / product information, signature action, handwriting, etc. in the picture obtained by extracting frames, so as to determine whether the account manager and the customer are in the same screen, whether the account manager displays the certificate or product information, whether the customer has a signature action, whether there is a handwritten signature, etc., and compares it with the preset threshold. When the confidence of the detection result is greater than the threshold, it is judged as qualified in the quality inspection, and if it is lower than the threshold, it is unqualified.

[0191] From the above description, it can be seen that the quality inspection terminal provided in the embodiment of the present application reasonably deploys quality inspection functions between the quality inspection terminal and the quality inspection server based on its own performance, and uses high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection on some quality inspection items that are time-consuming or have high requirements. Other quality inspection items that can be completed quickly or have lower processing performance requirements are executed at the quality inspection terminal, further shortening the time required for data flow quality inspection, ensuring that quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0192] In order to further improve the accuracy of data stream quality inspection, in one embodiment of the quality inspection terminal provided in the present application, a preferred method for data stream processing is provided, see Figure 6 The quality inspection terminal specifically further includes a data processing module 15.

[0193] It can be understood that the data processing module 15 includes an audio and video separation unit, an audio preprocessing unit and a video preprocessing unit. According to different types of data streams, the data processing module 15 processes the data streams. When the data stream is an audio data stream, the data processing module 15 calls the audio preprocessing unit, and the audio preprocessing unit performs re-encoding and other processing on the audio data in terms of encoding format, sampling rate, bit stream, etc. according to the needs of the speech-to-text function; when the data stream is a video data stream, the data processing module 15 calls the video preprocessing unit, and the video preprocessing unit performs frame extraction processing on the video data stream according to a preset frequency to convert the video data stream into a picture; when the data stream is a dual-recording video stream, the data processing module 15 calls the audio and video separation unit, the audio preprocessing unit and the video preprocessing unit, and the audio and video separation unit performs separation and preprocessing on the dual-recording video stream to obtain separated audio data and separated video data, and the audio preprocessing unit and the video preprocessing unit then perform the above processing on the separated audio data and separated video data respectively, and the above audio and video separation and preprocessing can be implemented based on the function functions provided by FFMPEG, OPENCV, etc.

[0194] From the above description, it can be seen that the quality inspection terminal provided in the embodiment of the present application first processes the data stream and then performs the quality inspection operation, thereby avoiding network resource occupation and transmission delay caused by transmitting large amounts of video to the quality inspection server, and further improving the timeliness of quality inspection.

[0195] In order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of a quality inspection server, see Figure 7 , the quality inspection server specifically includes the following contents:

[0196] Data receiving module 20: receiving a data stream sent by a quality inspection terminal, wherein the data stream is a currently recorded data stream obtained by the quality inspection terminal during a data stream recording process;

[0197] The first quality inspection module 21 performs a first quality inspection according to the data stream to obtain a first quality inspection result;

[0198] The first result sending module 22 sends the first quality inspection result to the quality inspection terminal, so that the quality inspection terminal returns the first quality inspection result to the data stream recording terminal.

[0199] It can be understood that during the recording process, the recording terminal sends the currently recorded data stream and quality inspection information to the quality inspection terminal at set intervals, the quality inspection terminal processes the data stream, the data receiving module 20 receives the processed data stream sent by the quality inspection terminal, the first quality inspection module 21 performs full or partial quality inspection on the processed data stream according to the quality inspection information, after the quality inspection is completed, the first result sending module 22 transmits the quality inspection result to the quality inspection terminal, the quality inspection terminal returns the quality inspection result to the recording terminal, and re-records the data stream that fails the quality inspection. The first quality inspection module 21 includes an audio quality inspection unit and a video quality inspection unit. For the audio data stream, the audio quality inspection unit converts the re-encoded audio data into text by speech conversion, and then compares the similarity of the text with the standard speech template and prohibited words through natural language processing, keyword matching, etc., to determine whether it exceeds the preset qualified threshold. If it exceeds, it is judged as qualified in the quality inspection, and if it is lower than the threshold, it is judged as unqualified. For the video data stream, the video quality inspection unit adopts the target detection algorithm and behavior recognition algorithm based on deep learning to detect the facial information, certificate / product information, signature action, handwriting, etc. in the picture obtained by extracting frames, so as to determine whether the account manager and the customer are in the same screen, whether the account manager displays the certificate or product information, whether the customer has a signature action, whether there is a handwritten signature, etc., and compares it with the preset threshold. When the confidence of the detection result is greater than the threshold, it is judged as qualified in the quality inspection, and if it is lower than the threshold, it is unqualified.

[0200] From the above description, it can be seen that the quality inspection server provided in the embodiment of the present application uses its own CPU, GPU, TPU and other high-performance computing resources to perform quality inspection, ensuring that the quality inspection is completed within a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0201] In some specific implementations, the quality inspection server further specifically includes a storage unit 23, and the storage unit 23 can store the quality inspection results for subsequent query and statistical analysis.

[0202] In order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of a data stream quality inspection system, see Figure 8 The data flow quality inspection system specifically includes a quality inspection terminal 30 and a quality inspection server 31:

[0203] It is understandable that the quality inspection terminal 30 can process the recorded data stream, and the quality inspection terminal 30 can be reasonably allocated between the quality inspection terminal 30 and the quality inspection server 31 according to the terminal side performance, and the quality inspection items that can be supported by the terminal side computing resources and have a large amount of data are retained in the quality inspection terminal 30, and other quality inspection items are deployed to the quality inspection server 31, so as to achieve the purpose of reducing network transmission delay and improving the timeliness of quality inspection. If the terminal performance is weak, the data stream quality inspection function of the quality inspection terminal 30 can be migrated to the quality inspection server 31, and only the data processing function of the quality inspection terminal 30 is retained. The quality inspection terminal 30 finally integrates the quality inspection results sent by the quality inspection server 31, and returns the quality inspection results to the recording terminal. The quality inspection terminal 30 can be deployed in combination with the recording terminal. When the performance of the recording terminal device is not enough to complete the basic necessary functions, it can be deployed independently from the recording terminal. The quality inspection server 31 receives the quality inspection request forwarded by the quality inspection server 31, uses its own high-performance computing power to complete the quality inspection and returns the quality inspection results.

[0204] From the above description, it can be seen that in the data stream quality inspection system provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream and sends the data stream to the quality inspection server, and uses the high-performance computing resources such as the CPU, GPU, TPU, etc. of the quality inspection server to perform quality inspection, thereby ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0205] In order to further improve the efficiency of data stream quality inspection, in one embodiment of the data stream quality inspection system provided in the present application, see Figure 8 The data stream quality inspection system further specifically includes: a dual recording peripheral 32, a dual recording terminal module 33 and a dual recording server 34.

[0206] It can be understood that the dual recording peripherals 32 include audio and video acquisition devices such as cameras and microphones, which are used to collect images and sound information of account managers and customers, and then return the relevant audio and video streams to the dual recording terminal module 33. The dual recording peripherals 32 can be external hardware, connected to the dual recording terminal module 2 through wired or wireless interfaces such as USB and Bluetooth, or can be embedded hardware of the dual recording terminal module 33. The dual recording terminal module 33 is the program interface of the dual recording system. The account manager can implement dual recording by clicking the relevant menu, obtain the audio and video stream information of the dual recording peripherals 32 to form a dual recording file, and provide an additional real-time dual recording video stream and quality inspection task information to send to the quality inspection terminal 30 through memory copying and other methods. The dual recording terminal module 33 can be in B / S mode or C / S mode, and is generally deployed on devices in the form of desktop / laptop computers, tablet computers, smart phones, etc. The dual recording server 34 is the server of the dual recording system, which provides the business functions required for dual recording and displays them to the account manager through the dual recording terminal module 33, such as: user and authority management, dual recording product information management, dual recording speech management, customer information query, etc.

[0207] From the above description, it can be seen that the data stream quality inspection system provided in the embodiment of the present application, on the one hand, realizes simultaneous quality inspection when dual recording is started by additionally acquiring a real-time dual-recording video stream, thereby avoiding the delay caused by waiting for the dual recording to be completed and the video file to be uploaded before starting the quality inspection in the traditional mode; on the other hand, according to the terminal performance, some quality inspection items are arranged to be completed on the terminal side, and the quality inspection items with high computing resources are deployed to the server side, which reduces the transmission time and reduces the pressure on the server side, and further improves the timeliness of quality inspection, thereby completing the quality inspection within a short period of time after the dual recording is completed. At this time, the customer has not left yet, and re-recording can be performed for non-compliant items, thereby improving customer experience and business efficiency.

[0208] The data flow quality inspection system is described in detail below with reference to a specific embodiment. Fig. 9 .

[0209] S1101: The dual recording peripheral collects video and audio data of the account manager and the customer.

[0210] S1102: The dual recording terminal module obtains dual recording video data.

[0211] S1103: The data acquisition module obtains an additional real-time dual-recording video stream and task information required for quality inspection (such as dual-recording product information, quality inspection items, etc.) from the dual-recording terminal.

[0212] S1104: The audio and video separation unit separates the real-time dual-recording data into audio data and video data.

[0213] S1105: The audio preprocessing unit re-encodes the audio data in terms of encoding format, sampling rate, bit stream, etc. as required.

[0214] S1106: The video preprocessing unit extracts frames from the separated video data at a preset frequency to form images.

[0215] S1107: The audio quality inspection unit performs audio quality inspection according to the deployed functions. If the terminal performance is insufficient, part or all of the quality inspection functions can be deployed in S1110 of the quality inspection server.

[0216] S1108: The video quality inspection unit performs quality inspection on the extracted frames. If the terminal performance is insufficient, part or all of the quality inspection functions can be deployed in S1111 of the quality inspection server.

[0217] S1109: The transmission unit receives the quality inspection task information and corresponding audio / text / picture information.

[0218] S1110: The audio quality inspection unit performs quality inspection according to audio quality inspection rules.

[0219] S1111: The video quality inspection unit performs quality inspection according to the video quality inspection rules.

[0220] S1112: The storage unit stores the quality inspection results for subsequent query and statistical analysis.

[0221] At the same time, the quality inspection results of the quality inspection server will be returned to the quality inspection terminal, which will integrate the results of all quality inspection items and return them to the dual recording terminal for the customer manager to view.

[0222] From a hardware perspective, in order to solve the problem that the existing data stream quality inspection generally needs to be completed several hours or even the next day after the recording is completed, resulting in poor customer experience and operational efficiency, the present application provides an embodiment of an electronic device for implementing all or part of the content of the data stream quality inspection method, and the electronic device specifically includes the following content:

[0223] Fig.10 FIG. 9 is a schematic block diagram of the system structure of the electronic device 9600 according to an embodiment of the present application. Fig.10 As shown, the electronic device 9600 may include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. It is worth noting that Fig.10 is exemplary; other types of structures may also be used to supplement or replace this structure to implement telecommunication functions or other functions.

[0224] In one embodiment, the data stream quality inspection function may be integrated into a central processing unit, wherein the central processing unit may be configured to perform the following control:

[0225] Step S110: During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream;

[0226] Step S120: sending the currently recorded data stream to a quality inspection server;

[0227] Step S130: the quality inspection server performs a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result;

[0228] Step S140: the quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal.

[0229] Step S150: the quality inspection terminal performs a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0230] Step S160: the quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

[0231] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream, and reasonably deploys the quality inspection function between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and utilizes the high-performance computing resources such as the CPU, GPU, and TPU of the quality inspection server to perform quality inspection on some time-consuming or high-requirement quality inspection items, while other quality inspection items that can be completed quickly or have lower processing performance requirements are executed at the quality inspection terminal, further shortening the time required for data stream quality inspection and ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0232] In another embodiment, the data flow quality inspection system may be configured separately from the central processing unit 9100. For example, the data flow quality inspection system may be configured as a chip connected to the central processing unit 9100, and the data flow quality inspection function may be implemented under the control of the central processing unit.

[0233] like Fig.10 As shown, the electronic device 9600 may also include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is worth noting that the electronic device 9600 does not necessarily have to include Fig.10 In addition, the electronic device 9600 may also include Fig.10 For components not shown, reference may be made to the prior art.

[0234] like Fig.10 As shown, the central processing unit 9100 is sometimes also referred to as a controller or an operation control, and may include a microprocessor or other processor device and / or logic device. The central processing unit 9100 receives input and controls the operation of various components of the electronic device 9600.

[0235] The memory 9140 may be, for example, one or more of a cache, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory or other suitable devices. The above-mentioned information related to the failure may be stored, and a program for executing the relevant information may also be stored. The CPU 9100 may execute the program stored in the memory 9140 to implement information storage or processing, etc.

[0236] The input unit 9120 provides input to the central processing unit 9100. The input unit 9120 is, for example, a key or a touch input device. The power supply 9170 is used to provide power to the electronic device 9600. The display 9160 is used to display display objects such as images and texts. The display may be, for example, an LCD display, but is not limited thereto.

[0237] The memory 9140 may be a solid-state memory, such as a read-only memory (ROM), a random access memory (RAM), a SIM card, etc. It may also be a memory that saves information even when the power is off, can be selectively erased, and is provided with more data, examples of which are sometimes referred to as EPROMs, etc. The memory 9140 may also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application / function storage unit 9142, which is used to store application programs and function programs or processes for executing the operation of the electronic device 9600 through the central processor 9100.

[0238] The memory 9140 may also include a data storage unit 9143 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage unit 9144 of the memory 9140 may include various drivers for communication functions of the electronic device and / or for executing other functions of the electronic device (such as messaging applications, address book applications, etc.).

[0239] The communication module 9110 is a transmitter / receiver 9110 that sends and receives signals via an antenna 9111. The communication module (transmitter / receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as the case of a conventional mobile communication terminal.

[0240] Based on different communication technologies, multiple communication modules 9110 may be provided in the same electronic device, such as a cellular network module, a Bluetooth module and / or a wireless LAN module, etc. The communication module (transmitter / receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide an audio output via the speaker 9131 and receive an audio input from the microphone 9132, thereby realizing a common telecommunication function. The audio processor 9130 may include any suitable buffer, decoder, amplifier, etc. In addition, the audio processor 9130 is also coupled to the central processor 9100, so that recording can be performed on the local machine through the microphone 9132, and the sound stored on the local machine can be played through the speaker 9131.

[0241] The embodiments of the present application also provide a computer-readable storage medium capable of implementing all the steps of the data stream quality inspection method in the above embodiments. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, all the steps of the data stream quality inspection method in the above embodiments are implemented by the execution subject being a server or a client. For example, when the processor executes the computer program, the following steps are implemented:

[0242] Step S110: During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream;

[0243] Step S120: sending the currently recorded data stream to a quality inspection server;

[0244] Step S130: the quality inspection server performs a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result;

[0245] Step S140: the quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal.

[0246] Step S150: the quality inspection terminal performs a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different;

[0247] Step S160: the quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

[0248] From the above description, it can be seen that in the data stream quality inspection method provided in the embodiment of the present application, the quality inspection terminal obtains an additional data stream, and reasonably deploys the quality inspection function between the quality inspection terminal and the quality inspection server in combination with the performance of the quality inspection terminal, and utilizes the high-performance computing resources such as the CPU, GPU, and TPU of the quality inspection server to perform quality inspection on some time-consuming or high-requirement quality inspection items, while other quality inspection items that can be completed quickly or have lower processing performance requirements are executed at the quality inspection terminal, further shortening the time required for data stream quality inspection and ensuring that the quality inspection is completed in a short time after the recording is completed, avoiding the need for customers to return to the business premises for re-recording, thereby improving customer experience and operational efficiency.

[0249] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0250] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (apparatus), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0251] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0252] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0253] The present invention uses specific embodiments to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A data stream quality inspection method, characterized in that: include: During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream; Sending the currently recorded data stream to a quality inspection server; The quality inspection server performs a first quality inspection according to the currently recorded data stream to obtain a first quality inspection result; The quality inspection terminal returns the first quality inspection result sent by the quality inspection server to the data stream recording terminal; The data stream quality inspection method further includes: The quality inspection terminal performs a second quality inspection on the data stream to obtain a second quality inspection result, wherein the quality inspection operations of the first quality inspection and the second quality inspection are different; The quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

2. A data stream quality inspection system, characterized in that: Including quality inspection terminal and quality inspection server; During the data stream recording process, the quality inspection terminal obtains the currently recorded data stream and sends the currently recorded data stream to the quality inspection server; The quality inspection server performs a first quality inspection according to the currently recorded data stream, obtains a first quality inspection result, and sends the first quality inspection result to the quality inspection terminal; The quality inspection terminal returns the first quality inspection result to the data stream recording terminal; The quality inspection terminal performs a second quality inspection on the data stream to obtain a second quality inspection result; wherein the quality inspection operations of the first quality inspection and the second quality inspection are different; The quality inspection terminal returns the second quality inspection result to the data stream recording terminal.

3. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the data stream quality inspection method according to claim 1 is implemented.

4. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data stream quality inspection method according to claim 1 is implemented.

Images