Data processing method, system, electronic device, computer-readable storage medium

Abstract

The present disclosure provides a data processing method, system, electronic device and computer readable storage medium, the method comprising: in response to a data processing request of a resource control terminal, obtaining audio data requested to be processed by the resource control terminal; sending a start message to an audio processing device, the start message being used to instruct the audio processing device to start a voice endpoint detection function; receiving first confirmation information returned by the audio processing device, the first confirmation information being used to indicate a started state of the voice endpoint detection function; in response to the first confirmation information, sending the audio data to the audio processing device in real time; and receiving an audio processing result sent by the audio processing device. According to the embodiments of the present disclosure, the processing performance of the audio data can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of audio recognition technology, and in particular to a data processing method, system, electronic device, and computer-readable storage medium. Background Technology

[0002] With the development of artificial intelligence and audio processing technologies, audio processing technology is being used more and more widely in intelligent speech recognition services, such as intelligent customer service, real-time voice input, and real-time meeting recording.

[0003] In audio recognition systems, to eliminate noise interference from silent segments and improve the accuracy of audio data processing, voice activity detection (VAD) can be performed on the audio data before further audio processing. Therefore, it is necessary to improve the system's audio data processing performance from the overall processing flow perspective. Summary of the Invention

[0004] This disclosure provides a data processing method, system, electronic device, and computer-readable storage medium that can improve the system's performance in processing audio data from the overall processing flow.

[0005] In a first aspect, this disclosure provides a data processing method applied to a resource server. The method includes: in response to a data processing request from a resource control terminal, acquiring audio data requested for processing by the resource control terminal; sending a start message to an audio processing device, the start message being used to instruct the audio processing device to start a voice endpoint detection function; receiving a first confirmation message returned by the audio processing device, the first confirmation message being used to indicate the started state of the voice endpoint detection function; in response to the first confirmation message, sending the audio data to the audio processing device in real time; and receiving an audio processing result sent by the audio processing device.

[0006] Secondly, this disclosure provides a data processing method applied to an audio processing device. The method includes: receiving a startup message sent by a resource server, the startup message instructing the audio processing device to start a voice endpoint detection function; starting the voice endpoint detection function and sending a first confirmation message to the resource server, the first confirmation message indicating that the voice endpoint detection function has been started; receiving audio data sent by the resource server in real time in response to the first confirmation message; wherein the audio data is audio data requested to be processed by the resource control terminal obtained by the resource server in response to a data processing request from the resource control terminal; processing the audio data to obtain an audio processing result of the audio data; and sending the audio processing result to the resource server.

[0007] Thirdly, this disclosure provides a data processing system, which includes: a resource server and an audio processing device; wherein the resource server is used to execute the above-described data processing method applied to the resource server; and the audio processing device is used to execute the above-described data processing method applied to the audio processing device.

[0008] Fourthly, this disclosure provides an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores one or more computer programs executable by the at least one processor, the one or more computer programs being executed by the at least one processor to enable the at least one processor to perform the data processing method described above.

[0009] Fifthly, this disclosure provides a computer-readable storage medium storing instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the aforementioned data processing method.

[0010] In the embodiments provided in this disclosure, the resource server can respond to the data processing request of the resource control terminal by sending a start message to the audio processing device to instruct the audio processing device to start the voice endpoint detection function. Upon receiving a first confirmation message from the audio processing device indicating that the voice endpoint detection function has been started, the resource server forwards the audio data requested by the resource control terminal to the audio processing device in real time, so that the audio processing device can perform voice endpoint detection and audio processing on the audio signal, and receive the audio processing results sent by the audio processing device.

[0011] In related technologies, resource servers cache audio data, perform voice endpoint detection on the cached audio data, and then send the detected valid audio segments as content to be processed to the audio processing device for audio processing. This processing method introduces a delay between the resource server receiving the audio data and sending the content to be processed to the audio processing device for processing, resulting in an increase in overall processing response latency. However, in the data processing method provided in this disclosure, after the resource server determines that the audio processing device has started the voice endpoint detection function, it can directly send the audio data requested for recognition by the resource control terminal as content to be processed to the audio processing device. The audio processing device then performs voice endpoint detection and audio processing on the audio data, thereby reducing the overall processing response latency caused by the aforementioned processing of audio data by the audio server and improving the audio data processing performance in the overall processing flow.

[0012] Furthermore, in related technologies, the resource server performs voice endpoint detection on the audio data, and the audio processing device performs audio processing based on the voice endpoint detection results. Therefore, when the accuracy of the audio processing results is low, it is necessary to troubleshoot both the resource server and the audio processing device, which increases the difficulty of problem analysis. However, in the data processing method provided in this disclosure, if the accuracy of the audio processing results is low, it is only necessary to troubleshoot the audio processing device, which reduces the difficulty of problem analysis and helps to improve the efficiency of problem analysis.

[0013] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0014] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the embodiments of the present disclosure to explain the disclosure and do not constitute a limitation thereof. The above and other features and advantages will become more apparent to those skilled in the art from the detailed description of exemplary embodiments with reference to the accompanying drawings, in which:

[0015] Figure 1 This is a schematic diagram illustrating an application scenario of an embodiment of this disclosure;

[0016] Figure 2 A flowchart of a data processing method provided in an embodiment of this disclosure;

[0017] Figure 3 A flowchart of a data processing method provided in an embodiment of this disclosure;

[0018] Figure 4 A flowchart illustrating a data processing method of an exemplary embodiment of this disclosure;

[0019] Figure 5 A block diagram of a data processing apparatus provided in an embodiment of this disclosure;

[0020] Figure 6 A block diagram of a data processing apparatus provided in an embodiment of this disclosure;

[0021] Figure 7 A block diagram of a data processing system provided in an embodiment of this disclosure;

[0022] Figure 8 This is a block diagram of an electronic device provided in an embodiment of the present disclosure. Detailed Implementation

[0023] To enable those skilled in the art to better understand the technical solutions of this disclosure, exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments of this disclosure to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0024] Where there is no conflict, the various embodiments of this disclosure and the features thereof in the embodiments may be combined with each other.

[0025] As used herein, the term “and / or” includes any and all combinations of one or more related enumerated entries.

[0026] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. As used herein, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that when the terms “comprising” and / or “made of” are used in this specification, they specify the presence of features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Words such as “connected” or “linked” are not limited to physical or mechanical connections but can include electrical connections, whether direct or indirect.

[0027] Unless otherwise specified, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this disclosure, and will not be interpreted as having an idealized or overly formal meaning, unless expressly so defined herein.

[0028] Figure 1 A schematic diagram illustrating an application scenario of an embodiment of this disclosure is shown. Figure 1 The audio processing system includes a resource control terminal 10, a resource server 20, and an audio processing device 30.

[0029] The resource control terminal 10 and resource server 20 can be a terminal and server based on the Media Resource Control Protocol (MRCP). The MRCP protocol is a standard protocol drafted for media resources and Internet Protocol (IP) networks, used by the resource control terminal 10 to request various media resource services from the resource server 20. The MRCP protocol provides a standard, consistent, and flexible interface for network-based media processing resource services (such as speech recognition, speech synthesis, and voiceprint authentication).

[0030] The audio processing device 30 can perform speech recognition processing through an Automatic Speech Recognition (ASR) engine, specifically, it can convert the speaker's voice data in the audio data into text data.

[0031] In this embodiment of the disclosure, speech endpoint detection, also known as speech activity detection or speech boundary detection, can identify and eliminate silent segments in an audio signal, thereby obtaining valid audio segments from the audio signal; wherein, a valid audio segment is an audio segment that includes speech signals (also known as active speech). Therefore, speech endpoint detection can extract speech signals from an audio signal and eliminate interference from silent segments and non-speech signals.

[0032] In related technologies, when the resource control terminal 10 requests the resource server 20 to process audio data, the resource server 20 can first cache the audio data, perform voice endpoint detection based on the cached audio data, and when a valid audio segment is detected, package the valid audio segment and send it to the audio processing device 30 for audio processing to obtain the audio processing result.

[0033] For example, when the audio processing is speech recognition processing, the speech recognition processing can extract features and parse speech from the valid audio segments in the detected audio data, and use the parsed text information corresponding to the valid audio segment as the audio processing result of the audio data.

[0034] As can be seen, in the audio processing of this related technology, the resource server typically caches the received audio data stream, then performs voice endpoint detection on the cached audio data stream. After detecting active voice, the active voice is packaged and sent to the audio processing device for processing. Because the audio data stream is cached and voice endpoint detection is performed on the resource server, there is a delay between the resource server receiving the audio data stream and sending the active voice to the audio processing device, resulting in an increase in the overall processing response delay. Furthermore, in some scenarios, since voice endpoint detection is performed by the resource server and audio processing is performed by the audio processing device, if the audio processing result has a low accuracy problem, both the resource server and the audio processing device need to participate in the problem analysis, which increases the difficulty of problem analysis.

[0035] This disclosure provides a data processing method that, in the process of audio data processing, helps to improve the processing performance of audio data and reduces the difficulty of problem analysis when the accuracy of audio processing results is low.

[0036] The data processing method according to embodiments of this disclosure can be executed by an electronic device such as a terminal device or a server. The terminal device can be an in-vehicle device, user equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, in-vehicle device, wearable device, etc. The method can be implemented by a processor calling computer-readable program instructions stored in memory. Alternatively, the method can be executed by a server.

[0037] Figure 2 A flowchart illustrating the data processing method provided in this embodiment of the disclosure. (Refer to...) Figure 2 This method can be applied to resource servers and may include the following steps.

[0038] S210, in response to the data processing request from the resource control terminal, obtains the audio data requested for processing by the resource control terminal.

[0039] S220, a start message is sent to the audio processing device, which instructs the audio processing device to start the voice endpoint detection function.

[0040] In this step, the resource server can trigger or control the audio processing device to start the voice endpoint detection function via a Start message.

[0041] S230, receive the first confirmation information returned by the audio processing device. The first confirmation information is used to indicate that the voice endpoint detection function has been activated.

[0042] In this step, the resource server can determine that the audio processing device has started voice endpoint detection by the first confirmation message (Recog_Start) of the start message, and then send the audio data requested by the resource control terminal to the audio processing device in real time in response to the first confirmation message.

[0043] S240, in response to the first confirmation message, sends audio data to the audio processing device in real time.

[0044] In this step, the resource server notifies the audio processing device to start voice endpoint detection by sending a start message, and after receiving the first confirmation message from the audio processing device, it sends the audio data to the audio processing device in real time. This provides a message basis for the audio processing device to perform voice endpoint detection before audio processing on the received audio signal, rather than performing audio processing directly.

[0045] S250 receives the audio processing results sent by the audio processing device.

[0046] According to the data processing method of this disclosure, compared with related technologies, the resource server needs to first cache the received audio data, then perform voice endpoint detection on the cached audio data, and after detecting the valid audio segments in the audio data, send the valid audio segments as processing content to the audio processing device for processing. This causes a delay between the resource server receiving the audio data and sending the processing content to the audio processing device, resulting in an increase in the overall processing response delay. In the solution of this disclosure, after the resource server determines that the audio processing device has started the voice endpoint detection function, it sends the audio data as processing content to the audio processing device in real time, shortening the delay between receiving the audio data and sending the processing content to the audio processing device. This is beneficial to reducing the overall processing response delay and improving the audio data processing performance in the overall processing flow.

[0047] Furthermore, according to the data processing method of this disclosure embodiment, when the problem of low accuracy of audio processing results occurs, since the resource server in this disclosure embodiment sends audio data to the audio processing device without performing audio processing; and the audio processing is performed by the audio processing device, it is only necessary to troubleshoot the problem of the audio processing device, without troubleshooting the problem of the resource server. The audio processing device and the audio server do not need to participate in the problem analysis together, thereby reducing the difficulty of problem analysis and improving the efficiency of problem analysis.

[0048] In some embodiments, the data processing request includes an audio processing requirement, and the audio processing result is the audio processing result obtained by the audio processing device after performing voice endpoint detection on the audio data to obtain valid audio segments in the audio data, and then performing audio processing on the valid audio segments according to the audio processing requirement.

[0049] For example, the audio processing requirements include at least one of the following processing items: speech recognition, voiceprint recognition, and number status detection; the audio processing results include at least one of the following processing results: the processing result corresponding to speech recognition processing, the processing result corresponding to voiceprint recognition, and the processing result corresponding to number status detection.

[0050] In this embodiment, the audio processing device can perform audio processing on the received audio data based on the audio processing requirements contained in the data processing request, thereby satisfying the diverse needs of audio processing.

[0051] In some embodiments, before receiving the audio processing result sent by the audio processing device in step S250, the data processing method may further include the following steps.

[0052] S21, receive a first event message from the audio processing device; wherein the first event message is used to indicate that the audio processing device has detected the start position of a valid audio segment through voice endpoint detection.

[0053] S22, receive a second event message from the audio processing device; wherein the second event message is used to indicate that the audio processing device has detected the end position of a valid audio segment through voice endpoint detection.

[0054] In this embodiment, the resource server can determine the start position of the valid audio segment detected by the audio processing device in the audio data based on the first event message received from the audio processing device; and can determine the end position of the valid audio segment detected by the audio processing device based on the second event message received from the audio processing device; thus, the voice endpoint detection status of the audio data can be obtained based on the first event message and the second event message.

[0055] In some embodiments, the data processing method further includes: in response to a first event message, sending a first reply message to a resource control terminal; wherein the first reply message is used to indicate that a valid audio segment has been detected from the audio data.

[0056] In this embodiment, if the resource server receives a first event message sent by the audio processing device, it generates and sends a first reply message to the resource control terminal to notify the resource control terminal that a valid audio segment has been detected in the audio data.

[0057] As an example, the first response message can be represented as: an indication message indicating the detection of the start of voice (START-OF-INPUT). The START-OF-INPUT message is a response event message from the resource server to the resource control terminal, enabling the resource control terminal to know that it has detected a valid audio segment in the audio data, which includes the detected voice signal.

[0058] In this embodiment, the resource server indicates through a first reply message that a valid audio segment in the audio data has been detected. This reply message can increase the communication content between the resource server and the resource control terminal, improve the message communication efficiency between the resource server and the resource control terminal, and realize an intelligent processing flow in the audio processing process.

[0059] In some embodiments, after the step of receiving the audio processing result sent by the audio processing device in step S250, the data processing method further includes the following steps.

[0060] S31, send an end message to the audio processing device; wherein, the end message is used to instruct the audio processing device to stop the audio processing operation on the audio data.

[0061] In this step, after receiving the audio processing result, the resource server sends an End message to the audio processing device, so that the audio processing device ends the processing of the audio signal, and the current audio processing ends. This prepares the audio processing device for the next start of voice endpoint detection and audio processing.

[0062] S32, receive a second confirmation message returned by the audio processing device, the second confirmation message being used to indicate that the audio processing operation has stopped.

[0063] In this step, if the resource server receives a second confirmation message from the audio processing device, it can determine that the audio processing device has received the termination message and has stopped the audio processing operation.

[0064] S33 feeds back the audio processing results to the resource control terminal.

[0065] In this step, the audio processing result can be carried in the result feedback message, and the result feedback message carrying the audio processing result can be sent to the resource control terminal. Based on the received result feedback message, the resource control terminal can know the processing status of the audio data requested by the resource server: the audio processing has been completed and the audio processing result of the audio data has been obtained.

[0066] In this embodiment, after receiving the second confirmation message from the audio processing device, the resource server sends the audio processing result to the resource control terminal. In other words, when the resource server determines that the audio processing operation has stopped, it can promptly send the audio processing result to the resource control terminal, improving the communication efficiency between the resource server and the resource control terminal and the reliability of the audio data processing flow.

[0067] In some embodiments, the start message in step S220 is further used to instruct the audio processing device not to provide feedback on the voice endpoint detection result; the data processing method may further include: sending a first notification message to the resource control terminal when a valid audio segment is detected in the audio data; wherein the first notification message is used to indicate that a valid audio segment in the audio data has been detected.

[0068] In this step, the start message from the resource server to the audio processing device serves not only to instruct the audio processing device to initiate the voice endpoint detection function but also to instruct the audio processing device not to provide feedback on the voice endpoint detection result. In this case, the resource server can initiate voice endpoint detection and, upon detecting a valid audio segment in the audio data, send a first notification message to the resource control terminal to indicate that a valid audio segment in the audio data has been detected. For example, the resource server can initiate voice endpoint detection no earlier than the time the audio data is sent to the audio processing device in real time and no later than the time the audio processing result is received. To achieve near synchronization with the time the audio processing device performs voice endpoint detection on the audio data, as an example, the resource server can initiate voice endpoint detection at the same time as sending the start message to the audio processing device.

[0069] In this embodiment, voice endpoint detection can be initiated on both the resource server and the audio processing device. On the resource server side, the resource server continuously sends audio data streams to the audio processing device in real time. The voice endpoint detection results on the resource server are only used to notify the detected valid audio segments in the audio data. On the audio processing device side, the audio processing device can proceed with the next audio processing step based on the valid audio data obtained from its own voice endpoint detection, without needing to report the voice endpoint detection results back to the resource server. This processing method reduces the number of messages that the audio processing device needs to report, thereby simplifying the processing steps of the audio processing device and improving audio processing efficiency.

[0070] According to the data processing method of the embodiments of this disclosure, when a resource server receives audio data requested for processing from a resource control terminal, it can instruct the audio processing device to start the voice endpoint detection function through a start message. Upon confirming that the voice endpoint detection function of the audio processing device is enabled based on a first confirmation message sent by the audio processing device, the resource server forwards the requested audio data to the audio processing device in real time and receives the audio processing result returned by the audio processing device. Compared to related technologies where the resource server needs to first cache the received audio data, then perform voice endpoint detection on the cached audio data, and after detecting valid audio segments, send the valid audio segments as processing content to the audio processing device for processing, resulting in a delay between the resource server receiving the audio data and sending the processing content to the audio processing device, thus increasing the overall processing response delay, the solution of this disclosure, where the resource server sends the audio data as processing content to the audio processing device in real time after determining that the audio processing device has started the voice endpoint detection function, shortens the delay in sending the processing content to the audio processing device, which is beneficial for reducing the overall processing response delay and improving the audio data processing performance in the overall processing flow.

[0071] In some scenarios of this disclosure, when the accuracy of audio processing results is low, since the resource server in this disclosure sends audio data to the audio processing device without performing audio processing, and the audio processing is performed by the audio processing device, it is only necessary to troubleshoot the problem of the audio processing device, without troubleshooting the problem of the resource server. The audio processing device and the audio server do not need to participate in the problem analysis together, thereby reducing the difficulty of problem analysis and improving the efficiency of problem analysis.

[0072] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further. Those skilled in the art will understand that in the above methods of specific implementation, the specific execution order of each step should be determined by its function and possible internal logic.

[0073] Figure 3 A flowchart illustrating the data processing method provided in this embodiment of the disclosure. (Refer to...) Figure 3 This method can be applied to audio processing devices and may include the following steps.

[0074] S310 receives a startup message sent by the resource server. The startup message is used to instruct the audio processing device to start the voice endpoint detection function.

[0075] S320, start the voice endpoint detection function and send the first confirmation message to the resource server. The first confirmation message is used to indicate that the voice endpoint detection function has been started.

[0076] In this step, the audio processing device can enable voice endpoint detection in response to the resource server's start message, and if voice endpoint detection is successfully enabled, it can send a first confirmation message to the resource server to trigger the resource server to start forwarding the audio data requested for recognition by the resource control terminal to the audio device based on the confirmation message.

[0077] S330, receiving audio data sent in real time by the resource server in response to the first confirmation information; wherein, the audio data is audio data requested to be processed by the resource control terminal and obtained by the resource server in response to the data processing request of the resource control terminal.

[0078] S340 processes the audio data to obtain the audio processing result.

[0079] S350 sends the audio processing results to the resource server.

[0080] Compared to related technologies, where the resource server needs to cache the received audio data first, then perform voice endpoint detection on the cached audio data, and send the valid audio segments as processing content to the audio processing device, resulting in a delay between the resource server receiving the audio data and sending the processing content to the audio processing device, thus increasing the overall processing response latency, the solution disclosed in this paper sends the audio data as processing content to the audio processing device in real time after determining that the audio processing device has started the voice endpoint detection function. This shortens the latency of sending the processing content to the audio processing device, which helps to reduce the overall processing response latency and improve the audio data processing performance of the overall processing flow. Furthermore, when the accuracy of the audio processing results is low, only the audio processing device needs to be investigated, without investigating the resource server, thereby reducing the difficulty of problem analysis and improving the efficiency of problem analysis.

[0081] In some scenarios, the activation of voice endpoint detection by the audio processing device can be pre-agreed upon by the resource server and the audio processing device. For example, according to the agreed-upon event processing flow, the audio processing device automatically activates voice endpoint detection upon receiving audio data from the resource server (without needing to activate the voice endpoint detection function based on a startup message), thereby improving data processing efficiency.

[0082] In some embodiments, step S340 may specifically include: S41, obtaining valid audio segments contained in the audio data by performing voice endpoint detection on the audio data; S42, performing audio processing on the valid audio segments according to audio processing requirements to obtain the audio processing result of the corresponding audio data.

[0083] In some embodiments, step S340 may further include the following steps.

[0084] S51, a first event message is sent to the resource server, wherein the first event message is used to instruct the audio processing device to detect the start position of a valid audio segment through voice endpoint detection.

[0085] S52, a second event message is sent to the resource server, wherein the second event message is used to instruct the audio processing device to detect the end position of a valid audio segment through voice endpoint detection.

[0086] In this embodiment, the audio processing device performs voice endpoint detection on the audio data sent by the resource server. Voice endpoint detection can remove background noise interference when the system is silent, thereby improving the system's anti-interference ability and audio processing performance.

[0087] In some embodiments, the startup message in step S310 is also used to notify the audio processing device not to provide feedback on the voice endpoint detection results. In this embodiment, when performing voice endpoint detection on audio data, the audio processing device does not need to provide feedback on the voice endpoint detection results to the resource server. Instead, after detecting a valid audio segment in the audio data, it directly performs audio processing on that valid audio segment. This processing method reduces the number of messages that the audio processing device needs to provide feedback, thereby simplifying the processing steps of the audio processing device and improving processing efficiency.

[0088] In some embodiments, step S42, which involves performing audio processing on valid audio segments according to audio processing requirements to obtain the audio processing result of the corresponding audio data, may specifically include the following steps.

[0089] S61, if the audio processing requirement includes speech recognition, then perform speech recognition processing on the valid audio segments, and use the recognized text information corresponding to the valid audio segments as the audio processing result.

[0090] In this step, by performing speech recognition processing on valid audio segments in the audio data, the text information corresponding to the valid audio segments can be identified, and the identified text information is used as the audio processing result.

[0091] S62, if the audio processing requirement includes voiceprint recognition, then acoustic features are extracted from the valid audio segments; the voiceprint registration information obtained by registering the extracted acoustic features is used as the audio processing result; or, the registered voiceprint features are compared with the extracted acoustic features, and the speaker identity information of the audio data obtained based on the voiceprint comparison result is used as the audio processing result.

[0092] In this step, voiceprint recognition is a type of biometric technology, also known as speaker recognition. Voiceprint recognition refers to the process of using a specialized electroacoustic conversion instrument to plot the characteristics of sound waves into a spectral graph, comparing it with a registered voiceprint model, thereby distinguishing different individuals and achieving identity verification.

[0093] Voiceprint recognition is divided into two stages: voiceprint registration and voiceprint verification. If the current stage is voiceprint registration, acoustic features are extracted from valid audio segments. These extracted acoustic features are then used to register the voiceprint, which is then used as the audio processing result. Furthermore, the voiceprint registration information can be added to a voiceprint feature database to update the database, which contains multiple different voiceprint registration records. If the current stage is voiceprint verification, the registered voiceprint features are compared with the acoustic features extracted from valid audio segments. Based on the speaker's identity information obtained from the voiceprint comparison, this speaker's identity information is used as the audio processing result. In this embodiment, voiceprint recognition can distinguish different individuals and achieve identity verification.

[0094] S63, if the audio processing requirement includes number status detection, then extract speech features from the valid audio segments. If the speech features meet the predetermined judgment conditions, use the obtained number status detection result corresponding to the predetermined judgment conditions as the audio processing result; wherein, the audio data is the voice call data fed back after the number is called.

[0095] In this step, the number status includes at least one of the following: switched off, disconnected, not in service, overdue, out of service area, busy, and in a call.

[0096] In some embodiments, the voice call data returned after a number is called may be the audio recording collected by a recording module integrated into the terminal device or a recording device connected to the terminal device after the number is called. Voice features may include, for example, at least one of the following: keywords contained in the voice call data and the call duration of the voice call data; predetermined judgment conditions are used to indicate the conditions that a certain number status must meet, such as: whether the call duration of the voice call data exceeds a predetermined duration threshold, and / or whether the voice call data contains keywords corresponding to a certain number status.

[0097] Taking a number's "power off" status as an example, if the voice call data returned after calling the number is "The user you dialed is powered off," the duration of the voice call is less than a predetermined duration threshold, and the voice call data contains the keyword "power off" corresponding to the power off status, then the number can be determined to be in a powered-off state. Other conditions for determining a number's status can also be preset based on the duration of the voice call data and / or whether the voice call data contains keywords corresponding to a particular number's status.

[0098] In this embodiment, by detecting the number status, scenarios such as number cleaning, empty number filtering, number screening, active number extraction, and risk number detection can be performed based on the pre-detected number status, thereby improving the effectiveness of calls.

[0099] In this embodiment, the audio processing device can perform audio processing on the received audio data based on the audio processing requirements contained in the data processing request, thereby satisfying the diverse needs of audio processing.

[0100] In some embodiments, after sending the audio processing result to the resource server in step S350, the data processing method further includes the following steps.

[0101] S81 receives a termination message sent by the resource server. The termination message is used to instruct the audio processing device to end the audio processing operation on the audio data.

[0102] S82, in response to the end message, stops audio processing of the audio data.

[0103] S83, send a second confirmation message to the resource server. The second confirmation message is used to indicate that the audio processing operation has stopped.

[0104] In this embodiment, a complete audio processing flow of the audio processing device can begin by enabling voice endpoint detection and end upon receiving a termination message from the resource server. In response to the termination message from the resource server, the audio processing device can terminate the current audio processing operation on the audio data, preparing for the next audio processing operation.

[0105] According to the data processing method of this disclosure, an audio processing device can activate a voice endpoint detection function based on a received activation message from a resource server; send a first confirmation message to the resource server to indicate the activated state of the voice endpoint detection function; and after receiving audio data sent in real time by the resource server in response to the first confirmation message, process and send the audio processing result to the resource server. Through this method, on the one hand, the resource server directly sends the audio data requested for recognition by the resource control terminal to the audio processing device, which performs voice endpoint detection and real-time processing on the audio data. This helps reduce the overall processing response delay caused by the audio server caching the audio data, thereby improving the overall audio data processing performance. On the other hand, when the accuracy of the audio processing result is low, only the audio processing device needs to be checked, reducing the problem analysis process and difficulty, and improving the efficiency of problem analysis and processing.

[0106] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further. Those skilled in the art will understand that in the above methods of specific implementation, the specific execution order of each step should be determined by its function and possible internal logic.

[0107] To facilitate understanding, the following will be combined with... Figure 4 Taking voice recognition as an example, and voice data requested by a resource control terminal as a voice data stream (hereinafter referred to as a voice stream), a flowchart of a data processing method of an exemplary embodiment of this disclosure is described. Figure 4 A flowchart illustrating a data processing method of an exemplary embodiment of this disclosure is provided.

[0108] like Figure 4 As shown, the data processing method may include the following steps.

[0109] S401, the resource control terminal sends a voice recognition request to the resource server.

[0110] In this embodiment of the disclosure, when the audio processing requirement includes speech recognition, the data processing request sent by the resource control terminal to the resource server can be a speech recognition (RECOGNIZE) request.

[0111] S402, the resource server sends a response message to the resource control terminal in response to the voice recognition request.

[0112] In this step, the resource server sends a response message (IN-PROGRESS) to the resource control terminal to reply to the speech recognition request; the IN-PROGRESS message is used to indicate that the speech recognition request should be processed.

[0113] S403, the resource server sends a startup message to the audio processing device.

[0114] In this step, the resource server sends a Start message to the audio processing device to instruct the audio processing device to start the voice endpoint detection function.

[0115] S404, the audio processing device sends the first confirmation message to the resource server.

[0116] In this step, the audio processing device starts the voice endpoint detection function according to the received start message and sends a first confirmation message to the resource server. The first confirmation message is used to indicate the started status of the voice endpoint detection function. The resource server can determine that the audio processing device has started the voice endpoint detection through the first confirmation message, and can then send the voice stream requested by the resource control terminal to the audio processing device in real time in response to the first confirmation message.

[0117] S405, the resource server sends voice streams to the audio processing device in real time.

[0118] In this step, the resource server does not cache the audio stream; instead, it continuously forwards the audio stream received from the resource control terminal to the audio processing device in real time. Figure 4 As shown, the resource server continuously sends the voice stream until the audio processing device detects the end of the active voice.

[0119] S406, the audio processing device sends a first event message to the resource server; wherein, the first event message is used to indicate that the start position of a valid audio segment in the voice stream has been detected by voice endpoint detection.

[0120] For example, when the audio processing device detects the start position of a valid audio segment in the speech stream, it sends a first event message (speech_on message) to the resource server.

[0121] S407, the resource server sends the first reply message to the resource control terminal.

[0122] In this step, the resource server responds to the first event message from the audio processing device by sending a first reply message (Start-Of-Input message); through this message, the resource server notifies the resource control terminal that a valid audio segment has been detected in the voice stream.

[0123] S408, the audio processing device sends a second event message to the resource server.

[0124] In this step, when the audio processing device detects the end position of a valid audio segment in the speech, it sends a second event message (speech_off message) to the resource server to indicate that the audio processing device has detected the end position of a valid audio segment through speech endpoint detection.

[0125] S409, the audio processing device sends the speech recognition results to the resource server.

[0126] In this step, the audio processing device performs speech recognition processing on the valid audio segments detected in the speech stream, and uses the text information corresponding to the recognized valid audio segments as the speech recognition result.

[0127] S410, the resource server sends an end message to the audio processing device.

[0128] In this step, upon receiving the speech recognition result, the resource server sends a termination message to the audio processing device to instruct the audio processing device to terminate the speech recognition process.

[0129] S411, the audio processing device replies with a second confirmation message to the resource server.

[0130] In this step, the audio processing device sends a second confirmation message (recog_end message) to the resource server to indicate that the audio processing operation of the audio processing device has stopped, thereby ending the current round of speech recognition processing of the speech stream.

[0131] S412, the resource server sends the voice recognition results to the resource control terminal.

[0132] In this step, the resource server sends a Recognition-Complete message to feed back the recognition result to the resource control terminal.

[0133] In this embodiment, compared to related technologies where a resource server caches audio data and performs voice endpoint detection before sending the detection results to an audio processing device for processing, the data processing method in this embodiment does not cache the received audio signal. Instead, after determining that the audio processing device has activated the voice endpoint detection function, it forwards the audio data to the audio processing device in real time. The audio processing device then performs voice endpoint detection and audio processing, thereby reducing overall processing response latency and improving the system's audio data processing performance from the overall processing flow perspective. Furthermore, according to this embodiment, when a problem of low accuracy in audio processing results occurs, since both voice endpoint detection and audio processing steps are performed by the audio processing device, only the problem with the audio processing device needs to be investigated, without needing to investigate the resource server. This reduces the difficulty of problem analysis and improves its efficiency.

[0134] In addition, the embodiments of this disclosure also provide a data processing apparatus, a data processing system, an electronic device, and a computer-readable storage medium, all of which can be used to implement any of the data processing methods provided in this disclosure. The corresponding technical solutions and descriptions are described in the corresponding descriptions in the method section, and will not be repeated here.

[0135] Figure 5 This is a block diagram of a data processing apparatus provided in an embodiment of the present disclosure.

[0136] Reference Figure 5 This disclosure provides a data processing apparatus 500 applied to a resource server, and the apparatus may include: an acquisition module 510, configured to acquire audio data requested for processing by a resource control terminal in response to a data processing request from the resource control terminal; a sending module 520, configured to send a start message to an audio processing device, the start message being used to instruct the audio processing device to start a voice endpoint detection function; a receiving module 530, configured to receive a first confirmation message returned by the audio processing device, the first confirmation message being used to indicate the started state of the voice endpoint detection function; the sending module 520 is further configured to send audio data to the audio processing device in real time in response to the first confirmation message; and the receiving module 530 is further configured to receive audio processing results sent by the audio processing device.

[0137] In some embodiments, the data processing request includes an audio processing requirement, and the audio processing result is the audio processing result obtained by the audio processing device after performing voice endpoint detection on the audio data to obtain valid audio segments in the audio data, and then performing audio processing on the valid audio segments according to the audio processing requirement.

[0138] In some embodiments, after the receiving module 530 receives the audio processing result sent by the audio processing device, the sending module 520 is further configured to send an end message to the audio processing device; wherein the end message is used to instruct the audio processing device to stop the audio processing operation on the audio data; the receiving module 530 is further configured to receive a second confirmation message returned by the audio processing device, the second confirmation message being used to indicate that the audio processing operation has stopped; the sending module 520 is further configured to feed back the audio processing result to the resource control terminal.

[0139] In some embodiments, the initiation message is further configured to instruct the audio processing device not to provide feedback on the voice endpoint detection result; the sending module 520 is further configured to send a first notification message to the resource control terminal when a valid audio segment is detected in the audio data; wherein the first notification message is configured to indicate that a valid audio segment in the audio data has been detected.

[0140] According to the data processing apparatus of this application embodiment, when the resource server determines that the audio processing device has activated the voice endpoint detection function, it can send the audio data requested for recognition by the resource control terminal to the audio processing device in real time, where the audio processing device performs voice endpoint detection and audio processing on the audio data. In contrast, in related technologies, the resource server needs to first cache the received audio data, then perform voice endpoint detection on the cached audio data, and after detecting valid audio segments in the audio data, send the valid audio segments as processing content to the audio processing device for processing. This causes a delay between the resource server receiving the audio data and sending the processing content to the audio processing device, resulting in a delay in the overall processing response. In this embodiment, the resource server can send audio data as processing content to the audio processing device in real time after determining that the audio processing device has started the voice endpoint detection function. This shortens the delay in sending the processing content to the audio processing device, which helps to reduce the overall processing response delay and thus improves the system's audio data processing performance from the overall processing flow. Furthermore, according to the data processing device of this embodiment, when the accuracy of the audio processing result is low, since both the voice endpoint detection and audio processing steps are performed by the audio processing device, it is only necessary to investigate the problem of the audio processing device, without having to investigate the problem of the resource server. This reduces the difficulty of problem analysis and improves the efficiency of problem analysis.

[0141] Figure 6 This is a block diagram of a data processing apparatus provided in an embodiment of the present disclosure.

[0142] Reference Figure 6This disclosure provides a data processing apparatus 600 for use in an audio processing device. The data processing apparatus 600 includes: a receiving module 610 for receiving a startup message sent by a resource server, the startup message instructing the audio processing device to start a voice endpoint detection function; a startup module 620 for starting the voice endpoint detection function and sending a first confirmation message to the resource server, the first confirmation message indicating the startup status of the voice endpoint detection function; the receiving module 610 is also used to receive audio data sent in real-time by the resource server in response to the first confirmation message; wherein the audio data is audio data requested for processing by the resource control terminal, obtained by the resource server in response to a data processing request from the resource control terminal; a processing module 630 for processing the audio data to obtain an audio processing result; and a sending module 640 for sending the audio processing result to the resource server.

[0143] In some embodiments, the data processing request includes an audio processing requirement; the processing module 630 includes: a detection unit, configured to obtain valid audio segments contained in the audio data by performing voice endpoint detection on the audio data; and an audio processing unit, configured to perform audio processing on the valid audio segments according to the audio processing requirement, and obtain the audio processing result of the corresponding audio data.

[0144] In some embodiments, the audio processing unit includes: a speech recognition subunit, configured to perform speech recognition processing on a valid audio segment if the audio processing requirement includes speech recognition, and use the recognized text information corresponding to the valid audio segment as the audio processing result; a voiceprint recognition subunit, configured to extract acoustic features from the valid audio segment if the audio processing requirement includes voiceprint recognition, and use the voiceprint registration information obtained by voiceprint registration of the extracted acoustic features as the audio processing result; or, to compare the registered voiceprint features with the extracted acoustic features, and use the speaker identity information of the audio data obtained according to the voiceprint comparison result as the audio processing result; and a status detection subunit, configured to extract speech features from the valid audio segment if the audio processing requirement includes number status detection, and use the number status detection result corresponding to the predetermined judgment condition as the audio processing result if the speech features meet a predetermined judgment condition; wherein the audio data is the voice call data fed back after the number is called.

[0145] In some embodiments, the receiving module 610 is further configured to receive an end message sent by the resource server after sending the audio processing result to the resource server, the end message being used to instruct the audio processing device to end the audio processing operation on the audio data; the stopping processing module is further configured to stop the audio processing of the audio data in response to the end message; and the sending module 640 is further configured to send a second confirmation message to the resource server, the second confirmation message being used to indicate that the audio processing operation has been stopped.

[0146] According to the data processing apparatus of this application embodiment, the audio processing device starts the voice endpoint detection function based on the start message received from the resource server; and sends a first confirmation message to the resource server to indicate the started state of the voice endpoint detection function; and after receiving the audio data sent by the resource server in real time in response to the first confirmation message, processes and sends the audio processing result to the resource server.

[0147] Through this data processing device, after determining that the audio processing device has activated the voice endpoint detection function, the resource server sends the audio data requested for recognition by the resource control terminal to the audio processing device in real time. The audio processing device then performs voice endpoint detection and audio processing on the audio data. Compared to related technologies, where the resource server needs to cache the received audio data first, then perform voice endpoint detection on the cached audio data, and after detecting valid audio segments, sends the valid audio segments as processing content to the audio processing device for processing, resulting in a delay between the resource server receiving the audio data and sending the processing content to the audio processing device, thus causing a delay in the overall processing response, the resource server in this embodiment can send the audio data as processing content to the audio processing device in real time after determining that the audio processing device has activated the voice endpoint detection function. This shortens the delay in sending the processing content to the audio processing device, which helps to reduce the overall processing response delay caused by the audio server caching the audio data, thereby improving the audio data processing performance in the overall processing flow. Furthermore, when there is a problem of low accuracy in the audio processing results, only the audio processing device needs to be checked, without needing to check the resource server, which reduces the difficulty of problem analysis and helps to improve the efficiency of problem analysis and processing.

[0148] Figure 7 This is a block diagram of a data processing system provided in an embodiment of this disclosure. Figure 7 As shown, this embodiment of the disclosure provides a data processing system, which includes a resource server 710 and an audio processing device 720; wherein, the resource server 710 is used to execute the above-described data processing method applied to the resource server 710; and the audio processing device 720 is used to execute the above-described data processing method applied to the audio processing device 720.

[0149] According to the data processing system of this disclosure embodiment, the resource server can directly send the audio data requested and identified by the resource control terminal to the audio processing device, which performs both voice endpoint detection and audio processing on the audio data, thereby improving the audio data processing performance. On the other hand, when the accuracy of the audio processing results is low, only the audio processing device needs to be checked, which reduces the problem analysis process, lowers the difficulty of problem analysis, and helps to improve the efficiency of problem analysis and processing.

[0150] It should be clarified that this disclosure is not limited to the specific configurations and processes described in the foregoing embodiments and shown in the figures. For the sake of convenience and brevity, detailed descriptions of known methods are omitted here, and the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0151] Figure 8 This is a block diagram of an electronic device provided in an embodiment of the present disclosure.

[0152] Reference Figure 8 This disclosure provides an electronic device, which includes: at least one processor 801; at least one memory 802; and one or more I / O interfaces 803 connected between the processor 801 and the memory 802; wherein the memory 802 stores one or more computer programs that can be executed by the at least one processor 801, and the one or more computer programs are executed by the at least one processor 801 to enable the at least one processor 801 to perform any of the data processing methods described in the above embodiments.

[0153] This disclosure also provides a computer-readable storage medium storing a computer program thereon, wherein the computer program, when executed by a processor / processor core, implements any of the data processing methods described in the above embodiments. The computer-readable storage medium may be a volatile or non-volatile computer-readable storage medium.

[0154] This disclosure also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in the processor of an electronic device, the processor in the electronic device executes the above-described data processing method.

[0155] Those skilled in the art will understand that all or some of the steps, systems, and apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software can be distributed on a computer-readable storage medium, which may include computer storage media (or non-transitory media) and communication media (or transient media).

[0156] As is known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable program instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technologies, portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, it is known to those skilled in the art that communication media typically contain computer-readable program instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0157] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0158] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0159] The computer program product described herein can be implemented specifically through hardware, software, or a combination thereof. In one alternative embodiment, the computer program product is specifically embodied in a computer storage medium; in another alternative embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0160] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0161] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0162] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0163] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0164] Example embodiments have been disclosed herein, and while specific terminology has been used, it is for illustrative purposes only and should be construed as such, and is not intended to be limiting. In some instances, it will be apparent to those skilled in the art that features, characteristics, and / or elements described in connection with particular embodiments may be used alone, or in combination with features, characteristics, and / or elements described in connection with other embodiments, unless otherwise expressly indicated. Therefore, those skilled in the art will understand that various changes in form and detail may be made without departing from the scope of this disclosure as set forth by the appended claims.

Claims

1. A data processing method, characterized in that, Applied to a resource server, the method includes: In response to a data processing request from a resource control terminal, the audio data requested for processing by the resource control terminal is obtained; A start message is sent to the audio processing device, the start message being used to instruct the audio processing device to start the voice endpoint detection function; the start message is also used to instruct the audio processing device not to provide feedback on the voice endpoint detection result; Receive first confirmation information returned by the audio processing device, the first confirmation information being used to indicate the activated state of the voice endpoint detection function; In response to the first confirmation information, the audio data is sent to the audio processing device in real time; If a valid audio segment is detected in the audio data, a first notification message is sent to the resource control terminal; wherein, the first notification message is used to indicate that a valid audio segment has been detected in the audio data; Receive the audio processing results sent by the audio processing device.

2. The method according to claim 1, characterized in that, The data processing request includes an audio processing requirement. The audio processing result is the audio processing result obtained by the audio processing device after performing voice endpoint detection on the audio data to obtain valid audio segments in the audio data, and then performing audio processing on the valid audio segments according to the audio processing requirement.

3. The method according to claim 1, characterized in that, After receiving the audio processing result sent by the audio processing device, the method further includes: Send an end message to the audio processing device; wherein the end message is used to instruct the audio processing device to stop the audio processing operation on the audio data; Receive a second confirmation message returned by the audio processing device, the second confirmation message being used to indicate that the audio processing operation has stopped; The audio processing results are then fed back to the resource control terminal.

4. A data processing method, characterized in that, Applied to an audio processing device, the method includes: The system receives a startup message from a resource server, which instructs the audio processing device to start the voice endpoint detection function; the startup message also instructs the audio processing device not to provide voice endpoint detection results. The voice endpoint detection function is activated, and a first confirmation message is sent to the resource server. The first confirmation message is used to indicate that the voice endpoint detection function has been activated. The system receives audio data sent in real time by the resource server in response to the first confirmation information; wherein the audio data is audio data requested to be processed by the resource control terminal and obtained by the resource server in response to the data processing request of the resource control terminal. The audio data is processed to obtain the audio processing result of the audio data; If a valid audio segment is detected in the audio data, a first notification message is sent to the resource control terminal; wherein, the first notification message is used to indicate that a valid audio segment has been detected in the audio data; The audio processing result is sent to the resource server.

5. The method according to claim 4, characterized in that, The data processing request includes an audio processing requirement; the process of processing the audio data to obtain the audio processing result includes: By performing voice endpoint detection on the audio data, valid audio segments contained in the audio data are obtained; The effective audio segments are processed according to the audio processing requirements to obtain the corresponding audio processing results of the audio data.

6. The method according to claim 5, characterized in that, The step of performing audio processing on the effective audio segments according to the audio processing requirements to obtain the corresponding audio data audio processing result includes: If the audio processing requirement includes speech recognition, then the valid audio segment is subjected to speech recognition processing, and the recognized text information corresponding to the valid audio segment is used as the audio processing result; If the audio processing requirement includes voiceprint recognition, then acoustic features are extracted from the valid audio segment; the voiceprint registration information obtained by registering the extracted acoustic features is used as the audio processing result; or, the registered voiceprint features are compared with the extracted acoustic features, and the speaker identity information of the audio data obtained based on the voiceprint comparison result is used as the audio processing result. If the audio processing requirement includes number status detection, then speech features are extracted from the valid audio segments. If the speech features meet a predetermined judgment condition, the number status detection result corresponding to the predetermined judgment condition is used as the audio processing result; wherein, the audio data is the voice call data fed back after the number is called.

7. The method according to claim 4, characterized in that, After sending the audio processing result to the resource server, the method further includes: The device receives an end message sent by the resource server, the end message being used to instruct the audio processing device to end the audio processing operation on the audio data; In response to the termination message, audio processing of the audio data is stopped; A second confirmation message is sent to the resource server, the second confirmation message indicating that the audio processing operation has stopped.

8. A data processing system, characterized in that, The system includes: a resource server and an audio processing device; wherein the resource server is used to execute the data processing method according to any one of claims 1-3; The audio processing device is used to perform the data processing method according to any one of claims 4-7.

9. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores one or more computer programs that can be executed by the at least one processor, the one or more computer programs being executed by the at least one processor to enable the at least one processor to perform the method as claimed in any one of claims 1-3 or any one of claims 4-7.

10. A computer-readable storage medium, characterized in that, The storage medium stores instructions that, when executed by the processor of the electronic device, enable the electronic device to perform the method as claimed in any one of claims 1-3 or any one of claims 4-7.

Images