Audio data transmission method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an audio data transmission method and device, equipment and a storage medium, and can be applied to the technical field of data transmission. According to the method, an audio data acquisition request of a client is responded through a server, required audio acquisition parameters are analyzed, and the parameters are used for installation and configuration of an audio acquisition program. And then the installation parameters of the audio acquisition program are sent to the corresponding terminal equipment for installation and starting, so that the server can perform audio data acquisition according to the preset parameters, the quality and applicability of the audio data are ensured, the efficiency and flexibility of the audio acquisition process are improved, diversified application scene requirements are met, and the user experience is improved. And the reliability of the system and the user experience are enhanced.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to an audio data transmission method, apparatus, device and storage medium. Background Art

[0002] With the rapid development of modern technology, remote control technology has become an indispensable tool. For Android devices, remote control not only enables basic device operations such as screenshots and touchscreens, but also extends to the collection and transmission of audio information. This technology has demonstrated significant value in a variety of fields, including but not limited to remote technical support, online education, and game live streaming.

[0003] Regarding data transmission, by outputting the Android device's audio to the web client in real time, remote users can hear the device's sound, gaining a more comprehensive understanding and control of the device's status. Therefore, remote debugging of Android devices has become a critical task in terminal intelligent testing labs.

[0004] However, traditional audio acquisition methods have significant limitations. When using a traditional microphone to capture audio, it is usually necessary to turn on the device's speakers to complete the recording. This method is not applicable in a centralized deployment environment because when multiple devices play sound simultaneously, the speakers of different devices will interfere with each other, causing the collected sound to contain unnecessary background noise, which not only affects the audio quality, but also increases the complexity of environmental management and reduces overall efficiency. Therefore, the present invention provides a solution for audio data transmission. Summary of the Invention

[0005] The embodiments of the present application provide an audio data transmission method, apparatus, device and storage medium, which are used to improve the problem of noise interference caused by turning on the speaker of the device to complete the recording when traditional audio data is collected.

[0006] In a first aspect, an embodiment of the present application provides an audio data transmission method, applied to a server, the method comprising:

[0007] In response to an audio data acquisition request sent by a client via the WebSocket protocol, the audio data acquisition request is parsed and processed to obtain audio acquisition parameters, wherein the audio acquisition parameters include: a terminal device identifier;

[0008] Sending installation parameters of the audio acquisition program to the terminal device corresponding to the terminal device identifier, so that the terminal device installs the audio acquisition program based on the installation parameters;

[0009] The audio acquisition parameters are sent to the terminal device, so that the terminal device starts the audio acquisition program based on the audio acquisition parameters and acquires the audio data corresponding to the audio data acquisition request.

[0010] Optionally, the installation parameters of the audio acquisition program include: an APK file, and sending the installation parameters of the audio acquisition program to the terminal device corresponding to the terminal device identifier includes:

[0011] Use the ADB tool to determine whether the terminal device identifier exists in the device list;

[0012] When the terminal device identifier exists in the device list, the APK file of the audio acquisition program is obtained, and the APK file is installed to the terminal device through the ADB tool.

[0013] In a second aspect, an embodiment of the present application provides an audio data transmission method, applied to a terminal device, the method comprising:

[0014] Receive the installation parameters sent by the server and install the corresponding audio acquisition program based on the installation parameters;

[0015] Receiving audio acquisition parameters sent by the server, where the audio acquisition parameters are determined by the server in response to an audio data acquisition request sent by the client via the WebSocket protocol;

[0016] Based on the audio acquisition parameters, starting the audio acquisition program and performing acquisition processing using the audio acquisition program to obtain target audio data corresponding to the audio data acquisition request;

[0017] The target audio data is sent to a server, so that the server feeds the target audio data back to the client.

[0018] Optionally, the adopting the audio acquisition program to perform acquisition processing to obtain target audio data corresponding to the audio data acquisition request includes:

[0019] Using the audio acquisition program to perform acquisition processing to obtain first audio data;

[0020] Performing quality detection on the first audio data to obtain second audio data according to preset conditions;

[0021] encoding the second audio data, and determining corresponding audio format parameters based on the encoded second audio data;

[0022] generating corresponding audio header information according to the audio format parameters, and encapsulating the encoded second audio data with the corresponding audio header information to obtain a plurality of audio data packets;

[0023] The plurality of audio data packets are used as the target audio data.

[0024] Optionally, performing quality detection on the first audio data to obtain second audio data according to a preset condition includes:

[0025] Performing feature extraction processing on the first audio data to obtain a plurality of feature information, wherein the feature information includes: signal strength, noise level, and frequency response;

[0026] Obtaining an audio quality benchmark, and determining whether the quality of the first audio data is qualified based on the signal strength, the noise level, the frequency response, and the audio quality benchmark corresponding to the first audio data;

[0027] The first audio data with qualified quality is determined as the second audio data.

[0028] In a third aspect, an embodiment of the present application provides an audio data transmission method, applied to a client, the method comprising:

[0029] In response to the user's operation of obtaining audio information, sending an audio data collection request to the server through the WebSocket protocol, so that the server obtains the corresponding target audio data from the terminal device based on the audio data collection request;

[0030] Receive the target audio data sent by the server, and parse and process the target audio data to obtain second audio data.

[0031] Optionally, after obtaining the second audio data, the method further includes:

[0032] Playing the second audio data and obtaining an audio playing index of the second audio data during the playing process;

[0033] Based on the audio playback index, performing data analysis and processing on the audio playback of the second audio data to obtain an audio playback effect trend index;

[0034] The playback quality of the second audio data is evaluated according to the audio playback effect trend index to obtain a playback quality evaluation result of the second audio data.

[0035] In a fourth aspect, an embodiment of the present application provides an audio data transmission device, applied to a server, the device comprising:

[0036] A processing module is used to respond to an audio data collection request sent by a client through the WebSocket protocol, parse and process the audio data collection request, and obtain audio collection parameters, wherein the audio collection parameters include: a terminal device identifier;

[0037] a sending module, configured to send installation parameters of the audio acquisition program to a terminal device corresponding to the terminal device identifier, so that the terminal device installs the audio acquisition program based on the installation parameters;

[0038] The sending module is further configured to send the audio acquisition parameters to the terminal device so that the terminal device receives the audio acquisition parameters based on the audio acquisition parameters;

[0039] The processing module is further configured to start the audio acquisition program and acquire the audio data corresponding to the audio data acquisition request.

[0040] Optionally, the device further includes: a judgment module and an acquisition module;

[0041] The determination module is configured to determine whether the terminal device identifier exists in the device list through an ADB tool;

[0042] The acquisition module is configured to acquire the APK file of the audio acquisition program when the terminal device identifier exists in the device list;

[0043] The processing module is further configured to install the APK file to the terminal device via the ADB tool.

[0044] In a fifth aspect, an embodiment of the present application provides an audio data transmission device, applied to a terminal device, the device comprising:

[0045] A processing module is configured to receive installation parameters sent by a server and install a corresponding audio acquisition program based on the installation parameters; receive audio acquisition parameters sent by the server, the audio acquisition parameters being determined by the server in response to an audio data acquisition request sent by a client via the WebSocket protocol; start the audio acquisition program based on the audio acquisition parameters, and use the audio acquisition program to perform acquisition processing to obtain target audio data corresponding to the audio data acquisition request;

[0046] The sending module is used to send the target audio data to the server, so that the server feeds back the target audio data to the client.

[0047] Optionally, the device further comprises: a determination module and a generation module;

[0048] The processing module is further configured to use the audio acquisition program to perform acquisition processing to obtain first audio data; perform quality detection processing on the first audio data to obtain second audio data according to preset conditions; and perform encoding processing on the second audio data;

[0049] The determining module is configured to determine corresponding audio format parameters based on the encoded second audio data;

[0050] The generating module is configured to generate corresponding audio header information according to the audio format parameters;

[0051] The processing module is further configured to encapsulate the encoded second audio data and the corresponding audio header information to obtain a plurality of audio data packets; and use the plurality of audio data packets as the target audio data.

[0052] Optionally, the device further includes: an acquisition module and a judgment module;

[0053] The processing module is further configured to perform feature extraction processing on the first audio data to obtain a plurality of feature information, wherein the feature information includes: signal strength, noise level, and frequency response;

[0054] The acquisition module is used to obtain an audio quality benchmark;

[0055] The judgment module is configured to judge whether the quality of the first audio data is qualified based on the signal strength, the noise level, the frequency response, and the audio quality benchmark corresponding to the first audio data;

[0056] The processing module is further configured to determine the first audio data of qualified quality as the second audio data.

[0057] In a sixth aspect, an embodiment of the present application provides an audio data transmission device, applied to a client, the device comprising:

[0058] A sending module is configured to send an audio data acquisition request to a server via the WebSocket protocol in response to a user's operation of acquiring audio information, so that the server acquires corresponding target audio data from the terminal device based on the audio data acquisition request;

[0059] The processing module is used to receive the target audio data sent by the server and parse the target audio data to obtain second audio data.

[0060] Optionally, the device further includes: an acquisition module;

[0061] The processing module is further configured to play the second audio data;

[0062] The acquisition module is used to obtain the audio playback index of the second audio data during the playback process;

[0063] The processing module is further used to perform data analysis and processing on the audio playback of the second audio data based on the audio playback index to obtain an audio playback effect trend index; and evaluate and process the playback quality of the second audio data based on the audio playback effect trend index to obtain a playback quality evaluation result of the second audio data.

[0064] In a seventh aspect, an embodiment of the present application provides an audio data transmission device, comprising: a memory, a processor;

[0065] The memory stores computer-executable instructions;

[0066] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the first aspect and / or various possible ways of implementing the audio data transmission method of the first aspect.

[0067] In an eighth aspect, the present application provides a computer storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the first aspect and various possible ways of implementing the audio data transmission method as described above.

[0068] The audio data transmission method provided in the embodiment of the present application is that the server responds to the audio data acquisition request sent by the client, parses it to obtain corresponding audio acquisition parameters, and sends the installation parameters of the audio acquisition program to the terminal device corresponding to the audio acquisition parameters, so that the audio acquisition program is installed on the terminal device, and then sends the audio acquisition parameters to the terminal device to ensure that it starts the audio acquisition program to collect audio data, thereby ensuring the quality and applicability of the audio data, while improving the efficiency and flexibility of the audio acquisition process, meeting the needs of diverse application scenarios, and enhancing the reliability of the system and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0070] Figure 1 A schematic diagram of the process of transmitting audio data provided by this application Figure 1 ;

[0071] Figure 2 A schematic diagram of the process of transmitting audio data provided by this application Figure 2 ;

[0072] Figure 3A schematic diagram of the process of transmitting audio data provided by this application Figure 3 ;

[0073] Figure 4 This is a schematic diagram of the structure of an audio data transmission device provided by this application Figure 1 ;

[0074] Figure 5 This is a schematic diagram of the structure of an audio data transmission device provided by this application Figure 2 ;

[0075] Figure 6 This is a schematic diagram of the structure of an audio data transmission device provided by this application Figure 3 ;

[0076] Figure 7 This is a structural diagram of an audio data transmission device provided in this application.

[0077] The above drawings illustrate specific embodiments of the present application, which will be described in more detail below. These drawings and the textual description are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0078] To make the objectives, technical solutions, and advantages of this application more clear, the technical solutions in this application will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0079] The terms "first," "second," "third," "fourth," and so forth (if any) in the description and claims of the present invention and in the accompanying drawings are used to distinguish similar items and are not necessarily used to describe a particular order or sequential sequence. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances, such that the embodiments of the present invention described herein can be practiced in orders other than those illustrated or described herein.

[0080] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0081] First, let’s explain the terms involved in this application:

[0082] The WebSocket protocol is a communication protocol that provides full-duplex communication over a single TCP connection. Unlike HTTP's request-response model, WebSocket allows real-time data transmission between servers and clients, eliminating the need for clients to frequently initiate requests to check for new data. This means that once a WebSocket connection is established, both the server and the client can send messages to each other at any time.

[0083] A URL (Uniform Resource Locator) is an address used to identify the location of a resource on the internet. It allows users to access resources such as web pages, files, images, and videos through a browser or other network tools.

[0084] Host computer: A term commonly used in computer control and automation, it refers to a computing device or system at a higher level in a control system, primarily responsible for monitoring, management, and sending instructions to lower-level devices, known as slave computers. Simply put, a host computer typically refers to the computers or servers used for human-computer interaction, data processing, decision-making, and directing the operations of other devices.

[0085] ADB (Android Debug Bridge): ADB is a general-purpose command-line tool used to communicate with Android devices from a computer. It primarily provides debugging capabilities for developers, supporting operations such as command execution, file transfer, and application installation. It can also be used to monitor device status, run shell commands, and manage on-device applications. It's a powerful tool for developing, debugging, and managing Android devices.

[0086] APK (Android Package) files are a software package format used by the Android operating system for distributing and installing mobile applications. Essentially, an APK file is a compressed package containing all of an application's data and resources, such as code (.dex files), resource files (images, strings, etc.), asset files, and a manifest file, which together define the application's structure and behavior. Simply put, an APK file is like an .exe installation file on Windows, specifically designed for installing applications on Android devices. It enables developers to easily distribute their applications to users and allows them to install and use these applications on their devices.

[0087] A socket connection is a mechanism for enabling bidirectional communication in a network environment, allowing data exchange between two different processes. Sockets abstract underlying network protocols, such as TCP / IP or UDP, allowing developers to focus on application-level data processing logic without having to deal directly with complex network details. Sockets are commonly used for continuous communication between clients and servers, such as instant messaging and online gaming.

[0088] While both Sockets and WebSockets enable two-way communication over the Internet, their design objectives and usage scenarios differ. WebSockets are more suitable for real-time communication in modern web applications, while Sockets are a more general network programming concept suitable for a wider range of application scenarios.

[0089] With the rapid development of modern technology, remote control technology has become an indispensable tool. For Android devices, remote control not only enables basic device operations such as screenshots and touchscreens, but also extends to the collection and transmission of audio information. This technology has demonstrated significant value in a variety of fields, including but not limited to remote technical support, online education, and game live streaming.

[0090] Regarding data transmission, by outputting the Android device's audio to the web client in real time, remote users can hear the device's sound, gaining a more comprehensive understanding and control of the device's status. Therefore, remote debugging of Android devices has become a critical task in terminal intelligent testing labs.

[0091] However, traditional audio capture methods have significant limitations. When using traditional microphones to capture audio, it's often necessary to turn on the device's speakers to complete the recording. This approach isn't suitable for centralized deployment environments because when multiple devices play audio simultaneously, the speakers of different devices interfere with each other, causing the captured audio to contain unnecessary background noise. This not only affects audio quality, but also complicates environment management and reduces overall efficiency.

[0092] In response to the above problems, this application proposes an audio data transmission method.

[0093] The method responds to the audio data acquisition request sent by the client through a server, parses the request to obtain corresponding audio acquisition parameters, and sends the installation parameters of the audio acquisition program to the terminal device corresponding to the audio acquisition parameters, so that the audio acquisition program is installed on the terminal device, and then sends the audio acquisition parameters to the terminal device to ensure that the audio acquisition program is started to acquire audio data, thereby ensuring the quality and applicability of the audio data, while improving the efficiency and flexibility of the audio acquisition process, meeting the needs of diverse application scenarios, and enhancing the reliability of the system and user experience.

[0094] The following specific embodiments describe in detail the technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0095] Figure 1 A schematic diagram of the process of transmitting audio data provided by this application Figure 1 ,like Figure 1 As shown, the audio data transmission method provided in this embodiment is applied to a server and includes:

[0096] S101: In response to an audio data collection request sent by a client via the WebSocket protocol, the server parses and processes the audio data collection request to obtain audio collection parameters, where the audio collection parameters include a terminal device identifier.

[0097] The server may be a host computer, for example, and the client may be a browser, for example. The audio data collection request refers to a request instruction sent by the client through the WebSocket protocol after receiving the user's operation instruction. The terminal device identifier is also the terminal device ID.

[0098] This step is based on the audio data collection request sent by the client and parses it to obtain audio collection parameters in order to accurately understand and meet specific audio collection requirements. Specifically, extracting audio collection parameters such as the terminal device identifier helps determine which device to collect audio data from and how to perform the collection operation based on specific configurations such as sampling rate and encoding format. This not only ensures the accuracy and efficiency of the audio collection process, but also adapts to the diverse needs of different application scenarios.

[0099] In one possible implementation, after receiving a user's command, the browser can create a WebSocket instance through JavaScript code and connect to the designated port and path of the host computer. Specifically, when attempting to establish a WebSocket connection with the host computer, the browser can first send a WebSocket handshake request with a specific URL (the URL points to the host computer's WebSocket service) to the host computer. After receiving the handshake request, the host computer needs to verify the legitimacy of the request, for example, by checking the Origin field in the request to ensure that the handshake request comes from a trusted source. After the legitimacy verification is passed, the host computer accepts the connection and returns a handshake response, completing the WebSocket handshake process and successfully establishing the WebSocket connection between the browser and the host computer.

[0100] After a successful WebSocket connection is established between the browser and the host computer, the browser can also construct an audio data collection request based on the user's business needs. This audio data collection request includes the session ID, terminal device ID, and audio format requirements. The browser sends the audio data collection request to the host computer through the established WebSocket connection. During this process, the host computer listens to the designated port, waiting for the WebSocket connection request sent by the browser. Upon receiving the audio data collection request, the host computer receives and parses the message content to determine the device from which audio needs to be collected and the relevant audio collection parameters, and uses this information as the audio collection parameters.

[0101] S102: The server sends installation parameters of the audio acquisition program to the terminal device corresponding to the terminal device identifier, so that the terminal device installs the audio acquisition program based on the installation parameters.

[0102] The installation parameter may be, for example, an APK file of an audio acquisition program prepared by a server, and the terminal device may be, for example, a target Android device.

[0103] This step sends the audio acquisition program's installation parameters to the terminal device corresponding to the terminal device identifier, allowing the terminal device to install the audio acquisition program based on the installation parameters. This ensures that the terminal device can accurately install and configure the audio acquisition program according to these parameters. This further ensures that the audio acquisition program can run directly according to preset requirements after installation, without requiring additional manual configuration. This improves deployment efficiency and configuration accuracy, making the audio data acquisition process more automated and precise.

[0104] In one possible implementation, after parsing the audio data acquisition request, the host computer can obtain the audio acquisition parameters, that is, the terminal device ID and the acquisition mode, encoding format, etc. of the audio acquisition. At this time, the ADB tool can also be used to check whether the target Android device has been connected to the host computer via USB. Specifically, the ADB tool can be used to find out whether the target Android device ID (terminal device ID) exists in the device list. If not, the device is not connected, and the host computer needs to send an error message to the client through WebSocket, prompting that the Android device is not connected; if it exists, the device is connected, and the host computer can prepare the APK file of the audio acquisition program and use the ADB command to push the APK file to the target Android device, thereby installing the audio acquisition program.

[0105] Optionally, during the installation of the audio acquisition program on the host computer, the output of the ADB command can be monitored to confirm whether the installation is successful. If the installation fails, the host computer will send an error message to the client through WebSocket, indicating that the installation failed.

[0106] Understandably, the audio capture program supports silent capture (applicable to Android 11 and above) and audio encoding functions.

[0107] S103: The server sends the audio collection parameters to the terminal device, so that the terminal device starts the audio collection program based on the audio collection parameters and collects the audio data corresponding to the audio data collection request.

[0108] This step sends the audio acquisition parameters to the terminal device, enabling it to launch an audio acquisition program based on the parameters and collect the corresponding audio data. This ensures that the audio acquisition process complies with pre-set configuration standards, thereby guaranteeing the quality and applicability of the collected audio data and enabling efficient and accurate data collection.

[0109] In one possible implementation, after the audio acquisition program is installed, the host computer can construct startup parameters for the audio acquisition program according to user requests. The startup parameters include: audio acquisition mode, such as internal recording mode or microphone mode, session ID, audio encoding format, such as AAC, Opus, number of channels and sampling rate parameters, etc., and then use the ADB command to start the audio acquisition program, and pass the constructed startup parameters to the audio acquisition program, so that the audio acquisition program collects audio data corresponding to the audio acquisition data request sent by the browser based on the startup parameters.

[0110] Optionally, after the audio capture program is launched on the target Android device, it initializes the audio capture module based on the passed startup parameters. Specifically, if the audio capture mode is internal recording mode, the audio capture program captures the internal audio stream of the target Android device through the MediaRecorder or AudioRecord API; if the audio capture mode is microphone mode, the audio capture program captures audio through the microphone. Based on the passed audio encoding format, the audio capture program initializes the audio encoder and then adds audio header information based on the audio encoding format to facilitate subsequent decoding.

[0111] It can be understood that in the process of starting the audio acquisition program, the host computer can also monitor the output log of the audio acquisition program through ADB to confirm whether the program is successfully started. If the audio acquisition program is successfully started, the host computer sends a confirmation message to the client through WebSocket to inform it that the audio acquisition program has been started; similarly, if the audio acquisition program succeeds or fails, the host computer will also send a failure message to the client through WebSocket to inform it that the audio acquisition program failed to start.

[0112] An audio data transmission method provided by an embodiment of the present application, wherein a server responds to an audio data acquisition request sent by a client, parses the request to obtain corresponding audio acquisition parameters, and sends the installation parameters of the audio acquisition program to a terminal device corresponding to the audio acquisition parameters, so that the audio acquisition program is installed on the terminal device, and then sends the audio acquisition parameters to the terminal device to ensure that the audio acquisition program is started to acquire audio data, thereby ensuring the quality and applicability of the audio data, while improving the efficiency and flexibility of the audio acquisition process and meeting the needs of diverse application scenarios.

[0113] Figure 2 A process diagram of a restart operation monitoring alarm method provided in this application Figure 2 ,like Figure 2 As shown, this embodiment Figure 1 Based on the embodiment, a possible implementation of the restart operation monitoring alarm method is described in detail. The method is applied to a terminal device and includes:

[0114] S201: The terminal device receives the installation parameters sent by the server and installs the corresponding audio acquisition program based on the installation parameters.

[0115] The terminal device may be, for example, a target Android device.

[0116] Once the host computer has prepared the APK file of the audio capture program, it can push the APK file to the target Android device using the ADB (Android Debug Bridge) command. Specifically, the host computer can first use the adb push command to transfer the APK file to the specified directory of the target Android device. After the APK file is successfully transferred to the target Android device, the host computer then executes the adb install command to install the audio capture program. During this process, the device will verify the integrity and security of the APK file and request the user to confirm the installation operation as needed. This step ensures that the audio capture program can be seamlessly deployed to the target Android device and can be put into use immediately, thereby achieving efficient and accurate audio data collection.

[0117] S202: The terminal device receives the audio collection parameters sent by the server.

[0118] The audio acquisition parameters are determined by the server in response to an audio data acquisition request sent by the client via the WebSocket protocol.

[0119] This step receives the audio capture parameters sent by the server to ensure that the target device accurately configures and launches the audio capture process based on these parameters. These parameters typically include key information such as the session ID, device ID, and audio format requirements. They instruct the device on how to capture audio data, such as specifying the sampling rate, encoding format, and number of channels. By receiving and applying these parameters, the device can capture audio according to pre-set standards and requirements, ensuring that the captured data meets the expected quality and format requirements.

[0120] In one possible implementation, the host computer responds to the audio data acquisition request sent by the browser through the WebSocket protocol, parses the obtained corresponding audio acquisition parameters, and sends them to the target Android device after the audio acquisition program is successfully installed on the target Android device. That is, the target Android device receives the audio acquisition parameters sent by the host computer.

[0121] S203: The terminal device starts the audio collection program based on the audio collection parameters.

[0122] The purpose of starting the audio acquisition program based on the audio acquisition parameters is to ensure that the audio data acquisition task is accurately executed according to the preset specific configuration, such as sampling rate, encoding format, number of channels, etc. By initializing and starting the audio acquisition program with these parameters, the device can accurately meet the acquisition requirements and ensure that the collected audio data meets the expected quality standards and format requirements, thereby supporting subsequent data processing, analysis, or transmission operations.

[0123] S204: Using the audio acquisition program to perform acquisition processing to obtain first audio data.

[0124] The first audio data may be original audio data collected by the audio acquisition data without any processing.

[0125] This step uses an audio acquisition program to collect and process the first audio data. The purpose of obtaining the first audio data is to obtain qualified raw audio data based on preset acquisition parameters. This data can be used in various subsequent applications, such as audio analysis, monitoring, transcription, or other processing tasks, to meet the needs of different business scenarios.

[0126] In a possible implementation, the audio acquisition program calls an audio acquisition interface provided by the Android system, such as MediaRecorder or AudioRecord API, according to startup parameters, starts audio data acquisition, and obtains the first audio data.

[0127] It is understandable that the collected first audio data may also be allocated to a data buffer for temporary storage, thereby ensuring the continuity and integrity of the data.

[0128] Optionally, before an audio acquisition program is used for acquisition and processing and the first audio data is obtained, a Socket connection needs to be established between the audio acquisition program in the target Android device and the host computer. Specifically, after the audio acquisition program in the target Android device is started, a Socket object can be created in the Android program using the java.net.Socket class based on the host computer IP address and port number contained in the startup parameters passed in by the host computer, and the remote endpoint of the Socket object can be set. The connect method of the Socket object is then called to initiate a connection request to the server (IP address) and port of the specified host computer. At this point, the host computer starts a Socket service at the specified port, listens for and receives Socket connection requests from the audio acquisition program, and creates a new thread to handle communication for each Socket connection. During the connection establishment process, the audio acquisition program can send a session ID to the host computer through the established Socket connection and mark this audio transmission session. The host computer receives the session ID sent by the audio acquisition program and verifies its legitimacy, such as checking whether the session ID is consistent with the user request. If the session ID verification is successful, the host computer sends a confirmation message to the audio acquisition program through the Socket connection, indicating that the connection has been successfully established. At the same time, the audio acquisition program receives the confirmation message sent by the host computer, confirming that the connection has been successfully established; if the session ID is consistent with the user request, the host computer disconnects the session with the browser and the work is terminated.

[0129] S205: The terminal device performs feature extraction processing on the first audio data to obtain a plurality of feature information and acquires an audio quality benchmark, wherein the feature information includes: signal strength, noise level, and frequency response.

[0130] Among them, audio quality benchmarks include: signal strength benchmark, noise level benchmark and frequency response benchmark. Signal strength indicates the strength of audio data. Qualified audio data needs to ensure that the collected audio is neither too weak nor too strong. Noise level indicates the background noise level. Qualified audio data needs to ensure that the noise is within an acceptable range and does not affect the audio quality. Frequency response indicates the distribution of audio data within the frequency range. Similarly, qualified audio data needs to ensure that the audio data performs well within the key frequency band.

[0131] This step extracts features from the first audio data, obtains multiple feature information, and acquires an audio quality benchmark. The goal is to evaluate the quality of the first audio data and analyze whether it meets the quality standards. Based on the evaluation results, the team then determines whether to re-collect the audio data or adjust preprocessing parameters, i.e., audio collection parameters, to improve audio quality. This ensures the high quality and applicability of the final audio data, meeting the requirements of subsequent processing and applications.

[0132] In one possible implementation, after obtaining the first audio data, feature analysis can be performed on the audio data to extract audio quality features including signal strength features, noise level features, and frequency response features, and set preset audio quality benchmark values, namely, signal strength benchmark, noise level benchmark, and frequency response benchmark.

[0133] As you can understand, the benchmark value is used to evaluate whether the collected audio data meets the quality requirements, the signal strength benchmark value is used to ensure that the audio is neither too weak nor too strong, the noise level benchmark value is used to define the acceptable background noise level to avoid noise interference with the audio content, and the frequency response benchmark value is used to define the frequency response range of key frequency bands to ensure that the audio performs well within these frequency bands.

[0134] S206: Determine whether the quality of the first audio data is qualified; if so, execute step S207; if not, execute step S208.

[0135] Among them, according to the signal strength, noise level, frequency response corresponding to the first audio data and the preset signal strength benchmark, noise level benchmark and frequency response benchmark, an audio quality evaluation index can be calculated by a formula, and a qualified threshold is preset to judge whether the quality of the first audio data is qualified. If the audio quality evaluation index is higher than the preset qualified threshold, the audio data is considered to be qualified and subsequent processing can continue. If the audio quality evaluation index is lower than the qualified threshold, the audio data is considered to be substandard and needs to be adjusted. Specifically, the calculation formula of the audio quality evaluation index is as follows:

[0136]

[0137] in, is the audio quality assessment index, is the signal strength, is the noise level, is the frequency response, is the signal strength benchmark, is the noise level benchmark, The frequency response benchmark.

[0138] In one possible implementation, The value range is between 0 and 1. When the audio quality fully meets the benchmark value, Close to 1, when the audio quality deviates seriously from the baseline value, Close to 0; if near , then The contribution is greater if Too low or too high, will decrease; if near , then The contribution is greater if Too high, will decrease; if near , then The contribution is greater if Deviation from the baseline value, It will decrease. Assuming the threshold is 0.7, if , the audio data is considered to meet the standards and can continue to be processed. , then the audio data is considered not up to standard and needs to be adjusted. , you can increase the microphone gain, if , you can reduce the microphone gain; if , a noise reduction algorithm can be applied if Not compliant , you can adjust the audio equalizer to enhance or attenuate the energy of specific frequency bands.

[0139] S207: Determine the first audio data with qualified quality as the second audio data.

[0140] The purpose of determining qualified first audio data as the second audio data in this step is to determine the final usable second audio data from the qualified first audio data that has passed the quality assessment, ensuring that only high-quality audio data that meets the preset standards is selected. This provides reliable and high-quality audio material for subsequent processing, analysis, or application, avoiding biased results or quality issues caused by the use of unqualified data.

[0141] S208: Re-collect the first audio data that does not meet the quality standards.

[0142] If the audio data does not meet the expected quality requirements, the evaluation results can be used to determine whether to re-collect the audio data or adjust the pre-processing parameters to improve the audio quality. This ensures that all collected audio data can achieve the best results and provides a reliable foundation for subsequent processing.

[0143] It is understandable that the following strategies can also be used to make adjustments to make the first audio data of unqualified quality meet the standards. The adjustment strategies may specifically include: adjusting the microphone gain to improve the signal strength. For example, when the signal strength is lower than the baseline value, the microphone gain can be increased; if the signal strength is higher than the baseline value, the gain can be reduced, and the audio data can be re-collected for evaluation. Alternatively, a noise reduction algorithm can be applied to reduce background noise. For example, when the noise level is detected to be higher than the baseline value, spectral subtraction, wavelet noise reduction and other techniques can be used to reduce the background noise. At the same time, the clarity of the audio content needs to be retained as much as possible, and then the audio data is collected and evaluated again. Alternatively, the audio equalizer can be adjusted to optimize the frequency response. For example, if the frequency response in the key frequency band does not meet the baseline value, the audio performance can be optimized by enhancing or attenuating the energy of a specific frequency band, and then the audio data can be re-collected and evaluated.

[0144] If the audio data still does not meet the standards after these adjustments, repeat the above evaluation and adjustment process until the audio quality meets the requirements. If the standards are still not met after multiple adjustments, feedback is required and the audio capture environment or equipment should be checked for potential issues. This ensures that the final audio data obtained is of high quality and good usability.

[0145] S209: The terminal device encodes the second audio data and determines corresponding audio format parameters based on the encoded second audio data.

[0146] The corresponding audio encoder can be selected based on a specified encoding format, i.e., the encoding format in the startup parameters of the audio acquisition program, and initialized based on the selected encoding format. This allows the second audio data of acceptable quality to be encoded to generate compressed audio data, and specific audio format parameters are then determined based on the encoded audio data.

[0147] It can be understood that the encoder can be used to convert the collected original audio data into a coding format suitable for transmission, send the preprocessed audio data to the encoder for encoding, generate compressed audio data, and determine specific audio format parameters based on the encoded audio data.

[0148] S210: Generate corresponding audio header information according to the audio format parameters, and encapsulate the encoded second audio data with the corresponding audio header information to obtain multiple audio data packets.

[0149] Among them, each data packet contains audio header information, audio data, timestamp and session ID. The audio header information describes the audio format such as sampling rate, number of channels, encoding format, etc. The audio data is the encoded audio content. The timestamp is used for synchronous playback. The session ID can be used to identify this audio transmission session.

[0150] In one possible implementation, corresponding audio header information can be generated based on audio format parameters, including sampling rate, number of channels, bit depth, and encoding format, and the generated audio header information can be appended to the encoded audio data to form a complete audio file, i.e., multiple audio data packets.

[0151] S211: Use the multiple audio data packets as the target audio data.

[0152] The purpose of using multiple audio data packets as target audio data in this step is to integrate the processed and optimized audio data packets into the final target audio data, ensuring that these data packets meet the preset quality standards and format requirements. This provides complete and high-quality audio materials for subsequent applications or storage.

[0153] S212: The terminal device sends the target audio data to the server, so that the server feeds back the target audio data to the client.

[0154] Among them, the audio acquisition program in the terminal device can encapsulate the encoded audio data and audio header information into data packets, and then send them one by one to the host computer in real time through the established Socket connection to ensure the continuity of the audio stream.

[0155] The host computer can also start a Socket service on a designated port to listen for connection requests from the audio capture program, receive these audio data packets, and temporarily store them in a buffer to ensure data integrity and sequence. The host computer then establishes a two-way communication connection with the browser via the WebSocket protocol. The received audio data packets are encapsulated into WebSocket message format and forwarded to the browser in real time via the WebSocket connection, ensuring low latency and sequential data transmission. The browser's JavaScript code listens for the WebSocket onmessage event, receives and processes the audio data packets forwarded by the host computer, thus achieving a seamless transition from audio capture to playback.

[0156] The audio data transmission method provided in the embodiment of the present application installs the corresponding audio acquisition program on the terminal device by receiving the installation parameters sent by the server, and starts the audio acquisition program after successful installation, thereby acquiring the first audio data, and then performing feature extraction processing on the first audio data to obtain multiple feature information, and calculating and judging whether the quality of the first audio data is qualified based on the preset audio quality benchmark. If the quality of the first audio data is qualified, it is determined as the second audio data, and the second audio data is encoded, the corresponding audio format parameters are determined and the corresponding audio header information is generated, and the encoded second audio data and the corresponding audio header information are encapsulated to obtain multiple audio data packets, that is, the target audio data, and finally the target audio data is sent to the server, and the server then feeds it back to the client, thereby realizing fully automated management of audio data from acquisition, processing to transmission, ensuring the high quality and consistency of the audio data, and at the same time improving the efficiency and accuracy of audio data acquisition and processing, meeting the high standards requirements in various application scenarios.

[0157] Figure 3 A process diagram of a restart operation monitoring alarm method provided in this application Figure 3 ,like Figure 3 As shown, this embodiment Figure 2 Based on the embodiment, a possible implementation of the restart job monitoring alarm method is described in detail. The method is applied to the client and includes:

[0158] S301: In response to the user's operation of obtaining audio information, the client sends an audio data collection request to the server through the WebSocket protocol, so that the server obtains corresponding target audio data from the terminal device based on the audio data collection request.

[0159] This step sends an audio data collection request to the server via the WebSocket protocol, enabling the server to retrieve the target audio data from the terminal device based on the user's specific requirements, such as the specified device ID and audio format. This approach not only supports real-time two-way communication, ensuring efficient data transmission and immediate response, but also allows flexible configuration of audio collection parameters to meet the needs of different application scenarios, thereby improving user experience and system efficiency.

[0160] In one possible implementation, after the client receives a user's request to retrieve audio information, it first creates a WebSocket instance using JavaScript and connects to the server. It then constructs an audio data collection request containing parameters such as the session ID, device ID, and audio format requirements, and sends it to the server via the established WebSocket connection. The server receives and parses the request, locates the corresponding terminal device based on the parameters, launches or adjusts the audio collection program to obtain the required target audio data, and ultimately returns the collected audio data to the client or for subsequent processing.

[0161] S302: The client receives the target audio data sent by the server, and parses the target audio data to obtain second audio data.

[0162] In this step, the client parses the target audio data sent by the server to convert it into a format suitable for further use or analysis. By decoding the target audio data, i.e., the data packet, the desired second audio data can be extracted to meet the needs of different application scenarios, such as audio analysis, multi-channel processing, or specific format requirements.

[0163] In one possible implementation, after receiving the target audio data from the server, an appropriate parsing method is first selected based on the specific format of the audio data, such as the encoding format. The target audio data is then decoded and parsed using a corresponding audio processing library to extract the desired second audio data. This may include, but is not limited to, separating different audio channels, extracting audio clips from a specific time period, or converting audio from one encoding format to another. After parsing, the second audio data can be played, stored, or further analyzed according to application requirements.

[0164] S303: The client plays the second audio data and obtains an audio playback indicator of the second audio data during the playback process.

[0165] This step plays the second audio data and obtains audio playback metrics during playback to ensure audio playback quality and performance, while also providing a basis for subsequent analysis or optimization. By monitoring metrics such as playback latency, packet loss rate, and volume level, potential issues can be promptly identified and resolved, ensuring a consistent and high-quality user experience.

[0166] In one possible implementation, the browser side can use the Web Audio API to decode the received audio data packets and obtain the decoded audio data. Specifically, you can first create an AudioContext object, which is the core of the Web Audio API and is used to manage the decoding, processing and playback of audio. AudioContext provides an audio processing environment that can process multiple audio streams at the same time, and uses its decodeAudioData method to decode the received encoded audio data into an AudioBuffer object. Since the audio data is sent in multiple data packets, the browser side needs to splice these data packets during the decoding process to form a complete audio stream. The decoded audio data is temporarily stored in the audio buffer to ensure the continuity of audio playback and avoid playback interruptions due to network delays or data transmission problems.

[0167] The audio playback system then reads the audio data from the buffer and plays it through the browser's audio output device. During playback, the Web Audio API dynamically adjusts the buffer size based on playback progress and network conditions to ensure smooth playback. Simultaneously, the browser uses the Web Audio API to monitor audio playback smoothness, latency, and packet loss in real time. It also calculates an audio quality index to assess audio playback quality, thereby analyzing audio playback performance on Android devices.

[0168] S304: Based on the audio playback index, perform data analysis and processing on the audio playback of the second audio data to obtain an audio playback effect trend index.

[0169] The audio playback indicators include: fluency index, delay index, packet loss rate index, and sound quality index. Fluency indicates whether the audio playback is smooth and whether there are any freezes or interruptions. Delay indicates the delay of audio playback and whether it meets real-time requirements. Packet loss rate indicates the packet loss of audio data and whether it affects the playback quality. Sound quality indicates whether the audio quality is clear and whether there is noise or distortion. The audio playback effect trend index of the third audio data is calculated and processed to obtain the audio playback effect trend index. The audio playback effect trend index calculation formula is as follows:

[0170]

[0171] in, is the audio effect trend index, which is used to evaluate the overall quality of audio playback. The value range is from 0 to 1. When all indicators reach the optimal state (i.e. ), Close to 1, when all indicators are at their worst state, Close to 0, A value close to 1 indicates excellent audio playback quality, high fluency, low latency, low packet loss rate, and clear sound quality. If it is close to 0, it means that the audio playback quality is poor, and there may be problems such as lag, high latency, high packet loss rate, or poor sound quality. The fluency index reflects whether the audio playback is stuck or interrupted, indicating the smoothness of the audio playback. The value range is 0 to 1. The closer the value is to 1, the smoother the playback. The delay index reflects the real-time performance of audio playback and indicates the delay of audio playback. Its value range is 0 to 1. The closer the value is to 0, the lower the delay. The packet loss rate indicator reflects the integrity of the audio data and indicates the packet loss of the audio data. Its value range is 0 to 1. The closer the value is to 0, the lower the packet loss rate is. The sound quality index reflects the clarity and distortion of the audio, and its value range is 0 to 1. The closer the value is to 1, the better the sound quality.

[0172] It is understandable that the higher the fluency, the better The greater the contribution, the lower the delay. The greater the contribution, the lower the packet loss rate. The greater the contribution, the better the sound quality. The greater the contribution.

[0173] S305: Evaluate the playback quality of the second audio data according to the audio playback effect trend index to obtain a playback quality evaluation result of the second audio data.

[0174] The purpose of this step is to evaluate the playback quality of the second audio data based on the audio playback quality trend index, thereby obtaining a playback quality assessment result for the second audio data. This process can quantify the impact of playback issues such as smoothness, latency, and packet loss, ensuring that the final third audio data used is not only of high quality but also achieves the expected effect during actual playback.

[0175] The audio data transmission method provided in the embodiment of the present application receives the target audio data sent by the server through the client, decodes it to obtain second audio data, plays the second audio data, obtains the audio playback index during the playback process, and then calculates the playback effect trend index of the second audio based on the audio playback index, thereby evaluating the playback quality of the audio, ensuring that each link from audio data reception to playback can meet high quality standards, providing a stable and high-quality audio experience, and achieving the purpose of accurately analyzing and optimizing audio playback performance under different network conditions and device environments.

[0176] Figure 4 This is a schematic diagram of the structure of an audio data transmission device provided by this application, such as Figure 4 As shown, the audio data transmission device 400 provided in this embodiment is applied to a server and includes:

[0177] The processing module 401 is configured to respond to an audio data collection request sent by a client via the WebSocket protocol, parse the audio data collection request, and obtain audio collection parameters, wherein the audio collection parameters include: a terminal device identifier;

[0178] A sending module 402 is configured to send installation parameters of the audio acquisition program to a terminal device corresponding to the terminal device identifier, so that the terminal device installs the audio acquisition program based on the installation parameters;

[0179] The sending module 402 is further configured to send the audio acquisition parameters to the terminal device so that the terminal device receives the audio acquisition parameters based on the audio acquisition parameters;

[0180] The processing module 401 is further configured to start the audio acquisition program and acquire the audio data corresponding to the audio data acquisition request.

[0181] Optionally, the device further includes: a judgment module 403 and an acquisition module 404;

[0182] The determination module 403 is configured to determine whether the terminal device identifier exists in the device list through an ADB tool;

[0183] The acquisition module 404 is configured to acquire the APK file of the audio acquisition program if the terminal device identifier exists in the device list;

[0184] The processing module 401 is further configured to install the APK file to the terminal device through the ADB tool.

[0185] This embodiment provides an audio data transmission device that can execute the method provided in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0186] Figure 5 This is a schematic diagram of the structure of an audio data transmission device provided by this application, such as Figure 5 As shown, the audio data transmission device 500 provided in this embodiment is applied to a terminal device and includes:

[0187] Processing module 501 is configured to receive installation parameters sent by a server and install a corresponding audio acquisition program based on the installation parameters; receive audio acquisition parameters sent by the server, the audio acquisition parameters being determined by the server in response to an audio data acquisition request sent by a client via the WebSocket protocol; start the audio acquisition program based on the audio acquisition parameters, and use the audio acquisition program to perform acquisition processing to obtain target audio data corresponding to the audio data acquisition request;

[0188] The sending module 502 is configured to send the target audio data to a server, so that the server feeds the target audio data back to the client.

[0189] Optionally, the apparatus further includes: a determination module 503 and a generation module 504;

[0190] The processing module 501 is further configured to perform acquisition processing using the audio acquisition program to obtain first audio data; perform quality detection processing on the first audio data to obtain second audio data according to preset conditions; and perform encoding processing on the second audio data.

[0191] The determining module 503 is configured to determine corresponding audio format parameters based on the encoded second audio data;

[0192] The generating module 504 is configured to generate corresponding audio header information according to the audio format parameters;

[0193] The processing module 501 is further configured to encapsulate the encoded second audio data and the corresponding audio header information to obtain a plurality of audio data packets; and use the plurality of audio data packets as the target audio data.

[0194] Optionally, the device further includes: an acquisition module 505 and a judgment module 506;

[0195] The processing module 501 is further configured to perform feature extraction processing on the first audio data to obtain a plurality of feature information, wherein the feature information includes: signal strength, noise level, and frequency response;

[0196] The acquisition module 505 is used to obtain an audio quality benchmark;

[0197] The judgment module 506 is configured to judge whether the quality of the first audio data is qualified based on the signal strength, the noise level, the frequency response, and the audio quality benchmark corresponding to the first audio data;

[0198] The processing module 501 is further configured to determine the first audio data with qualified quality as the second audio data.

[0199] This embodiment provides an audio data transmission device that can execute the method provided in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0200] Figure 6 This is a schematic diagram of the structure of an audio data transmission device provided by this application, such as Figure 6 As shown, the audio data transmission device 600 provided in this embodiment is applied to a client and includes:

[0201] The sending module 601 is configured to send an audio data acquisition request to the server via the WebSocket protocol in response to the user's operation of acquiring audio information, so that the server acquires the corresponding target audio data from the terminal device based on the audio data acquisition request;

[0202] The processing module 602 is configured to receive the target audio data sent by the server, and parse and process the target audio data to obtain second audio data.

[0203] Optionally, the device further includes: an acquisition module 603;

[0204] The processing module 602 is further configured to play the second audio data;

[0205] The acquisition module 603 is used to obtain the audio playback index of the second audio data during the playback process;

[0206] The processing module 602 is further used to perform data analysis and processing on the audio playback of the second audio data based on the audio playback index to obtain an audio playback effect trend index; and to evaluate and process the playback quality of the second audio data based on the audio playback effect trend index to obtain a playback quality evaluation result of the second audio data.

[0207] This embodiment provides an audio data transmission device that can execute the method provided in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0208] Figure 7 This is a structural diagram of an audio data transmission device provided by this application. Figure 7 As shown, the present application provides an audio data transmission device 700 including: a receiver 701 , a transmitter 702 , a processor 703 and a memory 704 .

[0209] Receiver 701, for receiving instructions and data;

[0210] Transmitter 702, used to send instructions and data;

[0211] Memory 704, for storing computer-executable instructions;

[0212] The processor 703 is configured to execute the computer-executable instructions stored in the memory 704 to implement the various steps of the audio data transmission method in the above embodiment. For details, please refer to the relevant description of the above embodiment of the audio data transmission method.

[0213] Optionally, the memory 704 may be independent or integrated with the processor 703 .

[0214] When the memory 704 is independently provided, the electronic device further includes a bus for connecting the memory 704 and the processor 703 .

[0215] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the audio data transmission method executed by the above-mentioned audio data transmission device is implemented.

[0216] The readable storage medium may be implemented by any type of volatile or non-volatile memory device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium may be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0217] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be an integral part of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0218] The division of units is merely a logical functional division; actual implementations may employ alternative divisions, such as combining or integrating multiple units or components into another system, or omitting or disabling certain features. Furthermore, any direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units, either through an interface, electrical, mechanical, or other means.

[0219] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0220] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0221] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the method of the present invention. The aforementioned storage medium includes various media that can store program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0222] Those skilled in the art will appreciate that all or part of the steps in the above-described method embodiments can be implemented using hardware associated with program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0223] Finally, it should be noted that those skilled in the art will readily identify other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art not disclosed herein. The present invention is not limited to the precise structure described above and illustrated in the accompanying drawings, and various modifications and variations may be made without departing from the scope thereof. The scope of the present invention is limited solely by the appended claims.

Claims

1. A method for transmitting audio data, characterized in that: Applicable to servers, including: In response to an audio data acquisition request sent by a client via the WebSocket protocol, the audio data acquisition request is parsed and processed to obtain audio acquisition parameters, wherein the audio acquisition parameters include: a terminal device identifier; Sending installation parameters of the audio acquisition program to the terminal device corresponding to the terminal device identifier, so that the terminal device installs the audio acquisition program based on the installation parameters; The audio acquisition parameters are sent to the terminal device, so that the terminal device starts the audio acquisition program based on the audio acquisition parameters and acquires the audio data corresponding to the audio data acquisition request.

2. The method according to claim 1, characterized in that The installation parameters of the audio acquisition program include: an APK file, and sending the installation parameters of the audio acquisition program to the terminal device corresponding to the terminal device identifier includes: Use the ADB tool to determine whether the terminal device identifier exists in the device list; When the terminal device identifier exists in the device list, the APK file of the audio acquisition program is obtained, and the APK file is installed to the terminal device through the ADB tool.

3. An audio data transmission method, characterized in that: Applied to terminal equipment, including: Receive the installation parameters sent by the server and install the corresponding audio acquisition program based on the installation parameters; Receiving audio acquisition parameters sent by the server, where the audio acquisition parameters are determined by the server in response to an audio data acquisition request sent by the client via the WebSocket protocol; Based on the audio acquisition parameters, starting the audio acquisition program and performing acquisition processing using the audio acquisition program to obtain target audio data corresponding to the audio data acquisition request; The target audio data is sent to a server, so that the server feeds the target audio data back to the client.

4. The method according to claim 3, characterized in that The step of using the audio acquisition program to perform acquisition processing to obtain target audio data corresponding to the audio data acquisition request includes: Using the audio acquisition program to perform acquisition processing to obtain first audio data; Performing quality detection on the first audio data to obtain second audio data according to preset conditions; encoding the second audio data, and determining corresponding audio format parameters based on the encoded second audio data; generating corresponding audio header information according to the audio format parameters, and encapsulating the encoded second audio data with the corresponding audio header information to obtain a plurality of audio data packets; The plurality of audio data packets are used as the target audio data.

5. The method according to claim 4, characterized in that The performing quality detection processing on the first audio data to obtain second audio data according to a preset condition includes: Performing feature extraction processing on the first audio data to obtain a plurality of feature information, wherein the feature information includes: signal strength, noise level, and frequency response; Obtaining an audio quality benchmark, and determining whether the quality of the first audio data is qualified based on the signal strength, the noise level, the frequency response, and the audio quality benchmark corresponding to the first audio data; The first audio data with qualified quality is determined as the second audio data.

6. An audio data transmission method, characterized in that: Applied to the client, including: In response to the user's operation of obtaining audio information, sending an audio data collection request to the server through the WebSocket protocol, so that the server obtains the corresponding target audio data from the terminal device based on the audio data collection request; Receive the target audio data sent by the server, and parse and process the target audio data to obtain second audio data.

7. The method according to claim 6, characterized in that After obtaining the second audio data, the method further includes: Playing the second audio data and obtaining an audio playing index of the second audio data during the playing process; Based on the audio playback index, performing data analysis and processing on the audio playback of the second audio data to obtain an audio playback effect trend index; The playback quality of the second audio data is evaluated according to the audio playback effect trend index to obtain a playback quality evaluation result of the second audio data.

8. An audio data transmission device, characterized in that: The device comprises: A processing module is used to respond to an audio data collection request sent by a client through the WebSocket protocol, parse and process the audio data collection request, and obtain audio collection parameters, wherein the audio collection parameters include: a terminal device identifier; a sending module, configured to send installation parameters of the audio acquisition program to a terminal device corresponding to the terminal device identifier, so that the terminal device installs the audio acquisition program based on the installation parameters; The sending module is further configured to send the audio acquisition parameters to the terminal device so that the terminal device receives the audio acquisition parameters based on the audio acquisition parameters; The processing module is further configured to start the audio acquisition program and acquire the audio data corresponding to the audio data acquisition request.

9. An audio data transmission device, characterized in that include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the audio data transmission method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, which are used to implement the audio data transmission method according to any one of claims 1 to 7 when executed by a processor.

Images