Audio communication method, system, device and medium

Abstract

The present invention provides an audio communication method, system, device and medium, wherein the audio communication method comprises: establishing a connection between a client and a server, and obtaining information indicating that the connection has been successfully established; obtaining a task set, a control instruction and the audio input by the client based on the information indicating that the connection has been successfully established; performing data acquisition, noise reduction processing, data compression and encryption processing on the audio on the client based on the task set, and obtaining encrypted audio data; receiving the encrypted audio data uploaded by multiple clients based on the task set and the control instruction, and decrypting and decompressing the encrypted audio data to obtain multiple decompressed audio data, and then synthesizing the multiple decompressed audio data, and playing the synthesized decompressed audio data on the server. The audio communication method disclosed by the present invention improves the real-time performance and accuracy of audio communication.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to an audio communication method, system, device and medium. Background Art

[0002] In an environment of highly developed network technology, the internet's various file and information transmission capabilities are highly sophisticated, and communication technology between different embedded devices is particularly mature. Local Area Network (LAN) communication is widely used within major enterprises due to its advantages of high security, high controllability, and privacy protection. However, because the devices implementing LAN communication are separated by air or cannot easily communicate with each other, implementing LAN communication in more specialized environments requires the repeated purchase or development of specialized equipment. Using specialized equipment to implement LAN communication often results in significant data transmission delays, lacks real-time control between the server and client, and can even cause data corruption, reducing communication efficiency and accuracy. Summary of the Invention

[0003] In view of the shortcomings of the prior art described above, the present invention provides an audio communication method, system, device and medium to solve the problem that the above-mentioned method of using dedicated equipment to achieve local area network communication often has a large data transmission delay, cannot achieve real-time control of the server and client, and even causes damage to the communication data, thereby reducing the efficiency and accuracy of communication.

[0004] The present invention provides an audio communication method, the method comprising:

[0005] Establish connections between multiple clients and the server, and obtain information about successful connection establishment;

[0006] Acquire, based on the information indicating successful connection establishment, a task set of the plurality of clients and the server, a control instruction, and audio input by the plurality of clients;

[0007] According to the task set, performing data collection, noise reduction processing, data compression and encryption processing on the audio on the plurality of clients to obtain encrypted audio data;

[0008] According to the task set and the control instruction, the server receives the encrypted audio data uploaded by the plurality of clients, decrypts and decompresses the encrypted audio data, and obtains a plurality of decompressed audio data on the server; and

[0009] According to the task set, a plurality of the decompressed audio data are synthesized and processed, and the synthesized decompressed audio data are played on the server.

[0010] In one embodiment of the present invention, obtaining the information indicating successful connection establishment includes the following steps:

[0011] Determine whether the server exists. If so, establish connections between the multiple clients and the server, and determine whether the multiple clients are successfully connected to the server. If so, obtain information that the connections are successfully established.

[0012] In one embodiment of the present invention, obtaining the encrypted audio data includes the following steps:

[0013] Acquire the audio input by the server or the client;

[0014] Performing data collection and noise reduction processing on the audio to obtain noise-reduced audio data;

[0015] Compressing the noise-reduced audio data to obtain compressed audio data; and

[0016] The compressed audio data is encrypted to obtain the encrypted audio data.

[0017] In one embodiment of the present invention, the audio communication method further comprises the following steps:

[0018] Obtaining the audio input from the server;

[0019] According to the task set, performing data collection, noise reduction processing, data compression and encryption processing on the audio on the server to obtain the encrypted audio data;

[0020] According to the task set and the control instruction, the plurality of clients receive the encrypted audio data uploaded by the server, and decrypt and decompress the encrypted audio data to obtain decompressed audio data on the plurality of clients; and

[0021] The decompressed audio data is played on the plurality of clients according to the task set.

[0022] In one embodiment of the present invention, playing the synthesized decompressed audio data on the server includes the following steps:

[0023] Decrypting the encrypted audio data to obtain multiple decrypted audio data;

[0024] Decompressing the decrypted audio data to obtain the decompressed audio data; and

[0025] The multiple decompressed audio data are synthesized to obtain synthesized decompressed audio data, and the synthesized decompressed audio data is played on the server.

[0026] In one embodiment of the present invention, the audio communication method further includes the following steps:

[0027] Obtain control instructions for the client to send data and the server to receive data;

[0028] According to the control instruction of the client to send data and the control instruction of the server to receive data, the plurality of clients send the encrypted audio data to the server, and the server receives the encrypted audio data.

[0029] In one embodiment of the present invention, the audio communication method further includes the following steps:

[0030] Obtain control instructions for the client to receive data and the server to send data;

[0031] According to the control instruction of the client to receive data and the control instruction of the server to send data, the server sends the encrypted audio data to the multiple clients, and the multiple clients receive the encrypted audio data.

[0032] The present invention provides a device for processing abnormal conditions of a vehicle controller, the device comprising:

[0033] The connection module is used to establish connections between multiple clients and the server and obtain information about successful connection establishment;

[0034] A task set and audio acquisition module, configured to acquire the task sets, control instructions, and audio input from the plurality of clients and the server according to the information that the connection is successfully established;

[0035] An audio processing module, configured to perform data collection, noise reduction, data compression, and encryption on the audio on the plurality of clients according to the task set, to obtain encrypted audio data;

[0036] an encrypted audio data processing module, configured to receive, on the server side, the encrypted audio data uploaded by the multiple clients, and decrypt and decompress the encrypted audio data to obtain multiple decompressed audio data on the server side according to the task set and the control instruction; and

[0037] The audio data playing module is used to synthesize the multiple decompressed audio data according to the task set, and play the synthesized decompressed audio data on the server.

[0038] The present invention provides an electronic device, comprising:

[0039] at least one processor;

[0040] A storage device is used to store at least one program, and when the at least one program is executed by the at least one processor, the electronic device implements any of the above-mentioned audio communication methods.

[0041] The present invention provides a computer-readable storage medium, characterized in that a computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute any of the above-mentioned audio communication methods.

[0042] The beneficial effects of the present invention are as follows: the application of the audio communication method implemented in the present invention is integrated into existing embedded devices or small system devices, reducing the application of independent devices and reducing application costs. In addition, the audio data is processed confidentially and optimized and synthesized, thereby improving the privacy and accuracy of the data. In addition, through real-time control between the server and the client, the real-time performance of the audio data communication is improved, and the integrity of the transmitted audio data is protected.

[0043] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings are incorporated into and constitute a part of the specification, illustrating embodiments consistent with the present application and, together with the specification, serving to explain the principles of the present application. It is obvious that the drawings described below are merely some embodiments of the present application, and a person of ordinary skill in the art can derive other drawings based on these drawings without inventive effort. In the drawings:

[0045] Figure 1 is a schematic diagram of an application environment of an audio communication method shown in an exemplary embodiment of the present application;

[0046] Figure 2 is a flow chart of an audio communication method shown in an exemplary embodiment of the present application;

[0047] Figure 3 is a flow chart of a method for obtaining encrypted audio data shown in an exemplary embodiment of the present application;

[0048] Figure 4 is a flow chart of a method for playing synthesized decompressed audio data on a server side, shown in an exemplary embodiment of the present application;

[0049] Figure 5This is a flow chart of a method for transmitting audio data from a server to a client, shown in an exemplary embodiment of the present application;

[0050] Figure 6 is a structural diagram of an audio communication device shown in an exemplary embodiment of the present application;

[0051] Figure 7 A schematic diagram of the structure of a computer system suitable for implementing an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0052] The following describes the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art will readily appreciate the other advantages and benefits of the present invention from the disclosure herein. The present invention may also be implemented or applied through various other specific embodiments, and the various details in this specification may be modified or altered based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are intended only to illustrate the present invention and are not intended to limit the scope of protection of the present invention.

[0053] It should be noted that the illustrations provided in the following embodiments are merely schematic illustrations of the basic concept of the present invention. Therefore, the illustrations only show components related to the present invention and are not drawn according to the number, shape, and size of components in actual implementation. In actual implementation, the type, quantity, and proportion of each component may be changed arbitrarily, and the component layout may also be more complex.

[0054] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the embodiments of the present invention may be practiced without these specific details. In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring the embodiments of the present invention.

[0055] First, it's important to note that UDP (User Datagram Protocol) is a connectionless transport layer protocol in the OSI (Open Systems Interconnection) reference model, providing simple, unreliable, business-oriented information transmission services. TCP (Transmission Control Protocol) is a connection-oriented, reliable, byte-stream-based transport layer communication protocol. Like TCP, UDP handles data packets, but it's a connectionless protocol. The source and endpoint don't establish a connection before transmitting data. When data is ready to be transmitted, UDP simply grabs data from the application and sends it back to the network as quickly as possible. On the sending end, UDP's data transmission speed is limited only by the data generation rate of the application software, the transmission bandwidth, and the performance of the source and endpoint hosts. Therefore, UDP offers fast data transmission speeds and supports one-to-one, one-to-many, many-to-one, and many-to-many interactive communication, making it suitable for audio and multimedia applications. TCP is a connection-oriented transport layer protocol. Each TCP connection can only have two endpoints, and TCP provides reliable delivery services. The data transmitted through the TCP connection is error-free, loss-free, non-duplicate, and arrives in order. It is suitable for transmitting the entire data accurately, such as the transmission of control instructions.

[0056] Figure 1 FIG. 1 is a schematic diagram of an application environment of an audio communication method according to an exemplary embodiment of the present application. Figure 1 As shown, in some embodiments, multiple clients 110 establish a connection with a server 120. When multiple clients 110 transmit audio to the server 120, the multiple clients 110 acquire the multiple audio data, perform data acquisition and noise reduction processing on the audio data to obtain audio data, then compress the audio data and encrypt the compressed audio data. Finally, the client 110 transmits the multiple encrypted audio data to the server 120. The server 120 receives the multiple encrypted audio data, decrypts and decompresses the multiple encrypted audio data, optimizes and synthesizes the decompressed audio data, and plays the synthesized audio data on the server 120. When the server 120 transmits audio to multiple clients 110, the server 120 acquires the audio data, performs data acquisition, noise reduction, compression, and encryption on the audio data, obtains encrypted audio data, and transmits the encrypted audio data to the multiple clients 110. The multiple clients 110 decrypt and decompress the encrypted audio data to obtain decompressed audio data, and then play the decompressed audio data on the multiple clients 110.

[0057] The embodiments of the present application do not limit the specific roles of the client 110 and the server 120. Figure 1 The server 120 shown can be, for example, an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and basic cloud computing services such as big data and artificial intelligence platforms, which are not limited here. The audio data transmitted between the client 110 and the server 120 can be operated through wireless networks such as 3G (third generation mobile information technology), 4G (fourth generation mobile information technology), and 5G (fifth generation mobile information technology). The embodiments of the present application are not limited to this and can be set according to actual needs.

[0058] In some embodiments, methods that utilize dedicated equipment to implement local area network communication often experience significant data transmission delays, cannot achieve real-time control between the server and client, and may even cause corruption of communication data, reducing communication efficiency and accuracy. Therefore, to address these issues, the present application provides an audio communication method, system, device, and medium, which are described in detail below.

[0059] See also Figure 2 , Figure 2 is a flowchart of an audio communication method according to an exemplary embodiment of the present application. In some embodiments, the method can be applied to Figure 1 The implementation environment shown is specifically executed by the client 110 and the server 120 in the implementation environment. It should be understood that the method can also be applied to other exemplary implementation environments and specifically executed by devices in other implementation environments. This embodiment does not limit the implementation environment to which the method is applicable.

[0060] For example, the client 110 and the server 120 to which the audio communication method disclosed in this embodiment is applicable may be installed with an SDK (Software Development Kit, a collection of development tools for building application software for a specific software package, software framework, operating system, etc.), and the method disclosed in this embodiment is specifically implemented as one or more functions provided to the outside by the SDK.

[0061] like Figure 2 As shown, in an exemplary embodiment, the audio communication method includes at least steps S210 to S250, which are described in detail as follows:

[0062] Step S210: Establish connections between multiple clients and the server, and obtain information indicating successful connection establishment.

[0063] In one embodiment of the present invention, at startup, the first step is to check Figure 1 The server 120 shown in FIG. 1 is checked to see whether it exists. If the server 120 does not exist, a prompt indicating that the server 120 does not exist is given. If the server 120 exists, multiple clients 110 establish contact with the server 120 and determine whether the client 110 and the server 120 have successfully established a connection. If the client 110 and the server 120 have successfully established a connection, information indicating successful connection establishment is obtained. If the client 110 and the server 120 cannot establish a connection, a corresponding error prompt is given. The client 110 then clears the previous resource overhead, restarts initialization, and establishes a connection with the server 120. Before the connection with the server 120 is fully established, the client 110 cannot perform any other operations except exiting the application. After the client 110 and the server 120 establish a connection, the client 110 completes the device registration on the server 120. The server 120 controls the sending and receiving of audio data by the server 110 by transmitting control instructions to the client 110.

[0064] Step S220 , obtaining task sets, control instructions, and audio input from multiple clients of the server based on the information indicating successful connection establishment.

[0065] In one embodiment of the present invention, after obtaining Figure 1 After the client 110 and server 120 have successfully established a connection, a task set is established between the client 110 and server 120. The tasks in the client 110 task set include audio data sampling, noise reduction, data compression, encryption, and data transmission, as well as receiving, decrypting, decompressing, and playing back encrypted audio data, as well as receiving and sending control commands. The tasks in the server 120 task set include audio data sampling, noise reduction, data compression, encryption, and data transmission, as well as receiving, decrypting, decompressing, multi-channel audio synthesis, and playing back encrypted audio data, as well as receiving and sending control commands and managing client devices. The task set includes control commands. After the task set is established, if the client 110 sends audio to the server 120, multiple clients input the audio. If the server 120 sends audio to multiple clients 110, the server 120 inputs the audio.

[0066] Control commands include audio communication status synchronization, muting, recording, sending audio data, receiving audio data, and returning control command execution results and status changes. Device management involves the server 120 maintaining connections between multiple clients 110 and effectively managing the audio data sent and received by the clients 110.

[0067] Step S230 : performing data collection, noise reduction, data compression, and encryption on the audio on multiple clients according to the information of the task set to obtain encrypted audio data.

[0068] In one embodiment of the present invention, based on the information of the task set, if Figure 1 The client 110 shown sends audio to the server 120, and the audio is acquired on multiple clients 110. The audio data is then collected to obtain the collected audio data. To prevent the impact of noise on the audio data, the collected audio data needs to be subjected to noise reduction processing to obtain the noise-reduced audio data. In order to reduce the amount of data to reduce storage space and improve transmission, storage, and processing efficiency without losing useful information, the noise-reduced audio data needs to be compressed to obtain compressed audio data. To ensure the security of the data information when the audio data is transmitted in the local area network, the compressed audio data needs to be encrypted to obtain encrypted audio data. Then, based on the control instructions of the client to send audio data and the control instructions of the server 120 to receive data, the multiple clients 110 send encrypted audio data to the server 120. After the client 110 sends the audio data, the client 110 task ends and waits for audio input again or audio data input.

[0069] In one embodiment of the present invention, if Figure 1 The server 120 shown sends audio to multiple clients 110. Server 120 receives the audio and performs data acquisition, noise reduction, compression, and encryption on the audio to obtain encrypted audio data. Then, based on a control instruction for sending audio data, server 120 sends the encrypted audio data to multiple clients 110 and a control instruction for clients 110 to receive data. After server 120 sends the audio data, its task is terminated and it waits for further audio input or audio data input.

[0070] In one embodiment of the present invention, Figure 1The client 110 and server 120 shown in the figure establish two communication methods. UDP is used as the communication method for audio data transmission, and TCP is used for control command transmission. The audio data transmission channel protocol is UDP. The individual channels for audio data transmission perform separate tasks during operation, including audio data compression, data encryption, and data transmission. Data compression is required because the original data volume of two-channel audio is relatively large, and the network bandwidth occupied during transmission is also large. Therefore, to minimize network usage during transmission, the audio data is compressed and encoded before real-time transmission. Typically, compression encoding is performed based on the sampling rate and the audio format to be transmitted. Different audio formats have different compression ratios for the corresponding protocols. For example, the maximum compression ratio for the MP3 (Moving Picture Experts Group Audio Layer III) audio format is 1:10 or 1:12, while the compression ratio for the WMA (Windows Media Audio) audio format is, for example, 1:18. Audio data compression uses an audio optional scheme, and the most appropriate audio compression method can be selected according to on-site needs. The process from audio acquisition to transmission involves two steps, all transmitted via unreliable real-time transmission. Unreliable transmission via UDP prevents audio data from being damaged and retransmitted, ensuring timely data transmission and avoiding anomalies caused by audio data retransmission or damage.

[0071] In step S240 , according to the task set and the control instruction, the server receives the encrypted audio data uploaded by the multiple clients, decrypts and decompresses the encrypted audio data, and obtains multiple decompressed audio data on the server.

[0072] In one embodiment of the present invention, if multiple Figure 1 The client 110 shown sends encrypted audio data to the server 120. Based on the control instruction for receiving data on the server 120 and the task set of the server 120, the server 120 receives encrypted audio data uploaded by multiple clients 110, and then decrypts and decompresses the encrypted audio data to obtain multiple decompressed audio data on the server 120. If the server 120 sends encrypted audio data to the client 110, based on the control instruction for receiving data on the client 110 and the task set of the client 110, the client 110 receives the encrypted audio data uploaded by the server 120, and decrypts and decompresses the encrypted audio data to obtain the decompressed audio data on the client 110.

[0073] Step S250 : synthesizing the multiple decompressed audio data according to the task set, and playing the synthesized decompressed audio data on the server.

[0074] In one embodiment of the present invention, according to the information of the task set, if multiple Figure 1 The client 110 shown sends multiple audios to the server 120, which optimizes and synthesizes the multiple decompressed audio data. The server 120 caches and plays the synthesized decompressed audio data. When caching multiple audio data, if too much audio data is cached, the server will appropriately accelerate the playback of the audio data. This can reduce the cache volume of the audio data and prevent the audio data from losing frames, thereby protecting the integrity of the audio data. If the server 120 distributes audio data to multiple clients 110, the decompressed audio data will be cached and played on the multiple clients 110. After the audio data is played or an exception occurs, the client 110 and the server 120 end the task process.

[0075] Figure 3 FIG. 1 is a flow chart of a method for obtaining encrypted audio data, shown in an exemplary embodiment of the present application. Figure 3 As shown, in an exemplary embodiment, the method for obtaining encrypted audio data includes at least steps S310 to S340, which are described in detail as follows:

[0076] Step S310: Acquire audio input from the server or client.

[0077] Step S320: perform data collection and noise reduction processing on the audio to obtain the audio data after noise reduction.

[0078] Step S330: compress the audio data after noise reduction to obtain compressed audio data.

[0079] Step S340: encrypt the compressed audio data to obtain encrypted audio data.

[0080] Figure 4 This is a flow chart of a method for playing synthesized decompressed audio data on a server side, illustrating an exemplary embodiment of the present application. In an exemplary embodiment, the method for playing synthesized decompressed audio data on a server side includes at least steps S410 to S440, which are described in detail as follows:

[0081] Step S410: decrypt the encrypted audio data to obtain a plurality of decrypted audio data.

[0082] Step S420: decompress the decrypted audio data to obtain a plurality of decompressed audio data.

[0083] Step S430 , synthesizing the multiple decompressed audio data to obtain synthesized decompressed audio data, and playing the synthesized decompressed audio data on the server.

[0084] In one embodiment of the present invention, if multiple Figure 1 The client 110 shown sends multiple audios to the server 120. The server 120 optimizes and synthesizes the multiple decompressed audio data, and then caches and plays the synthesized decompressed audio data. When caching multiple audio data, if too much audio data is cached, the server will appropriately accelerate the playback of the audio data. This can reduce the amount of audio data cached, prevent audio data frame loss, and protect the integrity of the audio data.

[0085] Figure 5 This is a flow chart of a method for transmitting audio data from a server to a client, as shown in an exemplary embodiment of the present application. In an exemplary embodiment, the method for transmitting audio data from a server to a client includes at least steps S510 to S540, which are described in detail as follows:

[0086] S510: Acquire audio input from the server.

[0087] S520 , performing data collection, noise reduction, data compression, and encryption on the audio on the server according to the task set to obtain encrypted audio data.

[0088] S530 , according to the task set and the control instruction, the multiple clients receive the encrypted audio data uploaded by the server, and decrypt and decompress the encrypted audio data to obtain the decompressed audio data on the multiple clients.

[0089] S540: Play the decompressed audio data on multiple clients according to the task set.

[0090] Figure 6 This is a structural diagram of an audio communication device shown in an exemplary embodiment of the present application. The device can be applied to Figure 1 The device is configured in the application environment shown in FIG. 1 and is specifically configured in the client 110 and the server 120. The device may also be applicable to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the device is applicable.

[0091] like Figure 6 As shown, the exemplary audio communication device includes:

[0092] The connection module 610 is used to establish connections between multiple clients and a server and obtain information that the connection is successfully established; the task set and audio acquisition module 620 is used to obtain the task sets, control instructions and audio input by multiple clients of multiple clients and a server based on the information that the connection is successfully established; the audio processing module 630 is used to perform data collection, noise reduction processing, data compression and encryption processing on audio on multiple clients according to the task set to obtain encrypted audio data; the encrypted audio data processing module 640 is used to receive encrypted audio data uploaded by multiple clients on the server according to the task set and control instructions, and decrypt and decompress the encrypted audio data to obtain multiple decompressed audio data on the server; and the audio data playback module 650 is used to synthesize multiple decompressed audio data according to the task set, and play the synthesized decompressed audio data on the server.

[0093] Figure 7 The following is a schematic diagram showing the structure of a computer system suitable for implementing an electronic device according to an embodiment of the present application. Figure 7 The computer system 700 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0094] like Figure 7 As shown, the computer system 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 into the random access memory (RAM) 703, such as executing the method described in the above embodiment. Various programs and data required for system operation are also stored in the RAM 703. The CPU 701, ROM 702 and RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0095] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, and the like; an output section 707 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN (Local Area Network) card or a modem. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. Removable media 711, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 710 as needed, so that computer programs read therefrom can be installed into the storage section 708 as needed.

[0096] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 709, and / or installed from a removable medium 711. When the computer program is executed by the central processing unit (CPU) 701, the various functions defined in the system of the present application are executed.

[0097] It should be noted that the computer-readable medium shown in the embodiments of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable computer program. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0098] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and application structures according to the various embodiments of the present application. Among them, each box in the flowchart or block diagram can represent a module, program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0099] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. In some cases, the names of these units do not constitute limitations on the units themselves.

[0100] Another aspect of the present application provides a computer-readable storage medium having a computer program stored thereon. When executed by a computer processor, the computer program causes the computer to perform the aforementioned audio communication method. The computer-readable storage medium may be included in the electronic device described in the above embodiments, or may exist independently and not be incorporated into the electronic device.

[0101] Another aspect of the present application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the audio communication method provided in each of the above embodiments.

[0102] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the present invention. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, any equivalent modifications or alterations made by one of ordinary skill in the art without departing from the spirit and technical principles disclosed herein are intended to be covered by the claims of the present invention.

Claims

1. An audio communication method, characterized in that: The method comprises: Establish connections between multiple clients and the server, and obtain information about successful connection establishment; Acquire, based on the information indicating successful connection establishment, a task set of the plurality of clients and the server, a control instruction, and audio input by the plurality of clients; According to the task set, performing data collection, noise reduction processing, data compression and encryption processing on the audio on the plurality of clients to obtain encrypted audio data; According to the task set and the control instruction, the server receives the encrypted audio data uploaded by the plurality of clients, decrypts and decompresses the encrypted audio data, and obtains a plurality of decompressed audio data on the server; and synthesizing the plurality of decompressed audio data according to the task set, and playing the synthesized decompressed audio data on the server; Obtaining the audio input from the server; According to the task set, performing data collection, noise reduction processing, data compression and encryption processing on the audio on the server to obtain the encrypted audio data; According to the task set and the control instruction, the plurality of clients receive the encrypted audio data uploaded by the server, and decrypt and decompress the encrypted audio data to obtain decompressed audio data on the plurality of clients; and Playing the decompressed audio data on the plurality of clients according to the task set; UDP is used as the communication method for transmitting the audio data, and TCP is used as the communication method for transmitting the control instructions.

2. An audio communication method according to claim 1, characterized in that: Obtaining the information that the connection is successfully established includes the following steps: Determine whether the server exists. If so, establish connections between the multiple clients and the server, and determine whether the multiple clients are successfully connected to the server. If so, obtain information that the connections are successfully established.

3. The audio communication method according to claim 1, wherein: Obtaining the encrypted audio data comprises the following steps: Acquire the audio input by the server or the client; Performing data collection and noise reduction processing on the audio to obtain noise-reduced audio data; Compressing the noise-reduced audio data to obtain compressed audio data; and The compressed audio data is encrypted to obtain the encrypted audio data.

4. The audio communication method according to claim 1, wherein: Playing the synthesized decompressed audio data on the server includes the following steps: Decrypting the encrypted audio data to obtain multiple decrypted audio data; Decompressing the decrypted audio data to obtain the decompressed audio data; and The multiple decompressed audio data are synthesized to obtain synthesized decompressed audio data, and the synthesized decompressed audio data is played on the server.

5. The audio communication method according to claim 1, wherein: The following steps are also included: Obtain control instructions for the client to send data and the server to receive data; According to the control instruction of the client to send data and the control instruction of the server to receive data, the plurality of clients send the encrypted audio data to the server, and the server receives the encrypted audio data.

6. The audio communication method according to claim 1, wherein: The following steps are also included: Obtain control instructions for the client to receive data and the server to send data; According to the control instruction of the client to receive data and the control instruction of the server to send data, the server sends the encrypted audio data to the multiple clients, and the multiple clients receive the encrypted audio data.

7. An audio communication system, characterized in that: The system comprises: The connection module is used to establish connections between multiple clients and the server and obtain information about successful connection establishment; A task set and audio acquisition module, configured to acquire the task sets, control instructions, and audio input from the plurality of clients and the server based on the information indicating successful connection establishment, or to acquire audio input from the server; an audio processing module, configured to perform data acquisition, noise reduction, data compression, and encryption processing on the audio on the plurality of clients according to the task set to obtain encrypted audio data, or perform data acquisition, noise reduction, data compression, and encryption processing on the audio on the server to obtain encrypted audio data; an encrypted audio data processing module, configured to, according to the task set and the control instruction, cause the server to receive the encrypted audio data uploaded by the multiple clients, decrypt and decompress the encrypted audio data, and obtain multiple decompressed audio data on the server, or cause multiple clients to receive the encrypted audio data uploaded by the server, decrypt and decompress the encrypted audio data, and obtain decompressed audio data on the multiple clients; and an audio data playing module, configured to synthesize the plurality of decompressed audio data according to the task set and play the synthesized decompressed audio data on the server, or to play the decompressed audio data on the plurality of clients according to the task set; UDP is used as the communication method for transmitting the audio data, and TCP is used as the communication method for transmitting the control instructions.

8. An electronic device, comprising: at least one processor; A storage device for storing at least one program, which, when executed by the at least one processor, enables the electronic device to implement the audio communication method of any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the audio communication method according to any one of claims 1 to 6.

Images