Audio processing method and device, electronic equipment and storage medium

Abstract

The invention relates to the technical field of audio processing, in particular to an audio processing method and device, electronic equipment and a storage medium. The method comprises the following steps: a main audio acquisition device sets any device as a main speaking device in response to a main speaking mode starting operation triggered for any device, and sets a main speaking identifier of the main speaking device; if the audio data collected by at least one device is obtained, screening out a main speaking device from the devices based on the main speaking identifier and the device identifier carried by each audio data; if the main speaking equipment is screened out, preset operation is executed on the at least one piece of audio data to obtain audio data to be transmitted, and the preset operation comprises at least one of the following operations: enhancement processing is performed on the audio data collected by the main speaking equipment, and suppression processing is performed on other audio data; and transmitting the to-be-transmitted audio data to the terminal equipment for playing. According to the embodiment of the invention, in the speaker mode, the interference of other sounds on the speaker sound is reduced, and the sound collection effect of the cascade equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of audio acquisition technology, and in particular to an audio processing method, device, electronic device and storage medium. Background Art

[0002] As a kind of intelligent hardware, audio acquisition equipment (such as microphones) can be applied to various activity scenes, such as conference scenes, lecture scenes, etc. In larger activity venues (such as conference rooms, classrooms, theaters, etc.), in order to expand the pickup range, multiple audio acquisition devices are usually cascaded to form a cascade device, and one audio acquisition device of the cascade device is connected to the terminal device (such as a conference terminal); in this way, the cascade device can serve as an extension of the terminal device's pickup. Since the cascade device can cover a wider area, it can pick up sounds in a larger range, making it easier for conference equipment to capture sounds clearly in larger venues. For example: Figure 1 As shown, the audio acquisition device 110 is connected to the terminal device 150 , and the audio acquisition device 110 , the audio acquisition device 120 , the audio acquisition device 130 , and the audio acquisition device 140 are connected in sequence to form a cascade device.

[0003] In the related art, to facilitate the use of cascaded devices, multiple audio capture devices in the cascade are usually controlled in a unified manner, that is, they are turned on and off in a unified manner. When the cascaded audio capture devices are turned on, when the speaker of the meeting uses any audio capture device in the cascade to speak, while the audio capture device captures the speaker's voice, other audio capture devices may also capture the voices of others. As a result, the sound captured by the terminal device contains not only the speaker's voice, but also the voices of others, which interferes with the speaker's voice and affects the speaker's voice quality.

[0004] Therefore, the sound collected by the existing cascade equipment is relatively poor. Summary of the Invention

[0005] Embodiments of the present application provide an audio processing method, apparatus, electronic device, and storage medium for improving the effect of sound collected by cascaded devices.

[0006] In one aspect, an embodiment of the present application provides an audio processing method, which is applied to a master audio acquisition device, wherein the master audio acquisition device is connected to at least one slave audio acquisition device, and the method includes:

[0007] In response to a speaker mode activation operation triggered for any device, setting the any device as a speaker device and setting a speaker identifier of the speaker device; wherein the any device is the master audio acquisition device or the slave audio acquisition device;

[0008] If audio data collected by at least one device is obtained, the speaker device is selected from the at least one device based on the speaker identifier and the device identifier carried by the at least one audio data; wherein the at least one device includes: part or all of the at least one slave audio collection device and the master audio collection device;

[0009] If the main speaker device is selected, a preset operation is performed on the at least one audio data to obtain audio data to be transmitted; wherein the preset operation includes at least one of the following: enhancing the audio data collected by the main speaker device, and suppressing the audio data other than the audio data collected by the main speaker device;

[0010] The audio data to be transmitted is transmitted to the terminal device for playback.

[0011] In one aspect, an embodiment of the present application provides an audio processing method, which is applied to any one of at least one slave audio acquisition device, where the at least one slave audio acquisition device is connected to a master audio acquisition device, and the method includes:

[0012] In response to a speaker mode activation operation triggered for any of the slave audio acquisition devices, sending a speaker activation request to the master audio acquisition device, wherein the speaker activation request includes a device identifier of any of the slave audio acquisition devices, so that the master audio acquisition device sets any of the slave audio acquisition devices as a speaker device, and saves the device identifier of any of the slave audio acquisition devices as a speaker identifier;

[0013] Audio data is collected, and the audio data carrying the device identification is sent to the master audio collection device, so that the master audio collection device determines any slave audio collection device as the main speaker device based on the device identification.

[0014] In one aspect, an embodiment of the present application provides an audio processing device, which is applied to a master audio acquisition device, wherein the master audio acquisition device is connected to at least one slave audio acquisition device, and the device includes:

[0015] A setting unit, configured to, in response to a speaker mode activation operation triggered for any device, set the device as a speaker device and set a speaker identifier of the speaker device; wherein the device is the master audio acquisition device or the slave audio acquisition device;

[0016] a screening unit configured to, upon obtaining audio data collected by at least one device, screen out the main speaker device from the at least one device based on the main speaker identifier and the device identifier carried by the at least one audio data, and obtain the audio data collected by the main speaker device; wherein the at least one device includes: the main audio collection device and part or all of the at least one slave audio collection device;

[0017] a processing unit configured to, if the main speaker device is selected, perform a preset operation on the at least one audio data to obtain audio data to be transmitted; wherein the preset operation includes at least one of the following: enhancing the audio data collected by the main speaker device, and suppressing the audio data other than the audio data collected by the main speaker device;

[0018] The first transmission unit is configured to transmit the audio data to be transmitted to a terminal device for playback.

[0019] Optionally, the setting unit is specifically configured to:

[0020] In response to receiving a speaker start request sent by any slave audio acquisition device, setting the any slave audio acquisition device as a speaker device, using the device identifier included in the speaker start request as the speaker identifier, and saving the speaker identifier;

[0021] The speaker request is sent by any slave audio acquisition device in response to a speaker mode start operation triggered on any slave audio acquisition device.

[0022] Optionally, the device further includes:

[0023] A display unit, configured to display the microphone muting status of the primary audio acquisition device;

[0024] A first notification unit is configured to send a first notification message to the at least one slave audio acquisition device, where the first notification message includes the speaker identifier, which is used to indicate that a speaker mode is enabled, so that any slave audio acquisition device displays an open microphone state according to the speaker identifier, and any slave audio acquisition device other than the slave audio acquisition device displays a closed microphone state according to the speaker identifier.

[0025] Optionally, the device further includes:

[0026] a switching unit, configured to, in response to receiving a request to exit the main speaker mode sent by any of the slave audio acquisition devices, determine to exit the main speaker mode and switch the microphone-off state of the master audio acquisition device to the microphone-on state;

[0027] The second notification unit is configured to send a second notification message to the at least one slave audio collection device, where the second notification message is used to instruct the at least one slave audio collection device to exit the speaker mode, so that the slave audio collection device other than any of the slave audio collection devices switches from a closed microphone state to an open microphone state.

[0028] Optionally, the setting unit is specifically configured to:

[0029] In response to a speaker mode activation operation triggered on the primary audio acquisition device, setting the primary audio acquisition device as the speaker device and displaying the microphone-on status of the primary audio acquisition device;

[0030] Then the device further comprises:

[0031] A third notification unit is used to send a third notification message to the at least one slave audio collection device, where the third notification message includes the speaker identifier, which is used to indicate that the speaker mode is turned on, so that the at least one slave audio collection device displays a microphone-mute state according to the speaker identifier.

[0032] Optionally, in response to the speaker mode activation operation triggered for the primary audio acquisition device, when the primary audio acquisition device is set as the speaker device and the microphone-on status of the primary audio acquisition device is displayed, the setting unit is specifically configured to:

[0033] When the primary audio acquisition device is in the microphone-on state, in response to a first speaker mode activation operation triggered on the primary audio acquisition device, setting the primary audio acquisition device as the speaker device and maintaining the microphone-on state of the primary audio acquisition device; or

[0034] When the primary audio acquisition device is in a closed-microphone state, in response to a second speaker mode activation operation triggered for the primary audio acquisition device, the primary audio acquisition device is set as a speaker device, and the closed-microphone state of the primary audio acquisition device is switched to an open-microphone state.

[0035] Optionally, the device further includes a fourth notification unit, configured to:

[0036] In response to a speaker mode exit operation triggered for the master audio acquisition device, a fourth notification message is sent to the at least one slave audio acquisition device, where the fourth notification message is used to indicate the exit from the speaker mode, so that the at least one slave audio acquisition device switches from a closed microphone state to an open microphone state.

[0037] Optionally, the device further includes:

[0038] A mixing unit, configured to, after exiting the speaker mode, mix the multiple audio data to obtain mixed data if audio data collected by multiple devices are obtained; wherein the multiple devices include: the at least one slave audio collection device and part or all of the master audio collection device;

[0039] The second transmission unit is configured to transmit the mixed audio data to the terminal device for playback.

[0040] Optionally, the processing unit is specifically configured to:

[0041] filtering out audio data other than the audio data collected by the main speaker device from the at least one audio data, and using the audio data collected by the main speaker device as the audio data to be transmitted; or

[0042] The at least one audio data is a plurality of audio data, and in a process of mixing the plurality of audio data, the preset operation is performed to obtain the audio data to be transmitted; or

[0043] The at least one audio data is a plurality of audio data. After the preset operation is performed on the plurality of audio data, the plurality of audio data after the operation are mixed to obtain the audio data to be transmitted.

[0044] In one aspect, an embodiment of the present application provides an audio processing device, which is applied to any one of at least one slave audio acquisition device, wherein the at least one slave audio acquisition device is connected to a master audio acquisition device in a cascade manner, and the device includes:

[0045] a first sending unit, configured to, in response to a speaker mode start operation triggered for any of the slave audio acquisition devices, send a speaker start request to the master audio acquisition device, wherein the speaker start request includes a device identifier of any of the slave audio acquisition devices, so that the master audio acquisition device sets any of the slave audio acquisition devices as a speaker device, and stores the device identifier of any of the slave audio acquisition devices as a speaker identifier;

[0046] The collecting unit is used to collect audio data and send the audio data carrying the speaker identification to the master audio collecting device, so that the master audio collecting device determines that any slave audio collecting device is the speaker device based on the device identification.

[0047] Optionally, the first sending unit is specifically configured to:

[0048] When any of the slave audio acquisition devices is in the microphone-on state, in response to a third speaker mode start operation triggered for any of the slave audio acquisition devices, sending a speaker start request to the master audio acquisition device; or

[0049] In a case where any of the slave audio acquisition devices displays a mute state, in response to a fourth speaker mode start operation triggered for any of the slave audio acquisition devices, a speaker start request is sent to the master audio acquisition device.

[0050] Optionally, the device further includes a receiving unit, configured to:

[0051] In response to receiving a first notification message sent by the master audio acquisition device, the microphone-opening status of any of the slave audio acquisition devices is displayed according to the speaker identifier included in the first notification message; wherein the first notification message is used to indicate that the speaker mode is turned on.

[0052] Optionally, the device further includes a second sending unit:

[0053] In response to a speaker mode exit operation triggered for any of the slave audio acquisition devices, sending an exit speaker request to the master audio acquisition device, so that the master audio acquisition device sends a second notification message to the at least one slave audio acquisition device;

[0054] The second notification message is used to instruct exiting the speaker mode, so that the slave audio acquisition device other than any slave audio acquisition device switches from a closed microphone state to an open microphone state.

[0055] An embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of any one of the above-mentioned audio processing methods.

[0056] An embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to perform the steps of any one of the above-mentioned audio processing methods.

[0057] An embodiment of the present application provides a computer program product, which includes a computer program stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, causing the electronic device to perform the steps of any one of the above-mentioned audio processing methods.

[0058] The embodiments of the present application provide an audio processing method, apparatus, electronic device, and storage medium. Any device in the cascaded devices can trigger a speaker mode. The main audio acquisition device can respond to the speaker mode activation operation triggered on any device, set any device as a speaker device, and save the speaker identification of the speaker device. In this way, in the speaker mode, when the main audio acquisition device obtains audio data collected by at least one device in the cascaded devices, it can filter out the speaker device from at least one device based on the speaker identification, so as to suppress the audio data collected by non-speaker devices, and / or enhance the audio data collected by the main speaker device to obtain audio data to be transmitted, and transmit the audio data to be transmitted to the terminal device for playback.

[0059] Therefore, in speaker mode, the embodiments of the present application can suppress the audio data collected by non-speaker devices, or enhance the audio data collected by the speaker device, or both suppress the audio data collected by non-speaker devices and enhance the audio data collected by the speaker device, thereby reducing the interference of other sounds on the voice of the speaker using the speaker device and improving the effect of the sound collected by the cascaded devices. At the same time, the embodiments of the present application can set any device as the speaker device based on the speaker's location, and people who need to speak can take turns to speak as the speaker, which improves the flexibility of the cascaded devices.

[0060] Other features and advantages of the present application will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present application. The purposes and other advantages of the present application can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0062] Figure 1 This is a connection diagram of a cascade device in the related art;

[0063] Figure 2 A schematic diagram of an application scenario of an audio processing method in an embodiment of the present application;

[0064] Figure 3 This is a connection diagram of a cascade device in an embodiment of the present application;

[0065] Figure 4 A schematic diagram of PoE in an embodiment of the present application;

[0066] Figure 5This is a flowchart of an audio processing method in an embodiment of the present application;

[0067] Figure 6 This is a schematic diagram of a main audio acquisition device transmitting audio data in a speaker mode according to an embodiment of the present application;

[0068] Figure 7 A logical diagram of an audio processing method in an embodiment of the present application;

[0069] Figure 8 A schematic diagram of a switching method of a speaker mode in an embodiment of the present application;

[0070] Figure 9 This is a schematic diagram of switching from a microphone-open state to a speaker mode in an embodiment of the present application;

[0071] Figure 10 This is a schematic diagram of switching from a microphone-mute state to a speaker mode in an embodiment of the present application;

[0072] Figure 11 This is a schematic diagram of switching from a speaker mode to an open microphone state in an embodiment of the present application;

[0073] Figure 12 This is a schematic diagram of a master audio acquisition device transmitting audio data in normal mode according to an embodiment of the present application;

[0074] Figure 13 This is a flowchart of another audio processing method in an embodiment of the present application;

[0075] Figure 14 Schematic diagram of the structure of an audio processing device in an embodiment of the present application;

[0076] Figure 15 Schematic diagram of the structure of another audio processing device in an embodiment of the present application;

[0077] Figure 16 A schematic diagram of the hardware structure of an electronic device to which the embodiments of the present application are applied;

[0078] Figure 17 The present invention is a schematic diagram of the hardware structure of an electronic device to which the present invention is applied. DETAILED DESCRIPTION

[0079] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of the technical solutions of this application, but not all of them. Based on the embodiments described in this application document, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the technical solutions of this application.

[0080] The following is an introduction to some concepts involved in the embodiments of this application.

[0081] Cascading devices refers to connecting multiple audio capture devices together so they can work together and share audio signals. Cascading devices can be connected in series or in a one-to-many manner. Cascading devices are often used to improve audio capture quality, increase audio input sources, or cover a wider area. They can be used in a variety of scenarios, such as conferences, lectures, performances, and recordings.

[0082] Power over Ethernet (PoE) is a technology that allows data and power to be transmitted simultaneously over Ethernet cables (such as Cat5e or Cat6). PoE simplifies network device wiring, reduces costs, and increases flexibility.

[0083] The word “exemplary” is used hereinafter to mean “serving as an example, example, or illustration.” Any embodiment described as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0084] The terms "first" and "second" are used for descriptive purposes only and should not be construed as explicitly or implicitly indicating relative importance or the number of the technical features indicated. Therefore, features specified as "first" or "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0085] The present application relates to the field of cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or a local area network to realize data computing, storage, processing, and sharing.

[0086] Cloud technology is a general term for network technologies, information technologies, integration technologies, management platform technologies, and application technologies based on the cloud computing business model. It can form a resource pool that can be used flexibly and conveniently on demand. Cloud computing technology will become a crucial support. Backend services for technical network systems, such as video websites, image websites, and more portals, require extensive computing and storage resources. With the rapid development and application of the internet industry, every item will likely have its own unique identifier, requiring transmission to backend systems for logical processing. Different levels of data will be processed separately, and data from various industries will require a strong system backend, which can only be achieved through cloud computing.

[0087] Cloud conferencing is an efficient, convenient, and low-cost conferencing format based on cloud computing technology. Users can quickly and efficiently share voice, data, and video with teams and clients around the world through a simple, easy-to-use internet interface. The cloud conferencing service provider handles the complex technical aspects of data transmission and processing.

[0088] At present, domestic cloud conferencing mainly focuses on service content based on the Software as a Service (SaaS) model, including telephone, network, video and other service forms. Video conferencing based on cloud computing is called cloud conferencing.

[0089] In the era of cloud conferencing, data transmission, processing, and storage are all handled by the computer resources of video conferencing manufacturers. Users no longer need to purchase expensive hardware or install cumbersome software. They only need to open a browser and log in to the corresponding interface to conduct efficient remote meetings.

[0090] Cloud conferencing systems support dynamic multi-server cluster deployment and offer multiple high-performance servers, significantly improving conference stability, security, and availability. In recent years, video conferencing has gained widespread popularity due to its ability to significantly improve communication efficiency, continuously reduce communication costs, and enhance internal management. It has been widely adopted in various sectors, including government, transportation, finance, carriers, education, and enterprises. Undoubtedly, the convenience, speed, and ease of use of cloud computing will further enhance video conferencing's appeal, undoubtedly driving a new surge in its application.

[0091] The audio processing method of the embodiment of the present application can be applied to audio collection in a cloud conference scenario, and the main audio collection device can transmit the acquired audio data to the terminal device in the cloud conference scenario.

[0092] The following is a brief overview of the design concepts of the embodiments of the present application.

[0093] In the related art, in larger venues (such as conference rooms, classrooms, theaters, etc.), in order to expand the sound pickup range, multiple audio acquisition devices are usually cascaded to form a cascade device. In order to facilitate the use of the cascade device, the multiple audio acquisition devices in the cascade device are usually controlled in a unified manner, that is, they are turned off and on in a unified manner. After the cascade audio acquisition device is turned on, when the speaker of the meeting uses any audio acquisition device in the cascade device to speak, while the audio acquisition device is collecting the speaker's voice, other audio acquisition devices may also collect the voices of other people; ultimately, the sound obtained by the terminal device contains not only the speaker's voice, but also the voices of other people, which interferes with the speaker's voice and affects the speaker's voice effect. Therefore, the sound collected by the existing cascade device is relatively poor.

[0094] In view of this, the embodiments of the present application provide an audio processing method, apparatus, electronic device and storage medium. Any device in the cascaded devices can trigger the speaker mode. In the speaker mode, the main audio acquisition device in the cascaded devices can suppress audio data other than the audio data collected by the main speaker device, or enhance the audio data collected by the main speaker device, or both suppress audio data other than the audio data collected by the main speaker device and enhance the audio data collected by the main speaker device, thereby reducing the interference of other sounds on the voice of the speaker using the main speaker device and improving the effect of the sound collected by the cascaded devices.

[0095] The preferred embodiments of the present application are described below in conjunction with the drawings in the specification. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application and are not used to limit the present application. In addition, the embodiments and features in the embodiments of the present application can be combined with each other if there is no conflict.

[0096] like Figure 2 , which is a schematic diagram of an application scenario of an embodiment of the present application. The application scenario diagram includes multiple audio acquisition devices, a terminal device 230, other terminal devices 240, and a server 250. The multiple audio acquisition devices include a master audio acquisition device 210 and at least one slave audio acquisition device 220.

[0097] In the embodiments of the present application, the audio acquisition device may be a device with an audio acquisition function, such as a device including a microphone, including but not limited to a speaker, a recording device, etc. The terminal device 230 and other terminal devices 240 include but are not limited to smartphones, tablet computers, laptop computers, desktop computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, smart speakers, smart watches, etc. The server 250 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0098] In an optional embodiment, the master audio acquisition device 210 and the at least one slave audio acquisition device 220 among the multiple audio acquisition devices may be connected via a wired network or a wireless network. Figure 2 The cascade connection is only exemplary. Connection methods include, but are not limited to, serial connection, one-to-many connection, and other connection methods. Each slave audio capture device can be directly or indirectly connected to the master audio capture device. The master audio capture device 210 can be connected to the terminal device 230 via a wired network or a wireless network.

[0099] In an optional implementation, the terminal device 230, other terminal devices 240 and the server 250 may be directly or indirectly connected via a wired network or a wireless network, which is not limited in this application.

[0100] It should be noted that the audio processing method in each embodiment of the present application can be executed by a master audio acquisition device or a slave audio acquisition device.

[0101] In some embodiments, taking a conference scenario as an example, the terminal device 230 and other terminal devices 240 can access an online conference, and the main audio acquisition device 210 is connected to the terminal device 230; during the meeting, the participants can trigger the main audio acquisition device 210 or turn on the main speaker mode from the audio acquisition device 220, and the main audio acquisition device 210 responds to the main speaker mode start operation triggered on any device and sets any device as the main speaker; in the main speaker mode, the speaker who needs to speak can speak through the main speaker device. At this time, the main speaker device can collect the audio data of the speaker, and the slave audio acquisition device 220 may also collect the voices or noises of other people, etc. The slave audio acquisition device can The collected audio data is transmitted to the main audio collection device 210. The main audio collection device 210 can also collect audio data and filter out the audio data of the main speaker from the acquired audio data. Afterwards, the audio data collected by non-main speakers can be suppressed, or the audio data collected by the main speaker can be enhanced, or both the audio data collected by non-main speakers and the audio data collected by the main speaker can be suppressed, thereby obtaining the audio data to be transmitted and transmitting the audio data to be transmitted to the terminal device 230. The terminal device 230 can send the received audio data to the server 250, and the server 250 will send the audio data to other terminal devices 240 for playback, so as to realize the online meeting. At the same time, the terminal device 230 can also play the audio data.

[0102] In other embodiments, still taking the conference scenario as an example, multiple participants can conduct a local conference through multiple audio acquisition devices and terminal devices 230, and the main audio acquisition device 210 is connected to the terminal device 230; unlike the online conference in the above embodiment, in the main speaker mode, the main audio acquisition device filters out the audio data of the main speaker device from the acquired audio data; after that, the audio data collected by the non-main speaker devices can be suppressed, or the audio data collected by the main speaker device can be enhanced, or the audio data collected by the non-main speaker devices can be suppressed and the audio data collected by the main speaker device can be enhanced, so as to obtain the audio data to be transmitted, and transmit the audio data to be transmitted to the terminal device 230, and the terminal device 230 plays the received audio data to achieve sound amplification.

[0103] In other embodiments, taking the recording scenario as an example, multiple recorders can record through multiple audio collection devices and terminal devices 230, and the main audio collection device 210 is connected to the terminal device 230; during the recording process, the user can trigger the main audio collection device 210 or turn on the main speaker mode from the audio collection device 220, and the main audio collection device 210 responds to the main speaker mode start operation triggered for any device and sets any device as the main speaker device; in the main speaker mode, the speaker who needs to record can record through the main speaker device, at this time, the main speaker device can collect the audio data of the speaker, and the non-main speaker device may also collect the voices or noises of other people, etc. The acquisition device 220 can transmit the collected audio data to the main audio acquisition device 210. The main audio acquisition device 210 can also collect audio data and filter out the audio data of the main speaker from the acquired audio data. Afterwards, the audio data collected by the non-main speaker devices can be suppressed, or the audio data collected by the main speaker device can be enhanced, or both the audio data collected by the non-main speaker devices can be suppressed and the audio data collected by the main speaker device can be enhanced, thereby obtaining the audio data to be transmitted, and transmitting the audio data to be transmitted to the terminal device 230. The terminal device 230 saves the received audio data to realize recording so that the user can play the audio data through the terminal device 230.

[0104] The above-mentioned conference scenarios include various conference scenarios, including but not limited to education and training, corporate meetings, product launches, etc., which can be online conference scenarios or local conference scenarios. In addition, in addition to the above-mentioned conference scenarios and recording scenarios, the audio processing method of the embodiment of the present application can also be applied to other scenarios, including but not limited to speech scenarios, performance scenarios, etc. The audio collection process in these scenarios is similar to the audio collection process in the above-mentioned conference scenarios, and will not be repeated here.

[0105] It should be noted that Figure 2 The figures are only examples. In fact, the number of audio acquisition devices and terminal devices is not limited and is not specifically limited in the embodiments of the present application.

[0106] The following describes the audio processing method provided by the exemplary embodiment of the present application in combination with the application scenarios described above and with reference to the accompanying drawings. It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principles of the present application, and the implementation of the present application is not limited in this respect.

[0107] Before introducing the audio processing method of the embodiment of the present application, the cascade device for implementing the audio processing method of the embodiment of the present application is first introduced.

[0108] The cascaded devices of the present embodiment include a master audio capture device and at least one slave audio capture device, wherein the master audio capture device and the at least one slave audio capture device are connected. When there are multiple slave audio capture devices, the cascaded devices include various connection methods. Several possible connection methods are exemplarily described below.

[0109] In the first possible connection method, the master audio capture device and multiple slave audio capture devices can be connected in series in a predetermined order. For example, the master audio capture device is connected to slave audio capture device 1, slave audio capture device 1 is connected to slave audio capture device 2, master audio capture device 2 is connected to slave audio capture device 3, and so on.

[0110] In this connection mode, the master audio acquisition device and the slave audio acquisition device 2 can communicate indirectly through the slave audio acquisition device 1, and the master audio acquisition device and the slave audio acquisition device 3 can communicate indirectly through the slave audio acquisition device 1 and the slave audio acquisition device 2. That is, when the master audio acquisition device needs to transmit the first data to each slave audio acquisition device, it can transmit the first data to the slave audio acquisition device 1, the slave audio acquisition device 1 then transmits the first data to the slave audio acquisition device 2, and the slave audio acquisition device 2 then transmits the first data to the slave audio acquisition device 3. Correspondingly, when the slave audio acquisition device 2 needs to transmit the second data to the master audio acquisition device, it can transmit the second data to the slave audio acquisition device 1, and the slave audio acquisition device then transmits the second data to the slave audio acquisition device 2, and so on.

[0111] The second possible connection method is that the master audio capture device is directly connected to multiple slave audio capture devices, that is, a one-to-many connection. For example, the master audio capture device is connected to slave audio capture device 1, slave audio capture device 2, slave audio capture device 3, and so on.

[0112] In this connection mode, the master audio acquisition device and each slave audio acquisition device 2 can communicate directly.

[0113] A third possible connection method is for the master audio capture device to connect to multiple slave audio capture devices, including serial and one-to-many connections. For example, the master audio capture device can be connected to slave audio capture device 1 and slave audio capture device 2, and the master audio capture device 2 can be connected to slave audio capture device 3.

[0114] In the various connection methods described above, the master audio acquisition device and the multiple slave audio acquisition devices can be connected via a wired network or a wireless network, that is, the master audio acquisition device and the multiple slave audio acquisition devices are connected via a wired network, or the master audio acquisition device and the multiple slave audio acquisition devices are connected via a wireless network, or there is both a wireless network connection and a wired network connection between the master audio acquisition device and the multiple slave audio acquisition devices. For example, wireless networks include but are not limited to Bluetooth, Wireless Fidelity (WiFi), etc., and wired networks can be implemented through various network cables, such as PoE.

[0115] For example, Figure 3 As shown, taking the master audio acquisition device and multiple slave audio acquisition devices connected in series via PoE as an example, the master audio acquisition device 310 is connected to the slave audio acquisition device 320 via PoE, the master audio acquisition device 320 is connected to the slave audio acquisition device 330 via PoE, the slave audio acquisition device 330 is connected to the slave audio acquisition device 340 via PoE, and the slave audio acquisition device 340 is connected to the slave audio acquisition device 350 via PoE. The master audio acquisition device 310 can be connected to the terminal device via a wired network or a wireless network. The terminal device can, for example, be the terminal device 230 in the above embodiment.

[0116] Among them, PoE can transmit data and power simultaneously through Ethernet cables, such as Figure 4 As shown, PoE mainly consists of the following components:

[0117] a. Power supply: a device responsible for providing power to connected devices.

[0118] b. The powered end is the device that receives power provided through the Ethernet cable.

[0119] c. Ethernet cable: Ethernet cable is used to transmit data and power between the power supply end and the power receiving end.

[0120] In the above Figure 3 In the figure, the master audio capture device is the power supply end of the slave audio capture device 1, and the slave audio capture device 1 is the power receiving end of the master audio capture device; the slave audio capture device 1 is the power supply end of the slave audio capture device 2, and the slave audio capture device 2 is the power receiving end of the slave audio capture device 1; the slave audio capture device 2 is the power supply end of the slave audio capture device 3, and the slave audio capture device 3 is the power receiving end of the slave audio capture device 2.

[0121] See Figure 5As shown in FIG. 1 , it is an implementation flow chart of an audio processing method provided by an embodiment of the present application. The execution subject is a master audio acquisition device. The master audio acquisition device is connected to at least one slave audio acquisition device to form a cascade device. The specific implementation process of the method includes the following S51-S53:

[0122] S51. In response to a speaker mode activation operation triggered for any device, set any device as a speaker device and set a speaker identifier of the speaker device; wherein any device is a master audio acquisition device or a slave audio acquisition device.

[0123] The user can trigger speaker mode for any cascaded device. The triggering method can be set as needed and is not limited. For example, triggering a setting button on any device, including but not limited to long pressing, short pressing, and rotating the setting button; another example, clicking a setting control displayed on any device, including but not limited to single-clicking and double-clicking the setting control; another example, sliding a setting control displayed on any device; and another example, sending a voice control command to any device, such as "turn on speaker mode."

[0124] The main audio acquisition device may receive a speaker mode activation operation triggered for any device, and in response to the speaker mode activation operation, set any device as a speaker device and use the device identifier of the any device as a speaker identifier.

[0125] On the one hand, a user can trigger the speaker mode activation operation for any slave audio acquisition device. At this time, any slave audio acquisition device can respond to the trigger operation and send a speaker activation request to the master audio acquisition device. When any slave audio acquisition device is directly connected to the master audio acquisition device, any slave audio acquisition device can send the speaker activation request to the master audio acquisition device; when any slave audio acquisition device is indirectly connected to the master audio acquisition device through another slave audio acquisition device, any slave audio acquisition device can forward the speaker activation request to the master audio acquisition device through the other slave audio acquisition device.

[0126] On the other hand, the user can trigger the speaker mode start operation for the main audio acquisition device. At this time, the main audio acquisition device responds to the triggered speaker mode start operation, sets the main audio acquisition device as the speaker device, and uses the device identifier of the main audio acquisition device as the speaker identifier.

[0127] In an embodiment of the present application, the master audio acquisition device and the slave audio acquisition device can be directly or indirectly connected via a network. Optionally, the device identifier of the master audio acquisition device and the device identifier of the slave audio acquisition device can be a network address, i.e., an Internet Protocol Address (IP). The network address can facilitate communication between the master audio acquisition device and each slave audio acquisition device. For example, when a slave audio acquisition device sends data to the master audio acquisition device, the destination address of the data can be set to the network address of the master audio acquisition device; correspondingly, when the master audio acquisition device sends data to the slave audio acquisition device, the destination address of the data can be set to the network address of the slave audio acquisition device.

[0128] In addition, the device identifier may also be other identifiers that can uniquely identify the master audio acquisition device or the slave audio acquisition device, and this is not limited.

[0129] S52: If audio data collected by at least one device is obtained, the speaker device is selected from the at least one device based on the speaker identifier and the device identifier carried by the at least one audio data; wherein the at least one device includes: at least one slave audio collection device and part or all of the master audio collection device.

[0130] When either device is in speaker mode, the primary and secondary audio capture devices can each collect audio data, such as the speaker's voice, other people's voices, and other possible noise. The speaker is the person who needs to speak individually in various activity scenarios.

[0131] The slave audio capture device can send collected audio data to the master audio capture device. The audio data can carry a device identifier. The master audio capture device can obtain the audio data collected by at least one device and the device identifier of at least one device. The master audio capture device can then compare the speaker identifier with the obtained device identifier to select the master speaker from the at least one device, thereby obtaining the audio data collected by the master speaker.

[0132] S53. Perform a preset operation on at least one audio data to obtain audio data to be transmitted; wherein the preset operation includes at least one of the following: enhancing the audio data collected by the main speaker device, and suppressing the audio data other than the audio data collected by the main speaker device.

[0133] Among them, the preset operation may include: only enhancing the audio data collected by the main speaker device, or only suppressing the audio data other than the audio data collected by the main speaker device, or both enhancing the audio data collected by the main speaker device and suppressing the audio data other than the audio data collected by the main speaker device.

[0134] The enhancement processing is used to increase the volume of the audio data collected by the main speaker device. Specifically, the enhancement processing includes enhancing the amplitude of the audio data collected by the main speaker device. For example, the amplitude of the audio data collected by the main speaker device can be multiplied by a coefficient greater than 1. The value of the coefficient can be set as needed.

[0135] Suppression processing is used to eliminate or reduce the volume of other audio data (except the audio data collected by the main speaker device); specifically, suppression processing includes filtering out other audio data and reducing the amplitude of other audio data. For example, the amplitude of other audio data can be multiplied by a coefficient less than 1. The value of this coefficient can be set as needed.

[0136] Several possible implementations of S53 are described below.

[0137] In a possible implementation, audio data other than the audio data collected by the main speaker device in the at least one audio data may be filtered out, and the audio data collected by the main speaker device may be used as the audio data to be transmitted.

[0138] For example, Figure 6 As shown, the master device (i.e., the master audio acquisition device) collects audio data and, at the same time, receives audio data collected by the slave device (i.e., the slave audio acquisition device) through a network (wired network or wireless network), which includes the device identification of the slave device; in the speaker mode, the master device selects the audio data collected by the speaker device from the acquired audio data according to the set speaker identification, and uses the audio data collected by the speaker device as the audio data to be transmitted.

[0139] In another possible implementation, the at least one audio data is a plurality of audio data, and during the mixing process of the plurality of audio data, a preset operation is performed to obtain the audio data to be transmitted.

[0140] The audio mixing process is a process of combining multiple audio data into a single audio output stream. In this process, the above-mentioned preset operations can be performed on the multiple audio data.

[0141] In another possible implementation, the at least one audio data is a plurality of audio data. After a preset operation is performed on the plurality of audio data, the plurality of audio data after the operation are mixed to obtain audio data to be transmitted.

[0142] In an embodiment of the present application, in order to reduce the interference of other audio data on the audio data of the main speaker device, the other audio data can be suppressed, or the audio data of the main speaker device can be enhanced, or both the audio data collected by the main speaker device can be enhanced and the other audio data can be suppressed.

[0143] S54: Transmit the audio data to be transmitted to the terminal device for playback.

[0144] The terminal device may be the terminal device 230 or other terminal device 240 in the above-mentioned embodiment of the present application. The main audio acquisition device may transmit the audio data to be transmitted directly or indirectly to the terminal device. In other words, the terminal device may include a terminal device connected to the main audio acquisition device, or may include other terminal devices connected to the terminal device, without limitation.

[0145] For example, in a local conference scenario, the terminal device can specifically be a local conference terminal, and the main audio acquisition device can be connected to the local conference terminal to transmit the audio data to be transmitted to the local conference terminal for playback. For another example, in an online conference scenario, the main audio acquisition device is connected to the local conference terminal, and the local conference terminal and other conference terminals are connected to the online conference at the same time. After the main audio acquisition device transmits the audio data to be transmitted to the local conference terminal, the local conference terminal then transmits the received audio data to the other conference terminals, which then play the audio data. That is, the terminal device in the above S53 can be another conference terminal, and at the same time, the local conference terminal can also play the audio data.

[0146] It should be noted that the master audio acquisition device and the slave audio acquisition device in the embodiment of the present application can be located in the same space or in different spaces. For example, the master audio acquisition device and the slave audio acquisition device are located in different conference rooms.

[0147] The following combination Figure 7 The overall logic of the audio processing method of the embodiment of the present application is exemplarily introduced.

[0148] For example, Figure 7As shown, the slave audio capture device is referred to as the slave device, and the master audio capture device is referred to as the master device. Assuming that the user triggers the speaker mode for slave device 2, slave device 2 sends a speaker start request to the master device in response to the trigger operation. The master device determines to enable the speaker mode and sets slave device 2 as the master device (saving the device identifier of slave device 2 as the master identifier). In the speaker mode, slave device 1 can send the collected audio data 1 to the master device, slave device 2 can send the collected audio data 2 to the master device, slave device 3 can send the collected audio data 3 to the master device, slave device 4 can send the collected audio data 4 to the master device, and slave device 5 can send the collected audio data 5 to the master device. At the same time, the master device can also collect audio data 6. After obtaining each audio data, the master device can filter out the audio data 2 collected by slave device 2 (i.e., the master device). Then, a preset operation is performed on each audio data to obtain the audio data to be transmitted; for example, the preset operation is to select audio data 2 of the master device from each audio data and transmit it.

[0149] Any device in the embodiment of the present application (the main audio acquisition device or the slave audio acquisition device) can trigger the speaker mode. In the speaker mode, the speaker can speak through the main speaker device. When the main audio acquisition device obtains the audio data collected by at least one device, it can filter out the main speaker device from at least one device based on the speaker identifier, and then suppress the audio data collected by the non-main speaker device, and / or enhance the audio data collected by the main speaker device. Even if the non-main speaker makes a sound, the impact on the speaker's voice is relatively small, which can reduce the interference of other sounds on the speaker's voice, thereby improving the effect of the sound collected by the cascade device. At the same time, the embodiment of the present application can set any device as the main speaker device according to the location of the speaker. People who need to speak can take turns to speak as the main speaker, which improves the flexibility of the cascade device.

[0150] It should be noted that when any device triggers the speaker mode and turns on the speaker mode, other devices can also trigger the speaker mode, that is, multiple devices can serve as speaker devices at the same time. The following embodiments are described by taking one device as the speaker device as an example.

[0151] The following describes the specific implementation process of triggering the speaker mode from the audio capture device.

[0152] In some embodiments, when any slave audio capture device triggers the speaker mode, the master audio capture device in S51 of the above embodiment responds to the speaker mode activation operation triggered on any device, sets the any device as the speaker device, and sets the speaker identifier of the speaker device, specifically including:

[0153] In response to receiving a speaker start request sent by any slave audio collection device, any slave audio collection device is set as a speaker device, and the device identifier included in the speaker start request is used as a speaker identifier, and the speaker identifier is saved.

[0154] The speaker request is sent by any slave audio acquisition device in response to a speaker mode start operation triggered on any slave audio acquisition device.

[0155] Specifically, users can trigger the speaker mode for any slave audio capture device. The triggering method can be set as needed and is not limited to this. For example, triggering a setting button on any slave audio capture device, including but not limited to long pressing the setting button, short pressing the setting button, rotating the setting button, etc.; another example, clicking a setting control displayed on any slave audio capture device, including but not limited to single-clicking the setting control, double-clicking the setting control, etc.; another example, sliding the setting control displayed on any device; another example, sending a voice control command to any slave audio capture device, such as "turn on speaker mode."

[0156] In response to the triggered speaker mode start operation, any slave audio acquisition device sends a speaker start request carrying the device identification of any slave audio acquisition device to the master audio acquisition device. The master audio acquisition device responds to the speaker start request, sets any slave audio acquisition device as the speaker device, and saves the device identification of any slave audio acquisition device as the speaker identification.

[0157] Specifically, any slave audio capture device can display an open mic state or a closed mic state, that is, any slave audio capture device can switch from an open mic state to a speaker mode, or from a closed mic state to a speaker mode. The operation method for triggering the speaker mode in these two cases can be the same or different. Among them, the open mic state can indicate that any slave audio capture device is available, that is, the device is turned on, and the audio data collected by the device needs to be transmitted; the closed mic state can indicate that any slave audio capture device is unavailable. On the one hand, unavailable can mean that the device is turned off, and on the other hand, unavailable can also mean that the device is turned on, but the audio data collected by the device is not transmitted.

[0158] Switching between the microphone-on state, the microphone-off state, and the speaker mode of any device in the embodiments of the present application may specifically include the following three scenarios:

[0159] (1) The microphone status switches to speaker mode.

[0160] (2) Switch from microphone-mute mode to speaker mode.

[0161] (3) The speaker mode is switched to the microphone open state.

[0162] The triggering operation for switching from the open mic state to the speaker mode can be the same as or different from the triggering operation for switching from the closed mic state to the speaker mode. The triggering operation for switching from the speaker mode to the open mic state can be different from the triggering operation for switching from the open mic state to the speaker mode, and different from the triggering operation for switching from the closed mic state to the speaker mode.

[0163] For example, Figure 8 As shown, assuming that each device is equipped with a mute button, the operation to trigger the speaker mode can be a long press of the mute button, and the operation to exit the speaker mode can be a short press of the mute button. Therefore, when any device is in the microphone-off state or the microphone-on state, you can long press the mute button of any device to trigger the speaker mode; after any device turns on the speaker mode, short press the mute button of any device to switch from the speaker mode to the microphone-on state, that is, exit the speaker mode.

[0164] The microphone on and microphone off states can be displayed in different ways, which can be set as needed and are not limited to this. For example, the microphone on and microphone off states can be indicated by displaying different colors of indicator lights, such as a green light indicating the microphone on and a red light indicating the microphone off state; another example is the display of different patterns indicating the microphone on and microphone off states; another example is the display of different text indicating the microphone on and microphone off states, such as "microphone on" indicating the microphone on state and "microphone off" indicating the microphone off state.

[0165] In an embodiment of the present application, when the speaker mode is triggered for any slave audio capture device, any slave audio capture device can send a speaker start request to the master audio capture device to start the speaker mode, so as to facilitate the speaker to speak using any slave audio capture device, thereby improving the flexibility of the cascaded device.

[0166] In some embodiments, after receiving a speaker start request from any slave audio collection device and setting any slave audio collection device as the speaker device, the master audio collection device may further perform the following steps A1-A2:

[0167] A1. Displays the microphone muting status of the primary audio capture device.

[0168] Among them, after determining that any slave audio collection device is a master device, the master audio collection device determines itself as a non-master device and displays the microphone-mute state. The display method of the microphone-mute state can be found in the above embodiment of this application and will not be repeated here.

[0169] A2. Send a first notification message to at least one slave audio collection device, where the first notification message includes a speaker identifier, which is used to indicate that a speaker mode is turned on, so that any slave audio collection device displays an open microphone state according to the speaker identifier, and any slave audio collection device other than the slave audio collection device displays a closed microphone state according to the speaker identifier.

[0170] After the master audio acquisition device determines that the speaker mode is enabled, it can send a first notification message to each slave audio acquisition device. Specifically, the device identifier of each slave audio acquisition device can be a network address, and the destination address of the first notification message can include the network address of each slave audio acquisition device. In this way, when slave audio acquisition device 2 is indirectly connected to the master audio acquisition device through slave audio acquisition device 1, after receiving the first notification message sent by the master audio acquisition device, slave audio acquisition device 1 can determine, based on the destination address of the first notification message, that the first notification message needs to be sent to the connected slave audio acquisition device 2, thereby achieving the broadcast of the first notification message.

[0171] After receiving the first notification message, any slave audio collection device that triggers the speaker mode determines to turn on the speaker mode, and determines itself as the speaker device based on the speaker identifier, and can display the microphone-on state. After receiving the first notification message, other slave audio collection devices determine to turn on the speaker mode, and determine themselves as non-speaker devices based on the speaker identifier, and can display the microphone-off state.

[0172] On the one hand, when the master audio acquisition device and each slave audio acquisition device are in the open microphone state, when any slave audio acquisition device triggers the speaker mode, the slave audio acquisition device remains in the open microphone state, and the other slave audio acquisition devices switch from the open microphone state to the closed microphone state.

[0173] For example, Figure 9 As shown, the slave audio capture device is referred to as the slave device, and the master audio capture device is referred to as the master device. It is assumed that the master device is connected in series with slave devices 1, 2, 3, 4, and 5 in sequence via PoE, and the master device is connected to the terminal device via a wired network or a wireless network. When the master device and each slave device are in the open microphone state, the user triggers the speaker mode for slave device 2, for example, long pressing the mute button of slave device 2. In response to the trigger operation, slave device 2 sends a speaker start request carrying a device identifier to the master device. The master device determines to start the speaker mode according to the speaker start request, and sets the device identifier of slave device 2 to the speaker identifier for storage. Then, the master device can switch from the open microphone state to the closed microphone state, and broadcast a first notification message to each slave device, so that slave device 2 remains in the open microphone state, and the slave devices other than slave device 2 switch from the open microphone state to the closed microphone state.

[0174] On the other hand, when the master audio acquisition device and all slave audio acquisition devices are in the mute state, when any slave audio acquisition device triggers the speaker mode, the slave audio acquisition device switches from the mute state to the open state, and the other slave audio acquisition devices remain in the mute state.

[0175] For example, Figure 10 As shown, still based on the above Figure 9 Taking the master device and each slave device in as an example, when the master device and each slave device are in the mute state, the user triggers the speaker mode for slave device 2, for example, long pressing the mute button of slave device 2, and slave device 2 responds to the trigger operation by sending a speaker start request carrying the device identification to the master device. The master device determines to turn on the speaker mode according to the speaker start request, and sets the device identification of slave device 2 to the speaker identification for storage; then, the master device can maintain the mute state, and broadcast the first notification message to each slave device, so that slave device 2 switches from the mute state to the open state, and the slave devices other than slave device 2 maintain the mute state.

[0176] In an embodiment of the present application, after the speaker mode is triggered to be turned on by the slave audio capture device, the master audio capture device sends a first notification message to each slave audio capture device, so that the speaker device displays the microphone-on state and the non-speaker device displays the microphone-off state, so that the user can intuitively determine the speaker device and the non-speaker device, which is convenient for the speaker to accurately use the speaker device to speak, so that the speaker's audio data can be collected and transmitted to the terminal device for playback.

[0177] In some embodiments, after the master audio capture device sets any slave audio capture device as the master device, the speaker can use the master device to speak. When the speech is finished, the master device can be triggered to exit the master mode. At this time, the master audio capture device can perform the following steps B1-B2:

[0178] B1. In response to receiving a request to exit the main speaker mode sent by any slave audio acquisition device, determine to exit the main speaker mode and switch the microphone-off state of the master audio acquisition device to the microphone-on state.

[0179] Among them, any slave audio acquisition device can respond to the trigger operation of exiting the speaker mode and send an exit speaker request to the master audio acquisition device. The trigger operation of exiting the speaker mode can be set as needed and is not limited to this. For example, when the setting button on any slave audio acquisition device is triggered to turn on the speaker mode, the setting button can also be triggered to exit the speaker mode, such as long pressing the setting button to turn on the speaker mode, short pressing the setting button to exit the speaker mode, or short pressing the setting button to turn on the speaker mode, long pressing the setting button to exit the speaker mode; for another example, when the setting control displayed by any slave audio acquisition device is triggered to turn on the speaker mode, the setting control can also be triggered to exit the speaker mode, such as single-clicking the setting control to turn on the speaker mode, double-clicking the setting control to exit the speaker mode, or double-clicking the setting control to turn on the speaker mode, single-clicking the setting control to exit the speaker mode. The above-mentioned triggering operation of turning on the speaker mode and the triggering operation of exiting the speaker mode are only exemplary and are not limited in the embodiments of the present application.

[0180] B2. Send a second notification message to at least one slave audio collection device, where the second notification message is used to instruct the user to exit the speaker mode, so that any slave audio collection device other than the slave audio collection device switches from a closed microphone state to an open microphone state.

[0181] After the master audio acquisition device determines to exit the speaker mode, it can send a second notification message to each slave audio acquisition device to broadcast the message of exiting the speaker mode. Specifically, the device identifier of each slave audio acquisition device can be a network address, and the destination address of the second notification message can include the network address of each slave audio acquisition device. In this way, when slave audio acquisition device 2 is indirectly connected to the master audio acquisition device through slave audio acquisition device 1, after receiving the second notification message sent by the master audio acquisition device, slave audio acquisition device 1 can determine that the second notification message needs to be sent to the connected slave audio acquisition device 2 based on the destination address of the second notification message, thereby realizing the broadcast of the second notification message.

[0182] For example, Figure 11 As shown, still based on the above Figure 9 Taking the master device and each slave device in as an example, after slave device 2 turns on the speaker mode, after the speaker finishes speaking using slave device 2, the speaker can trigger the exit of the speaker mode for slave device 2, for example, by short pressing the mute button of slave device 2. In response to the trigger operation, slave device 2 sends an exit speaker request to the master device. The master device determines to exit the speaker mode according to the exit speaker request. The master device can switch from the closed microphone state to the open microphone state, and broadcast a second notification message to each slave device, so that the slave devices other than slave device 2 switch from the closed microphone state to the open microphone state.

[0183] In an embodiment of the present application, after any slave audio acquisition device exits the speaker mode, the master audio acquisition device sends a second notification message to each slave audio acquisition device to switch the non-speaker device from the closed microphone state to the open microphone state, so that the user can intuitively determine the exit from the speaker mode. Since all devices are in the open microphone state, that is, in normal mode, it is convenient for the user to use any device to speak, thereby ensuring the convenience of use of cascaded devices.

[0184] The following describes the specific implementation process of the main audio acquisition device triggering the main speaker mode.

[0185] In some embodiments, when the speaker mode is triggered for the primary audio capture device, in response to the speaker mode activation operation triggered for any device in S51 of the above embodiment, any device is set as the speaker device and the speaker identifier of the speaker device is saved, which may specifically include:

[0186] In response to a speaker mode start operation triggered for the primary audio acquisition device, the primary audio acquisition device is set as the speaker device, and the microphone-on status of the primary audio acquisition device is displayed.

[0187] Specifically, the method for triggering the speaker mode on the primary audio capture device can be set as needed and is not limited to this. For example, triggering a setting button on the primary audio capture device includes, but is not limited to, long pressing the setting button, short pressing the setting button, rotating the setting button, etc.; another example is clicking a setting control displayed on the primary audio capture device, including, but not limited to single-clicking the setting control, double-clicking the setting control, etc.; another example is sliding a setting control displayed on any device; another example is sending a voice control command to the primary audio capture device, such as "turn on speaker mode."

[0188] Furthermore, the master audio collection device sends a third notification message to at least one slave audio collection device, where the third notification message includes a speaker identifier, which is used to indicate that the speaker mode is turned on, so that at least one slave audio collection device displays a microphone-mute state according to the speaker identifier.

[0189] In an embodiment of the present application, when the main audio acquisition device triggers the speaker mode, the main audio acquisition device sends a third notification message to each slave audio acquisition device to make each slave audio acquisition device display the microphone-mute state, so that the user can intuitively determine the main speaker device and the non-main speaker device, so that the speaker can accurately use the main speaker device to speak, so that the speaker's audio data can be collected and transmitted to the terminal device.

[0190] In some embodiments, in response to the speaker mode activation operation triggered on the primary audio capture device in step C1, the primary audio capture device is set as the speaker device, and the microphone-on status of the primary audio capture device is displayed, specifically including the following two situations:

[0191] In the first case, when the main audio acquisition device shows the microphone-on state, in response to the first speaker mode start operation triggered for the main audio acquisition device, the main audio acquisition device is set as the speaker device and the microphone-on state of the main audio acquisition device is maintained.

[0192] In the second case, when the main audio acquisition device displays the closed microphone state, in response to the second speaker mode start operation triggered for the main audio acquisition device, the main audio acquisition device is set as the speaker device, and the closed microphone state of the main audio acquisition device is switched to the open microphone state.

[0193] Among them, the main audio acquisition device can display the open microphone state or the closed microphone state, that is, the main audio acquisition device can switch from the open microphone state to the speaker mode, and can also switch from the closed microphone state to the speaker mode. The operation method of triggering the speaker mode in these two cases can be the same or different, that is, the above-mentioned first speaker mode activation operation and the second speaker mode activation operation can be the same or different. For details, please refer to the operation method of triggering the speaker mode in the above embodiment of this application.

[0194] In the embodiment of the present application, the main audio acquisition device can switch to the main speaker mode in the microphone-on state, and can also switch to the main speaker mode in the microphone-off state, thereby realizing multiple switching scenarios of the main speaker mode and improving the switching flexibility of the main speaker mode.

[0195] In some embodiments, after the primary audio capture device sets itself as the main speaker device, the speaker can use the main speaker device to speak. When the speech is finished, the main speaker device can be triggered to exit the main speaker mode. At this time, the primary audio capture device can perform the following steps:

[0196] In response to the speaker mode exit operation triggered for the master audio acquisition device, a fourth notification message is sent to at least one slave audio acquisition device, where the fourth notification message is used to instruct the exit from the speaker mode, so that the at least one slave audio acquisition device switches from a closed microphone state to an open microphone state.

[0197] In an embodiment of the present application, after any slave audio acquisition device exits the speaker mode, the master audio acquisition device sends a second notification message to each slave audio acquisition device to switch the non-speaker device from the closed microphone state to the open microphone state, so that the user can intuitively determine the exit from the speaker mode. Since all devices are in the open microphone state, that is, in normal mode, it is convenient for the user to use any device to speak, thereby ensuring the convenience of use of cascaded devices.

[0198] In some embodiments, when the main speaker device exits the main speaker mode, the main audio capture device and at least one slave audio capture device can both be in the open microphone state. In this case, the main audio capture device and the slave audio capture device can capture audio data, and the slave audio capture device transmits the captured audio data to the main audio capture device. Therefore, the main audio capture device can obtain the audio data collected by at least one device. The at least one device includes: at least one slave audio capture device and part or all of the main audio capture device. If the main audio capture device obtains the audio data collected by multiple devices, it mixes the multiple audio data to obtain mixed data; then transmits the mixed data to the terminal device for playback.

[0199] Specifically, in the process of mixing the audio data of multiple devices, the amplitudes of the audio data of the multiple devices can be adjusted according to the weight coefficients of the multiple devices; for example, the amplitude of the audio data of each device is multiplied by the corresponding weight coefficient. The weight coefficients of the multiple devices can be the same or different, and the sizes of the weight coefficients of the multiple devices can be set as needed, which is not limited. For example, the weight coefficient of the main audio acquisition device is set to be greater than the weight coefficient of the slave audio acquisition device to enhance the audio data collected by the main audio acquisition device and weaken the audio data collected by the slave audio acquisition device.

[0200] For example, Figure 12 As shown, the main audio acquisition device is referred to as the master device, and the slave audio acquisition device is referred to as the slave device. After the main speaker device exits the main speaker mode and turns on the normal mode, the master device can collect audio data and receive the audio data collected by the slave device (including the device identification) through the network. Then, the audio data collected by the master device and the audio data collected by each slave device are mixed and the mixed data is output to the terminal device.

[0201] In addition, if the master audio acquisition device obtains audio data collected by a device, it transmits the audio data to the terminal device for playback; wherein the device is a slave audio acquisition device or a master audio acquisition device.

[0202] In an embodiment of the present application, after the main speaker device exits the main speaker mode, the normal mode is turned on, all devices are in the microphone-on state, and the user can use any device to speak. After the main audio acquisition device obtains the audio data collected by itself and the audio data collected by each slave audio acquisition device, it can mix the audio data and transmit it to the terminal device, thereby realizing the audio data transmission between the main audio acquisition device and each slave audio acquisition device in the normal mode.

[0203] Based on the same inventive concept, an embodiment of the present application also provides an audio processing method, which is executed by a slave audio acquisition device. The principle of solving the problem by this method is similar to that of the method on the master audio acquisition device side in the above embodiment. Therefore, the implementation of this method can refer to the implementation of the method on the master audio acquisition device side, and the repeated parts will not be repeated.

[0204] See Figure 13 As shown, an audio processing method provided in an embodiment of the present application is applied to any slave audio acquisition device among at least one slave audio acquisition device, and at least one slave audio acquisition device is connected to the master audio acquisition device. The specific implementation process of the method includes the following S131-S132:

[0205] S131. In response to a speaker mode start operation triggered for any slave audio capture device, sending a speaker start request to the master audio capture device, where the speaker start request includes a device identifier of any slave audio capture device, so that the master audio capture device sets any slave audio capture device as a speaker device, and saves the device identifier of any slave audio capture device as a speaker identifier.

[0206] S132: Collect audio data and send the audio data carrying the device identification to the master audio collection device, so that the master audio collection device determines any slave audio collection device as the master device based on the device identification.

[0207] In an embodiment of the present application, any slave audio acquisition device can trigger the speaker mode, the master audio acquisition device uses any slave audio acquisition device as the speaker device, and sets the device identifier of any slave audio acquisition device as the speaker identifier. The speaker device sends the collected audio data to the master audio acquisition device, so that the master audio acquisition device can enhance the audio data collected by the speaker device in the speaker mode, and / or suppress the audio data collected by the non-speaker device; in this way, even if the non-speaker makes a sound, the impact on the speaker's voice is relatively small, which can reduce the interference of other sounds on the speaker's voice and improve the effect of the sound collected by the cascaded devices. At the same time, the embodiment of the present application can set any device as the speaker device according to the location of the speaker, and people who need to speak can take turns to speak as the speaker, thereby improving the flexibility of the cascaded devices.

[0208] In some embodiments, in response to the speaker mode start operation triggered on any slave audio capture device in S131, sending a speaker start request to the master audio capture device may include the following two situations:

[0209] Case 1: When any slave audio capture device displays the microphone-on state, in response to the third speaker mode start operation triggered for any slave audio capture device, a speaker start request is sent to the master audio capture device.

[0210] Case 2: When any slave audio capture device displays the microphone-mute state, in response to the fourth speaker mode start operation triggered for any slave audio capture device, a speaker start request is sent to the master audio capture device.

[0211] Among them, any slave audio acquisition device can display the open microphone state or the closed microphone state, that is, any slave audio acquisition device can switch from the open microphone state to the speaker mode, and can also switch from the closed microphone state to the speaker mode. The operation method of triggering the speaker mode in these two cases can be the same or different, that is, the above-mentioned third speaker mode activation operation and the fourth speaker mode activation operation can be the same or different. For details, please refer to the operation method of triggering the speaker mode in the above embodiment of this application.

[0212] In some embodiments, after any slave audio capture device triggers the speaker mode, the following steps may be performed:

[0213] In response to receiving a first notification message sent by the master audio acquisition device, the microphone-on status of any slave audio acquisition device is displayed according to the speaker identifier included in the first notification message; wherein the first notification message is used to indicate that the speaker mode is turned on.

[0214] In some embodiments, after any slave audio capture device turns on the speaker mode, when the speaker finishes speaking using the slave audio capture device, the slave audio capture device can be triggered to exit the speaker mode. The slave audio capture device can also perform the following steps:

[0215] In response to an exit operation of the speaker mode triggered for any slave audio acquisition device, an exit request for the speaker is sent to the master audio acquisition device, so that the master audio acquisition device sends a second notification message to at least one slave audio acquisition device, and the second notification message is used to indicate the exit from the speaker mode, so that any slave audio acquisition device other than the slave audio acquisition device switches from a closed microphone state to an open microphone state.

[0216] Based on the same inventive concept, an embodiment of the present application also provides an audio processing device. The principle of solving the problem by this device is similar to the method of the above embodiment. Therefore, the implementation of this device can refer to the implementation of the above method, and the repeated parts will not be repeated.

[0217] like Figure 14 , which is a structural diagram of an audio processing device 1400. The device can be set in a master audio acquisition device, which is connected to at least one slave audio acquisition device. The device includes:

[0218] The setting unit 1401 is configured to, in response to a speaker mode activation operation triggered on any device, set the device as a speaker device and set a speaker identifier of the speaker device; wherein the device is a master audio acquisition device or a slave audio acquisition device;

[0219] The screening unit 1402 is configured to, upon obtaining audio data collected by at least one device, screen out the speaker device from the at least one device based on the speaker identifier and the device identifier carried by the at least one audio data, and obtain the audio data collected by the speaker device; wherein the at least one device includes: at least one slave audio collection device and part or all of the master audio collection device;

[0220] The processing unit 1403 is configured to perform a preset operation on at least one audio data to obtain audio data to be transmitted; wherein the preset operation includes at least one of the following: enhancing the audio data collected by the main speaker device, and suppressing the audio data other than the audio data collected by the main speaker device;

[0221] The first transmission unit 1404 is configured to transmit the audio data to be transmitted to the terminal device for playback.

[0222] Any device in the embodiment of the present application (the main audio acquisition device or the slave audio acquisition device) can trigger the speaker mode. In the speaker mode, when the main audio acquisition device obtains the audio data collected by at least one device, it can filter out the main speaker device from at least one device based on the main speaker identifier, and then suppress the audio data collected by non-main speakers, and / or enhance the audio data collected by the main speaker device, thereby reducing the interference of other sounds on the voice of the speaker using the main speaker device, and improving the effect of the sound collected by the cascaded devices. At the same time, the embodiment of the present application can set any device as the main speaker device according to the location of the speaker, and people who need to speak can take turns to speak as the main speaker, thereby improving the flexibility of the cascaded devices.

[0223] Optionally, the setting unit 1401 is specifically configured to:

[0224] In response to receiving a speaker start request sent by any slave audio acquisition device, setting any slave audio acquisition device as a speaker device, using the device identifier included in the speaker start request as a speaker identifier, and saving the speaker identifier;

[0225] The speaker request is sent by any slave audio acquisition device in response to a speaker mode start operation triggered on any slave audio acquisition device.

[0226] Optionally, in response to a speaker mode activation operation triggered on the primary audio capture device, the primary audio capture device is set as the speaker device, and the microphone-on status of the primary audio capture device is displayed, the setting unit 1401 is specifically configured to:

[0227] When the primary audio acquisition device is in the microphone-on state, in response to a first speaker mode activation operation triggered on the primary audio acquisition device, the primary audio acquisition device is set as the speaker device and the microphone-on state of the primary audio acquisition device is maintained; or

[0228] When the main audio acquisition device is in a closed microphone state, in response to a second speaker mode start operation triggered for the main audio acquisition device, the main audio acquisition device is set as a speaker device, and the closed microphone state of the main audio acquisition device is switched to an open microphone state.

[0229] Optionally, the device further comprises:

[0230] Display unit, used to display the microphone muting status of the main audio acquisition device;

[0231] A first notification unit is used to send a first notification message to at least one slave audio collection device, where the first notification message includes a speaker identifier, which is used to indicate that a speaker mode is turned on, so that any slave audio collection device displays an open microphone state according to the speaker identifier, and any slave audio collection device other than the slave audio collection device displays a closed microphone state according to the speaker identifier.

[0232] Optionally, the device further comprises:

[0233] a switching unit, configured to, in response to receiving a request to exit the main speaker mode sent by any slave audio acquisition device, determine to exit the main speaker mode and switch the closed microphone state of the master audio acquisition device to the open microphone state;

[0234] The second notification unit is used to send a second notification message to at least one slave audio collection device, where the second notification message is used to instruct the exit from the speaker mode, so that any slave audio collection device other than the slave audio collection device switches from a closed microphone state to an open microphone state.

[0235] Optionally, the setting unit 1401 is specifically configured to:

[0236] In response to a speaker mode activation operation triggered on the primary audio capture device, the primary audio capture device is set as the speaker device, and the microphone-on status of the primary audio capture device is displayed;

[0237] The device further comprises:

[0238] The third notification unit is used to send a third notification message to at least one slave audio collection device, where the third notification message includes a speaker identifier, which is used to indicate that a speaker mode is turned on, so that at least one slave audio collection device displays a microphone-mute state according to the speaker identifier.

[0239] Optionally, the device further includes a fourth notification unit, configured to:

[0240] In response to the speaker mode exit operation triggered for the master audio acquisition device, a fourth notification message is sent to at least one slave audio acquisition device, where the fourth notification message is used to instruct the exit from the speaker mode, so that the at least one slave audio acquisition device switches from a closed microphone state to an open microphone state.

[0241] Optionally, the device further comprises:

[0242] A mixing unit is configured to, after exiting the speaker mode, mix the multiple audio data if audio data collected by multiple devices are obtained to obtain mixed data; wherein the multiple devices include: at least one slave audio collection device and some or all of the master audio collection device;

[0243] The second transmission unit is used to transmit the mixed data to the terminal device for playback.

[0244] Optionally, the processing unit 1403 is specifically configured to:

[0245] Filtering out audio data other than the audio data collected by the main speaker device from the at least one audio data, and using the audio data collected by the main speaker device as the audio data to be transmitted; or

[0246] The at least one audio data is a plurality of audio data, and in a process of mixing the plurality of audio data, a preset operation is performed to obtain the audio data to be transmitted; or

[0247] The at least one audio data is a plurality of audio data. After a preset operation is performed on the plurality of audio data, the plurality of audio data after the operation is mixed to obtain audio data to be transmitted.

[0248] Based on the same inventive concept, an embodiment of the present application further provides an audio processing device, the principle of which is similar to the method from the audio acquisition device side of the above embodiment. Therefore, the implementation of the device can refer to the implementation of the above method from the audio acquisition device side, and the repeated parts will not be repeated.

[0249] See Figure 15 As shown, an audio processing device 1500 provided in an embodiment of the present application can be provided in any of at least one slave audio acquisition device, at least one slave audio acquisition device is connected to a master audio acquisition device, and the device includes:

[0250] The first sending unit 1501 is configured to, in response to a speaker mode start operation triggered for any slave audio acquisition device, send a speaker start request to the master audio acquisition device, where the speaker start request includes a device identifier of any slave audio acquisition device, so that the master audio acquisition device sets any slave audio acquisition device as a speaker device, and stores the device identifier of any slave audio acquisition device as a speaker identifier;

[0251] The collecting unit 1502 is configured to collect audio data and send the audio data carrying the device identification to the master audio collecting device, so that the master audio collecting device determines any slave audio collecting device as the master device based on the device identification.

[0252] In an embodiment of the present application, any slave audio acquisition device can trigger the speaker mode, the master audio acquisition device uses any slave audio acquisition device as the speaker device, and sets the device identifier of any slave audio acquisition device as the speaker identifier. The speaker device sends the collected audio data to the master audio acquisition device, so that the master audio acquisition device can enhance the audio data collected by the speaker device in the speaker mode, and / or suppress the audio data collected by the non-speaker device; in this way, even if the non-speaker makes a sound, the impact on the speaker's voice is relatively small, which can reduce the interference of other sounds on the speaker's voice and improve the effect of the sound collected by the cascaded devices. At the same time, the embodiment of the present application can set any device as the speaker device according to the location of the speaker, and people who need to speak can take turns to speak as the speaker, thereby improving the flexibility of the cascaded devices.

[0253] Optionally, the first sending unit 1501 is specifically configured to:

[0254] When any slave audio acquisition device displays the microphone-on state, in response to a third speaker mode start operation triggered for any slave audio acquisition device, sending a speaker start request to the master audio acquisition device; or

[0255] In the case that any slave audio acquisition device displays the microphone-mute state, in response to the fourth speaker mode start operation triggered for any slave audio acquisition device, a speaker start request is sent to the master audio acquisition device.

[0256] Optionally, the device further includes a receiving unit, configured to:

[0257] In response to receiving a first notification message sent by the master audio acquisition device, the microphone-on status of any slave audio acquisition device is displayed according to the speaker identifier included in the first notification message; wherein the first notification message is used to indicate that the speaker mode is turned on.

[0258] Optionally, the device further includes a second sending unit:

[0259] In response to an exit operation of the speaker mode triggered for any slave audio acquisition device, an exit request for the speaker is sent to the master audio acquisition device, so that the master audio acquisition device sends a second notification message to at least one slave audio acquisition device, and the second notification message is used to indicate the exit from the speaker mode, so that any slave audio acquisition device other than the slave audio acquisition device switches from a closed microphone state to an open microphone state.

[0260] For the convenience of description, the above parts are divided into modules (or units) according to their functions and described separately. Of course, when implementing this application, the functions of each module (or unit) can be implemented in the same or multiple software or hardware.

[0261] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0262] After introducing the audio processing method and apparatus according to an exemplary embodiment of the present application, an electronic device according to another exemplary embodiment of the present application is introduced next.

[0263] Based on the same inventive concept as the above method embodiment, an electronic device is also provided in the embodiment of the present application. The electronic device can be the master audio acquisition device or the slave audio acquisition device in the above embodiment. In this embodiment, the structure of the electronic device can be as follows: Figure 16 As shown, it includes a memory 1601 , a communication module 1603 , a bus 1604 and one or more processors 1602 .

[0264] Memory 1601 is used to store computer programs executed by processor 1602. Memory 1601 may mainly include a program storage area and a data storage area. The program storage area may store an operating system and programs required for running instant messaging functions, while the data storage area may store various instant messaging messages and operating instruction sets.

[0265] Memory 1601 may be a volatile memory, such as random-access memory (RAM); a non-volatile memory, such as read-only memory, flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or any other medium capable of carrying or storing a desired computer program in the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 1601 may be a combination of the aforementioned memories.

[0266] The processor 1602 may include one or more central processing units (CPUs) or digital processing units, etc. The processor 1602 is configured to implement the above-mentioned audio processing method when calling the computer program stored in the memory 1601 .

[0267] The communication module 1603 is used to communicate with terminal devices and other audio collection devices.

[0268] The specific connection medium between the memory 1601, the communication module 1603 and the processor 1602 is not limited in the embodiment of the present application. Figure 16 In the embodiment, the memory 1601 and the processor 1602 are connected via a bus 1604. Figure 16 The connections between the other components are shown in bold lines, which are only for illustration and are not intended to be limiting. The bus 1604 can be divided into an address bus, a data bus, a control bus, etc. For ease of description, Figure 16 The diagram shows a single thick line, but this does not indicate that there is only one bus or one type of bus.

[0269] The memory 1601 stores a computer storage medium, which stores computer executable instructions. The computer executable instructions are used to implement the audio processing method of the embodiment of the present application. The processor 1602 is used to execute the audio processing method of the above embodiment, such as Figure 5 or Figure 13 shown.

[0270] In another embodiment, the electronic device may also be other electronic devices. In this embodiment, the structure of the electronic device may be as follows: Figure 17 As shown, it includes: a communication component 1710, a memory 1720, an audio circuit 1740, a Bluetooth module 1750, a processor 1730 and other components.

[0271] The communication component 1710 is used to communicate with other electronic devices. In some embodiments, it can include a WiFi module. The WiFi module is a short-range wireless transmission technology, and the electronic device can transmit data with other electronic devices through the WiFi module.

[0272] The memory 1720 can be used to store software programs and data. The processor 1730 executes various functions of the electronic device and processes data by running the software programs or data stored in the memory 1720. The memory 1720 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. The memory 1720 stores an operating system that enables the electronic device to operate. In the present application, the memory 1720 can store the operating system and various application programs, and may also store a computer program that executes the audio processing method of the embodiment of the present application.

[0273] Audio circuit 1740 and microphone 1741 provide an audio interface between the user and the electronic device. Microphone 1741 converts collected sound signals into electrical signals, which are then received by audio circuit 1740 and converted into audio data. The audio data is then output to communication component 1710 for transmission to, for example, another electronic device, or to memory 1720 for further processing.

[0274] The Bluetooth module 1750 is used to exchange information with other electronic devices having Bluetooth modules via the Bluetooth protocol. For example, an electronic device can establish a Bluetooth connection with another electronic device also having a Bluetooth module via the Bluetooth module 1750 to exchange data.

[0275] The processor 1730 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire terminal. By running or executing software programs stored in the memory 1720 and calling data stored in the memory 1720, it performs various functions of the terminal device and processes data. In some embodiments, the processor 1730 may include one or more processing units; the processor 1730 may also integrate an application processor and a baseband processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the baseband processor mainly processes wireless communications. It is understandable that the above-mentioned baseband processor may not be integrated into the processor 1730. In this application, the processor 1730 can run the operating system, application programs, user interface display and touch response, as well as the audio processing method of the embodiment of the application.

[0276] In some possible implementations, various aspects of the audio processing method provided in the present application may also be implemented in the form of a program product, which includes a computer program. When the program product is run on an electronic device, the computer program is used to enable the electronic device to perform the steps of the audio processing method according to various exemplary embodiments of the present application described above in this specification. For example, the electronic device may perform the following steps: Figure 5 or Figure 13 Follow the steps shown in .

[0277] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0278] The program product of the embodiment of the present application may be a portable compact disc read-only memory (CD-ROM) and include a computer program, and can be run on an electronic device. However, the program product of the present application is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with a command execution system, apparatus, or device.

[0279] A readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a readable computer program. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with a command execution system, apparatus, or device.

[0280] The computer program embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0281] The computer program for performing the operations of the present application can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The computer program can be executed entirely on the user electronic device, partially on the user electronic device, as a separate software package, partially on the user electronic device and partially on a remote electronic device, or entirely on a remote electronic device or server. In cases involving remote electronic devices, the remote electronic device can be connected to the user electronic device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external electronic device (for example, using an Internet service provider to connect through the Internet).

[0282] It should be noted that although several units or subunits of the device are mentioned in the detailed description above, this division is merely exemplary and not mandatory. In fact, depending on the embodiment of the application, the features and functions of two or more units described above can be embodied in a single unit. Conversely, the features and functions of a single unit described above can be further divided and embodied by multiple units.

[0283] Furthermore, although the operations of the method of the present application are described in a particular order in the accompanying drawings, this does not require or imply that the operations must be performed in this particular order, or that all illustrated operations must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0284] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain a computer-usable computer program.

[0285] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program commands. These computer program commands can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the commands executed by the processor of the computer or other programmable data processing device generate commands for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0286] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising a command device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0287] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0288] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0289] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. An audio processing method, characterized in that: Applied to a master audio acquisition device, the master audio acquisition device is connected to at least one slave audio acquisition device, the method comprising: In response to a speaker mode activation operation triggered for any device, setting the any device as a speaker device and setting a speaker identifier of the speaker device; wherein the any device is the master audio acquisition device or the slave audio acquisition device; If audio data collected by at least one device is obtained, the speaker device is selected from the at least one device based on the speaker identifier and the device identifier carried by the at least one audio data; wherein the at least one device includes: part or all of the at least one slave audio collection device and the master audio collection device; Performing a preset operation on the at least one audio data to obtain audio data to be transmitted; wherein the preset operation includes at least one of the following: performing enhancement processing on the audio data collected by the main speaker device, and performing suppression processing on audio data other than the audio data collected by the main speaker device; The audio data to be transmitted is transmitted to the terminal device for playback.

2. The method according to claim 1, characterized in that The step of setting any device as a speaker device and setting a speaker identifier of the speaker device in response to a speaker mode activation operation triggered on any device includes: In response to receiving a speaker start request sent by any slave audio acquisition device, setting the any slave audio acquisition device as a speaker device, using the device identifier included in the speaker start request as the speaker identifier, and saving the speaker identifier; The speaker request is sent by any slave audio acquisition device in response to a speaker mode start operation triggered on any slave audio acquisition device.

3. The method according to claim 2, characterized in that The method further comprises: Display the microphone muting status of the main audio acquisition device; A first notification message is sent to the at least one slave audio collection device, where the first notification message includes the speaker identifier, which is used to indicate that the speaker mode is turned on, so that any slave audio collection device displays an open microphone state according to the speaker identifier, and any slave audio collection device other than the slave audio collection device displays a closed microphone state according to the speaker identifier.

4. The method according to claim 3, characterized in that The method further comprises: In response to receiving a request to exit the main speaker mode sent by any of the slave audio acquisition devices, determining to exit the main speaker mode and switching the microphone-off state of the master audio acquisition device to the microphone-on state; A second notification message is sent to the at least one slave audio collection device, where the second notification message is used to instruct the exit from the speaker mode, so that the slave audio collection device other than any of the slave audio collection devices switches from a closed microphone state to an open microphone state.

5. The method according to claim 1, wherein The step of setting any device as a speaker device in response to a speaker mode activation operation triggered on any device and saving a speaker identifier of the speaker device includes: In response to a speaker mode activation operation triggered on the primary audio acquisition device, setting the primary audio acquisition device as the speaker device and displaying the microphone-on status of the primary audio acquisition device; The method further comprises: A third notification message is sent to the at least one slave audio collection device, where the third notification message includes the speaker identifier, which is used to indicate that a speaker mode is turned on, so that the at least one slave audio collection device displays a microphone-mute state according to the speaker identifier.

6. The method according to claim 5, characterized in that The method of setting the primary audio acquisition device as a primary audio acquisition device in response to a speaker mode activation operation triggered on the primary audio acquisition device and displaying a microphone-on status of the primary audio acquisition device includes: When the primary audio acquisition device is in the microphone-on state, in response to a first speaker mode activation operation triggered on the primary audio acquisition device, setting the primary audio acquisition device as the speaker device and maintaining the microphone-on state of the primary audio acquisition device; or When the primary audio acquisition device is in a closed-microphone state, in response to a second speaker mode activation operation triggered for the primary audio acquisition device, the primary audio acquisition device is set as a speaker device, and the closed-microphone state of the primary audio acquisition device is switched to an open-microphone state.

7. The method according to claim 1, characterized in that The method further comprises: In response to a speaker mode exit operation triggered for the master audio acquisition device, a fourth notification message is sent to the at least one slave audio acquisition device, where the fourth notification message is used to indicate the exit from the speaker mode, so that the at least one slave audio acquisition device switches from a closed microphone state to an open microphone state.

8. The method according to claim 4 or 7, characterized in that After exiting the speaker mode, the method further includes: If audio data collected by multiple devices are obtained, the multiple audio data are mixed to obtain mixed data; wherein the multiple devices include: the at least one slave audio collection device and part or all of the master audio collection device; The mixed audio data is transmitted to the terminal device for playback.

9. The method according to any one of claims 1-3, 5-6, characterized in that: The performing a preset operation on the at least one audio data to obtain the audio data to be transmitted includes: filtering out audio data other than the audio data collected by the main speaker device from the at least one audio data, and using the audio data collected by the main speaker device as the audio data to be transmitted; or The at least one audio data is a plurality of audio data, and in a process of mixing the plurality of audio data, the preset operation is performed to obtain the audio data to be transmitted; or The at least one audio data is a plurality of audio data. After the preset operation is performed on the plurality of audio data, the plurality of audio data after the operation are mixed to obtain the audio data to be transmitted.

10. An audio processing method, characterized in that: Applied to any one of at least one slave audio acquisition device, the at least one slave audio acquisition device being connected to the master audio acquisition device in a cascade manner, the method comprising: In response to a speaker mode activation operation triggered for any of the slave audio acquisition devices, sending a speaker activation request to the master audio acquisition device, wherein the speaker activation request includes a device identifier of any of the slave audio acquisition devices, so that the master audio acquisition device sets any of the slave audio acquisition devices as a speaker device and sets the device identifier of any of the slave audio acquisition devices to a speaker identifier; Audio data is collected, and the audio data carrying the device identification is sent to the master audio collection device, so that the master audio collection device determines that any slave audio collection device is the main speaker device based on the device identification.

11. The method according to claim 10, characterized in that The step of sending a speaker start request to the master audio acquisition device in response to a speaker mode start operation triggered on any slave audio acquisition device includes: When any of the slave audio acquisition devices is in the microphone-on state, in response to a third speaker mode start operation triggered for any of the slave audio acquisition devices, sending a speaker start request to the master audio acquisition device; or In a case where any of the slave audio acquisition devices displays a mute state, in response to a fourth speaker mode start operation triggered for any of the slave audio acquisition devices, a speaker start request is sent to the master audio acquisition device.

12. The method according to claim 10 or 11, characterized in that The method further comprises: In response to receiving a first notification message sent by the master audio acquisition device, the microphone-opening status of any of the slave audio acquisition devices is displayed according to the speaker identifier included in the first notification message; wherein the first notification message is used to indicate that the speaker mode is turned on.

13. The method according to claim 10 or 11, characterized in that The method further comprises: In response to a speaker mode exit operation triggered for any of the slave audio acquisition devices, sending an exit speaker request to the master audio acquisition device, so that the master audio acquisition device sends a second notification message to the at least one slave audio acquisition device; The second notification message is used to instruct exiting the speaker mode, so that the slave audio acquisition device other than any slave audio acquisition device switches from a closed microphone state to an open microphone state.

14. An audio processing device, characterized in that: Applied to a master audio acquisition device, the master audio acquisition device is connected to at least one slave audio acquisition device in a cascade manner, and the device includes: A setting unit, configured to, in response to a speaker mode activation operation triggered for any device, set the device as a speaker device and set a speaker identifier of the speaker device; wherein the device is the master audio acquisition device or the slave audio acquisition device; A screening unit, configured to, upon obtaining audio data collected by at least one device, screen out the speaker device from the at least one device based on the speaker identifier and the device identifier carried by each of the at least one audio data; wherein the at least one device includes: part or all of the at least one slave audio collection device and the master audio collection device; a processing unit, configured to perform a preset operation on the at least one audio data to obtain audio data to be transmitted; wherein the preset operation includes at least one of the following: enhancing the audio data collected by the main speaker device, and suppressing audio data other than the audio data collected by the main speaker device; The first transmission unit is configured to transmit the audio data to be transmitted to a terminal device for playback.

15. An audio processing device, characterized in that: Applicable to any one of at least one slave audio acquisition device, wherein the at least one slave audio acquisition device is connected to the master audio acquisition device in a cascade manner, the device comprises: a first sending unit, configured to, in response to a speaker mode start operation triggered for any of the slave audio acquisition devices, send a speaker start request to the master audio acquisition device, wherein the speaker start request includes a device identifier of any of the slave audio acquisition devices, so that the master audio acquisition device sets any of the slave audio acquisition devices as a speaker device, and stores the device identifier of any of the slave audio acquisition devices as a speaker identifier; The collecting unit is used to collect audio data and send the audio data carrying the speaker identification to the master audio collecting device, so that the master audio collecting device determines that any slave audio collecting device is the speaker device based on the device identification.

16. An electronic device, characterized in that: It includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the method according to any one of claims 1 to 9 or any one of claims 10 to 13.

17. A computer-readable storage medium, characterized in that The invention comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of the method according to any one of claims 1 to 9 or any one of claims 10 to 13.

18. A computer program product, characterized in that The method comprises a computer program stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device performs the steps of the method according to any one of claims 1 to 9 or any one of claims 10 to 13.

Images