A conference method and a conference device

Abstract

The application discloses a conference method and a conference device. The conference device is connected with a first device through a first connection mode and is connected with a second device through a second connection mode. The method comprises the following steps: receiving input audio of the first device and the second device; outputting the input audio of the first device or the input audio of the second device in the case that a mixing function is closed; and outputting the input audio of the first device and the input audio of the second device in the case that the mixing function is opened. Thus, the audio demand in a multi-audio-source application scenario can be met.

Description

Technical Field

[0001] This application relates to the field of audio technology, and more particularly to a conferencing method and conferencing equipment. Background Technology

[0002] With the rapid development of information technology, people's demand for audio information is increasing, and audio devices are becoming more and more diversified. In daily life, people often need to use multiple audio devices at the same time, such as mobile phones, tablets, and laptops.

[0003] However, traditional audio output can usually only process a single audio source and cannot meet the audio needs of multi-audio source application scenarios. Summary of the Invention

[0004] This application discloses a conferencing method and conferencing equipment. The conferencing equipment can output the input audio of a first device and / or the input audio of a second device according to actual needs, which is beneficial to meet the audio needs in multi-audio source application scenarios.

[0005] In a first aspect, embodiments of this application provide a conferencing method that can be applied to a conferencing device or a device compatible with the conferencing device (e.g., a device with a chip or processor located inside the conferencing device). The conferencing device is connected to a first device via a first connection method and to a second device via a second connection method. The method includes: receiving input audio from the first device and receiving input audio from the second device; when the mixing function is enabled, outputting the input audio from the first device and the input audio from the second device; and when the mixing function is disabled, outputting either the input audio from the first device or the input audio from the second device.

[0006] In this technical solution, the conferencing equipment can break the limitation of traditional equipment that can only output a single audio source. It can output the input audio of the first device and / or the input audio of the second device according to actual needs. For example, when the mixing function is enabled, the conferencing equipment can output multiple audio sources, which is beneficial to meet the audio needs in multi-audio source application scenarios and enrich the user's multimedia experience.

[0007] In one possible implementation, the first device connects to the first conference application, and the second device connects to the second conference application.

[0008] In this technical solution, when the first device connects to the first conference application, the conference device can send the input audio from the second device to the first conference application. And / or, when the second device connects to the first conference application, the conference device can send the input audio from the first device to the second conference application. This allows users to join the same conference through different conference applications, which improves the convenience and flexibility of the conference.

[0009] In one possible implementation, the method further includes: acquiring local audio; and sending target audio to a first conference application and / or a second conference application based on the input audio from the first device, the input audio from the second device, and the local audio.

[0010] In this technical solution, the conferencing equipment can select to perform one or more of the following to obtain the target audio, depending on the actual situation: mixing the input audio from at least one device with local audio; mixing the input audio from at least two devices; not mixing the input audio from any device; and not mixing the local audio. The conferencing equipment can also select which conferencing applications to send the target audio to, which helps improve the diversity of conferencing audio output and also helps protect user privacy.

[0011] In one possible implementation, the specific method for sending target audio to a first conference application and / or a second conference application based on the input audio of the first device, the input audio of the second device, and local audio can be: performing audio mixing processing based on the input audio of the first device and local audio to obtain a first target audio, and sending the first target audio to the second conference application; and / or performing audio mixing processing based on the input audio of the second device and local audio to obtain a second target audio, and sending the second target audio to the first conference application.

[0012] In this application, the first conference application and the second conference application belong to different conference platforms. If the embodiment of this application is not adopted, the user participating in the conference corresponding to the second conference application can only hear the local audio collected by the conference device and cannot hear the input audio of the first device. Similarly, the user participating in the conference corresponding to the first conference application can only hear the local audio collected by the conference device and cannot hear the input audio of the second device.

[0013] In this technical solution, the input audio and local audio of the first device are mixed to obtain the first target audio, which is then sent to the second conference application. The second conference application can use the first target audio as the audio collected by the second device. Furthermore, other devices connected to the second conference application can output the first target audio. In other words, users participating in the conference corresponding to the second conference application can hear both the local audio collected by the conference device and the input audio of the first device.

[0014] Similarly, the second target audio is obtained by mixing the input audio from the second device and the local audio, and then sent to the first conference application. The first conference application can use the second target audio as the audio collected by the first device. Furthermore, other devices connected to the first conference application can output the second target audio. In other words, users participating in the conference corresponding to the first conference application can hear both the local audio collected by the conference device and the input audio from the second device.

[0015] It is evident that this method enables multi-party meetings to be conducted through different meeting platforms, thereby improving the convenience and flexibility of multi-party meetings.

[0016] In one possible implementation, the specific method for sending target audio to the first conference application and / or the second conference application based on the input audio of the first device, the input audio of the second device, and local audio can be: sending the input audio of the first device to the second conference application; and / or sending the input audio of the second device to the first conference application.

[0017] In this technical solution, the conferencing equipment does not need to send the captured local audio to the conferencing application, which helps protect the privacy of the local users.

[0018] In one possible implementation, the conferencing device is also connected to a third device; the method further includes: receiving input audio from the third device; performing audio mixing based on the input audio from the first device, the input audio from the second device, and local audio to obtain a third target audio, and sending the third target audio to the third device; performing audio mixing based on the input audio from the first device and local audio to obtain a first target audio, including: performing audio mixing based on the input audio from the first device, the input audio from the third device, and local audio to obtain a first target audio; performing audio mixing based on the input audio from the second device and local audio to obtain a second target audio, including: performing audio mixing based on the input audio from the second device, the input audio from the third device, and local audio to obtain a second target audio.

[0019] This technical solution allows for the mixing of three audio channels from four audio streams to enable multi-party conferencing across different platforms, thus improving the convenience and flexibility of multi-party meetings. The input audio from the third device can include voice calls or music, allowing for the addition of background music or enabling participation via telephone.

[0020] In one possible implementation, the conferencing device includes a display screen, and the method further includes: displaying a settings interface on the display screen, the settings interface including a first device identifier and a second device identifier, the first device identifier being configured to enable the mixing function for the first device, and the second device identifier being configured to enable the mixing function for the second device.

[0021] In one possible implementation, the method further includes: outputting a first prompt message when the conferencing device is connected to at least two devices; receiving a first user operation in response to the first prompt message, the first user operation being used to enable the mixing function of the conferencing device for the first device and the second device, wherein the at least two devices include the first device and the second device.

[0022] In one possible implementation, the conferencing device is also connected to a fourth device via a third connection method; wherein the first connection method and the third connection method do not support simultaneous audio mixing; the method further includes: receiving a second user operation, the second user operation being used to enable the conferencing device's audio mixing function for the first device.

[0023] In one possible implementation, the first connection method is Bluetooth, and the third connection method is Wi-Fi 2.4G.

[0024] In one possible implementation, the method further includes: performing audio mixing processing based on the input audio of the first device and the input audio of the second device to obtain a fourth target audio, and outputting the fourth target audio.

[0025] In this technical solution, the conference equipment can play a fourth target audio, so that the user on the conference equipment side can hear both the input audio from the first device and the input audio from the second device.

[0026] In one possible implementation, the conferencing device connects to at least two devices. When the mixing function of the conferencing device is turned off, the method further includes: determining a target device among the at least two devices based on preset rules, wherein the target device is a first device or a second device.

[0027] In one possible implementation, the target device connects to the conferencing equipment based on a target connection link, and the preset rules include one or more of the following: among the established connection links between at least two devices and the conferencing equipment, the target connection link has the highest priority; the target connection link is the connection link most recently selected by the user; the target connection link is the connection link previously selected by the user.

[0028] In one possible implementation, the method further includes: receiving input audio from a fifth device; outputting a second prompt message to indicate whether to switch audio; receiving a third user operation in response to the second prompt message, outputting the input audio from the fifth device, and stopping the output of the input audio from the target device, the third user operation being used to confirm the audio switch.

[0029] Secondly, embodiments of this application provide an audio device, which includes units for implementing the method described in the first aspect.

[0030] Thirdly, embodiments of this application provide a conference device, which includes at least two communication interfaces and at least one processor; wherein, the at least two communication interfaces are used to connect the conference device to a first device via a first connection method, and the at least two communication interfaces are also used to connect the conference device to a second device via a second connection method; the at least one processor is used to run computer programs or instructions to perform the method described in the first aspect.

[0031] In one possible implementation, the conferencing device may further include a memory connected to the at least one processor; the memory is used to store computer programs or instructions; the at least one processor is specifically used to retrieve the computer programs or instructions from the memory and run the computer programs or instructions to perform the method described in the first aspect.

[0032] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program or computer instructions, which, when executed, cause a conference device to perform the method described in the first aspect.

[0033] Fifthly, embodiments of this application provide a computer program product including a computer program or instructions, which, when run on a conference device, causes the conference device to perform the method described in the first aspect. Attached Figure Description

[0034] Figure 1 This is a schematic diagram illustrating an application scenario applicable to an embodiment of this application;

[0035] Figure 2 This is a flowchart illustrating a meeting method provided in an embodiment of this application;

[0036] Figure 3 This is a flowchart illustrating another meeting method provided in an embodiment of this application;

[0037] Figure 4 This is a flowchart illustrating another meeting method provided in an embodiment of this application;

[0038] Figure 5 This is a schematic diagram of the settings interface for a mixing function provided in an embodiment of this application.

[0039] Figure 6A This is a schematic diagram of the settings interface of a mixing device provided in an embodiment of this application;

[0040] Figure 6B This is a schematic diagram of the settings interface of another mixing device provided in an embodiment of this application;

[0041] Figure 7 This is a schematic diagram of a display interface for a first prompt message provided in an embodiment of this application;

[0042] Figure 8 This is a schematic diagram of another display interface for the first prompt information provided in an embodiment of this application;

[0043] Figure 9 This is a schematic diagram of a third prompt information display interface provided in an embodiment of this application;

[0044] Figure 10 This is a schematic diagram of an input audio selection interface provided in an embodiment of this application;

[0045] Figure 11 This is a schematic diagram of a second prompt information display interface provided in an embodiment of this application;

[0046] Figure 12 This is a schematic diagram of a fourth prompt information display interface provided in an embodiment of this application;

[0047] Figure 13 This is a schematic diagram of the structure of an audio device provided in an embodiment of this application;

[0048] Figure 14 This is a schematic diagram of the structure of a conference device provided in an embodiment of this application. Detailed Implementation

[0049] The terms "first," "second," etc., used in the embodiments of this application are used to distinguish different objects, not to describe a specific order. "At least one" in the embodiments of this application refers to one or more, and "multiple" refers to two or more. "And / or" in the embodiments of this application describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the following three situations: A exists alone, A and B exist simultaneously, and B exists alone. Here, A and B can be singular or plural.

[0050] In the embodiments of this application, "at least one of the following" or similar expressions refer to any combination of these items, including any combination of a single item or a plurality of items. For example, at least one of a, b, or c can represent the following seven cases: a, b, c, a and b, a and c, b and c, a, b, and c. Each of a, b, and c can be an element or a set containing one or more elements.

[0051] The following describes the application scenarios applicable to the embodiments of this application. These application scenarios may include, but are not limited to, a conference device and N devices connected to the conference device, where N is an integer greater than or equal to 2.

[0052] The conference equipment may include a sound pickup component, a sound playback component, and a communication interface. A sound pickup component refers to a device or module used to collect sound signals. For example, a sound pickup component may include a microphone. A sound playback component refers to a device or module used to play and output sound signals. For example, a sound playback component may include, but is not limited to, speakers and headphones.

[0053] The communication interface enables the conferencing equipment to connect to N devices via wired and / or wireless connections. The communication interface may include, but is not limited to, a Universal Serial Bus (USB) interface, a High Definition Multimedia Interface (HDMI) interface, or wireless modules such as Wi-Fi and Bluetooth. The conferencing equipment connects to the N devices through different communication interfaces.

[0054] In this embodiment, the connection methods between different devices and the conferencing equipment can be the same or different. In this application, the connection methods can include wired connections and wireless connections. Wired connections may include, but are not limited to, Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), twisted pair, and fiber optic cables. Wireless connections may include, but are not limited to, Bluetooth, Wi-Fi, cellular mobile communication, and satellite communication. Wi-Fi connections include Wi-Fi 2.4G, Wi-Fi 5G, or other Wi-Fi connection methods. Other Wi-Fi connection methods refer to using radio waves in frequency bands other than 2.4GHz and 5GHz to achieve wireless connection between devices. Wi-Fi 2.4G refers to using radio waves in the 2.4GHz frequency band to achieve wireless connection between devices, and Wi-Fi 5G refers to using radio waves in the 5GHz frequency band to achieve wireless connection between devices.

[0055] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating an application scenario applicable to an embodiment of this application.

[0056] Figure 1 Taking N=2 as an example, where the N devices are designated as the first device, the second device, etc. Figure 1 As shown, the application scenario includes a conference device (10), a first device (11), and a second device (12).

[0057] The conference equipment connects to a first device via a first connection method and to a second device via a second connection method. The first and second connection methods can be different or the same. For example, both the first and second connection methods can be USB connections; the conference equipment connects to the first device via USB interface 1 and to the second device via USB interface 2. Another example is that the first connection method is Bluetooth, and the second connection method is USB.

[0058] like Figure 1 As shown, the first device is connected to the conference equipment via connection link L1, and the second device is connected to the conference equipment via connection link L2. Connection link L1 is established using a first connection method, and connection link L2 is established using a second connection method.

[0059] In one possible implementation, a device connected to the conferencing equipment can install at least one audio application. This audio application can output audio data or receive audio data input. The audio application can include, but is not limited to, conferencing applications, call applications, music applications, and other similar applications. Taking a device connected to the conferencing equipment (e.g., device a) as an example, the conferencing equipment can act as a peripheral device of device a. The conferencing equipment can receive input audio from device a, which may include audio data output by device a's audio application. The conferencing equipment can output this input audio, and / or, the conferencing equipment can send audio acquired through a microphone to device a, which can then use this audio as input audio data for its audio application. For example, if device a has a conferencing application installed and connected, device a can send audio data from the conferencing application to the conferencing equipment, which will then play the audio data. Alternatively, the conferencing equipment can send audio acquired through a microphone to device a, which can then use this audio as input audio data for its conferencing application.

[0060] In one possible implementation, at least two of the N devices can access conferencing applications on different conferencing platforms. Taking a single device as an example, accessing a conferencing application (e.g., conferencing application a) means that the device accesses the conferencing platform corresponding to conferencing application a through conferencing application a to participate in the conferencing process.

[0061] In one possible implementation, a first device has installed and connected to a first conference application, which belongs to conference platform a. The first device can transmit audio from the first conference application to the conference device via connection link L1. The conference device can be used to send the captured audio to both the first and second conference applications. That is, when the first device connects to the first conference application, the conference device can act as a peripheral device for the first device, used to capture the audio of the user on its end during the conference. When the second device connects to the first conference application, the conference device can act as a peripheral device for the second device, used to capture the audio of the user on its end during the conference. In this way, the user's audio can be transmitted to both the first and second conference applications simultaneously, allowing users to join the same conference through different conference applications, thus improving the convenience and flexibility of the conference.

[0062] In one possible implementation, the second device has installed and connected to a second conference application, which is a conference application of conference platform b. The second device can transmit the audio of the second conference application to the conference device through the connection link L2.

[0063] In one possible implementation, Figure 1 The application scenario shown can also include a third device (13), which is connected to the conference equipment via connection link L3 and has an audio application installed. When the audio application is a call application, the third device can transmit call voice to the conference equipment via connection link L3. When the audio application is a music application, the third device can transmit music generated by the music application to the conference equipment via connection link L3.

[0064] In one possible implementation, in addition to the first device, there may be at least one other device that is also connected to the first conference application and participates in the same conference as the first device. Figure 1 Taking at least one device as device A(14) as an example. Figure 1 As shown, device A is connected to the first device via connection link L4.

[0065] In one possible implementation, in addition to the second device, there may be at least one other device that is also connected to the second conferencing application and participates in the same conference as the second device. Figure 1 Taking the at least one device including device B1 (15) and device B2 (16) as an example. Figure 1 As shown, device B1 is connected to the second device via connection link L5, and device B2 is connected to the second device via connection link L6.

[0066] The connection methods for links L4, L5, and L6 can be the same or different. Connection methods can include wired and wireless connections, as described above.

[0067] In this embodiment of the application, a device can provide online meeting services to one or more users through the meeting application of an accessed meeting platform. For example, such as... Figure 1 As shown, the first device provides online meeting services to its local users through a first meeting application. The second device provides online meeting services to its local users through a second meeting application. Device A provides online meeting services to users in area A through the first meeting application. Device B1 provides online meeting services to users in area B1 through the second meeting application. Device B2 provides online meeting services to users in area B2 through the second meeting application. Each user can include at least one user locally, at least one user in area A, at least one user in area B1, and at least one user in area B2.

[0068] The embodiments of this application are as follows: Figure 1 The deployment locations of the devices shown are not limited. In one possible implementation, Figure 1 One or more of the following devices shown—the conference equipment, the first device, the second device, the third device, device A, device B1, and device B2—can be deployed in the same area (such as the same building or the same room). For example, Figure 1 The conference equipment shown, the first equipment, and the second equipment can be deployed in the same area, while the third equipment, equipment A, equipment B1, and equipment B2 can be deployed in different areas.

[0069] Figure 1 The number, form, and connection method of the devices shown are for illustrative purposes only and do not constitute a limitation on the embodiments of this application. In actual applications, the conferencing equipment can connect to more devices, and the number of conferencing applications accessing the same conferencing platform can be even greater.

[0070] The devices involved in the embodiments of this application (such as conference equipment, first device, second device, third device, device A, device B1, device B2) may be in the form of, but are not limited to, tablet computers, desktop computers, laptop computers, all-in-one computers, mobile phones, wearable devices, speakers or other terminal devices.

[0071] It is understood that the application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. Those skilled in the art will know that with the evolution of technology and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0072] The following describes the meeting method proposed in the embodiments of this application. The meeting method can be executed by a meeting device or by a device that matches the meeting device (such as a device with a chip or processor placed inside the meeting device). The embodiments of this application illustrate the meeting method as being executed by a meeting device.

[0073] The conference equipment connects to a first device via a first connection method and to a second device via a second connection method. The conference equipment can be... Figure 1 The conference equipment 10 shown can be a first device. Figure 1 The first device 11 shown, the second device can be Figure 1 The second device 12 shown.

[0074] Please see Figure 2 , Figure 2 This is a flowchart illustrating a conferencing method provided in an embodiment of this application. It mainly describes how conferencing equipment can break the limitation of traditional equipment that can only output a single audio source, and can output the input audio of a first device and / or the input audio of a second device according to actual needs. For example... Figure 2 As shown, this meeting method may include, but is not limited to, the following steps.

[0075] S201: The first device sends its input audio to the conference device. Correspondingly, the conference device receives the input audio from the first device.

[0076] The first device can be accessed Figure 1 The connection link L1 shown sends the input audio of the first device to the conference equipment.

[0077] The input audio of the first device can be the audio generated or received by the audio application of the first device. In other words, the first device can use the audio generated or received by the audio application of the first device as the input audio of the first device and transmit it to the conferencing equipment.

[0078] Taking an audio application as an example of a conferencing application, assuming the first device connects to the first conferencing application, the input audio of the first device can be the audio received by the first conferencing application on the first device. In other words, the first device can use the audio received by the first conferencing application on the first device as its input audio and transmit it to the conferencing equipment. For example, the input audio of the first device can be collected by device A and transmitted to the first device via connection link L4, or in other words, the input audio of the first device can be collected by device A and transmitted to the first conferencing application on the first device via connection link L4. The audio collected by device A (i.e., the input audio of the first device) can include the voice of users in area A.

[0079] For example, in the case of an audio application like a calling application, a first device can use the calling application to communicate with another device (e.g., device Z). The input audio of the first device can be captured by device Z and transmitted to the first device; or, in other words, the input audio of the first device can be captured by device Z and transmitted to the first device's calling application. In this case, the audio captured by device Z (i.e., the input audio of the first device) can include the voice of the call. The calling application can be a cellular calling application or an internet calling application.

[0080] For example, if the audio application is a music application, the input audio of the first device can be generated by the music application on the first device. In this case, the input audio of the first device can include music.

[0081] S202: The second device sends its input audio to the conference device. Correspondingly, the conference device receives the input audio from the second device.

[0082] The second device can be accessed via Figure 1 The connection link L2 shown sends the input audio from the second device to the conference equipment.

[0083] The input audio of the second device can be the audio generated or received by the audio application of the second device. In other words, the second device can use the audio generated or received by the audio application of the second device as the input audio of the second device and transmit it to the conferencing equipment.

[0084] Taking an audio application as an example of a conferencing application, assuming a second device connects to a second conferencing application, the input audio of the second device can be the audio received by the second conferencing application on the second device. That is, the second device can use the audio received by the second conferencing application on the second device as its input audio and transmit it to the conferencing device. For example, the input audio of the second device can include: audio collected by device B1 and transmitted to the second device via connection link L5, and audio collected by device B2 and transmitted to the second device via connection link L6. Alternatively, the input audio of the second device can include: audio collected by device B1 and transmitted to the second conferencing application on the second device via connection link L5, and audio collected by device B2 and transmitted to the second conferencing application on the second device via connection link L6. The audio collected by device B1 can include the voice of users in area B1, and the audio collected by device B2 can include the voice of users in area B2; that is, the input audio of the second device can include the voices of users in areas B1 and B2.

[0085] For example, the audio application could be a calling application. A second device can use this application to communicate with another device (e.g., device Y). The input audio of the second device can be captured by device Y and transmitted to the second device; or, in other words, the input audio of the second device can be captured by device Y and transmitted to the second device's calling application. In this case, the audio captured by device Y (i.e., the input audio of the second device) can include the voice of the call. The calling application can be a cellular calling application or an internet calling application.

[0086] S203: When the mixing function is enabled, the conference equipment outputs the input audio of the first device and the input audio of the second device; when the mixing function is disabled, the conference equipment outputs the input audio of the first device or the input audio of the second device.

[0087] In one possible implementation, the conferencing equipment can enable or disable the mixing function as needed.

[0088] Disabling the mixing function on the conferencing equipment means that the equipment does not perform audio mixing. In this case, even if the conferencing equipment receives input audio from multiple devices, it will only output the input audio from one of those devices. For example, if the conferencing equipment receives input audio from a first device and input audio from a second device, with the mixing function disabled, the conferencing equipment will output either the first device's input audio or the second device's input audio; that is, it will only output the input audio from one device.

[0089] Enabling the mixing function on a conference device indicates that the device supports mixing input audio from at least two devices. This can also be described as: the device supports enabling the mixing function for those at least two devices.

[0090] The fact that a conferencing device supports mixing input audio from at least two devices means that the device has the capability to mix input audio from at least two devices. In practice, a conferencing device with its mixing function enabled may or may not perform this function.

[0091] Enabling device-specific mixing functionality on a conference device means that after receiving input audio from that device, the conference device can mix that device's input audio with other audio. Disabling device-specific mixing functionality means that even if the conference device receives input audio from that device, it will not mix that device's input audio.

[0092] The conferencing equipment receives input audio from a first device and input audio from a second device. With the mixing function enabled, the conferencing equipment outputs the input audio from the first device and the input audio from the second device. Specific implementations may include one or more of the following:

[0093] The conferencing equipment sends the input audio from the first device to the second device;

[0094] The conferencing equipment sends a first target audio to the second equipment. The first target audio is obtained by mixing the input audio from the first equipment and the local audio collected by the conferencing equipment.

[0095] The conferencing equipment sends the input audio from the second device to the first device;

[0096] The conferencing equipment sends a second target audio to the first equipment. The second target audio is obtained by mixing the input audio from the second equipment and the local audio collected by the conferencing equipment.

[0097] The conference equipment outputs a fourth target audio through the audio playback component. The fourth target audio is obtained by mixing the input audio from the first device and the input audio from the second device.

[0098] As can be seen, this method allows conferencing equipment to break free from the traditional limitation of outputting only a single audio source. It can output input audio from a first device and / or a second device, depending on actual needs. For example, with the mixing function enabled, the conferencing equipment can output multiple audio streams. For details regarding the first, second, and fourth target audio sources, please refer to [link to relevant documentation]. Figure 3 Specific descriptions in the corresponding embodiments.

[0099] In one possible implementation, when the first device connects to the first conference application, the conference device can send the input audio from the second device to the first conference application. And / or, when the second device connects to the first conference application, the conference device can send the input audio from the first device to the second conference application. This allows users to join the same conference through different conference applications, improving the convenience and flexibility of the meeting.

[0100] In one possible implementation, the conferencing equipment can also capture audio via a microphone component; optionally, the conferencing equipment can capture audio in real time via the microphone component. In one possible implementation... Figure 1 The local user shown can include one or more users; in other words, the audio collected by the conferencing equipment through the microphone can include the audio data of one or more users.

[0101] In one possible implementation, the local audio collected by the conferencing device may include all audio data collected by the conferencing device through its microphone component, or the local audio may include a portion of the audio data collected by the conferencing device through its microphone component. This portion of audio data may include the audio data of some users on the local end. In another possible implementation, the local audio may include the audio data of a specific local user (hereinafter referred to as the target user) collected by the conferencing device through its microphone component. For example, when multiple people are speaking on the conferencing device's local end, the conferencing device may use only the audio of a primary speaker as the local audio.

[0102] In one possible implementation, the target user can be a user with specific voiceprint characteristics, or the target user can be selected by the user. After acquiring audio data from multiple users through the sound pickup component, the conferencing equipment can identify the target audio (i.e., the target user's audio data) from the audio data of multiple users based on voiceprint recognition technology.

[0103] In one possible implementation, the local audio can be obtained after audio preprocessing. After the conferencing equipment acquires audio through the microphone, it can preprocess the acquired audio to obtain the local audio. Preprocessing can include, but is not limited to, denoising, Voice Activity Detection (VAD), and pre-emphasis. Denoising removes environmental noise (such as wind noise, traffic noise, etc.), improving the signal-to-noise ratio. VAD can distinguish between speech segments and non-speech segments (such as silence or noise segments) in the audio, helping to reduce the computational load in subsequent processing and improve processing efficiency. Pre-emphasis can boost the energy of high-frequency components for easier subsequent processing.

[0104] In one possible implementation, the conferencing device can send target audio to a first conferencing application and / or a second conferencing application based on the input audio from a first device, the input audio from a second device, and local audio. The target audio can include one or more of the audio data from the first device, the second device, and the local audio. For example, the target audio can include a first target audio, a second target audio, a third target audio, a fourth target audio, etc. For details regarding the first target audio, second target audio, third target audio, and fourth target audio, please refer to [link to relevant documentation]. Figure 3 The description in the corresponding embodiment.

[0105] In this way, the conferencing equipment can choose to perform one or more of the following to obtain the target audio, depending on the actual situation: mixing the input audio from at least one device with local audio; mixing the input audio from at least two devices; not mixing the input audio from any device; and not mixing the local audio. The conferencing equipment can also select which conferencing applications to send the target audio to, which improves the diversity of the conferencing audio output and also helps protect user privacy.

[0106] Sending target audio to a first conferencing application means that the conferencing device sends the target audio to the first conferencing application on the first device. In other words, the target audio is data specifically sent to the first conferencing application on the first device, rather than data sent to other applications on the first device. In this case, after receiving the target audio, the first device can transmit the target audio to the first conferencing application, not to other applications. Similarly, sending target audio to a second conferencing application means that the conferencing device sends the target audio to the second conferencing application on the second device. In other words, the target audio is data specifically sent to the second conferencing application on the second device, rather than data sent to other applications on the second device. In this case, after receiving the target audio, the second device can transmit the target audio to the second conferencing application, not to other applications.

[0107] It should be noted that the target audio sent by the conferencing device to the first conferencing application may or may not be the same as the target audio sent by the conferencing device to the second conferencing application.

[0108] For example, if the target audio sent by the conferencing device to the first conferencing application includes local audio, and the target audio sent by the conferencing device to the second conferencing application also includes local audio, then the target audio sent by the conferencing device to the first conferencing application is the same as the target audio sent to the second conferencing application.

[0109] For example, if the target audio sent by the conferencing device to the first conferencing application includes the input audio from the second device, and the target audio sent by the conferencing device to the second conferencing application includes the input audio from the first device, then the target audio sent by the conferencing device to the first conferencing application is different from the target audio sent to the second conferencing application. In this way, the conferencing device can avoid sending the captured local audio to the conferencing application, which helps protect the privacy of the local user.

[0110] For example, if the target audio sent by the conferencing device to the first conferencing application includes the second target audio, and the target audio sent by the conferencing device to the second conferencing application includes the first target audio, then the target audio sent by the conferencing device to the first conferencing application is different from the target audio sent to the second conferencing application.

[0111] As can be seen, by implementing the embodiments of this application, the conference equipment can break the limitation of traditional equipment that can only output a single audio source, and can output the input audio of the first device and / or the input audio of the second device according to actual needs. For example, when the mixing function is off, the conference equipment can output one audio channel. When the mixing function is on, the conference equipment can output multiple audio channels, which is beneficial to meeting the audio needs in multi-audio source application scenarios and enriching the user's multimedia experience.

[0112] Please see Figure 3 , Figure 3 This is a flowchart illustrating another conferencing method provided in an embodiment of this application. It mainly describes how the conferencing device mixes three audio streams in pairs when a first device is connected to a first conferencing application and a second device is connected to a second conferencing application. The three audio streams include the input audio from the first device, the input audio from the second device, and the local audio collected by the conferencing device. Figure 3 As shown, this meeting method may include, but is not limited to, the following steps.

[0113] S301: The first device sends its input audio to the conference device. Correspondingly, the conference device receives the input audio from the first device.

[0114] The input audio for the first device can be the audio received by the first conferencing application on the first device.

[0115] For details regarding S301, please refer to [link / reference]. Figure 2 The detailed description in S201 of the corresponding embodiment will not be repeated here.

[0116] S302: The second device sends its input audio to the conference device. Correspondingly, the conference device receives the input audio from the second device.

[0117] The input audio for the second device can be the audio received by the second conferencing application on the second device.

[0118] For details regarding S302, please refer to [link / reference]. Figure 2 The detailed description in S202 of the corresponding embodiment will not be repeated here.

[0119] S303: When the mixing function is enabled, the conference equipment performs mixing processing based on the input audio of the first device and the local audio collected by the conference equipment to obtain the first target audio.

[0120] When the mixing function is enabled, after the conferencing equipment receives the input audio from the first device and the input audio from the second device, it can perform mixing processing based on the input audio from the first device and the local audio to obtain the first target audio.

[0121] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio of the first device, so that after compensation, the input audio of the first device and the local audio are in the same time reference system during mixing.

[0122] S304: When the mixing function is enabled, the conference equipment performs mixing processing based on the input audio of the second device and the local audio collected by the conference equipment to obtain the second target audio.

[0123] When the mixing function is enabled, after the conferencing equipment receives the input audio from the first device and the input audio from the second device, it can perform mixing processing based on the input audio from the second device and the local audio to obtain the second target audio.

[0124] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio of the second device, so that after compensation, the input audio of the second device and the local audio are in the same time reference system during mixing.

[0125] It should be noted that the execution order of S303 and S304 is not limited in this embodiment. For example, the conferencing device may execute S303 first; or, the conferencing device may execute S304 first; or, the conferencing device may execute S303 and S304 simultaneously.

[0126] S305: The conferencing device sends the first target audio to the second conferencing application. Correspondingly, the second device receives the first target audio, and the second conferencing application of the second device acquires the first target audio.

[0127] After the conferencing equipment receives the first target audio, it can... Figure 1 The connection link L2 shown sends the first target audio to the second conferencing application of the second device.

[0128] The message "The conferencing device sends the first target audio to the second conferencing application of the second device" means that the first target audio is data specifically sent to the second conferencing application of the second device, rather than data sent to other applications of the second device. In other words, after receiving the first target audio, the second device transmits the first target audio to the second conferencing application instead of other applications.

[0129] After acquiring the first target audio, the second conferencing application can use it as the audio captured by the second device. Furthermore, other devices connected to the second conferencing application can output this first target audio. In other words, users participating in the meeting corresponding to the second conferencing application can hear both the local audio captured by the conferencing device and the input audio from the first device. The input audio from the first device can include... Figure 1The voices of users in Zone A mean that users participating in the second meeting application can hear both the voices of their own users and the voices of users in Zone A.

[0130] S306: The conferencing device sends the second target audio to the first conferencing application. Correspondingly, the first device receives the second target audio, and the first conferencing application of the first device acquires the second target audio.

[0131] After the conferencing equipment receives the second target audio, it can... Figure 1 The connection link L1 shown sends the second target audio to the first conferencing application of the first device.

[0132] The message "The conferencing device sends the second target audio to the first conferencing application of the first device" means that the second target audio is data specifically sent to the first conferencing application of the first device, rather than data sent to other applications of the first device. In other words, after receiving the second target audio, the first device transmits the second target audio to the first conferencing application instead of other applications.

[0133] After the first conference application acquires the second target audio, it can use the second target audio as the audio captured by the first device. Furthermore, other devices connected to the first conference application can output this second target audio. In other words, users participating in the conference corresponding to the first conference application can hear both the local audio captured by the conference device and the input audio from the second device. The input audio from the second device can include... Figure 1 The voices of users in Zone B1 and Zone B2 can be heard. In other words, users participating in the first meeting application can hear the voices of their own users, as well as the voices of users in Zone B1 and Zone B2.

[0134] It should be noted that, Figure 3 The example shown, where the conferencing device generates both a first target audio and a second target audio, is merely an example and does not constitute a limitation on the embodiments of this application. In other possible implementations, the conferencing device may generate only one of the first target audio or the second target audio, and correspondingly, the conferencing device may only send the generated target audio to one of the first or second devices. That is, the conferencing device may not execute S303 and S305, or the conferencing device may not execute S304 and S306.

[0135] As can be seen, by implementing the embodiments of this application, users in area A, area B1, area B2, and the local user can be connected to achieve cross-conference platform meetings. In other words, multi-party meetings can be achieved through different conference platforms, which improves the convenience and flexibility of multi-party meetings. Without the embodiments of this application, users participating in the meeting corresponding to the second conference application (i.e., users in area B1 and area B2) can only hear the local audio collected by the conference equipment (i.e., the local user's voice) and cannot hear the input audio of the first device (i.e., the voice of users in area A). Similarly, users participating in the meeting corresponding to the first conference application (i.e., users in area A) can only hear the local audio collected by the conference equipment (i.e., the local user's voice) and cannot hear the input audio of the second device (i.e., the voices of users in area B1 and area B2).

[0136] In one possible implementation, after the conferencing device receives the input audio from the first device and the second device, it can also execute step S307. Step S307 is optional; that is, the conferencing device can execute step S307 or not.

[0137] S307: When the mixing function is enabled, the conference equipment performs mixing processing based on the input audio of the first device and the input audio of the second device to obtain the fourth target audio and output the fourth target audio.

[0138] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio of the first device and the input audio of the second device, so that after compensation, the input audio of the first device and the input audio of the second device are in the same time reference system during mixing.

[0139] The fourth target audio output method of the conference equipment may include, but is not limited to: speaker output, headphone output, audio interface output, and HDMI output. Among them, the audio interface and HDMI are used to connect to the sound system, television, or other conference equipment.

[0140] As can be seen, by playing a fourth target audio, the conferencing equipment allows the local user to hear both the input audio from the first device and the input audio from the second device. The input audio from the first device may include... Figure 1 The voice of the user in Zone A, the input audio of the second device can include Figure 1 The voices of users in zone B1 and zone B2 can be heard. In other words, the user on this end can hear the voices of users in zone A, zone B1, and zone B2.

[0141] It should be noted that the execution order of S303, S304, and S307 is not limited in the embodiments of this application. For example, the conferencing device may execute S307 first; or, the conferencing device may execute S307 after S303; or, the conferencing device may execute S307 after S304; or, the conferencing device may execute S303, S304, and S307 simultaneously.

[0142] By implementing the embodiments of this application, multi-party meetings can be achieved through different meeting platforms, which helps to improve the convenience and flexibility of multi-party meetings.

[0143] It should be noted that when the conferencing equipment is connected to N devices, there can be N+1 audio channels. Each of the N devices inputs its own audio channel, and the conferencing equipment can also capture one local audio channel. In this case, the conferencing equipment can mix every N audio channels out of the N+1 channels and transmit the mixed audio to the corresponding device. For simplicity, the following example uses N=3 to illustrate mixing every 3 audio channels out of four.

[0144] The conference equipment connects to three devices: Device 1, Device 2, and Device 3. Device 1 connects to a first conference application, Device 2 connects to a second conference application, and Device 3 includes an audio application. Details regarding the audio application can be found in the preceding description. The conference equipment can be... Figure 1 The conference equipment 10 shown can be a first device. Figure 1 The first device 11 shown can be used for the first conference application. Figure 1 The first conference application shown.

[0145] The second device can be Figure 1 The second device 12 shown can be used for the second conference application. Figure 1 The second meeting application is shown.

[0146] The third device can be Figure 1 The third device 13 shown can be used for audio applications. Figure 1 The audio application shown.

[0147] Please see Figure 4 , Figure 4 This is a flowchart illustrating another conferencing method provided in an embodiment of this application, mainly describing the mixing of three audio channels out of four audio channels. For example... Figure 4 As shown, this meeting method may include, but is not limited to, the following steps.

[0148] S401: The first device sends its input audio to the conference device. Correspondingly, the conference device receives the input audio from the first device.

[0149] S402: The second device sends its input audio to the conference device. Correspondingly, the conference device receives the input audio from the second device.

[0150] For details on the execution process of S401 and S402, please refer to [link / reference]. Figure 3 The specific descriptions in S301 and S302 of the corresponding embodiments will not be repeated here.

[0151] S403: The third device sends its input audio to the conference equipment. Correspondingly, the conference equipment receives the input audio from the third device.

[0152] The third device can... Figure 1 The connection link L3 shown sends the input audio from the third device to the conference equipment.

[0153] The input audio of the third device can be audio generated or received by the audio application of the third device. In other words, the third device can use the audio generated or received by the audio application of the third device as the input audio of the third device and transmit it to the conferencing equipment.

[0154] For example, the audio application is a calling application. A third device can use the calling application to make a call with another device (such as device C). The input audio of the third device can be captured by device C and transmitted to the third device. In other words, the input audio of the third device can be captured by device C and transmitted to the calling application of the third device. In this case, the audio captured by device C (i.e., the input audio of the third device) can include the voice of the call. The calling application can be a cellular calling application or an internet calling application.

[0155] For example, if the audio application is a music application, the input audio from the third device can be generated by the music application on the third device. In this case, the input audio from the third device can include music.

[0156] S404: When the mixing function is enabled, the conference equipment performs mixing processing based on the input audio of the first device, the input audio of the third device, and the local audio collected by the conference equipment to obtain the first target audio.

[0157] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio of the first device and the input audio of the third device, so that after compensation, the input audio of the first device, the input audio of the third device, and the local audio are in the same time reference system during mixing.

[0158] S405: When the mixing function is enabled, the conference equipment performs mixing processing based on the input audio from the second device, the input audio from the third device, and the local audio collected by the conference equipment to obtain the second target audio.

[0159] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio from the second device and the third device, so that after compensation, the input audio from the second device, the input audio from the third device, and the local audio are all in the same time reference frame during mixing.

[0160] S406: The conferencing device sends the first target audio to the second conferencing application. Correspondingly, the second device receives the first target audio, and the second conferencing application of the second device acquires the first target audio.

[0161] After acquiring the first target audio, the second conferencing application can use it as the audio captured by the second device. Furthermore, other devices connected to the second conferencing application can output this first target audio. In other words, users participating in the meeting corresponding to the second conferencing application can hear not only the local audio captured by the conferencing device, but also the input audio from the first device and the input audio from the third device. The input audio from the first device can include... Figure 1 The audio input from the third device can include voice calls or music generated by a music application. This means that users participating in the meeting using the second meeting application can hear their own voice, the voices of users in area A, and voice calls. Alternatively, users participating in the meeting using the second meeting application can hear their own voice, the voices of users in area A, and music generated by a music application. This allows for the insertion of background music into the meeting, enhancing its engagement.

[0162] For further information on S406, please refer to [link / reference]. Figure 3 The specific description in S305 of the corresponding embodiment will not be repeated here.

[0163] S407: The conferencing device sends the second target audio to the first conferencing application. Correspondingly, the first device receives the second target audio, and the first conferencing application of the first device acquires the second target audio.

[0164] After the first conference application acquires the second target audio, it can use the second target audio as the audio captured by the first device. Furthermore, other devices connected to the first conference application can output this second target audio. In other words, users participating in the conference corresponding to the first conference application can hear not only the local audio captured by the conference device, but also the input audio from the second device and the input audio from the third device. The input audio from the second device can include... Figure 1The audio input from the third device can include the voices of users in Zone B1 and Zone B2, and can also include voice calls or music generated by a music application. This means that users participating in the meeting using the first conference application can hear their own voice, as well as the voices of users in Zones B1 and B2, and the voice calls. Alternatively, users participating in the meeting using the first conference application can hear their own voice, as well as the voices of users in Zones B1 and B2, and music generated by a music application. This allows for the insertion of background music into the meeting, enhancing its engagement.

[0165] For further information on S407, please refer to [link / reference]. Figure 3 The specific description in S306 of the corresponding embodiment will not be repeated here.

[0166] In one possible implementation, after the conferencing device receives the input audio from the first device, the input audio from the second device, and the acquired local audio, it can also execute steps S408-S409, which are optional steps.

[0167] S408: When the mixing function is enabled, the conference equipment performs mixing processing based on the input audio of the first device, the input audio of the second device, and the local audio collected by the conference equipment to obtain the third target audio.

[0168] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio of the first device and the input audio of the second device, so that after compensation, the input audio of the first device, the input audio of the second device, and the local audio are in the same time reference system during mixing.

[0169] S409: The conferencing equipment sends a third target audio signal to the third device. Correspondingly, the third device receives the third target audio signal.

[0170] After the conferencing equipment receives the audio from the third target, it can... Figure 1 The connection link L3 shown sends third target audio to the third device.

[0171] In one possible implementation, after receiving the third target audio, the third device can output the third target audio.

[0172] In one possible implementation, the conferencing device can send third target audio to the audio application of a third device. Sending third target audio to the audio application of a third device means that the third target audio is data specifically sent to the audio application of the third device, rather than data sent to other applications on the third device. In other words, after receiving the third target audio, the third device transmits the third target audio to that audio application, not to other applications.

[0173] In one possible implementation, when the audio application is a call application, after the call application of the third device acquires the third target audio, it can use the third target audio as the audio collected by the second device. Furthermore, other devices connected to the call application (i.e., device C) can output this third target audio. Device C is the device that conducts a call with the third device through the call application. In other words, the user participating in the call (i.e., the user corresponding to device C) can hear both the local audio collected by the conferencing device and the input audio from the first and second devices. That is, the user participating in the call can hear the voice of their own device, as well as the voices of users in areas A, B1, and B2.

[0174] As can be seen, by implementing the embodiments of this application, on the one hand, cross-conference platform meetings can be realized, and on the other hand, background music can be added to the meeting or participants can participate in the meeting by telephone. In this way, multi-party meetings can be realized through different conference platforms or even call applications, which is conducive to improving the convenience and flexibility of multi-party meetings.

[0175] In one possible implementation, if the audio application is a music application, the conferencing device may not execute S408-S409. That is, if the audio application is a music application, the third device is used to provide background music for the meeting, and the conferencing device does not need to send audio to the third device.

[0176] It should be noted that the execution order of S404, S405, and S408 is not limited in this embodiment.

[0177] In one possible implementation, after the conferencing device receives the input audio from the first device, the second device, and the third device, it can also execute step S410, which is an optional step.

[0178] S410: The conference equipment performs audio mixing based on the input audio from the first device, the input audio from the second device, and the input audio from the third device to obtain the fourth target audio, and outputs the fourth target audio.

[0179] Before mixing, the conferencing equipment can use its system time as a reference (i.e., a reference clock) to calculate and compensate for the audio time deviation of the input audio from the first device, the second device, and the third device, so that after compensation, the input audio from the first device, the second device, the third device, and the local audio are all in the same time reference frame during mixing.

[0180] For further information on the S410, please refer to [link / reference]. Figure 3The specific description in S307 of the corresponding embodiment will not be repeated here.

[0181] As can be seen, by playing a fourth target audio source, the conferencing equipment allows users on the conferencing equipment side to hear the input audio from the first, second, and third devices. In other words, the user on their end can hear the voices of users in area A, as well as users in areas B1 and B2, along with the call audio. Alternatively, the user on their end can hear the voices of users in area A, B1, and B2, along with music generated by a music application. This allows for the insertion of background music into the meeting, enhancing its engagement and enjoyment.

[0182] It should be noted that the execution order of S404, S405, S408, and S410 is not limited in this embodiment.

[0183] By implementing the embodiments of this application, on the one hand, cross-conference platform meetings can be realized, and on the other hand, background music can be added to multi-party meetings or participants can participate in multi-party meetings by telephone. In this way, multi-party meetings can be realized through different conference platforms or even call applications, which helps to improve the convenience and flexibility of multi-party meetings.

[0184] In one possible implementation, when the conferencing device is connected to at least two devices, it can receive a specific user operation to activate the device's mixing function. For example, the conferencing device may include a display screen showing a settings interface for the mixing function, which may include a power button for the mixing function. When at least two devices are connected, the conferencing device can receive a user's activation operation on the power button to activate the mixing function. A schematic diagram of the mixing function's settings interface can be shown below. Figure 5 As shown, Figure 5 The switch button is in the ON position, meaning the mixing function of the conference equipment is enabled.

[0185] Optionally, if the number of devices connected to the conference equipment is less than two, the conference equipment can still receive user activation commands for the switch button. Alternatively, if the number of devices connected to the conference equipment is less than two, the user cannot perform an activation command for the switch button, and the conference equipment will not be able to receive such commands.

[0186] In one possible implementation, when the conference equipment has its mixing function enabled, it can display a settings interface on its screen. This interface includes device identifiers for each device connected to the conference equipment. The conference equipment can receive selections from the user for at least two of these device identifiers, which enable the mixing function for at least two devices corresponding to those identifiers. Each device identifier uniquely identifies a device connected to the conference equipment.

[0187] Taking a mixing device's settings interface as an example, which includes two device identifiers, designated as a first device identifier and a second device identifier, the first device identifier identifies the first device, and the second device identifier identifies the second device. Assuming the conferencing device receives a selection operation for both the first and second device identifiers, it can enable the mixing function for both devices. In this case, the first device identifier is set to enable the mixing function for the first device, and the second device identifier is set to enable the mixing function for the second device.

[0188] A schematic diagram of the mixing device's settings interface can be shown as follows: Figure 6A As shown, Figure 6A In the settings interface shown, the area corresponding to the first device identifier is filled in gray, indicating that the first device identifier is set to enable the mixing function for the first device. Similarly, the area corresponding to the second device identifier is filled in gray, indicating that the second device identifier is set to enable the mixing function for the second device.

[0189] Another diagram of the mixing device settings interface can be seen as follows: Figure 6B As shown, Figure 6B In the settings interface shown, the checkbox corresponding to the first device identifier is selected, indicating that the first device identifier is set to enable the mixing function for the first device. Similarly, the checkbox corresponding to the second device identifier is selected, indicating that the second device identifier is set to enable the mixing function for the second device.

[0190] In this way, users can see which devices' input audio is involved in the mixing process in the mixing device's settings interface.

[0191] If the conferencing equipment is also connected to a third device, the mixing equipment's settings interface can also include a third device identifier to identify the third device. Assuming the conferencing equipment only receives selection operations for the first and second device identifiers, but not for the third device identifier, the conferencing equipment can enable mixing for the first and second devices, but disable mixing for the third device. In this case, such as... Figure 6AAs shown, the area corresponding to the third device identifier is not filled in gray, indicating that the third device identifier is not set to enable mixing functionality for the third device. Alternatively, as... Figure 6B As shown, the checkbox corresponding to the third device identifier is not selected, indicating that the third device identifier has not been set to enable the mixing function for the third device.

[0192] In one possible implementation, when the conferencing device is connected to at least two devices, the conferencing device can output a first prompt message; receive a first user operation in response to the first prompt message, the first user operation being used to enable the conferencing device's mixing function for the first device and the second device, the at least two devices including the first device and the second device.

[0193] Optionally, the conferencing device may play the first prompt message, or display the first prompt message on a screen. This embodiment of the application does not limit the manner in which the conferencing device outputs the first prompt message. Optionally, the first user operation may be a voice operation. Alternatively, the conferencing device may include a touchscreen, and the first user operation may be a touch operation detected on the touchscreen. Alternatively, the conferencing device may include an confirm button and a cancel button, and the first user operation may be a button press operation on the confirm button. This embodiment of the application does not limit the form of the first user operation.

[0194] For example, a schematic diagram of the display interface for the first prompt information can be as follows: Figure 7 As shown. Figure 7 Taking the connection of a conferencing device to a first device, a second device, and a third device as an example, the first user operation for the first prompt information may include selecting the checkbox corresponding to the first device and selecting the checkbox corresponding to the second device.

[0195] In one possible implementation, when the conferencing device is connected to at least two devices and detects new audio, the conferencing device can output a first prompt message. For example, the conferencing device has its mixing function enabled, and it is connected to a first device and a second device. However, the conferencing device originally only output the input audio from the first device, and the first device is connected to a first conferencing application for a meeting. At this time, the conferencing device receives new audio from the second device, and it can output a first prompt message to prompt the user to choose whether to mix the input audio from the first and second devices. Another schematic diagram of the display interface for the first prompt message can be as follows: Figure 8 As shown. Figure 8 It includes an OK button and a Cancel button for mixing the input audio of the first device and the second device, wherein the first user operation in response to the first prompt information may include a selection operation on the OK button.

[0196] In one possible implementation, the conferencing equipment can display a third prompt message on the screen, indicating which devices' input audio is currently being mixed. For example, a schematic diagram of the third prompt message display interface could be as follows: Figure 9 As shown. Figure 9 As shown, the third prompt message is used to indicate that the input audio to the first device and the second device is currently being mixed. Optionally, the display duration of the third prompt message is shorter than the first duration; that is, the third prompt message is displayed briefly and then disappears automatically without interrupting the user's current operation.

[0197] In one possible implementation, in addition to connecting to the first and second devices, the conference equipment also connects to a fourth device via a third connection method; however, the first and third connection methods do not support simultaneous audio mixing. The lack of simultaneous audio mixing between the first and third connection methods means that the conference equipment cannot simultaneously enable audio mixing functions for both the first and fourth devices.

[0198] In this scenario, the conferencing device can determine whether to enable the mixing function for the first or fourth device based on one or more of the following: user selection, connection method priority, whether the conferencing device receives input audio from the first device, whether the conferencing device receives input audio from the fourth device, whether the conferencing device is currently using input audio from the first device, and whether the conferencing device is currently using input audio from the fourth device.

[0199] In one possible implementation, the conferencing device can receive a second user operation to enable the conferencing device's mixing function for the first device. That is, if the connection method does not support simultaneous mixing, i.e., if a connection method conflict occurs, the conferencing device, based on the user operation, chooses to enable the conferencing device's mixing function for the first device while disabling the conferencing device's mixing function for the fourth device.

[0200] Optionally, if the conferencing equipment is currently using the input audio from the fourth device, the conferencing equipment can choose to enable the mixing function for the first device and disable the mixing function for the fourth device after stopping the use of the input audio from the fourth device (e.g., output is complete). This can avoid interrupting the output of the input audio from the fourth device.

[0201] Optionally, the first connection method is Bluetooth, and the third connection method is Wi-Fi 2.4G. This means that Bluetooth and Wi-Fi 2.4G can be online simultaneously and maintain a connection in the conference equipment; however, simultaneous audio mixing is not supported between Bluetooth and Wi-Fi 2.4G.

[0202] In one possible implementation, the priority of different connection methods, from highest to lowest, is as follows: wired connection > Dongle connection > Bluetooth = Wi-Fi. Here, Dongle is a device connection method, typically referring to a small, portable hardware device used to connect to a computer or other device's port to achieve specific functions or provide specific services.

[0203] In one possible implementation, the conferencing equipment can choose to enable the mixing function for the device corresponding to the higher-priority connection method. For example, if the first connection method has a higher priority than the third connection method, the conferencing equipment can choose to enable the mixing function for the first device. If the first connection method has a lower priority than the third connection method, the conferencing equipment can choose to enable the mixing function for the fourth device.

[0204] In one possible implementation, the conferencing device can selectively enable the mixing function for the device corresponding to the received input audio. For example, if the conferencing device has received input audio from a first device but not from a fourth device, it can choose to enable the mixing function for the first device. Conversely, if the conferencing device has not received input audio from the first device but has received input audio from the fourth device, it can choose to enable the mixing function for the fourth device. In this way, it can dynamically switch between enabling the mixing function for the first device and enabling the mixing function for the fourth device based on the received input audio.

[0205] In one possible implementation, the conferencing device can selectively enable the mixing function for the device corresponding to the currently used input audio. For example, if the conferencing device is currently using input audio from a first device and not from a fourth device, it can choose to enable the mixing function for the first device. Similarly, if the conferencing device is currently using input audio from a fourth device and not from the first device, it can choose to enable the mixing function for the fourth device. This approach allows for dynamic switching between enabling the mixing function for the first and fourth devices based on input audio usage, while ensuring that the use of input audio from a particular device is not interrupted.

[0206] In one possible implementation, with the mixing function disabled, the conferencing equipment can display an input audio selection interface on its screen. This interface includes device identifiers for each device connected to the conferencing equipment. The conferencing equipment can receive a user selection for one of the device identifiers and can output the input audio from the device corresponding to the selected identifier. A schematic diagram of the input audio selection interface can be shown below. Figure 10 As shown, Figure 10 In this case, the user selects the device identifier of the first device, and the conferencing equipment can output the input audio from the first device. Figure 10 In this system, users can only select one device identifier and cannot select two or more device identifiers at the same time.

[0207] In one possible implementation, the conferencing device connects to at least two devices. With the conferencing device's mixing function disabled, it can determine a target device among these at least two devices based on preset rules and output the target device's input audio. The target device is one of the at least two devices, for example, the target device is either a first device or a second device. Figure 10 In the case shown, the target device is the first device.

[0208] In this way, even with mixing disabled, the conferencing equipment can maintain a connection with at least two devices and output audio from one of them. Users can dynamically switch between the selected devices to switch the output audio from different devices while maintaining the connection with the devices without disconnecting them.

[0209] For example, the conferencing equipment was originally connected to only one device (such as the first device), and the conferencing equipment output the input audio from the first device. Later, the conferencing equipment also establishes a connection with other devices (such as the second device). In this case, the conferencing equipment can determine the target device among at least two connected devices based on preset rules, rather than directly switching from outputting the input audio from the first device to outputting the input audio from the second device. This avoids interrupting the output audio from the first device.

[0210] In one possible implementation, the target device connects to the conference device based on a target connection link. The preset rules may include one or more of the following: among the established connection links between the conference device and at least two devices connected to it, the connection method of the target connection link has the highest priority; the target connection link is the connection link most recently selected by the user; or the target connection link is the connection link previously selected by the user.

[0211] The at least two devices connected to the conferencing equipment include Figure 1Taking the first, second, and third devices as an example, the first device is connected to the conference equipment via connection link L1, the second device via connection link L2, and the third device via connection link L3. Assume the priority of different connection methods, from highest to lowest, is as follows: wired connection > Dongle connection > Bluetooth = Wi-Fi, and that connection link L1 is a wired connection, connection link L2 is a Dongle connection, and connection link L3 is Bluetooth. In this case, the target connection link can be connection link L1.

[0212] See Figure 10 When a user selects to output the input audio from the first device, it can be understood that the user's latest selected connection link is the connection link between the first device and the conferencing device (i.e., connection link L1). If the user has not currently selected a target connection link, but has previously selected one, the conferencing device can use the previously selected connection link as the target connection link. If the user has neither currently nor previously selected a target connection link, the conferencing device can use the connection link corresponding to the highest priority connection method among the established connections as the target connection link.

[0213] In one possible implementation, while outputting the input audio from the target device, the conferencing device can also receive the input audio from the fifth device, output a second prompt message to indicate whether to switch audio; receive a third user operation in response to the second prompt message, output the input audio from the fifth device, and stop outputting the input audio from the target device, with the third user operation used to confirm the audio switch.

[0214] Optionally, the conferencing device may play a second prompt message, or display the second prompt message on a screen. This embodiment of the application does not limit the manner in which the conferencing device outputs the second prompt message. Optionally, the third user operation may be a voice operation. Alternatively, the conferencing device may include a touchscreen, and the third user operation may be a touch operation detected on the touchscreen. Alternatively, the conferencing device may include a confirmation button and a cancel button, and the third user operation may be a button press operation on the confirmation button. This embodiment of the application does not limit the form of the third user operation.

[0215] For example, a schematic diagram of the display interface for the second prompt message can be as follows: Figure 11 As shown. The second prompt message display interface includes an "OK" button and a "Cancel" button for switching audio. The third user operation related to the second prompt message can include selecting the "OK" button. If the user selects the "Cancel" button, the conferencing device continues to output the input audio from the target device, ignoring the input audio from the fifth device.

[0216] In one possible implementation, the conferencing device receives a third user operation in response to the second prompt information, and can start outputting the input audio of the fifth device after the input audio output of the fifth device is completed, thus avoiding interruption of the output of the input audio of the fifth device.

[0217] In one possible implementation, the conferencing equipment can display a fourth prompt message on the screen, indicating which device's input audio is currently being output. For example, a schematic diagram of the fourth prompt message display interface could be as follows: Figure 12 As shown. Figure 12 As shown, the fourth prompt message is used to indicate that the input audio from the fifth device is currently being output. Optionally, the display duration of the fourth prompt message is shorter than the second duration; that is, the fourth prompt message is displayed briefly and then disappears automatically without interrupting the user's current operation.

[0218] Please see Figure 13 , Figure 13 This is a schematic diagram of the structure of an audio device provided in an embodiment of this application. Figure 13 As shown, the audio device 130 includes an output unit 1301 and a communication unit 1302, and optionally, may also include an acquisition unit 1303 and a mixing unit 1304. The audio device 130 can perform the relevant steps of the conference equipment in the aforementioned method embodiments.

[0219] The communication unit 1302 is used to receive input audio from the first device and to receive input audio from the second device;

[0220] The output unit 1301 is used to output the input audio of the first device and the input audio of the second device when the mixing function is enabled.

[0221] The output unit 1301 is also used to output the input audio of the first device or the input audio of the second device when the mixing function is turned off.

[0222] In one possible implementation, the acquisition unit 1303 is used to acquire local audio. The communication unit 1302 is further used to send target audio to a first conferencing application and / or a second conferencing application based on the input audio from the first device, the input audio from the second device, and the local audio. The first device connects to the first conferencing application, and the second device connects to the second conferencing application.

[0223] In one possible implementation, the mixing unit 1303 is used to perform mixing processing based on the input audio and local audio of the first device to obtain a first target audio, and the communication unit 1302 is also used to send the first target audio to a second conferencing application. The mixing unit 1303 is also used to perform mixing processing based on the input audio and local audio of the second device to obtain a second target audio, and the communication unit 1302 is also used to send the second target audio to the first conferencing application.

[0224] Specifically, in this case, the operations performed by the output unit 1301, communication unit 1302, acquisition unit 1303, and mixing unit 1304 can be referred to the description of the conference equipment in the foregoing method embodiments.

[0225] Please see Figure 14 , Figure 14 This is a schematic diagram of a conference device 140 provided in an embodiment of this application, which can be used to implement the functions of the conference device in the above method embodiments. The conference device 140 may include at least one processor 1401, at least two communication interfaces 1402, and a microphone component 1403. Optionally, the conference device 140 may also include one or more of the following: a memory 1404, a sound playback component 1405, a display screen 1406, and a touch screen 1407. Figure 14 The components shown by the dashed lines are optional; that is, the conference equipment 140 may not include them. Figure 14 The component shown by the dashed line.

[0226] Among them, at least one processor 1401, at least two communication interfaces 1402, a pickup component 1403, a memory 1404, a playback component 1405, a display screen 1406, and a touch screen 1407 can be connected via a bus 1408 or other means. The bus is in... Figure 14 The connections between other components are shown in bold lines only and are not intended to be limiting. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, Figure 14 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0227] The coupling in this application embodiment is an indirect coupling or communication connection between devices, units, or modules, which can be electrical, mechanical, or other forms, used for information interaction between devices, units, or modules. This application embodiment does not limit the specific connection medium between the at least one processor 1401, at least two communication interfaces 1402, microphone component 1403, memory 1404, playback component 1405, display screen 1406, and touch screen 1407.

[0228] The communication interface enables the conferencing equipment to connect to other devices via wired or wireless connections. The communication interface can be a USB interface, an HDMI interface, or a wireless module such as Wi-Fi or Bluetooth. The audio pickup component refers to the device or module used to capture and convert audio signals. For example, an audio pickup component can include a microphone. The audio playback component refers to the device or module used to play and output audio signals. For example, an audio playback component can include a speaker, headphones, etc.

[0229] Memory 1404 may include read-only memory and random access memory, and provides instructions and data to at least one processor 1401. A portion of memory 1404 may also include non-volatile random access memory.

[0230] At least one processor 1401 may be a Central Processing Unit (CPU), but it may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor; optionally, at least one processor 1401 may also be any conventional processor.

[0231] In one example, when the conferencing equipment uses Figure 14 When in the form shown, Figure 14 At least one processor 1401 in the device can execute the method performed by the conferencing device in any of the above method embodiments.

[0232] In one possible implementation, memory 1404 is used to store computer programs or instructions; at least one processor 1401 is used to invoke the computer programs or instructions stored in memory 1404 to perform the steps performed by the conferencing device in the foregoing method embodiments.

[0233] In the embodiments of this application, the method provided in the embodiments of this application can be implemented by running a computer program (including program code) capable of performing the steps involved in the above-described method on a general-purpose computing device, such as a computer, which includes processing elements and storage elements such as a CPU, random access memory (RAM), and read-only memory (ROM). The computer program can be recorded on, for example, a computer-readable recording medium, loaded into a conferencing device through the computer-readable recording medium, and run therein.

[0234] Based on the same inventive concept, the principles and beneficial effects of the devices and conference equipment provided in the embodiments of this application in solving the problem are similar to those of the conference equipment in the method embodiments of this application in solving the problem. Please refer to the principles and beneficial effects of the method embodiments. For the sake of brevity, they will not be repeated here.

[0235] This application also provides a computer-readable storage medium storing a computer program or computer instructions, which are adapted to be loaded by a conferencing device and execute the method provided in the above-described method embodiments.

[0236] This application also provides a computer program product containing a computer program or instructions, which, when run on a conference device, causes the conference device to perform the method provided in the above-described method embodiments.

[0237] Regarding the modules / units included in the various devices and products described in the above embodiments, they can be software modules / units, hardware modules / units, or a combination of both. For example, for devices and products applied to or integrated into a chip, all modules / units can be implemented using hardware methods such as circuits, or at least some modules / units can be implemented using software programs running on a processor integrated within the chip, while the remaining (if any) modules / units can be implemented using hardware methods such as circuits. For devices and products applied to or integrated into a chip module, all modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components of the chip module, or at least some modules / units can be implemented using hardware methods such as circuits. The implementation is achieved through a software program that runs on the processor integrated within the chip module. The remaining modules / units (if any) can be implemented using hardware methods such as circuits. For each device or product applied to or integrated into the conference equipment, each of its modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components within the conference equipment. Alternatively, at least some modules / units can be implemented through a software program that runs on the processor integrated within the conference equipment, while the remaining modules / units (if any) can be implemented using hardware methods such as circuits.

[0238] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0239] In the above embodiments, the descriptions of each embodiment have their own emphasis, and any multiple embodiments can be used in combination. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0240] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0241] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0242] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by program instructions and related hardware. The program instructions can be stored in a computer-readable storage medium, which may include: flash drive, ROM, RAM, disk or optical disk, etc.

[0243] The above-disclosed embodiments are merely one example of this application and only a part of the embodiments of this application. They should not be construed as limiting the scope of this application.

Claims

1. A meeting method, characterized in that, The method is applied to a conference device, wherein the conference device is connected to a first device via a first connection method and to a second device via a second connection method; the method includes: Receive input audio from the first device; Receive input audio from the second device; When the mixing function is enabled, the input audio from the first device and the input audio from the second device are output; With the mixing function off, output the input audio from the first device or the input audio from the second device.

2. The method according to claim 1, characterized in that, The first device is connected to the first conference application, and the second device is connected to the second conference application.

3. The method according to claim 2, characterized in that, The method further includes: Capture local audio; Based on the input audio from the first device, the input audio from the second device, and the local audio, the target audio is sent to the first conferencing application and / or the second conferencing application.

4. The method according to claim 3, characterized in that, The step of sending target audio to the first conferencing application and / or the second conferencing application based on the input audio from the first device, the input audio from the second device, and the local audio includes: The input audio from the first device and the local audio are mixed to obtain a first target audio, which is then sent to the second conferencing application; and / or... The second target audio is obtained by mixing the input audio from the second device and the local audio, and then sent to the first conferencing application.

5. The method according to claim 4, characterized in that, The conference equipment is also connected to a third device; the method further includes: Receive the input audio from the third device; The third target audio is obtained by mixing the input audio from the first device, the input audio from the second device, and the local audio, and then the third target audio is sent to the third device. The step of mixing the input audio from the first device and the local audio to obtain the first target audio includes: mixing the input audio from the first device, the input audio from the third device, and the local audio to obtain the first target audio; The step of mixing the input audio from the second device and the local audio to obtain the second target audio includes: mixing the input audio from the second device, the input audio from the third device, and the local audio to obtain the second target audio.

6. The method according to claim 1, characterized in that, The conference equipment includes a display screen, and the method further includes: A settings interface is displayed on the screen. The settings interface includes a first device identifier and a second device identifier. The first device identifier is set to enable the mixing function for the first device, and the second device identifier is set to enable the mixing function for the second device.

7. The method according to claim 1, characterized in that, The method further includes: When at least two devices are connected to the conference equipment, a first prompt message is output; The system receives a first user operation in response to the first prompt message. The first user operation is used to enable the mixing function of the conferencing device for the first device and the second device. The at least two devices include the first device and the second device.

8. The method according to claim 1, characterized in that, The conference equipment is also connected to a fourth device via a third connection method; wherein, the first connection method and the third connection method do not support simultaneous audio mixing; the method further includes: The system receives a second user operation, which is used to enable the mixing function of the conferencing device for the first device.

9. The method according to claim 8, characterized in that, The first connection method is Bluetooth, and the third connection method is Wi-Fi 2.4G.

10. The method according to any one of claims 1-9, characterized in that, The conferencing equipment connects to at least two devices, and when the mixing function of the conferencing equipment is turned off, the method further includes: Based on preset rules, a target device is determined among the at least two devices, wherein the target device is either the first device or the second device.

11. The method according to claim 10, characterized in that, The target device is connected to the conference device via a target connection link, and the preset rules include one or more of the following: Of the established connection links between the at least two devices and the conferencing device, the target connection link has the highest priority. The target connection link is the connection link most recently selected by the user; The target connection link is the connection link that the user previously selected.

12. The method according to claim 10, characterized in that, The method further includes: Receive input audio from a fifth device; Output a second prompt message, which is used to prompt whether to switch audio; The system receives a third user operation in response to the second prompt information, outputs the input audio of the fifth device, and stops outputting the input audio of the target device. The third user operation is used to confirm the audio switching.

13. A conference device, characterized in that, The conference device includes at least two communication interfaces and at least one processor; wherein the at least two communication interfaces are used to connect the conference device to a first device via a first connection method, and the at least two communication interfaces are also used to connect the conference device to a second device via a second connection method; the at least one processor is used to run computer programs or instructions to perform the method as described in any one of claims 1-12.

Images