Audio transmission method, related device and communication system
By establishing a connection between the first device and the audio device, and a communication connection between the second device and the first device, the audio device can be shared, solving the audio input/output needs of multiple devices, simplifying the interaction between devices, and improving the user experience and audio transmission efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-26
- Publication Date
- 2026-03-27
Smart Images

Figure CN121751397A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to audio transmission methods, related devices and communication systems. Background Technology
[0002] With the development of electronic devices, users own an increasing variety of electronic devices. For example, a user may own multiple types of devices such as mobile phones, tablets, laptops, and headphones. Users can use different devices simultaneously to complete different tasks. However, a pair of headphones can only provide audio input / output to one electronic device at a time. If multiple electronic devices require audio input / output, a pair of headphones needs to frequently switch connections with these devices. This not only fails to meet the audio input / output needs of one or more electronic devices in a timely manner, but also makes the interaction between devices cumbersome, resulting in a poor user experience when listening to or capturing audio. Summary of the Invention
[0003] This application provides an audio transmission method, related apparatus, and communication system. A first device establishes a communication connection with an audio device. A second device establishes a communication connection with the first device. The second device can simultaneously share the audio device for audio input / output with the first device. When the first and second devices share the audio device, the audio device can maintain its connection with the first device without switching connections between them. This method can promptly meet the audio input / output needs of multiple electronic devices using a single audio device, and it simplifies the interaction between the audio device and these multiple electronic devices, improving audio transmission efficiency and thus enhancing the user experience for listening to or capturing audio.
[0004] In a first aspect, this application provides an audio transmission method. The method is applied to a communication system including a first device and a second device, wherein the first device is connected to an audio device. The first device sends a first audio signal to the audio device, the first audio signal being the audio of a first audio application in the first device; the first device receives a second audio signal collected by the audio device and sends the second audio signal to the second device; the second device uses the second audio signal as the audio input for a first audio input service.
[0005] The first audio may refer to this application. Figure 5G The audio stream of the electronic device 100 shown. A second audio stream can be referenced in this application. Figure 5C The audio stream captured by the audio device 300 shown.
[0006] As can be seen, the audio device can simultaneously meet the audio output requirements of the first device and the audio input requirements of the second device while maintaining a connection with the first device. This method not only allows users to conveniently use a single audio device to simultaneously achieve audio input / output for multiple electronic devices, improving the user's audio listening or recording experience, but also simplifies the interaction between the audio device and multiple electronic devices, improving audio transmission efficiency.
[0007] In conjunction with the first aspect, in some embodiments, the second device sends a third audio signal to the first device, the third audio signal being the audio applied by the second audio signal in the second device; the first device mixes the first and third audio signals to obtain a fourth audio signal; the first device then sends the fourth audio signal to an audio device. The audio device can play the fourth audio signal.
[0008] The third audio can be referenced. Figures 5A to 5D The audio stream of electronic device 200 sent by electronic device 200 to electronic device 100. A fourth audio stream can be referenced in this application. Figures 5A to 5D The audio streams of electronic device 100 and electronic device 200 are sent from electronic device 100 to audio device 300.
[0009] As can be seen, when both the first and second devices have audio input requirements, the first device can receive the audio to be played from the second device, mix the audio from both devices, and send it to the audio device. The audio device can then play the audio from both devices simultaneously. This satisfies the user's need to listen to audio from multiple devices simultaneously through a single audio device.
[0010] In conjunction with the first aspect, in some embodiments, a first device receives a first operation for stopping the playback of a first audio; in response to the first operation, the first device stops sending the first audio to an audio device; a second device sends a third audio to the first device, the third audio being the audio of a second audio application in the second device; and the first device sends the third audio to the audio device.
[0011] The first step can be referred to in this application. Figure 5D The operation shown is for the local audio pause output control 512.
[0012] As can be seen, with the audio output of the first device off and the audio output of the second device on, the first device can send the third audio signal directly to the audio device without mixing. The audio device can then play the third audio signal.
[0013] In conjunction with the first aspect, in some embodiments, the second device receives a second operation for stopping the playback of the third audio; in response to the second operation, the second device stops sending the third audio to the first device.
[0014] Alternatively, the first device receives a third operation on a first control, the first control being used to control the audio output state of the second device, and the third operation being used to turn off the audio output of the second device; in response to the third operation, the first device sends a second message to the second device, the second message being used to instruct the second device to turn off the audio output; according to the second message, the second device stops sending third audio to the first device.
[0015] For example, the second operation could be to this application. Figure 5F The operation of the local audio pause output control 522 is shown. The first control can be the one described in this application. Figure 5F The illustrated electronic device 200 has an audio pause output control 514. A third operation could be performed on this application. Figure 5F The operation of the audio pause output control 514 of the electronic device 200 shown.
[0016] As can be seen, users can control the audio output of the second device to be turned on or off from both the second device and the first device. This allows users to conveniently control the audio output status of the second device.
[0017] In conjunction with the first aspect, in some embodiments, the first device displays first status information, which indicates that the audio output of the second device is enabled; in response to the second operation, the second device sends a first message to the first device, which indicates that the audio output of the second device has been disabled; according to the first message, the first device updates the first status information to second status information, which indicates that the audio output of the second device is disabled.
[0018] The first status information can be found in this application. Figure 5F The illustrated electronic device 200 audio pause output control 514 includes icons and text information. Second status information can be found in this application. Figure 5G The audio output control 518 of the electronic device 200 shown contains icons and text information.
[0019] As can be seen, the first and second devices can synchronize the audio output status of the second device. The first device can display corresponding status information based on the current audio output status of the second device to inform the user of the current audio output status of the second device. The user can quickly understand the audio output status of the first and second devices on the first device.
[0020] In some embodiments, after the second device stops sending the third audio to the first device, the second device receives an operation to continue playing the third audio. In response to this operation, the second device can send the third audio to the first device. The first device can then have the third audio played by an audio device.
[0021] Alternatively, the first device displays controls for controlling the audio output state of the second device. After the second device stops sending third audio to the first device, the first device receives an operation to enable the audio output of the second device. In response to this operation, the first device can send a message to the second device instructing it to enable audio output. Based on this message, the second device can send the third audio to the first device. The first device can then have the third audio played by an audio device.
[0022] Specifically, after the audio output state of the second device changes from off to on, the first device can update the second state information to the first state information.
[0023] As can be seen, after a user operates on the first or second device to control the second device to turn off audio input, they can then operate on the first or second device to control the second device to turn on audio input.
[0024] In conjunction with the first aspect, in some embodiments, before the first device sends the second audio to the second device, the second device receives a fourth operation, the fourth operation being used to enable audio input for the second device; in response to the fourth operation, the second device sends a third message to the first device, the third message being used to indicate that the second device has enabled audio input.
[0025] Alternatively, the first device receives a fifth operation on the second control, which is used to control the audio input state of the second device, and the fifth operation is used to enable the audio input of the second device; in response to the fifth operation, the first device sends a fourth message to the second device, which is used to instruct the second device to enable the audio input.
[0026] For example, the fourth operation could be this application. Figure 5B The diagram shows the operation of the unmute control 521. The second control can be... Figure 5B The electronic device 200 shown de-mutes the control 513. The fifth operation can be... Figure 5B The operation of de-mute control 513 on the electronic device 200 shown.
[0027] As can be seen, users can control the audio input of the second device to be turned on or off, both from the first device and from the second device. This allows users to conveniently control the audio input status of the second device.
[0028] In conjunction with the first aspect, in some embodiments, the first device displays third status information, which indicates that the audio input of the second device is off; according to the third message, the first device updates the third status information to fourth status information, which indicates that the audio input of the second device is on.
[0029] The third state information can be found in this application. Figure 5B The illustrated electronic device 200 includes an unmute control 513 containing icons and text information. Fourth status information can be found in this application. Figure 5C The illustrated electronic device 200 mute control 515 contains icons and text information.
[0030] As can be seen, the first and second devices can synchronize the audio input status of the second device. The first device can display corresponding status information based on the current audio input status of the second device to inform the user of the current audio input status of the second device. The user can quickly understand the audio input status of the first and second devices on the first device.
[0031] In conjunction with the first aspect, in some embodiments, the first device uses the second audio as the audio input for the second audio input service.
[0032] As can be seen, when the audio device remains connected to the first device, both the first and second devices can use the audio captured by the audio device as the audio input for their respective audio input services. Specifically, the first and second devices can use the audio device simultaneously for audio input. Alternatively, once audio input is enabled on one device, audio input on the other device can be automatically disabled. This method can meet the user's need to use a single audio device for audio input on multiple devices, and it simplifies the interaction between the audio device and these multiple electronic devices, improving audio transmission efficiency.
[0033] In conjunction with the first aspect, in some embodiments, before the first device sends the second audio to the second device, the second audio input service of the first device is in progress; after the first device sends the second audio to the second device, the first device stops performing the second audio input service.
[0034] As can be seen, once the audio input on the second device is enabled, the audio input on the first device can be automatically disabled. When the user only wants audio input on the second device, this method eliminates the need for the user to manually disable the audio input on the first device, simplifying the user's audio input control.
[0035] In conjunction with the first aspect, in some embodiments, after the second device uses the second audio as the audio input for the first audio input service, the first device receives a sixth operation, which is used to enable the audio input of the first device; in response to the sixth operation, the first device uses the second audio as the audio input for the second audio input service, stops sending the second audio to the second device, and sends a fifth message to the second device, which is used to instruct the second device to disable the audio input; according to the fifth message, the second device stops performing the first audio input service.
[0036] For example, the sixth operation could be an operation on this application. Figure 5C The operation of unmute control 516 is shown.
[0037] As can be seen, once the audio input on the first device is enabled, the audio input on the second device can be automatically disabled. When the user only wants audio input on the first device, this method eliminates the need for the user to manually disable the audio input on the second device, simplifying the user's audio input control.
[0038] In conjunction with the first aspect, in some embodiments, after the second device uses the second audio as the audio input for the first audio input service, the second device receives a seventh operation, which is used to turn off the audio input of the second device; in response to the seventh operation, the second device stops performing the first audio input service and sends a sixth message to the first device, which is used to indicate that the second device has turned off the audio input; according to the sixth message, the first device stops sending the second audio to the second device.
[0039] Alternatively, the first device receives an eighth operation on a third control, which controls the audio input state of the second device, and the eighth operation is used to disable the audio input of the second device; in response to the eighth operation, the first device stops sending the second audio to the second device and sends a seventh message to the second device, which instructs the second device to disable the audio input; according to the seventh message, the second device stops performing the first audio input service.
[0040] For example, the seventh operation could be an operation on this application. Figure 5C The operation of the mute control 523 is shown. The third control can be described in this application. Figure 5C The illustrated electronic device 200 has a mute control 515. The eighth operation can be performed on this application. Figure 5C The operation of the mute control 515 of the electronic device 200 shown.
[0041] Specifically, after the audio input state of the second device changes from the on state to the off state, the first device can update the fourth state information to the third state information.
[0042] As can be seen, users can control the audio input of the second device to be turned on or off, both from the first device and from the second device. This allows users to conveniently control the audio input status of the second device.
[0043] In some embodiments, when the audio inputs of both the first and second devices are turned off, the first device can instruct the audio device to stop capturing audio. This saves energy from the audio device.
[0044] Secondly, this application provides an audio transmission method. The method is applied to a first device connected to an audio device. The first device sends a first audio signal to the audio device, the first audio signal being the audio used in a first audio application within the first device; the first device receives a second audio signal collected by the audio device and sends the second audio signal to a second device.
[0045] In this embodiment, the second device uses the second audio input as the audio input for the first audio input service. The first audio input can be found in this application. Figure 5G The audio stream of the electronic device 100 shown. A second audio stream can be referenced in this application. Figure 5C The audio stream captured by the audio device 300 shown.
[0046] As can be seen, the audio device can simultaneously meet the audio output requirements of the first device and the audio input requirements of the second device while maintaining a connection with the first device. This method not only allows users to conveniently use a single audio device to simultaneously achieve audio input / output for multiple electronic devices, improving the user's audio listening or recording experience, but also simplifies the interaction between the audio device and multiple electronic devices, improving audio transmission efficiency.
[0047] In conjunction with the second aspect, in some embodiments, the first device receives a third audio signal from the second device, the second audio signal being different from the first audio signal; the first device mixes the first audio signal and the third audio signal to obtain a fourth audio signal; the first device sends the fourth audio signal to the audio device.
[0048] As can be seen, when both the first and second devices have audio input requirements, the first device can receive the audio to be played from the second device, mix the audio from both devices, and send it to the audio device. The audio device can then play the audio from both devices simultaneously. This satisfies the user's need to listen to audio from multiple devices simultaneously through a single audio device.
[0049] In conjunction with the second aspect, in some embodiments, the first device receives a first operation to stop playing a first audio; in response to the first operation, the first device stops sending the first audio to the audio device; the first device receives a third audio from the second device, the second audio being different from the first audio; and the first device sends the third audio to the audio device.
[0050] As can be seen, with the audio output of the first device off and the audio output of the second device on, the first device can send the third audio signal directly to the audio device without mixing. The audio device can then play the third audio signal.
[0051] In conjunction with the second aspect, in some embodiments, the first device displays first status information, which indicates that the audio output of the second device is enabled. The first device receives a first message from the second device, which indicates that the audio output of the second device is disabled; based on the first message, the first device updates the first status information to second status information, which indicates that the audio output of the second device is disabled.
[0052] The first message mentioned above may be sent by the second device after receiving the second operation. The second operation is used to stop playing the third audio. In addition to sending the first message, the second device can also stop sending the third audio to the first device according to the second operation.
[0053] As can be seen, the first and second devices can synchronize the audio output status of the second device. The first device can display corresponding status information based on the current audio output status of the second device to inform the user of the current audio output status of the second device. The user can quickly understand the audio output status of the first and second devices on the first device.
[0054] In conjunction with the second aspect, in some embodiments, the first device displays a first control for controlling the audio output state of the second device. The first device receives a third operation on the first control, which is used to turn off the audio output of the second device. In response to the third operation, the first device sends a second message to the second device, instructing the second device to turn off the audio output. The second device can stop sending third audio based on the second message.
[0055] As can be seen, users can control the audio output of the second device to be turned on or off from both the second device and the first device. This allows users to conveniently control the audio output status of the second device.
[0056] In some embodiments, after the second device stops sending the third audio to the first device, the second device receives an operation to continue playing the third audio. In response to this operation, the second device can send the third audio to the first device. The first device can then have the third audio played by an audio device.
[0057] Alternatively, the first device displays controls for controlling the audio output state of the second device. After the second device stops sending third audio to the first device, the first device receives an operation to enable the audio output of the second device. In response to this operation, the first device can send a message to the second device instructing it to enable audio output. Based on this message, the second device can send the third audio to the first device. The first device can then have the third audio played by an audio device.
[0058] Specifically, after the audio output state of the second device changes from off to on, the first device can update the second state information to the first state information.
[0059] As can be seen, after a user operates on the first or second device to control the second device to turn off audio input, they can then operate on the first or second device to control the second device to turn on audio input.
[0060] In conjunction with the second aspect, in some embodiments, before the first device sends the second audio to the second device, the first device receives a third message from the second device, the third message indicating that the second device has enabled audio input.
[0061] Alternatively, the first device receives a fifth operation on the second control, which is used to control the audio input state of the second device, and the fifth operation is used to enable the audio input of the second device; in response to the fifth operation, the first device sends a fourth message to the second device, which is used to instruct the second device to enable the audio input.
[0062] The third message can be sent by the second device after receiving the fourth operation. The fourth operation is used to enable audio input on the second device.
[0063] As can be seen, users can control the audio input of the second device to be turned on or off, both from the first device and from the second device. This allows users to conveniently control the audio input status of the second device.
[0064] In conjunction with the second aspect, in some embodiments, the first device displays third status information, which is used to indicate that the audio input of the second device is off. According to the third message, the first device updates the third status information to a fourth status information, which is used to indicate that the audio input of the second device is on.
[0065] As can be seen, the first and second devices can synchronize the audio input status of the second device. The first device can display corresponding status information based on the current audio input status of the second device to inform the user of the current audio input status of the second device. The user can quickly understand the audio input status of the first and second devices on the first device.
[0066] In conjunction with the second aspect, in some embodiments, the first device uses the second audio as the audio input for the second audio input service.
[0067] As can be seen, when the audio device remains connected to the first device, both the first and second devices can use the audio captured by the audio device as the audio input for their respective audio input services. Specifically, the first and second devices can use the audio device simultaneously for audio input. Alternatively, once audio input is enabled on one device, audio input on the other device can be automatically disabled. This method can meet the user's need to use a single audio device for audio input on multiple devices, and it simplifies the interaction between the audio device and these multiple electronic devices, improving audio transmission efficiency.
[0068] In conjunction with the second aspect, in some embodiments, before the first device sends the second audio to the second device, the second audio input service of the first device is in progress; after the first device sends the second audio to the second device, the first device stops performing the second audio input service.
[0069] As can be seen, once the audio input on the second device is enabled, the audio input on the first device can be automatically disabled. When the user only wants audio input on the second device, this method eliminates the need for the user to manually disable the audio input on the first device, simplifying the user's audio input control.
[0070] In conjunction with the second aspect, in some embodiments, after the first device sends the second audio to the second device, the first device receives a sixth operation, which is used to enable audio input for the first device. In response to the sixth operation, the first device uses the second audio as the audio input for the second audio input service, stops sending the second audio to the second device, and sends a fifth message to the second device, which instructs the second device to disable audio input. According to the fifth message, the second device stops performing the first audio input service.
[0071] As can be seen, once the audio input on the first device is enabled, the audio input on the second device can be automatically disabled. When the user only wants audio input on the first device, this method eliminates the need for the user to manually disable the audio input on the second device, simplifying the user's audio input control.
[0072] In conjunction with the second aspect, in some embodiments, after the first device sends the second audio to the second device, the first device receives a sixth message from the second device, the sixth message indicating that the second device has turned off audio input; according to the sixth message, the first device stops sending the second audio to the second device.
[0073] Alternatively, the first device receives an eighth operation on the second control, which is used to control the audio input state of the second device, and the eighth operation is used to turn off the audio input of the second device; in response to the eighth operation, the first device stops sending the second audio to the second device and sends a seventh message to the second device, which is used to instruct the second device to turn off the audio input.
[0074] Specifically, after the audio input state of the second device changes from the on state to the off state, the first device can update the fourth state information to the third state information.
[0075] As can be seen, users can control the audio input of the second device to be turned on or off, both from the first device and from the second device. This allows users to conveniently control the audio input status of the second device.
[0076] In some embodiments, when the audio inputs of both the first and second devices are turned off, the first device can instruct the audio device to stop capturing audio. This saves energy from the audio device.
[0077] Thirdly, this application provides an electronic device. The electronic device may include a memory and a processor. The memory can be used to store a computer program. The processor can be used to invoke the computer program to execute any of the possible implementation methods described in the second aspect.
[0078] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed by a processor, can implement any of the possible implementation methods described in the second aspect.
[0079] Fifthly, this application provides a computer program product that may contain computer instructions that, when executed on a processor, can implement any of the possible implementation methods described in the second aspect.
[0080] In a sixth aspect, this application provides a chip for use in an electronic device, the chip including one or more processors for invoking computer instructions to cause the electronic device to perform any of the possible implementation methods in the second aspect.
[0081] It is understood that the electronic device provided in the third aspect, the computer-readable storage medium provided in the fourth aspect, the computer program product provided in the fifth aspect, and the chip provided in the sixth aspect are all used to execute the methods provided in the embodiments of this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0082] Figure 1A This is a schematic diagram of the communication system 10 provided in an embodiment of this application;
[0083] Figure 1B This is a schematic diagram of the communication system 20 provided in an embodiment of this application;
[0084] Figure 2A This is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of this application;
[0085] Figure 2B This is a schematic diagram of the software structure of an electronic device 100 provided in an embodiment of this application;
[0086] Figure 2C This is a schematic diagram of the structure of an audio device 300 provided in an embodiment of this application;
[0087] Figure 3A This is a schematic diagram of the communication system 30 provided in an embodiment of this application;
[0088] Figure 3B This is a schematic diagram of the communication system 40 provided in an embodiment of this application;
[0089] Figure 3C This is a schematic diagram of the communication system 50 provided in an embodiment of this application;
[0090] Figures 4A-4E These are schematic diagrams illustrating some audio transmission scenarios provided in the embodiments of this application;
[0091] Figures 5A to 5G These are schematic diagrams illustrating some audio transmission scenarios provided in the embodiments of this application;
[0092] Figure 6 This is a flowchart of an audio transmission method provided in an embodiment of this application;
[0093] Figure 7 This is a flowchart of an audio transmission method provided in an embodiment of this application;
[0094] Figure 8 This is a flowchart of an audio transmission method provided in an embodiment of this application. Detailed Implementation
[0095] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0096] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.
[0097] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.
[0098] This application provides an audio transmission method applicable to a communication system including an electronic device 100, an electronic device 200, and an audio device 300. The electronic device 100 and the audio device 300 establish a communication connection. The electronic device 100 can transmit audio 1 from its own audio source to the audio device 300 for playback. The electronic device 100 can also receive audio collected by the audio device 300 and perform corresponding functions based on the collected audio.
[0099] When electronic device 200 has an audio input / output requirement, it can establish a communication connection with electronic device 100. Electronic device 200 can send audio 2 from its own audio input to electronic device 100. If electronic device 100 still needs to output audio 1 upon receiving audio 2, it can mix audio 1 and audio 2 and send the mixed audio to audio device 300. Audio device 300 can then play the mixed audio. If electronic device 100 does not have an audio output requirement upon receiving audio 2, it can send audio 2 to audio device 300 for playback. Electronic device 100 can also determine which device receives the audio collected by audio device 300 based on the audio input status of electronic devices 100 and 200. If electronic device 200 has audio input enabled, electronic device 100 can send the audio collected by audio device 300 to electronic device 200. Electronic device 200 can then implement corresponding functions based on the audio collected by audio device 300.
[0100] As can be seen, electronic device 200 can share audio device 300 for audio input / output simultaneously with electronic device 100. When both electronic devices 100 and 200 have audio output requirements, audio device 300 can simultaneously play audio from both electronic devices 100 and 200. When multiple electronic devices share audio device 300, audio device 300 can maintain a connection with one of the electronic devices (e.g., electronic device 100) without frequently switching connections with multiple electronic devices. This method not only allows multiple electronic devices to meet their audio input / output needs promptly with a single audio device, but also simplifies the interaction between the audio device and these multiple electronic devices, improves audio transmission efficiency, and thus enhances the user experience for listening to or capturing audio.
[0101] The communication system provided in this application is described below.
[0102] Figure 1A A schematic diagram of the communication system 10 is shown as an example.
[0103] like Figure 1A As shown, the communication system 10 may include electronic device 100, electronic device 200, and audio device 300. A communication connection may be established between electronic device 100 and electronic device 200. A communication connection may be established between electronic device 100 and audio device 300. These communication connections may include, but are not limited to, Bluetooth communication connections, wireless fidelity (Wi-Fi) network connections, wired connections, etc. This application embodiment does not limit the communication connection method between electronic device 100 and electronic device 200, or the communication connection method between electronic device 100 and audio device 300.
[0104] Electronic devices 100 and 200 can be mobile phones, tablets, laptops, smartwatches, televisions, etc. Audio device 300 can be a device that includes an audio output device (e.g., a handset, a speaker) and / or an audio input device (e.g., a microphone). For example, an audio device can be headphones, a microphone, a speaker, etc. This application does not limit the types of electronic devices 100, 200, and 300.
[0105] In some embodiments, when the electronic device 100 has audio output enabled, the electronic device 100 can send the audio to be played from the electronic device 100 to the audio device 300. The audio device 300 can then play the audio from the electronic device 100. When the electronic device 100 has audio input enabled, the electronic device 100 can instruct the audio device 300 to capture audio. The audio device 300 then sends the captured audio to the electronic device 100. The electronic device 100 can perform corresponding functions based on the audio captured by the audio device 300, such as recording, voice calls, sending voice messages, video recording, etc.
[0106] When the audio output of electronic device 200 is enabled, electronic device 200 can send the audio to be played from electronic device 100. If the audio outputs of both electronic device 100 and electronic device 200 are enabled, electronic device 100 can mix the audio from electronic device 100 and electronic device 200, and send the mixed audio to audio device 300. Audio device 300 can play the mixed audio. This allows simultaneous playback of the audio from electronic device 100 and electronic device 200 on audio device 300. This application embodiment does not limit the above mixing method. For example, audio device 300 includes one or more audio output devices. The audio played by these one or more audio output devices can be the same. That is, the audio played by any one of these one or more audio output devices includes both the audio from electronic device 100 and the audio from electronic device 200. Alternatively, after mixing, the audio from electronic device 100 and the audio from electronic device 200 can be played by different audio output devices in audio device 300. For example, audio device 300 is a headset. The headset can include a left earphone and a right earphone. The left earpiece can play audio from electronic device 100, and the right earpiece can play audio from electronic device 200. Thus, when audio device 300 simultaneously plays audio from both electronic device 100 and electronic device 200, the user can listen to audio from different electronic devices using the different audio output devices within audio device 300.
[0107] If the audio output of electronic device 200 is on and the audio output of electronic device 100 is off, electronic device 100 can send the audio from electronic device 200 to audio device 300. Audio device 300 can then play the audio from electronic device 200.
[0108] In some embodiments, when audio input is performed using audio device 300, only one of electronic devices 100 and 200 can have audio input enabled at any given time. When electronic device 200 has audio input enabled, electronic device 100 can disable audio input and send the audio captured by audio device 300 to electronic device 200. Electronic device 200 can then perform corresponding functions based on the audio captured by audio device 300, such as recording, voice calls, sending voice messages, video recording, etc. When audio input is enabled on electronic device 200, if electronic device 100 has audio input enabled, electronic device 100 can instruct electronic device 200 to disable audio input. Electronic device 100 can receive and use the audio captured by audio device 300 to perform corresponding functions without sending the audio captured by audio device 300 to electronic device 200. When the audio inputs of both electronic devices 100 and 200 are disabled, electronic device 100 can send a command to audio device 300 to stop capturing audio. Based on this command, audio device 300 can disable its audio input.
[0109] In some embodiments, electronic devices 100 and 200 can simultaneously enable audio input. Electronic device 100 can either use the audio collected by audio device 300 to perform corresponding functions, or it can send the audio collected by audio device 300 to electronic device 200 for use by electronic device 200.
[0110] Electronic devices 100 and 200 can synchronize the audio input and output states of electronic device 200. This allows electronic device 100 to determine whether to send audio collected by audio device 300 to electronic device 200. Furthermore, electronic device 100 can display controls for managing the audio input / output states of electronic device 200, allowing users to control the audio input / output states of electronic device 200 through user operations on electronic device 100.
[0111] It should be noted that when the audio input of an electronic device (e.g., electronic device 100, electronic device 200) is turned on, it indicates that the electronic device has an audio input requirement. When the audio output of an electronic device is turned on, it indicates that the electronic device has an audio output requirement. Conversely, when the audio input of an electronic device is turned off, it indicates that the electronic device does not have an audio input requirement. When the audio output of an electronic device is turned off, it indicates that the electronic device does not have an audio output requirement.
[0112] The communication system 10 may include more devices than just electronic device 100, electronic device 200, and audio device 300. For example, in addition to electronic device 200, the communication system 10 may include other electronic devices connected to electronic device 100. That is, multiple electronic devices can be connected to electronic device 100 to share audio device 300 for audio input / output. Optionally, in addition to audio device 300, the communication system 10 may include other audio devices. Users can choose to connect electronic device 200 to electronic device 100 connected to audio device 300 to achieve audio input / output through audio device 300. Alternatively, users can choose to connect electronic device 200 to other electronic devices connected to audio devices to achieve audio input / output through those other audio devices.
[0113] Figure 1B A schematic diagram of the communication system 20 is shown as an example.
[0114] like Figure 1B As shown, the communication system 20 may include a mobile phone, a computer, and a headset. The mobile phone can be referenced as described above. Figure 1A The electronic device 100 shown. The computer can be referenced as described above. Figure 1A The electronic device 200 shown. Headphones can be referenced from the aforementioned... Figure 1A The headphones shown.
[0115] Both mobile phones and computers can have one or more audio applications that require audio input and / or audio output services installed. Audio applications may include conferencing applications, multimedia audio playback applications (e.g., music applications, video playback applications), call applications, instant messaging applications, social networking applications, camera applications, etc. This application does not limit the types of audio applications described above.
[0116] Audio streams can be transmitted between a mobile phone and headphones. Audio streams and control streams can be transmitted between a mobile phone and a computer.
[0117] The audio stream transmitted from the phone to the headphones may include audio that the phone's audio application needs to play and / or audio that the computer's audio application needs to play. The audio stream transmitted from the headphones to the phone may include audio captured by the headphones.
[0118] The audio stream transmitted between a mobile phone and a computer can include audio that the audio application on the computer needs to play and / or audio captured by headphones. Specifically, when the computer has audio output enabled, it can send the audio that its audio application needs to play to the mobile phone. When the computer has audio input enabled, the mobile phone can send the audio captured by headphones to the computer.
[0119] The control flow transmitted between the mobile phone and the computer may include the computer's audio input status and / or the computer's audio output status.
[0120] In some embodiments, in response to an operation that enables audio output on the computer, the computer can send a message to the mobile phone instructing the computer to enable audio output. Based on this message, the mobile phone can send audio from the computer to the headphones. In response to an operation that enables audio input on the computer, the computer can send a message to the mobile phone instructing the computer to enable audio input. Based on this message, the mobile phone can send audio captured by the headphones to the computer. Optionally, the mobile phone can disable its own audio input based on the aforementioned message instructing the computer to enable audio input. Based on the aforementioned messages instructing the computer to enable audio output and audio input, the mobile phone can also update the computer's audio input and audio output status on the screen.
[0121] In some embodiments, the mobile phone can display controls on its screen for controlling the audio input and output states of the computer. In response to an operation on the mobile phone to enable the computer's audio output, the mobile phone can send a message to the computer instructing it to enable audio output. The computer can then enable audio output and send audio that an audio application on the computer needs to play to the mobile phone. In response to an operation on the mobile phone to disable the computer's audio output, the mobile phone can send a message to the computer instructing it to disable audio output. Based on this message, the computer can stop sending audio to the mobile phone. In response to a message on the mobile phone to enable the computer's audio input, the mobile phone can send a message to the computer instructing it to enable audio input. The computer can receive the audio sent by the mobile phone (i.e., the audio captured by the headphones) and use the audio to perform corresponding functions. In response to a message on the mobile phone to disable the computer's audio input, the mobile phone can send a message to the computer instructing it to disable audio and stop sending the audio captured by the headphones to the computer.
[0122] In other words, the aforementioned control flow can be used to synchronize the audio input and audio output states of a mobile phone and a computer.
[0123] In the communication system 20, users can wear headphones to listen to audio that needs to be played by audio applications on their mobile phones and / or computers. Furthermore, users can control the audio input status of their mobile phones and computers, choosing to transmit the audio captured by the headphones to the audio applications on their phones or computers.
[0124] As can be seen, a computer can use a mobile phone to share headphones for audio input / output. The headphones can remain connected to the phone without needing to switch connections between the phone and the computer. This allows users to conveniently listen to audio from their phone and / or computer in real time, or to perform audio input tasks for audio applications on their phone and / or computer using headphones.
[0125] The structure of the equipment involved in this application is described below.
[0126] Figure 2A An exemplary schematic diagram of the hardware structure of electronic device 100 is shown.
[0127] like Figure 2A As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0128] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0129] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0130] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0131] The processor 110 may also include a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is recurring. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0132] In this application, a computer program may be stored in the memory to enable a controller or processor to implement the audio transmission method of this application through an interface or protocol. Exemplarily, the computer program stored in the memory can be used for: establishing a communication connection with an audio device; establishing a communication connection with other electronic devices to provide other electronic devices with the function of using the audio device; controlling the audio input state and / or audio output state of electronic devices connected to electronic device 100; mixing the audio in this device and the audio of electronic devices connected to electronic device 100; establishing a communication connection with other electronic devices connected to an audio device when no audio device is connected, and using the audio device connected to other electronic devices to achieve audio input / output, etc., by means of the connection to other electronic devices.
[0133] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback.
[0134] The charging management module 140 receives charging input from a charger, which can be a wireless charger or a wired charger. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0135] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.
[0136] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0137] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0138] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.
[0139] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0140] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering.
[0141] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0142] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0143] The ISP is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.
[0144] Camera 193 is used to capture still images or videos. In some embodiments, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0145] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0146] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0147] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0148] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0149] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0150] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0151] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0152] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a telephone call or voice message, the receiver 170B can be brought close to the ear to hear the voice.
[0153] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C.
[0154] The 170D headphone jack is used to connect wired headphones.
[0155] In this application, the speaker 170A, receiver 170B, and microphone 170C are all optional.
[0156] The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, gravity sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, angle sensors, etc.
[0157] Buttons 190 include a power button, volume buttons, etc. Motor 191 can generate vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, and also to indicate messages, missed calls, notifications, etc.
[0158] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and detach from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to achieve functions such as calls and data communication. In some examples, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be removed from it.
[0159] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered architecture. Taking the system as an example, the software structure of electronic device 100 is illustrated.
[0160] Figure 2B An exemplary schematic diagram of the software structure of an electronic device 100 is shown.
[0161] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, [the following is omitted as the text is incomplete and likely refers to a specific implementation or feature]. The system is divided into four layers, from top to bottom: application layer, application framework layer, system library, and kernel layer.
[0162] The application layer can include a series of application packages.
[0163] like Figure 2B As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, SMS, audio application, and multi-device audio management module.
[0164] Audio applications can refer to applications that require audio input and / or audio output services. The aforementioned audio input services can refer to services that require audio acquisition, including but not limited to: recording, sending voice messages, capturing videos, making voice calls, detecting voice commands, etc. The aforementioned audio output services can refer to services that require audio playback, including but not limited to: playing music, playing videos, making voice calls, listening to voice messages, etc. This application does not limit the type of audio application.
[0165] The multi-device audio management module can be used to discover nearby electronic devices connected to audio devices, establish communication connections between electronic device 100 and other electronic devices for using audio devices, and manage the audio input and output states of multiple electronic devices sharing a single audio device. In some embodiments, the multi-device audio management module can be based on Huawei... A distributed soft bus can be used to realize the discovery, connection, and data transmission between electronic devices. Alternatively, the multi-device audio management module can be based on standard communication protocols or proprietary protocols of other device manufacturers to realize the discovery, connection, and data transmission between electronic devices. This application does not limit the implementation method of the multi-device audio management module.
[0166] For example, when electronic device 100 is not connected to an audio device, it can use the multi-device audio management module to locate nearby electronic devices connected to audio devices. Once a connected electronic device is found, electronic device 100 can establish a communication connection with it for using the audio device. In this way, electronic device 100 can share the audio devices connected to other electronic devices by connecting to them.
[0167] When electronic device 100 is connected to audio device 300, electronic device 100 can establish a communication connection with other electronic devices that are not connected to audio devices for using audio device 300 through the multi-device audio management module.
[0168] The establishment of a communication connection for using audio devices described above can be referred to as establishing a logical link for audio transmission. For example, in a scenario where electronic device 200 is connected to electronic device 100, and audio input / output is performed using audio device 300 through electronic device 100, electronic device 100 can establish a logical link between electronic device 200 and audio device 300 through a multi-device audio management module. The logical link between electronic device 200 and audio device 300 may include: a communication link between electronic device 100 and electronic device 200 for transmitting audio streams and control streams, and a communication link between electronic device 100 and audio device 300 for transmitting audio streams.
[0169] In some embodiments, the multi-device audio management module can be a standalone application within the electronic device 100. The multi-device audio management module and the audio application can synchronize the audio input and output states of the electronic device through a preset interface. Alternatively, the multi-device audio management module can be integrated into the audio application. This application does not limit the implementation method of the multi-device audio management module. The multi-device audio management module can also be referred to as a multi-device audio management application, an interactive scene control module, etc.
[0170] Electronic device 100 can establish a communication connection between itself and electronic device 200 based on the aforementioned multi-device audio management module. In this way, the audio device can simultaneously meet the audio input / output needs of multiple electronic devices without switching the connected electronic devices. It can be seen that the audio transmission method provided in this application can be implemented through software upgrades or updates, without requiring additional hardware from audio device 300, electronic device 100, electronic device 200, etc.
[0171] The application framework layer provides APIs and a programming framework for applications within the application layer. The application framework layer includes some predefined functions.
[0172] like Figure 2B As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, activity manager, mixing module, multi-device interaction protocol module, audio transmission protocol module, etc.
[0173] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0174] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0175] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0176] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).
[0177] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0178] The notification manager allows applications to display notifications in the status bar (such as the pull-down notification bar). It can be used to convey informational messages and can disappear automatically after a short pause without user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0179] The Activity Manager is responsible for managing activities, including starting, switching, and scheduling components in the system, as well as managing and scheduling applications. The Activity Manager can be called by upper-level applications to open the corresponding activities.
[0180] The mixing module can be used to mix multiple audio streams. For example, the audio application in electronic device 100 has audio 1 to be played. When audio, such as audio 2, is received from other electronic devices, electronic device 100 can mix audio 1 and audio 2 using the mixing module.
[0181] The multi-device interaction protocol module may include a protocol for transmitting control flows between electronic devices. This protocol can support the synchronization of audio input and output states among multiple electronic devices sharing a single audio device. This application does not limit the content of the above protocol.
[0182] The audio transmission protocol module may include protocols for implementing audio input and audio output. These protocols can support audio transmission between devices. This application does not limit the content of the audio transmission protocol.
[0183] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0184] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0185] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0186] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0187] A 2D graphics engine is a graphics engine for 2D drawing.
[0188] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0189] The device structure of electronic device 200 can be referred to the above. Figure 2A and Figure 2B The structure of the electronic device 100 shown.
[0190] Figure 2C An exemplary structural diagram of an audio device 300 is shown.
[0191] like Figure 2C As shown, the audio device 300 may include a processor 310, a memory 320, a communication module 330, a power management module 340, an audio input device 350, and an audio output device 360, and these devices can be coupled via a bus.
[0192] The memory 320 can be used to store program code. For example, program code for implementing wireless pairing between the audio device 300 and other electronic devices, program code for transmitting audio streams between the audio device 300 and other electronic devices, program code for playing audio, program code for capturing audio, etc. Optionally, the memory 320 may also store a Bluetooth address for uniquely identifying the audio device 300, and connection data of electronic devices previously successfully paired with the audio device 300. For example, this connection data can be the Bluetooth address of an electronic device that has been successfully paired with the audio device. Based on this connection data, the audio device 300 can automatically pair with the corresponding electronic device without needing to configure the connection, such as performing authentication. The aforementioned Bluetooth address can be a media access control (MAC) address.
[0193] The processor 310 can be used to execute the program code stored in the memory 320 and call relevant modules to implement the functions of the audio device 300 in this embodiment. For example, functions such as playing audio and capturing audio and transmitting it to other devices. Specifically, the processor 310 can be an integrated control chip or a circuit comprising various active and / or passive components, configured to perform the functions of the processor 310 described in this embodiment. Optionally, the processor 310 of the audio device 300 can be a microcontroller unit (MCU).
[0194] In some embodiments, the processor 310 may include one or more interfaces. The processor 310 may be connected to other components of the audio device 300 through these one or more interfaces.
[0195] The communication module 330 may include a wireless communication module. The wireless communication module can be used to support data exchange between the audio device 300 and other electronic devices via wireless communication methods including Bluetooth, GNSS, WLAN, FM, NFC, and IR. In some embodiments, the wireless communication module may be a Bluetooth chip. The audio device 300 can pair with and establish a wireless connection with the Bluetooth chips of other electronic devices through this Bluetooth chip, thereby enabling wireless communication between the audio device 300 and other electronic devices. For example, after the audio input device collects audio, the wireless communication module can send the audio collected by the audio input device to an electronic device that has established a wireless connection (such as a Bluetooth connection) with the audio device 300.
[0196] In addition, the wireless communication module can also be connected to an antenna. The wireless communication module receives electromagnetic waves via the antenna, modulates and filters the electromagnetic wave signals, and sends the processed signal to the processor 310. The wireless communication module can also receive signals to be transmitted from the processor 310, modulate and amplify them, and then convert them into electromagnetic waves for radiation via the antenna.
[0197] The communication module 330 may also include a wired communication module. The audio device 300 can establish a wired connection with other electronic devices through the wired communication module and transmit data based on the wired connection.
[0198] The power management module 340 can be used to provide power to the audio device 300 and power the various components in the audio device 300. The power management module 340 can support the audio device 300 to receive charging input, etc.
[0199] The audio input device 350 may include a microphone or other device for acquiring audio. The audio input device 350 can process the acquired sound and convert it into an audio signal, and transmit the audio signal to the processor 310 for further processing.
[0200] The audio output device 360 may include a speaker, earpiece, or other device for playing audio. The audio output device 360 can convert audio signals from the processor 310 into sound output.
[0201] Figure 2C The illustrated structure does not constitute a specific limitation on the audio device 300. In practical applications, the audio device 300 may include more or fewer components than illustrated, or combine some components, or separate some components. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
[0202] Figure 3A A schematic diagram of the communication system 30 is shown as an example.
[0203] like Figure 3A As shown, the communication system 30 may include electronic device 100, electronic device 200, and audio device 300. A communication connection may be established between electronic device 100 and electronic device 200. An audio connection may be established between electronic device 100 and audio device 300.
[0204] Electronic device 100 may include a multi-device audio management module, a multi-device interaction protocol module, an audio mixing module, audio application 1, and an audio transmission protocol module. Audio application 1 can be any audio application running in electronic device 100. Electronic device 200 may include an audio management module, a multi-device interaction protocol module, an audio mixing module, audio application 2, and an audio transmission protocol module. Audio application 2 can be any audio application in electronic device 200. The audio management module, multi-device interaction protocol module, audio mixing module, and audio transmission protocol module can be referenced from the foregoing. Figure 2B Introduction.
[0205] When an audio device 300 is connected to an electronic device 100, the multi-device audio management module in the electronic device 100 can synchronize the audio input and audio output states of the electronic device 200 with the multi-device audio management module of the electronic device 200 based on the multi-device interaction protocol.
[0206] The audio input state of electronic device 200 can be determined based on the audio input state of the audio application occupying the audio input port of electronic device 200. The audio output state of electronic device 200 can be determined based on the audio output state of the audio application occupying the audio output port of electronic device 200.
[0207] For example, the audio application occupying the audio output port in electronic device 200 is a music playback application. When the music playback application is playing music, its audio output is on, meaning the audio output of electronic device 200 is on. When the music playback application pauses playback, its audio output is off, meaning the audio output of electronic device 200 is off. As another example, the audio application occupying the audio input port in electronic device 200 is a recording application. When the recording application is recording, its audio input is on, meaning the audio input of electronic device 200 is on. When the recording application pauses recording, its audio input is off, meaning the audio input of electronic device 200 is off.
[0208] Here, we will take audio application 2 in electronic device 200 as an example to illustrate the application that occupies the audio input port and audio output port of electronic device 200.
[0209] In some embodiments, when electronic device 200 receives a user operation to change the audio input state and / or audio output state of audio application 2, audio application 2 can send the updated audio input state and / or audio output state of audio application 2 to the multi-device audio management module in electronic device 200, that is, the updated audio input state and / or audio output state of electronic device 200. Further, the multi-device audio management module in electronic device 200 can send the updated audio input state and / or audio output state of electronic device 200 to the multi-device audio management module of electronic device 100.
[0210] The multi-device audio management module of electronic device 100 can synchronize the audio input and audio output status of electronic device 200 with audio application 1, so that audio application 1 can determine whether to pass the audio from electronic device 200 to audio device 300 for playback, and whether to send the audio collected by audio device 300 to electronic device 200.
[0211] The aforementioned audio application 1 may be an application that occupies the audio input port and / or audio output port of the electronic device 100.
[0212] In some embodiments, electronic device 100 may provide controls for controlling the audio input and audio output states of electronic device 200. When electronic device 100 receives a user operation to change the audio input and / or audio output states of electronic device 200, the multi-device audio management module in electronic device 100 may send a message updating the audio input and / or audio output states to the multi-device audio management module in electronic device 200. Further, the multi-device audio management module in electronic device 200 may instruct audio application 2 to update its audio input and / or audio output states. For example, when audio application 2 updates its audio output to a closed state, audio application 2 may stop outputting audio. That is, electronic device 200 may stop sending audio to electronic device 100.
[0213] In some embodiments, if audio application 1 occupies both the audio input and audio output ports of electronic device 100, the multi-device audio management module in electronic device 100 can also synchronize the audio input and audio output states of electronic device 100 with audio application 1. The audio input state of electronic device 100 is the same as the audio input state of audio application 1. The audio output state of electronic device 100 is the same as the audio output state of audio application 2. When the audio outputs of both electronic device 100 and electronic device 200 are enabled, the multi-device audio management module of electronic device 100 can enable the audio mixing module, allowing it to mix the audio from electronic device 100 and electronic device 200. Optionally, when the audio outputs of electronic device 100 and / or electronic device 200 are disabled, the multi-device audio management module of electronic device 100 can disable the audio mixing module.
[0214] In some embodiments, if the audio output of electronic device 100 is on and the audio output of electronic device 200 is off, audio application 1 in electronic device 100 can send an audio stream to be played to audio device 300 based on an audio transmission protocol. Audio application 1 can send the audio stream to be played to audio device 300 via an audio output port. The aforementioned audio stream to be played may include the audio to be played in audio application 1. For example, if audio application 1 is a music playback application, the audio to be played in audio application 1 may include the audio corresponding to the music to be played. If audio application 1 is a call application, the audio to be played in audio application 1 may include the voice audio of the other end of the call to electronic device 100. If audio application is a conferencing application, the audio to be played in audio application 1 may include the conference audio received by electronic device 100 after joining the conference (i.e., the voice audio of other members in the conference). In this way, audio device 300 can play the audio to be played in audio application 1.
[0215] If the audio output of electronic device 100 is off and the audio output of electronic device 200 is on, audio application 2 in electronic device 200 can send the audio stream of electronic device 200 to electronic device 100 based on the audio transmission protocol. The audio stream of electronic device 200 can be the audio to be played in electronic device 200, i.e., the audio to be played in audio application 2. Audio application 2 can send the audio stream to be played to electronic device 100 via the audio output port. When electronic device 100 receives the audio stream from electronic device 200, audio application 1 in electronic device 100 can obtain the audio stream from electronic device 200 via the audio input port. Audio application 1 can then send the audio stream to be played to audio device 300 based on the audio transmission protocol. This audio stream to be played is the audio stream of electronic device 200. In this way, audio device 300 can play the audio to be played from electronic device 200.
[0216] If the audio outputs of both electronic devices 100 and 200 are enabled, audio application 2 in electronic device 200 can send its audio stream to electronic device 100 based on an audio transmission protocol. Audio application 1 in electronic device 100 can obtain the audio stream from electronic device 200. Audio application 1 can then have the audio to be played in audio application 1 and the audio to be played in electronic device 200 mixed by an audio mixing module. The audio mixing module can then send the mixed audio to audio application 1. Then, audio application 1 can send the audio stream to be played to audio device 300 based on the audio transmission protocol. This audio stream to be played is the mixed audio stream described above. In this way, audio device 300 can simultaneously play the audio streams from both audio application 1 and audio application 2.
[0217] If the audio input of electronic device 100 is enabled and the audio input of electronic device 200 is disabled, electronic device 100 can instruct audio device 300 to capture audio. Audio device 300 can send the audio stream captured by audio device 300 to electronic device 100 based on an audio transmission protocol. Audio application 1 in electronic device 100 can obtain the audio stream captured by audio device 300 via the audio input port. Since the audio input of audio application 1 is enabled, audio application 1 can use the audio stream captured by audio device 300 to perform corresponding functions.
[0218] If the audio input of electronic device 100 is off and the audio input of electronic device 200 is on, electronic device 100 can instruct audio device 300 to capture audio. Audio device 300 can send the audio stream captured by audio device 300 to electronic device 100 based on an audio transmission protocol. Audio application 1 in electronic device 100 can obtain the audio stream captured by audio device 300 via the audio input port. Since the audio input of electronic device 200 is on, audio application 1 can send the audio stream captured by audio device 300 to electronic device 200 based on the audio transmission protocol. Specifically, audio application 1 can send the audio stream captured by audio device 300 to electronic device 200 via the audio output port. When electronic device 200 receives the audio stream captured by audio device 300, audio application 2 in electronic device 200 can obtain the audio stream captured by audio device 300 via the audio input port. Then, audio application 2 can use the audio stream captured by audio device 300 to perform corresponding functions.
[0219] In some embodiments, if the audio input and audio output of the electronic device 100 are both turned off, but the audio application 1 is still running (e.g., running in the background), the electronic device 100 can still transfer the audio stream between the audio device 300 and the electronic device 200 through the audio application 1.
[0220] When both audio input and audio output of electronic device 100 are turned off and audio application 1 is not running, if there is another running audio application in electronic device 100, such as audio application 3, electronic device 100 can switch the audio application used to realize the flow of audio stream between audio device 300 and electronic device 200 from audio application 1 to audio application 3.
[0221] If both audio input and audio output of electronic device 100 are turned off, and no audio application is running on electronic device 100, the connection between electronic device 100 and electronic device 200 for using audio device 300 is disconnected. Electronic device 200 can use its built-in audio input / output devices for audio input / output. Alternatively, if electronic device 100 is not providing audio input / output services, the user can manually connect audio device 300 to electronic device 200. In response to the user's operation of connecting audio device 300 to electronic device 200, electronic device 200 can connect to audio device 300 and perform audio input / output through audio device 300.
[0222] In some embodiments, an electronic device 100 establishes a wireless connection with an audio device 300. No audio application is running on the electronic device 100. When the electronic device 100 needs to perform audio input / output, it can search for nearby audio devices. Specifically, the electronic device 200 can detect the audio device 300. The electronic device 200 can establish a communication connection with the audio device 300 and perform audio input / output through the audio device 300. That is, even if the electronic device currently connected to the audio device 300 is not running an audio application, the electronic device 200 can preempt the audio device 300 and directly transmit audio streams to it.
[0223] As can be seen from the communication system 30 described above, electronic device 200 can simultaneously share audio device 300 for audio input / output with electronic device 100. When the audio outputs of both electronic devices 100 and 200 are enabled, audio device 300 can simultaneously play audio from both electronic devices 100 and 200. When the audio input of electronic device 200 is enabled, electronic device 200 can acquire the audio captured by audio device 300 through electronic device 100. When electronic devices 100 and 200 share audio device 300, audio device 300 can maintain a connection with electronic device 100 without frequently switching connections between them. This not only allows multiple electronic devices to meet their audio input / output needs promptly with a single audio device, but also simplifies the interaction between the audio device and these multiple electronic devices, improves audio transmission efficiency, and thus enhances the user experience for listening to or capturing audio.
[0224] Figure 3B A schematic diagram of a communication system 40 is shown as an example.
[0225] like Figure 3B As shown, the communication system 40 may include electronic device 100, electronic device 200 and audio device 300.
[0226] In some embodiments, the multi-device audio management module described above can be integrated into an audio application. For example, electronic device 100 includes audio application 1. Audio application 1 integrates a multi-device audio management module. Electronic device 200 includes audio application 2. Audio application 2 may also integrate a multi-device audio management module. Audio application 1 and audio application 2 can be the same application. For example, audio application 1 and audio application 2 can be the same conferencing application, or the same music application, etc. Alternatively, audio application 1 and audio application 2 can be different audio applications. For example, audio application 1 is a conferencing application, and audio application 2 is a music application. Audio application 1 and audio application 2 can be applications developed by the same application development company, or they can be applications developed by different application companies.
[0227] Audio applications 1 and 2 in electronic device 100 can transmit audio streams. For example, audio application 2 can send audio to be played in audio application 2 to electronic device 100. Audio application 1 in electronic device 100 can obtain audio to be played in audio application 2 through an audio input port. Audio application 1 can send audio captured by audio device 300 to electronic device 200. Audio application 2 in electronic device 200 can obtain audio captured by audio device 300 through an audio input port.
[0228] In this system, a control flow can be transmitted between the multi-device audio management module in audio application 1 and the multi-device audio management module in audio application 2. This control flow may include information indicating the audio input and output states of the electronic device 200. Audio application 1 can determine the audio input and output states of the electronic device 200 based on the multi-device audio management module integrated within audio application 1, and thus determine whether the audio collected by audio device 300 needs to be transferred to electronic device 200.
[0229] In some embodiments, in addition to audio application 1, electronic device 100 also includes other audio applications, such as audio application 3 (not shown in the figure). Audio application 3 may also integrate a multi-device audio management module. When the application occupying the audio input and audio output ports of electronic device 100 is switched from audio application 1 to audio application 3, electronic device 100 can transfer the audio input and audio output states of electronic device 200 to the multi-device audio management module in audio application 3. Audio application 3 can transmit audio streams with audio application 2 in electronic device 200. The aforementioned control stream can be transmitted between the multi-device audio management module in audio application 3 and the multi-device management module in audio application 2.
[0230] For example, audio application 1 is a music playback application. Audio application 3 is a conferencing application. When electronic device 100 plays music from the music playback application via audio device 300, the audio to be played in electronic device 200 can be transmitted to audio device 300 via the music playback application in electronic device 100. Audio device 300 can play the audio after mixing the music from the music playback application in electronic device 100 with the audio to be played in electronic device 200. If the conferencing application in electronic device 100 joins a conference, the conferencing application can preempt the audio input port and audio output port. The music playback application in electronic device 100 can pause music playback. Electronic device 100 can play the conference audio from the conferencing application via audio device 300. The audio to be played in electronic device 200 can be transmitted to audio device 300 via the conferencing application in electronic device 100. Audio device 300 can play the audio after mixing the conference audio from the conferencing application in electronic device 100 with the audio to be played in electronic device 200. Among them, the multi-device audio management module integrated in the conferencing application of electronic device 100 can transmit control streams with the multi-device audio management module integrated in the audio application 2 of electronic device 200.
[0231] Optionally, audio application 1 can display the audio output and audio input states of electronic device 200 based on the audio output and audio input states of electronic device 200 synchronized by the multi-device audio management module in audio application 1. Audio application 1 can also provide controls for controlling the audio output and / or audio output states of electronic device 200. When the application occupying the audio input and audio output ports in electronic device 100 is switched to another application, such as audio application 3, audio application 3 can display the audio output and audio input states of electronic device 200 synchronized by the multi-device audio management module in audio application 3. Audio application 3 can also provide controls for controlling the audio output and / or audio output states of electronic device 200.
[0232] Figure 3C A schematic diagram of a communication system 50 is shown as an example.
[0233] like Figure 3C As shown, the communication system 50 may include electronic device 100, electronic device 200 and audio device 300.
[0234] In some embodiments, the multi-device audio management module and the audio application described above can be independently configured in electronic device 100 and electronic device 200. Exemplarily, electronic device 100 includes audio application 1 and a multi-device audio management module. Electronic device 200 includes audio application 2 and a multi-device audio management module. Audio application 1 and audio application 2 can be the same application. For example, audio application 1 and audio application 2 can be the same conferencing application, or the same music application, etc. Alternatively, audio application 1 and audio application 2 can be different audio applications. For example, audio application 1 is a conferencing application, and audio application 2 is a music application. Audio application 1 and audio application 2 can be applications developed by the same application development company, or they can be applications developed by different application companies.
[0235] The multi-device audio management module in electronic device 100 can determine that electronic device 100 is connected to audio device 300. Electronic device 200 can send a request to electronic device 100 to use the audio device through its multi-device audio management module. If electronic device 100 agrees to electronic device 200 using audio device 300, electronic devices 100 and 200 can establish a communication connection through their respective multi-device audio management modules to transmit audio and control streams. Specifically, the multi-device audio management module in electronic device 100 can transmit control streams with the multi-device audio management module in electronic device 200 to synchronize the audio input and output states of electronic device 200.
[0236] Audio streams can be transmitted between audio application 1 of electronic device 100 and audio application 2 of electronic device 200. The transmission of audio streams between audio application 1 and audio application 2 can be referred to the description in the foregoing embodiments.
[0237] The multi-device audio management module in electronic device 100 can synchronize the audio input and output states of electronic devices 100 and 200 with audio application 1. When audio application 1 occupies both the audio input and audio output ports of electronic device 100, the audio input state of audio application 1 becomes the audio input state of electronic device 100, and the audio output state of audio application 1 becomes the audio output state of electronic device 100.
[0238] The multi-device audio management module in electronic device 200 can synchronize the audio input and audio output states of electronic device 200 with audio application 2.
[0239] In some embodiments, when the audio application occupying the audio input and audio output ports in electronic device 100 is switched to audio application 3 (not shown in the figure), the multi-device audio management module in electronic device 100 can synchronize the audio input and audio output states of electronic device 100 and electronic device 200 with audio application 3. When audio application 3 occupies the audio input and audio output ports of electronic device 100, the audio input state of audio application 3 is the audio input state of electronic device 100, and the audio output state of audio application 3 is the audio output state of electronic device 100. The application transmitting audio streams between electronic device 100 and electronic device 200 can also be switched from audio application 1 to audio application 3.
[0240] Based on the above communication system and equipment structure, some audio transmission scenarios provided in this application are described below.
[0241] Figures 4A-4E The illustrations are schematic diagrams of some audio transmission scenarios provided in this application.
[0242] like Figure 4A As shown, electronic device 100 can display user interface 410. User interface 410 can be a user interface for a conferencing application. For example, electronic device 100 accesses conference 1 through a conferencing application. User interface 410 can be a user interface for controlling and managing conference 1.
[0243] The user interface 410 may include a meeting time indicator 411, a video start control 412, a mute control 413, a sharing control 414, an invite control 415, an end control 416, and a search control 417.
[0244] The meeting time indicator 411 can be used to indicate the duration of the current meeting (e.g., meeting 1).
[0245] The video control 412 can be used to trigger the electronic device 100 to activate its camera and capture images. The electronic device 100 can then send the captured images to other electronic devices connected to Conference 1. This allows users of the electronic device 100 to conduct video conferences with other participants in Conference 1.
[0246] The mute control 413 can be used to trigger the electronic device 100 to stop recording audio. For example, a user of the electronic device 100 can mute themselves via the mute control 413 without needing to speak at the meeting. When mute is enabled, the user's voice will not be heard by other members of the meeting.
[0247] When mute is enabled, the audio input of electronic device 100 is turned off.
[0248] In some embodiments, the electronic device 100 establishes a communication connection with the audio device 300. The electronic device 100 can perform audio input and audio output through the audio device 300. In response to an operation of the mute control 413, the electronic device 100 can instruct the audio device 300 to stop capturing audio.
[0249] The sharing control 414 can be used to trigger screen sharing on electronic device 100. Electronic device 100 can then send the shared screen content to other electronic devices connected to conference 1. In this way, users of electronic device 100 can share the content displayed on their screen with other members of conference 1 for information presentation and explanation.
[0250] The invite control 415 can be used to invite members who have not yet joined Meeting 1 to join Meeting 1.
[0251] The end control 416 can be used to end the meeting 1.
[0252] Search control 417 can be used to search for electronic devices 100 that are connected to audio devices.
[0253] Electronic device 100 can receive audio sent by other electronic devices connected to conference 1 and send this audio to audio device 300. Audio device 300 can play the audio from the other electronic devices connected to conference 1. In this way, the user of electronic device 100 can listen to the speeches of other members participating in conference 1 through audio device 300.
[0254] When not muted, audio device 300 can capture audio and send it to electronic device 100. Electronic device 100 can then send the audio captured by audio device 300 to other electronic devices connected to conference 1. The audio captured by audio device 300 may include the voice of the user of electronic device 100. In this way, other members participating in conference 1 can hear the speech of the user of electronic device 100.
[0255] In addition to the controls mentioned above, the user interface 410 may also include more or fewer controls.
[0256] like Figure 4B As shown, electronic device 200 can display user interface 420. User interface 420 can be a user interface for a conferencing application. For example, electronic device 200 accesses conference 2 through a conferencing application. User interface 420 can be a user interface for controlling and managing conference 2.
[0257] The user interface 420 may include a meeting time indicator 421, a video start control 422, a mute control 423, a sharing control 424, an invite control 425, an end control 426, and a search control 427.
[0258] The meeting time indicator 421 can be used to indicate the duration of the current meeting (e.g., meeting 2). The video activation control 422 can be used to trigger electronic device 200 to activate its camera and capture images. The sharing control 424 can be used to trigger electronic device 200 to share its screen. The invite control 425 can be used to invite members who have not yet joined meeting 2 to join meeting 2. The end control 426 can be used to end meeting 2. For details on these controls, please refer to the foregoing. Figure 4A The following is an introduction to the meeting time indicator 411, the video start control 412, the sharing control 414, the invite participant control 415, and the end control 416.
[0259] The unmute control 423 can be used to trigger the electronic device 200 to capture audio. For example, a user of the electronic device 200 can unmute themselves by using the unmute control 423 if they need to speak at meeting 2. When unmuteed, the user's voice can be heard by other members of meeting 2.
[0260] When the mute function is released, the audio input of the electronic device 200 is enabled.
[0261] Search control 427 can be used to search for electronic devices 200 that are connected to audio devices.
[0262] In response to Figure 4B The operation of the search control 427 shown, such as a click operation, allows electronic device 200 to search for electronic devices in its vicinity that have audio devices connected to them. For example, electronic devices in the vicinity of electronic device 200 that have audio devices connected to them include electronic device 100.
[0263] When electronic device 100 is found, electronic device 100 can be displayed. Figure 4C The prompt box shown is 430.
[0264] like Figure 4C As shown, the prompt box 430 may include prompt information 431, connection control 432, and cancellation control 433.
[0265] The prompt message 431 can be used to prompt the user to use the audio device 300 through the electronic device 100, thereby enabling audio input and output of the electronic device 200. For example, the content of the prompt message 431 may include: Electronic device 100 has been found; connecting to electronic device 100 will output local audio through audio device 300; whether to connect. The content of the above prompt message 431 is merely an exemplary description of this application and should not be construed as limiting this application.
[0266] The connection control 432 can be used to trigger the electronic device 200 to request the establishment of a communication connection with the electronic device 100 using the audio device 300.
[0267] Cancel control 433 can be used to cancel the communication connection established between electronic device 200 and electronic device 100 using audio device 300.
[0268] In some embodiments, in response to an operation of the connection control 432, the electronic device 200 may request to establish a communication connection with the electronic device 100 to use the audio device 300. Optionally, the electronic device 100 may display a connection prompt. This connection prompt may include a control to agree to share the audio device 300 with the electronic device 200, and a control to refuse to share the audio device 300 with the electronic device 200. Thus, the user of the electronic device 100 can choose to agree to or refuse the electronic device 200's use of the audio device 300.
[0269] When electronic devices 100 and 200 establish a communication connection using audio device 300, electronic device 200 can send audio to be played from electronic device 100 to audio device 300. Audio device 300 can then play the audio from electronic device 200. For example, when electronic device 200 is connected to conference 2, the audio to be played may include audio from other electronic devices connected to conference 2. In this way, the user of electronic device 200 can listen to the speeches of other members participating in conference 2 through audio device 300.
[0270] Electronic device 200 can also acquire audio from audio device 300 via electronic device 100. Electronic device 200 can then send the audio acquired by audio device 300 to other electronic devices connected to conference 2. This allows other members of conference 2 to hear the speech of the user of electronic device 200.
[0271] In some embodiments, electronic device 100 and electronic device 200 are different devices belonging to the same user. A user may need to access multiple online meetings simultaneously. For example, a user can use electronic device 100 to access meeting 1 and electronic device 200 to access meeting 2. When electronic device 200 shares the audio device 300 with electronic device 100, the user can simultaneously listen to the speeches of meeting members in meeting 1 and meeting members in meeting 2 through the audio device 300. Furthermore, the user can control the audio input status of electronic devices 100 and 200, enabling them to speak in meeting 1 (where electronic device 100 is accessed, i.e., members of meeting 1 can hear the user's speech on electronic device 100) or in meeting 2 (where electronic device 200 is accessed, i.e., members of meeting 2 can hear the user's speech on electronic device 200).
[0272] In some embodiments, if a wireless connection is established between the electronic device 100 and the audio device 300, and no audio application is running on the electronic device 100, the electronic device 200 responds to Figure 4B The operation of the search control 427 shown can display a control for connecting to the audio device 300. In response to this control, the electronic device 200 can establish a communication connection with the audio device 300 and directly transmit audio streams to it. In this way, the electronic device 200 does not need to establish a communication connection with the electronic device 100, and therefore does not need to rely on the electronic device 100 to transfer audio streams between the audio device 300 and the electronic device 200.
[0273] In some embodiments, multiple electronic devices connected to audio devices are present around the electronic device 200. In response to Figure 4B As shown in the operation of the search control 427, the electronic device 200 can search for multiple electronic devices connected to audio devices. The electronic device 200 can provide options corresponding to these multiple electronic devices connected to audio devices, so that the user can select which audio device to use for audio input and audio output of the electronic device 200.
[0274] For example, such as Figure 4D As shown, when multiple electronic devices connected to audio devices are detected, electronic device 200 can display a prompt box 440. The prompt box 440 may include device options 441, 442, 443, and a cancel control 444.
[0275] Device option 441 can be used to select connection to electronic device 100. Electronic device 100 is connected to audio device 300. When electronic device 200 is connected to electronic device 100, electronic device 200 can use audio device 300 for audio input and audio output.
[0276] Device option 442 can be used to select an electronic device to connect to, named "Zhang San's Mobile Phone". This "Zhang San's Mobile Phone" is connected to an audio device named "Zhang San's Headphones". When electronic device 200 is connected to "Zhang San's Headphones", electronic device 200 can use "Zhang San's Headphones" for audio input and output.
[0277] Device option 443 can be used to select an electronic device to connect to, named "Li Si's Laptop". This "Li Si's Laptop" is connected to an audio device named "Li Si's Headphones". When electronic device 200 is connected to "Li Si's Laptop", electronic device 200 can use "Li Si's Headphones" for audio input and output.
[0278] The aforementioned electronic device 100, "Zhang San's mobile phone," and "Li Si's laptop" can all be electronic devices connected to audio devices that electronic device 200 can search for. Not limited to device options 441 to 443, electronic device 200 may also provide more or fewer device options corresponding to electronic devices connected to audio devices. The aforementioned device names are merely illustrative examples of this application and should not be construed as limiting this application.
[0279] Cancel control 444 can be used to cancel communication connections with other electronic devices that use audio devices.
[0280] In response to an operation on device option 441, such as a click operation, electronic device 200 can select device option 441 from... Figure 4D The unselected state is shown as Figure 4E The selected state is shown.
[0281] When device option 441 is selected, electronic device 200 can display connection control 445 in prompt box 440. In response to operation of connection control 445, electronic device 200 can establish a communication connection with electronic device 100 to use audio device 300. In this way, electronic device 200 can share audio device 300 with electronic device 100 through electronic device 100.
[0282] As can be seen, if there are multiple electronic devices connected to different audio devices around electronic device 200, the user can select one electronic device as needed to establish a logical audio transmission link with the audio device connected to that electronic device. The above embodiment can improve the user's experience in listening to and capturing audio. Users can choose to share a single audio device with multiple electronic devices, thereby enabling audio input / output from multiple electronic devices through a single audio device.
[0283] In some embodiments, if the electronic device 200 only detects one electronic device connected to an audio device, the electronic device 200 can directly establish a communication connection with the detected electronic device connected to an audio device, so as to use the corresponding audio device for audio input and audio output. That is, the electronic device 200 does not need to display anything. Figure 4C The prompt box shown is 430.
[0284] In some embodiments, upon receiving the above Figures 4C to 4D After the user operation shown is used to establish a connection with an electronic device connected to an audio device, the electronic device 200 can also provide relevant controls for setting audio input / output paths, allowing the user to set the audio device connected to the electronic device 200 as the audio input device and / or audio output device of the electronic device 200.
[0285] For example, electronic device 200 is connected to electronic device 100. Electronic device 100 is connected to audio device 300. Electronic device 200 may provide: audio input device access control, audio output device access control, and audio input and output device access control.
[0286] In response to an operation on the audio input device access control, electronic device 200 can treat audio device 300, with which it has a logical link, solely as an audio input device. Specifically, when audio input is enabled on electronic device 200, it can acquire audio from audio device 300 via electronic device 100 to perform the corresponding audio input service. When audio output is enabled on electronic device 200, it can play corresponding audio through its built-in audio output device (e.g., its speaker or earpiece). Electronic devices 100 and 200 can synchronize the audio input state of electronic device 200 without synchronizing its audio output state. Electronic device 100 can provide controls for controlling the audio input state of electronic device 200, but does not need to provide controls for controlling its audio output state.
[0287] In response to operations on the audio output device access control, electronic device 200 can treat audio device 300, with which it has a logical link, solely as an audio output device. Specifically, when audio output of electronic device 200 is enabled, it can send audio to be played to audio device 300 via electronic device 100 to achieve the corresponding audio output service. When audio input of electronic device 200 is enabled, it can capture audio through its built-in audio input device (e.g., its microphone). Electronic devices 100 and 200 can synchronize the audio output state of electronic device 200 without synchronizing its audio input state. Electronic device 100 can provide controls for controlling the audio output state of electronic device 200, but does not need to provide controls for controlling the audio input state of electronic device 200.
[0288] In response to operations on the audio input and output device access controls, electronic device 200 can use audio device 300, with which it has a logical link, as both an audio input device and an audio output device. Specifically, when audio input is enabled on electronic device 200, electronic device 200 can acquire audio collected by audio device 300 through electronic device 100 to perform the corresponding audio input service. When audio output is enabled on electronic device 200, electronic device 200 can send audio to be played to audio device 300 through electronic device 100 to perform the corresponding audio output service. Electronic device 100 and electronic device 200 can synchronize the audio input and audio output states of electronic device 200. Electronic device 100 can provide controls for controlling the audio input state and the audio output state of electronic device 200.
[0289] The above embodiments allow users to easily configure the audio input / output channels of the electronic device 200 according to their needs, thereby improving the user experience.
[0290] It should be noted that, not limited to the aforementioned conferencing applications, audio applications occupying the audio input and output ports of electronic device 200 can be other audio applications (such as music applications, call applications, etc.). The user interface of one or more audio applications in electronic device 200 may include the aforementioned... Figure 4BThe search control 427 is shown. When a user uses one or more audio applications in the electronic device 200, they can trigger the electronic device 200 to search for nearby electronic devices connected to audio devices through the search control 427. Optionally, the electronic device 200 can also provide the search control 427 in the user interface of non-audio applications (e.g., the settings interface of a settings application, a drop-down control interface, etc.). The electronic device 200 can search for nearby electronic devices connected to audio devices at any time (e.g., when no audio application is running) and establish a communication connection with them to use the audio devices. When the electronic device 200 has an audio input / output requirement, it can achieve audio input / output through a logical link with the audio device. This application embodiment does not limit the method by which the electronic device 200 provides the search control 427.
[0291] Figures 5A to 5G The illustrations are schematic diagrams of some audio transmission scenarios provided in this application.
[0292] like Figure 5A As shown, electronic device 100 establishes a communication connection with electronic device 200. Electronic device 100 also establishes a communication connection with audio device 300. Here, we will use User 1 as an example, where all users of electronic device 100, electronic device 200, and audio device 300 are considered to be User 1. Electronic device 100 can display a user interface 510. The user interface 510 can be referenced from the aforementioned... Figure 4A The user interface 410 is shown below. The electronic device 200 can display the user interface 520. The user interface 520 can be referenced from the foregoing. Figure 4B The user interface 520 shown is described below.
[0293] The user interface 520 may include an unmute control 521 and a local audio pause output control 522. The unmute control 521 can indicate that the audio input of the electronic device 200 is in a closed state, as detailed above. Figure 4B The unmute control 423 is shown. The local audio pause output control 522 can indicate that the audio output of the electronic device 200 is on, and can be used to turn off the audio output of the electronic device 200.
[0294] The user interface 510 may include a mute control 511, a local audio pause output control 512, an electronic device 200 audio pause output control 514, and an electronic device 200 unmute control 513. The mute control 511 can indicate that the audio input of the electronic device 100 is enabled; for details, please refer to the foregoing. Figure 4AThe mute control 413 is shown. The local audio pause output control 512 indicates that the audio output of electronic device 100 is on, and can be used to turn off the audio output of electronic device 100. The audio pause output control 514 of electronic device 200 indicates that the audio output of electronic device 200 is on, and can be used to turn off the audio output of electronic device 200. The unmute control 513 of electronic device 200 indicates that the audio input of electronic device 200 is off, and can be used to turn on the audio input of electronic device 200.
[0295] In some embodiments, electronic device 200 can send its current audio input and audio output states to electronic device 100. For example, if the audio input of electronic device 200 is currently off and the audio output is on, electronic device 100 can display the unmute control 513 based on the current audio input state of electronic device 200, and display the audio pause control 514 based on the current audio output state of electronic device 200.
[0296] As can be seen, the audio outputs of both electronic devices 100 and 200 are currently enabled. Electronic device 200 can send an audio stream to electronic device 100. For example, electronic device 200 is connected to conference 2. Electronic device 200 can receive audio from other electronic devices connected to conference 2. The audio stream sent by electronic device 200 to electronic device 100 may include the audio from other electronic devices connected to conference 2. Electronic device 100 is connected to conference 1. Electronic device 100 can receive audio from other electronic devices connected to conference 1. The audio to be played in electronic device 100 may include the audio from other electronic devices connected to conference 1. Electronic device 100 can mix the audio stream from electronic device 200 with the audio to be played in electronic device 100 and send the mixed audio to audio device 300. Audio device 300 can play the mixed audio. In this way, user 1 can simultaneously listen to the speeches of members participating in conference 1 and members participating in conference 2 through audio device 300.
[0297] This application does not limit the above-described mixing method. For example, the audio device 300 includes a left earphone and a right earphone. The audio played by the left earphone may be an audio stream mixed with the audio streams of electronic device 100 and electronic device 200. The audio played by the right earphone may also be an audio stream mixed with the audio streams of electronic device 100 and electronic device 200. Alternatively, the left earphone may play the audio stream of electronic device 100, and the right earphone may play the audio stream of electronic device 200.
[0298] Audio input is enabled on electronic device 100. Audio input is disabled on electronic device 200. Electronic device 100 can instruct audio device 300 to capture audio. Audio device 300 can send the captured audio stream to electronic device 100. The conferencing application in electronic device 100 can acquire the audio stream captured by audio device 300 and send it to other electronic devices connected to conference 1. The audio stream captured by audio device 300 may include the voice of the user (i.e., user 1) who uses electronic device 100 to access conference 1. In this way, other members of conference 1 can hear user 1's speech. Since audio input is disabled on electronic device 200, electronic device 100 will not send the audio stream captured by audio device 300 to electronic device 200; therefore, user 1's voice may not be heard by other members of conference 2.
[0299] like Figure 5B As shown, in response to the operation of the unmute control 521, the electronic device 200 can send an audio stream to the electronic device 100 and also send a message that the electronic device 200 is unmute.
[0300] like Figure 5C As shown, based on the above operation of the unmute control 521, the electronic device 200 can replace the unmute control 521 with the mute control 523. The mute control 523 can indicate that the audio input of the electronic device 200 is on, as detailed above. Figure 4A The mute control 413 is shown. Based on the message from the electronic device 200 to unmute, the electronic device 100 can replace the unmute control 513 with the mute control 515. The mute control 515 has the same function as the mute control 523; both can be used to trigger the electronic device 200 to unmute (i.e., disable audio input).
[0301] Optionally, when electronic devices 100 and 200 share an audio device 300, at most one of them can have its audio input enabled. Therefore, when the audio input of electronic device 200 is enabled, electronic device 100 can disable its audio input. Based on the message that electronic device 200 has been unmuted, electronic device 100 can also... Figure 5B The mute control 511 shown is replaced with Figure 5C The unmute control 516 is shown. The unmute control 516 can indicate that the audio input of the electronic device 100 is in a closed state, and can be used to turn on the audio input of the electronic device 100.
[0302] like Figure 5CAs shown, the audio outputs of both electronic devices 100 and 200 are currently enabled. Electronic device 200 can send its audio stream to electronic device 100. The audio stream of electronic device 200 can be referenced... Figure 5A The electronic device 100 can mix the audio stream from the electronic device 200 with the audio to be played in the electronic device 100, and send the mixed audio to the audio device 300. The audio device 300 can play the mixed audio. In this way, user 1 can listen to the speeches of the members attending meeting 1 and the members attending meeting 2 simultaneously through the audio device 300.
[0303] Audio input is off on electronic device 100. Audio input is on on electronic device 200. Audio device 300 can send the captured audio stream to electronic device 100. Electronic device 100 can send the audio stream captured by audio device 300 to electronic device 200. The conferencing application in electronic device 200 can acquire the audio stream captured by audio device 300 and send it to other electronic devices connected to conference 2. In this way, user 1's voice can be heard by other members of conference 2, but not by other members of conference 1.
[0304] As can be seen, when User 1 wants to speak in Meeting 2, User 1 can turn on the audio input of Electronic Device 200 (i.e., unmute) by using the unmute control 521 or the unmute control 513 of Electronic Device 200. Specifically, when Electronic Device 200 turns on the audio input, Electronic Device 100 can automatically turn off the audio input. This simplifies user operation, eliminating the need for users to manually control the audio input. Figure 5B The mute control 511 shown is operated to turn off the audio input of the electronic device 100. This method prevents the speaker's remarks at meeting 2 from being heard by members of meeting 1.
[0305] Similarly, when electronic device 100 enables audio input, it can instruct electronic device 200 to disable audio input. This allows user 1 to speak in meeting 1 connected to electronic device 100 without their speech being heard by members in meeting 2 connected to electronic device 200.
[0306] Optionally, the audio outputs of electronic devices 100 and 200 can be simultaneously enabled. For example, after receiving the audio stream captured by audio device 300, the conferencing application in electronic device 100 can send the audio stream captured by audio device 300 to other electronic devices connected to conference 1. Electronic device 100 can also send the audio stream captured by audio device 300 to electronic device 200. The conferencing application in electronic device 200 can send the audio stream captured by audio device 300 to other electronic devices connected to conference 2. In this way, members of both conference 1 and conference 2 can hear user 1's speech.
[0307] The audio outputs of electronic devices 100 and 200 can be simultaneously turned off. When the audio outputs of both electronic devices 100 and 200 are off, electronic device 100 can instruct audio device 300 to stop capturing audio. For example, when user 1 does not need to speak at meetings 1 and 2, user 1 can... Figure 5B The mute control 511 shown turns off (i.e. mutes) the audio input of the electronic device 100, and through... Figure 5C The mute control 523 shown or the mute control 515 of the electronic device 200 turns off the audio input of the electronic device 200.
[0308] In response to Figure 5D The operation shown for the local audio pause output control 512 allows the electronic device 100 to replace the local audio pause output control 512 with... Figure 5E The local audio output continuation control 517 is shown. The local audio output continuation control 517 can indicate that the audio output of the electronic device 100 is in a closed state, and can be used to turn on the audio output of the electronic device 100.
[0309] like Figure 5E As shown, the audio output of electronic device 100 is off. The audio output of electronic device 200 is on. Electronic device 200 can send its own audio stream to electronic device 100. Electronic device 100 can also send its own audio stream to audio device 300. Audio device 300 can play the audio stream from electronic device 200. The audio stream from electronic device 200 can include the voices of other members participating in conference 2. Electronic device 100 can receive audio from other electronic devices connected to conference 1. Because the audio output of electronic device 100 is off, it does not need to send the audio from other electronic devices connected to conference 1 to audio device 300. Thus, the user can listen only to the speeches of members participating in conference 2 through audio device 300, without listening to the speeches of members participating in conference 1.
[0310] Furthermore, the audio input of electronic device 100 is off. The audio input of electronic device 200 is on. Electronic device 100 can send the audio stream captured by audio device 300 to electronic device 200. See the foregoing for details. Figure 5C Introduction.
[0311] It should be noted that although the audio input and audio output of electronic device 100 are currently turned off, audio applications are still running in electronic device 100 (e.g., Figure 5E (As shown in the conference application). Therefore, electronic device 200 can maintain a connection with electronic device 100 and realize the flow of audio stream between audio device 300 and electronic device 200 through electronic device 100. Specifically, the conference application in electronic device 100 can acquire the audio stream from electronic device 200 and send the audio stream from electronic device 200 to audio device 300. Similarly, the conference application in electronic device 100 can acquire the audio stream captured by audio device 300 and send the audio stream captured by audio device 300 to electronic device 200.
[0312] In some embodiments, electronic device 100 terminates conference 1 and terminates the operation of the conference application. When no audio application is running on electronic device 100, electronic device 100 and electronic device 200 use audio device 300 for communication. Electronic device 200 can use its built-in audio input / output devices for audio input / output. For example, in Figure 5E After Meeting 1 concludes, electronic device 100 terminates its conference application, and no other audio applications are running on electronic device 100. Electronic device 100 can then disconnect from electronic device 200. Electronic device 200 can then use its built-in audio output device (e.g., the speaker of electronic device 200) to play the audio from Meeting 2 and its built-in audio input device (e.g., the microphone of electronic device 200) to capture audio. After Meeting 1 concludes on electronic device 100, the user can connect audio device 300 to electronic device 200. In this way, electronic device 200 can directly transmit audio streams to audio device 300 for audio input / output services.
[0313] In the case where electronic device 200 is connected to audio device 300 and an audio application is running on electronic device 200, if electronic device 100 needs to perform audio input / output again, electronic device 100 can connect to electronic device 200. Electronic device 100 can then use the audio application in electronic device 200 to transfer audio streams between audio device 300 and electronic device 100.
[0314] like Figure 5FAs shown, in response to the operation of the audio pause output control 514 of the electronic device 200, the electronic device 100 can send a message to the electronic device 200 that the electronic device 200 has paused audio output.
[0315] like Figure 5G As shown, based on the above operation of the audio pause output control 514 of electronic device 200, electronic device 100 can replace the operation of the audio pause output control 514 of electronic device 200 with the audio resume output control 518 of electronic device 200. The audio resume output control 518 of electronic device 200 can indicate that the audio output of electronic device 100 is in a closed state, and can be used to turn on the audio output of electronic device 200.
[0316] Based on the message that the electronic device 200 pauses audio output, the electronic device 200 can turn off the audio output and... Figure 5F The local audio pause output control 522 shown is replaced with Figure 5G The local audio continuation output control 524 is shown. The local audio continuation output control 524 has the same function as the audio continuation output control 518 of the electronic device 200; both can be used to trigger the electronic device 200 to start audio output. Specifically, when audio output is turned off, the electronic device 200 can stop sending its audio stream to the electronic device 100.
[0317] With the audio output of electronic device 100 enabled, electronic device 100 can send its audio stream to audio device 300. The audio stream of electronic device 100 may include the voices of other members participating in meeting 2. Thus, a user can listen only to the speeches of members participating in meeting 1 through audio device 300, without listening to the speeches of members participating in meeting 2.
[0318] In addition, the audio input of electronic device 100 is enabled. The audio input of electronic device 200 is disabled. The conferencing application in electronic device 100 can send the audio stream captured by audio device 300 to other electronic devices connected to conference 1. See the foregoing for details. Figure 5A Introduction.
[0319] The above Figure 5B The electronic device 200 is shown with an unmute control 513 and an audio pause output control 514. Figure 5D The electronic device 200 shown has a mute control 515, and Figure 5GThe audio continue output control 518 of the electronic device 200 shown can contain status information of the electronic device 200 (such as control icon, text information in the control, etc.). Based on the unmute control 513 and mute control 515 of the electronic device 200, the user can know whether the audio input of the electronic device 200 is enabled. Based on the audio pause output control 514 and audio continue output control 518 of the electronic device 200, the user can know whether the audio output of the electronic device 200 is enabled. When the audio input of the electronic device 200 is enabled, the electronic device 100 can update the unmute control 513 to the mute control 515. When the audio output of the electronic device 200 is enabled, the electronic device 100 can update the audio continue output control 518 to the audio pause output control 514.
[0320] It should be noted that the controls for turning on / off the audio input and audio output of electronic device 100 and the controls for turning on / off the audio input and audio output of electronic device 200 are merely illustrative examples of this application.
[0321] In some embodiments, the electronic device 100 may also store audio input status information and audio output status information of the electronic device 200. When the audio input status of the electronic device 200 changes, the electronic device 100 may update the audio input status information of the electronic device 200 stored in its memory. When the audio output status of the electronic device 200 changes, the electronic device 100 may update the audio output status information of the electronic device 200 stored in its memory.
[0322] As described above, electronic device 200 can share audio device 300 for audio input / output simultaneously with electronic device 100, thanks to the assistance of electronic device 100. When both electronic devices 100 and 200 have their audio output enabled, audio device 300 can simultaneously play audio from both electronic devices 100 and 200. Audio device 300 can maintain a connection with electronic device 100 without frequently switching connections between them. Users can quickly listen to audio from electronic devices 100 and / or 200 and quickly input audio into them by enabling or disabling the audio input / output of both devices. In other words, users do not need to wait for audio device 300 to complete the connection switch before inputting or listening to audio from the connected electronic device. This method simplifies the interaction between audio device 300 and multiple electronic devices, improves audio transmission efficiency, and thus enhances the user experience for listening to or capturing audio.
[0323] Figure 6 An exemplary flowchart of an audio transmission method provided in this application is shown.
[0324] If electronic device 100 does not establish a communication connection with other electronic devices to use audio device 300, then audio device 300 can be used solely for audio input / output of electronic device 100. After electronic device 100 establishes a communication connection with other electronic devices to use audio device 300, audio device 300 can be used for audio input / output of multiple electronic devices.
[0325] Scenario 1: Electronic device 100 uses audio device 300 for audio input / output only.
[0326] S611, Electronic device 100 sends audio a1 of electronic device 100 to audio device 300.
[0327] Audio a1 can be audio to be played by any audio application in electronic device 100. For example, electronic device 100 connects to conference 1 via a conferencing application. Audio a1 can include audio sent to electronic device 100 by other electronic devices connected to conference 1. As another example, electronic device 100 opens a music application. Audio a1 can include audio corresponding to the music currently playing in the music application. As yet another example, electronic device 100 conducts a voice call via a calling application. Audio a1 can include audio sent to electronic device 100 by the other end of the call. This application embodiment does not limit the scope of audio a1 described above.
[0328] S612, Audio device 300 plays audio a1.
[0329] S613, Audio device 300 acquires audio a2.
[0330] S614, Audio device 300 sends audio a2 to electronic device 100.
[0331] If the audio input of electronic device 100 is enabled, electronic device 100 can instruct audio device 300 to capture audio. Audio device 300 can then send the captured audio a2 to electronic device 100.
[0332] S615, Electronic device 100 implements function 1 based on audio a2.
[0333] An audio application occupying the audio input port in electronic device 100 can obtain audio a2 through the audio input port and implement function 1 based on audio a2. For example, electronic device 100 accesses conference 1 through a conferencing application. The conferencing application can obtain audio a2 and send audio a2 to other electronic devices accessing conference 1. That is, function 1 can be the function of a user speaking in the aforementioned conference 1. As another example, electronic device 100 conducts a voice call through a calling application. The calling application can obtain audio a2 and send audio a2 to the other end of the call. That is, function 1 can be a voice call function. As yet another example, electronic device 100 starts a recording application. The recording application can obtain audio a2 and save audio a2 as a recording file. That is, function 1 can be a recording function. The embodiments of this application do not limit the above-mentioned function 1.
[0334] If the audio input of the electronic device 100 is turned off, the electronic device 100 can instruct the audio device 300 to stop capturing audio.
[0335] Scenario 2: Electronic device 100 and electronic device 200 share audio device 300 for audio input / output.
[0336] 1. Both electronic device 100 and electronic device 200 output audio, while electronic device 100 inputs audio.
[0337] S616, electronic device 100 and electronic device 200 establish a communication connection.
[0338] Electronic device 100 and electronic device 200 can establish a communication connection for using audio device 300. Electronic device 200 can use audio device 300 for audio input / output with electronic device 100.
[0339] In one possible implementation, electronic device 200 can discover nearby electronic devices connected to audio devices, such as electronic device 100, using a distributed soft bus discovery technology. Electronic device 200 can then establish a communication connection with electronic device 100 using distributed soft bus connection technology. Specifically, electronic device 200 can send a request to electronic device 100 to use audio device 300. Electronic device 100 can agree to or refuse the request. If electronic device 100 agrees to the request, electronic device 100 and electronic device 200 can establish a communication connection for using audio device 300. Then, electronic device 100 and electronic device 200 can transmit audio streams and control streams using distributed soft bus transmission technology. This application embodiment does not limit the method by which electronic device 200 discovers electronic device 100, establishes a communication connection with electronic device 100, and performs data transmission.
[0340] The scenario for establishing a communication connection between electronic device 100 and electronic device 200 can be referred to the above. Figures 4A-4E The scene shown.
[0341] S617, Electronic device 200 receives user operation 1, which is used to turn on the audio output of electronic device 200 and turn off the audio input of electronic device 200.
[0342] For example, refer to the above Figures 5A to 5G In the scenario shown, electronic device 200 connects to conference 2 via a conferencing application. User operation 1 may include... Figure 5G The operation of the local audio output control 524 is shown, as well as the operation of... Figure 5C The operation of the mute control 523 is shown.
[0343] For example, electronic device 200 includes a music application. User operation 1 may include playing a specified piece of music from the music application.
[0344] This application embodiment does not limit user operation 1.
[0345] S618, Electronic device 200 sends the audio input status and audio output status of electronic device 200 to electronic device 100.
[0346] In this case, the audio input of the electronic device 200 is in the off state, while the audio output is in the on state.
[0347] S619, Electronic device 200 sends audio a3 of electronic device 200 to electronic device 100.
[0348] Audio a2 can be any audio to be played by any audio application in electronic device 200. Refer to the description of audio a1 above for details on audio a2.
[0349] S620 and electronic device 100 mix audio a1 and audio a3 to obtain audio a4.
[0350] In one possible implementation, the electronic device 100 can provide options corresponding to multiple mixing methods. The electronic device 100 can mix audio a1 and audio a3 according to the mixing method selected by the user. This application embodiment does not limit the above-described mixing method.
[0351] S621, Electronic device 100 sends audio a4 to audio device 300.
[0352] S622, Audio device 300 plays audio a4.
[0353] Steps S620 and S622 described above are optional. In one possible implementation, the electronic device 100 may not mix audio a1 and audio a3. Instead, the electronic device 100 can send audio a1 to the audio device 300. Upon receiving audio a3, the electronic device 100 can send audio a3 to the audio device 300. Audio a1 and audio a3 can be transmitted to the audio device 300 as two different audio streams.
[0354] In one possible implementation, electronic device 100 can provide corresponding controls based on the audio input and audio output states of electronic device 200 to change these states. For example, as can be seen from step S617 above, electronic device 200 is currently enabling audio output and disabling audio input. Electronic device 100 can provide the aforementioned... Figure 5A The electronic device 200 is shown with an audio pause output control 514 and an unmute control 513. This allows the user to adjust the audio input and output states of both the electronic device 100 and the electronic device 200.
[0355] This application embodiment does not limit the controls used to change the audio input and audio output states of the electronic device 200. In different audio applications, the controls used to change the audio input state of the electronic device 200 may be different, and the controls used to change the audio output state of the electronic device 200 may also be different. For example, if the audio output scenario of the electronic device 200 is an audio playback scenario, the controls used to change the audio output state of the electronic device 200 may include controls to pause music playback and controls to resume music playback. If the audio output scenario of the electronic device 200 is a video playback scenario, the controls used to change the audio output state of the electronic device 200 may include controls to pause video playback and controls to resume video playback. If the audio input scenario of the electronic device 200 is a recording scenario, the controls used to change the audio input state of the electronic device 200 may include controls to pause recording and controls to resume recording.
[0356] S623, Audio device 300 captures audio a5.
[0357] S624, Audio device 300 sends audio a5 to electronic device 100.
[0358] S625, Electronic device 100 implements function 1 based on audio a5.
[0359] Since the audio input of electronic device 200 is off and the audio input of electronic device 100 is on, electronic device 100 does not need to send audio a5 to electronic device 200. The method by which electronic device 100 implements function 1 based on audio a5 can be referred to the description of step S615 above.
[0360] It should be noted that if the audio applications occupying the audio input port are different when the electronic device 100 receives audio a2 and audio a5, the functions implemented by the electronic device 100 based on audio a2 and audio a5 can be different. For example, if the electronic device 100 is accessing conference 1 through a conferencing application when it receives audio a2, then the electronic device 100 can implement the function of the user speaking in conference 1 based on audio a2. If the electronic device 100 is conducting a voice call through a calling application when it receives audio a5, then the electronic device 100 can implement the voice call function based on audio a2.
[0361] 2. Both electronic device 100 and electronic device 200 output audio, while electronic device 200 inputs audio.
[0362] S626, Electronic device 200 receives user operation 2, user operation 1 is used to enable audio input of electronic device 200.
[0363] For example, refer to the above Figures 5A to 5GIn the scenario shown, electronic device 200 accesses conference 2 via a conferencing application. User operation 2 may include the aforementioned... Figure 5B The operation shown is for unmute control 521.
[0364] For example, electronic device 200 includes a recording application. User operation 2 may include starting recording in the recording application. This application embodiment does not limit user operation 2.
[0365] S627, Electronic device 200 sends the audio input status of electronic device 200 to electronic device 100.
[0366] The audio input of the electronic device 200 can be turned on.
[0367] S628. Based on the audio input status of electronic device 200, electronic device 100 determines that electronic device 200 is a device receiving audio and turns off the audio input of electronic device 100.
[0368] In one possible implementation, electronic device 100 can update the control used to change the audio input state of electronic device 200 based on the audio input state of electronic device 200. For example, when receiving the audio input state of electronic device 200 in step S627 above, electronic device 100 can update the control used to change the audio input state of electronic device 200. Figure 5B The demute control 513 of the electronic device 200 shown is replaced with Figure 5C The electronic device 200 shown has a mute control 515.
[0369] When the audio input of electronic device 100 is turned off, electronic device 100 can update the controls used to change the audio input state of electronic device 100. For example, the audio input scenario of electronic device 100 is an online meeting scenario. When the audio input of electronic device 100 is turned off, electronic device 100 can update the aforementioned controls. Figure 5B The mute control 511 shown is replaced with Figure 5C The unmute control 516 is shown. This application embodiment does not limit the controls described above for changing the audio input and audio output states of the electronic device 100.
[0370] S629, Electronic device 200 sends audio a3 of electronic device 200 to electronic device 100.
[0371] As can be seen from the aforementioned steps S617 to S622, the audio output of electronic device 200 is turned on. When the audio output of electronic device 200 is not turned off, electronic device 200 can continuously send audio to be played, such as audio a3, to electronic device 100.
[0372] S630 and electronic device 100 mix audio a1 and audio a3 to obtain audio a4.
[0373] S631, Electronic device 100 sends audio a4 to audio device 300.
[0374] S632, Audio device 300 plays audio a4.
[0375] S633, Audio device 300 captures audio a6.
[0376] S634, Audio device 300 sends audio a6 to electronic device 100.
[0377] S635, Electronic device 100 sends audio a6 to electronic device 200.
[0378] Since the audio input of electronic device 200 is enabled, electronic device 100 can send audio a6 to electronic device 200.
[0379] S636, Electronic device 200 implements function 2 based on audio a6.
[0380] Function 2 can be referred to the description of Function 1 above. It will not be repeated here. In particular, since the audio input of electronic device 100 is turned off, the audio application in electronic device 100 can achieve audio input function without using audio a6.
[0381] When the audio application occupying the audio input port in the electronic device 200 changes, the audio input function implemented by the electronic device 200 based on audio a2 can also change accordingly.
[0382] It should be noted that in step S628 above, turning off the audio input of electronic device 100 when turning on the audio input of electronic device 200 is optional. For example, when the audio input of electronic device 200 is turned on, electronic device 100 can still keep its audio input on. In this way, when the aforementioned audio a2 is received, in addition to performing step S635 above, electronic device 100 can also implement the corresponding audio input function (such as function 1 above) based on audio a6.
[0383] In one possible implementation, electronic device 100 can receive operations for adjusting the audio input state and / or audio output state of electronic device 200. Electronic device 100 can then send a message to electronic device 200 indicating the adjustment of the audio input state and / or audio output state. Electronic device 200 can adjust the audio input state and / or output state according to this message.
[0384] For example, when audio input is enabled on electronic device 200, electronic device 100 receives an operation to disable audio input on electronic device 200. In response to the operation to disable audio input, electronic device 100 can send a message to electronic device 200 to disable audio input. Based on this message, electronic device 200 can disable audio input. Electronic device 100 can replace the control for disabling audio input with a control for enabling audio input. Similarly, electronic device 200 can replace the control for disabling audio input with a control for enabling audio input. This allows the user to re-enable audio input on either electronic device 100 or electronic device 200.
[0385] For example, when the audio output of electronic device 200 is on, electronic device 100 receives an operation to turn off the audio output of electronic device 200. In response to the operation to turn off the audio output of electronic device 200, electronic device 100 can send a message to electronic device 200 to turn off the audio output. Based on the aforementioned message, electronic device 200 can turn off the audio output. Specifically, electronic device 100 can replace the control used to turn off the audio output of electronic device 200 with a control used to turn on the audio output of electronic device 200. Similarly, electronic device 200 can replace the control used to turn off the audio output of electronic device 200 with a control used to turn on the audio output of electronic device 200. In this way, the user can operate on either electronic device 100 or electronic device 200 to re-enable the audio output of electronic device 200.
[0386] In some embodiments, electronic devices 100 and 200 can adjust their audio input / output states according to a preset strategy. The preset strategy may include an audio output strategy and / or an audio input strategy. This eliminates the need for users to manually adjust the audio input / output states of electronic devices 100 and 200.
[0387] The electronic device 100 can store priority sequences for different audio output services and different audio input services. A preset audio output strategy may include: when multiple electronic devices share the audio device 300 for audio output, enabling the audio output of the electronic device with the highest audio output priority and disabling the audio output of other electronic devices. A preset audio input strategy may include: when multiple electronic devices share the audio device 300 for audio input, enabling the audio input of the electronic device with the highest audio input priority and disabling the audio input of other electronic devices.
[0388] For example, in a music application, music playback has a lower priority than voice call functionality in a call application. Electronic devices 100 and 200 share audio device 300 for audio input / output. When audio output is enabled on electronic device 100, music from its music application is played via audio device 300. When electronic device 200 answers a voice call, electronic device 100 can enable both audio input and output. Electronic device 200 can send audio from the voice call to electronic device 100. Electronic device 100 can recognize that the audio output functionality of the audio to be played on electronic device 200 has a higher priority than the music playback functionality. Therefore, electronic device 100 can pause music playback, effectively turning off its audio output. Electronic device 100 can then send audio from electronic device 200 to audio device 300. Thus, if a user is listening to music on electronic device 100 using audio device 300 and electronic device 200 receives a voice call, the user can directly use audio device 300 to answer the voice call on electronic device 200 after answering the call. Furthermore, to avoid interfering with the user's voice calls on the electronic device 200, the electronic device 100 can automatically pause music playback.
[0389] It should be noted that after adjusting the audio input and output states of electronic devices 100 and / or 200 according to the aforementioned preset strategies, electronic devices 100 and / or 200 can also adjust their audio input / output states manually by the user. For example, a user can manually enable the audio output of electronic devices with lower audio output service priority and disable the audio output of electronic devices with higher audio output service priority as needed.
[0390] The above audio output and audio input strategies are merely illustrative examples of this application and should not be construed as limiting this application.
[0391] In some embodiments, after electronic device 200 establishes a communication connection with electronic device 100, electronic device 200 can also switch to other electronic devices to use the audio devices connected to other electronic devices for audio input / output.
[0392] For example, when electronic device 200 and electronic device 100 share audio device 300 for audio input / output, electronic device 200 can search for nearby electronic devices connected to audio devices. (Refer to the foregoing.) Figure 4EAccording to the introduction, electronic device 200 can also search for "Zhang San's mobile phone". Electronic device 200 can establish a communication connection with "Zhang San's mobile phone", thereby sharing "Zhang San's headset" for audio input / output. After establishing a communication connection with "Zhang San's mobile phone", electronic device 200 can send audio to be played from electronic device 200 to "Zhang San's mobile phone". "Zhang San's mobile phone" can then pass the audio to be played from electronic device 200 to "Zhang San's headset" for playback. Electronic device 200 can also obtain audio captured by "Zhang San's headset" through "Zhang San's mobile phone". In this way, electronic device 200 can switch the audio input / output device from audio device 300 to "Zhang San's headset".
[0393] As described above, electronic device 200 can simultaneously share audio device 300 for audio input / output with electronic device 100 via electronic device 100. When both electronic devices 100 and 200 have their audio outputs enabled, audio device 300 can simultaneously play audio from both electronic devices 100 and 200. Electronic devices 100 and 200 can flexibly adjust their audio input / output states according to preset strategies and / or user adjustments. While adjusting the audio input / output states of electronic devices 100 and 200, audio device 300 can maintain a connection with electronic device 100 without frequently switching connections between them. This avoids audio transmission delays caused by switching connected electronic devices. This method simplifies the interaction between audio device 300 and multiple electronic devices, improves audio transmission efficiency, and thus enhances the user experience for listening to or capturing audio.
[0394] Figure 7 An exemplary flowchart of an audio transmission method provided in this application is shown.
[0395] S711, electronic device 100 and electronic device 200 establish a communication connection.
[0396] Step S711 can be referred to the above. Figure 6 The following is an explanation of step S616.
[0397] S712, Electronic device 100 receives user operation 3, which is used to enable audio input and audio output of electronic device 200 and disable audio input and audio output of electronic device 100.
[0398] Electronic device 100 can turn off its audio input and audio output according to user operation 3. For example, electronic device 100 connects to conference 1 through a conferencing application. When both audio input and audio output of electronic device 100 are on, electronic device 100 can pass audio from other electronic devices connected to conference 1 to audio device 300 for playback, and send audio collected by audio device 300 to other electronic devices connected to conference 1. When audio input and audio output of electronic device 100 are turned off, electronic device 100 can stop sending audio from other electronic devices connected to conference 1 to audio device 300, and stop sending audio collected by audio device 300 to other electronic devices connected to conference 1.
[0399] In this setup, both audio input and audio output of electronic device 100 are turned off, but an audio application (such as a conferencing application) is still running on electronic device 100. Therefore, electronic device 200 can maintain a connection with electronic device 100 and enable the flow of audio streams between audio device 300 and electronic device 200 through the audio application running on electronic device 100.
[0400] S713, Electronic device 100 sends the audio input status and audio output status of electronic device 200 to electronic device 200.
[0401] In response to user operation 3 described above, electronic device 100 can send a message to electronic device 200 to adjust the audio input and audio output states. This message may include the adjusted audio input and audio output states of electronic device 200. Electronic device 200 can adjust the audio input and audio output states according to this message. For example, electronic device 200 can enable audio input and audio output.
[0402] S714, Electronic device 200 sends audio a3 of electronic device 200 to electronic device 100.
[0403] After the electronic device 200 turns on its audio output, it can send audio a3 to the electronic device 100. Audio a3 can be referred to the description in the foregoing embodiments.
[0404] S715, Electronic device 100 sends audio a3 to audio device 300.
[0405] Since the audio output of electronic device 100 is turned off, electronic device 100 can directly send audio a3 to audio device 300 without mixing.
[0406] S716, Audio device 300 plays audio a3.
[0407] S717, Audio Device 300 Acquires Audio a7.
[0408] S718, Audio device 300 sends audio a7 to electronic device 100.
[0409] S719. Electronic device 100 determines that electronic device 200 is a device for receiving audio based on the audio input status of electronic device 200.
[0410] S720, Electronic device 100 sends audio a7 to electronic device 200.
[0411] Electronic device 100 can store the latest audio input status of electronic device 200. When the audio input of electronic device 100 is currently enabled, electronic device 100 can send the audio (e.g., audio a7) captured by audio device 300 to electronic device 200.
[0412] S721, Electronic device 200 implements function 2 based on audio a7.
[0413] Function 2 can be described in the foregoing embodiments. It will not be repeated here.
[0414] As described above, electronic device 200 can simultaneously share audio device 300 for audio input / output with electronic device 100 via electronic device 100. When both electronic devices 100 and 200 have their audio outputs enabled, audio device 300 can simultaneously play audio from both electronic devices 100 and 200. Audio device 300 can maintain a connection with electronic device 100 without frequently switching connections between them. Users can quickly listen to audio from electronic devices 100 and / or 200 and quickly input audio into them by enabling or disabling the audio input / output of electronic devices 100 and / or 200. In other words, users do not need to wait for audio device 300 to complete the connection switch before inputting or listening to audio from the connected electronic device. This method simplifies the interaction between audio device 300 and multiple electronic devices, improves audio transmission efficiency, and thus enhances the user experience for listening to or capturing audio.
[0415] Figure 8 An exemplary flowchart of an audio transmission method provided in this application is shown.
[0416] S811, The first device sends a first audio to the audio device, the first audio being the audio of the first audio application in the first device.
[0417] The first device can be the electronic device 100 in the foregoing embodiments. The audio device can be the audio device 300 in the foregoing embodiments. A communication connection is established between the first device and the audio device. The first device can perform audio input and / or audio output services through the audio device.
[0418] For example, a first audio application in a first device has a first audio file to be played. The first device can send the first audio file to an audio device. The audio device can play the first audio file. The first audio application can refer to the description of audio application 1 in the embodiment.
[0419] The first audio may refer to this application. Figure 5G The audio stream of the electronic device 100 shown. A second audio stream can be referenced in this application. Figure 5C The audio stream captured by the audio device 300 shown.
[0420] S812, The first device receives the second audio collected by the audio device and sends the second audio to the second device.
[0421] The first device can establish a communication connection with the second device. The second device can be the electronic device 200 in the aforementioned embodiments. The process of establishing a communication connection between the first device and the second device can be referred to the aforementioned... Figures 4A-4E The scene shown.
[0422] The first audio input service in the second device is in progress. The first audio input service may include services that require audio acquisition, such as recording, sending voice messages, and making voice calls. This application embodiment does not limit the type of the first audio input service. The second device can obtain the second audio collected by the audio device by establishing a logical audio transmission link between the first device and the audio device.
[0423] S813, The second device uses the second audio as the audio input for the first audio input service.
[0424] For example, the first audio input service is a voice call. The second device can send the second audio to the device at the other end of the voice call. Alternatively, the first audio input service is recording. The second device can save the second audio as a recording file.
[0425] As can be seen, the audio device can simultaneously meet the audio output requirements of the first device and the audio input requirements of the second device while maintaining a connection with the first device. This method not only allows users to conveniently use a single audio device to simultaneously achieve audio input / output for multiple electronic devices, improving the user's audio listening or recording experience, but also simplifies the interaction between the audio device and multiple electronic devices, improving audio transmission efficiency.
[0426] In some embodiments, a second audio application in the second device has a third audio to be played. The second device can send the third audio to the first device. The first device can mix the first and third audio to obtain a fourth audio. The first device can send the fourth audio to an audio device. The audio device can play the fourth audio. In this way, a user can simultaneously listen to the audio to be played on both the first and second devices through the audio device. Furthermore, during the above process, the audio device can always maintain a connection with the first device without switching connections between the first and second devices. This can improve the efficiency of audio transmission.
[0427] In some embodiments, when a first audio application in a first device stops playing the first audio, the first device may stop sending the first audio to the audio device. If a second audio application in a second device still has a third audio to play, the second device may continue sending the third audio to the first device. The first device may send the third audio to the audio device independently without mixing. The audio device may then play the third audio.
[0428] In some embodiments, the second device may receive an operation to control the second device to turn on or off audio output. Optionally, the first device may receive an operation to control the second device to turn on or off audio output, and instruct the second device to turn on or off audio output based on the operation. See the foregoing for details. Figures 5A to 5G The scene shown.
[0429] In some embodiments, the second audio input service in the first device may be in progress. The first device can use the second audio collected by the aforementioned audio device as the audio input for the second audio input service. The second audio input service may include: recording, sending voice messages, voice calls, and other services that require audio collection. This application embodiment does not limit the type of the second audio input service.
[0430] Specifically, while the first device uses the second audio for its second audio input service, it can also send the second audio to the second device, allowing the second device to use the second audio for its first audio input service. In other words, the audio inputs of both the first and second devices can be enabled simultaneously. Both devices can use the second audio collected by the audio device for their respective audio input services at the same time.
[0431] Alternatively, if the first device uses the second audio for the second audio input service, and the second device enables audio input, the first device can stop the second audio input service and send the second audio to the second device. The second device can then use the second audio for the first audio input service. Alternatively, if the first device sends the second audio to the second device, and the second device uses the second audio for the first audio input service, and the first device enables audio input, the first device can stop sending the second audio to the second device. The second device can then stop the first audio input service or use audio collected by its own audio input device for the first audio input service. The first device can then use the second audio for the second audio input service.
[0432] The second device can receive an operation to control the second device to enable or disable audio input. Optionally, the first device can receive an operation to control the second device to enable or disable audio input, and instruct the second device to enable or disable audio input based on the operation. See the foregoing for details. Figures 5A to 5G The scene shown.
[0433] As can be seen, the second device can utilize the first device to simultaneously share the audio input / output. When both the first and second devices require audio output, the audio device can simultaneously play audio from electronic device 100 and audio from the second device. In cases where multiple electronic devices share the audio device, the audio device can maintain a connection with the first device without frequently switching connections between the first and second devices. This method not only allows a single audio device to promptly meet the audio input / output needs of multiple electronic devices but also simplifies the interaction between the audio device and these multiple electronic devices, improving audio transmission efficiency and thus enhancing the user experience for listening to or capturing audio.
[0434] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps in the above-described method embodiments.
[0435] This application also provides a computer program product, including a computer program that, when run on a processor, can implement the steps in the various method embodiments described above.
[0436] This application also provides a chip system, which includes a processing circuit and an interface circuit. The interface circuit receives code instructions and transmits them to the processing circuit. The processing circuit executes the code instructions to enable the chip system to implement the steps of any method embodiment of this application. The chip system can be a single chip or a chip module composed of multiple chips.
[0437] It is understood that the user interfaces described in the embodiments of this application are merely example interfaces and do not constitute a limitation on the solution of this application. In other embodiments, the user interface may adopt different interface layouts, may include more or fewer controls, and may add or remove other functional options, as long as they are based on the same inventive concept provided in this application, they are all within the protection scope of this application.
[0438] It should be noted that, without causing contradictions or conflicts, any feature in any embodiment of this application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of this application.
[0439] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. An audio transmission method, characterized by, The method is applied to a communication system comprising a first device and a second device, the first device being connected with an audio device, and the method comprises: The first device sends first audio to the audio device, the first audio being audio of a first audio application in the first device; The first device receives second audio collected by the audio device and sends the second audio to the second device; The second device uses the second audio as audio input of a first audio input service.
2. The method of claim 1, wherein, The method further comprises: The second device sends third audio to the first device, the third audio being audio of a second audio application in the second device; The first device mixes the first audio and the third audio to obtain fourth audio; The first device sends the fourth audio to the audio device.
3. The method of claim 1, wherein, The method further comprises: The first device receives a first operation for stopping playing the first audio; In response to the first operation, the first device stops sending the first audio to the audio device; The second device sends third audio to the first device, the third audio being audio of a second audio application in the second device; The first device sends the third audio to the audio device.
4. The method according to claim 2 or 3, characterized in that, The method further comprises: The second device receives a second operation for stopping playing the third audio; In response to the second operation, the second device stops sending the third audio to the first device; Alternatively, The first device receives a third operation on a first control for controlling an audio output state of the second device, the third operation being for turning off the audio output of the second device; In response to the third operation, the first device sends a second message to the second device, the second message being for instructing the second device to turn off the audio output; According to the second message, the second device stops sending the third audio to the first device.
5. The method of claim 4, wherein, The first device displays first state information for indicating that the audio output of the second device is turned on; the method further comprises: In response to the second operation, the second device sends a first message to the first device, the first message being for indicating that the second device has turned off the audio output; According to the first message, the first device updates the first state information to second state information, the second state information being for indicating that the audio output of the second device is turned off.
6. The method according to any one of claims 1-5, characterized in that, Before the first device sends the second audio to the second device, the method further comprises: The second device receives a fourth operation for turning on the audio input of the second device; In response to the fourth operation, the second device sends a third message to the first device, the third message being for indicating that the second device has turned on the audio input; Alternatively, The first device receives a fifth operation on a second control for controlling an audio input state of the second device, the fifth operation being for turning on the audio input of the second device; In response to the fifth operation, the first device sends a fourth message to the second device, the fourth message being used to instruct the second device to turn on the audio input.
7. The method of claim 6, wherein, The first device displays third status information, the third status information being used to indicate that the audio input of the second device is turned off; and the method further comprises: According to the third message, the first device updates the third status information to fourth status information, the fourth status information being used to indicate that the audio input of the second device is turned on.
8. The method according to any one of claims 1-7, characterized in that, The method further comprises: The first device uses the second audio as audio input of a second audio input service.
9. The method of claim 8, wherein, Before the first device sends the second audio to the second device, the second audio input service of the first device is in a proceeding state; After the first device sends the second audio to the second device, the method further comprises: The first device stops the second audio input service from proceeding.
10. The method of any one of claims 1-9, wherein, After the second device uses the second audio as audio input of a first audio input service, the method further comprises: The first device receives a sixth operation, the sixth operation being used to turn on the audio input of the first device; In response to the sixth operation, the first device uses the second audio as audio input of a second audio input service, stops sending the second audio to the second device, and sends a fifth message to the second device, the fifth message being used to instruct the second device to turn off the audio input; According to the fifth message, the second device stops the first audio input service from proceeding.
11. The method according to any one of claims 1-9, characterized in that, After the second device uses the second audio as audio input of a first audio input service, the method further comprises: The second device receives a seventh operation, the seventh operation being used to turn off the audio input of the second device; In response to the seventh operation, the second device stops the first audio input service from proceeding, and sends a sixth message to the first device, the sixth message being used to indicate that the second device has turned off the audio input; According to the sixth message, the first device stops sending the second audio to the second device; Or, The first device receives an eighth operation on a third control, the third control being used to control the audio input state of the second device, the eighth operation being used to turn off the audio input of the second device; In response to the eighth operation, the first device stops sending the second audio to the second device, and sends a seventh message to the second device, the seventh message being used to instruct the second device to turn off the audio input; According to the seventh message, the second device stops the first audio input service from proceeding.
12. An audio transmission method, characterized by, The method is applied to a first device, the first device being connected with an audio device, and the method comprises: The first device sends a first audio to the audio device, the first audio being audio of a first audio application in the first device; The first device receives second audio collected by the audio device, and sends the second audio to the second device.
13. The method of claim 12, wherein, The method further includes: The first device receives third audio of the second device, the second audio being different from the first audio; The first device mixes the first audio and the third audio to obtain fourth audio; The first device sends the fourth audio to the audio device.
14. The method of claim 12, wherein, The method further includes: The first device receives a first operation for stopping playing the first audio; In response to the first operation, the first device stops sending the first audio to the audio device; The first device receives third audio of the second device, the second audio being different from the first audio; The first device sends the third audio to the audio device.
15. The method according to claim 13 or 14, characterized in that, The first device displays first status information indicating that the second device has opened audio output; the method further includes: The first device receives a first message from the second device, the first message indicating that the second device has closed audio output; According to the first message, the first device updates the first status information to second status information indicating that the second device has closed audio output.
16. The method according to claim 13 or 14, characterized in that The first device displays a first control for controlling the audio output state of the second device; the method further includes: The first device receives a third operation on the first control, the third operation being for closing the audio output of the second device; In response to the third operation, the first device sends a second message to the second device, the second message indicating that the second device closes audio output.
17. The method according to any one of claims 12-16, characterized by, Before the first device sends the second audio to the second device, the method further includes: The first device receives a third message from the second device, the third message indicating that the second device has opened audio input; Or, The first device receives a fifth operation on a second control for controlling the audio input state of the second device, the fifth operation being for opening the audio input of the second device; In response to the fifth operation, the first device sends a fourth message to the second device, the fourth message indicating that the second device opens audio input.
18. The method of claim 17, wherein, The first device displays third status information indicating that the second device has closed audio input; the method further includes: According to the third message, the first device updates the third status information to fourth status information indicating that the second device has opened audio input.
19. The method of any one of claims 12-18, wherein, The method further includes: The first device uses the second audio as audio input of a second audio input service.
20. The method of claim 19, wherein, Before the first device sends the second audio to the second device, the second audio input service of the first device is in a running state; After the first device sends the second audio to the second device, the method further includes: The first device stops sending the second audio to the second device.
21. The method of any one of claims 12-20, wherein, After the first device sends the second audio to the second device, the method further includes: The first device receives a sixth operation for starting audio input of the first device; In response to the sixth operation, the first device stops sending the second audio to the second device using the second audio as audio input of a second audio input service, and sends a fifth message to the second device, the fifth message being used to instruct the second device to close audio input.
22. The method of any one of claims 12-20, wherein, After the sending of the second audio to the second device, the method further includes: The first device receives a sixth message of the second device, the sixth message being used to instruct the second device to have closed audio input; According to the sixth message, the first device stops sending the second audio to the second device; Or, The first device receives an eighth operation on a third control, the third control being used to control audio input state of the second device, the eighth operation being used to close audio input of the second device; In response to the eighth operation, the first device stops sending the second audio to the second device, and sends a seventh message to the second device, the seventh message being used to instruct the second device to close audio input.
23. An electronic device, comprising: The electronic device includes a memory and a processor, wherein the memory is used to store a computer program; the processor executes the computer program to implement the method of any one of claims 12-22.
24. A computer readable storage medium storing instructions, the instructions comprising: The instructions are executed by the processor to implement the method of any one of claims 12-22.
25. A computer program product, characterised in that, The computer program product contains computer instructions, which are executed by the processor to implement the method of any one of claims 12-22.