Audio control method and related device

Abstract

The audio control method and related device provided in the embodiment of the present application relate to the field of terminal technology. The method includes: while the mobile phone and the Bluetooth headset transmit the recording data, the Bluetooth headset can also be used to play the surrounding ambient sound, so as to realize the transparent transmission of the ambient sound while recording and saving, and improve the user experience.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an audio control method and related devices. Background Art

[0002] A user can connect a Bluetooth headset to an electronic device via Bluetooth and use the Bluetooth headset to record. However, when the user uses the Bluetooth headset to record, the user cannot receive communication information from other people nearby or cannot receive sound information from surrounding cars, resulting in a poor user experience. Summary of the invention

[0003] The audio control method and related devices provided in the embodiments of the present application can also use the Bluetooth headset to play the surrounding environmental sound while the mobile phone and the Bluetooth headset transmit the recording data, thereby achieving transparent transmission of the environmental sound while saving the recording, thereby improving the user experience.

[0004] In a first aspect, an audio control method provided by an embodiment of the present application includes:

[0005] The first electronic device establishes a communication connection with the second electronic device; the first electronic device starts a recording application; the second electronic device obtains a first audio signal; the second electronic device sends the first audio signal to the first electronic device, and the second electronic device plays a second audio signal; the second audio signal is the same as the first audio signal, or the second audio signal is received by the second electronic device from the first electronic device; the recording application of the first electronic device generates a recording based on the first audio signal. In this way, while the first electronic device and the second electronic device transmit the recording data, the second electronic device can also be used to play the surrounding ambient sound, so that the ambient sound can be transparently transmitted while the recording is saved, which can improve the user experience.

[0006] In a possible implementation, the second audio signal is the same as the first audio signal, the second electronic device includes a first microphone device, and the second electronic device obtains the first audio signal, including: the second electronic device collects the first source audio signal through the first microphone device; the codec CODEC of the second electronic device converts the first source audio signal from an analog signal to a digital signal; the digital signal processor DSP of the second electronic device mixes the first source audio signal converted into a digital signal to obtain the first audio signal. In this way, the power consumption of the first electronic device can be reduced and the battery life can be improved.

[0007] In a possible implementation, the second audio signal is received by the second electronic device from the first electronic device, including: the second audio signal is received by the second electronic device from the first electronic device based on the synchronous directional connection SCO channel. In this way, by multiplexing the SCO channel, both a voice call and a recording function can be realized based on the second electronic device, thereby improving the compatibility of data transmission between the first electronic device and the second electronic device.

[0008] In a possible implementation, the first electronic device includes a second microphone device, and before the second electronic device plays the second audio signal, the first electronic device collects the second source audio signal through the second microphone device; the codec CODEC of the first electronic device converts the second source audio signal from an analog signal to a digital signal; and the mixing module of the first electronic device mixes the second source audio signal converted into a digital signal to obtain the second audio signal. In this way, the power consumption of the second electronic device is reduced and the battery life of the second electronic device is improved.

[0009] In a possible implementation, the second electronic device sends the first audio signal to the first electronic device, including: the second electronic device sends the first audio signal to the first electronic device based on a synchronous directional connection (SCO) channel. In this way, a recording function can be implemented based on the SCO channel, thereby improving the compatibility of the SCO channel.

[0010] In a possible implementation, the first electronic device includes: a recording algorithm module, a recording channel control module, and before the second electronic device sends the first audio signal to the first electronic device based on the synchronous directional connection SCO channel, it includes: the Bluetooth chip of the second electronic device encodes the first source audio signal using the improved sub-band coding mSBC, and the first source audio signal is collected by the first microphone; after the second electronic device sends the first audio signal to the first electronic device based on the synchronous directional connection SCO channel, it includes: the Bluetooth chip of the first electronic device decodes the first source audio signal using the improved sub-band coding mSBC to obtain the first audio signal; the digital signal processor DSP of the first electronic device calls the control recording interface to transfer the first audio signal to the recording algorithm module of the hardware abstraction layer; the recording algorithm module transfers the first audio signal to the recording channel control module of the application framework; the recording channel control module transfers the first audio signal to the recording application of the application layer. In this way, the SCO channel can be reused to build a recording channel between the first electronic device and the second electronic device, so as to realize the recording function based on the second electronic device.

[0011] In a possible implementation, the first electronic device is configured with a target list, and the recording path control module transmits the first audio signal to the recording application of the application layer, including: if the target list includes the recording application, the recording path control module transmits the first audio signal to the recording application of the application layer. In this way, the recording application can run normally on the recording path, reducing the probability of abnormality when the application is running.

[0012] In a second aspect, an embodiment of the present application provides a communication system, the communication system comprising a first electronic device and a second electronic device. The first electronic device is used to execute the method executed by the first electronic device in the first aspect or any possible implementation of the first aspect. The second electronic device is used to execute the method executed by the second electronic device in the first aspect or any possible implementation of the first aspect.

[0013] Exemplarily, the first electronic device is used to establish a communication connection with the second electronic device, and is also used to start a recording application, and specifically is also used to generate a recording based on the first audio signal.

[0014] The first electronic device is used to collect a second source audio signal through a second microphone device, and is also used to convert the second source audio signal from an analog signal to a digital signal, and specifically is used to mix the second source audio signal converted into a digital signal to obtain a second audio signal.

[0015] The first electronic device is used to decode the first source audio signal using improved sub-band coding mSBC to obtain a first audio signal, and is also used to call a control recording interface to transmit the first audio signal to a recording algorithm module of a hardware abstraction layer, and is also used to transmit the first audio signal to a recording path control module of an application framework, and specifically to transmit the first audio signal to a recording application at an application layer.

[0016] The second electronic device is used to obtain the first audio signal, and is also used to send the first audio signal to the first electronic device, and is specifically used to play the second audio signal.

[0017] The second electronic device is used to collect the first source audio signal through the first microphone device, and is also used to convert the first source audio signal from an analog signal to a digital signal, and specifically to mix the first source audio signal converted into a digital signal to obtain a first audio signal.

[0018] The second electronic device is used to receive the second audio signal from the first electronic device based on the synchronous directional connection (SCO) channel, and is also used to send the first audio signal to the first electronic device based on the synchronous directional connection (SCO) channel.

[0019] The second electronic device is used to encode the first source audio signal by adopting improved sub-band coding mSBC.

[0020] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, the memory being used to store code instructions, and the processor being used to run the code instructions to execute the method executed by the first electronic device in the first aspect or any possible implementation of the first aspect, or to execute the method executed by the second electronic device in the first aspect or any possible implementation of the first aspect.

[0021] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is run on a computer, the computer executes the method executed by the first electronic device in the first aspect or any possible implementation of the first aspect, or executes the method executed by the second electronic device in the first aspect or any possible implementation of the first aspect.

[0022] In a fifth aspect, an embodiment of the present application provides a computer program product comprising a computer program. When the computer program runs on a computer, the computer executes the method executed by the first electronic device in the first aspect or any possible implementation of the first aspect, or executes the method executed by the second electronic device in the first aspect or any possible implementation of the first aspect.

[0023] In a sixth aspect, the present application provides a chip or a chip system, the chip or chip system includes at least one processor and a communication interface, the communication interface and the at least one processor are interconnected by a line, and the at least one processor is used to run a computer program or instruction to execute the method executed by the first electronic device in the first aspect or any possible implementation of the first aspect, or to execute the method executed by the second electronic device in the first aspect or any possible implementation of the first aspect. Among them, the communication interface in the chip can be an input / output interface, a pin or a circuit, etc.

[0024] In a possible implementation, the chip or chip system described above in the present application further includes at least one memory, in which instructions are stored. The memory may be a storage unit inside the chip, such as a register, a cache, etc., or a storage unit of the chip (e.g., a read-only memory, a random access memory, etc.).

[0025] It should be understood that the second to sixth aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0027] Figure 2 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0028] Figure 3 A schematic diagram of establishing a path between a mobile phone and a Bluetooth headset provided in an embodiment of the present application;

[0029] Figure 4 A schematic diagram of a recording channel construction process provided in an embodiment of the present application;

[0030] Figure 5 A schematic diagram of a transparent transmission path construction process provided in an embodiment of the present application;

[0031] Figure 6 A schematic diagram of module interaction of a transparent transmission path provided in an embodiment of the present application;

[0032] Figure 7 A schematic diagram of data interaction in a transparent transmission path provided in an embodiment of the present application;

[0033] Figure 8 A schematic diagram of another process of establishing a transparent transmission path provided in an embodiment of the present application;

[0034] Fig. 9 A schematic diagram of module interaction of another transparent transmission path provided in an embodiment of the present application;

[0035] Fig.10 A schematic diagram of data interaction of another transparent transmission path provided in an embodiment of the present application;

[0036] Fig.11 A schematic diagram of an audio control method provided in an embodiment of the present application;

[0037] Fig.12 A schematic diagram of the structure of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to clearly describe the technical solutions of the embodiments of the present application, some terms and technologies involved in the embodiments of the present application are briefly introduced below:

[0039] 1. 3A algorithm: The 3A algorithm may include acoustic echo cancellation (AEC), automatic noise suppression (ANS), and automatic gain control (AGC).

[0040] 2. mSBC codec: Modified sub-band coding (mSBC) is a codec technology that can encode or decode data transmitted between electronic devices and Bluetooth headsets.

[0041] 3. Terminology

[0042] In the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with substantially the same functions and effects. For example, the first chip and the second chip are only used to distinguish different chips, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0043] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0044] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, c can be single or multiple.

[0045] 4. Electronic equipment

[0046] The electronic device of the embodiment of the present application may also be a terminal device in any form. For example, the electronic device may include: a mobile phone, a tablet computer, a PDA, a laptop computer, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a wireless terminal in industrial control, a wireless terminal in self driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, a cellular phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device, a wearable device, an electronic device in a 5G network or a public land mobile communication network (public land mobile communication network) to be evolved in the future. Mobile network, PLMN) and the like, the embodiments of the present application are not limited to this.

[0047] As an example but not limitation, in the embodiments of the present application, the electronic device may also be a wearable device. Wearable devices may also be referred to as wearable smart devices, which are a general term for wearable devices that are intelligently designed and developed using wearable technology for daily wear, such as glasses, gloves, watches, clothing, and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not only hardware devices, but also powerful functions achieved through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include full-featured, large-sized, and fully or partially independent of smartphones, such as smart watches or smart glasses, as well as devices that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various types of smart bracelets and smart jewelry for vital sign monitoring.

[0048] In addition, in the embodiments of the present application, the electronic device may also be an electronic device in an Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network that interconnects people and machines and things.

[0049] The electronic devices in the embodiments of the present application may also be referred to as: user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.

[0050] In an embodiment of the present application, the electronic device or each network device includes a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and a memory (also called main memory). The operating system can be any one or more computer operating systems that implement business processing through processes, such as Linux operating system, Unix operating system, Android operating system, iOS operating system, or Windows operating system. The application layer includes applications such as browsers, address books, word processing software, and instant messaging software.

[0051] For example, Figure 1 A schematic structural diagram of an electronic device is shown.

[0052] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0053] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0054] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0055] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0056] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0057] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc.

[0058] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0059] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor. For example, the method of an embodiment of the present application may be executed.

[0060] The electronic device can implement audio functions, such as audio playback or recording, through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0061] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The speaker 170A, also known as a "speaker", is used to convert audio electrical signals into sound signals. The electronic device may include 1 or N speakers 170A, where N is a positive integer greater than 1. The electronic device can listen to music, videos, or listen to hands-free calls through the speaker 170A. The receiver 170B, also known as a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device answers a call or voice message, the voice can be answered by placing the receiver 170B close to the human ear. The microphone 170C, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.

[0062] Figure 2 It is a software structure block diagram of the electronic device of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, the hardware abstraction layer, and the kernel layer.

[0063] The application layer can also be called the application layer, which can include a series of application packages. Figure 2 As shown, the application package may include applications such as recording, phone, music, calendar, camera, game, memo, video, etc. Applications may include system applications and third-party applications.

[0064] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0065] like Figure 2 As shown, the application framework layer may include a resource manager, a content provider, a view system, etc. The application framework layer may also include recording channel control, etc.

[0066] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, touch the screen, drag the screen, capture the screen, etc.

[0067] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0068] Content providers are used to implement data sharing between different applications, allowing one program to access data in another program while ensuring the security of the accessed data.

[0069] The view system can be responsible for the application interface drawing and event processing.

[0070] The recording path control can be used to pass the recording data to the recording application, and can also be used to determine whether the recording application is an application in the application whitelist.

[0071] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0072] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0073] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0074] The system library can also be called the Native layer, which can include multiple functional modules, such as media libraries, function libraries, and graphics processing libraries (such as OpenGL ES).

[0075] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0076] The function library provides developers with API interfaces for multiple services, making it easy for developers to quickly integrate and implement various functions.

[0077] The graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing.

[0078] The hardware abstraction layer (HAL) is an abstracted layer between the kernel layer and the Android runtime. The hardware abstraction layer can be a package of the hardware driver, providing a unified interface for the call of the upper layer application. In the embodiment of the present application, the hardware abstraction layer may include a recording algorithm module, an audio mixing (audiomixing, mix) module, etc.

[0079] The recording algorithm module can be used to transmit the recording data to the recording path control module, and can also be used to amplify, reduce noise, filter, and perform other processing on the recording data.

[0080] The audio mixing module can be used to mix the recording data picked up by the Bluetooth headset mic with the downlink channel data of the SCO channel. The audio mixing module can also be called a mixing module.

[0081] The kernel layer is the layer between hardware and software. The kernel layer may include display driver, camera driver, audio driver, battery driver, Bluetooth driver, CPU driver, USB driver, etc.

[0082] It should be noted that the embodiments of the present application are only illustrated using the Android system as an example. In other operating systems (such as Windows system, IOS system, etc.), as long as the functions implemented by each functional module are similar to those in the embodiments of the present application, the solutions of the present application can also be implemented.

[0083] When talking on the phone or listening to music, the user can connect the Bluetooth headset to the electronic device via Bluetooth and use the Bluetooth headset to talk or listen to music. In addition, the user can also use the Bluetooth headset to record or video. The Bluetooth headset can include a true wireless stereo (TWS) Bluetooth headset. For the sake of ease of description, the following description takes the electronic device as a mobile phone as an example.

[0084] However, when users use Bluetooth headsets to record, since Bluetooth headsets do not play ambient sounds, and since users wear Bluetooth headsets, their ears are blocked from receiving ambient sounds, users may not be able to receive communication information from other people nearby, or the sound information from surrounding cars, etc. Therefore, when users use Bluetooth headsets to record, the transparent transmission capability of ambient sounds is poor, which reduces the user experience.

[0085] In view of this, the audio control method provided in the embodiment of the present application can, while the mobile phone and the Bluetooth headset transmit the recording data, also use the Bluetooth headset to play the surrounding environmental sound, thereby achieving transparent transmission of the environmental sound while saving the recording, thereby improving the user experience.

[0086] For the sake of convenience, in the present embodiment, the data link between the mobile phone and the Bluetooth headset for transmitting the recording can be called the recording path, and the data link between the Bluetooth headset for playing the ambient sound can be called the transparent transmission path. Figure 3 Describe the recording path and the transparent transmission path.

[0087] like Figure 3 As shown, the mobile phone 300 may include a top microphone 301 and a bottom microphone 302, wherein the microphone may also be referred to as a mic, and the embodiment of the present application does not limit the specific positions of the top mic 301 and the bottom mic 302 in the mobile phone 300. The mobile phone 300 may be installed with a recording application 303, which may be a pre-installed application of the mobile phone 300 or a third-party application, and the embodiment of the present application does not limit it.

[0088] The Bluetooth headset 304 may include a headset mic 305 and a headset speaker 306 .

[0089] A recording channel 307 and a transparent transmission channel 308 can be established between the mobile phone 300 and the Bluetooth headset 304.

[0090] The recording channel 307 can be used to transmit recording data. For example, when recording, the user can turn on the recording function of the recording application 303 of the mobile phone 300. Based on the established recording channel 307, the earphone mic 305 of the Bluetooth headset 304 can pick up the recording signal, and the recording signal can be transmitted to the recording application 303 via the recording channel 307, and the recording application 303 can save the recording signal into a recording file.

[0091] The transparent transmission path 308 can be used to transmit environmental sound transparent transmission data. In one possible implementation, the earphone mic 305 of the Bluetooth earphone 304 can pick up the environmental sound, and based on the established transparent transmission path 308, the environmental sound is returned to the earphone speaker 306, so that the human ear can receive the environmental sound. In another possible implementation, the top mic 301 and / or the bottom mic 302 of the mobile phone 300 can pick up the environmental sound, and based on the established transparent transmission path 308, the environmental sound is returned to the earphone speaker 306, so that the human ear can receive the environmental sound.

[0092] It can be understood that after the recording channel 307 and the transparent transmission channel 308 are set up, the record stream in the application framework layer of the mobile phone can be started. When the connection status of the Bluetooth headset is detected, the record stream can trigger the recording channel to transmit the recording data, and the transparent transmission channel to transmit the transparent transmission data.

[0093] In some implementations, based on the support of high-fidelity output and low-fidelity stereo bidirectional transmission protocols between the Bluetooth headset and the mobile phone, the working channel between the Bluetooth headset and the mobile phone may include an advanced audio distribution profile (A2DP) channel and a synchronous connection oriented (SCO) channel. Among them, when the Bluetooth headset and the mobile phone transmit audio data such as music and prompt tones, the A2DP channel can be used, and when the Bluetooth headset and the mobile phone transmit uplink and downlink audio data such as calls, the SCO channel can be used.

[0094] The audio control method of the embodiment of the present application can reuse the SCO path to build a recording path between the mobile phone and the Bluetooth headset.

[0095] under Figure 4 The process of setting up the recording channel is shown.

[0096] S401, start the recording application.

[0097] The method of opening the recording application may include clicking the icon of the recording application, or may include voice input to open the recording application. The embodiment of the present application does not limit the method of opening the recording application.

[0098] S402, Bluetooth headset connection monitoring.

[0099] In a possible implementation, the recording application can discover and connect to the Bluetooth headset by registering for broadcast.

[0100] In another possible implementation, after detecting that the Bluetooth headset is connected, the mobile phone can report the Bluetooth headset connection message to the recording application. It is understandable that this implementation method can synchronize the start of the recording application and the connection detection of the Bluetooth headset.

[0101] The specific method of monitoring the connection of the Bluetooth headset is not limited in this embodiment of the application.

[0102] S403, open the SCO channel from the Bluetooth headset to the mobile phone.

[0103] When the recording application is started and the Bluetooth headset is connected to the mobile phone, the recording application can call the relevant interface, pass the parameters such as recording application startup and Bluetooth headset connection, and then open the SCO path from the Bluetooth headset to the mobile phone. Among them, the SCO path can include an upstream path and a downstream path. The upstream path can be understood as the path from the Bluetooth headset to the mobile phone, and the downstream path can be understood as the path from the mobile phone to the Bluetooth headset.

[0104] S404: The Bluetooth headset transmits the recording to the mobile phone side DSP through the SCO channel.

[0105] After opening the SCO path from the Bluetooth headset to the mobile phone, the Bluetooth headset mic can pick up the recording data and transmit the recording data through the uplink path of the SCO path to the digital signal processor DSP on the mobile phone side. The recording data can also be called sound data or voice data.

[0106] S405. DSP transmits the recording data to the recording module.

[0107] After the DSP on the mobile phone side obtains the recording data, it can call the control recording module to pass the recording data to the chip platform recording algorithm module of the hardware abstraction layer. The chip platform recording algorithm module can amplify, reduce noise, filter and other processing on the recording data. Among them, the control recording module can also be called the control recording interface or recording module, and the chip platform recording algorithm module can also be called the recording algorithm module. The embodiment of the present application does not limit the specific chip platform. It can be understood that the process of DSP calling the control recording module to pass the recording data to the recording algorithm module can be called forced data transfer or data transfer.

[0108] S406, Bluetooth recording is saved.

[0109] After the recording algorithm module obtains the recording data, it can pass the recording data to the recording application of the application layer through the recording path control module of the application framework. The recording application can save the recording data as a Bluetooth recording file, which can also be called a recording file.

[0110] After the recording path is established, the audio control method of the embodiment of the present application can also establish a transparent transmission path between the mobile phone and the Bluetooth headset, so that when the Bluetooth headset is used for recording, the transparent transmission of the ambient sound can be achieved. Among them, the establishment of the transparent transmission path may include the following methods: (1) establishing a transparent transmission path based on the Bluetooth headset mic picking up the ambient sound; (2) establishing a transparent transmission path based on the mobile phone mic picking up the ambient sound.

[0111] under Figure 5 The following shows the process of (1) building a transparent transmission channel based on the Bluetooth headset mic picking up ambient sound.

[0112] S501, start the recording application.

[0113] The method of opening the recording application can refer to the above Figure 4 The relevant description in step S401 of the corresponding embodiment is not repeated here.

[0114] S502, Bluetooth headset connection monitoring.

[0115] The implementation method of Bluetooth headset connection monitoring can refer to the above Figure 4 The relevant description in step S402 of the corresponding embodiment is not repeated here.

[0116] S503, open the SCO channel from the Bluetooth headset to the mobile phone.

[0117] The implementation method of opening the SCO channel from the Bluetooth headset to the mobile phone can refer to the above Figure 4 The relevant description in step S403 of the corresponding embodiment is not repeated here.

[0118] S504: Load an uplink and downlink mixing module into the DSP on the Bluetooth headset side.

[0119] When the SCO channel from the Bluetooth headset to the mobile phone is opened, the DSP on the Bluetooth headset side can load an uplink and downlink mixing module to facilitate subsequent mixing and data transmission of ambient sound data. The uplink and downlink mixing module can also be called a mixing module.

[0120] S505: The DSP on the Bluetooth headset side synchronously transfers the ambient sound data to the mixing module.

[0121] After opening the SCO channel from the Bluetooth headset to the mobile phone, the Bluetooth headset mic can pick up the ambient sound data. It can be understood that the Bluetooth headset mic can pick up the ambient sound data and can also be understood as recording data.

[0122] On the one hand, the ambient sound data is transmitted to the recording application via the recording path, that is, through the uplink path of the SCO path, so that the recording file can be saved. The specific process of the Bluetooth headset transmitting the recording data to the recording application of the mobile phone can be referred to above. Figure 4 The relevant descriptions in the corresponding embodiments are not repeated here.

[0123] On the other hand, the Bluetooth headset mic can transmit the ambient sound data to the codec CODEC on the Bluetooth headset side. After the codec CODEC converts the ambient sound data from an analog signal to a digital signal, it can transmit the ambient sound data of the digital signal to the DSP on the Bluetooth headset side. After acquiring the ambient sound data, the DSP on the Bluetooth headset side can call the relevant interface to transmit the ambient sound data to the mixing module that has been loaded in step S704.

[0124] S506: The ambient sound data picked up by the Bluetooth headset mic is mixed to the SCO downlink channel.

[0125] The DSP on the Bluetooth headset side can mix the ambient sound data picked up by the Bluetooth headset mic with the downlink channel data of the SCO channel through the mixing module.

[0126] S507: The ambient sound data is transmitted to the earphone to achieve transparent transmission of the ambient sound.

[0127] After the mixing module mixes the ambient sound data, the DSP on the Bluetooth headset side can transmit the ambient sound data to the Bluetooth headset, thereby realizing transparent transmission of the ambient sound.

[0128] Figure 6 The module interaction diagram of the recording path and the transparent transmission path based on the Bluetooth headset mic picking up the ambient sound is shown.

[0129] 6.1. Recording channel.

[0130] After the Bluetooth headset mic picks up the recording data, the Bluetooth headset mic can pass the recording data to the codec CODEC on the Bluetooth headset side. After the codec CODEC converts the recording data from an analog signal to a digital signal, it can pass the recording data of the data signal to the DSP on the Bluetooth headset side. The DSP on the Bluetooth headset side can perform 3A algorithm processing on the recording data. After the 3A algorithm processing, the DSP on the Bluetooth headset side can pass the recording data to the Bluetooth chip on the Bluetooth headset side. The Bluetooth chip on the Bluetooth headset side can perform mSBC encoding on the recording data. After completing the mSBC encoding, the Bluetooth chip on the Bluetooth headset side can pass the recording data to the Bluetooth chip on the mobile phone side through the uplink channel of the SCO channel. The Bluetooth chip on the mobile phone side can perform mSBC decoding on the recording data.

[0131] For the SCO channel in a call scenario, the mobile phone can pass the decoded audio data to the high-fidelity (HIFI) DSP on the mobile phone side. After the HIFI DSP processes the audio data with a 3A algorithm, it can send the audio data out through a modem.

[0132] It is understandable that the execution logic of the SCO path in the recording scenario is different from that in the call scenario. In the recording scenario, the execution logic of the SCO path in the call scenario can be suspended, and the audio data will not be sent out through the modem.

[0133] Specifically, for the SCO channel in the recording scenario, after the mobile phone passes the decoded recording data to the HIFI DSP on the mobile phone side, the HIFI DSP can call the control recording module to pass the recording data to the recording algorithm module of the hardware abstraction layer. After the recording algorithm module obtains the recording data, it can pass the recording data to the recording application of the application layer through the recording channel control module of the application framework, and the recording application can save the recording data as a Bluetooth recording file.

[0134] It is understandable that in order to ensure the stable operation of the mobile phone, the mobile phone can test some recording applications, and for the tested recording applications, the recording path can be used. In a possible implementation, for the tested recording applications, the mobile phone can add these recording applications to the application whitelist, and when the recording path control module determines that the current recording application is in the application whitelist, the recording path control module can pass the recording data to the recording application. In this way, the recording application can run normally on the recording path, reducing the probability of abnormalities when the application is running.

[0135] 6.2. Transparent transmission path based on Bluetooth headset mic picking up ambient sound.

[0136] While opening the SCO channel from the Bluetooth headset to the mobile phone, the uplink and downlink mixing modules can be loaded into the DSP on the Bluetooth headset side. After the Bluetooth headset mic picks up the ambient sound data, the DSP on the Bluetooth headset side can process the ambient sound data with the 3A algorithm and pass the ambient sound data to the mixing module that has been loaded in the DSP on the Bluetooth headset side. The mixing module can mix the ambient sound data with the downlink channel data of the SCO channel. After mixing, the DSP on the Bluetooth headset side can pass the ambient sound data to the Bluetooth headset, thereby realizing the transparent transmission of the ambient sound.

[0137] Figure 7 The timing diagram of the recording path and the transparent transmission path based on the Bluetooth headset mic picking up the ambient sound is shown.

[0138] After the user starts the recording application, the recording application can start the SCO channel between the Bluetooth headset and the mobile phone based on the information that the recording application is started and connected to the Bluetooth headset.

[0139] 7.1. Recording channel.

[0140] The Bluetooth headset mic can pick up the recording data and transmit the recording data to the DSP on the Bluetooth headset side. After the DSP on the Bluetooth headset side processes the recording data with the 3A algorithm, it can transmit the recording data to the Bluetooth chip on the Bluetooth headset side. After the Bluetooth chip on the Bluetooth headset side performs mSBC encoding on the recording data, it can transmit the recording data to the Bluetooth chip on the mobile phone side.

[0141] After the Bluetooth chip on the mobile phone side performs mSBC decoding on the recording data, it can pass the recording data to the DSP on the mobile phone side. The DSP on the mobile phone side can call the control recording module to pass the recording data to the recording algorithm module. After the recording algorithm module obtains the recording data, it can pass the recording data to the recording application through the recording channel control module, and then the recording application can save the recording data as a Bluetooth recording file. The specific process of the Bluetooth headset passing the recording data to the recording application of the mobile phone can refer to the above Figure 4 as well as Figure 6 The relevant descriptions in the corresponding embodiments are not repeated here.

[0142] 7.2. Transparent transmission path based on Bluetooth headset mic picking up ambient sound.

[0143] It is understandable that the recording data picked up by the Bluetooth headset mic can also be called ambient sound data.

[0144] When the SCO channel between the Bluetooth headset and the mobile phone is started, the mixing module can be loaded into the DSP on the Bluetooth headset side. After the mixing module obtains the ambient sound data, it can mix the ambient sound data with the SCO downlink channel data. After mixing, the DSP on the Bluetooth headset side can transmit the ambient sound data to the Bluetooth headset, thereby realizing the transparent transmission of the ambient sound. The specific transparent transmission channel based on the Bluetooth headset mic picking up the ambient sound can refer to the above Figure 5 as well as Figure 6 The relevant descriptions in the corresponding embodiments are not repeated here.

[0145] under Figure 8 The process of (2) building a transparent transmission channel based on the mobile phone mic picking up ambient sound is shown.

[0146] S801. Start the recording application.

[0147] The method of opening the recording application can refer to the above Figure 4 The relevant description in step S401 of the corresponding embodiment is not repeated here.

[0148] S802, Bluetooth headset connection monitoring.

[0149] The implementation method of Bluetooth headset connection monitoring can refer to the above Figure 4 The relevant description in step S402 of the corresponding embodiment is not repeated here.

[0150] S803, open the SCO channel from the Bluetooth headset to the mobile phone.

[0151] The implementation method of opening the SCO channel from the Bluetooth headset to the mobile phone can refer to the above Figure 4 The relevant description in step S403 of the corresponding embodiment is not repeated here.

[0152] S804: Load the audio mixing module in the hardware abstraction layer on the mobile phone side.

[0153] While opening the SCO channel from the Bluetooth headset to the mobile phone, the hardware abstraction layer on the mobile phone side can load the mixing module to facilitate subsequent mixing and data transmission of the ambient sound data.

[0154] S805: The ambient sound data picked up by the mobile phone mic is transmitted to the mixing module of the hardware abstraction layer.

[0155] After picking up the ambient sound data, the mobile phone mic can pass the ambient sound data to the codec CODEC. After the codec CODEC converts the ambient sound data from an analog signal to a digital signal, it can pass the ambient sound data of the digital signal to the mixing module of the hardware abstraction layer.

[0156] S806: The ambient sound data picked up by the mobile phone mic is mixed to the SCO downlink channel.

[0157] The mixing module can mix the ambient sound data picked up by the mobile phone mic with the downlink channel data of the SCO channel.

[0158] S807: The ambient sound data is transmitted to the earphone to achieve transparent transmission of the ambient sound.

[0159] After mixing, the mobile phone can transmit the ambient sound data to the Bluetooth headset through the downlink channel of the SCO channel, thereby realizing transparent transmission of the ambient sound.

[0160] Fig. 9 The recording path and the transparent transmission path based on the mobile phone mic picking up the ambient sound are shown.

[0161] In the embodiment of the present application, the specific process of transmitting the recording data from the Bluetooth headset to the recording application of the mobile phone can refer to the above Figure 4 as well as Figure 6 The relevant descriptions in the corresponding embodiments are not repeated here.

[0162] After the mobile phone mic picks up the ambient sound data, it can pass the ambient sound data to the codec CODEC. After the codec CODEC converts the ambient sound data from analog signals to digital signals, it can pass the digital signal ambient sound data to the mixing module of the hardware abstraction layer. The mixing module can mix the ambient sound data with the downstream channel data of the SCO channel. After mixing, the mobile phone can pass the ambient sound data to the Bluetooth headset through the downstream channel of the SCO channel, thereby realizing the transparent transmission of the ambient sound.

[0163] Fig.10 The timing diagram of the recording path and the transparent transmission path based on the mobile phone mic picking up the ambient sound is shown.

[0164] After the user starts the recording application, the recording application can start the SCO channel between the Bluetooth headset and the mobile phone based on the information that the recording application is started and connected to the Bluetooth headset.

[0165] The specific process of Bluetooth headset transmitting recording data to the recording application of the mobile phone can refer to the above Figure 4 as well as Figure 6 The relevant descriptions in the corresponding embodiments are not repeated here.

[0166] When the SCO channel between the Bluetooth headset and the mobile phone is started, the mobile phone can load the mixing module in the hardware abstraction layer. The mobile phone mic can pick up the ambient sound data and pass the ambient sound data to the mixing module of the hardware abstraction layer through the codec CODEC. The mixing module can mix the ambient sound data with the downstream channel data of the SCO channel. After mixing, the mobile phone can pass the ambient sound data to the Bluetooth headset through the downstream channel of the SCO channel, thereby realizing the transparent transmission of the ambient sound.

[0167] The following is a detailed description of the method of the embodiment of the present application through specific embodiments. The following embodiments can be combined with each other or implemented independently, and the same or similar concepts or processes may not be repeated in some embodiments.

[0168] Fig.11 The audio control method of the embodiment of the present application is shown. The method includes:

[0169] S1101. A first electronic device establishes a communication connection with a second electronic device.

[0170] In the embodiment of the present application, the first electronic device may include the above Figure 3 In the corresponding embodiment of the mobile phone 300, the second electronic device may include the above Figure 3 Corresponding to the Bluetooth headset 304 in the embodiment, the embodiment of the present application does not limit the first electronic device and the second electronic device.

[0171] The first electronic device and the second electronic device can establish a communication connection by referring to the above Figure 4 The relevant description of step S402 in the corresponding embodiment is not repeated here.

[0172] S1102: The first electronic device starts a recording application.

[0173] In the embodiment of the present application, the first electronic device can start the recording application by referring to the above Figure 4 The relevant description of step S401 in the corresponding embodiment is not repeated here.

[0174] S1103: The second electronic device obtains a first audio signal.

[0175] In the embodiment of the present application, the first audio signal can be understood as an audio signal obtained by the second electronic device based on the microphone device. Figure 5 The recorded data or ambient sound data in the corresponding embodiment.

[0176] S1104: The second electronic device sends a first audio signal to the first electronic device, and the second electronic device plays a second audio signal; the second audio signal is the same as the first audio signal, or the second audio signal is received by the second electronic device from the first electronic device.

[0177] In the embodiment of the present application, the process of the second electronic device sending the first audio signal to the first electronic device can be understood as the process of the Bluetooth headset sending recording data to the mobile phone. For details, please refer to the above Figure 4 The relevant descriptions in the corresponding embodiments are not repeated here.

[0178] The second audio signal may include an audio signal acquired by the first electronic device based on the microphone device, and may also include an audio signal acquired by the second electronic device based on the microphone device. The audio signal may be understood as the above Figure 5 or Figure 8 The ambient sound data in the corresponding embodiment.

[0179] The process of the second electronic device playing the second audio signal may include the following steps: Figure 8 In the corresponding embodiment, the process of building a transparent transmission path based on the Bluetooth headset mic picking up ambient sound can also include the above Figure 8 In the corresponding embodiment, a process of building a transparent transmission path based on the mobile phone mic picking up ambient sound.

[0180] S1105. A recording application of the first electronic device generates a recording based on the first audio signal.

[0181] In the embodiment of the present application, while the first electronic device and the second electronic device are transmitting recorded data, the second electronic device can also be used to play the surrounding ambient sound, thereby achieving transparent transmission of the ambient sound while saving the recording, which can improve the user experience.

[0182] Optional, in Fig.11 On the basis of the corresponding embodiment, the second audio signal is the same as the first audio signal, the second electronic device includes a first microphone device, and the second electronic device obtains the first audio signal, which may include: the second electronic device collects the first source audio signal through the first microphone device; the codec CODEC of the second electronic device converts the first source audio signal from an analog signal to a digital signal; the digital signal processor DSP of the second electronic device mixes the first source audio signal converted into a digital signal to obtain the first audio signal.

[0183] In the embodiment of the present application, the process of the second electronic device acquiring the first audio signal can refer to the above Figure 5 , Figure 6 or Figure 7 The relevant descriptions in the corresponding embodiments are not repeated here.

[0184] The recording and transparent transmission of the ambient sound can be realized based on the audio signal collected by the second electronic device, and the first electronic device does not need to collect the audio signal, which can reduce the power consumption of the first electronic device and improve the battery life.

[0185] Optional, in Fig.11 On the basis of the corresponding embodiment, the second audio signal is received by the second electronic device from the first electronic device, which may include: the second audio signal is received by the second electronic device from the first electronic device based on a synchronous directional connection (SCO) channel.

[0186] In an embodiment of the present application, the second electronic device receives a second audio signal from the first electronic device based on a synchronous directional connection SCO channel, and the SCO channel can be multiplexed, so that both voice calls and recording functions can be realized based on the second electronic device, thereby improving the compatibility of data transmission between the first electronic device and the second electronic device.

[0187] Optional, in Fig.11 On the basis of the corresponding embodiment, the first electronic device includes a second microphone device. Before the second electronic device plays the second audio signal, it may include: the first electronic device collects the second source audio signal through the second microphone device; the codec CODEC of the first electronic device converts the second source audio signal from an analog signal to a digital signal; the mixing module of the first electronic device mixes the second source audio signal converted into a digital signal to obtain a second audio signal.

[0188] In the embodiment of the present application, the process of the second electronic device playing the second audio signal can refer to the above Figure 8 , Fig. 9 or Fig.10 The relevant descriptions in the corresponding embodiments are not repeated here.

[0189] By transparently transmitting the ambient sound based on the audio signal collected by the first electronic device, the power consumption of the second electronic device can be reduced and the battery life of the second electronic device can be improved.

[0190] Optional, in Fig.11 On the basis of the corresponding embodiment, the second electronic device sending the first audio signal to the first electronic device may include: the second electronic device sending the first audio signal to the first electronic device based on a synchronous directional connection (SCO) channel.

[0191] In an embodiment of the present application, the second electronic device sends the first audio signal from the first electronic device based on the synchronous directional connection SCO channel, which can realize multiplexing of the SCO channel, so that the recording function can be realized based on the SCO channel, improving the compatibility of the SCO channel.

[0192] Optional, in Fig.11 On the basis of the corresponding embodiments, the first electronic device includes: a recording algorithm module, a recording channel control module, and before the second electronic device sends the first audio signal to the first electronic device based on the synchronous directional connection SCO channel, it may include: the Bluetooth chip of the second electronic device encodes the first source audio signal using the improved sub-band coding mSBC technology, and the first source audio signal is collected by the first microphone; after the second electronic device sends the first audio signal to the first electronic device based on the synchronous directional connection SCO channel, it may include: the Bluetooth chip of the first electronic device decodes the first source audio signal using the improved sub-band coding mSBC technology to obtain the first audio signal; the digital signal processor DSP of the first electronic device calls the control recording interface to transfer the first audio signal to the recording algorithm module of the hardware abstraction layer; the recording algorithm module transfers the first audio signal to the recording channel control module of the application framework; the recording channel control module transfers the first audio signal to the recording application of the application layer.

[0193] In the embodiment of the present application, the process of the second electronic device sending the first audio signal to the first electronic device based on the synchronous directional connection SCO path can refer to the above Figure 5 In this way, the SCO channel can be reused to build a recording channel between the first electronic device and the second electronic device, thereby realizing the recording function based on the second electronic device.

[0194] Optional, in Fig.11 On the basis of the corresponding embodiment, the first electronic device is configured with a target list, and the recording path control module transmits the first audio signal to the recording application of the application layer, which may include: if the target list includes a recording application, the recording path control module transmits the first audio signal to the recording application of the application layer.

[0195] In the embodiment of the present application, the target list can be understood as the above Figure 6 The specific recording path control module transmits the first audio signal to the recording application of the application layer, which can refer to Figure 6 The relevant descriptions in the corresponding embodiments are not repeated here. In this way, the recording application can run normally on the recording path, reducing the probability of abnormalities occurring during the operation of the application.

[0196] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0197] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to achieve the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily appreciate that, in combination with the method steps of each example described in the embodiment disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0198] The embodiment of the present application can divide the functional modules of the device implementing the method according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0199] like Fig.12 FIG. 1 is a schematic diagram of a chip structure provided by an embodiment of the present application. The chip 1200 includes one or more (including two) processors 1201 , a communication line 1202 , a communication interface 1203 and a memory 1204 .

[0200] In some implementations, the memory 1204 stores the following elements: executable modules or data structures, or a subset thereof, or an extended set thereof.

[0201] The method described in the above embodiment of the present application can be applied to the processor 1201, or implemented by the processor 1201. The processor 1201 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor 1201 or an instruction in the form of software. The above processor 1201 can be a general-purpose processor (for example, a microprocessor or a conventional processor), a digital signal processor (digital signal processing, DSP), an application specific integrated circuit (application specific integrated circuit, ASIC), a field-programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates, transistor logic devices or discrete hardware components. The processor 1201 can implement or execute the methods, steps and logic block diagrams related to each processing disclosed in the embodiment of the present application.

[0202] The steps of the method disclosed in the embodiment of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. Among them, the software module can be located in a mature storage medium in the field such as a random access memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable read only memory (EEPROM). The storage medium is located in the memory 1204, and the processor 1201 reads the information in the memory 1204 and completes the steps of the above method in combination with its hardware.

[0203] The processor 1201 , the memory 1204 , and the communication interface 1203 may communicate with each other via the communication line 1202 .

[0204] In the above embodiments, the instructions stored in the memory for execution by the processor may be implemented in the form of a computer program product, wherein the computer program product may be pre-written in the memory, or may be downloaded and installed in the memory in the form of software.

[0205] The embodiment of the present application also provides a computer program product including one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. For example, the available medium can include a magnetic medium (e.g., a floppy disk, a hard disk or a tape), an optical medium (e.g., a digital versatile disc (digital versatile disc, DVD)), or a semiconductor medium (e.g., a solid state drive (solid state disk, SSD)), etc.

[0206] The present application also provides a computer-readable storage medium. The methods described in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer-readable media may include computer storage media and communication media, and may also include any medium that can transfer a computer program from one place to another. The storage medium may be any target medium that can be accessed by a computer.

[0207] As a possible design, the computer readable medium may include a compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM or other optical disc storage; the computer readable medium may include a magnetic disk storage or other magnetic disk storage device. Moreover, any connection line may also be appropriately referred to as a computer readable medium. For example, if the software is transmitted from a website, server or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave), the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while optical discs reproduce data optically using lasers.

[0208] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

Claims

1. An audio control method, characterized in that: The method is used in a communication system, the system includes a first electronic device and a second electronic device, the second electronic device includes a first microphone device, and the method includes: The first electronic device establishes a communication connection with the second electronic device; The first electronic device starts a recording application; The first electronic device opens a synchronous directional connection (SCO) path from the first electronic device to the second electronic device; the SCO path includes an upstream path and a downstream path; The second electronic device loads an uplink and downlink mixing module; The second electronic device acquires a first source audio signal through a first microphone device; The codec CODEC of the second electronic device converts the first source audio signal from an analog signal to a digital signal; The digital signal processor DSP of the second electronic device mixes the first source audio signal converted into a digital signal with the data of the downstream path through the upstream and downstream mixing module to obtain a first audio signal; The second electronic device sends the first audio signal to the first electronic device through the uplink path, and the second electronic device plays a second audio signal; the second audio signal is the same as the first audio signal, or the second audio signal is received by the second electronic device from the first electronic device; the second audio signal includes ambient sound data; The recording application of the first electronic device generates a recording based on the first audio signal.

2. The method according to claim 1, characterized in that: The second audio signal is received by the second electronic device from the first electronic device, and includes: The second audio signal is received by the second electronic device from the first electronic device based on a synchronous directional connection (SCO) channel.

3. The method according to claim 2, characterized in that The first electronic device includes a second microphone device, and before the second electronic device plays the second audio signal, the method includes: The first electronic device acquires a second source audio signal through the second microphone device; The codec CODEC of the first electronic device converts the second source audio signal from an analog signal to a digital signal; The mixing module of the first electronic device mixes the second source audio signal converted into a digital signal to obtain the second audio signal.

4. The method according to claim 3, characterized in that: The first electronic device includes: a recording algorithm module and a recording channel control module. Before the second electronic device sends the first audio signal to the first electronic device based on a synchronous directional connection (SCO) channel, the second electronic device includes: The Bluetooth chip of the second electronic device encodes the first source audio signal by using improved sub-band coding mSBC, where the first source audio signal is collected by the first microphone; After the second electronic device sends the first audio signal to the first electronic device based on the synchronous directional connection (SCO) path, the method includes: The Bluetooth chip of the first electronic device decodes the first source audio signal by using the improved sub-band coding mSBC to obtain the first audio signal; The digital signal processor DSP of the first electronic device calls and controls the recording interface to transmit the first audio signal to the recording algorithm module of the hardware abstraction layer; The recording algorithm module transmits the first audio signal to the recording path control module of the application framework; The recording path control module transmits the first audio signal to the recording application at the application layer.

5. The method according to claim 4, characterized in that The first electronic device is configured with a target list, and the recording path control module transmits the first audio signal to the recording application of the application layer, including: If the target list includes the recording application, the recording path control module transmits the first audio signal to the recording application of the application layer.

6. A communication system, characterized in that: include: A first electronic device and a second electronic device, wherein the first electronic device is used to execute the method executed by the first electronic device in the method described in any one of claims 1 to 5, and the second electronic device is used to execute the method executed by the second electronic device in the method described in any one of claims 1 to 5.

7. An electronic device, characterized in that: include: A memory and a processor, the memory being used to store a computer program, and the processor being used to execute the computer program to perform the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed, the computer executes the method according to any one of claims 1 to 5.

9. A computer program product, characterized in that The invention comprises a computer program, which, when being executed, enables an electronic device to execute the method according to any one of claims 1 to 5.

Images