Microphone control method and electronic equipment

Abstract

A microphone control method and an electronic device (100) relate to the technical field of intelligent terminals. When the electronic device (100) is in the first pose, enabling the first array to collect first sound data; wherein the first array comprises a first microphone and a second microphone of the plurality of microphones (170C); starting the first array includes: establishing a connection between a first microphone and a first analog-to-digital converter, and establishing a connection between a second microphone and a second analog-to-digital converter; when the electronic device (100) is in a second pose, enabling a second array to collect second sound data; wherein the second array also comprises a third microphone and a fourth microphone of the plurality of microphones (170C); starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first pose is different from the second pose. The control method can solve the problem that the pickup range of the electronic device (100) is limited.

Description

Microphone control method and electronic equipment

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on December 24, 2022, with application number 202211668285.7 and invention name “A Microphone Control Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the technical field of smart terminals, and in particular to a microphone control method and electronic equipment. Background Art

[0003] With the iterative updates of device hardware, various electronic devices can provide users with more high-quality services. In theory, by increasing the number of microphones connected to electronic devices, the sound pickup range of electronic devices can be expanded.

[0004] However, the number of microphones that can be connected to an electronic device is limited by hardware conditions, so the sound pickup range of the electronic device is always limited.

[0005] Summary of the Invention

[0006] Embodiments of the present application provide a microphone control method and an electronic device for improving the sound pickup range of the electronic device.

[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0008] In a first aspect, an embodiment of the present application provides a microphone control method, which is applied to an electronic device, the electronic device including multiple microphones, a first analog-to-digital converter, and a second analog-to-digital converter. The method includes:

[0009] When the electronic device is in the first posture, a first array is enabled to collect first sound data; wherein the first array includes a first microphone and a second microphone among the multiple microphones.

[0010] Exemplarily, starting the first array includes: establishing a connection between the first microphone and a first analog-to-digital converter, and establishing a connection between the second microphone and a second analog-to-digital converter.

[0011] When the electronic device is in a second posture, the second array is enabled to collect second sound data; wherein the second array also includes the third microphone and the fourth microphone among the multiple microphones.

[0012] Exemplarily, starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first posture is different from the second posture.

[0013] Understandably, different microphones have different pickup directions. By activating arrays composed of different microphones, an electronic device can collect sounds from different areas. Obviously, the more arrays an electronic device can activate, the wider the pickup range.

[0014] In the above embodiment, the electronic device can activate different arrays to collect sound data in different positions, completing the task of picking up sounds of different ranges. In this way, the electronic device has a very large actual pickup range. In addition, when different arrays are activated, it is only necessary to connect different microphones to the analog-to-digital converter. In other words, the analog-to-digital converter no longer corresponds one-to-one with the microphone. In this way, the number of analog-to-digital converters in the electronic device does not limit the number of microphones connected to the electronic device. The electronic device can also combine more microphone arrays to increase the pickup range and meet different sound pickup requirements.

[0015] In some embodiments, before starting the second array, the method further includes: disconnecting the first microphone from the first analog-to-digital converter; and disconnecting the second microphone from the second analog-to-digital converter.

[0016] In the above embodiment, the connection between the analog-to-digital converter and the microphone can be established or disconnected. By controlling the connection between the analog-to-digital converter and the microphone, the microphone array can be switched to enable and the sound pickup range can be flexibly adjusted.

[0017] In some embodiments, before enabling the first array to collect first sound data, the method further includes: collecting first posture information, the first posture information indicating that the electronic device is in the first posture; before enabling the second array to collect second sound data, the method further includes: collecting second posture information, the second posture information indicating that the electronic device is in the second posture.

[0018] In some embodiments, the method further includes: receiving a first operation of a user; and in response to the first operation, switching to enable a third array to collect third sound data, wherein the third array includes a fifth microphone and a sixth microphone among the plurality of microphones.

[0019] In the above embodiment, the user can instruct to change the microphone array to be used, thereby meeting the sound pickup requirements directly instructed by the user and improving the intelligence level of switching microphone arrays of the electronic device.

[0020] As an implementation method, the first operation includes an operation in which the user selects the third array. Before receiving the first operation of the user, the method further includes: displaying a first interface, in which the position distribution of the multiple microphones is displayed; detecting the user's selection operation on the microphone in the first interface; wherein, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0021] In this implementation, the user can directly select the microphone array to be enabled. For example, before instructing the electronic device to enable sound pickup, the user can first specify the microphone array involved in sound pickup to ensure that the sound pickup result meets the user's requirements.

[0022] In some embodiments, the first operation is an operation of indicating a first direction, and in the electronic device, the third array corresponds to the first direction.

[0023] In some embodiments, before receiving the first operation of the user, the method includes: displaying a second interface, the second interface being an application interface of a conference service application, the second interface including a location distribution map of the participants; when detecting that the user selects the first participant in the second interface, and the direction between the first participant and the user is the first direction, determining that the first operation is received.

[0024] In some embodiments, the method further includes: detecting establishment of a communication connection with the stylus; switching to enable a fourth array to collect fourth sound data, wherein the fourth array includes a seventh microphone among the plurality of microphones and a microphone configured on the stylus.

[0025] In some embodiments, the electronic device is configured with a first model, which is a machine learning model for identifying a matching microphone array. The method also includes: obtaining current scene information, the scene information including one or more combinations of system time, positioning location, device power and posture information; inputting the current scene information into the first model to determine the fifth array; and enabling the fifth array to collect fifth sound data.

[0026] In some embodiments, the electronic device includes a first list, wherein the first list records a match between the first array and the first posture, and also records a match between the second array and the second posture.

[0027] In a second aspect, an embodiment of the present application provides an electronic device, comprising one or more processors and a memory; the memory is coupled to the processor, and the memory is used to store computer program code, the computer program code including computer instructions. When the one or more processors execute the computer instructions, the one or more processors are configured to:

[0028] When the electronic device is in a first posture, the first array is enabled to collect first sound data; wherein, the first array includes the first microphone and the second microphone among the multiple microphones; starting the first array includes: establishing a connection between the first microphone and the first analog-to-digital converter, and establishing a connection between the second microphone and the second analog-to-digital converter; when the electronic device is in a second posture, the second array is enabled to collect second sound data; wherein, the second array also includes the third microphone and the fourth microphone among the multiple microphones; starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first posture is different from the second posture.

[0029] In some embodiments, the one or more processors are further configured to: disconnect the first microphone from the first analog-to-digital converter; and disconnect the second microphone from the second analog-to-digital converter.

[0030] In some embodiments, the one or more processors are further used to: collect first posture information, the first posture information indicating that the electronic device is in the first posture; collect second posture information, the second posture information indicating that the electronic device is in the second posture.

[0031] In some embodiments, the one or more processors are further used to: receive a first operation from a user; and in response to the first operation, switch to enable a third array to collect third sound data, wherein the third array includes a fifth microphone and a sixth microphone among the multiple microphones.

[0032] In some embodiments, the one or more processors are further used to: display a first interface, in which the position distribution of the multiple microphones is displayed; detect a user's selection operation on the microphone in the first interface; wherein, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0033] In some embodiments, the first operation is an operation of indicating a first direction, and in the electronic device, the third array corresponds to the first direction.

[0034] In some embodiments, the one or more processors are also used to: display a second interface, where the second interface is an application interface of a conference service application, and the second interface includes a location distribution map of the participants; when it is detected that the user selects the first participant in the second interface, and the direction between the first participant and the user is the first direction, it is determined that the first operation has been received.

[0035] In some embodiments, the one or more processors are further used to: detect establishment of a communication connection with the stylus; and switch to enable a fourth array to collect fourth sound data, wherein the fourth array includes a seventh microphone among the multiple microphones and a microphone configured on the stylus.

[0036] In some embodiments, the one or more processors are further used to: obtain current scene information, which includes one or more combinations of system time, positioning location, device power and posture information; input the current scene information into the first model to determine the fifth array; and enable the fifth array to collect fifth sound data.

[0037] In some embodiments, the electronic device includes a first list, wherein the first list records a match between the first array and the first posture, and also records a match between the second array and the second posture.

[0038] In a third aspect, an embodiment of the present application provides a computer storage medium, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method in the above-mentioned first aspect and its possible embodiments.

[0039] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on the above-mentioned electronic device, the electronic device executes the method in the above-mentioned first aspect and its possible embodiments.

[0040] It can be understood that the electronic devices, computer storage media and computer program products provided in the above aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] FIG1 is one of the exemplary diagrams of the distribution of microphones in an electronic device (tablet computer) provided in an embodiment of the present application;

[0042] FIG2 is a second diagram illustrating the distribution of microphones in an electronic device (tablet computer) according to an embodiment of the present application;

[0043] FIG3 is one of the exemplary diagrams of the hardware structure of the electronic device provided in an embodiment of the present application;

[0044] FIG4 is a second diagram illustrating a hardware structure of an electronic device according to an embodiment of the present application;

[0045] FIG5 is a third diagram illustrating a hardware structure of an electronic device according to an embodiment of the present application;

[0046] FIG6 is one of the example diagrams of a switching microphone array provided in an embodiment of the present application;

[0047] FIG7 is a second example diagram of a switching microphone array provided in an embodiment of the present application;

[0048] FIG8 is a third example diagram of a switching microphone array provided in an embodiment of the present application;

[0049] FIG9 is one of the example diagrams of the sound pickup range corresponding to the microphone array provided in an embodiment of the present application;

[0050] FIG10 is a second example diagram of the sound pickup range corresponding to the microphone array provided in an embodiment of the present application;

[0051] FIG11 is one of the example diagrams of selecting a collection direction provided in an embodiment of the present application;

[0052] FIG12 is a second example diagram of selecting a collection direction provided in an embodiment of the present application;

[0053] FIG13 is an example diagram of the sound pickup range of a collaborative system composed of an electronic device and a stylus provided in an embodiment of the present application;

[0054] FIG14 is an example diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0056] With the development of technology, the hardware resources configured in various electronic devices (such as storage resources, computing resources, input and output resources, etc.) are constantly iterating and upgrading, aiming to provide users with higher quality services.

[0057] Taking the audio acquisition module (such as a microphone) of an electronic device as an example, as the audio acquisition module is continuously iterated and upgraded, the quality of the audio acquisition services provided by the electronic device also improves accordingly.

[0058] In some embodiments, electronic devices can upgrade their audio acquisition modules by increasing the number of microphones. For example, the microphone on an electronic device can be upgraded from a single microphone to four microphones, or even eight microphones. This increase in microphones allows for more sound pickup angles, effectively expanding the sound pickup range of the electronic device.

[0059] In some embodiments, microphones in an electronic device may pick up different sound directions depending on their placement. For example, microphones located on different sides of an electronic device may pick up different sound directions. Of course, some microphones may have different placements but the same sound pickup direction. For example, microphones located on the same side of an electronic device may have different placements but the same sound pickup direction.

[0060] In some embodiments, the electronic device may be a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (PDA), a wearable device (such as a smartwatch), a smart screen, a game console, an augmented reality (AR) or virtual reality (VR) device, or other intelligent electronic device. In the following embodiments, the electronic device is primarily exemplified by a tablet computer.

[0061] Taking a tablet as an example, the tablet's body includes four side edges. The tablet's microphones can be deployed on these four side edges. For example, each side edge can be configured with one or more microphones. As shown in Figure 1 , the top edge can be configured with microphones a and b, the bottom edge can be configured with microphones e and f, the left edge of the tablet can be configured with microphone c, and the right edge can be configured with microphone d.

[0062] In another exemplary embodiment, some side edges are configured with at least one microphone, while some side edges are not configured with a microphone. For example, the upper edge, the left edge, and the right edge are all configured with at least one microphone, while the lower edge is not configured with a microphone.

[0063] In addition, as shown in FIG1 , the tablet computer body also includes a back cover, which is disposed opposite the display screen. Typically, the back cover can be used to house the tablet computer's rear camera. In some examples, a microphone can also be disposed on the tablet computer's back cover. For example, at least one microphone can be disposed on one side of the tablet computer's rear camera.

[0064] In some embodiments, the tablet computer can collect sounds from sound sources in different directions through a microphone installed on the tablet computer.

[0065] For example, when the tablet is in landscape mode, the microphone configured on the upper edge is used to pick up sound emitted by a sound source located above the tablet. The microphone configured on the lower edge is used to pick up sound emitted by a sound source located below the tablet. The microphone configured on the back cover is used to pick up sound emitted by a sound source located in front of the tablet. The microphone configured on the left edge is used to pick up sound emitted by a sound source located to the left of the tablet. The microphone configured on the right edge is used to pick up sound emitted by a sound source located to the right of the tablet.

[0066] Of course, the sound pickup directions of the various microphones may also change. For example, when the tablet computer's posture in space changes, the sound pickup directions of the various microphones may also change accordingly.

[0067] For example, when the tablet is rotated to the right side to the portrait mode, as shown in Figure 2, microphones a and b, located on the original upper edge, are used to pick up sound from a sound source located to the right of the tablet. Microphones e and f, located on the original lower edge, are used to pick up sound from a sound source located to the left of the tablet. Microphone g, located on the back cover, is used to pick up sound from a sound source located in front of the tablet. Microphone c, located on the original left edge, is used to pick up sound from a sound source located above the tablet, and microphone d, located on the original right edge, is used to pick up sound from a sound source located below the tablet.

[0068] For example, when the tablet is rotated to the left to the portrait orientation, microphones a and b, located on the original top edge, are used to pick up sound from sources to the left of the tablet. Microphones e and f, located on the original bottom edge, are used to pick up sound from sources to the right of the tablet. Microphone g, located on the back cover, is used to pick up sound from sources in front of the tablet. Microphone c, located on the original left edge, is used to pick up sound from sources below the tablet. Microphone d, located on the original right edge, is used to pick up sound from sources above the tablet.

[0069] It should be noted that the above-mentioned directions of up, down, left, and right may be determined with reference to the tablet computer housing. For example, if the tablet computer is rectangular, the two relatively short edges of the tablet computer housing are the left edge and the right edge, and the two relatively long edges are the top edge and the bottom edge.

[0070] In addition, in addition to collecting sound data through the microphone configured on the body of the electronic device, the electronic device can also collect sound data through a third-party device (such as headphones, stylus). For example, after the third-party device establishes a communication connection with the electronic device, the microphone of the third-party device can collect sound. Then, the third-party device can send the collected sound data to the electronic device. Obviously, the microphone of the third-party device can additionally increase the sound pickup direction of the electronic device. Of course, the sound pickup directions provided by some third-party devices are relatively more variable. For example, the sound pickup directions provided by the stylus are different at different angles. The sound pickup directions provided by some third-party devices are relatively fixed. For example, when the headphones are worn by the user, the sound pickup directions provided are relatively fixed.

[0071] Ideally, the more microphones an electronic device can connect to, the wider the sound pickup range, thus providing users with higher-quality sound pickup services (e.g., recording services). However, in reality, the number of microphones that can be connected to an electronic device (including microphones of third-party devices) is limited.

[0072] It is understandable that the sound data (e.g., sound wave signals) collected by the microphone must be converted from analog to digital by an analog-to-digital converter (ADC). The converted sound data is then recognized and processed by the electronic device. After completing the analog-to-digital conversion of the sound data, the ADC can pass the sound data to a digital encoder / decoder (Codec Digital). This allows the sound data collected by the microphone to be encoded and compressed, and the encoded and compressed sound data can then be used for subsequent services, such as storage and transmission.

[0073] However, due to device chip limitations, the number of analog-to-digital converters in electronic devices is limited. Furthermore, microphones must correspond one-to-one with each analog-to-digital converter, which limits the number of microphones that can be connected to an electronic device. For example, if an electronic device only has three analog-to-digital converters, the number of microphones that can be connected to the electronic device cannot exceed three. If an analog-to-digital converter is also reserved for the microphone of a third-party device, the electronic device cannot have more than two microphones configured on the device, otherwise the microphone will not function properly.

[0074] The embodiment of the present application provides a microphone control method for electronic devices. Without adding an analog-to-digital converter to the electronic device, by dynamically switching the microphone connected to the analog-to-digital converter, different microphone arrays (including multiple microphones) or different single microphones are used to pick up sound in different ranges by utilizing the different pickup directions of different microphones. In this way, the analog-to-digital converter no longer limits the number of microphones that can be connected to the electronic device.

[0075] Please refer to FIG3 , which is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application.

[0076] As shown in Figure 3, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0077] Among them, the above-mentioned sensor module 180 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.

[0078] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0079] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0080] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0081] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0082] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0083] It is understood that the interface connection relationship between the modules illustrated in this embodiment is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0084] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0085] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0086] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0087] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED).

[0088] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0089] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0090] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include N cameras 193, where N is a positive integer greater than 1.

[0091] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0092] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0093] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0094] Microphone 170C can be used to collect sounds in the environment. In the embodiment of the present application, the microphone 170C can include multiple microphones, and the arrangement positions, or installation positions, of the multiple microphones 170C on the electronic device can be different. For example, Figure 1 is an example of the arrangement of microphones 170C on an electronic device. Of course, the electronic device can also be installed with more or fewer microphones, and similarly, the microphones can be arranged in other ways on the electronic device.

[0095] In some embodiments, the electronic device may include a digital codec, an ADC, and multiple microphones.

[0096] In some embodiments, the digital codec is connected to an ADC. The ADC can establish a connection with a microphone and simultaneously disconnect from the microphone. A single ADC can only establish a connection with a single microphone during a given time period. The ADC can establish connections with different microphones during different time periods.

[0097] After the connection between the ADC and the microphone is established, the sound data collected by the microphone can be converted from analog to digital by the ADC. The sound data after the ADC analog conversion processing can also be sent to the digital codec, which will be encoded and compressed by the digital codec.

[0098] In other embodiments, a connection can be established between the ADC and the microphone via a bias circuit. That is, the electronic device may further include multiple bias circuits, each of which is connected to the microphone. Furthermore, the bias circuit can also be connected to the ADC. When a connection is established between the bias circuit and the ADC, the sound data collected by the microphone must first be processed with a bias voltage before being passed to the ADC for analog-to-digital conversion. The operating principle of the bias circuit can be found in related art and will not be further described here.

[0099] In addition, while the bias circuit can establish a connection with the ADC, the connection between the bias circuit and the ADC can also be disconnected. In this way, by controlling the connection between the bias circuit and the ADC, the ADC can be connected to different microphones at different times.

[0100] In some examples, a fixed connection relationship is established between a microphone and a bias circuit. For example, bias circuit 0, bias circuit 2, bias circuit 3, bias circuit 4, and bias circuit 5 are shown in Figure 4. Among them, a connection is established between bias circuit 0 and microphone 0, and bias circuit 0 can receive sound data collected by microphone 0. A connection is established between bias circuit 2 and microphone 2, and bias circuit 2 can receive sound data collected by microphone 2, and so on. In addition, the above-mentioned microphone 0 can be a microphone from a stylus (third-party device). The above-mentioned microphone 2, microphone 3, microphone 4, and microphone 5 can be microphones installed on the body of the electronic device.

[0101] In other examples, multiple microphones can also reuse the same bias circuit. When multiple microphones reuse the same bias circuit, only one microphone can be connected to the bias circuit at the same time. For example, the bias circuit 1 shown in Figure 4 can be connected to microphone 1 (one of the microphones configured on the electronic device body) or the microphone of the headset (third-party device). That is, microphone 1 and the microphone of the headset need to reuse bias circuit 1. In some examples, when the electronic device is connected to the headset, it is the headset microphone that is connected to the bias circuit 1. When the electronic device is not connected to the headset, it is microphone 1 that is connected to the bias circuit 1.

[0102] In some examples, the electronic device further includes an earphone detection module, which can be used to detect whether an earphone is plugged into the electronic device. For example, the earphone detection module can include an ACCDET module, and the principle of detecting whether an earphone is plugged in can be referred to in related art and will not be described in detail here.

[0103] Furthermore, if the headset is detected to be connected to an electronic device, bias circuit 1 is connected to the headset microphone. In this case, bias circuit 1 only receives sound data collected by the headset microphone. If the headset is not detected to be connected to an electronic device, bias circuit 1 is connected to microphone 1. In this case, bias circuit 1 can receive sound data collected by microphone 1.

[0104] In other embodiments, the connection between the ADC and the microphone (or bias circuit) can be established or disconnected by a data selection module.

[0105] In some examples, the data selection module may be a PGA-MUX device, so that one data selection module can be connected to one ADC.

[0106] In this example, if the number of ADCs in the electronic device is the same as the number of data selection modules, then the ADCs correspond one-to-one with the data selection modules. For example, as shown in Figure 4, the electronic device includes ADC1, ADC2, ADC3, data selection module 1, data selection module 2, and data selection module 3. ADC1 uniquely corresponds to data selection module 1, ADC2 uniquely corresponds to data selection module 2, and ADC3 uniquely corresponds to data selection module 3.

[0107] In this example, if the number of ADCs in the electronic device is different from the number of data selection modules, that is, the number of data selection modules can be less than the number of ADCs, each data selection module is connected to an ADC, but there may be ADCs that are not connected to a data selection module. For example, as shown in Figure 5, the electronic device includes ADC4, ADC5, ADC6, data selection module 1, and data selection module 2. ADC4 is connected to data selection module 1, and ADC5 is connected to data selection module 2. ADC6 is not connected to a data selection module.

[0108] In some embodiments, in addition to being connected to the ADC, the data selection module can also establish a connection with at least one microphone, for example, by establishing a connection with the microphone through a bias circuit. It is understood that the data selection module is a switch-like device that can not only establish a connection with the microphone, but also disconnect the connection with the microphone.

[0109] In the case where the data selection module can establish connections with multiple microphones, only one microphone can be connected to the data selection module at the same time period. The data selection module can choose to establish connections with different microphones at different time periods.

[0110] In this way, after the data selection module establishes a connection with the selected microphone, for example, after being connected to the bias circuit corresponding to the selected microphone, the sound data collected by the microphone can be transmitted to the corresponding ADC through the data selection module after being processed by the bias circuit.

[0111] For example, as shown in Figure 4, when the data selection module 1 can select microphone 0 from microphone 1 to establish a connection with microphone 0, the data selection module 1 can receive the sound data 1 (sound data collected by microphone 0) processed by the bias circuit 0 and pass the sound data 1 to ADC1. It can be seen that after the data selection module 1 establishes a connection with microphone 0, it is equivalent to establishing a data transmission channel between microphone 0 and ADC1. At this time, the sound data collected by microphone 0 can be normally passed to ADC1, and ADC1 performs analog-to-digital conversion. Then, ADC1 can pass the analog-to-digital converted sound data to the digital encoder / decoder, which performs encoding, compression, and other processing. That is, the electronic device can normally enable microphone 0, but cannot enable microphone 1.

[0112] Of course, between microphone 0 and microphone 1, the data selection module 1 can also choose to disconnect from microphone 0 and establish a connection with microphone 1. In this way, the data selection module 1 can receive the sound data 2 (the sound data collected by microphone 1) after being processed by the bias circuit 1, and pass the sound data 2 to ADC1. It can be seen that after the data selection module 1 establishes a connection with microphone 1, it is equivalent to establishing a data transmission channel between microphone 1 and ADC1, and disconnecting the data transmission channel between microphone 0 and ADC1. At this time, the sound data collected by microphone 1 can be normally passed to ADC1, and ADC1 will perform analog-to-digital conversion. Then, ADC1 can pass the sound data that has undergone analog-to-digital conversion to the digital encoder / decoder, which will perform encoding, compression, and other processing. In other words, the electronic device can normally enable microphone 1, but cannot enable microphone 0.

[0113] Similarly, the data selection module 2 in FIG4 can also select to enable microphone 2 or microphone 3 by establishing a connection between ADC2 and microphone 2, or by establishing a connection between ADC2 and microphone 3. The data selection module 3 in FIG4 can also select to enable microphone 4 or microphone 5 by establishing a connection between ADC3 and microphone 4, or by establishing a connection between ADC3 and microphone 5.

[0114] As can be seen, in the case of only three ADCs, the electronic device provided by the embodiment of the present application can be connected to six microphones (including microphones of third-party devices). Of course, more microphones can be connected. For example, when a single data selection module can select one of three microphones to establish a connection, a total of nine microphones can be connected to the electronic device. In addition, all microphones connected to the electronic device can be used normally.

[0115] Understandably, within a given time period, the same ADC can only establish a connection with one microphone. Only when a connection is established between the ADC and a microphone can the ADC receive sound data collected by that microphone. Furthermore, the electronic device can change the microphone connected to the ADC through the data selection module during different time periods.

[0116] That is, in the embodiment of the present application, the electronic device can dynamically switch the microphone connected to the ADC by using the above data selection module. For the convenience of description, "switching the microphone connected to the ADC" will be referred to as switching for the ADC.

[0117] In some embodiments, the electronic device can enable at least one microphone for sound collection, wherein the enabled microphone is connected to the ADC. Microphones connected to different ADCs can operate normally simultaneously without affecting each other. When multiple microphones are enabled simultaneously, the electronic device can be considered to have enabled a microphone array.

[0118] In addition, the electronic device can enable different microphone arrays by switching at least one ADC.

[0119] For example, as shown in FIG6 , a connection is established between ADC1 in the electronic device and microphone 0. A connection is established between ADC2 in the electronic device and microphone 2. A connection is established between ADC3 in the electronic device and microphone 4. At this point, the electronic device can enable the microphone array consisting of microphone 0, microphone 2, and microphone 4 to collect sound.

[0120] After dynamic switching of all ADCs, ADC1 in the electronic device can be switched to connect to microphone 1, ADC2 can be switched to connect to microphone 3, and ADC3 can be switched to connect to microphone 5. At this time, the electronic device enables the microphone array composed of microphone 1, microphone 3 and microphone 5 to collect sound.

[0121] In addition, when the electronic device performs dynamic switching only for ADC1, it can switch to enable the microphone array consisting of microphone 1, microphone 2, and microphone 4. When the electronic device performs dynamic switching only for ADC2, it can switch to enable the microphone array consisting of microphone 0, microphone 3, and microphone 4. When the electronic device performs dynamic switching only for ADC3, it can switch to enable the microphone array consisting of microphone 0, microphone 2, and microphone 5. When the electronic device performs dynamic switching for ADC1 and ADC2, it can switch to enable the microphone array consisting of microphone 1, microphone 3, and microphone 4, etc.

[0122] Of course, electronic devices may also include ADCs that cannot be dynamically switched, such as ADC6 in Figure 5 . As shown in Figure 5 , ADC6 lacks a corresponding data selection module and is fixedly connected to bias circuit 4 . In other words, ADC6 can only communicate with bias circuit 4 and can only receive and process audio data sent by bias circuit 4 (audio data collected by microphone 4 ). Unlike ADC4 and ADC5 in Figure 5 , ADC6 cannot switch the microphone it is connected to.

[0123] In other examples, the data selection module may be an analog circuit with a selection function. For example, the analog circuit may select N microphones from M microphones, where M is a positive integer greater than N, M may be the number of microphones connected to the electronic device, and N may be the number of ADCs in the electronic device.

[0124] In this example, the data selection module may connect to all ADCs. Alternatively, the data selection module may select a specified number of microphones from the microphones connected to the electronic device and establish connections therewith.

[0125] As shown in Figure 7, the electronic device includes ADC1, ADC2, ADC3, and a data selection module 4. Data selection module 4 can establish connections with each of ADC1, ADC2, and ADC3, allowing it to send different data to each of these three devices simultaneously. Furthermore, data selection module 4 is capable of establishing a connection with each microphone and, of course, also disconnecting from each microphone.

[0126] Based on this, data selection module 4 can select three microphones from the microphones connected to the electronic device and establish connections. In this way, data selection module 4 can send the three channels of sound data collected by the three microphones to ADC1, ADC2, and ADC3, respectively. For example, if microphone 2, microphone 4, and microphone 5 are selected, data selection module 4 can transmit the sound data collected by microphone 2 to ADC1, the sound data collected by microphone 4 to ADC2, and the sound data collected by microphone 5 to ADC3.

[0127] This means that data selection module 4 has established a connection between microphone 2 and ADC1, a connection between microphone 4 and ADC2, and a connection between microphone 5 and ADC3. This allows the electronic device to normally activate microphones 2, 4, and 5 to perform sound collection tasks, while deactivating microphones 0, 1, and 3. At this point, the electronic device activates the microphone array consisting of microphones 2, 4, and 5.

[0128] In some embodiments, the electronic device may also select to establish connections with different microphones through the instruction data selection module 4, so that different microphone arrays can be combined.

[0129] For example, if data selection module 4 reselects microphone 0, microphone 2, and microphone 4 to establish connections, as shown in Figure 8, this is equivalent to data selection module 4 establishing a connection between microphone 0 and ADC1, a connection between microphone 2 and ADC2, and a connection between microphone 4 and ADC3. In this way, the electronic device can normally enable microphone 0, microphone 2, and microphone 4, while deactivating microphone 1, microphone 3, and microphone 5. At this point, the electronic device switches to enable the microphone array consisting of microphone 0, microphone 2, and microphone 4.

[0130] Furthermore, the connection between the data selection module and the microphone mentioned in the aforementioned embodiment may be established through a bias circuit in addition to a direct connection between the data selection module and the microphone. For example, after the data selection module establishes a connection with bias circuit 0, since bias circuit 0 also has a connection with microphone 0, it can be considered that the data selection module establishes a connection with microphone 0 through bias circuit 0.

[0131] In summary, the electronic device provided in the embodiment of the present application can dynamically switch the microphone arrays to be enabled. It can be understood that different microphone arrays can collect sounds in different ranges of the environment in which the electronic device is located.

[0132] For example, as shown in Figure 9, when the microphone array consisting of microphone c, microphone a, and microphone b is enabled, the electronic device can pick up sounds in range area 1. For another example, as shown in Figure 10, when the microphone array consisting of microphone a, microphone b, and microphone d is enabled, the electronic device can pick up sounds in range area 2.

[0133] In some embodiments, the electronic device can intelligently enable different microphone arrays to meet different sound pickup requirements of users. When the electronic device decides which microphone array to use, it can use any of the following methods:

[0134] In the first method, the electronic device can determine the appropriate microphone array based on the detected posture information.

[0135] Among them, the above-mentioned posture information can indicate the posture of the electronic device in space. For example, the above-mentioned posture may include being parallel to the horizontal plane in the horizontal screen state (such as referred to as posture 1), being at an angle less than angle 1 (such as 90 degrees) with the horizontal plane in the horizontal screen state (such as referred to as posture 2), being at an angle not less than angle 1 with the horizontal plane in the horizontal screen state (such as referred to as posture 3), etc. For another example, the above-mentioned posture also includes being parallel to the horizontal plane in the vertical screen state (such as referred to as posture 4), being at an angle less than angle 1 (such as 90 degrees) with the horizontal plane in the vertical screen state (such as referred to as posture 5), being at an angle not less than angle 1 with the horizontal plane in the vertical screen state (such as referred to as posture 6), etc.

[0136] In some embodiments, the electronic device may periodically determine the position information corresponding to the electronic device. For example, every minute, the electronic device may determine the position information of the electronic device based on data collected by a gyroscope, a gravity sensor, an accelerometer, and the like. The specific implementation process can be referenced in related technologies and will not be further described here.

[0137] In other embodiments, the electronic device may respond to a specific event and determine the corresponding posture information of the electronic device.

[0138] Exemplarily, the specific event may be the activation of a specified application, such as a recording application, conference application, or voice call application that requires microphone activation. Exemplarily, the specific event may be the receipt of a specific instruction, such as an instruction to activate a sound collection function. Exemplarily, the specific event may be the detection that an enabled microphone array does not meet the conditions for continued use. For example, if it is detected that some microphones in an enabled microphone array are blocked, the electronic device may determine that the microphone array does not meet the conditions for continued use.

[0139] In this way, the electronic device can determine the current posture of the electronic device through the collected posture information, and then select the microphone array that actually needs to be activated based on the current posture.

[0140] As an implementation method, the electronic device may be pre-configured with a table a of correspondences between different postures and different microphone arrays. For example, if the electronic device is a tablet computer as shown in FIG1 , and the tablet computer only has three ADCs, the table a of correspondences between postures and microphone arrays may be as shown in Table 1 below:

[0141] Table 1

[0142] It is understandable that the above Table 1 is only an example of the corresponding relationship and does not serve as a limitation on the embodiments of the present application. Of course, it can be seen from the above Table 1 that a single posture can correspond to one or more microphone arrays, and the number of microphones in each microphone array does not exceed the total number of ADCs. The ADCs corresponding to the microphones in the same group are different, so that the microphones in the same group can work normally, that is, they can pass the collected sound data to the digital codec in parallel, and the digital codec performs encoding, compression and other processing.

[0143] It should also be noted that in addition to enabling the microphone array to collect sound data, the electronic device can also enable a single microphone to collect sound data. Similarly, the electronic device can pre-configure a single microphone that is most suitable for sound collection in different postures. In this way, the electronic device can also switch to enable different single microphones for sound collection based on different posture information. In subsequent embodiments, the judgment logic and methods related to the microphone array are also applicable to single microphones, and will not be repeated in subsequent embodiments.

[0144] In addition, the number and type of postures can be set based on empirical values. The correspondence between different postures and microphone arrays can be obtained by testing. For example, in each posture, the sound pickup effect corresponding to all enabled microphone arrays is tested. The sound pickup effect can be distinguished by a sound effect score, which can be the score of the collected sound data by the artificial intelligence model from the perspectives of sound quality and volume. Then, the microphone array whose sound pickup effect is ranked before the specified ranking is selected as the microphone array corresponding to the posture, and the above-mentioned correspondence table a is formed.

[0145] When the electronic device is configured with the above-mentioned correspondence table a, the electronic device can query the microphone array that matches the current posture through the above-mentioned comparison relationship table a and activate the microphone array. For example, based on the collected posture information, it is determined that the current posture of the electronic device is posture 3. Then, according to Table 1, the matching microphone arrays can be queried, including microphone b, microphone d, and microphone g. In this scenario, the electronic device can use the queried microphone array as the microphone array that actually needs to be activated.

[0146] Alternatively, the microphone array can be activated by establishing a connection between each microphone in the array and its corresponding ADC. The sound data collected by each microphone in the array is processed by the corresponding bias circuit and then transmitted to the corresponding ADC via a data selection module. After the corresponding ADC completes analog-to-digital conversion of the sound data, the sound data is sent to a digital codec, which encodes and compresses the sound data. This allows the microphone array to operate normally.

[0147] Of course, if there is no data selection module between the microphones in the microphone array and the ADC, the sound data collected by the microphone is processed by the bias circuit and then sent directly to the corresponding ADC, which performs analog-to-digital conversion on the sound data. Finally, the digital codec encodes and compresses the sound data. For example, in Figure 5, when ADC6 and microphone 4 are included in the microphone array, the sound data collected by microphone 4 is processed by bias circuit 4 and then sent directly to ADC6 for analog-to-digital conversion.

[0148] In addition, in some special cases, such as when multiple matching microphone arrays are queried, one of the multiple matching microphone arrays can be selected as the microphone array actually enabled.

[0149] Exemplarily, the selection may be performed in a random manner, that is, the electronic device may use a preconfigured random algorithm to select a microphone array from a plurality of matching microphone arrays as the currently enabled microphone array.

[0150] As another example, a microphone array that meets preset conditions may be selected.

[0151] For example, the above-mentioned preset conditions may include being marked with commonly used tags by the user. In some examples, the electronic device may pre-display an example diagram of the distribution of each microphone on the electronic device. During the display of the distribution example diagram, the user can select a commonly used microphone, and the electronic device can determine the commonly used microphone based on the user's selection. In this way, among multiple microphone arrays corresponding to the same posture, the array containing the most commonly used microphones can be marked with a commonly used tag. In other examples, the electronic device may pre-display an example diagram of the distribution of each microphone on the electronic device. During the display of the distribution example diagram, the electronic device may also display microphone arrays matching different postures in sequence. At this time, the user can select a commonly used microphone array by clicking on the display screen of the electronic device. Correspondingly, the electronic device may also mark a commonly used tag for the microphone array selected by the user.

[0152] In this way, the electronic device can select a microphone array with a common tag from a plurality of matching microphone arrays by identifying the common tag as the currently actually enabled microphone array.

[0153] For another example, the above-mentioned preset conditions may also include the best sound pickup effect in the current environment. The sound pickup effect may be distinguished by a sound effect score, which may be a score of the collected sound data by the artificial intelligence model based on sound quality and volume.

[0154] In this way, the electronic device can enable each matching microphone array in turn to collect sound for a short period of time, and then use the artificial intelligence model to score the sound data collected by each microphone array to determine the microphone array with the best sound pickup effect as the microphone array currently actually enabled.

[0155] For another example, the aforementioned preset conditions may also include that no microphone is blocked. In some examples, the vibration amplitude of the sound wave signal collected by the microphone can be compared with a preset value (empirical value). If the vibration amplitude corresponding to the microphone is less than the preset value, and the vibration amplitudes corresponding to other microphones are not less than the preset value, then the microphone is determined to be blocked.

[0156] In this way, the electronic device can first determine the blocked microphone, and then select a microphone array that does not contain the blocked microphone from the matching microphone array as the currently actually enabled microphone array.

[0157] In addition, there is a case where, when the actually enabled microphone array (e.g., microphone array 1) is determined, the microphone array 1 does not contain any blocked microphones. If a microphone in microphone array 1 is blocked while microphone array 1 is enabled, a requery of the microphone array matching the current pose can be triggered, and the actually enabled microphone array can be re-determined.

[0158] In the second method, the electronic device can determine the appropriate microphone array according to the collection direction selected by the user.

[0159] In some embodiments, the electronic device may determine the user-selected collection direction based on the user's operation on the display screen, wherein the collection direction may include left front, right front, left, right, and front, etc.

[0160] For example, the user may click on the display screen, and the electronic device may determine the collection direction according to the direction between the clicked position and a pre-selected point.

[0161] For example, when the center point of the display screen is configured as a fixed pre-selected point, as shown in Figure 11, the user clicks position 1101 on the display screen, and the electronic device can recognize position 1101 as the clicked position. In this case, the direction between the center point 1102 of the display screen and position 1101 is the left front, so the electronic device can determine that the acquisition direction is the left front.

[0162] For another example, when a user attends an offline meeting, a conference service application can be enabled in the electronic device to record voice conference minutes. During the activation of the conference service application, as shown in Figure 12, the electronic device can display a conference service interface. Among them, the conference service interface includes the positions of multiple participants, such as, position 1201 indicates the position of participant A in the current conference scene, position 1202 indicates the position of participant B in the current conference scene, position 1203 indicates the position of participant C in the current conference scene, position 1204 indicates the position of participant D in the current conference scene, position 1205 indicates the position of the user in the current conference scene, and position 1206 indicates the position of participant E in the current conference scene. The user's position in the current conference scene, that is, position 1205 can be used as a pre-selected point.

[0163] In addition, the position distribution of the participants in the above conference service interface can be determined based on the seating template selected by the user, the number of participants input, etc. Alternatively, the position distribution of the participants in the above conference service interface can also be generated based on an on-site photo of the current conference scene, which is not limited in this embodiment of the present application.

[0164] Continuing with the previous example, if a user clicks on any participant's location, the direction between the selected participant's location and the user's location can be used as the selected collection direction. For example, if the user selects participant A's location, i.e., location 1201, and the direction between location 1201 and the user's location (i.e., location 1205) is the left front, the left front can be determined as the collection direction.

[0165] After determining the collection direction, the electronic device can determine the appropriate microphone array by looking up a table.

[0166] As an implementation method, a table b of correspondences between different acquisition directions and different microphone arrays can be pre-configured in the electronic device. For example, if the electronic device is a tablet computer as shown in Figure 1, and the tablet computer only has three ADCs, the table b of correspondences between postures and microphone arrays can be as shown in Table 2 below:

[0167] Table 2

[0168] It can be understood that the above Table 2 is only an example of the corresponding relationship and cannot be regarded as a specific limitation of the corresponding relationship Table b in the embodiment of the present application.

[0169] Of course, in actual application, the above correspondence table b may include more or updated collection directions, and the microphone arrays corresponding to different collection directions are determined through pre-testing.

[0170] Take the test of the microphone array corresponding to the left front as an example: first, place the sound source on the left front of the electronic device, then enable different microphone arrays to collect sound data, and then evaluate the pickup effect of each group of microphone arrays based on the collected sound data, and then select the microphone array whose pickup effect ranks before the specified ranking as the microphone array corresponding to the left front, and create the corresponding relationship table b.

[0171] When the electronic device is configured with the above-mentioned correspondence table b, the electronic device can query the microphone array that matches the user's selected collection direction through the above-mentioned comparison relationship table b and activate the microphone array. For example, based on the user's selected collection direction as the front, the matching microphone array can be queried through Table 2 to include microphone a and microphone b. At this time, the electronic device can use the matching microphone array as the microphone array that actually needs to be activated. At present, the process of activating the microphone array can refer to the description in the aforementioned embodiment and will not be repeated here.

[0172] In addition, in some special cases, such as when multiple matching microphone arrays are found, one of the multiple matching microphone arrays can be selected as the actual microphone array to be activated. The method for selecting the actual microphone array to be activated from the multiple matching microphone arrays can be found in the description of the previous embodiment and will not be repeated here.

[0173] In the third method, the electronic device can randomly select an appropriate microphone array.

[0174] In some embodiments, the electronic device is configured with an array table, which lists all available microphone arrays. The electronic device can select a microphone array from all available microphone arrays based on the above array table and enable the microphone array. During the activation process, the sound pickup effect of the microphone array is evaluated based on the sound data collected by the microphone array. If the sound pickup effect of the microphone array is unqualified, for example, the score corresponding to the sound pickup effect is less than the specified score, then the electronic device is triggered to reselect an adapted microphone array. Among them, the above specified score can be an empirical value, which is not specifically limited here. If the sound pickup effect of the microphone array is qualified, for example, the score corresponding to the sound pickup effect is not less than the specified score, then continue to use the current microphone array.

[0175] The electronic device may reselect an adapted microphone array by randomly selecting another one from the previously enabled microphone arrays and enabling the newly selected microphone array. While the newly selected microphone array is enabled, the sound pickup effect of the newly selected microphone array is repeatedly evaluated. If the sound pickup effect of the newly selected microphone array is also unsatisfactory, the electronic device may be triggered to select an adapted microphone array again. If the sound pickup effect of the newly selected microphone array is unsatisfactory, the newly selected microphone array may continue to be used.

[0176] In other possible embodiments, the electronic device may sequentially activate each microphone array to collect sound data. The collected sound data is then used to evaluate the sound pickup performance of the corresponding microphone array. The microphone array with the best sound pickup performance is then selected as the adapted microphone array.

[0177] Fourthly, electronic devices can use machine learning models to determine the appropriate microphone array.

[0178] As an implementation, the machine learning model can be trained based on historical usage data for all microphone arrays. This historical usage data may include the electronic device's system time, location, battery level, and corresponding posture information when the microphone array was used. This allows the trained machine learning model to evaluate the appropriate microphone array based on at least one of the following dimensions: time, space, battery level, and posture.

[0179] In this way, during operation, the electronic device can obtain one or more of the current system time, positioning location, power information and posture information, and combine it with a machine learning model to identify the microphone array that is suitable for the current situation.

[0180] In some special scenarios, as shown in Figure 13, when the stylus and electronic device work together, that is, when a collaborative communication channel is established between the stylus and the electronic device, or when the stylus is connected to the electronic device, the electronic device can activate the microphone array including the stylus microphone. For example, as shown in Figure 13, microphones a, b, and 0 are activated to collect sound from sound sources within range area 3.

[0181] As an implementation, the electronic device is configured with a correspondence table containing the third-party device microphones, such as correspondence table C. Correspondence table C contains corresponding microphone arrays in different postures and different collection directions. The microphone arrays in correspondence table C all include third-party device microphones.

[0182] In this way, when the electronic device detects that a microphone of a third-party device is connected, it uses the correspondence list c to search for the microphone array corresponding to the current video and enables the microphone array.

[0183] In summary, the electronic device provided in the embodiment of the present application can adjust the microphones connected to each ADC. Then, a microphone array is formed by the microphones currently connected to at least one ADC, and the microphone array is used to collect sound data. Of course, the microphone arrays that can be enabled in the electronic device at different time periods can be different. In this way, the electronic device can collect sound data in different ranges according to different scene requirements. In addition, the scenario in which the electronic device enables sound pickup services is more likely to trigger the switching of the enabled microphone array. For example, the scenario of using conference service applications mentioned in the aforementioned embodiment. For another example, the scenario in which the user uses an electronic device to shoot a video, etc. For another example, the user uses an electronic device to record scenes such as classrooms, dramas, or large-scale stage plays.

[0184] The following describes a microphone control method provided in an embodiment of the present application, which is applied to an electronic device. For example, the electronic device includes multiple microphones, a first ADC, and a second ADC. The implementation process of the above method is as follows:

[0185] S1, when the electronic device is in a first posture, enabling a first array to collect first sound data.

[0186] The first array belongs to the microphone array provided in the aforementioned embodiment, and the first array includes at least a first microphone and a second microphone. A corresponding relationship may exist between the first array and the first posture. For example, the electronic device includes a first list (correspondence table a in the aforementioned embodiment), in which the first list records that the first array matches the first posture, and also records that the second array matches the second posture.

[0187] In some embodiments, when the first array is activated, a connection between the first microphone and the first ADC and a connection between the second microphone and the second ADC need to be established. In this way, the sound data collected by the first microphone can be processed by the first ADC to perform analog-to-digital processing and then sent to a digital codec for encoding and compression. The sound data collected by the second microphone can be processed by the second ADC to perform analog-to-digital processing and then sent to a digital codec for encoding and compression. Furthermore, the sound data collected by the microphones in the first array can be referred to as first sound data.

[0188] In addition, the connection between the ADC and the microphone can be direct or indirect, for example, through a bias circuit, a data selection module, or other devices.

[0189] S2: When the electronic device is in a second posture, enable the second array to collect second sound data.

[0190] The second array is also a microphone array and includes at least a third microphone and a fourth microphone. The first array and the second array include at least one different microphone, so the sound pickup ranges of the first array and the second array are also different.

[0191] In some embodiments, the process of the electronic device starting the second array includes: establishing a connection between the third microphone and the first ADC, and establishing a connection between the fourth microphone and the second ADC. In addition, the sound data collected by the microphones in the second array can be referred to as second sound data.

[0192] In some examples, the first posture is different from the second posture. The electronic device can adjust the enabled microphone array according to its different postures in the air to meet the sound pickup requirements in different postures.

[0193] In some embodiments, when the electronic device switches from the first array to activating the second array, the method may further include disconnecting the first microphone from the first ADC; and disconnecting the second microphone from the second ADC.

[0194] In this way, by disconnecting and reconnecting the microphone and ADC, the same ADC can be reused by multiple microphones, ensuring normal sound pickup effects while removing the restriction on the number of connected microphones by the number of ADCs.

[0195] Additionally, in some embodiments, before enabling the first array to collect the first sound data, the method further includes: collecting first posture information, where the first posture information indicates that the electronic device is in a first posture. The first posture information may be information determined based on data detected by a gravity sensor, an accelerometer, a gyroscope, or the like in the electronic device, and may indicate the posture of the device in its environment.

[0196] Similarly, before enabling the second array to collect the second sound data, the method further includes: collecting second posture information, where the second posture information indicates that the electronic device is in a second posture. The second posture information is similar to the first posture information, and the difference between the two is the different collection time.

[0197] In some embodiments, the above method may further include:

[0198] S3: Receive the user's first operation.

[0199] In some embodiments, the first operation may be an operation of selecting a microphone array or an operation of indicating a direction.

[0200] In some scenarios, before the electronic device needs to start the sound collection function, such as before the electronic device starts shooting video data or before connecting a video call, it can detect whether the user has made a first operation.

[0201] S4 , in response to the first operation, switching and enabling the third array to collect third sound data.

[0202] In some embodiments, the third array is also a microphone array, and the third array includes a fifth microphone and a sixth microphone. In addition, there is an association between the third array and the first operation.

[0203] For example, the first operation is the user selecting the third array. Thus, there is an association between the first operation and the third array. In this example, the method further includes: displaying a first interface, wherein the first interface displays the location distribution of all microphones. At this time, the user can click on a microphone in the first interface, and the selected microphones form the third array. In other words, while displaying the first interface, the electronic device can detect the user's selection operation on a microphone in the first interface. When the user selects the fifth microphone and the sixth microphone, it is determined that the first operation has been received.

[0204] For another example, the first operation is an operation indicating a first direction. When the correspondence table b indicates that there is a correspondence between the first direction and the third array, the first operation is related to the third array.

[0205] In addition, in the case where the first operation is an operation indicating a first direction, the first operation may be an operation of a user sliding on a display screen of the electronic device, and the sliding direction of the operation may be the first direction.

[0206] In the case where the first operation is an operation of indicating a first direction, the first operation may also be an operation of the user selecting a position point on the display screen, and the first direction is the direction corresponding to the selected position point.

[0207] For example, the electronic device may display a second interface, which is an application interface of a conference service application and includes a location distribution map of conference participants. Upon detecting that a user has selected a first conference participant in the second interface and the direction between the first conference participant and the user is the first direction, it is determined that the first operation has been received.

[0208] In addition, the method of activating the third array can refer to the method of activating the first array or the second array mentioned in the above embodiments, which will not be repeated here. After the third array is activated, the sound data collected by the microphones in the third array can be collectively referred to as third sound data.

[0209] In some other embodiments, the above method further includes:

[0210] S5, detecting that a communication connection is established with the stylus.

[0211] S6, switching to enable the fourth array to collect fourth sound data.

[0212] The fourth array is also a microphone array, but it includes the stylus's microphone. Alternatively, it may include microphones configured on the electronic device itself, such as the seventh microphone. This allows multiple devices to coordinate sound pickup, improving sound pickup effectiveness.

[0213] In addition, the method of activating the fourth array can refer to the method of activating the first array or the second array mentioned in the above embodiments, which will not be repeated here. After the fourth array is activated, the sound data collected by the microphones in the fourth array can be collectively referred to as fourth sound data.

[0214] In other embodiments, a first model is configured in the electronic device, and the first model is a machine learning model for identifying a matching microphone array. The method also includes: obtaining current scene information, the scene information including one or more combinations of system time, positioning location, device power and posture information; inputting the current scene information into the first model to determine the fifth array; and enabling the fifth array to collect fifth sound data.

[0215] In addition, the method of activating the fifth array can refer to the method of activating the first array or the second array mentioned in the above embodiments, which will not be repeated here. After the fifth array is activated, the sound data collected by the microphones in the fifth array can be collectively referred to as the fifth sound data.

[0216] An embodiment of the present application further provides an electronic device, which may include a memory and one or more processors. The memory and processor are coupled. The memory is used to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device performs each step of the above embodiment. Of course, the electronic device includes but is not limited to the above memory and one or more processors.

[0217] The embodiment of the present application also provides a chip system, which can be applied to the terminal device in the aforementioned embodiment. As shown in Figure 14, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 can be the processor in the above-mentioned electronic device. The processor 2201 and the interface circuit 2202 can be interconnected via a line. The processor 2201 can receive and execute computer instructions from the memory of the above-mentioned electronic device through the interface circuit 2202. When the computer instructions are executed by the processor 2201, the electronic device can perform the various steps in the above-mentioned embodiment. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiment of the present application.

[0218] In some embodiments, through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment and will not be repeated here.

[0219] The functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0220] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.

[0221] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A microphone control method, characterized in that: Applied to an electronic device, the electronic device includes a plurality of microphones, a first analog-to-digital converter and a second analog-to-digital converter, the method including: When the electronic device is in the first posture, enabling a first array to collect first sound data; wherein the first array includes a first microphone and a second microphone among the plurality of microphones; enabling the first array includes: establishing a connection between the first microphone and a first analog-to-digital converter, and establishing a connection between the second microphone and a second analog-to-digital converter; When the electronic device is in a second posture, the second array is enabled to collect second sound data; wherein, the second array also includes a third microphone and a fourth microphone among the multiple microphones; starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first posture is different from the second posture.

2. The method according to claim 1, characterized in that Before starting the second array, the method further includes: disconnecting the first microphone from the first analog-to-digital converter; Disconnect the second microphone from the second analog-to-digital converter.

3. The method according to claim 1 or 2, characterized in that Before enabling the first array to collect the first sound data, the method further includes: collecting first posture information, where the first posture information indicates that the electronic device is in the first posture; Before enabling the second array to collect the second sound data, the method further includes: Second posture information is collected, and the second posture information indicates that the electronic device is in the second posture.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: Receiving a first operation from the user; In response to the first operation, a third array is switched on to collect third sound data, wherein the third array includes a fifth microphone and a sixth microphone among the plurality of microphones.

5. The method according to claim 4, characterized in that The first operation includes an operation of a user selecting the third array. Before receiving the first operation of the user, the method further includes: Displaying a first interface, wherein the first interface displays the position distribution of the plurality of microphones; Detecting a user's selection operation on a microphone in the first interface; When the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

6. The method according to claim 4, characterized in that The first operation is an operation of indicating a first direction, and in the electronic device, the third array corresponds to the first direction.

7. The method according to claim 6, characterized in that Before receiving the first operation of the user, the method includes: Displaying a second interface, where the second interface is an application interface of a conference service application and includes a location distribution map of conference participants; When it is detected that the user selects the first participant in the second interface, and the direction between the first participant and the user is the first direction, it is determined that the first operation is received.

8. The method according to claim 1, characterized in that The method further comprises: Detecting that a communication connection is established with the stylus; Switching and enabling a fourth array to collect fourth sound data, wherein the fourth array includes a seventh microphone among the plurality of microphones and a microphone configured on the stylus.

9. The method according to claim 1, characterized in that The electronic device is configured with a first model, where the first model is a machine learning model for identifying a matching microphone array. The method further includes: Obtaining current scene information, including one or more combinations of system time, location, device power, and posture information; Inputting the current scene information into the first model to determine a fifth array; The fifth array is enabled to collect fifth sound data.

10. The method according to claim 1, characterized in that The electronic device includes a first list, which records that the first array matches the first posture, and also records that the second array matches the second posture.

11. An electronic device, characterized in that: The electronic device includes one or more processors and a memory; the memory is coupled to the processor, and the memory is used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the one or more processors are used to execute the method according to any one of claims 1 to 10.

12. A computer storage medium, characterized in that The method comprises computer instructions, which, when executed on an electronic device, enable the electronic device to execute the method according to any one of claims 1 to 10.

13. A computer program product, characterized in that The computer program product comprises a computer program which, when run on a computer, causes the computer to perform the method according to any one of claims 1 to 10.

Images