Microphone control method and electronic device

Abstract

The present application provides a microphone control method and an electronic device, which relate to the field of smart terminal technology. The problem of limited sound pickup range of electronic devices is solved. The specific scheme is: when the electronic device is in the first posture, the first array is enabled to collect the first sound data; wherein the first array includes the first microphone and the second microphone among the multiple microphones; starting the first array includes: establishing a connection between the first microphone and the first analog-to-digital converter, and establishing a connection between the second microphone and the second analog-to-digital converter; when the electronic device is in the second posture, the second array is enabled to collect the second sound data; wherein the second array also includes the third microphone and the fourth microphone among the multiple microphones; starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first posture is different from the second posture.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent terminals, and in particular to a microphone control method and electronic equipment. Background Art

[0002] With the iterative update of device hardware, various electronic devices can provide users with more high-quality services. In theory, by increasing the number of microphones connected to electronic devices, the sound pickup range of electronic devices can be expanded.

[0003] However, the number of microphones that can be connected to an electronic device is limited by hardware conditions, so the sound pickup range of the electronic device is always limited. Summary of the invention

[0004] The embodiments of the present application provide a microphone control method and an electronic device, which are used to improve the sound pickup range of the electronic device.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a microphone control method, which is applied to an electronic device, wherein the electronic device includes a plurality of microphones, a first analog-to-digital converter and a second analog-to-digital converter, and the method includes:

[0007] When the electronic device is in the first posture, the first array is enabled to collect first sound data; wherein the first array includes a first microphone and a second microphone among the multiple microphones.

[0008] Exemplarily, starting the first array includes: establishing a connection between the first microphone and a first analog-to-digital converter, and establishing a connection between the second microphone and a second analog-to-digital converter.

[0009] When the electronic device is in a second posture, the second array is enabled to collect second sound data; wherein the second array also includes a third microphone and a fourth microphone among the multiple microphones.

[0010] Exemplarily, starting the second array includes: establishing a connection between a third microphone and a first analog-to-digital converter, and establishing a connection between a fourth microphone and a second analog-to-digital converter; the first posture is different from the second posture.

[0011] It is understandable that different microphones have different sound pickup directions. The electronic device can collect sounds in different ranges by activating arrays composed of different microphones. Obviously, the more arrays the electronic device can activate, the wider the sound pickup range.

[0012] In the above embodiments, the electronic device can enable different arrays to collect sound data in different positions to complete the sound pickup work of different ranges of content, so that the actual available sound pickup range of the electronic device is very large. In addition, when different arrays are enabled, different microphones only need to be connected to the analog-to-digital converter. In other words, the analog-to-digital converter no longer corresponds to the microphone one-to-one, so the number of analog-to-digital converters in the electronic device cannot limit the number of microphones connected to the electronic device. The electronic device can also combine more microphone arrays to increase the sound pickup range and meet different sound pickup needs.

[0013] In some embodiments, before starting the second array, the method further includes: disconnecting the first microphone from the first analog-to-digital converter; and disconnecting the second microphone from the second analog-to-digital converter.

[0014] In the above embodiment, the connection between the analog-to-digital converter and the microphone can be established or disconnected. By controlling the connection between the analog-to-digital converter and the microphone, the microphone array can be switched and the sound pickup range can be flexibly adjusted.

[0015] In some embodiments, before enabling the first array to collect first sound data, the method further includes: collecting first posture information, the first posture information indicating that the electronic device is in the first posture; before enabling the second array to collect second sound data, the method further includes: collecting second posture information, the second posture information indicating that the electronic device is in the second posture.

[0016] In some embodiments, the method further includes: receiving a first operation of a user; in response to the first operation, switching to enable a third array to collect third sound data, wherein the third array includes a fifth microphone and a sixth microphone among the multiple microphones.

[0017] In the above embodiment, the user can instruct to change the microphone array to be used, so as to meet the sound pickup requirements directly instructed by the user and improve the intelligence level of switching microphone arrays of the electronic device.

[0018] As an implementation method, the first operation includes an operation in which a user selects the third array. Before receiving the first operation of the user, the method also includes: displaying a first interface, in which the position distribution of the multiple microphones is displayed; detecting the user's selection operation on the microphone in the first interface; wherein, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0019] In this implementation, the user can directly select the microphone array to be enabled. For example, before instructing the electronic device to enable sound pickup, the user can first specify the microphone array involved in sound pickup to ensure that the sound pickup result is close to the user's needs.

[0020] In some embodiments, the first operation is an operation of indicating a first direction, and in the electronic device, there is a corresponding relationship between the third array and the first direction.

[0021] In some embodiments, before receiving the first operation of the user, the method includes: displaying a second interface, the second interface being an application interface of a conference service application, the second interface including a location distribution map of participants; when it is detected that the user selects the first participant in the second interface, and the direction between the first participant and the user is the first direction, determining that the first operation has been received.

[0022] In some embodiments, the method further includes: detecting establishment of a communication connection with the stylus; switching to enable a fourth array to collect fourth sound data, wherein the fourth array includes a seventh microphone among the plurality of microphones and a microphone configured on the stylus.

[0023] In some embodiments, the electronic device is configured with a first model, which is a machine learning model for identifying a matching microphone array, and the method further includes: obtaining current scene information, the scene information including one or more combinations of system time, positioning location, device power and posture information; inputting the current scene information into the first model to determine a fifth array; and enabling the fifth array to collect fifth sound data.

[0024] In some embodiments, the electronic device includes a first list, in which the first list records the matching between the first array and the first posture, and also records the matching between the second array and the second posture.

[0025] In a second aspect, an embodiment of the present application provides an electronic device, the electronic device comprising one or more processors and a memory; the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, when the one or more processors execute the computer instructions, the one or more processors are used to:

[0026] When the electronic device is in a first posture, the first array is enabled to collect first sound data; wherein the first array includes a first microphone and a second microphone among the multiple microphones; starting the first array includes: establishing a connection between the first microphone and a first analog-to-digital converter, and establishing a connection between the second microphone and a second analog-to-digital converter; when the electronic device is in a second posture, the second array is enabled to collect second sound data; wherein the second array also includes a third microphone and a fourth microphone among the multiple microphones; starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first posture is different from the second posture.

[0027] In some embodiments, the one or more processors are further configured to: disconnect the first microphone from the first analog-to-digital converter; and disconnect the second microphone from the second analog-to-digital converter.

[0028] In some embodiments, the one or more processors are further used to: collect first posture information, the first posture information indicating that the electronic device is in the first posture; collect second posture information, the second posture information indicating that the electronic device is in the second posture.

[0029] In some embodiments, the one or more processors are further used to: receive a first operation from a user; and in response to the first operation, switch to enable a third array to collect third sound data, wherein the third array includes a fifth microphone and a sixth microphone among the multiple microphones.

[0030] In some embodiments, the one or more processors are further used to: display a first interface in which the location distribution of the multiple microphones is displayed; detect a user's selection operation on a microphone in the first interface; wherein, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0031] In some embodiments, the first operation is an operation of indicating a first direction, and in the electronic device, there is a corresponding relationship between the third array and the first direction.

[0032] In some embodiments, the one or more processors are also used to: display a second interface, where the second interface is an application interface of a conference service application, and the second interface includes a location distribution map of participants; when it is detected that a user selects a first participant in the second interface, and the direction between the first participant and the user is the first direction, determine that the first operation has been received.

[0033] In some embodiments, the one or more processors are further used to: detect establishment of a communication connection with the stylus; and switch to enable a fourth array to collect fourth sound data, wherein the fourth array includes a seventh microphone among the multiple microphones and a microphone configured on the stylus.

[0034] In some embodiments, the one or more processors are further used to: obtain current scene information, the scene information including one or more combinations of system time, positioning location, device power and posture information; input the current scene information into the first model to determine the fifth array; and enable the fifth array to collect fifth sound data.

[0035] In some embodiments, the electronic device includes a first list, in which the first list records the matching between the first array and the first posture, and also records the matching between the second array and the second posture.

[0036] In a third aspect, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method in the above-mentioned first aspect and possible embodiments thereof.

[0037] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on the above-mentioned electronic device, the electronic device executes the method in the above-mentioned first aspect and possible embodiments thereof.

[0038] It can be understood that the electronic devices, computer storage media and computer program products provided in the above-mentioned aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is one of the example diagrams of the distribution of microphones in an electronic device (tablet computer) provided in an embodiment of the present application;

[0040] Figure 2 The second diagram of the distribution example of microphones in the electronic device (tablet computer) provided in the embodiment of the present application;

[0041] Figure 3 This is one of the hardware structure examples of the electronic device provided in the embodiment of the present application;

[0042] Figure 4 FIG2 is a second example of the hardware structure of the electronic device provided in the embodiment of the present application;

[0043] Figure 5FIG3 is a third example of the hardware structure of the electronic device provided in the embodiment of the present application;

[0044] Figure 6 One of the example diagrams of switching microphone arrays provided in an embodiment of the present application;

[0045] Figure 7 The second example diagram of switching microphone array provided in the embodiment of the present application;

[0046] Figure 8 The third example diagram of switching microphone arrays provided in an embodiment of the present application;

[0047] Fig. 9 One of the example diagrams of the sound pickup range corresponding to the microphone array provided in the embodiment of the present application;

[0048] Fig.10 A second example diagram of the sound pickup range corresponding to the microphone array provided in an embodiment of the present application;

[0049] Fig.11 One of the example diagrams of selecting a collection direction provided in an embodiment of the present application;

[0050] Fig.12 The second example diagram of selecting a collection direction provided in an embodiment of the present application;

[0051] Fig.13 An example diagram of the sound pickup range of a collaborative system consisting of an electronic device and a stylus provided in an embodiment of the present application;

[0052] Fig.14 An example diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0054] With the development of technology, the hardware resources (such as storage resources, computing resources, input and output resources, etc.) configured in various electronic devices are constantly iterating and upgrading, aiming to provide users with higher quality services.

[0055] Taking the audio acquisition module (such as a microphone) of an electronic device as an example, as the audio acquisition module is continuously iterated and upgraded, the quality of the audio acquisition services provided by the electronic device also improves accordingly.

[0056] In some embodiments, the electronic device can upgrade the audio acquisition module by increasing the number of microphones. For example, the microphone configured on the electronic device body is upgraded from a single microphone to four microphones, or to eight microphones. In this way, more microphones can increase more sound pickup angles, which can effectively expand the sound pickup range of the electronic device.

[0057] In some embodiments, microphones in electronic devices may have different pickup directions when their deployment positions are different. For example, microphones located at different side edges of an electronic device may have different pickup directions. Of course, there are also cases where some microphones have different deployment positions but the same pickup directions. For example, microphones located at the same side edge of an electronic device may have the same pickup directions despite different deployment positions.

[0058] In some embodiments, the electronic device may be a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (PDA), a wearable device (such as a smart watch), a smart screen, a game console, and an augmented reality (AR) or virtual reality (VR) device. In the following embodiments, the electronic device is mainly taken as a tablet computer for example.

[0059] Taking the electronic device as a tablet computer as an example, the body of the tablet computer includes four side edges. The microphones of the tablet computer can be deployed on the above four side edges. Exemplarily, one or more microphones can be configured on each side edge. Figure 1 As shown, the upper edge may be configured with microphone a and microphone b, the lower edge may also be configured with microphone e and microphone f, the left edge of the tablet computer may also be configured with microphone c, and the right edge of the tablet computer may also be configured with microphone d.

[0060] In another exemplary embodiment, some side edges are configured with at least one microphone, while some side edges are not configured with microphones. For example, the upper side edge, the left side edge, and the right side edge are all configured with at least one microphone, while the lower side edge is not configured with a microphone.

[0061] In addition, if Figure 1 As shown, the body of the tablet computer also includes a back cover, which is arranged opposite to the display screen. Generally, the back cover can be used to configure the rear camera of the tablet computer. In some examples, a microphone can also be configured on the back cover of the tablet computer. For example, at least one microphone can be configured on one side of the rear camera of the tablet computer.

[0062] In some embodiments, the tablet computer can collect sounds from sound sources in different directions through a microphone installed on the tablet computer.

[0063] Exemplarily, when the tablet computer is in landscape mode, the microphone configured at the upper edge is used to pick up the sound emitted by the sound source located above the tablet computer. The microphone configured at the lower edge is used to pick up the sound emitted by the sound source located below the tablet computer. The microphone configured at the back cover is used to pick up the sound emitted by the sound source located in front of the tablet computer. The microphone configured at the left edge is used to pick up the sound emitted by the sound source located to the left of the tablet computer. The microphone configured at the right edge is used to pick up the sound emitted by the sound source located to the right of the tablet computer.

[0064] Of course, the sound pickup directions of each microphone may also change. For example, when the posture of the tablet computer in space changes, the sound pickup directions of each microphone may also change accordingly.

[0065] For example, the tablet computer is rotated to the right side to the vertical screen state. Figure 2 As shown, microphones a and b are configured on the original upper edge, and are used to pick up the sound emitted by the sound source located on the right side of the tablet computer. Microphones e and f are configured on the original lower edge, and are used to pick up the sound emitted by the sound source located on the left side of the tablet computer. Microphone g is configured on the back cover, and is used to pick up the sound emitted by the sound source located in front of the tablet computer. Microphone c is configured on the original left edge, and is used to pick up the sound emitted by the sound source located above the tablet computer. Microphone d is configured on the right edge, and is used to pick up the sound emitted by the sound source located below the tablet computer.

[0066] As another example, when the tablet computer is rotated to the left side to the portrait mode, the microphones a and b configured at the original upper edge are used to pick up the sound emitted by the sound source located on the left side of the tablet computer, and the microphones e and f configured at the original lower edge are used to pick up the sound emitted by the sound source located on the right side of the tablet computer. The microphone g configured at the back cover is used to pick up the sound emitted by the sound source located in front of the tablet computer. The microphone c configured at the original left edge is used to pick up the sound emitted by the sound source located below the tablet computer, and the microphone d configured at the right edge is used to pick up the sound emitted by the sound source located above the tablet computer.

[0067] It should be noted that the above-mentioned up, down, left, and right may be directions determined with the tablet computer housing as a reference. For example, when the tablet computer is rectangular, the two relatively short edges of the tablet computer housing are the left edge and the right edge, and the two relatively long edges are the upper edge and the lower edge.

[0068] In addition, in addition to collecting sound data through the microphone configured on the body, the electronic device can also collect sound data through a third-party device (such as headphones, stylus). Exemplarily, after the third-party device establishes a communication connection with the electronic device, the microphone of the third-party device can collect sound. Then, the third-party device can send the collected sound data to the electronic device. Obviously, the microphone of the third-party device can additionally increase the sound pickup direction of the electronic device. Of course, the sound pickup directions provided by some third-party devices are relatively more variable. For example, the stylus provides different sound pickup directions at different angles. The sound pickup directions provided by some third-party devices are relatively fixed. For example, when the headphones are worn by the user, the sound pickup directions provided are relatively fixed.

[0069] Ideally, the more microphones that can be connected to an electronic device, the wider the corresponding sound pickup range, so that the user can be provided with a higher quality sound pickup service (such as a recording service). However, in reality, the number of microphones that can be connected to an electronic device (including microphones of third-party devices) is limited.

[0070] It is understandable that the sound data (such as sound wave signals) collected by the microphone needs to be converted to digital through an analog to digital converter (ADC). The sound data after analog to digital conversion is data that the electronic device can recognize and continue to process. After completing the analog to digital conversion of the sound data, the analog to digital converter can pass the sound data to the digital codec (Codec Digital). In this way, the sound data collected by the microphone can be encoded and compressed, and the encoded and compressed sound data can participate in subsequent services, such as storage, transmission, etc.

[0071] However, due to the limitation of device chips, the number of analog-to-digital converters in electronic devices is limited. In addition, microphones must correspond one-to-one with analog-to-digital converters, so the number of microphones that can be connected to electronic devices is also limited. For example, when there are only three analog-to-digital converters in an electronic device, the number of microphones that can be connected to the electronic device cannot exceed three. If an analog-to-digital converter is required for the microphone of a third-party device, the number of microphones that can be configured on the body of the electronic device cannot exceed two, otherwise there will be microphones that cannot be used normally.

[0072] The embodiment of the present application provides a microphone control method, which is applied to electronic devices. Without adding an analog-to-digital converter to the electronic device, by dynamically switching the microphone connected to the analog-to-digital converter, different microphone arrays (including multiple microphones) or different single microphones are used to pick up sound in different ranges by utilizing the different pickup directions of different microphones. In this way, the analog-to-digital converter no longer limits the number of microphones that can be connected to the electronic device.

[0073] Please refer to Figure 3 , is a structural diagram of an electronic device 100 provided in an embodiment of the present application.

[0074] like Figure 3 As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0075] Among them, the above-mentioned sensor module 180 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.

[0076] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0077] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0078] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0079] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0080] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0081] It is understandable that the interface connection relationship between the modules shown in this embodiment is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0082] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0083] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0084] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0085] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc.

[0086] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0087] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0088] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include N cameras 193, where N is a positive integer greater than 1.

[0089] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0090] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0091] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0092] The microphone 170C can be used to collect sounds in the environment. In the embodiment of the present application, the microphone 170C may include multiple microphones, and the arrangement positions of the multiple microphones 170C on the electronic device, or the installation positions, may be different. For example, Figure 1 This is an example diagram of the arrangement of microphone 170C on an electronic device. Of course, more or fewer microphones may be installed in the electronic device. Similarly, the microphones may be arranged in other ways in the electronic device.

[0093] In some embodiments, an electronic device may include a digital codec, ADC, and multiple microphones.

[0094] In some embodiments, the digital codec is connected to an ADC. The ADC can establish a connection with a microphone and can also be disconnected from the microphone. In the same time period, a single ADC can only establish a connection with a single microphone. In different time periods, the ADC can establish connections with different microphones.

[0095] After the connection between the ADC and the microphone is established, the sound data collected by the microphone can be processed by the ADC for analog-to-digital conversion. The sound data after the ADC is processed by the ADC can also be sent to the digital codec for encoding, compression, and other processing.

[0096] In other embodiments, the ADC and the microphone may be connected via a bias circuit. That is, the electronic device may further include a plurality of bias circuits, the bias circuits being connected to the microphone, and the bias circuits being connected to the ADC. When the bias circuit is connected to the ADC, the sound data collected by the microphone needs to be processed by the bias voltage before being passed to the ADC, which performs analog-to-digital conversion. The working principle of the bias circuit may refer to the relevant technology and will not be described in detail here.

[0097] In addition, while the bias circuit can establish a connection with the ADC, the connection between the bias circuit and the ADC can also be disconnected. In this way, by controlling the connection and disconnection between the bias circuit and the ADC, the ADC can be connected to different microphones at different time periods.

[0098] In some examples, a fixed connection relationship is established between a microphone and a bias circuit. Figure 4 Bias circuit 0, bias circuit 2, bias circuit 3, bias circuit 4, bias circuit 5 are shown. A connection is established between bias circuit 0 and microphone 0, and bias circuit 0 can receive sound data collected by microphone 0. A connection is established between bias circuit 2 and microphone 2, and bias circuit 2 can receive sound data collected by microphone 2, and so on. In addition, the microphone 0 can be a microphone from a stylus (third-party device). The microphone 2, microphone 3, microphone 4 and microphone 5 can be microphones installed on the body of the electronic device.

[0099] In other examples, multiple microphones may also reuse the same bias circuit. When multiple microphones reuse the same bias circuit, only one microphone may be connected to the bias circuit at the same time period. Figure 4 The bias circuit 1 shown can be connected to a microphone 1 (one of the microphones configured on the electronic device) or a microphone of a headset (a third-party device). That is, the microphone 1 and the microphone of the headset need to reuse the bias circuit 1. In some examples, when the electronic device is connected to the headset, it is the headset microphone that is connected to the bias circuit 1. When the electronic device is not connected to the headset, it is the microphone 1 that is connected to the bias circuit 1.

[0100] In some examples, the electronic device further includes an earphone detection module, which can be used to detect whether an earphone is plugged into the electronic device. For example, the earphone detection module can include an ACCDET module, and the principle of detecting whether an earphone is plugged in can be referred to in the relevant art and will not be described in detail here.

[0101] In addition, when it is detected that the earphone is connected to the electronic device, the bias circuit 1 is connected to the earphone microphone, and at this time, the bias circuit 1 only receives the sound data collected by the earphone microphone. When it is not detected that the earphone is connected to the electronic device, the bias circuit 1 is connected to the microphone 1, and at this time, the bias circuit 1 can receive the sound data collected by the microphone 1.

[0102] In other embodiments, the connection between the ADC and the microphone (or bias circuit) may be established or disconnected through a data selection module.

[0103] In some examples, the data selection module may be a PGA-MUX device. Thus, one data selection module may be connected to one ADC.

[0104] In this example, if the number of ADCs in the electronic device is the same as the number of data selection modules, then the ADCs correspond to the data selection modules one by one. Figure 4 As shown, the electronic device includes ADC1, ADC2, ADC3, data selection module 1, data selection module 2 and data selection module 3. Among them, ADC1 uniquely corresponds to data selection module 1, ADC2 uniquely corresponds to data selection module 2, and ADC3 uniquely corresponds to data selection module 3.

[0105] In this example, if the number of ADCs in the electronic device is not the same as the number of data selection modules, that is, the number of data selection modules may be less than the number of ADCs, each data selection module is connected to an ADC, but there are ADCs that are not connected to a data selection module. Figure 5 As shown, the electronic device includes ADC4, ADC5, ADC6, a data selection module 1 and a data selection module 2, ADC4 is connected to the data selection module 1, and ADC5 is connected to the data selection module 2. ADC6 is not connected to the data selection module.

[0106] In some embodiments, in addition to being connected to the ADC, the data selection module can also establish a connection with at least one microphone, for example, by establishing a connection with the microphone through a bias circuit. It can be understood that the data selection module is a switch-like device that can not only establish a connection with the microphone, but also disconnect the connection with the microphone.

[0107] In the case where the data selection module can establish connections with multiple microphones, only one microphone can be connected to the data selection module at the same time period. The data selection module can choose to establish connections with different microphones at different time periods.

[0108] In this way, after the data selection module establishes a connection with the selected microphone, for example, after being connected with the bias circuit corresponding to the selected microphone, the sound data collected by the microphone can be transmitted to the corresponding ADC through the data selection module after being processed by the bias circuit.

[0109] for example, Figure 4 As shown, the data selection module 1 can select from microphone 0 and microphone 1 to establish a connection with microphone 0. The data selection module 1 can receive the sound data 1 (sound data collected by microphone 0) processed by the bias circuit 0, and pass the sound data 1 to ADC1. It can be seen that after the data selection module 1 establishes a connection with microphone 0, it is equivalent to establishing a data transmission channel between microphone 0 and ADC1. At this time, the sound data collected by microphone 0 can be normally passed to ADC1, and ADC1 performs analog-to-digital conversion. Then, ADC1 can pass the analog-to-digital converted sound data to the digital encoder-decoder, which performs encoding, compression and other processing. That is, the electronic device can normally enable microphone 0, but cannot enable microphone 1.

[0110] Of course, between microphone 0 and microphone 1, the data selection module 1 can also choose to disconnect from microphone 0 and establish a connection with microphone 1. In this way, the data selection module 1 can receive the sound data 2 (sound data collected by microphone 1) processed by the bias circuit 1, and pass the sound data 2 to ADC1. It can be seen that after the data selection module 1 establishes a connection with microphone 1, it is equivalent to establishing a data transmission channel between microphone 1 and ADC1, and disconnecting the data transmission channel between microphone 0 and ADC1. At this time, the sound data collected by microphone 1 can be normally passed to ADC1, and ADC1 performs analog-to-digital conversion. Then, ADC1 can pass the analog-to-digital converted sound data to the digital encoder-decoder, which performs encoding, compression and other processing. That is, the electronic device can normally enable microphone 1, but cannot enable microphone 0.

[0111] Likewise, Figure 4 The data selection module 2 can also select to enable microphone 2 or microphone 3 by establishing a connection between ADC2 and microphone 2, or establishing a connection between ADC2 and microphone 3. Figure 4 The data selection module 3 can also select to enable microphone 4 or microphone 5 by establishing a connection between ADC3 and microphone 4, or establishing a connection between ADC3 and microphone 5.

[0112] It can be seen that, in the case of only three ADCs, the electronic device provided in the embodiment of the present application can be connected to six microphones (including third-party device microphones). Of course, more microphones can be connected. For example, when a single data selection module can select one from three microphones to establish a connection, a total of nine microphones can be connected to the electronic device. In addition, the microphones connected to the electronic device can be used normally.

[0113] It is understandable that in the same time period, the same ADC can only establish a connection with one microphone. When the connection between the ADC and the microphone is established, the ADC can receive the sound data collected by the microphone. In addition, in different time periods, the electronic device can change the microphone connected to the ADC through the data selection module.

[0114] That is, in the embodiment of the present application, by using the above data selection module, the electronic device can dynamically switch the microphone connected to the ADC. For the convenience of description, "switching the microphone connected to the ADC" will be referred to as switching for the ADC.

[0115] In some embodiments, the electronic device can enable at least one microphone for sound collection, wherein the connection between the enabled microphone and the ADC has been established. Microphones connected to different ADCs can work normally at the same time without affecting each other. When multiple microphones are enabled at the same time, it can be regarded as the electronic device enabling the microphone array.

[0116] In addition, the electronic device can enable different microphone arrays by switching at least one ADC.

[0117] For example, Figure 6 As shown, a connection is established between ADC1 in the electronic device and microphone 0. A connection is established between ADC2 in the electronic device and microphone 2. A connection is established between ADC3 in the electronic device and microphone 4. At this time, the electronic device can enable the microphone array composed of microphone 0, microphone 2 and microphone 4 to collect sound.

[0118] After dynamic switching of all ADCs, ADC1 in the electronic device can be switched to connect to microphone 1, ADC2 can be switched to connect to microphone 3, and ADC3 can be switched to connect to microphone 5. At this time, the electronic device enables the microphone array composed of microphone 1, microphone 3 and microphone 5 to collect sound.

[0119] In addition, when the electronic device performs dynamic switching only for ADC1, it can switch to enable the microphone array composed of microphone 1, microphone 2 and microphone 4. When the electronic device performs dynamic switching only for ADC2, it can switch to enable the microphone array composed of microphone 0, microphone 3 and microphone 4. When the electronic device performs dynamic switching only for ADC3, it can switch to enable the microphone array composed of microphone 0, microphone 2 and microphone 5. When the electronic device performs dynamic switching for ADC1 and ADC2, it can switch to enable the microphone array composed of microphone 1, microphone 3 and microphone 4, etc.

[0120] Of course, electronic devices may also contain ADCs that cannot be dynamically switched, for example, Figure 5 ADC6 in. Figure 5 As shown, ADC6 has no corresponding data selection module, and the ADC6 can only be fixedly connected to the bias circuit 4, that is, the ADC6 can only communicate with the bias circuit 4, and can only receive and process the sound data sent by the bias circuit 4 (the sound data collected by the microphone 4). Figure 5 Unlike ADC4 and ADC5 in the example, ADC6 cannot switch the microphone connected to it.

[0121] In other examples, the data selection module may be an analog circuit with a selection function. For example, the analog circuit may select N microphones from M microphones, where M is a positive integer greater than N, M may be the number of microphones connected to the electronic device, and N may be the number of ADCs in the electronic device.

[0122] In this example, the data selection module may connect all ADCs. In addition, the data selection module may select a specified number of microphones from the microphones connected to the electronic device and establish connections.

[0123] like Figure 7 As shown, the electronic device includes ADC1, ADC2, ADC3 and a data selection module 4. The data selection module 4 can establish connections with the ADC1, ADC2 and ADC3, so that the data selection module 4 can send different data to ADC1, ADC2 and ADC3 in parallel. In addition, the data selection module 4 has the ability to establish a connection with each microphone, and of course, it also has the ability to disconnect the connection with the microphone.

[0124] On this basis, the data selection module 4 can select three microphones from the microphones connected to the electronic device and establish connections. In this way, the data selection module 4 can send the three channels of sound data collected by the above three microphones to ADC1, ADC2 and ADC3 respectively. For example, if microphone 2, microphone 4 and microphone 5 are selected, the data selection module 4 can pass the sound data collected by microphone 2 to ADC1, pass the sound data collected by microphone 4 to ADC2, and pass the sound data collected by microphone 5 to ADC3.

[0125] This is equivalent to the data selection module 4 establishing a connection between microphone 2 and ADC1, a connection between microphone 4 and ADC2, and a connection between microphone 5 and ADC3. In this way, the electronic device can normally enable microphone 2, microphone 4, and microphone 5 to perform the sound collection task, and does not enable microphone 0, microphone 1, and microphone 3. At this time, the electronic device enables the microphone array composed of microphone 2, microphone 4, and microphone 5.

[0126] In some embodiments, the electronic device may also select to establish connections with different microphones by indicating the data selection module 4, so that different microphone arrays may be combined.

[0127] For example, the data selection module 4 reselects microphone 0, microphone 2 and microphone 4 to establish a connection. Figure 8 As shown, it is equivalent to that the data selection module 4 establishes a connection between microphone 0 and ADC1, a connection between microphone 2 and ADC2, and a connection between microphone 4 and ADC3. In this way, the electronic device can normally enable microphone 0, microphone 2 and microphone 4, and not enable microphone 1, microphone 3 and microphone 5. At this time, the electronic device switches to enable the microphone array composed of microphone 0, microphone 2 and microphone 4.

[0128] In addition, the connection between the data selection module and the microphone mentioned in the above embodiment can be established through a bias circuit in addition to a direct connection between the data selection module and the microphone. For example, after the data selection module establishes a connection with bias circuit 0, since there is also a connection between bias circuit 0 and microphone 0, it can be regarded that the data selection module establishes a connection with microphone 0 through bias circuit 0.

[0129] In summary, the electronic device provided in the embodiment of the present application can dynamically switch the enabled microphone arrays. It can be understood that different microphone arrays can collect sounds in different ranges of the environment in which the electronic device is located.

[0130] For example, Fig. 9As shown, when the microphone array consisting of microphone c, microphone a and microphone b is enabled, the electronic device can pick up the sound in range area 1. Fig.10 As shown, when the microphone array consisting of microphone a, microphone b and microphone d is enabled, the electronic device can pick up sounds in range area 2.

[0131] In some embodiments, the electronic device can intelligently enable different microphone arrays to meet different sound pickup requirements of users. When the electronic device decides which microphone array to use, it can use any of the following methods:

[0132] In the first method, the electronic device can determine an appropriate microphone array based on the detected posture information.

[0133] Among them, the above-mentioned posture information can indicate the posture of the electronic device in space. For example, the above-mentioned posture may include being parallel to the horizontal plane in the horizontal screen state (such as referred to as posture 1), being at an angle less than angle 1 (such as 90 degrees) with the horizontal plane in the horizontal screen state (such as referred to as posture 2), being at an angle not less than angle 1 with the horizontal plane in the horizontal screen state (such as referred to as posture 3), etc. For another example, the above-mentioned posture also includes being parallel to the horizontal plane in the vertical screen state (such as referred to as posture 4), being at an angle less than angle 1 (such as 90 degrees) with the horizontal plane in the vertical screen state (such as referred to as posture 5), being at an angle not less than angle 1 with the horizontal plane in the vertical screen state (such as referred to as posture 6), etc.

[0134] In some embodiments, the electronic device may periodically determine the posture information corresponding to the electronic device. For example, every minute, the electronic device may determine the posture information of the electronic device based on the data collected by the gyroscope, gravity sensor, and acceleration sensor. For the specific implementation process, please refer to the relevant technology and will not be described in detail here.

[0135] In other embodiments, the electronic device may respond to a specific event and determine the corresponding posture information of the electronic device.

[0136] Exemplarily, the specific event may be the activation of a specified application, such as a recording application, conference application, voice call application, etc. that requires the microphone to be activated. Another exemplary embodiment may be the receipt of a specific instruction, such as an instruction to activate the sound collection function. Another exemplary embodiment may be the detection that the enabled microphone array does not meet the conditions for continued use. For example, when it is detected that some microphones in the enabled microphone array are blocked, the electronic device may determine that the microphone array does not meet the conditions for continued use.

[0137] In this way, the electronic device can determine the current posture of the electronic device through the collected posture information, and then select the microphone array that actually needs to be activated according to the current posture.

[0138] As an implementation method, a correspondence table a between different postures and different microphone arrays may be pre-configured in the electronic device. Figure 1 In the case where the tablet computer shown in the figure has only three ADCs, the corresponding relationship table a between the posture and the microphone array can be shown in the following Table 1:

[0139] Table 1

[0140]

[0141] It can be understood that the above Table 1 is only an example of the corresponding relationship and is not intended to limit the embodiments of the present application. Of course, it can be seen from the above Table 1 that a single posture can correspond to one or more groups of microphone arrays, and the number of microphones in each group of microphone arrays does not exceed the total number of ADCs. The ADCs corresponding to the microphones in the same group are different, so that the microphones in the same group can work normally, that is, they can pass the collected sound data to the digital encoder / decoder in parallel, and the digital encoder / decoder performs encoding, compression and other processing.

[0142] It should also be noted that in addition to enabling the microphone array to collect sound data, the electronic device can also enable a single microphone to collect sound data. Similarly, the electronic device can pre-configure a single microphone that is most suitable for sound collection in different postures, so that the electronic device can also switch to enable different single microphones for sound collection according to different posture information. In subsequent embodiments, the judgment logic and methods related to the microphone array are also applicable to a single microphone, and this will not be repeated in subsequent embodiments.

[0143] In addition, the number and type of postures can be set according to empirical values. The correspondence between different postures and microphone arrays can be obtained by testing. For example, in each posture, the sound pickup effect corresponding to all enabled microphone arrays is tested. The sound pickup effect can be distinguished by a sound effect score, which can be the score of the collected sound data by the artificial intelligence model from the perspectives of sound quality and volume. Then, the microphone array whose sound pickup effect is ranked before the specified ranking is selected as the microphone array corresponding to the posture, and the above-mentioned correspondence table a is formed.

[0144] When the electronic device is configured with the above correspondence table a, the electronic device can query the microphone array that matches the current posture through the above comparison table a and enable the microphone array. For example, according to the collected posture information, it is determined that the current posture of the electronic device is posture 3, then the matching microphone array can be queried through Table 1, including microphone b, microphone d and microphone g. In this scenario, the electronic device can use the queried microphone array as the microphone array that actually needs to be enabled.

[0145] In addition, the microphone array can be enabled by establishing a connection between each microphone in the microphone array and the corresponding ADC, and then the sound data collected by each microphone in the microphone array is processed by the corresponding bias circuit and then transmitted to the corresponding ADC through the data selection module, and after the corresponding ADC completes the analog-to-digital conversion of the sound data, the sound data is sent to the digital encoder-decoder, and the digital encoder-decoder encodes and compresses the sound data. In this way, the microphone array can operate normally.

[0146] Of course, if there is no data selection module between the microphone in the microphone array and the ADC, the sound data collected by the microphone is directly sent to the corresponding ADC after being processed by the bias circuit, and the corresponding ADC performs analog-to-digital conversion on the sound data, and finally, the digital encoder and decoder encodes and compresses the sound data. For example, Figure 5 ADC6 and microphone 4, when the microphone array includes microphone 4, the sound data collected by microphone 4 is directly sent to ADC6 after being processed by bias circuit 4, and ADC6 performs analog-to-digital conversion processing.

[0147] In addition, in some special cases, such as when multiple matching microphone arrays are queried, one of the multiple matching microphone arrays can be selected as the microphone array that is actually enabled.

[0148] Exemplarily, the selection may be performed in a random manner, that is, the electronic device may use a preconfigured random algorithm to select a microphone array from a plurality of matching microphone arrays as the currently actually enabled microphone array.

[0149] Also illustratively, a microphone array that meets preset conditions may be selected.

[0150] For example, the above-mentioned preset conditions may include being marked with common tags by the user. In some examples, the electronic device may pre-display a distribution example diagram of each microphone on the electronic device. During the display of the distribution example diagram, the user can select a common microphone, and the electronic device can determine the common microphone based on the user's selection. In this way, among multiple microphone arrays corresponding to the same posture, the array containing the most common microphones can be marked with a common tag. In other examples, the electronic device may pre-display a distribution example diagram of each microphone on the electronic device. During the display of the distribution example diagram, the electronic device may also display microphone arrays matching different postures in sequence. At this time, the user can select a commonly used microphone array by clicking on the display screen of the electronic device. Correspondingly, the electronic device may also mark a common tag for the microphone array selected by the user.

[0151] In this way, the electronic device can select a microphone array with a common tag from a plurality of matching microphone arrays by identifying the common tag as the microphone array that is actually enabled currently.

[0152] For another example, the above-mentioned preset conditions may also include the best sound pickup effect in the current environment. The sound pickup effect may be distinguished by a sound effect score, which may be a score of the collected sound data by the artificial intelligence model from the perspectives of sound quality and volume.

[0153] In this way, the electronic device can enable each matching microphone array in turn to collect sound for a short period of time, and then use the artificial intelligence model to score the sound data collected by each microphone array to determine the microphone array with the best sound pickup effect as the microphone array that is actually enabled at present.

[0154] For another example, the above-mentioned preset conditions may also include that no microphone is blocked. In some examples, the vibration amplitude of the sound wave signal collected by the microphone may be compared with a preset value (empirical value). If the vibration amplitude corresponding to the microphone is less than the preset value, and the vibration amplitudes corresponding to other microphones are not less than the preset values, then it is determined that the microphone is blocked.

[0155] In this way, the electronic device can first determine the blocked microphone, and then select a microphone array that does not contain the blocked microphone from the matching microphone arrays as the microphone array that is actually enabled currently.

[0156] In addition, there is a situation where, when the microphone array (such as microphone array 1) that is actually enabled is determined, the microphone array 1 does not contain an obstructed microphone. During the activation of microphone array 1, if a microphone in microphone array 1 is obstructed, it may trigger a re-query of the microphone array that matches the current posture, and re-determine the actually enabled microphone array.

[0157] In the second method, the electronic device can determine the appropriate microphone array according to the collection direction selected by the user.

[0158] In some embodiments, the electronic device may determine the collection direction selected by the user according to the user's operation on the display screen, wherein the collection direction may include left front, right front, left, right, and front, etc.

[0159] Exemplarily, the user may click on the display screen, and the electronic device may determine the collection direction according to the direction between the clicked position and a pre-selected point.

[0160] For example, when the center point of the display is configured as a fixed pre-selected point, such as Fig.11 As shown, the user clicks on the position 1101 on the display screen, and the electronic device can identify the position 1101 as the click position. At this time, the direction between the center point 1102 of the display screen and the position 1101 is the left front, so the electronic device can determine that the collection direction is the left front.

[0161] For another example, when a user attends an offline meeting, he or she may enable a conference service application in the electronic device to record the minutes of the voice conference. Fig.12 As shown, the electronic device can display a conference service interface. The conference service interface includes the positions of multiple participants, such as position 1201 indicating the position of participant A in the current conference scene, position 1202 indicating the position of participant B in the current conference scene, position 1203 indicating the position of participant C in the current conference scene, position 1204 indicating the position of participant D in the current conference scene, position 1205 indicating the position of the user in the current conference scene, and position 1206 indicating the position of participant E in the current conference scene. The position of the user in the current conference scene, that is, position 1205, can be used as a pre-selected point.

[0162] In addition, the position distribution of the participants in the above conference service interface can be determined according to the seat template selected by the user, the number of participants input, etc. Alternatively, the position distribution of the participants in the above conference service interface can also be generated according to the on-site photo of the current conference scene, which is not limited in the embodiment of the present application.

[0163] Continuing with the above example, when it is detected that the user clicks on any participant's position, the direction between the selected participant's position and the user's position can be used as the selected collection direction. For example, it is detected that the user selects the position of participant A, that is, position 1201, and it is determined that the direction between position 1201 and the user's position (that is, position 1205) is the left front, so the left front can be determined as the collection direction.

[0164] After determining the collection direction, the electronic device can determine the appropriate microphone array by looking up a table.

[0165] As an implementation method, a correspondence table b between different collection directions and different microphone arrays may be pre-configured in the electronic device. Figure 1 In the case where the tablet computer shown in the figure has only three ADCs, the corresponding relationship table b between the posture and the microphone array can be shown in the following Table 2:

[0166] Table 2

[0167]

[0168] It can be understood that the above Table 2 is only an example of the corresponding relationship and cannot be regarded as a specific limitation of the corresponding relationship Table b in the embodiment of the present application.

[0169] Of course, in actual application, the above correspondence table b may include more or updated collection directions, and the microphone arrays corresponding to different collection directions are determined through pre-tests.

[0170] Take the test of the microphone array corresponding to the left front as an example: first, place a sound source on the left front of the electronic device, then enable different microphone arrays to collect sound data, then evaluate the sound pickup effect of each group of microphone arrays based on the collected sound data, and then select the microphone array whose sound pickup effect ranks before the specified ranking as the microphone array corresponding to the left front, and create a corresponding relationship table b.

[0171] When the above-mentioned correspondence table b is configured in the electronic device, the electronic device can query the microphone array that matches the user-selected collection direction through the above-mentioned comparison relationship table b, and enable the microphone array. For example, according to the user-selected collection direction as the front, the matching microphone array can be queried through Table 2, including microphone a and microphone b. At this time, the electronic device can use the matching microphone array as the microphone array that actually needs to be enabled. At present, the process of starting the microphone array can refer to the description in the aforementioned embodiment, which will not be repeated here.

[0172] In addition, in some special cases, such as when multiple matching microphone arrays are queried, one microphone array can be selected from the multiple matching microphone arrays as the microphone array that is actually enabled. The method of selecting the microphone array that is actually enabled from the multiple matching microphone arrays can be referred to the description in the aforementioned embodiment, which will not be repeated here.

[0173] In the third method, the electronic device can randomly select an appropriate microphone array.

[0174] In some embodiments, an array table is configured in the electronic device, and the array table lists all available microphone arrays. The electronic device can select a microphone array from all available microphone arrays according to the above array table and enable the microphone array. During the activation process, the sound pickup effect of the microphone array is evaluated based on the sound data collected by the microphone array. If the sound pickup effect of the microphone array is unqualified, for example, the score corresponding to the sound pickup effect is less than the specified score, then the electronic device is triggered to reselect an adapted microphone array. Among them, the above specified score can be an empirical value, which is not specifically limited here. If the sound pickup effect of the microphone array is qualified, for example, the score corresponding to the sound pickup effect is not less than the specified score, then continue to use the current microphone array.

[0175] The electronic device reselects an adapted microphone array by randomly selecting another one from the microphone arrays that have not been enabled, and enabling the newly selected microphone array. During the enabling of the newly selected microphone array, the sound pickup effect corresponding to the microphone array continues to be repeatedly evaluated. If the sound pickup effect of the newly selected microphone array is also unqualified, the electronic device is also triggered to select an adapted microphone array again. If the sound pickup effect of the newly selected microphone array is qualified, it continues to be used.

[0176] In other possible embodiments, the electronic device may also enable each group of microphone arrays in turn to collect sound data, and then evaluate the sound pickup effect of the corresponding microphone array using the collected sound data, and then select the microphone array with the best sound pickup effect as the adapted microphone array.

[0177] Fourthly, electronic devices can use machine learning models to determine the appropriate microphone array.

[0178] As an implementation method, the machine learning model can be a model trained based on the historical usage data of all microphone arrays. The historical usage data can include the system time, location, power information and corresponding posture information of the electronic device when the microphone array is used. In this way, the trained machine learning model can evaluate the suitable microphone array from at least one dimension of time, space, power and posture.

[0179] In this way, during operation, the electronic device can obtain one or more of the current system time, positioning location, power information and posture information, and combine it with a machine learning model to identify the microphone array that is suitable for the current situation.

[0180] In some special scenarios, such as Fig.13As shown, when the stylus pen and the electronic device work together, that is, when a cooperative communication channel is established between the stylus pen and the electronic device, or, it can also be called when the stylus pen is connected to the electronic device, the electronic device can enable the microphone array including the stylus pen microphone. For example, Fig.13 As shown, microphone a, microphone b and microphone 0 are enabled to collect the sound emitted by the sound source within range area 3.

[0181] As an implementation method, the electronic device is configured with a correspondence table containing the microphone of the third-party device, such as correspondence table c. The correspondence table c contains corresponding microphone arrays in different postures and different collection directions. The microphone arrays in the correspondence table c all contain microphones of the third-party device.

[0182] In this way, when the electronic device detects that the microphone of a third-party device is connected, the correspondence list c is used to find the microphone array corresponding to the current video and enable the microphone array.

[0183] In summary, the electronic device provided in the embodiment of the present application can adjust the microphones connected to each ADC. Then, a microphone array is formed by the microphones currently connected to at least one ADC, and the microphone array is used to collect sound data. Of course, the microphone arrays that can be enabled in the electronic device at different time periods can be different. In this way, the electronic device can collect sound data in different ranges according to different scene requirements. In addition, the scene in which the electronic device enables sound pickup services is more likely to trigger the switching of the enabled microphone array. For example, the scene of using conference service applications mentioned in the aforementioned embodiments. For another example, the scene in which the user uses an electronic device to shoot a video, etc. For another example, the user uses an electronic device to record scenes such as classrooms, dramas, or large-scale stage plays.

[0184] The following describes a microphone control method provided in an embodiment of the present application, which is applied to an electronic device. For example, the electronic device includes multiple microphones, a first ADC and a second ADC. The implementation process of the above method is as follows:

[0185] S1, when the electronic device is in a first posture, enabling a first array to collect first sound data.

[0186] The first array belongs to the microphone array provided in the aforementioned embodiment, and the first array includes at least a first microphone and a second microphone. There may be a corresponding relationship between the first array and the first posture. For example, the electronic device includes a first list (correspondence table a in the aforementioned embodiment), and the first list records that the first array matches the first posture, and also records that the second array matches the second posture.

[0187] In some embodiments, when the first array is started, it is necessary to establish a connection between the first microphone and the first ADC, and to establish a connection between the second microphone and the second ADC. In this way, the sound data collected by the first microphone can be sent to the digital encoder / decoder for encoding, compression, etc. after analog-to-digital processing by the first ADC. The sound data collected by the second microphone can be sent to the digital encoder / decoder for encoding, compression, etc. after analog-to-digital processing by the second ADC. In addition, the sound data collected by the microphones in the first array can be referred to as first sound data.

[0188] In addition, the connection between the ADC and the microphone may be direct or indirect, for example, through a bias circuit, a data selection module, or other devices.

[0189] S2, when the electronic device is in a second posture, enabling a second array to collect second sound data.

[0190] The second array is also a microphone array, and the second array includes at least a third microphone and a fourth microphone. The first array and the second array include at least one different microphone, so the sound pickup ranges of the first array and the second array will also be different.

[0191] In some embodiments, the process of the electronic device starting the second array includes: establishing a connection between the third microphone and the first ADC, and establishing a connection between the fourth microphone and the second ADC. In addition, the sound data collected by the microphones in the second array can be referred to as second sound data.

[0192] In some examples, the first posture is different from the second posture, and the electronic device can adjust the enabled microphone array according to its different postures in the air to meet the sound pickup requirements in different postures.

[0193] In some embodiments, when the electronic device switches from the first array to enabling the second array, the method may further include disconnecting the first microphone from the first ADC; and disconnecting the second microphone from the second ADC.

[0194] In this way, by disconnecting and reconnecting the microphone and ADC, the same ADC can be reused by multiple microphones, ensuring normal sound pickup effects while removing the restriction on the number of connected microphones by the number of ADCs.

[0195] In addition, in some embodiments, before enabling the first array to collect the first sound data, the method further includes: collecting first posture information, the first posture information indicating that the electronic device is in a first posture. The first posture information can be information determined based on data detected by a gravity sensor, an acceleration sensor, a gyroscope, etc. in the electronic device, which can indicate the posture of the device in the environment.

[0196] Similarly, before enabling the second array to collect the second sound data, the method further includes: collecting second posture information, the second posture information indicating that the electronic device is in a second posture. The second posture information is similar to the first posture information, and the difference between the two is the different collection time.

[0197] In some embodiments, the above method may further include:

[0198] S3, receiving the first operation of the user.

[0199] In some embodiments, the first operation may be an operation of selecting a microphone array or an operation of indicating a direction.

[0200] In some scenarios, before the electronic device needs to start the sound collection function, such as before the electronic device starts shooting video data or before connecting a video call, it can detect whether the user has made a first operation.

[0201] S4, in response to the first operation, switching and enabling the third array to collect third sound data.

[0202] In some embodiments, the third array is also a microphone array, and the third array includes a fifth microphone and a sixth microphone. In addition, there is an association between the third array and the first operation.

[0203] For example, the first operation is an operation in which the user selects the third array, so there is an association between the first operation and the third array. In this example, the method further includes: displaying the first interface, in which the position distribution of all microphones is displayed, and at this time, the user can click on the microphone in the first interface, and the selected microphones form the third array. That is, the electronic device can detect the user's selection operation on the microphone in the first interface while displaying the first interface. Among them, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0204] For another example, the first operation is an operation indicating a first direction. When the corresponding relationship table b indicates that there is a corresponding relationship between the first direction and the third array, the first operation is related to the third array.

[0205] In addition, in the case where the first operation is an operation indicating a first direction, the first operation may be an operation in which the user slides on a display screen of the electronic device, and the sliding direction of the operation may be the first direction.

[0206] In the case where the first operation is an operation of indicating a first direction, the first operation may also be an operation of the user selecting a position point on the display screen, and the first direction is the direction corresponding to the selected position point.

[0207] For example, the electronic device may display a second interface, which is an application interface of a conference service application, and includes a location distribution map of conference participants. When it is detected that the user selects a first conference participant in the second interface, and the direction between the first conference participant and the user is the first direction, it is determined that the first operation is received.

[0208] In addition, the method of activating the third array can refer to the method of activating the first array or the second array mentioned in the above embodiments, which will not be described in detail here. After the third array is activated, the sound data collected by the microphones in the third array can be collectively referred to as the third sound data.

[0209] In some other embodiments, the above method further includes:

[0210] S5, detecting that a communication connection is established with the stylus.

[0211] S6, switching to enable the fourth array to collect fourth sound data.

[0212] The fourth array is also a microphone array, but the difference is that the fourth array includes the microphone of the stylus, and of course, it can also include the microphone configured by the electronic device itself, such as the seventh microphone. In this way, multiple devices can coordinate to pick up sound, thereby improving the effect of picking up sound.

[0213] In addition, the method of activating the fourth array can refer to the method of activating the first array or the second array mentioned in the above embodiments, which will not be described in detail. After the fourth array is activated, the sound data collected by the microphones in the fourth array can be collectively referred to as fourth sound data.

[0214] In other embodiments, a first model is configured in the electronic device, and the first model is a machine learning model for identifying a matching microphone array. The method also includes: obtaining current scene information, the scene information including one or more combinations of system time, positioning location, device power and posture information; inputting the current scene information into the first model to determine the fifth array; and enabling the fifth array to collect fifth sound data.

[0215] In addition, the method of activating the fifth array can refer to the method of activating the first array or the second array mentioned in the above embodiments, which will not be described in detail. After the fifth array is activated, the sound data collected by the microphones in the fifth array can be collectively referred to as fifth sound data.

[0216] The embodiment of the present application also provides an electronic device, which may include: a memory and one or more processors. The memory and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can perform each step in the above embodiment. Of course, the electronic device includes but is not limited to the above memory and one or more processors.

[0217] The present application also provides a chip system, which can be applied to the terminal device in the above embodiment. Fig.14 As shown, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 may be a processor in the above-mentioned electronic device. The processor 2201 and the interface circuit 2202 may be interconnected via a line. The processor 2201 may receive and execute computer instructions from the memory of the above-mentioned electronic device via the interface circuit 2202. When the computer instructions are executed by the processor 2201, the electronic device may execute the various steps in the above-mentioned embodiment. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0218] In some embodiments, through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0219] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0220] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0221] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A microphone control method, characterized in that: Applied to an electronic device, the electronic device includes a plurality of microphones, a first analog-to-digital converter, a second analog-to-digital converter, a first data selection module, a second data selection module and a digital codec, the plurality of microphones include a first microphone, a second microphone, a third microphone and a fourth microphone, the digital codec is connected to the first analog-to-digital converter and the second analog-to-digital converter respectively, the first analog-to-digital converter is connected to the first microphone or the third microphone through the first data selection module, the second analog-to-digital converter is connected to the second microphone or the fourth microphone through the second data selection module, and the method includes: When the electronic device is in the first posture, enabling the first array to collect first sound data; wherein the first array includes the first microphone and the second microphone; enabling the first array includes: establishing a connection between the first microphone and a first analog-to-digital converter through the first data selection module, and establishing a connection between the second microphone and a second analog-to-digital converter through the second data selection module; When the electronic device is in a second posture, the second array is enabled to collect second sound data; wherein the second array includes the third microphone and the fourth microphone; starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter through the first data selection module, and establishing a connection between the fourth microphone and the second analog-to-digital converter through the second data selection module; the first posture is different from the second posture.

2. The method according to claim 1, characterized in that Before starting the second array, the method further includes: Disconnecting the first microphone from the first analog-to-digital converter; The connection between the second microphone and the second analog-to-digital converter is disconnected.

3. The method according to claim 1 or 2, characterized in that: Before enabling the first array to collect the first sound data, the method further includes: A first posture information is collected, wherein the first posture information indicates that the electronic device is in the first posture; Before enabling the second array to collect the second sound data, the method further includes: Second posture information is collected, and the second posture information indicates that the electronic device is in the second posture.

4. The method according to claim 1, characterized in that: The plurality of microphones further include: a fifth microphone and a sixth microphone, and the method further includes: Receiving a first operation from a user; In response to the first operation, a third array is switched on to collect third sound data, wherein the third array includes the fifth microphone and the sixth microphone.

5. The method according to claim 4, characterized in that The first operation includes an operation of a user selecting the third array. Before receiving the first operation of the user, the method further includes: Displaying a first interface, wherein the first interface displays the position distribution of the plurality of microphones; Detecting a user's selection operation on a microphone in the first interface; When the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

6. The method according to claim 4, characterized in that The first operation is an operation of indicating a first direction, and in the electronic device, there is a corresponding relationship between the third array and the first direction.

7. The method according to claim 6, characterized in that Before receiving the first operation of the user, the method includes: Displaying a second interface, where the second interface is an application interface of a conference service application, and the second interface includes a location distribution map of conference participants; When it is detected that the user selects the first participant in the second interface, and the direction between the first participant and the user is the first direction, it is determined that the first operation is received.

8. The method according to claim 1, characterized in that The plurality of microphones further includes a seventh microphone, the method further including: Detecting that a communication connection is established with the stylus; The fourth array is switched to collect fourth sound data, wherein the fourth array includes the seventh microphone and a microphone configured on the stylus.

9. The method according to claim 1, characterized in that: The electronic device is configured with a first model, the first model being a machine learning model for identifying a matching microphone array, and the method further includes: Obtaining current scene information, where the scene information includes one or more combinations of system time, location, device power, and posture information; Inputting the current scene information into the first model to determine a fifth array; The fifth array is enabled to collect fifth sound data.

10. The method according to claim 1, characterized in that The electronic device includes a first list, which records the matching between the first array and the first posture, and also records the matching between the second array and the second posture.

11. An electronic device, characterized in that: The electronic device includes one or more processors and a memory; the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the one or more processors are used to execute the method as described in any one of claims 1-10.

12. A computer storage medium, characterized in that: The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method as claimed in any one of claims 1 to 10.

13. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed on a computer, causes the computer to execute the method according to any one of claims 1 to 10.

Images