Microphone control method and electronic equipment

Abstract

The invention provides a microphone control method and electronic equipment, and relates to the technical field of intelligent terminals. The control method comprises the following steps: when the electronic equipment is in a first pose, determining a first microphone array according to the first pose, establishing connection between each microphone in the first microphone array and a corresponding ADC (Analog to Digital Converter), and collecting first sound data based on the first microphone array; wherein the first microphone array comprises a plurality of microphones connected with the first ADC and / or the second ADC; when the electronic equipment is in a second pose, determining a second microphone array according to the second pose, establishing connection between each microphone in the second microphone array and the corresponding ADC, and collecting second sound data based on the second microphone array; wherein the first pose is different from the second pose; the second microphone array comprises a plurality of microphones connected with the first ADC and / or the second ADC, and the microphones contained in the second microphone array are not completely the same as or completely different from the microphones contained in the first microphone array.

Description

[0001] This application is a divisional application. The application number of the original application is 202211668285.7, the original application date is December 24, 2022, and the entire content of the original application is incorporated herein by reference. Technical Field

[0002] This application relates to the technical field of intelligent terminals, and in particular, to a microphone control method and an electronic device. Background Art

[0003] With the iterative update of device hardware, various electronic devices can provide users with more high-quality services. In theory, by increasing the number of microphones connected to an electronic device, the sound pickup range of the electronic device can be expanded.

[0004] However, the number of microphones that can be connected to an electronic device is limited by hardware conditions. Thus, the sound pickup range of the electronic device is always limited. Summary of the Invention

[0005] Embodiments of this application provide a microphone control method and an electronic device for improving the sound pickup range of the electronic device.

[0006] To achieve the above object, the embodiments of this application adopt the following technical solutions:

[0007] In a first aspect, a microphone control method provided by an embodiment of this application is applied to an electronic device. The electronic device includes a plurality of microphones, a first analog-to-digital converter, and a second analog-to-digital converter. The method includes:

[0008] When the electronic device is in a first pose, enable a first array to collect first sound data; wherein, the first array includes a first microphone and a second microphone among the plurality of microphones.

[0009] Exemplarily, starting the first array includes: establishing a connection between the first microphone and the first analog-to-digital converter, and establishing a connection between the second microphone and the second analog-to-digital converter.

[0010] When the electronic device is in a second pose, enable a second array to collect second sound data; wherein, the second array also includes a third microphone and a fourth microphone among the plurality of microphones.

[0011] Exemplarily, starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first pose is different from the second pose.

[0012] Understandably, there are differences in the sound pickup directions corresponding to different microphones. When the electronic device activates an array composed of different microphones, it can collect sounds in different range areas. Obviously, the more arrays the electronic device can activate, the wider the sound pickup range.

[0013] In the above embodiments, when the electronic device is in different poses, it can activate different arrays to collect sound data and complete the sound pickup work for different ranges of content. In this way, the actually available sound pickup range of the electronic device is very large. In addition, when activating different arrays, only different microphones need to be connected to the analog-to-digital converter. That is, the analog-to-digital converter no longer corresponds one-to-one with the microphones. In this way, the number of analog-to-digital converters in the electronic device cannot limit the number of microphones connected to the electronic device. The electronic device can also combine more microphone arrays to expand the sound pickup range and meet different sound pickup requirements.

[0014] In some embodiments, before activating the second array, the method further includes: disconnecting the connection between the first microphone and the first analog-to-digital converter; disconnecting the connection between the second microphone and the second analog-to-digital converter.

[0015] In the above embodiments, the connection between the analog-to-digital converter and the microphone can be established or disconnected. By controlling the on and off of the connection between the analog-to-digital converter and the microphone, the activated microphone array can be switched to flexibly adjust the sound pickup range.

[0016] In some embodiments, before activating the first array to collect the first sound data, the method further includes: collecting first pose information, where the first pose information indicates that the electronic device is in the first pose; before activating the second array to collect the second sound data, the method further includes: collecting second pose information, where the second pose information indicates that the electronic device is in the second pose.

[0017] In some embodiments, the method further includes: receiving a first operation from the user; in response to the first operation, switching to activate a third array to collect third sound data, where the third array includes a fifth microphone and a sixth microphone among the multiple microphones.

[0018] In the above embodiments, the user can indicate to change the used microphone array to meet the sound pickup requirements directly indicated by the user and improve the intelligence level of the electronic device for switching the microphone array.

[0019] As an implementation, the first operation includes an operation where the user selects the third array. Before receiving the first operation from the user, the method further includes: displaying a first interface, in which the position distribution of the plurality of microphones is shown; detecting a selection operation of the user on the microphone in the first interface; where, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0020] In this implementation, the user can directly select the microphone array to be enabled. For example, before instructing the electronic device to enable sound pickup, the user can first specify the microphone array participating in sound pickup to ensure that the sound pickup result is close to the user's requirements.

[0021] In some embodiments, the first operation is an operation indicating a first direction, and in the electronic device, there is a corresponding relationship between the third array and the first direction.

[0022] In some embodiments, before receiving the first operation from the user, the method includes: displaying a second interface, which is an application interface of a conference service application, and the second interface includes a position distribution map of participants; when it is detected that the user selects a first participant in the second interface and the direction between the first participant and the user is the first direction, it is determined that the first operation is received.

[0023] In some embodiments, the method further includes: detecting the establishment of a communication connection with a stylus; switching to enable the fourth array to collect fourth sound data, where the fourth array includes the seventh microphone among the plurality of microphones and the microphone configured on the stylus.

[0024] In some embodiments, a first model is configured in the electronic device, and the first model is a machine learning model for identifying a matching microphone array. The method further includes: obtaining current scene information, where the scene information includes one or a combination of system time, location, device power, and pose information; inputting the current scene information into the first model to determine a fifth array; and enabling the fifth array to collect fifth sound data.

[0025] In some embodiments, a first list is included in the electronic device, and the first list records that the first array matches the first pose and also records that the second array matches the second pose.

[0026] In a second aspect, an electronic device provided by an embodiment of the present application includes one or more processors and a memory; the memory is coupled to the processor, and the memory is used to store computer program code. The computer program code includes computer instructions. When the one or more processors execute the computer instructions, the one or more processors are used for:

[0027] When the electronic device is in a first pose, enable a first array to collect first sound data; wherein, the first array includes a first microphone and a second microphone among the plurality of microphones; starting the first array includes: establishing a connection between the first microphone and a first analog-to-digital converter, and establishing a connection between the second microphone and a second analog-to-digital converter; when the electronic device is in a second pose, enable a second array to collect second sound data; wherein, the second array also includes a third microphone and a fourth microphone among the plurality of microphones; starting the second array includes: establishing a connection between the third microphone and the first analog-to-digital converter, and establishing a connection between the fourth microphone and the second analog-to-digital converter; the first pose is different from the second pose.

[0028] In some embodiments, the one or more processors are further used for: disconnecting the connection between the first microphone and the first analog-to-digital converter; disconnecting the connection between the second microphone and the second analog-to-digital converter.

[0029] In some embodiments, the one or more processors are further used for: collecting first pose information, where the first pose information indicates that the electronic device is in the first pose; collecting second pose information, where the second pose information indicates that the electronic device is in the second pose.

[0030] In some embodiments, the one or more processors are further used for: receiving a first operation of a user; in response to the first operation, switch to enable a third array to collect third sound data, where the third array includes a fifth microphone and a sixth microphone among the plurality of microphones.

[0031] In some embodiments, the one or more processors are further used for: displaying a first interface, where the position distribution of the plurality of microphones is displayed in the first interface; detecting a selection operation of the user on the microphones in the first interface; wherein, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0032] In some embodiments, the first operation is an operation indicating a first direction, and in the electronic device, the third array has a corresponding relationship with the first direction.

[0033] In some embodiments, the one or more processors are further configured to: display a second interface, which is an application interface of a conferencing service application, and the second interface includes a distribution map of the locations of the participants; when it is detected that a first participant in the second interface is selected by the user and the direction between the first participant and the user is the first direction, determine that the first operation is received.

[0034] In some embodiments, the one or more processors are further configured to: detect the establishment of a communication connection with a stylus; switch to enable a fourth array to collect fourth audio data, where the fourth array includes the seventh microphone among the multiple microphones and the microphone configured on the stylus.

[0035] In some embodiments, the one or more processors are further configured to: obtain current scene information, where the scene information includes one or more combinations of system time, location, device power, and pose information; input the current scene information into the first model to determine a fifth array; enable the fifth array to collect fifth audio data.

[0036] In some embodiments, the electronic device includes a first list, which records the matching of the first array with the first pose and also records the matching of the second array with the second pose.

[0037] In a third aspect, a computer storage medium provided by an embodiment of the present application includes computer instructions, which, when running on an electronic device, cause the electronic device to execute the methods in the first aspect and its possible embodiments described above.

[0038] In a fourth aspect, the present application provides a computer program product, which, when running on the above-mentioned electronic device, causes the electronic device to execute the methods in the first aspect and its possible embodiments described above.

[0039] It can be understood that the electronic devices, computer storage media, and computer program products provided in the above-mentioned aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 One of the exemplary diagrams of the distribution of microphones in the electronic device (tablet computer) provided by an embodiment of the present application;

[0041] Figure 2 Another exemplary diagram of the distribution of microphones in the electronic device (tablet computer) provided by an embodiment of the present application;

[0042] Figure 3One of the schematic diagrams of the hardware structure of the electronic device provided by the embodiment of the present application;

[0043] Figure 4 Another schematic diagram of the hardware structure of the electronic device provided by the embodiment of the present application;

[0044] Figure 5 The third schematic diagram of the hardware structure of the electronic device provided by the embodiment of the present application;

[0045] Figure 6 One of the schematic diagrams of the switched microphone array provided by the embodiment of the present application;

[0046] Figure 7 Another schematic diagram of the switched microphone array provided by the embodiment of the present application;

[0047] Figure 8 The third schematic diagram of the switched microphone array provided by the embodiment of the present application;

[0048] Figure 9 One of the schematic diagrams of the pickup range corresponding to the microphone array provided by the embodiment of the present application;

[0049] Figure 10 Another schematic diagram of the pickup range corresponding to the microphone array provided by the embodiment of the present application;

[0050] Figure 11 One of the schematic diagrams of the selected acquisition direction provided by the embodiment of the present application;

[0051] Figure 12 Another schematic diagram of the selected acquisition direction provided by the embodiment of the present application;

[0052] Figure 13 Schematic diagram of the pickup range of the collaborative system composed of the electronic device and the stylus provided by the embodiment of the present application;

[0053] Figure 14 Schematic diagram of the chip system provided by the embodiment of the present application. Detailed implementation manners

[0054] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of this embodiment, unless otherwise stated, "a plurality of" means two or more.

[0055] With the development of technology, the hardware resources (such as storage resources, computing resources, input / output resources, etc.) configured in various electronic devices are also continuously iterated and upgraded to provide users with higher-quality services.

[0056] Taking the audio acquisition module (e.g., microphone) of an electronic device as an example, as the audio acquisition module is continuously iterated and upgraded, the quality of the audio acquisition services provided by the electronic device also improves accordingly.

[0057] In some embodiments, the electronic device can upgrade the audio acquisition module by increasing the number of microphones. For example, the microphone configured on the body of the electronic device is upgraded from a single microphone to four microphones, or to eight microphones. In this way, more microphones can increase more pickup angles, and thus effectively expand the pickup range of the electronic device.

[0058] In some embodiments, when the deployment positions of the microphones in the electronic device are different, the pickup directions may also be different. For example, the microphones configured on different side edges of the electronic device have different corresponding pickup directions. Of course, there are also cases where some microphones have different deployment positions but the same pickup direction. For example, the microphones configured on the same side edge of the electronic device, although their deployment positions are different, have the same corresponding pickup direction.

[0059] In some embodiments, the above-mentioned electronic device may be a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (PDA), a wearable device (such as a smart watch), a smart large screen, a game console, and an augmented reality (AR) / virtual reality (VR) device and other intelligent electronic devices. In the subsequent embodiments, the electronic device is mainly exemplified by a tablet computer.

[0060] Taking the electronic device as a tablet computer as an example, the body of the tablet computer includes four side edges. The microphones of the tablet computer can be deployed on the above four side edges. Exemplarily, one or more microphones can be configured on each side edge. As Figure 1 shown, microphone a and microphone b can be configured on the upper side edge, microphone e and microphone f can also be configured on the lower side edge, microphone c can be configured on the left side edge of the tablet computer, and microphone d can be configured on the right side edge of the tablet computer.

[0061] Also exemplarily, at least one microphone is configured on some side edges, and no microphone is configured on some side edges. For example, at least one microphone is configured on the upper side edge, the left side edge, and the right side edge, while no microphone is configured on the lower side edge.

[0062] In addition, as Figure 1As shown, the body of the tablet computer further includes a rear cover, which is disposed opposite to the display screen. Generally, the rear cover can be used to configure the rear camera of the tablet computer. In some examples, a microphone can also be configured on the rear cover of the tablet computer. For example, at least one microphone can be configured on one side of the rear camera of the tablet computer.

[0063] In some embodiments, the tablet computer can collect sounds emitted by sound sources in different directions through the microphones installed on the body.

[0064] Exemplarily, in the landscape screen state of the tablet computer, the microphones configured on the upper edge are used to pick up the sounds emitted by the sound sources located above the tablet computer. The microphones configured on the lower edge are used to pick up the sounds emitted by the sound sources located below the tablet computer. The microphones configured on the rear cover are used to pick up the sounds emitted by the sound sources located in front of the tablet computer. The microphones configured on the left edge are used to pick up the sounds emitted by the sound sources located to the left of the tablet computer. The microphones configured on the right edge are used to pick up the sounds emitted by the sound sources located to the right of the tablet computer.

[0065] Of course, the sound pickup directions of the respective microphones can also change. Exemplarily, when the posture of the tablet computer changes in space, the sound pickup directions of the respective microphones will also change accordingly.

[0066] Exemplarily, when the tablet computer rotates to the vertical screen state to the right, as Figure 2 shown, the microphones a and b configured on the original upper edge are used to pick up the sounds emitted by the sound sources located to the right of the tablet computer. The microphones e and f configured on the original lower edge are used to pick up the sounds emitted by the sound sources located to the left of the tablet computer. The microphone g configured on the rear cover is used to pick up the sounds emitted by the sound sources located in front of the tablet computer. The microphone c configured on the original left edge is used to pick up the sounds emitted by the sound sources located above the tablet computer, and the microphone d configured on the right edge is used to pick up the sounds emitted by the sound sources located below the tablet computer.

[0067] Another example is that when the tablet computer rotates to the vertical screen state to the left, the microphones a and b configured on the original upper edge are used to pick up the sounds emitted by the sound sources located to the left of the tablet computer, and the microphones e and f configured on the original lower edge are used to pick up the sounds emitted by the sound sources located to the right of the tablet computer. The microphone g configured on the rear cover is used to pick up the sounds emitted by the sound sources located in front of the tablet computer. The microphone c configured on the original left edge is used to pick up the sounds emitted by the sound sources located below the tablet computer, and the microphone d configured on the right edge is used to pick up the sounds emitted by the sound sources located above the tablet computer.

[0068] It should be noted that the above up, down, left, and right directions can be determined with reference to the outer shell of the tablet computer. Exemplarily, in the case where the tablet computer is rectangular, the two relatively short edges on the outer shell of the tablet computer are the left edge and the right edge respectively, and the two relatively long edges are the upper edge and the lower edge respectively.

[0069] In addition to collecting sound data through the microphone configured on the body of the electronic device, the electronic device can also collect sound data through third-party devices (such as headphones and styluses). Exemplarily, after the third-party device establishes a communication connection with the electronic device, the microphone of the third-party device can collect sound. Then, the third-party device can send the collected sound data to the electronic device. Obviously, the microphone of the third-party device can additionally increase the sound pickup direction of the electronic device. Of course, the sound pickup directions provided by some third-party devices are relatively more variable. For example, the sound pickup directions provided by the stylus are different at different angles. The sound pickup directions provided by some third-party devices are relatively fixed. For another example, the sound pickup direction provided by the headphones is relatively fixed when the user wears them.

[0070] In an ideal situation, the more microphones that can be connected to the electronic device, the wider the corresponding sound pickup range. In this way, it is more capable of providing high-quality sound pickup services (such as recording services) for users. However, in actual situations, the number of microphones that can be connected to the electronic device (including the microphones of third-party devices) is limited.

[0071] It can be understood that the sound data (such as sound wave signals) collected by the microphone needs to be converted from analog to digital by an analog-to-digital converter (ADC). The sound data after analog-to-digital conversion is data that the electronic device can recognize and continue to process. After completing the analog-to-digital conversion of the sound data, the analog-to-digital converter can transfer the sound data to a codec digital. In this way, the sound data collected by the microphone can be encoded and compressed, and the encoded and compressed sound data can participate in subsequent services, such as storage, transmission, etc.

[0072] However, due to the limitations of the device chip, the number of analog-to-digital converters in the electronic device is limited. In addition, the microphones must correspond one-to-one with the analog-to-digital converters. In this way, the number of microphones that can be connected to the electronic device will also be limited. For example, when there are only three analog-to-digital converters in the electronic device, the number of microphones that can be connected to the electronic device cannot exceed three. If one analog-to-digital converter needs to be reserved for the microphone of the third-party device, then the number of microphones that can be configured on the body of the electronic device cannot exceed two, otherwise there will be microphones that cannot be used normally.

[0073] An embodiment of the present application provides a microphone control method, which is applied to an electronic device. Without adding an analog-to-digital converter to the electronic device, by dynamically switching the microphones connected to the analog-to-digital converter and utilizing the specific feature that different microphones have different sound pickup directions, it is possible to use different microphone arrays (including multiple microphones) or different single microphones to pick up sounds in different range areas. In this way, the analog-to-digital converter no longer limits the number of microphones that can be connected to the electronic device.

[0074] Please refer to Figure 3 , which is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application.

[0075] As Figure 3 shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0076] Among them, the above-mentioned sensor module 180 may include sensors such as a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor.

[0077] It can be understood that the structure schematically shown in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0078] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0079] The controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0080] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0081] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0082] It can be understood that the interface connection relationships between the modules illustrated in this embodiment are only illustrative descriptions and do not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0083] The electronic device 100 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to execute mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0084] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to implement the storage capacity expansion of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0085] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0086] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0087] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0088] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image through algorithms. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0089] The camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the electronic device 100 can include N cameras 193, where N is a positive integer greater than 1.

[0090] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0091] A video codec is used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0092] The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission pattern between human brain neurons, it can quickly process input information and can also continuously learn on its own. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as image recognition, face recognition, speech recognition, text understanding, etc.

[0093] The microphone 170C can be used to collect sounds in the environment. In the embodiments of the present application, there may be multiple of the above-mentioned microphones 170C, and the arrangement positions, or installation positions, of the multiple microphones 170C on the electronic device may be different. For example, Figure 1 is an example diagram of the arrangement of a microphone 170C on an electronic device. Of course, more or fewer microphones may also be installed in the electronic device. Similarly, there may be other arrangement ways of the microphones on the electronic device.

[0094] In some embodiments, the electronic device may include a digital coder-decoder, an ADC, and multiple microphones.

[0095] In some embodiments, the above digital coder-decoder is connected to the ADC. The above ADC can establish a connection with the microphone and can also disconnect from the microphone. Among them, within the same time period, a single ADC can only establish a connection with a single microphone. In different time periods, the ADC can establish a connection with different microphones.

[0096] After the connection between the ADC and the microphone is established, the sound data collected by the microphone can be subjected to analog-to-digital conversion processing by the ADC. The sound data after being subjected to analog-to-digital conversion processing by the ADC can also be sent to the digital coder-decoder for processing such as encoding and compression.

[0097] In some other embodiments, a connection can be established between the above ADC and the microphone through a bias circuit. That is, the electronic device may further include a plurality of bias circuits. The above bias circuit is connected to the microphone. At the same time, a connection can also be established between the above bias circuit and the ADC. When a connection is established between the bias circuit and the ADC, the sound data collected by the microphone needs to be processed by the bias voltage first and then transmitted to the ADC for analog-to-digital conversion processing. Among them, the working principle of the bias circuit can refer to the related technology and will not be elaborated here.

[0098] In addition, while a connection can be established between the bias circuit and the ADC, the connection between the bias circuit and the ADC can also be disconnected. In this way, by controlling the connection and disconnection between the bias circuit and the ADC, it is possible to enable the ADC to establish connections with different microphones at different times.

[0099] In some examples, a fixed connection relationship is established between a microphone and a bias circuit. For example Figure 4 the shown bias circuit 0, bias circuit 2, bias circuit 3, bias circuit 4, bias circuit 5. Among them, a connection is established between bias circuit 0 and microphone 0, and this bias circuit 0 can receive the sound data collected by microphone 0. A connection is established between bias circuit 2 and microphone 2, and this bias circuit 2 can receive the sound data collected by microphone 2, and so on. In addition, the above microphone 0 can be a microphone from a stylus (a third-party device). The above microphones 2, 3, 4, and 5 can be microphones installed on the body of the electronic device.

[0100] In some other examples, multiple microphones can also share the same bias circuit. When multiple microphones share the same bias circuit, only one microphone can be connected to the bias circuit at the same time. For example, Figure 4 the shown bias circuit 1, which can be connected to microphone 1 (one of the microphones configured on the body of the electronic device) or the microphone of the earphone (a third-party device). That is, microphone 1 and the microphone of the earphone need to share bias circuit 1. In some examples, when the electronic device is connected to the earphone, the earphone microphone is connected to bias circuit 1. When the electronic device is not connected to the earphone, microphone 1 is connected to bias circuit 1.

[0101] In some examples, the electronic device further includes an earphone detection module, which can be used to detect whether an earphone is connected to the electronic device. For example, the earphone detection module can include an ACCDET module, and the principle of its detecting whether the earphone is connected can refer to the related technology and will not be elaborated here.

[0102] In addition, when it is detected that the earphone is connected to the electronic device, the bias circuit 1 is connected to the earphone microphone. At this time, the bias circuit 1 only receives the sound data collected by the earphone microphone. When it is not detected that the earphone is connected to the electronic device, the bias circuit 1 is connected to the microphone 1. At this time, the bias circuit 1 can receive the sound data collected by the microphone 1.

[0103] In some other embodiments, the connection between the above ADC and the microphone (or, the bias circuit) can be established or disconnected through a data selection module.

[0104] In some examples, the above data selection module can be a PGA-MUX device. In this way, a data selection module can be connected to an ADC.

[0105] In this example, if the number of ADCs in the electronic device is the same as the number of data selection modules, then the ADCs and the data selection modules are in one-to-one correspondence. For example, Figure 4 As shown, the electronic device includes ADC1, ADC2, ADC3, data selection module 1, data selection module 2, and data selection module 3. Among them, ADC1 is uniquely corresponding to data selection module 1, ADC2 is uniquely corresponding to data selection module 2, and ADC3 is uniquely corresponding to data selection module 3.

[0106] In this example, if the number of ADCs in the electronic device is not the same as the number of data selection modules, that is, when the number of data selection modules can be less than the number of ADCs, each data selection module is connected to an ADC, but there are ADCs that are not connected to the data selection module. For example, Figure 5 As shown, the electronic device includes ADC4, ADC5, ADC6, data selection module 1, and data selection module 2. ADC4 is connected to data selection module 1, and ADC5 is connected to data selection module 2. ADC6 is not connected to the data selection module.

[0107] In some embodiments, in addition to being connected to the ADC, the data selection module can also be connected to at least one microphone. For example, it can be connected to the microphone through a bias circuit. It can be understood that the data selection module is a device similar to a switch, which can not only establish a connection with the microphone, but also disconnect the connection with the microphone.

[0108] When the data selection module can be connected to multiple microphones, at the same time period, only one microphone can be connected to the data selection module. In different time periods, the data selection module can select to establish a connection with different microphones.

[0109] In this way, after a connection is established between the data selection module and the selected microphone, for example, after connecting to the bias circuit corresponding to the selected microphone, the sound data collected by the microphone can be processed by the bias circuit and then transmitted to the corresponding ADC through the data selection module.

[0110] For example, Figure 4 As shown, when the data selection module 1 selects to establish a connection with microphone 0 among microphone 0 and microphone 1, the data selection module 1 can receive the sound data 1 (the sound data collected by microphone 0) processed by the bias circuit 0 and transmit the sound data 1 to ADC1. It can be seen that after the data selection module 1 establishes a connection with microphone 0, it is equivalent to establishing a data transmission channel between microphone 0 and ADC1. At this time, the sound data collected by microphone 0 can be normally transmitted to ADC1 for analog-to-digital conversion. Then, ADC1 can transmit the sound data after analog-to-digital conversion to the digital coder-decoder for encoding, compression and other processing. That is, the electronic device can normally enable microphone 0 but cannot enable microphone 1.

[0111] Of course, between microphone 0 and microphone 1, the data selection module 1 can also choose to disconnect the connection with microphone 0 and establish a connection with microphone 1. In this way, the data selection module 1 can receive the sound data 2 (the sound data collected by microphone 1) processed by the bias circuit 1 and transmit the sound data 2 to ADC1. It can be seen that after the data selection module 1 establishes a connection with microphone 1, it is equivalent to establishing a data transmission channel between microphone 1 and ADC1 and disconnecting the data transmission channel between microphone 0 and ADC1. At this time, the sound data collected by microphone 1 can be normally transmitted to ADC1 for analog-to-digital conversion. Then, ADC1 can transmit the sound data after analog-to-digital conversion to the digital coder-decoder for encoding, compression and other processing. That is, the electronic device can normally enable microphone 1 but cannot enable microphone 0.

[0112] Similarly, Figure 4 the data selection module 2 in [description] can also choose to enable microphone 2 or microphone 3 by establishing a connection between ADC2 and microphone 2, or by establishing a connection between ADC2 and microphone 3. Figure 4 the data selection module 3 in [description] can also choose to enable microphone 4 or microphone 5 by establishing a connection between ADC3 and microphone 4, or by establishing a connection between ADC3 and microphone 5.

[0113] It can be seen that in the case of only three ADCs, the electronic device provided by the embodiments of the present application can access six microphones (including the microphones of third-party devices). Of course, more microphones can also be accessed. For example, when a single data selection module can select one of the three microphones to establish a connection, a total of nine microphones can be accessed in the electronic device. In addition, all the microphones accessed in the electronic device can be used normally.

[0114] It can be understood that within the same time period, only one connection can be established between the same ADC and one microphone. Only when a connection is established between the ADC and the microphone can the ADC receive the sound data collected from the microphone. In addition, within different time periods, the electronic device can change the microphone connected to the ADC through the data selection module.

[0115] That is, in the embodiments of the present application, by using the above data selection module, the electronic device can dynamically switch the microphone connected to the ADC. For the convenience of description, hereinafter, "switching the microphone connected to the ADC" will be abbreviated as switching for the ADC.

[0116] In some embodiments, the electronic device can enable at least one microphone to collect sound, where the connection between the enabled microphone and the ADC has been established. The microphones connected to different ADCs can work normally at the same time without affecting each other. When multiple microphones are enabled at the same time, it can be regarded that the electronic device enables a microphone array.

[0117] In addition, the electronic device can enable different microphone arrays by switching for at least one ADC.

[0118] Exemplarily, as Figure 6 shown, a connection is established between ADC1 and microphone 0 in the electronic device. A connection is established between ADC2 and microphone 2 in the electronic device. A connection is established between ADC3 and microphone 4 in the electronic device. At this time, the electronic device can enable the microphone array composed of microphone 0, microphone 2, and microphone 4 to collect sound.

[0119] After dynamically switching for all ADCs, ADC1 in the electronic device can switch to connect to microphone 1, ADC2 can switch to connect to microphone 3, and ADC3 can switch to connect to microphone 5. At this time, the electronic device enables the microphone array composed of microphone 1, microphone 3, and microphone 5 to collect sound.

[0120] In addition, when the electronic device performs dynamic switching only for ADC1, it can switch to enable the microphone array composed of microphone 1, microphone 2, and microphone 4. When the electronic device performs dynamic switching only for ADC2, it can switch to enable the microphone array composed of microphone 0, microphone 3, and microphone 4. When the electronic device performs dynamic switching only for ADC3, it can switch to enable the microphone array composed of microphone 0, microphone 2, and microphone 5. When the electronic device performs dynamic switching for ADC1 and ADC2, it can switch to enable the microphone array composed of microphone 1, microphone 3, and microphone 4, etc.

[0121] Of course, the electronic device may also include an ADC that cannot perform dynamic switching. For example, Figure 5 the ADC6 in Figure 5 As shown, ADC6 does not have a corresponding data selection module. This ADC6 can only be fixedly connected to the bias circuit 4. That is, this ADC6 can only communicate with the bias circuit 4 and can only receive and process the sound data sent by the bias circuit 4 (the sound data collected by microphone 4). That is, different from Figure 5 the ADC4 and ADC5 in

[0122] In some other examples, the above data selection module can be an analog circuit with a selection function. For example, this analog circuit can select N microphones from M microphones, where M is a positive integer greater than N. M can be the number of microphones already connected in the electronic device, and the above N can be the number of ADCs in the electronic device.

[0123] In this example, the above data selection module can be connected to all ADCs. In addition, the above data selection module can also select a specified number of microphones from the microphones already connected to the electronic device and establish connections.

[0124] As Figure 7 shown, the electronic device includes ADC1, ADC2, ADC3, and data selection module 4. Among them, the above data selection module 4 can establish connections with the above ADC1, ADC2, and ADC3. In this way, the above data selection module 4 can send different data to ADC1, ADC2, and ADC3 in parallel. In addition, the data selection module 4 has the ability to establish connections with each microphone. Of course, it also has the ability to disconnect the connections with the microphones.

[0125] On this basis, the data selection module 4 can select three microphones from the microphones connected to the electronic device and establish connections. In this way, the data selection module 4 can separately send the three-channel sound data collected by the above three microphones to ADC1, ADC2, and ADC3. For example, if microphones 2, 4, and 5 are selected, then the data selection module 4 can transmit the sound data collected by microphone 2 to ADC1, the sound data collected by microphone 4 to ADC2, and the sound data collected by microphone 5 to ADC3.

[0126] Equivalently, the data selection module 4 establishes a connection between microphone 2 and ADC1, a connection between microphone 4 and ADC2, and a connection between microphone 5 and ADC3. In this way, the electronic device can normally enable microphones 2, 4, and 5 to perform sound collection tasks and does not enable microphones 0, 1, and 3. At this time, the electronic device enables the microphone array composed of microphones 2, 4, and 5.

[0127] In some embodiments, the electronic device can also instruct the data selection module 4 to select different microphones to establish connections, so that different microphone arrays can be combined.

[0128] For example, if the data selection module 4 reselects microphones 0, 2, and 4 to establish connections, then as Figure 8 shown, it is equivalent that the data selection module 4 establishes a connection between microphone 0 and ADC1, a connection between microphone 2 and ADC2, and a connection between microphone 4 and ADC3. In this way, the electronic device can normally enable microphones 0, 2, and 4 and does not enable microphones 1, 3, and 5. At this time, the electronic device switches to enable the microphone array composed of microphones 0, 2, and 4.

[0129] In addition, the connection established between the data selection module and the microphone in the foregoing embodiments may be, in addition to a direct connection between the data selection module and the microphone, a connection established through a bias circuit. For example, after the data selection module establishes a connection with bias circuit 0, since there is also a connection between bias circuit 0 and microphone 0, it can be regarded that the data selection module establishes a connection with microphone 0 through bias circuit 0.

[0130] In summary, the electronic device provided by the embodiments of the present application can dynamically switch the enabled microphone array. It can be understood that different microphone arrays can collect sounds in different range areas in the environment where the electronic device is located.

[0131] For example, as Figure 9As shown, when the microphone array composed of microphone c, microphone a, and microphone b is enabled, the electronic device can pick up the sound in the range area 1. For another example, as Figure 10 shown, when the microphone array composed of microphone a, microphone b, and microphone d is enabled, the electronic device can pick up the sound in the range area 2.

[0132] In some embodiments, the electronic device can intelligently enable different microphone arrays to meet different sound pickup requirements of users. Among them, when the electronic device decides which microphone array to use, it can adopt any of the following methods:

[0133] The first method is that the electronic device can determine the adapted microphone array according to the detected pose information.

[0134] Among them, the above pose information can indicate the posture of the electronic device in space. For example, the above posture can include being parallel to the horizontal plane in the landscape screen state (such as simply referred to as pose 1), having an angle less than angle 1 (such as 90 degrees) with the horizontal plane in the landscape screen state (such as simply referred to as pose 2), having an angle not less than angle 1 with the horizontal plane in the landscape screen state (such as simply referred to as pose 3), etc. For another example, the above posture also includes being parallel to the horizontal plane in the portrait screen state (such as simply referred to as pose 4), having an angle less than angle 1 (such as 90 degrees) with the horizontal plane in the portrait screen state (such as simply referred to as pose 5), having an angle not less than angle 1 with the horizontal plane in the portrait screen state (such as simply referred to as pose 6), etc.

[0135] In some embodiments, the electronic device can periodically determine the pose information corresponding to the electronic device. For example, every minute, the electronic device can determine the pose information of the electronic device according to the data collected by the gyroscope, gravity sensor, acceleration sensor, etc. The specific implementation process can refer to the related technology and will not be elaborated here.

[0136] In some other embodiments, the electronic device can respond to a specific event to determine the pose information corresponding to the electronic device.

[0137] Exemplarily, the above specific event can be enabling a specified application, such as a recording application, a conference application, a voice call application, etc. that require enabling the microphone. Additionally, the above specific event can also be receiving a specific instruction, such as an instruction to enable the sound collection function. Furthermore, the above specific event can also be detecting that the enabled microphone array does not meet the condition for continued use. For example, when it is detected that some microphones in the enabled microphone array are blocked, the electronic device can determine that the microphone array does not meet the condition for continued use.

[0138] In this way, the electronic device can determine its current pose based on the acquired pose information. Then, according to the current pose, the microphone array that actually needs to be enabled currently can be selected.

[0139] As an implementation manner, a correspondence table a between different poses and different microphone arrays can be pre-configured in the electronic device. For example, when the electronic device is Figure 1 the tablet computer shown, and the tablet computer only has three ADCs, the correspondence table a between the pose and the microphone array can be as shown in Table 1 below:

[0140] Table 1

[0141]

[0142] It can be understood that the above Table 1 is only an example of the correspondence relationship and does not limit the embodiments of the present application. Of course, as can be seen from the above Table 1, a single pose can correspond to one or more groups of microphone arrays, and the number of microphones in each group of microphone arrays does not exceed the total number of ADCs. The ADCs corresponding to the microphones in the same group are different, so that the microphones in the same group can work properly, that is, they can parallelly transmit the collected sound data to the digital coder-decoder for encoding, compression and other processing by the digital coder-decoder.

[0143] It should be further noted that in addition to enabling the microphone array to collect sound data, the electronic device can also enable a single microphone to collect sound data. Similarly, the electronic device can pre-configure the single microphone that is most suitable for sound collection in different poses. In this way, the electronic device can also switch to enable different single microphones to collect sound data according to different pose information. In the subsequent embodiments, the judgment logic and methods related to the microphone array are also applicable to the single microphone, and will not be described in detail in the subsequent embodiments.

[0144] In addition, the number and type of poses can be set according to empirical values. The correspondence relationship between different poses and the microphone array can be obtained by testing. For example, in each pose, the pickup effects corresponding to all enabled microphone arrays are tested. The pickup effects can be distinguished by the sound effect score, and the sound effect score can be the score of the artificial intelligence model on the collected sound data from the perspectives of sound quality and volume. Then, the microphone arrays whose pickup effects are ranked before the specified ranking are selected as the microphone arrays corresponding to the pose, and the above correspondence table a is formed.

[0145] When the above corresponding relationship table a is configured in the electronic device, the electronic device can query the microphone array matching the current pose through the above comparison relationship table a and enable the microphone array. For example, according to the collected pose information, it is determined that the current pose of the electronic device is pose 3. Then, through Table 1, it can be queried that the matching microphone arrays include microphone b, microphone d, and microphone g. In this scenario, the electronic device can use the queried microphone array as the microphone array that actually needs to be enabled.

[0146] In addition, the way to enable the microphone array can be: establish a connection between each microphone in the microphone array and the corresponding ADC. Then, the sound data collected by each microphone in the microphone array, after being processed by the corresponding bias circuit, is transmitted to the corresponding ADC through the data selection module. After the corresponding ADC completes the analog-to-digital conversion of the sound data, the sound data is sent to the digital coder-decoder, and the digital coder-decoder performs encoding, compression, and other processing on the sound data. In this way, the microphone array starts to operate normally.

[0147] Of course, if there is no data selection module between the microphone in the microphone array and the ADC, the sound data collected by the microphone, after being processed by the bias circuit, is directly sent to the corresponding ADC, and the corresponding ADC performs analog-to-digital conversion on the sound data. Finally, the digital coder-decoder performs encoding and compression on the sound data. For example, Figure 5 for ADC6 and microphone 4 in , when the microphone array includes microphone 4, the sound data collected by microphone 4, after being processed by bias circuit 4, is directly sent to ADC6, and ADC6 performs analog-to-digital conversion processing.

[0148] In addition, in some special cases, such as when multiple matching microphone arrays are queried, one can be selected from the multiple matching microphone arrays as the actually enabled microphone array.

[0149] Exemplarily, a random method can be adopted for selection. That is, the electronic device can use a pre-configured random algorithm to select one microphone array from the multiple matching microphone arrays as the currently actually enabled microphone array.

[0150] Another example is that a microphone array meeting the preset conditions can be selected.

[0151] For example, the above preset conditions may include being marked with common tags by the user. In some examples, the electronic device may pre-display a distribution example diagram of each microphone on the electronic device. During the display of this distribution example diagram, the user can select a common microphone, and the electronic device can determine the common microphone according to the user's selection. In this way, among multiple microphone arrays corresponding to the same pose, the array with the most common microphones can be marked with a common tag. In other examples, the electronic device may pre-display a distribution example diagram of each microphone on the electronic device. During the display of this distribution example diagram, the electronic device can also sequentially display microphone arrays matching different poses. At this time, the user can select a common microphone array by clicking on the display screen of the electronic device. Correspondingly, the electronic device can also mark a common tag for the microphone array selected by the user.

[0152] In this way, the electronic device can select the microphone array with this common tag from multiple matching microphone arrays by identifying the common tag as the currently actually enabled microphone array.

[0153] For another example, the above preset conditions may also include the best sound pickup effect in the current environment. Among them, the sound pickup effect can be distinguished by a sound effect score, and this sound effect score can be the score given by an artificial intelligence model to the collected sound data from the perspectives of sound quality and volume.

[0154] In this way, the electronic device can sequentially enable each group of matching microphone arrays to collect sound for a short period of time, and then use the artificial intelligence model to score the sound data collected by each group of microphone arrays to determine the microphone array with the best sound pickup effect as the currently actually enabled microphone array.

[0155] For another example, the above preset conditions may also include that no microphone is blocked, etc. In some examples, the vibration amplitude of the sound wave signal collected by the microphone can be compared with a preset value (empirical value). If the vibration amplitude corresponding to this microphone is less than the preset value and the vibration amplitudes corresponding to other microphones are not less than the preset value, then it is determined that this microphone is blocked.

[0156] In this way, the electronic device can first determine the blocked microphone, and then select the microphone array that does not contain the blocked microphone from the matching microphone arrays as the currently actually enabled microphone array.

[0157] In addition, there is also a situation where when the actually enabled microphone array (such as microphone array 1) is determined, there is no blocked microphone in this microphone array 1. During the activation of microphone array 1, if the microphone in microphone array 1 is blocked, then it can trigger a re-query for the microphone array matching the current pose and re-determine the actually enabled microphone array.

[0158] In the second method, the electronic device can determine a suitable microphone array according to the acquisition direction selected by the user.

[0159] In some embodiments, the electronic device can determine the acquisition direction selected by the user according to the operations of the user on the display screen. Among them, the above acquisition directions may include the front left, front right, left, right, and directly in front, etc.

[0160] Exemplarily, the user can perform a click on the display screen, and the electronic device can determine the acquisition direction according to the direction between the click position and the preselected point.

[0161] For example, when the center point of the display screen is configured as a fixed preselected point, as Figure 11 shown, the user clicks on the position 1101 on the display screen, and the electronic device can recognize that the position 1101 is the click position. At this time, the direction between the center point 1102 of the display screen and the position 1101 is the front left, so the electronic device can determine the acquisition direction as the front left.

[0162] For another example, when the user participates in an offline meeting, the user can enable a meeting service application in the electronic device to record the voice meeting minutes. During the period of enabling the meeting service application, as Figure 12 shown, the electronic device can display a meeting service interface. Among them, the meeting service interface includes the positions of multiple participants. For example, the position 1201 indicates the position of participant A in the current meeting scene, the position 1202 indicates the position of participant B in the current meeting scene, the position 1203 indicates the position of participant C in the current meeting scene, the position 1204 indicates the position of participant D in the current meeting scene, the position 1205 indicates the position of the user in the current meeting scene, and the position 1206 indicates the position of participant E in the current meeting scene. The position of the user in the current meeting scene, that is, the position 1205, can be used as the preselected point.

[0163] In addition, the position distribution of the participants in the above meeting service interface can be determined according to the seat template selected by the user, the number of participants input, etc. Or, the position distribution of the participants in the above meeting service interface can also be generated according to the on-site photo of the current meeting scene. The embodiments of the present application do not limit this.

[0164] Continuing with the above example, when it is detected that the user clicks on the position of any participant, then the direction between the selected participant position and the user position can be used as the selected acquisition direction. For example, when it is detected that the user selects the position of participant A, that is, the position 1201, and determines that the direction between the position 1201 and the user position (that is, the position 1205) is the front left, then the front left can be determined as the acquisition direction.

[0165] After determining the acquisition direction, the electronic device can determine the adapted microphone array by looking up a table.

[0166] As an implementation, a correspondence table b between different acquisition directions and different microphone arrays can be pre-configured in the electronic device. For example, when the electronic device is Figure 1 the tablet computer shown, and the tablet computer only has three ADCs, the correspondence table b between the pose and the microphone array can be as shown in Table 2 below:

[0167] Table 2

[0168]

[0169] It can be understood that the above Table 2 is only an example of the correspondence relationship and cannot be regarded as a specific limitation of the correspondence table b in the embodiments of the present application.

[0170] Of course, in the actual application process, the above correspondence table b may include more or updated acquisition directions, and the microphone arrays corresponding to different acquisition directions are determined through pre-tests.

[0171] Taking the test of the microphone array corresponding to the front left as an example: First, place a sound source in the front left of the electronic device, then, enable different microphone arrays to collect sound data, then, according to the collected sound data, evaluate the sound pickup effect of each group of microphone arrays, and then select the microphone arrays whose sound pickup effects are ranked before the specified ranking as the microphone arrays corresponding to the front left, and create the correspondence table b.

[0172] When the above correspondence table b is configured in the electronic device, the electronic device can query the microphone array matching the acquisition direction selected by the user through the above comparison table b and enable the microphone array. For example, if the acquisition direction selected by the user is the due front, then through Table 2, it can be queried that the matching microphone arrays include microphone a and microphone b. At this time, the electronic device can use the matching microphone array as the actually required microphone array to be enabled. Currently, the process of starting the microphone array can refer to the description in the foregoing embodiments and will not be elaborated here.

[0173] In addition, in some special cases, such as when multiple matching microphone arrays are queried, one can be selected from the multiple matching microphone arrays as the actually enabled microphone array. Among them, the method of selecting the actually enabled microphone array from the multiple matching microphone arrays can refer to the description in the foregoing embodiments and will not be elaborated here.

[0174] In the third method, the electronic device can randomly select the adapted microphone array.

[0175] In some embodiments, an array list is configured in the electronic device, and all selectable microphone arrays are listed in the array list. The electronic device can select a microphone array from all the selectable microphone arrays according to the above array list and enable the selected microphone array. During the enabling process, the sound pickup effect of the microphone array is evaluated according to the sound data collected by the microphone array. If the sound pickup effect of the microphone array is unqualified, for example, the score corresponding to the sound pickup effect is less than a specified score, then the electronic device is triggered to reselect a suitable microphone array. The above specified score can be an empirical value and is not specifically limited herein. If the sound pickup effect of the microphone array is qualified, for example, the score corresponding to the sound pickup effect is not less than the specified score, then the current microphone array continues to be used.

[0176] Among them, the electronic device reselecting a suitable microphone array can be: randomly selecting another one from the microphone arrays that have never been enabled and enabling the newly selected microphone array. During the enabling of the newly selected microphone array, the sound pickup effect corresponding to the microphone array continues to be evaluated. If the sound pickup effect of the newly selected microphone array is also unqualified, similarly, the electronic device will also be triggered to reselect a suitable microphone array. If the sound pickup effect of the newly selected microphone array is qualified, it continues to be used.

[0177] In other possible embodiments, the electronic device can also enable each group of microphone arrays in sequence to collect sound data. Then, the sound pickup effect of the corresponding microphone array is evaluated by using the collected sound data. Then, the microphone array with the best sound pickup effect is selected as the suitable microphone array.

[0178] In a fourth way, the electronic device can use a machine learning model to determine a suitable microphone array.

[0179] As an implementation manner, the above machine learning model can be a model trained according to the historical usage data of all microphone arrays. Among them, the above historical usage data can include the system time, positioning location, battery information, and corresponding pose information of the electronic device when the microphone array is used. In this way, the trained machine learning model can evaluate a suitable microphone array from at least one dimension such as time, space, battery, and pose.

[0180] In this way, during the operation of the electronic device, by obtaining one or more of the current system time, positioning location, battery information, and pose information, and combining with the machine learning model, a suitable microphone array for the current situation can be identified.

[0181] In some special scenarios, such as Figure 13As shown, when the stylus and the electronic device work in cooperation, that is, when a cooperative communication channel is established between the stylus and the electronic device, or, which can also be referred to as when the stylus accesses the electronic device, the electronic device can enable a microphone array including the stylus microphone. For example, Figure 13 As shown, microphones a, b, and 0 are enabled to collect the sounds emitted by sound sources within the collection range area 3.

[0182] As an implementation, a corresponding relationship table including the microphones of the third-party device is configured in the electronic device, such as a corresponding relationship table c. The corresponding relationship table c includes the corresponding microphone arrays in different poses and different collection directions. The microphone arrays in the corresponding relationship list c all include the microphones of the third-party device.

[0183] In this way, when the electronic device detects the access of the third-party device microphone, it uses the corresponding relationship list c to find the microphone array corresponding to the current video and enables the microphone array.

[0184] In summary, the electronic device provided in the embodiments of the present application can adjust the microphones connected to each ADC. Then, a microphone array is composed of the microphones currently connected by at least one ADC, and the microphone array is used to collect sound data. Of course, the microphone arrays that can be enabled by the electronic device can be different at different times. In this way, the electronic device can collect sound data in different range areas according to different scenario requirements. In addition, in the scenario where the electronic device enables a sound pickup service, it is easier to trigger the switching of the enabled microphone array. For example, the scenario of using a conference service application mentioned in the foregoing embodiments. For another example, the scenario where the user uses the electronic device to shoot a video. For another example, the scenarios where the user uses the electronic device to record a class, a drama, or a large-scale stage play, etc.

[0185] Next, the microphone control method provided in the embodiments of the present application will be introduced. This method is applied to an electronic device. For example, the electronic device includes multiple microphones, a first ADC, and a second ADC. The implementation process of the foregoing method is as follows:

[0186] S1, when the electronic device is in the first pose, enable the first array to collect the first sound data.

[0187] Among them, the first array belongs to the microphone array provided in the foregoing embodiments. The first array includes at least a first microphone and a second microphone. There may be a corresponding relationship between the first array and the first pose. For example, the electronic device includes a first list (the corresponding relationship table a in the foregoing embodiments), and the first list records that the first array matches the first pose and also records that the second array matches the second pose.

[0188] In some embodiments, when starting the first array, it is necessary to establish a connection between the first microphone and the first ADC, and establish a connection between the second microphone and the second ADC. In this way, the sound data collected by the first microphone can be sent to the digital coder / decoder for encoding, compression, etc. after being processed by the first ADC for analog-to-digital conversion. The sound data collected by the second microphone can be sent to the digital coder / decoder for encoding, compression, etc. after being processed by the second ADC for analog-to-digital conversion. In addition, the sound data collected by the microphones in the first array can be referred to as the first sound data.

[0189] In addition, the connection between the ADC and the microphone can be a direct connection or an indirect connection. For example, it can be connected through devices such as a bias circuit and a data selection module.

[0190] S2. When the electronic device is in the second pose, enable the second array to collect the second sound data.

[0191] Among them, the second array also belongs to the microphone array, and the second array includes at least a third microphone and a fourth microphone. Among the above-mentioned first array and second array, at least one microphone is different. In this way, there will also be differences in the sound pickup ranges of the first array and the second array.

[0192] In some embodiments, the process of the electronic device starting the second array includes: establishing a connection between the third microphone and the first ADC, and establishing a connection between the fourth microphone and the second ADC. In addition, the sound data collected by the microphones in the second array can be referred to as the second sound data.

[0193] In some examples, the above-mentioned first pose is different from the second pose, and the electronic device can adjust the enabled microphone array according to its different poses in the air to meet the sound pickup requirements in different poses.

[0194] In some embodiments, when the electronic device switches from the first array to enabling the second array, the above method may further include disconnecting the connection between the first microphone and the first ADC; disconnecting the connection between the second microphone and the second ADC.

[0195] In this way, through the disconnection and re-establishment of the connection between the microphone and the ADC, the same ADC can be reused by multiple microphones, ensuring the normal sound pickup effect while removing the limitation of the number of ADCs on the number of connected microphones.

[0196] In addition, in some embodiments, before enabling the first array to collect the first sound data, the method further includes: collecting first pose information, where the first pose information indicates that the electronic device is in a first pose. The first pose information can be information determined based on data detected by a gravity sensor, an acceleration sensor, a gyroscope, etc. in the electronic device, and can indicate the pose of the device in the environment where it is located.

[0197] Similarly, before enabling the second array to collect the second sound data, the method further includes: collecting second pose information, where the second pose information indicates that the electronic device is in a second pose. The second pose information is similar to the first pose information, and the difference between the two lies in the different collection times.

[0198] In some embodiments, the above method may further include:

[0199] S3. Receiving a first operation from the user.

[0200] In some embodiments, the first operation may be an operation of selecting a microphone array or an operation of indicating a direction.

[0201] In some scenarios, before the electronic device needs to start the function of sound collection, for example, before the electronic device starts shooting video data or connects to a video call, it can detect whether the user makes a first operation.

[0202] S4. In response to the first operation, switching to enable the third array to collect the third sound data.

[0203] In some embodiments, the third array is also a microphone array, and the third array includes a fifth microphone and a sixth microphone. In addition, there is an association between the third array and the first operation.

[0204] For example, the first operation is an operation in which the user selects the third array. In this way, there is an association between the first operation and the third array. In this example, the method further includes: displaying a first interface, where the position distribution of all microphones is displayed in the first interface. At this time, the user can click on the microphones in the first interface, and the selected microphones form the third array. That is, during the display of the first interface by the electronic device, it can detect the user's selection operation on the microphones in the first interface. Among them, when the user selects the fifth microphone and the sixth microphone, it is determined that the first operation is received.

[0205] For another example, the first operation is an operation of indicating a first direction. When there is a corresponding relationship between the indicated first direction and the third array in the foregoing corresponding relationship table b, the first operation is related to the third array.

[0206] In addition, when the first operation is an operation indicating a first direction, the above-mentioned first operation may be an operation in which the user slides on the display screen of the electronic device, and the sliding direction of this operation may be the first direction.

[0207] When the first operation is an operation indicating a first direction, the above-mentioned first operation may also be an operation in which the user selects a position point on the display screen, and the first direction is the direction corresponding to the selected position point.

[0208] For example, the electronic device may display a second interface, which is an application interface of a conference service application, and the second interface includes a location distribution map of participants. When it is detected that the user selects a first participant in the second interface and the direction between the first participant and the user is the first direction, it is determined that the first operation is received.

[0209] In addition, the method of starting the third array may refer to the method of starting the first array or the second array mentioned in the foregoing embodiments, which will not be elaborated here. After the third array is enabled, the sound data collected by the microphones in the third array can be collectively referred to as the third sound data.

[0210] In some other embodiments, the above method further includes:

[0211] S5, detecting the establishment of a communication connection with a stylus.

[0212] S6, switching to enable the fourth array to collect fourth sound data.

[0213] Among them, the above-mentioned fourth array is also a microphone array. The difference is that the fourth array includes a microphone of the stylus. Of course, it may also include a microphone configured by the electronic device itself, such as the seventh microphone. In this way, multiple devices can coordinate to pick up sound and improve the sound pickup effect.

[0214] In addition, the method of starting the fourth array may refer to the method of starting the first array or the second array mentioned in the foregoing embodiments, which will not be elaborated here. After the fourth array is enabled, the sound data collected by the microphones in the fourth array can be collectively referred to as the fourth sound data.

[0215] In other embodiments, a first model is configured in the electronic device. The first model is a machine learning model for identifying a matching microphone array. The method further includes: obtaining current scene information, where the scene information includes one or more combinations of system time, location, device power, and pose information; inputting the current scene information into the first model to determine a fifth array; enabling the fifth array to collect fifth sound data.

[0216] In addition, the method for starting the fifth array can refer to the method for starting the first array or the second array mentioned in the foregoing embodiments, which will not be elaborated herein. After the fifth array is enabled, the sound data collected by the microphones in the fifth array can be collectively referred to as the fifth sound data.

[0217] An embodiment of the present application further provides an electronic device, which may include: a memory and one or more processors. The memory is coupled to the processor. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can execute the steps in the foregoing embodiments. Of course, the electronic device includes, but is not limited to, the foregoing memory and one or more processors.

[0218] An embodiment of the present application further provides a chip system, which can be applied to the terminal device in the foregoing embodiments. As Figure 14 shown, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 may be the processor in the foregoing electronic device. The processor 2201 and the interface circuit 2202 can be interconnected through a line. The processor 2201 can receive and execute computer instructions from the memory of the foregoing electronic device through the interface circuit 2202. When the computer instructions are executed by the processor 2201, the electronic device can execute the steps in the foregoing embodiments. Of course, the chip system may further include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0219] In some embodiments, through the description of the foregoing embodiments, those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the division of the foregoing functional modules is used as an example for illustration. In actual applications, the above functions can be allocated to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, which will not be elaborated herein.

[0220] In each embodiment of the embodiments of the present application, the functional units may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0221] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk, or optical disc.

[0222] As described above, the above is only the specific implementation manner of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of the present application should be covered by the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.

Claims

1. A microphone control method, characterized in that, Applied to an electronic device, the electronic device includes a digital coder-decoder, a plurality of microphones, a first analog-to-digital converter (ADC) and a second ADC. The digital coder-decoder is connected to the first ADC and the second ADC, and the first ADC is connected to the plurality of microphones, and the second ADC is connected to one or more of the microphones; the method includes: When the electronic device is in a first pose, determine a first microphone array according to the first pose, establish connections between the microphones in the first microphone array and the corresponding ADCs, and collect first sound data based on the first microphone array; wherein, the first microphone array includes a plurality of microphones connected to the first ADC and / or the second ADC; When the electronic device is in a second pose, determine a second microphone array according to the second pose, establish connections between the microphones in the second microphone array and the corresponding ADCs, and collect second sound data based on the second microphone array; wherein, the first pose is different from the second pose; the second microphone array includes a plurality of microphones connected to the first ADC and / or the second ADC, and the microphones in the second microphone array are not all the same or completely different from the microphones in the first microphone array.

2. The method according to claim 1, characterized in that, Before collecting the second sound data based on the second microphone array, the method further includes: Disconnect the connections between the microphones in the first microphone array and the corresponding ADCs.

3. The method according to claim 1, wherein Before determining the first microphone array according to the first pose, the method further includes: Collect first pose information, and the first pose information indicates that the electronic device is in the first pose; Before determining the second microphone array according to the second pose, the method further includes: Collect second pose information, and the second pose information indicates that the electronic device is in the second pose.

4. The method according to any one of claims 1 to 3, characterized in that The number of the first ADCs is one or more, and the number of the second ADCs is one or more.

5. The method according to claim 4, wherein The plurality of microphones include a first microphone, a second microphone, a third microphone and a fourth microphone. The number of the first ADC and the second ADC is one respectively. The first ADC is connected to the first microphone and the third microphone, and the second ADC is connected to the second microphone and the fourth microphone; When the electronic device is in the first pose, determine a first microphone array according to the first pose, establish connections between the microphones in the first microphone array and the corresponding ADCs, and collect first sound data based on the first microphone array, includes: Determine a first microphone array composed of the first microphone and the second microphone according to the first pose, establish the connection between the first microphone and the first ADC, and the connection between the second microphone and the second ADC, and collect the first sound data based on the first microphone array; When the electronic device is in the second pose, determining a second microphone array according to the second pose, establishing connections between the microphones in the second microphone array and corresponding ADCs, and collecting second sound data based on the second microphone array, includes: Determining a second microphone array composed of the third microphone and the fourth microphone according to the second pose, establishing a connection between the third microphone and the first ADC, and a connection between the fourth microphone and the second ADC, and collecting the second sound data based on the second microphone array.

6. The method according to claim 1, characterized in that, The electronic device further includes a first bias circuit corresponding to the first ADC and a second bias circuit corresponding to the second ADC; The establishing connections between the microphones in the first microphone array and corresponding ADCs includes: Establishing connections between the microphones and corresponding ADCs through bias circuits corresponding to the microphones in the first microphone array, where the bias circuits corresponding to the microphones in the first microphone array are the first bias circuit and / or the second bias circuit; The establishing connections between the microphones in the second microphone array and corresponding ADCs includes: Establishing connections between the microphones and corresponding ADCs through bias circuits corresponding to the microphones in the second microphone array, where the bias circuits corresponding to the microphones in the second microphone array are the first bias circuit and / or the second bias circuit.

7. The method according to claim 1 or 5, characterized in that, Before determining the first microphone array according to the first pose and before determining the second microphone array according to the second pose, the method further includes: Displaying a first interface, where a distribution example diagram of each of the microphones is shown in the first interface; Responding to a user's selection operation, determining a commonly used microphone, and adding a common label to the microphone array that contains the largest number of the commonly used microphones among multiple microphone arrays corresponding to the same pose.

8. The method according to claim 7, wherein The determining the first microphone array according to the first pose includes: Displaying a second interface, where multiple microphone arrays corresponding to the first pose are shown in the second interface, where among the multiple microphone arrays corresponding to the first pose, there is a microphone array with the common label; Responding to a triggering operation by the user on the microphone array with the common label, determining the microphone array with the common label as the first microphone array; The determining the second microphone array according to the second pose includes: Displaying a third interface, where multiple microphone arrays corresponding to the second pose are shown in the third interface, where among the multiple microphone arrays corresponding to the second pose, there is a microphone array with the common label; Responding to a triggering operation by the user on the microphone array with the common label, determining the microphone array with the common label as the second microphone array.

9. The method according to claim 8, characterized in that The method further includes: When there is an occluded microphone in the first microphone array, re-determining the first microphone array from among the multiple microphone arrays corresponding to the first pose; and / or When there is an occluded microphone in the second microphone array, re-determine the second microphone array from the multiple microphone arrays corresponding to the second pose.

10. The method according to claim 1 or 5, characterized in that, When collecting second sound data based on the second microphone array, the method further includes: Continuing to collect pose information, and determining the current pose according to the pose information; Determining a third microphone array according to the current pose, establishing connections between the microphones in the third microphone array and the corresponding ADCs, and collecting third sound data based on the third microphone array; wherein, the current pose is different from the second pose; the third microphone array includes multiple microphones connected to the first ADC and / or the second ADC, and the microphones included in the third microphone array are not all the same or completely different from the microphones included in the second microphone array.

11. An electronic device, characterized in that, An electronic device includes one or more processors and a memory; the memory is coupled to the processor, and the memory is used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the one or more processors are used to execute the method according to any one of claims 1-10.

12. A computer storage medium, characterized in that, Including computer instructions, when the computer instructions run on an electronic device, the electronic device is caused to execute the method according to any one of claims 1-10.

13. A computer program product, characterized in that, The computer program product includes a computer program, and when it runs on a computer, the computer is caused to execute the method according to any one of claims 1-10.

Images