Sound pickup method and electronic device

Abstract

Provided in the present application are a sound pickup method and an electronic device. The method comprises: when the sound of at least one sound source is collected by means of a microphone, displaying a first interface, wherein the first interface comprises a first control and at least one second control, the first control indicates an electronic device, the second control indicates the sound source, the display modes of different second controls are different, and the display position of the second control indicates the orientation of the corresponding sound source relative to the electronic device. By using the present application, a user can visually view information of a sound source in at least one direction detected by an electronic device, thereby improving the availability of a sound pickup function and enhancing the user experience.

Description

Sound pickup method and electronic equipment

[0001] This application claims priority to the Chinese patent application with application number 202410226671.3 filed with the State Intellectual Property Office of China on February 28, 2024, and priority to the Chinese patent application with the invention name “A sound pickup method and electronic device”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a sound pickup method and electronic equipment. Background Art

[0003] In recent years, with the development of audio and video acquisition and processing technology of electronic devices, in sound pickup scenarios, multiple microphones in electronic devices can detect and record sounds to obtain recorded audio, but users cannot perceive the information of the sound source in any direction (such as the direction of the sound source, decibel, etc.), the sound pickup function is limited, and the user experience is poor. Summary of the Invention

[0004] The present application discloses a sound pickup method and an electronic device, which enable a user to intuitively view information about a sound source in at least one direction detected by the electronic device, thereby improving the usability of the sound pickup function and enhancing the user experience.

[0005] In a first aspect, an embodiment of the present application provides a sound pickup method, which is applied to an electronic device, the method comprising: when collecting sound from at least one sound source through a microphone, displaying a first interface, the first interface comprising a first control and at least one second control, the first control indicating the electronic device, the second control indicating the sound source, different second controls having different display modes, and the display position of the second control indicating the corresponding position of the sound source relative to the electronic device; receiving a first operation on the first interface; in response to the first operation, displaying a second interface, the second interface comprising the first control and the at least one second control, the third control in the at least one second control being an editable control, the third control being any one of the at least one second controls; receiving a second operation on the third control in the second interface; and in response to the second operation, adjusting the sound pickup parameters of the electronic device for the first sound source corresponding to the third control.

[0006] In the above method, in a sound pickup scenario, the electronic device can act as a recording device, detecting sound sources in various directions centered on the electronic device through a microphone, and displaying at least one sound zone (i.e., the second control) on a sound source detection interface (i.e., the first interface). The sound zone represents information about the sound source, for example, the display position of the sound zone indicates the position of the corresponding sound source relative to the electronic device, wherein a second control (sound zone) can indicate one or more sound sources. Then, the electronic device can display a sound zone editing interface (i.e., the second interface) in response to the first operation, and edit any sound zone in the second interface in response to the second operation to adjust the sound pickup parameters of the first sound source corresponding to the sound zone. By visually displaying information about sound sources in multiple directions detected by the electronic device on a display screen, the user can intuitively view the status of the sound sources in the surrounding environment. The user can adjust the sound pickup parameters of the sound sources corresponding to the sound zone in a timely manner through the electronic device, so that the electronic device records the sound sources in the environment according to the adjusted sound pickup parameters and outputs the audio desired by the user, thereby improving the user experience.

[0007] In a possible implementation, the first interface includes a circle, the circle includes at least one sector, the center point of the sector is the center of the circle, the first control is the center of the circle, and the second control is the sector.

[0008] In a possible implementation, the size of the central angle of the second control indicates the range of the electronic device recording the corresponding sound source.

[0009] In the above method, a circle can be used to represent the sound pickup plane, the center of the circle can be used to represent the position of the electronic device in space, and a sector can be used to represent the sound source detected by the electronic device. The central angle of the sector can represent the range of the microphone recording the corresponding sound source (i.e., the sound pickup range). Different graphic display methods (such as the shape, color, angle, display position, etc. of the graphic) can vividly represent the information of the sound source detected by the electronic device, making it convenient for users to intuitively view the status of the sound source in the surrounding environment, improving the comprehensibility of the information, and thus improving the user experience.

[0010] In one possible implementation, the first interface includes first information corresponding to the second control, the first information includes information about the sound source corresponding to the second control, the information about the sound source includes the orientation of the sound source relative to the electronic device, the energy of the sound source, and the type of the sound source.

[0011] In the above method, the first interface may also include information about the sound source corresponding to the sound zone, such as the specific numerical value of the sound source's position relative to the electronic device, the specific numerical value of the sound source's energy, and the type of sound source. The use of text descriptions and specific numerical values ​​further enhances the comprehensibility of the information, thereby improving the user experience.

[0012] In one possible implementation, the fourth control in the first interface is displayed in a first manner, the fourth control indicates a second sound source among the at least one sound source, the first manner indicates that the second sound source is in a first state, and the fourth control is any one of the at least one second controls; the method further includes: when it is detected that the state of the second sound source changes from the first state to the second state, displaying a third interface, the fourth control in the third interface is displayed in a second manner, and the second manner indicates that the second sound source is in the second state.

[0013] In the above method, when the state of the sound source changes, the display mode of the sound zone corresponding to the sound source will also change accordingly. For example, when the sound source moves, the display position of the sound zone corresponding to the sound source will also change, so that users can intuitively view the real-time status of the sound source and improve the user experience.

[0014] In a possible implementation method, the adjusting of the pickup parameters of the electronic device for the first sound source corresponding to the third control includes: when the second operation is a user operation on the display position of the third control, adjusting the direction in which the electronic device records the first sound source; when the second operation is a user operation on the size of the central angle of the third control, adjusting the range in which the electronic device records the first sound source; when the second operation is an enhancement value for the third control, adjusting the enhancement value of the energy of the first sound source by the electronic device; when the second operation is a suppression value for the third control, adjusting the suppression value of the energy of the first sound source by the electronic device.

[0015] In the above method, the electronic device can adjust different sound pickup parameters of the microphone for recording the first sound source based on different user operations, such as adjusting the direction of the microphone recording the sound source (i.e., the direction of sound pickup), the range of the sound source recording (i.e., the sound pickup range), and the enhancement / suppression value of the sound source energy (i.e., the degree of enhancement / suppression of the sound source energy, which can be understood as adjusting the volume of the sound). The user can adjust the microphone pickup parameters through the electronic device in a timely manner so that the electronic device records the sound source according to the adjusted sound pickup parameters, so that the recorded sound can meet the different needs of the user and improve the user experience.

[0016] In a possible implementation method, before receiving the second operation on the third control in the second interface, the method further includes: recording the first sound source corresponding to the third control according to the first sound pickup parameter; adjusting the sound pickup parameter of the electronic device for the first sound source corresponding to the third control includes: adjusting the first sound pickup parameter to a second sound pickup parameter; the method further includes: recording the first sound source corresponding to the third control according to the second sound pickup parameter.

[0017] In the above method, before the user edits the sound zone, the electronic device can record the sound source corresponding to the sound zone according to the preset parameters (i.e., the first sound pickup parameters). After the user edits the sound zone, the sound pickup parameters change, i.e., from the first sound pickup parameters to the second sound pickup parameters. The electronic device then records the sound source corresponding to the sound zone according to the changed sound pickup parameters (i.e., the second sound pickup parameters). By editing the sound zone, the user can adjust the microphone's sound pickup parameters. The adjusted sound pickup parameters better meet the user's needs, thereby improving the user experience.

[0018] In one possible implementation, the method further includes: displaying a fourth interface in response to the second operation, when the second operation is a user operation on the display position of the third control, the orientation of the first sound source corresponding to the third control in the fourth interface relative to the electronic device is different from the orientation of the first sound source corresponding to the third control in the second interface relative to the electronic device; when the second operation is a user operation on the size of the central angle of the third control, the range of the electronic device corresponding to the third control in the fourth interface recording the first sound source is different from the range of the electronic device corresponding to the third control in the second interface recording the first sound source; when the second operation is a user operation on the enhancement value or suppression value of the third control, the energy of the first sound source corresponding to the third control in the fourth interface is different from the energy of the first sound source corresponding to the third control in the second interface.

[0019] In the above method, after the user edits the sound zone, the sound source information on the edited interface (i.e., the fourth interface) also changes accordingly, making it convenient for the user to view the latest edited sound source information in a timely manner, improving the efficiency of the user in obtaining information and enhancing the user experience.

[0020] In one possible implementation, after displaying the second interface, the method further includes: receiving a third operation on the third control in the second interface; in response to the third operation, deleting the third control and displaying a fifth interface, wherein the fifth interface does not include the third control.

[0021] In a possible implementation, the method further includes: in response to the third operation, deleting the first sound source corresponding to the third control recorded by the electronic device.

[0022] In the above method, the electronic device can respond to the third operation by deleting the sound zone, causing the electronic device to remove the microphone from recording the sound source corresponding to the sound zone. This can be understood as the user directly canceling the electronic device's recording of the sound source in a certain direction. This method can facilitate users to delete unnecessary sound sources, such as interfering noise, and output the user's desired audio, thereby improving the user experience.

[0023] In one possible implementation, after displaying the second interface, the method further includes: receiving a fourth operation for the first area in the second interface; in response to the fourth operation, adding a fifth control in the first area and displaying a sixth interface, the sixth interface including the fifth control, and the display position of the fifth control is the same as the display position of the first area.

[0024] In a possible implementation, the method further includes: in response to the fourth operation, recording the sound source corresponding to the fifth control according to a preset range of the electronic device for recording sound sources.

[0025] In the above method, when the fourth operation is a user operation for adding a sound zone, the electronic device can respond to the fourth operation by adding a new sound zone, so that the electronic device controls the microphone to record the sound source in the direction indicated by the newly added sound zone according to the preset sound pickup range. It can be understood that when a sound source is added in a certain direction, the user can manually add a sound zone corresponding to the direction so that the microphone can record the sound source in the direction. This avoids the situation where the electronic device fails to recognize the newly added sound source in time, resulting in the sound source not being recorded, ensuring the comprehensiveness of the recorded sound sources and improving the user experience.

[0026] In a second aspect, the present application provides an electronic device, including a transceiver, a processor and a memory, wherein the memory is used to store a computer program, and the processor calls the computer program to execute the sound pickup method in any possible implementation of the first aspect.

[0027] In a third aspect, the present application provides an electronic device comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are configured to store computer program code, the computer program code comprising computer instructions. When the one or more processors execute the computer instructions, the electronic device performs the sound pickup method of any possible implementation of the first aspect.

[0028] In a fourth aspect, the present application provides a computer storage medium storing a computer program. When the computer program is executed by a processor, the sound pickup method in any possible implementation of any of the above aspects is implemented.

[0029] In a fifth aspect, the present application provides a computer program product, which, when running on an electronic device, enables the electronic device to execute the sound pickup method in any possible implementation of the first aspect.

[0030] In a sixth aspect, the present application provides an electronic device, the electronic device including a method or apparatus for executing any one of the implementations of the first aspect of the present application. The electronic device is, for example, a chip. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The following is an introduction to the drawings used in this application.

[0032] FIG1 is a schematic diagram of a sound pickup scene 10 provided by the present application;

[0033] FIG2 is a schematic diagram of the hardware structure of an electronic device 100 provided in this application;

[0034] FIG3 is a schematic diagram of a software architecture of an electronic device 100 provided in this application;

[0035] Figures 4 to 9 are schematic diagrams of some user interfaces provided by this application;

[0036] FIG10 is a flow chart of a sound pickup method provided in the present application. DETAILED DESCRIPTION

[0037] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents or, for example, A / B can represent A or B; "and / or" in the text is merely a description of the association relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" refers to two or more than two.

[0038] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0039] An embodiment of the present application provides a sound pickup method, which is applied to an electronic device. The electronic device may include multiple microphones, and the positions of these multiple microphones are not on the same straight line (i.e., not collinear). In a sound pickup scenario, the electronic device can be used as a recording device to detect sound sources in various directions centered on the electronic device, and display at least one sound zone on the sound source detection interface, and the sound zone represents information about the sound source. The information about the sound source may include information such as the direction, energy, and type of the sound source. In one embodiment, the electronic device can edit any sound zone in the sound zone editing interface in response to user operations, such as adjusting the direction of the sound zone, adjusting the size of the sound zone, adjusting the degree of enhancement or suppression of the sound zone, etc. By editing the sound zone, control of the sound pickup of multiple microphones (i.e., adjusting the sound pickup parameters of multiple microphones) can be achieved, such as adjusting the direction, range, and degree of enhancement / suppression of the energy of the sound source in any direction of the microphone pickup (which can be understood as adjusting the size of the sound). By visually displaying information about sound sources in multiple directions detected by the electronic device on a display screen, the user can intuitively view the status of the sound sources in the surrounding environment. Moreover, when the status of the sound source changes, such as when the sound source moves, the user can promptly adjust the pickup parameters of multiple microphones through the electronic device, so that the electronic device records the sound source in the environment according to the adjusted pickup parameters and outputs the audio expected by the user, thereby improving the user experience.

[0040] In the present application, electronic devices may include, but are not limited to, mobile phones, tablet computers, handheld computers, desktop computers, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, cellular phones, personal digital assistants (PDAs), smart home devices such as smart TVs and smart cameras, wearable devices such as smart bracelets, smart watches, and smart glasses, extended reality (XR) devices such as augmented reality (AR), virtual reality (VR), and mixed reality (MR), in-vehicle devices, or smart city devices. The embodiments of the present application do not impose any special restrictions on the specific types of electronic devices.

[0041] Next, a sound pickup scenario involved in an embodiment of the present application is introduced.

[0042] FIG1 exemplarily shows a schematic diagram of a sound pickup scene 10 .

[0043] As shown in FIG1(A), in the sound pickup scene 10, the electronic device 100 is placed flat on the table of the user 104. It is assumed that the user 101 is located at the orientation 1 of the electronic device 100, the user 102 is located at the orientation 2 of the electronic device 100, and the user 103 is located at the orientation 3 of the electronic device 100. The electronic device 100 can detect the sound sources in various directions of the center with the electronic device 100 as the center. The plane where the electronic device 100 is located can be called the sound pickup plane. For example, the electronic device 100 detects the sound source 1 at the orientation 1 of the electronic device 100, the sound source 2 at the orientation 2, and the sound source 3 at the orientation 3, and identifies the type of the sound source 1 as a human voice (i.e., the human voice of the user 101), the type of the sound source 2 as a human voice (i.e., the human voice of the user 102), and the type of the sound source 3 as a keyboard sound (i.e., the keyboard sound of the user 103). At this time, the electronic device 100 can display the information of the detected sound sources through the display screen. For specific examples, please refer to FIG1(B).

[0044] FIG1(B) is a schematic diagram showing a roulette wheel area in an exemplary display mode.

[0045] As shown in FIG1(B), the electronic device 100 may display a circle 111 (which may be referred to as a wheel area) on the display screen. The circle 111 may represent the sound pickup plane, and the center point 112 (i.e., the center of the circle) of the circle 111 may represent the position of the electronic device 100 in space. The circle 111 may include multiple sectors (which may be referred to as sound zones), such as sector 121, sector 123, and sector 125. The center points of these multiple sectors are the center of the circle 111 (i.e., center point 112). These multiple sectors are displayed in different ways (e.g., display position, color), and different sectors may represent different sound sources detected by the electronic device 100. Among them, sector 121 represents the aforementioned sound source 1, sector 123 represents the aforementioned sound source 2, and sector 125 represents the aforementioned sound source 3.

[0046] The display position of the sector in circle 111 can represent the orientation of the corresponding sound source. The following is an example of representing the display position of the sector by the angle between the center line of the sector and the reference line 130. As shown in (B) of Figure 1, circle 111 can be rotated 360 degrees clockwise from the reference line 130 (one end is the center point 112) as the starting point to return to the starting point (which can also be understood as the end point). The orientation of sector 121 corresponds to the angle α between the reference line 130 and the center line 122 (rotating clockwise from the reference line 130 at the starting point to the center line 122 at the end point). Angle α can represent the orientation 1 of sound source 1. The orientation of sector 123 corresponds to the angle β between the reference line 130 and the center line 124 (rotating clockwise from the reference line 130 at the starting point). Angle β can represent the orientation 2 of sound source 2. The orientation of sector 125 corresponds to the angle γ between the reference line 130 and the center line 126. Angle γ can represent the orientation 3 of sound source 3.

[0047] The central angle of the sector in circle 111 can represent the range of the corresponding sound source recorded by the microphone (which can be called the pickup range). As shown in Figure 1 (B), the angle θ1 of the central angle of sector 121 can represent the pickup range 1 of sound source 1, the angle θ2 of the central angle of sector 123 can represent the pickup range 2 of sound source 2, and the angle θ3 of the central angle of sector 125 can represent the pickup range 3 of sound source 3. Among them, the angle interval of the pickup range 1 corresponding to the angle θ1 within the pickup plane is [α-θ1 / 2, α+θ1 / 2], the angle interval of the pickup range 2 corresponding to the angle θ2 within the pickup plane is [β-θ1 / 2, β+θ1 / 2], and the angle interval of the pickup range 3 corresponding to the angle θ3 within the pickup plane is [γ-θ1 / 2, γ+θ1 / 2]. It can be understood that the electronic device 100 can record the sound of the sound source within the pickup range. Due to the characteristics of sound waves during propagation, sounds around the boundaries of the pickup range may also be recorded by the electronic device 100. For example, any sound source has a straight path that can be directly transmitted to the microphone. Due to the multipath propagation of sound waves, there will also be multiple reflection paths. The electronic device 100 can record all paths within the pickup range, and can also record the part where the sum of the energy of all reflection paths outside the pickup range is less than the sum of the energy of all paths (including straight paths and reflection paths) within the pickup range by a preset threshold (for example, 6dB).

[0048] The roulette area may be a closed figure / closed figure of any shape. Optionally, the roulette area is a planar closed figure, such as a triangle, circle, rectangle, parallelogram, sector, star, heart, etc.

[0049] Next, the structure of an exemplary electronic device provided by an embodiment of the present application is introduced.

[0050] FIG2 exemplarily shows a schematic diagram of the hardware structure of an electronic device 100 .

[0051] As shown in Figure 2, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0052] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0053] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0054] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0055] Processor 110 may also include a memory for storing instructions and data. In one embodiment, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0056] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In another embodiment, the power management module 141 can also be set in the processor 110. In another embodiment, the power management module 141 and the charging management module 140 can also be set in the same device.

[0057] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0058] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In another embodiment, the antenna can be used in conjunction with a tuning switch.

[0059] The mobile communication module 150 can provide wireless communication solutions for the electronic device 100, including second generation (2G), third generation (3G), fourth generation (4G), fifth generation (5G), and sixth generation (6G). The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1. In one embodiment, at least some of the functional modules of the mobile communication module 150 can be located in the processor 110. In another embodiment, at least some of the functional modules of the mobile communication module 150 and at least some of the modules of the processor 110 can be located in the same device.

[0060] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In one embodiment, the modem processor may be an independent device. In another embodiment, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0061] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0062] In one embodiment, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0063] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0064] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In one embodiment, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0065] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0066] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and color. It can also optimize parameters such as exposure and color temperature of the captured scene. In one embodiment, the ISP can be located within camera 193.

[0067] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In one embodiment, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0068] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0069] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0070] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0071] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals.

[0072] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0073] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0074] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. In one embodiment, the electronic device 100 can be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, and implement directional recording functions. In one embodiment, the positions of the multiple microphones 170C are not on the same straight line (i.e., not collinear) to detect sound sources in different directions. In one embodiment, the multiple microphones 170C can be distributed in different directions of the electronic device 100, for example, microphones 170C are provided on the sides of each direction of the mobile phone to detect sound sources in different directions. In one embodiment, the electronic device 100 can adjust the pickup parameters of the microphone 170C when recording the sound source in the surrounding environment in response to user operations, such as the direction, range, enhancement / suppression degree, etc. of the sound picked up by the microphone 170C.

[0075] The headphone jack 170D is used to connect a wired headphone.

[0076] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In one embodiment, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates with conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In one embodiment, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0077] The gyro sensor 180B may be used to determine the motion posture of the electronic device 100. In one embodiment, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor 180B.

[0078] The air pressure sensor 180C is used to measure air pressure.

[0079] The magnetic sensor 180D includes a Hall sensor, and the electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case.

[0080] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes).

[0081] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In one embodiment, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0082] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.

[0083] The ambient light sensor 180L is used to sense the brightness of the ambient light.

[0084] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0085] The temperature sensor 180J is used to detect temperature.

[0086] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0087] The bone conduction sensor 180M can acquire vibration signals.

[0088] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0089] The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect a SIM card.

[0090] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. For example, the software system with a layered architecture can be an Android system, a Harmony operating system (OS), or other software systems. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.

[0091] FIG3 exemplarily shows a schematic diagram of a software architecture of an electronic device 100 .

[0092] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In one embodiment, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0093] The application layer can include a series of application packages.

[0094] As shown in Figure 3, the application package may include applications such as camera, gallery, music, calendar, short message, call, navigation, Bluetooth, browser, and screen projection.

[0095] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0096] As shown in FIG3 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0097] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0098] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0099] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0100] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0101] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0102] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0103] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0104] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0105] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0106] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0107] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0108] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0109] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0110] A 2D graphics engine is a drawing engine for 2D drawings.

[0111] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0112] The following describes the workflow of the software and hardware of the electronic device 100 in conjunction with a sound pickup scenario.

[0113] The schematic diagram of the wheel area shown in FIG1(B) is used as an example for explanation. When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, a timestamp of the touch operation, and other information), which is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and determines the position of the adjusted sector 121 based on the raw input event. The electronic device 100 calls the interface of the application framework layer, and then controls the display driver by calling the kernel layer, and displays the adjusted position of the sector 121 on the display screen 194.

[0114] The following describes an application scenario involved in an embodiment of the present application and a user interface diagram for the scenario.

[0115] For the convenience of explanation, the roulette area in the user interface of the following example is described using the display method shown in FIG1(B) as an example.

[0116] FIG4 exemplarily shows a schematic diagram of a user interface.

[0117] As shown in (A) of FIG4 , the electronic device 100 may display a user interface 410. The user interface 410 may be a sound source detection interface. For example, the user interface 410 may be an interface displayed after the electronic device 100 turns on the directional sound pickup function in a sound pickup scenario. In some examples, in a call scenario, the electronic device 100 may display the user interface 410 in response to a user operation on a control for the sound pickup function in the call interface. In other examples, in a recording scenario, the electronic device 100 may display the user interface 410 in response to a user operation on a control for the sound pickup function in the recording interface. In other examples, in a speech transcription scenario, the electronic device 100 may display the user interface 410 in response to a user operation on a control for the sound pickup function in the speech transcription interface.

[0118] As shown in FIG4(A), user interface 410 may include a wheel area 411, which may represent a sound pickup plane. The center of wheel area 411 includes an icon 415, which may indicate electronic device 100, such as the position of electronic device 100 in space. Wheel area 411 may include multiple sound zones, any of which may represent information about a sound source currently detected by electronic device 100. For example, these multiple sound zones include sound zone 412, sound zone 413, and sound zone 414. These three sound zones are displayed in different positions to represent different sound sources at different locations. Sound zone 412 may represent sound source 1 located at location 1 relative to electronic device 100, sound zone 413 may represent sound source 2 located at location 2 relative to electronic device 100, and sound zone 414 may represent sound source 3 located at location 3 relative to electronic device 100. The characters "Voice 1" and "54dB" are displayed next to sound zone 412, indicating that the type of sound source 1 is a human voice and the energy of sound source 1 is 54 decibels (dB). The characters "Voice 2" and "62dB" are displayed next to sound zone 413, indicating that the type of sound source 2 is a human voice, and the characters "62dB" indicate that the energy of sound source 2 is 62dB. The characters "Keyboard sound" and "35dB" are displayed next to sound zone 414, indicating that the type of sound source 3 is a keyboard sound and the energy of sound source 3 is 35dB.

[0119] As shown in FIG4(A), electronic device 100 can indicate the direction of the corresponding sound source by the angle between the centerline of the sound zone and a reference line (not shown in FIG4(A)). The wheel zone 411 can rotate 360 ​​degrees clockwise from the reference line as a starting point to return to the starting point. The reference line is, for example, a line connecting the true north direction of the wheel zone 411 and the center point of the wheel zone 411. For example, the angle between the centerline of the sound zone 412 and the reference line (e.g., 25 degrees) can indicate the direction of the sound zone 412, i.e., direction 1 of sound source 1 is 25 degrees. The angle between the centerline of the sound zone 413 and the reference line (e.g., 75 degrees) can indicate the direction of the sound zone 413, i.e., direction 2 of sound source 2 is 75 degrees. The angle between the centerline of the sound zone 414 and the reference line (e.g., 300 degrees) can indicate the direction of the sound zone 414, i.e., direction 3 of sound source 3 is 300 degrees.

[0120] As shown in FIG4(A), the electronic device 100 can indicate the pickup range of the corresponding sound source by the angle of the central angle of the sound zone. For example, the angle of the central angle of sound zone 412 (e.g., 30 degrees) can indicate the pickup range 1 of sound source 1, and the angle range of pickup range 1 within the wheel zone 411 is [10, 40]. The angle of the central angle of sound zone 413 (e.g., 30 degrees) can indicate the pickup range 2 of sound source 2, and the angle range of pickup range 2 within the wheel zone 411 is [60, 90]. The angle of the central angle of sound zone 414 (e.g., 30 degrees) can indicate the pickup range 3 of sound source 3, and the angle range of pickup range 3 within the wheel zone 411 is [285, 315].

[0121] In one embodiment, the electronic device 100 can display an editing interface for a sound zone in response to a user operation (the user operation is, for example, a touch operation, and the touch operation is, for example, a long press operation) on any sound zone in the user interface 410 (for example, sound zone 412). For a specific example, see the user interface 420 shown in (B) of Figure 4.

[0122] As shown in (B) of Figure 4, user interface 420 is similar to user interface 410 shown in (A) of Figure 4, except that the sound zone 412 in user interface 420 is in an editable state. User interface 420 also includes window 421, which can indicate information about the sound source 1 corresponding to the sound zone 412. Window 421 includes text content 422, text content 423, text content 424 and text content 425. Text content 422 includes characters "human voice 1", which can indicate that the type of sound source 1 corresponding to the sound zone 412 is human voice. Text content 423 includes characters "energy: 54dB", which can indicate that the energy of the sound source 1 corresponding to the sound zone 412 is 54dB. Text content 424 includes characters "azimuth: 25 degrees", which can indicate that the azimuth of the sound source 1 corresponding to the sound zone 412 is 25 degrees. Text content 425 includes characters "pickup range: 30 degrees", which can indicate that the pickup range of the sound source 1 corresponding to the sound zone 412 is 30 degrees.

[0123] In one embodiment, the electronic device 100 can choose to enhance or suppress the energy of the sound source 1 of the sound zone 412 in response to a user operation on the sound zone 412 in the user interface 420 (the user operation is, for example, a touch operation, and the touch operation is, for example, a double-click operation). At this time, the electronic device 100 can display the user interface 430 shown in (C) of Figure 4.

[0124] As shown in FIG4(C), user interface 430 is similar to user interface 420 shown in FIG4(B), except that user interface 430 includes prompt information 431, which displays the characters "Please select whether to enhance or suppress vocals 1 in sound zone 1." Prompt information 431 includes controls 432 and 433. Control 432 can be used to enhance the energy of sound source 1 in sound zone 412, and control 433 can be used to suppress the energy of sound source 1 in sound zone 412. In one embodiment, electronic device 100 can enhance the energy of sound source 1 in sound zone 412 in response to a user operation on control 432 (e.g., a touch operation). At this time, electronic device 100 can display user interface 440 shown in FIG4(D).

[0125] As shown in (D) of Figure 4, the user interface 440 is similar to the user interface 420 shown in (B) of Figure 4, except that the user interface 440 includes text content 442 and a control bar 443 (including a sliding control 4431), and the text content 442 includes the characters "Sound Enhancement Zone 1", which can indicate that the zone in which the energy of the sound source is currently enhanced is the zone 412, and the control bar 443 and the sliding control 4431 can be used to adjust the degree of enhancement of the zone 412, wherein the control bar 443 can indicate that the degree of enhancement of the zone 412 is in the range of [0%, 100%], and the degree of enhancement of the zone 412 can be adjusted by sliding the sliding control 4431 on the control bar 443 left and right. For example, when the sliding control 4431 is located in the middle position of the control bar 443, the characters "50%" can be displayed above the control bar 443, which can indicate that the degree of enhancement of the current zone 412 is 50%. The characters "81dB" displayed next to the sound zone 412 in the user interface 440 and the characters "Energy: 81dB" included in the text content 441 can both indicate that the energy of the sound source 1 after the sound zone 412 is enhanced is 81dB. The user interface 440 also includes controls 444 and 445. The control 444 includes the characters "Follow" and can be used to turn on or off the dynamic following function of the sound source 1 in the sound zone 412. The control 445 (displayed with the characters "ON") can indicate that the dynamic following function of the sound source 1 in the sound zone 412 is currently turned on. The dynamic following function of the sound source 1 is used by the electronic device 100 to automatically adjust the pickup parameters of multiple microphones according to the status of the sound source 1, such as automatically adjusting the orientation of the sound zone 412, the degree of enhancement or suppression of the sound zone 412, etc., which can be understood as automatically editing the sound zone 412.

[0126] The enhancement degree of the sound zone 412 is not limited to the above example and is represented by a percentage value. In other examples, it can also be directly represented by an energy value. For example, the control bar 443 can represent that the enhancement degree of the sound zone 412 is in the range of [0dB, 54dB]. When the sliding control 4431 is located in the middle position of the control bar 443, the characters "27dB" can be displayed above the control bar 443, which can represent that the enhancement degree of the current sound zone 412 is 27dB.

[0127] In one embodiment, after the embodiment shown in FIG4(D), when the state of sound source 1 changes, for example, when sound source 1 moves, that is, when the position of sound source 1 changes, electronic device 100 can update the sound source information on the display screen in real time based on the enabled sound source dynamic tracking function, such as adjusting the position of the sound zone in real time. In some examples, after the sound source 1 moves, electronic device 100 can display user interface 510 shown in FIG5(A).

[0128] As shown in (A) of Figure 5, the user interface 510 is similar to the user interface 440 shown in (D) of Figure 4, except that the display position of the sound zone 511 in the user interface 510 is different from the display position of the sound zone 412 in the user interface 440, that is, the orientations of the sound zone 511 and the sound zone 412 are different, and the text content 512 in the user interface 510 includes the characters "orientation 15 degrees", which can indicate that the orientation of the sound source 1 corresponding to the sound zone 511 is 15 degrees.

[0129] In one embodiment, after the embodiment shown in FIG4(B), the electronic device 100 may receive a user operation and, in response to the user operation, adjust the orientation of any editable audio zone to adjust the direction of the microphone pickup. In some examples, the electronic device 100 may receive a user operation (e.g., a right-to-left sliding operation) on the audio zone 412 in the user interface 420 shown in FIG5(B). In response to the user operation, the electronic device 100 may adjust the orientation of the audio zone 412. At this time, the electronic device 100 may display the user interface 520 shown in FIG5(C).

[0130] As shown in (C) of Figure 5, the user interface 520 is similar to the user interface 420 shown in (B) of Figure 5, except that the display position of the sound zone 521 in the user interface 520 is different from the display position of the sound zone 412 in the user interface 420, that is, the orientations of the sound zone 521 and the sound zone 412 are different, and the text content 522 in the user interface 520 includes the characters "Orientation: 0 degrees", which can indicate that the orientation of the sound source 1 corresponding to the sound zone 521 is 0 degrees.

[0131] In one embodiment, after the embodiment shown in FIG4(B), the electronic device 100 may receive a user operation and, in response to the user operation, adjust the size of the central angle of any editable sound zone to adjust the range of the microphone pickup. In some examples, the electronic device 100 may receive a user operation (for example, a two-finger pinch operation) on the sound zone 412 in the user interface 420 shown in FIG6(A). In response to the user operation, the electronic device 100 may adjust the size of the central angle of the sound zone 412. At this time, the electronic device 100 may display the user interface 610 shown in FIG6(B).

[0132] As shown in (B) of Figure 6 , the user interface 610 is similar to the user interface 420 shown in (A) of Figure 5 , with the difference being that the central angle of the sound zone 611 in the user interface 610 is different from the central angle of the sound zone 412 in the user interface 420, and the text content 612 in the user interface 610 includes the characters “pickup range: 50 degrees”, which indicates that the pickup range of the sound source 1 corresponding to the sound zone 611 is 50 degrees, and the angle interval of the pickup range within the wheel area is [0,50].

[0133] In one embodiment, after the embodiment shown in FIG4(B), the electronic device 100 may receive a user operation and, in response to the user operation, delete any editable sound zone to delete the sound source corresponding to the sound zone recorded by the microphone. In some examples, the electronic device 100 may receive a user operation (such as a touch operation, such as a single click operation) on the sound zone 412 in the user interface 420 shown in FIG4(B) and display a prompt message. For a specific example, see the user interface 710 shown in FIG7(A).

[0134] As shown in FIG7(A), user interface 710 includes prompt information 711, which displays the characters "Delete vocal 1 in sound zone 1?". Prompt information 711 includes controls 712 and 713. Control 712 can be used to confirm the deletion of sound source 1 in sound zone 412, and control 713 can be used to cancel the deletion of sound source 1 in sound zone 412. In one embodiment, electronic device 100 can delete sound source 1 in sound zone 412 in response to a user operation on control 712 (e.g., the user operation is a touch operation). At this time, electronic device 100 can display user interface 720 shown in FIG7(B). User interface 720 is similar to user interface 420 shown in FIG4(B), except that user interface 720 does not include sound zone 412 and window 421.

[0135] In one embodiment, after the embodiment shown in FIG4(B), the electronic device 100 may receive a user operation and, in response to the user operation, add an editable sound zone so that the microphone records the sound source in the direction indicated by the sound zone. In some examples, the electronic device 100 may receive a user operation (the user operation is a touch operation, such as a long press operation) on an area other than the multiple sound zones in the wheel area 411 in the user interface 420 shown in FIG7(C) (for example, area 426). In response to the user operation, an editable sound zone is added in area 426. At this time, the electronic device 100 may display the user interface 730 shown in FIG7(D).

[0136] As shown in FIG7(D), user interface 730 is similar to user interface 420 shown in FIG7(C), except that user interface 730 further includes an editable sound zone 731. In one embodiment, when electronic device 100 detects sound source 5 located at position 4 relative to electronic device 100 (assuming it corresponds to the position of sound zone 731), electronic device 100 may display information about sound source 5 next to sound zone 731.

[0137] The electronic device 100 is not limited to the above example where the editing interface of any sound zone is displayed after receiving a long press operation on the sound zone. In another embodiment, the electronic device 100 can display editing interfaces of multiple sound zones in response to a user operation on the wheel area 411 in the user interface 410 shown in (A) of Figure 4 (the user operation is, for example, a touch operation, and the touch operation is, for example, a long press operation). For specific examples, see the user interface 810 shown in (A) of Figure 8.

[0138] As shown in FIG8(A), user interface 810 is similar to user interface 420 shown in FIG4(B), except that sound zones 412, 413, and 414 in user interface 810 are all editable. User interface 810 also includes windows 812 and 813. Window 812 may indicate information about sound source 2 corresponding to sound zone 413, and window 813 may indicate information about sound source 3 corresponding to sound zone 414. Window 812 includes the characters "Human Voice 2," which may indicate that the type of sound source 2 corresponding to sound zone 413 is a human voice; the characters "Energy: 62dB," which may indicate that the energy of sound source 2 corresponding to sound zone 413 is 62dB; the characters "Direction: 75 degrees," which may indicate that the direction of sound source 2 corresponding to sound zone 413 is 75 degrees; and the characters "Pickup Range: 30 degrees," which may indicate that the pickup range of sound source 2 corresponding to sound zone 413 is 30 degrees. Window 813 includes the characters “keyboard sound”, which may indicate that the type of the sound source 3 corresponding to the sound zone 414 is keyboard sound; the characters “energy: 35dB”, which may indicate that the energy of the sound source 3 corresponding to the sound zone 414 is 35dB; the characters “azimuth: 300 degrees”, which may indicate that the azimuth of the sound source 3 corresponding to the sound zone 414 is 300 degrees; and the characters “pickup range: 30 degrees”, which may indicate that the pickup range of the sound source 3 corresponding to the sound zone 414 is 30 degrees.

[0139] In one embodiment, the electronic device 100 may receive multiple user operations on editable sound zones in the user interface 810 and edit the multiple sound zones in sequence. For example, in response to a user operation on sound zone 412 in the user interface 810 (e.g., a touch operation, such as a double-click operation), the electronic device 100 may display a prompt message for selecting whether to enhance or suppress the energy of sound source 1 in sound zone 412. In response to a user operation on an enhancement control (e.g., a touch operation), the electronic device 100 may determine whether to enhance the energy of sound source 1 in sound zone 412. Subsequently, in response to a user operation on sound zone 413 (e.g., a touch operation, such as a double-click operation), the electronic device 100 may display a prompt message for selecting whether to enhance or suppress the energy of sound source 2 in sound zone 413. In response to a user operation on a suppression control (e.g., a touch operation), the electronic device 100 may determine whether to suppress the energy of sound source 2 in sound zone 413. Next, the electronic device 100 can display a prompt message in response to a user operation on the sound zone 414 (the user operation is, for example, a touch operation, and the touch operation is, for example, a double-click operation), and the prompt message is used to select to enhance or suppress the energy of the sound source 3 of the sound zone 414. The electronic device 100 can determine to suppress the energy of the sound source 3 of the sound zone 414 in response to a user operation on the suppression control (for example, the user operation is a touch operation). At this time, the electronic device 100 can display the user interface 820 shown in (B) of Figure 8.

[0140] As shown in (B) of Figure 8, the user interface 820 is similar to the user interface 440 shown in (D) of Figure 4, except that the user interface 820 includes text content 821 and a control bar 822. The text content 821 includes the characters "sound suppression zone 2", which can indicate that the sound zone currently suppressing the energy of the sound source is the sound zone 413. The control bar 822 can be used to adjust the suppression degree of the sound zone 413. The characters "70%" are displayed on the control bar 822, which can indicate that the current suppression degree of the sound zone 413 is 70%. The characters "18.6dB" displayed next to the sound zone 413 in the user interface 820 and the characters "Energy: 18.6dB" included in the text content 827 can both indicate that the energy of the sound source 2 after the sound zone 413 is suppressed is 18.6dB. The user interface 820 includes controls 823 and controls 8231. Control 823 includes the character "Follow", which can be used to turn on or off the dynamic following function of the sound source 2 in the sound zone 413. Control 8231 (displayed with the character "OFF") can indicate that the dynamic following function of the sound source 2 in the sound zone 413 is currently turned off. The description of the dynamic following function of the sound source 2 is similar to the description of the dynamic following function of the above-mentioned sound source 1, and will not be repeated here. The user interface 820 includes text content 824 and a control bar 825. The text content 824 includes the characters "Sound Suppression Zone 3", which can indicate that the sound zone currently suppressing the energy of the sound source is sound zone 414. The control bar 825 can be used to adjust the suppression degree of sound zone 414. The characters "90%" are displayed on the control bar 825, which can indicate that the current suppression degree of sound zone 414 is 90%. The characters "3.5dB" displayed next to the sound zone 414 in the user interface 820 and the characters "Energy: 3.5dB" included in the text content 828 can both indicate that the energy of the sound source 3 after the sound zone 414 is suppressed is 3.5dB. The user interface 820 includes controls 826 and controls 8261. Control 826 includes the character "Follow", which can be used to turn on or off the dynamic following function of the sound source 3 in the sound zone 414. Control 8261 (displayed with the character "OFF") can indicate that the dynamic following function of the sound source 3 in the sound zone 414 is currently turned off. The description of the dynamic following function of the sound source 3 is similar to the description of the dynamic following function of the above-mentioned sound source 1 and will not be repeated here.

[0141] Not limited to the above-mentioned example of editing a sound zone (e.g., sound zone 412), in another embodiment, the electronic device 100 can respond to a user operation on the sound zone 413 in the user interface 420 shown in FIG4(B) (the user operation is, for example, a touch operation, and the touch operation is, for example, a long press operation) and set the state of the sound zone 413 to an editable state. The editing interface is similar to the user interface 420 shown in FIG4(B), except that the sound zones 413 and 412 in the editing interface are both in an editable state. Subsequently, the electronic device 100 can receive the user operation on the sound zone 413 and edit the sound zone 413 to adjust the microphone's sound pickup parameters for the sound zone 413.

[0142] Not limited to the case where one sound zone includes one sound source as in the above example, in other examples, one sound zone may include multiple sound sources. For example, the sound zone 412 in the user interface 410 shown in (A) of FIG4 may represent sound source 1 and sound source 4, and the orientation of sound source 4 is the same as that of sound source 1. In this case, the electronic device 100 may display information about sound source 1 and sound source 4 next to the sound zone 412.

[0143] The situation is not limited to the above example where the state of the sound source changes and the sound zone indicating the sound source also changes accordingly. In another embodiment, the position of the electronic device 100 may also change. At this time, the information of the multiple sound zones displayed by the electronic device 100 and the sound sources indicated by the multiple sound zones will change.

[0144] The above example is not limited to the case where multiple sound zones do not overlap. In other examples, overlapping areas may exist between the sound zones. For example, when two sound zones have a partially overlapping area, the electronic device 100 may display the two sound zones separately in the wheel area. For example, the user interface 910 shown in FIG9 includes three sound zones, such as zone A, zone B, and zone C. Zone A includes area 911 and area 912, zone B includes area 912 and area 913, and zone C includes area 914. Zone A and zone B have a partially overlapping area, and the overlapping area of ​​zone A and zone B is area 912. Without limitation, when two sound zones have a partially overlapping area, the electronic device 100 may combine the two sound zones into a new sound zone. For example, the electronic device 100 may combine zone A and zone B in the user interface 910 shown in FIG9 into a new sound zone D, which includes area 911, area 912, and area 913. In other examples, when two sound zones completely overlap, the electronic device 100 may display only one sound zone, and this one sound zone may indicate the two completely overlapping sound zones.

[0145] Next, the sound pickup method provided by the embodiment of the present application is introduced.

[0146] Please refer to Figure 10, which is a flow chart of a sound pickup method provided in an embodiment of the present application. The method can be applied to the sound pickup scene 10 shown in Figure 1. The method can be applied to the electronic device 100 shown in Figure 2. The method can be applied to the electronic device 100 shown in Figure 3. The method can include but is not limited to the following steps:

[0147] S101: The electronic device obtains information of at least one sound source.

[0148] In one embodiment, in a sound pickup scenario, the electronic device 100 can receive a user operation on a control of a sound pickup function (for example, the user operation is a touch operation), and in response to the user operation, turn on the directional sound pickup function of the electronic device 100, such as turning on multiple microphones of the electronic device 100 to record sound. The directional sound pickup function can be used to implement a call function with the user in a call scenario, to implement a recording function in a recording scenario, and to implement a voice transcription function in a voice transcription scenario.

[0149] In one embodiment, in a sound pickup scenario, the electronic device 100 can detect sound sources in various directions centered on the electronic device 100 and obtain information about at least one sound source. In some examples, the multiple microphones in the electronic device 100 can detect sound sources in various directions of the electronic device 100 using an array signal processing algorithm. For example, the location of the sound source can be detected using a sound source localization / tracking algorithm, the energy level of the sound source can be detected using an energy level calculation and smoothing statistics algorithm, and the multiple sound sources can be separated using a sound source separation algorithm or a beamforming algorithm. The type of the at least one separated sound source can then be identified using an acoustic event classification algorithm to obtain information about the at least one sound source.

[0150] In one embodiment, the information of the sound source may include, but is not limited to, the direction of the sound source, the energy of the sound source, and the type of the sound source, wherein the direction of the sound source may be the direction of the sound source relative to the electronic device 100, the energy of the sound source may indicate the sound volume of the sound source picked up / recorded by multiple microphones, and the type of the sound source may be used to distinguish between target sound and interfering noise.

[0151] In one embodiment, the electronic device 100 can record the sound of the sound source based on the pickup parameters of multiple microphones, where the pickup parameters may include but are not limited to the direction of pickup, the pickup range, the degree of enhancement / suppression of the energy of the sound source, etc. The pickup direction is the same as the orientation of the sound source. The pickup range can be an angular area after being deflected to the left and right by preset angles based on the line between the electronic device 100 and the sound source. The range of the degree of enhancement / suppression of the energy of the sound source is [0%, 100%].

[0152] In some examples, the electronic device 100 can determine the pickup range based on the type of sound source. For example, when the sound source is a human voice, the corresponding pickup range can be x degrees, where x is greater than 0. When the sound source is music, the corresponding pickup range can be y degrees, where y is greater than x. It is understandable that reverberation occurs during the propagation of a sound source, and different types of sound signals correspond to different degrees of reverberation. The pickup range can be related to the degree of reverberation. The electronic device 100 can record the reverberation of different types of sound sources using different pickup ranges. For example, when the sound source is a human voice, the electronic device 100 needs to record a smaller degree of reverberation, so the pickup range corresponding to the human voice is smaller, thereby ensuring that the recorded sound is clearer. When the sound source is music, the electronic device 100 needs to record a larger degree of reverberation, so the pickup range corresponding to music is larger, thereby ensuring that the recorded sound is more realistic, natural, and full.

[0153] In some examples, when the electronic device 100 detects a sound source 1 located at a relative position 1 of the electronic device 100, the electronic device 100 can control multiple microphones to record the sound of the sound source 1 at the position 1 according to a preset pickup range, and the degree of enhancement / suppression of the energy of the sound source 1 by the electronic device 100 is preset to 0%.

[0154] S102: The electronic device displays a first interface according to information of at least one sound source.

[0155] In one embodiment, after the electronic device 100 obtains information about at least one sound source, it can display a first interface through the display screen. The first interface can be a sound source detection interface, such as the user interface 410 shown in FIG4 (A).

[0156] In one embodiment, the first interface may include a wheel area and at least one sound zone. The wheel area may represent a sound pickup plane, and any sound zone may represent information about the sound source currently detected by the electronic device 100. For an explanation of the wheel area and the sound zones, see FIG1(B). In some examples, the wheel area may be, for example, wheel area 411 in user interface 410 shown in FIG4(A), and the at least one sound zone may include, for example, sound zone 412, sound zone 413, and sound zone 414 in user interface 410.

[0157] S103: The electronic device receives a first user operation.

[0158] S104: The electronic device displays a second interface according to the first user operation.

[0159] In one embodiment, the electronic device 100 may display an editing interface (i.e., a second interface) for any audio zone in the first interface in response to a first user operation (e.g., a touch operation, which is a long press operation) on the audio zone. The second interface may include a wheel area and at least one audio zone, and the audio zone targeted by the first operation in the at least one audio zone is in an editable state. For example, the second interface is the user interface 420 shown in FIG4(B), and the editable audio zone is, for example, the audio zone 412 in the user interface 420.

[0160] In one embodiment, the electronic device 100 may display an editing interface for at least one audio zone (i.e., a second interface) in response to a first user operation on the wheel area in the first interface (e.g., the first user operation is a touch operation, and the touch operation is a long press operation). The second interface may include a wheel area and at least one audio zone, and at least one audio zone is in an editable state. For example, the second interface is the user interface 810 shown in FIG8 (A), and the editable audio zones include, for example, audio zones 412, 413, and 414 in the user interface 810.

[0161] S105: The electronic device receives a second user operation.

[0162] S106: The electronic device adjusts the sound pickup parameters according to the second user operation to obtain adjusted sound pickup parameters.

[0163] In one embodiment, the electronic device 100 can adjust the sound pickup parameters of multiple microphones for any editable sound zone in the second interface in response to a second user operation on the sound zone, and obtain adjusted sound pickup parameters. A specific example is shown below:

[0164] In some examples, when the second user operation is a user operation on the orientation of a sound zone, the electronic device 100 can adjust the directions of sound pickup of multiple microphones for the sound zone. For example, the second user operation is a sliding operation from right to left on the sound zone 412 in the user interface 420 shown in (B) of Figure 5 . The orientation of the sound zone 412 in the user interface 420 before adjustment is 25 degrees, and the corresponding directions of sound pickup of multiple microphones are 25 degrees. The orientation of the sound zone 512 in the user interface 520 shown in (C) of Figure 5 after adjustment is 0 degrees, and the corresponding directions of sound pickup of multiple microphones are 0 degrees. It can be understood that when the sound source moves, the orientation of the sound source relative to the electronic device also changes. At this time, the electronic device needs to adjust the orientation of the microphone to record the sound source in order to better pick up the sound source. That is to say, when the sound source is 25 degrees north-east of the electronic device (for example, the corresponding orientation is 25 degrees), the electronic device needs to adjust the orientation of multiple microphones recording the sound source to 25 degrees north-east. When the sound source moves to the north direction of the electronic device (for example, the corresponding orientation is 0 degrees), the electronic device needs to adjust the orientation of multiple microphones recording the sound source to the north direction.

[0165] In some examples, when the second user operation is a user operation on the size of the central angle of a sound zone, the electronic device 100 can adjust the pickup range of multiple microphones for the sound zone. For example, the second user operation is a two-finger pinch-out operation on the sound zone 412 in the user interface 420 shown in (A) of Figure 6. The central angle of the sound zone 412 in the user interface 420 before adjustment is 30 degrees, and the corresponding pickup range of multiple microphones is 30 degrees. The central angle of the sound zone 611 in the user interface 610 shown in (B) of Figure 6 after adjustment is 50 degrees, and the corresponding pickup range of multiple microphones is 50 degrees. It can be understood that when the sound source moves back and forth within the preset range, the preset sound pickup range of the electronic device cannot fully pick up the sound source. At this time, the electronic device needs to adjust the pickup range of the microphone to record the sound source in order to fully pick up the sound source. That is, when the sound source is fixed at 25 degrees north-east of the electronic device, the electronic device can record sound sources within a range of 10 degrees to 40 degrees north-east (for example, a corresponding pickup range of 30 degrees). When the sound source moves back and forth between 20 degrees and 30 degrees north-east of the electronic device, the electronic device can record sound sources within a range of 0 degrees to 50 degrees north-east (for example, a corresponding pickup range of 50 degrees). In addition, users can also adjust the pickup range of the sound zone so that the various types of sounds recorded by the electronic device can meet the different needs of users (for example, recording clearer, more realistic, and natural sounds), thereby improving the user experience.

[0166] In some examples, when the second user operation is a user operation targeting the degree of enhancement / suppression of a sound zone, the electronic device 100 may adjust the degree of enhancement / suppression of the energy of the sound source in the sound zone. For example, the second user operation includes a double-click operation on the sound zone 412 in the user interface 420 shown in FIG4(B) and a single-click operation on the control 432 in the user interface 430 shown in FIG4(C). Before the adjustment, the enhancement degree of the sound zone 412 is 0%, and the electronic device 100 accordingly enhances the energy of the sound source in the sound zone 412 by 0%. After the adjustment, the enhancement degree of the sound zone 412 is 50%, and the electronic device 100 accordingly enhances the energy of the sound source in the sound zone 412 by 50%. It can be understood that the user can choose to enhance the sound of the desired target sound source and suppress the sound of the unwanted interfering sound source to output the user's desired sound.

[0167] In some examples, when the second user operation is a user operation for deleting a sound zone, the electronic device 100 can delete the sound sources corresponding to the sound zone recorded by multiple microphones. For example, the second user operation includes a single-click operation on the sound zone 412 in the user interface 420 shown in FIG4 (B) and a single-click operation on the control 712 in the user interface 710 shown in FIG7 (A). Before deleting the sound zone 412, the electronic device 100 records and displays the sound sources corresponding to three sound zones (for example, the sound zone 412, the sound zone 413, and the sound zone 414). After deleting the sound zone 412, the electronic device 100 records and displays the sound sources corresponding to two sound zones (the sound zone 413 and the sound zone 414). It can be understood that the user directly canceled the electronic device from recording the sound source in a certain direction.

[0168] In some examples, when the second user operation is for adding a sound zone, the electronic device 100 can control multiple microphones to record the sound source in the direction indicated by the newly added sound zone according to the preset pickup range. For example, the second user operation is a long press operation on area 426 in the user interface 420 shown in Figure 7 (C). The electronic device 100 can use the direction of area 426 as a reference (recording direction) and record according to the angular area (pickup range) obtained by deflecting the area to the left and right by preset angles (e.g., 15 degrees). It can be understood that when a sound source is added in a certain direction, the user can manually add a sound zone corresponding to the direction so that the microphone can record the sound source in the direction.

[0169] Without limitation to this, in another embodiment, the electronic device 100 can respond to a third user operation (for example, the third user operation is a touch operation) of the dynamic follow function corresponding to any editable sound zone, turn on the dynamic follow function corresponding to the sound zone, automatically adjust the pickup parameters of multiple microphones, and obtain the adjusted pickup parameters, which will not be repeated here.

[0170] S107: The electronic device displays a third interface.

[0171] In one implementation, the electronic device 100 may display the edited audio range on the third interface.

[0172] In one embodiment, examples of S105-S107 can be found in the description of the above scenarios, wherein examples of adjusting the orientation of a sound zone can be found in the description of Figure 5 (B)-Figure 5 (C), examples of adjusting the size of the central angle of a sound zone can be found in the description of Figure 6 (A)-Figure 6 (B), examples of adjusting the degree of enhancement / suppression of a sound zone can be found in the description of Figure 4 (C)-Figure 4 (D), examples of deleting a sound zone can be found in the description of Figure 7 (A)-Figure 7 (B), and examples of adding a sound zone can be found in the description of Figure 7 (C)-Figure 7 (D).

[0173] S108: The electronic device records at least one sound source according to the adjusted sound pickup parameters.

[0174] In one embodiment, the order of S107 and S108 is not limited.

[0175] In one embodiment, the electronic device 100 can record the sound of at least one sound source based on the adjusted sound pickup parameters to obtain recorded audio. For example, the electronic device 100 can record the corresponding sound source according to the adjusted sound pickup direction and sound pickup range of multiple microphones, and process the energy of the recorded sound source (which can be understood as the sound volume) according to the adjusted degree of enhancement / suppression of the energy of the sound source. For example, when the energy of the sound source is 54dB and the degree of enhancement of the energy of the sound source is 50%, the energy of the processed sound source is 81dB.

[0176] In the method shown in FIG10 , in a sound pickup scenario, the electronic device can function as a recording device, detecting sound sources in various directions centered on the electronic device and displaying at least one sound zone on a sound source detection interface. The sound zone represents information about the sound source, which may include information such as the direction, energy, and type of the sound source. In one embodiment, the electronic device can edit any sound zone in the sound zone editing interface in response to user operation, such as adjusting the direction, size, or degree of enhancement or suppression of the sound zone. By editing the sound zone, the multiple microphones can be controlled (i.e., the pickup parameters of the multiple microphones can be adjusted), such as adjusting the direction and range of the sound picked up by the microphones, or the degree of enhancement / suppression of the energy of the sound source in any direction. By visually displaying the information about the sound sources detected by the electronic device in multiple directions on a display screen, the user can intuitively view the status of the sound sources in the surrounding environment. Furthermore, when the status of the sound source changes, such as when the sound source moves, the user can promptly adjust the pickup parameters of the multiple microphones through the electronic device so that the electronic device records the sound source in the environment according to the adjusted pickup parameters and outputs the user's desired audio, thereby improving the user experience.

[0177] The methods provided in the various embodiments of the present application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, they may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, or a magnetic tape), an optical medium (e.g., a digital video disc (DWD), or a semiconductor medium (e.g., a solid state drive (SSD)). As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit the same. Although the present application has been described in detail with reference to the above embodiments, a person skilled in the art should understand that the technical solutions described in the above embodiments may be modified, or some of the technical features thereof may be replaced by equivalents. However, such modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A sound pickup method, characterized in that: Applied to electronic equipment, the method includes: When sound from at least one sound source is collected through a microphone, a first interface is displayed, the first interface including a first control and at least one second control, the first control indicating the electronic device, the second control indicating the sound source, different second controls being displayed in different manners, and the display position of the second control indicating the position of the corresponding sound source relative to the electronic device; receiving a first operation on the first interface; In response to the first operation, displaying a second interface, where the second interface includes the first control and the at least one second control, a third control in the at least one second control is an editable control, and the third control is any one of the at least one second controls; receiving a second operation on the third control in the second interface; In response to the second operation, the electronic device adjusts the sound pickup parameters of the first sound source corresponding to the third control.

2. The method according to claim 1, wherein The first interface includes a circle, the circle includes at least one sector, the center point of the sector is the center of the circle, the first control is the center of the circle, and the second control is the sector.

3. The method according to claim 1 or 2, wherein: The size of the central angle of the second control indicates the range of the corresponding sound source recorded by the electronic device.

4. The method according to any one of claims 1 to 3, wherein The first interface includes first information corresponding to the second control, the first information includes information about the sound source corresponding to the second control, the information about the sound source includes the orientation of the sound source relative to the electronic device, the energy of the sound source, and the type of the sound source.

5. The method according to any one of claims 1 to 4, characterized in that The display mode of the fourth control in the first interface is the first mode, the fourth control indicates a second sound source among the at least one sound source, the first mode indicates that the second sound source is in the first state, and the fourth control is any one of the at least one second control; The method further comprises: When it is detected that the state of the second sound source changes from the first state to the second state, a third interface is displayed, and the display mode of the fourth control in the third interface is the second mode, and the second mode indicates that the second sound source is in the second state.

6. The method according to any one of claims 1 to 5, wherein: The adjusting the sound pickup parameter of the electronic device for the first sound source corresponding to the third control includes: When the second operation is a user operation on the display position of the third control, adjusting the direction in which the electronic device records the first sound source; When the second operation is a user operation on the size of the central angle of the third control, adjusting the range of the electronic device for recording the first sound source; When the second operation is an enhancement value for the third control, adjusting the enhancement value of the energy of the first sound source by the electronic device; When the second operation is a suppression value for the third control, the suppression value of the electronic device on the energy of the first sound source is adjusted.

7. The method according to any one of claims 1 to 6, wherein: Before receiving the second operation on the third control in the second interface, the method further includes: recording the first sound source corresponding to the third control according to the first sound pickup parameter; The adjusting the sound pickup parameter of the electronic device for the first sound source corresponding to the third control includes: adjusting the first sound pickup parameter to a second sound pickup parameter; The method further comprises: The first sound source corresponding to the third control is recorded according to the second sound pickup parameter.

8. The method according to any one of claims 1 to 7, wherein: The method further comprises: In response to the second operation, a fourth interface is displayed, and when the second operation is a user operation directed to a display position of the third control, a position of the first sound source corresponding to the third control in the fourth interface relative to the electronic device is different from a position of the first sound source corresponding to the third control in the second interface relative to the electronic device; When the second operation is a user operation on the size of the central angle of the third control, the range of the electronic device corresponding to the third control in the fourth interface for recording the first sound source is different from the range of the electronic device corresponding to the third control in the second interface for recording the first sound source; When the second operation is a user operation to enhance or suppress the value of the third control, the energy of the first sound source corresponding to the third control in the fourth interface is different from the energy of the first sound source corresponding to the third control in the second interface.

9. The method according to any one of claims 1 to 8, wherein After displaying the second interface, the method further includes: receiving a third operation on the third control in the second interface; In response to the third operation, the third control is deleted and a fifth interface is displayed, where the fifth interface does not include the third control.

10. The method according to any one of claims 1 to 9, wherein After displaying the second interface, the method further includes: receiving a fourth operation on the first area in the second interface; In response to the fourth operation, a fifth control is added to the first area and a sixth interface is displayed. The sixth interface includes the fifth control, and the display position of the fifth control is the same as the display position of the first area.

11. The method according to claim 9, wherein The method further comprises: In response to the third operation, the first sound source corresponding to the third control recorded by the electronic device is deleted.

12. The method according to claim 10, wherein The method further comprises: In response to the fourth operation, the sound source corresponding to the fifth control is recorded according to a preset range of the electronic device for recording sound sources.

13. An electronic device, characterized in that: The method comprises a transceiver, a processor and a memory, wherein the memory is used to store a computer program, and the processor calls the computer program to execute the method according to any one of claims 1 to 12.

14. A computer storage medium, characterized in that The computer storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images