Electronic device and related sound leakage prevention method

Abstract

An embodiment of this application discloses an electronic device and a related sound leakage prevention method. The electronic device includes an audio processing unit, a first-type array element, and a second-type array element. The audio processing unit is configured to receive an initial audio signal and determine a first-type audio signal and a second-type audio signal based on the initial audio signal, where the first-type audio signal includes M first audio signals and the second-type audio signal includes N second audio signals. The audio processing unit is configured to transmit the first-type audio signal to the first-type array element and the second-type audio signal to the second-type array element. The first-type array element is configured to output M first sound wave signals based on the corresponding first audio signals. The second-type array element is configured to output N second sound wave signals based on the corresponding second audio signals. The N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple points within a first preset area. According to the embodiments of this application, when the electronic device is used for calling, a private call can be realized, thereby improving the user experience.

Description

[Technical Field]

[0001] This application claims priority to Chinese Patent Application No. 202311050596.1, entitled "ELECTRONIC DEVICE AND RELATED SOUND LEAKAGE PREVENTION METHOD," filed with the State Intellectual Property Office of China on August 18, 2023, which is incorporated herein by reference in its entirety.

[0002] This application relates to the field of intelligent terminal technology, and in particular to electronic devices and related sound leakage prevention methods. [Background technology]

[0003] With the popularity of bezel-less mobile phones, the location of the receiver on a mobile phone must be moved to the top of the screen, which causes a more serious sound leakage problem during handheld calls. An effective solution to prevent sound leakage for mobile phone calls can enable users to make private calls without using a headset, so as to realize completely private calls in a handheld state. Currently, there are several technical solutions that can reduce sound leakage from mobile phones, but the effectiveness of these technical solutions in reducing sound leakage is insufficient. Therefore, how to improve the effectiveness of sound leakage prevention for calls is a current and future research direction. Summary of the Invention

[0004] The embodiments of this application provide an electronic device and a related sound leakage prevention method for ensuring that private calls can be realized when the electronic device is used for calls, thereby improving the user experience.

[0005] According to a first aspect, an embodiment of the present application provides an electronic device. The electronic device includes an audio processing unit, a first-type array element, and a second-type array element, where the first-type array element includes M first array elements and the second-type array element includes N second array elements, where M and N are integers greater than 0. The audio processing unit is configured to receive an initial audio signal, determine a first-type audio signal and a second-type audio signal based on the initial audio signal, where the first-type audio signal includes M first audio signals and the second-type audio signal includes N second audio signals, and transmit the first-type audio signals to the first-type array elements and the second-type audio signals to the second-type array elements, where one audio signal corresponds to one array element. The M first array elements in the first-type array elements are configured to output M first acoustic signals based on the corresponding first audio signals. The N second array elements in the second type of array element are configured to output N second acoustic signals based on corresponding second audio signals, and the N second acoustic signals are used for superimposition and cancellation with the M first acoustic signals at multiple points within the first preset area.

[0006] In this embodiment of the present application, a plurality of array elements may be configured on the electronic device, and the plurality of array elements may include first-type array elements and second-type array elements. In a call process, the audio processing unit may process an initial audio signal to be played to obtain M first audio signals and N second audio signals, and transmit the M first audio signals to corresponding first array elements, respectively, and transmit the N second audio signals to corresponding second array elements, respectively. Furthermore, the first array elements and the second array elements may simultaneously output different sound wave signals based on the received audio signals, so that the N sound wave signals output by the N second-type array elements overlap and cancel each other out with the leakage sound of the first-type array elements at multiple points within the sound leakage prevention area (i.e., the area surrounding the electronic device). In this way, the sound leakage effect is reduced within the sound leakage prevention area, thereby realizing private calls and improving user experience.

[0007] In some embodiments, the electronic device further includes M first filters, and the audio processing unit is further configured to perform a first filtering process on the initial audio signal using each first filter to obtain M first audio signals, wherein the M first audio signals are used to cancel interference of the N second audio signals with the M first audio signals at multiple points within the second preset area, and the first filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal.

[0008] In this embodiment of the application, the input of the first filter may be an initial audio signal, and the output may be a first audio signal. When M is an integer greater than 1, that is, when the electronic device includes multiple first filters, the preset amplitude adjustment and phase adjustment parameters corresponding to the first filters may be different. The first filters may perform amplitude adjustment and / or phase adjustment processing on the received initial audio signal based on the preset amplitude adjustment and phase adjustment parameters to obtain the first audio signal. The first array element does not directly output the initial audio signal, but outputs a processed audio signal to cancel out interference with the sound waves output by the first type array element caused by the sound waves output by the second type array element at multiple points within the audio reproduction area, so that the audio reception effect in the audio reproduction area remains unchanged, thereby improving the user experience.

[0009] In some embodiments, the first preset area is a sound leakage prevention area and the second preset area is an audio playback area.

[0010] In some embodiments, the electronic device further includes N second filters, and the audio processing unit is further configured to perform a second filtering process on the initial audio signal using each second filter to obtain N second audio signals, wherein the second filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal.

[0011] In this embodiment of the application, different second filters may correspond to different preset amplitude adjustment and phase adjustment parameters, and the input of the second filter may be the initial audio signal, and the output may be the second audio signal. The second filters may process the initial audio signal based on the preset amplitude adjustment and phase adjustment parameters corresponding to the second filters to obtain N second audio signals. Furthermore, the second type array elements may separately output second audio signals for superimposition and cancellation with leakage sounds of the first type array elements at multiple points within the sound leakage prevention area (i.e., the surrounding area), thereby reducing the sound leakage effect within the sound leakage prevention area and thereby realizing private calls and improving user experience.

[0012] In some embodiments, the electronic device includes Q array elements, where Q is greater than or equal to M+N, and the audio processing unit is further configured to obtain determination information, where the determination information includes one or more of a current number of people in the first preset area, a current remaining battery level of the electronic device, or a current location of the electronic device, and to determine, from the Q array elements, M first array elements in the first type of array elements and N second array elements in the second type of array elements based on the determination information.

[0013] In this embodiment of the application, the electronic device may utilize the audio processing unit to obtain determination information. The determination information may include, but is not limited to, information such as the number of people in a first preset area, the current remaining battery level of the electronic device, or the current location of the electronic device. Furthermore, the electronic device may determine M first array elements in the first type of array elements and N second array elements in the second type of array elements from the Q array elements based on the determination information, thereby selecting different array elements to operate in different application scenarios, thereby improving system performance.

[0014] In some embodiments, the value of N increases if the number of people currently in the first preset area increases; or If the current remaining battery level of the electronic device is low, the value of N is reduced, or If the current location of the electronic device is within a private area, the value of N is small.

[0015] In this embodiment of the application, when the number of people in the first preset area becomes large, the number of the second array elements may be appropriately increased to obtain better quiet call quality to ensure that the people in the first preset area cannot clearly hear the sound emitted by the electronic device. Alternatively, when the remaining battery level of the electronic device becomes low, the number of the second type of array elements may be appropriately reduced to reduce the power consumption of the electronic device. Alternatively, when the current location of the electronic device is within a user's private area, for example, at home, when the user has a relatively low requirement for quiet call quality, the number of the second type of array elements may be appropriately reduced to reduce the power consumption of the electronic device.

[0016] In some embodiments, the distance between N second array elements in the second type of array elements and M first array elements in the first type of array elements falls within a first range.

[0017] In this embodiment of the application, the shorter the distance between the N second array elements and the M first array elements, i.e., the shorter the distance between each of the N second array elements and each of the M first array elements, the better the sound leakage prevention effect, thereby improving the user experience.

[0018] In some embodiments, the electronic device further includes M+N power amplifier circuits, each power amplifier circuit corresponding to one audio signal; the audio processing unit is further configured to amplify the M first audio signals and the N second audio signals using the M+N power amplifier circuits, respectively, to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type of array element are specifically configured to output M first acoustic signals based on the processed first type of audio signals, and the second type of array element is specifically configured to output N second acoustic signals based on the processed second type of audio signals.

[0019] In this embodiment of the application, after the M first filters and the N second filters separately perform amplitude adjustment processing and / or phase adjustment processing on the initial audio signals, M first audio signals and N second audio signals may be obtained, and then the M first audio signals and N second audio signals may be separately input to corresponding power amplifier circuits for processing to amplify the audio signals, and drive the array elements to emit sounds so that the user can hear the sounds more clearly, thereby improving the user experience.

[0020] According to a second aspect, an embodiment of the present application provides a sound leakage prevention method applied to an electronic device. The electronic device includes a display, an audio processing unit, a first type of array elements, and a second type of array elements, where the first type of array elements include M first array elements and the second type of array elements include N second array elements, where M and N are integers greater than 0. The method includes the steps of: when the electronic device is in a call, displaying a first interface on the display; receiving and responding to a user's preset operation on a preset area in the first interface and displaying a second interface; receiving and responding to a touch operation on a first control in the second interface; receiving an initial audio signal through the audio processing unit; and determining a first type of audio signal and a second type of audio signal based on the initial audio signal, where the first type of audio signal includes M first audio signals and the second type of audio signal includes N second audio signals; and to the first type of array elements and to the second type of array elements, one audio signal corresponding to one array element; outputting M first sound signals based on the corresponding first sound signals through M first array elements in the first type of array elements; and outputting N second sound signals based on the corresponding second sound signals through N second array elements in the second type of array elements, wherein the N second sound signals are used for superposition and cancellation with the M first sound signals at multiple points in the first preset area.

[0021] According to a third aspect, an embodiment of the present application provides a sound leakage prevention method applied to an electronic device, the electronic device including an audio processing unit, a first type of array elements, and a second type of array elements, the first type of array elements including M first array elements, and the second type of array elements including N second array elements, where M and N are integers greater than 0. The method includes the steps of receiving an initial audio signal through an audio processing unit, and determining a first type audio signal and a second type audio signal based on the initial audio signal, wherein the first type audio signal includes M first audio signals and the second type audio signal includes N second audio signals; transmitting the first type audio signals to first type array elements and transmitting the second type audio signals to second type array elements, wherein one audio signal corresponds to one array element; outputting M first sound wave signals based on the corresponding first audio signals through the M first array elements in the first type array elements, and outputting N second sound wave signals based on the corresponding second audio signals through the N second array elements in the second type array elements, wherein the N second sound wave signals are used to superimpose and cancel with the M first sound wave signals at multiple points in a first preset area.

[0022] In some embodiments, the electronic device further includes M first filters, and the method further includes a step of performing a first filtering process on the initial audio signal using each of the first filters to obtain M first audio signals, wherein the M first audio signals are used to cancel interference of N second audio signals with the M first audio signals at multiple points within the second preset area, and the first filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal.

[0023] In some embodiments, the first preset area is a sound leakage prevention area and the second preset area is an audio playback area.

[0024] In some embodiments, the electronic device further includes N second filters, and the method further includes a step of performing a second filtering process on the initial audio signal using each second filter to obtain N second audio signals, wherein the second filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal.

[0025] In some embodiments, the distance between N second array elements in the second type of array elements and M first array elements in the first type of array elements falls within a first range.

[0026] In some embodiments, the electronic device includes Q array elements, where Q is greater than or equal to M+N, and the method further includes obtaining determination information, where the determination information includes one or more of a current number of people in a first preset area, a current remaining battery level of the electronic device, or a current location of the electronic device, and determining, from the Q array elements, M first array elements in a first type of array element and N second array elements in a second type of array element based on the determination information.

[0027] In some embodiments, the value of N increases if the number of people currently in the first preset area increases; or If the current remaining battery level of the electronic device is low, the value of N is reduced, or If the current location of the electronic device is within a private area, the value of N is small.

[0028] In some embodiments, the electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponding to one audio signal, and the method further includes utilizing the M+N power amplifier circuits to amplify the M first audio signals and the N second audio signals, respectively, to obtain M processed first audio signals and N processed second audio signals, wherein the M first array elements in the first type of array element are specifically configured to output M first acoustic signals based on the processed first type of audio signals, and the second type of array element is specifically configured to output N second acoustic signals based on the processed second type of audio signals.

[0029] According to a fourth aspect, there is provided an electronic device including a memory and one or more processors, wherein the memory is coupled to the one or more processors, and the memory is configured to store computer program code, the computer program code including computer instructions, and the one or more processors invoke the computer instructions, thereby causing the electronic device to perform a method according to the second aspect or any one of the implementations of the second aspect, or a method according to the third aspect or any one of the implementations of the third aspect.

[0030] According to a fifth aspect, there is provided a computer-readable storage medium comprising instructions which, when executed on an electronic device, enable the electronic device to perform a method according to the second aspect or any one of the implementations of the second aspect, or a method according to the third aspect or any one of the implementations of the third aspect.

[0031] According to a sixth aspect, there is provided a computer program product which, when run on a computer, enables the computer to perform a method according to the second aspect or any one of its implementations, or a method according to the third aspect or any one of its implementations.

[0032] According to a seventh aspect, there is provided a chip system, the chip system including at least one processor configured to perform the method according to the second aspect or any one of the implementations of the second aspect, or the method according to the third aspect or any one of the implementations of the third aspect. [Brief explanation of the drawings]

[0033] [Figure 1] 1 is a diagram of a structure of an electronic device according to an embodiment of the present application. [Figure 2] 1 is a diagram of the software structure of an electronic device according to an embodiment of the present application. [Figure 3a(a)] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 3a(b)] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 3b(a)] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 3b(b)] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 3c] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 3d] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 3e] FIG. 2 is a diagram of a group of user interfaces according to an embodiment of the present application. [Figure 4] 1 is a diagram of a structure of a smartphone according to an embodiment of the present application; [Figure 5] 1 is a diagram of the structure of a smart head-mounted device according to an embodiment of the present application. [Figure 6] FIG. 2 is a diagram of a call scenario according to an embodiment of the present application. [Figure 7] FIG. 1 is a diagram of an array element according to an embodiment of the present application. [Figure 8] FIG. 10 is a diagram of another array element according to an embodiment of the present application. [Figure 9] 1 is a diagram of a structure of an electronic device according to an embodiment of the present application. [Figure 10] 1 is a diagram of a filter according to an embodiment of the present application. [Figure 11] FIG. 10 is a diagram of another filter according to an embodiment of the present application. [Figure 12] 10A and 10B are diagrams illustrating the sound leakage prevention effect according to an embodiment of the present application. [Figure 13] 1 is a diagram of a power amplifier circuit according to an embodiment of the present application. [Figure 14] 1 is a flowchart of a method for determining filter parameters corresponding to each array element according to an embodiment of the present application. [Figure 15] FIG. 2 is a diagram of audio sampling according to an embodiment of the present application. [Figure 16(a)] 1 is a diagram of frequency response curves in the human ear area and surrounding area according to an embodiment of the present application. [Figure 16(b)] 1 is a diagram of frequency response curves in the human ear area and surrounding area according to an embodiment of the present application. [Figure 17] 1 is a schematic flowchart of a sound leakage prevention method according to an embodiment of the present application. [Figure 18] 1 is a schematic flowchart of another sound leakage prevention method according to an embodiment of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0034] Hereinafter, the embodiments of this application will be described with reference to the accompanying drawings in the embodiments of this application.

[0035] In the specification, claims, and accompanying drawings of this application, terms such as "first," "second," "third," and "fourth" are intended to distinguish between different objects, but do not indicate a particular order. Additionally, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include additional steps or units that are not listed, or may optionally include other steps or units that are inherent to the process, method, product, or device.

[0036] The term "embodiment" as used herein means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of this application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, or to separate or alternative embodiments that are mutually exclusive from other embodiments. Those skilled in the art will understand, both explicitly and implicitly, that the embodiments described in this specification may be combined with other embodiments.

[0037] The embodiments of this application provide an electronic device and a related sound leakage prevention method. The electronic device may include, but is not limited to, a smartphone, a tablet computer (tablet personal computer, tablet PC), a wearable electronic device (such as smart glasses), or a smart head-mounted device (such as VR glasses).

[0038] When a conventional electronic device (e.g., a smartphone) is in use, the electronic device is near a person's ear, and only the on-screen speaker produces sound. Therefore, the external sound volume can be reduced by simply reducing the volume of the electronic device. However, this also reduces the volume of the sound heard by the person's ear, making it difficult for the user to hear the sound clearly. In this application, multiple array elements (e.g., multiple speakers or multiple audio output holes) can be configured on the electronic device, and filters corresponding to different array elements can be calculated using a preset algorithm. Furthermore, after the filters are applied to the multi-array element system, the sound field formed by superimposing the sound waves output by the multiple speakers near the person's ear becomes the same as the sound field formed when the on-screen speaker produces sound independently. This ensures that the volume and sound quality of the sound heard by the person's ear remain unchanged, and sound waves in the surrounding area are canceled out after being superimposed, thereby reducing sound leakage from the electronic device. As a result, this application can ensure that the sound quality and volume of the sound heard by the user remain unchanged, and can also significantly reduce the volume of sound leakage from the electronic device.

[0039] Before describing in detail the method provided in the embodiments of this application, the electronic device provided in the embodiments of this application will be described first.

[0040] FIG. 1 is a diagram of the structure of an electronic device 100 .

[0041] The following describes embodiments using electronic device 100 as an example. It should be understood that electronic device 100 may have more or fewer components than those shown, may combine two or more components, or may have a different component configuration. The components shown in the figures may be implemented in hardware, including one or more signal processing and / or application specific integrated circuits, software, or a combination of hardware and software.

[0042] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a plurality of speakers 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a 3D camera module 193, a display 194, and a subscriber identity module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical axis sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M.

[0043] It may be understood that the structure shown in this embodiment of the present invention does not constitute a particular limitation on electronic device 100. In some other embodiments of this application, electronic device 100 may include more or fewer components than those shown in the figures, may combine some components, may separate some components, or may have a different component arrangement. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.

[0044] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be separate components or may be integrated into one or more processors.

[0045] The wireless communication function of the electronic device 100 may be implemented using an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a modem processor, a baseband processor, and the like.

[0046] The electronic device 100 realizes display functions using a GPU, a display 194, an application processor, and the like. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations and perform graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0047] The display 194 is configured to display images, videos, and the like. The display 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, or a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0048] The electronic device 100 may utilize an audio module 170, multiple speakers 170A, a receiver 170B, a microphone 170C, a headset jack 170D, and an application processor to provide audio functions such as calling, music playback, and recording.

[0049] Audio module 170 is configured to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals.

[0050] A plurality of speakers 170A, also referred to as "loudspeakers," are configured to convert audio electrical signals into sound signals.

[0051] The receiver 170B, also referred to as the "earpiece," is configured to convert an audio electrical signal into a sound signal.

[0052] The microphone 170C, also referred to as a "microphone" or "mic," is configured to convert sound signals into electrical signals.

[0053] The headset jack 170D is configured to connect to a wired headset and may be a USB interface 130, a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0054] The software system of the electronic device 100 may utilize a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to describe the software structure of the electronic device 100.

[0055] FIG. 2 is a block diagram of the software architecture of electronic device 100 according to an embodiment of the present invention.

[0056] In a layered architecture, software is divided into several layers, each with a distinct role and task. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0057] The application layer may include a series of application packages.

[0058] As shown in FIG. 2, the application package may include application programs (sometimes referred to as applications) such as phone, camera, gallery, calendar, map, navigation, WLAN, Bluetooth, music, video, and messaging.

[0059] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0060] As shown in FIG. 2, the application framework layer may include a phone manager, a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.

[0061] The phone manager is configured to provide communication functions for the electronic device 100, such as call state management (including admitting and denying).

[0062] A window manager is configured to manage window programs and may perform tasks such as obtaining the display size, determining whether there is a status bar, locking the screen, and taking screenshots.

[0063] Content providers are configured to store and retrieve data and make the data accessible to applications. Data may include video, images, audio, calls made and received, browsing history and bookmarks, and phone books.

[0064] The view system includes visual controls such as a text display control and an image display control. The view system can be configured to build applications. A display interface can include one or more views. For example, a display interface that includes an SMS notification icon can include a text display view and an image display view.

[0065] The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, and video files.

[0066] The notification manager allows applications to display notification information in the status bar and may be configured to convey notification-type messages. The information may disappear automatically without user interaction after a short time. For example, the notification manager may be configured to notify download completion, message reminders, etc. The notification manager may alternatively display notifications in the form of graphs or scrollbar text in a status bar at the top of the system, such as notifications for applications running in the background, or notifications in the form of an on-screen dialog interface. For example, the status bar may display text information, an alert sound may be emitted, the electronic device may vibrate, or an indicator may flash.

[0067] The Android runtime includes core libraries and a virtual machine, and is responsible for scheduling and managing the Android system.

[0068] The core library contains two parts: the functions that need to be called using the Java language and the Android core library.

[0069] The application layer and the application framework layer run within a virtual machine, which executes the binary files of the Java files in the application layer and the application framework layer, and is configured to perform functions such as object lifecycle management, stack management, thread management, security and anomaly management, and garbage collection.

[0070] The system library may include multiple functional modules, for example, a surface manager, media libraries, a three-dimensional graphics processing library (eg, OpenGL ES), and a two-dimensional graphics engine (eg, SGL).

[0071] The surface manager is configured to manage the display subsystem and provide blending of 2D and 3D layers for multiple applications.

[0072] The media library supports playback and recording of several commonly used audio and video formats, as well as still image files. The media library may support several audio and video coding formats, such as MPEG-4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0073] The 3D graphics processing library is configured to perform 3D graphics drawing, image rendering, compositing, layer processing, and the like.

[0074] The 2D graphics engine is a drawing engine for 2D drawing.

[0075] The kernel layer is a layer between the hardware and the software, and includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

[0076] The user interface provided in the embodiment of this application will be described below.

[0077] 3a(a) to 3e show a group of user interfaces displayed on the electronic device 100 according to an embodiment of the present application.

[0078] FIG. 3a(a) illustrates an exemplary user interface 20 present on the electronic device 100 and utilized to display installed applications.

[0079] 3a(a), the user interface 20 displays icons of one or more installed applications, such as a phone 201, a camera, a gallery, a clock, a calendar, a notepad, a file, an email, a music, a calculator, a Huawei video, a health, a weather, a browser, an AI life, a setting, and a recorder.

[0080] As shown in FIG. 3a(a), the electronic device 100 may respond to a user's touch operation on a phone 201 icon in the user interface 20 (i.e., an operation to launch a calling application), launch the calling application, and display the user interface 21 shown in FIG. 3a(b) on the display 194 of the electronic device 100. The user interface 21 may be a dialing interface, and may include an area 202 and a control 203. The area 202 may be used to display a plurality of digital controls by which a user inputs a telephone number. The control 203 may be used to dial the telephone number input by the user.

[0081] 3a(b), electronic device 100 may respond to a user's operation of inputting a phone number in area 202 in user interface 21 and display the phone number input by the user in user interface 21. Electronic device 100 may also respond to a user's touch operation on control 203 in user interface 21, place a call to the phone number input by the user, and display user interface 22 shown in FIG. 3b(a) on display 194 of electronic device 100. User interface 22 may be a call screen, and user interface 22 may include area 204.

[0082] Optionally, as shown in FIG. 3a(b), electronic device 100 may respond to a user's input of a phone number in area 202 within user interface 21 and display the phone number entered by the user within user interface 21. Electronic device 100 may also respond to a user's touch on control 203 within user interface 21, call the phone number entered by the user, and automatically enable quiet mode. After quiet mode is enabled, only the user can hear the sound emitted by the speaker during the call, and surrounding people cannot clearly hear the sound emitted by the speaker. This ensures that the user can conduct a private call when using electronic device 100 for a call, thereby improving the user experience. In some embodiments, quiet mode may also be referred to as quiet call mode, silent call mode, sound-proof call mode, or private call mode.

[0083] As shown in Fig. 3b(a), electronic device 100 may respond to a user's preset operation in area 204 within user interface 22, such as a user sliding downward in area 204, by activating a control center of electronic device 100 and displaying user interface 23 shown in Fig. 3b(b) on display 194 of electronic device 100. User interface 23 may be a control center interface, and user interface 23 may include control 205. Control 205 may be used to enable quiet mode during a call.

[0084] As shown in FIG. 3b(b), the electronic device 100 may also respond to a user's touch on a control 205 in the user interface 23 to enable quiet mode. After the quiet mode is enabled, only the user can hear the sound emitted by the speaker during a call; people around the user cannot clearly hear the sound emitted by the speaker. This ensures that the user can conduct private calls when using the electronic device 100 for calls, thereby improving the user experience. How the electronic device 100 implements quiet mode will be described in detail later and will not be described in detail here.

[0085] 3c, when a user enables quiet mode during a call, a "Quiet Mode In" prompt is displayed on the user interface 22 to inform the user that quiet mode is currently enabled. During a call, only the user can hear the sound emitted by the speaker; people around the user cannot clearly hear the sound emitted by the speaker. This ensures that the user can conduct private calls when using the electronic device 100 for calls, thereby improving the user experience.

[0086] As shown in FIG. 3d, when electronic device 100 is called or ringing, electronic device 100 may display user interface 24 on display 194. User interface 24 may be a caller ID interface, and user interface 24 may include control 206. Electronic device 100 may respond to a user dragging and sliding control 206 to the right to answer the call and display user interface 22 shown in FIG. 3b(a) on display 194 of electronic device 100. In some embodiments, electronic device 100 may respond to a user's preset operation in area 204 within user interface 22, such as a user sliding down area 204, to launch a control center for electronic device 100 and display user interface 23 shown in FIG. 3b(b) on display 194 of electronic device 100. 3b(b), electronic device 100 may respond to a user touch on control 205 in user interface 23 to enable quiet mode. In some embodiments, electronic device 100 may respond to a user dragging control 206 to the right to answer the call and automatically enable quiet mode.

[0087] As shown in FIG. 3e, after the electronic device 100 enters chat software (e.g., WeChat) and launches a chat dialog box, the electronic device 100 may display a user interface 25 on the display 194. The user interface 25 may be a chat dialog box interface, and the user interface 25 may include a voice message sent by a chat partner. The electronic device 100 may respond to a user tapping on the voice message, enable silent mode, and play the voice message, so that in the process of playing the voice message, only the user can hear the sound emitted by the speaker, and surrounding people cannot clearly hear the sound emitted by the speaker. This ensures that the user can play the voice message privately using the electronic device 100, thereby improving the user experience.

[0088] In the following, an electronic device according to an embodiment of this application will be described.

[0089] Referring to FIG. 4, it is assumed that the electronic device 100 is a smartphone, and that Q array elements and an audio processing unit may be disposed on the smartphone, where Q is an integer greater than or equal to 2. FIG. 4 shows only three array elements, namely, array element 1, array element 2, and array element 3. The audio processing unit in FIG. 4 may include the audio module 170 of FIG. 1 or may include the processor 110. It should be noted that an array element may be understood as a speaker or a sound output hole. Referring to FIG. 5, it is assumed that the electronic device 100 is a smart head-mounted device (e.g., VR glasses), and that Q array elements and an audio processing unit may be disposed on the smart head-mounted device, where Q is an integer greater than or equal to 2. FIG. 5 shows only four array elements, namely, array element 1, array element 2, array element 3, and array element 4. The audio processing unit in FIG. 5 may include the audio module 170 of FIG. 1 or may include the processor 110. It may be understood that the electronic device 100 in this application may include, but is not limited to, the two types of electronic devices provided as examples in Figures 4 and 5. For ease of explanation, the following uses an example in which the electronic device 100 is a smartphone. A detailed description of the electronic device 100 is as follows.

[0090] In some embodiments, after making a call to a phone number entered by a user, the electronic device 100 automatically activates silent mode. After the silent mode is activated, only the user can hear the sound emitted by the speaker during the call, and people around the user cannot clearly hear the sound emitted by the speaker. This ensures that the user can achieve a private call when using the electronic device 100 for a call, thereby improving the user experience. For a detailed description, please refer to the related description of FIG. 3a(b). The details will not be described again here.

[0091] In some embodiments, electronic device 100 may alternatively respond to a user action and enable quiet mode during the call. For a detailed description, see the related description of FIG. 3b(b). The details will not be described again here.

[0092] In some embodiments, when electronic device 100 is called and ringing, quiet mode may be automatically enabled after electronic device 100 answers the call. Alternatively, electronic device 100 may receive a user action to enable quiet mode during the call. For a detailed description, see the related description of FIG. 3d. The details will not be described again here.

[0093] In some embodiments, the electronic device 100 may enable quiet mode when playing a voice message. For a detailed explanation, see the related description of FIG. 3e. The details will not be described again here.

[0094] The following describes, with reference to the accompanying drawings, how the electronic device 100 enables the quiet mode so that during a call, only the user can hear the sounds emitted by the array elements (e.g., speakers), but people around cannot clearly hear the sounds emitted by the array elements.

[0095] In some embodiments, the electronic device 100 may obtain determination information through the audio processing unit, where the determination information includes one or more of the current number of people in the first preset area, the current remaining battery level of the electronic device 100, or the current location of the electronic device 100, and determine, based on the determination information, M first array elements in the first type of array elements and N second array elements in the second type of array elements from the Q array elements, where M and N are integers greater than 0.

[0096] Specifically, as shown in FIG. 6 , when a user holds the electronic device 100 to talk or listen to voices, the first preset area may be understood as a sound leakage prevention area (i.e., a surrounding area). For example, a space within 1 meter of the user's shoulder width may be referred to as a personal area, and a space outside the personal area may be referred to as a surrounding area. The purpose of this application is to minimize the volume of sound leaking into the surrounding area (i.e., the first preset area). The second preset area may be understood as a sound reproduction area (i.e., an area inside a person's ear), for example, the space between the profile of a person's ear and the electronic device 100. The first preset area is larger than the second preset area. After the electronic device 100 activates the silent mode, the electronic device 100 may obtain determination information using the audio processing unit. The determination information may include, but is not limited to, the number of people within the first preset area, the current remaining battery level of the electronic device 100, and the current location of the electronic device 100. Furthermore, the electronic device 100 may determine, from the Q array elements, M first array elements in the first type of array elements and N second array elements in the second type of array elements based on the determination information.

[0097] For example, the determining information is that the number of people in the first preset area is four and the current remaining battery level of the electronic device 100 is relatively high. As shown in FIG. 7, the electronic device 100 performs the following steps based on the determination information: the first type of array element includes one array element, which is array element 1, and array element 1 may be a screen speaker; and It may be determined that the second type of array element includes two array elements, which are array element 2 and array element 3, respectively. The current remaining battery level of the electronic device 100 is relatively high, and there are relatively many people in the first preset area. In this scenario, the user can appropriately increase the number of the second type of array elements to improve quiet call quality when the electronic device is used for calls, thereby improving the user experience.

[0098] In another example, the determining information is that the number of people in the first preset area is 1 and the current remaining battery level of the electronic device 100 is relatively low. As shown in FIG. 8, the electronic device 100 performs the following steps based on the determination information: the first type of array element includes one array element, which is array element 1, and array element 1 may be a screen speaker; and It may be determined that the second type of array element includes one array element 1, which is array element 2. Because there are relatively few people in the first preset area and the current battery level of the electronic device 100 is relatively low, the number of the second type of array elements is appropriately reduced to ensure that power consumption can be reduced while the user is making a quiet call, thereby improving system performance.

[0099] In some embodiments, the number N is large if the number of people currently in the first preset area is large; or If the current remaining battery level of the electronic device is low, the value of N is reduced, or If the current location of the electronic device is within a private area, the value of N is small.

[0100] 6 , when the number of people in the first preset area becomes large, the number of the second type array elements may be appropriately increased to obtain better quiet call quality, ensuring that the people in the first preset area cannot clearly hear the sound emitted by the electronic device 100. Alternatively, when the remaining battery level of the electronic device 100 becomes low, the number of the second type array elements may be appropriately reduced to reduce the power consumption of the electronic device 100. Alternatively, when the current location of the electronic device 100 is within a user's private area, for example, at home, and the user has a relatively low requirement for quiet call quality, the number of the second type array elements may be appropriately reduced to reduce the power consumption of the electronic device 100.

[0101] In some embodiments, the distance between the N second array elements in the second type array element and the M first array elements in the first type array element falls within a first range. Specifically, the first range may be 1 millimeter to 10 centimeters. The shorter the distance between the N second array elements and the M first array elements, i.e., the shorter the distance between each of the N second array elements and each of the M first array elements, the better the sound leakage prevention effect, thereby improving the user experience.

[0102] The audio processing unit is configured to receive an initial audio signal and determine a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0103] Specifically, the first type of audio signal includes M first audio signals, and the second type of audio signal includes N second audio signals. When the electronic device 100 is in a call, the audio processing unit of the electronic device 100 may receive an initial audio signal using an antenna. Then, the audio processing unit may divide the initial audio signal into M+N signal channels, all of which are the same, i.e., have the same frequency, phase, and amplitude. Furthermore, the audio processing unit may obtain M first audio signals and N second audio signals based on the M+N signal channels.

[0104] In some embodiments, the audio processing unit is particularly configured to split the initial audio signal into M signal channels and determine the M signal channels as the M first audio signals. Specifically, after receiving the initial audio signal through the audio processing unit and determining the first type of array elements, the electronic device 100 may split the initial audio signal into M signal channels and then use the M signal channels as the M first audio signals, so that the user can clearly hear the speech content (i.e., the speech content corresponding to the initial audio signal) in the audio reproduction area after the first type of array elements produce the sound.

[0105] In some embodiments, the electronic device 100 further includes M first filters, and the audio processing unit is specifically configured to: use each first filter to perform a first filtering process on the initial audio signal to obtain M first audio signals, wherein the M first audio signals are used to cancel out interference of the N second audio signals with the M first audio signals at multiple points in the second preset area, and the first filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal, and wherein the audio reception effect of the initial audio signal after processing in the second preset area remains unchanged.

[0106] Specifically, as shown in FIG. 10 , assume that M is 1. The electronic device 100 includes one first filter, which is the first filter 1. The first filter 1 corresponds to preset amplitude adjustment and phase adjustment parameters. The input of the first filter 1 may be an initial audio signal, and the output may be the first audio signal. If M is an integer greater than 1, that is, if the electronic device 100 includes multiple first filters, the preset amplitude adjustment and phase adjustment parameters corresponding to the first filters may be different. The first filter 1 may perform amplitude adjustment and / or phase adjustment processing on the received initial audio signal based on the preset amplitude adjustment and phase adjustment parameters to obtain the first audio signal. The first array element 1 does not directly output the initial audio signal, but outputs a processed audio signal to cancel interference with the audio waves output by the first type array element caused by the audio waves output by the second type array element at multiple points within the audio reproduction area, so that the audio reception effect within the audio reproduction area remains unchanged, thereby improving the user experience.

[0107] In some embodiments, the electronic device 100 further includes N second filters, and the audio processing unit is particularly configured to: use each second filter to perform a second filtering process on the initial audio signal to obtain N second audio signals, wherein the second filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal, and in the first preset area, the sound leakage effect of the processed initial audio signal is reduced.

[0108] Specifically, assume that N is 2, as shown in FIG. 11 . The electronic device 100 includes two second filters, i.e., second filter 1 and second filter 2. Second filter 1 and second filter 2 correspond to different preset amplitude and phase adjustment parameters, respectively. The input of both second filter 1 and second filter 2 may be an initial audio signal, and the output may be a second audio signal. Second filter 1 and second filter 2 may process the initial audio signal based on the preset amplitude and phase adjustment parameters corresponding to the second filter, respectively, to obtain two second audio signals. Furthermore, the second type array element may separately output second audio signals for superimposition and cancellation with the leakage sound of the first type array element at multiple points within the sound leakage prevention area (i.e., the surrounding area), thereby reducing the sound leakage effect within the sound leakage prevention area and thereby realizing private calls and improving user experience.

[0109] For example, as shown in FIG. 12 , if the second-type array elements do not produce sound and only the first-type array elements, e.g., array element 1, produce sound, others in the area around the user can hear the sound leaking from array element 1, and call privacy cannot be guaranteed. However, in this application, the second-type array elements and the second-type array elements are introduced to simultaneously produce sound. The sound waves output by the second-type array elements and the first-type array elements are superimposed and canceled out at multiple points in the area around the user. In this way, the sound leakage sound pressure of the first-type array elements in the area around the user is reduced, and others in the area around the user cannot clearly hear the sound emitted by the first-type array elements, thereby realizing a completely private call and improving the user experience.

[0110] The audio processing unit is further configured to transmit audio signals of the first type to the array elements of the first type and audio signals of the second type to the array elements of the second type.

[0111] Specifically, after the audio processing unit determines a first type of audio signal and a second type of audio signal based on the initial audio signal, the audio processing unit further sends the first type of audio signal to the first type of array element and sends the second type of audio signal to the second type of array element, where one audio signal corresponds to one array element.

[0112] For example, as shown in FIG. 9 , the audio processing unit may separately transmit M first audio signals in the acquired first-type audio signal to corresponding first array elements. In addition, the audio processing unit may also separately transmit N second audio signals in the acquired second-type audio signal to corresponding second array elements, so that the first-type array elements and the second-type array elements can then simultaneously produce sound. The sound waves output by the second-type array elements and the first-type array elements are superimposed and canceled out at multiple points in the area around the user. In this way, the sound leakage sound pressure of the first-type array elements in the area around the user is reduced, and other people in the area around the user cannot clearly hear the sounds emitted by the first-type array elements, thereby realizing a completely private call and improving the user experience.

[0113] The M first array elements in the first type of array element are configured to output M first acoustic signals based on corresponding first audio signals.

[0114] Specifically, after receiving the first audio signal, each first array element in the first-type array elements may convert the audio signal into a sound wave signal and output the sound wave signal, so that the user can clearly hear the call content (i.e., the call content corresponding to the initial audio signal) in the audio reproduction area. In addition, if the first-type array elements do not directly output the initial audio signal but output processed audio signals, the interference on the sound waves output by the first-type array elements caused by the sound waves output by the second-type array elements at multiple points in the audio reproduction area can be canceled out, so that the audio reception effect in the audio reproduction area remains unchanged, thereby improving the user experience.

[0115] The N second array elements in the second type of array element are configured to output N second sound signals based on the corresponding second audio signals.

[0116] Specifically, after receiving the second audio signal, each second array element in the second-type array elements may convert the audio signal into a sound wave signal and output the sound wave signal together with the sound wave signal of the first-type array element, so that the sound waves output by the second-type array elements can be superimposed and canceled out with the leakage sounds of the first-type array elements at multiple points in the sound leakage prevention area (i.e., the surrounding area). In this way, the sound leakage effect in the sound leakage prevention area is reduced, i.e., the sound leakage sound pressure of the first-type array elements is reduced in the area around the user, and other people in the surrounding area cannot clearly hear the sounds emitted by the first-type array elements, thereby realizing a completely private call and improving the user experience.

[0117] In some embodiments, as shown in FIG. 13 , the electronic device 100 further includes M+N power amplifier circuits, each power amplifier circuit corresponding to one audio signal; the audio processing unit is further configured to amplify the M first audio signals and the N second audio signals using the M+N power amplifier circuits, respectively, to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type of array element are specifically configured to output M first sound wave signals based on the processed first type of audio signals, and the second type of array element is specifically configured to output N second sound wave signals based on the processed second type of audio signals.

[0118] Specifically, after the M first filters and the N second filters separately perform amplitude adjustment processing and / or phase adjustment processing on the initial audio signals, M first audio signals and N second audio signals may be obtained, and then the M first audio signals and N second audio signals may be separately input into corresponding power amplifier circuits for processing to amplify the audio signals and drive the array elements to emit sounds, so that the user can hear the audio more clearly, thereby improving the user experience.

[0119] In the following, a method for determining filter parameters corresponding to each array element according to an embodiment of the present application will be described with reference to FIG.

[0120] Step S301: Collect the transfer function from each array element to each area.

[0121] Specifically, a first preset area (surrounding area) and a second preset area (audio reproduction area) may be first determined, a plurality of first sampling points may be determined from the first preset area, and a plurality of second sampling points may be determined from the second preset area. Furthermore, the electronic device 100 may use all of the plurality of array elements to reproduce the same frequency sweep signal, and collect the sound wave signals output by each array element at each sampling point to obtain a transfer function from each array element to each sampling point.

[0122] 15 , the target sampling point a is one of a plurality of first sampling points, and three array elements, namely, array element 1, array element 2, and array element 3, are arranged on the electronic device 100. The array element 1 is a first type of array element, and the array element 2 and array element 3 are second type of array elements. The electronic device 100 uses the array element 1 to play a frequency sweep signal, collects the sound wave signal output by the array element 1 at the target sampling point a, and

[0123]

number

[0124] (i.e., the transfer function of array element 1 at target sampling point a), and the electronic device 100 uses array element 2 to play the frequency sweep signal, and collects the sound wave signal output by array element 2 at target sampling point a;

[0125]

number

[0126] (i.e., the transfer function of array element 2 at target sampling point a), and the electronic device 100 uses array element 3 to play a frequency sweep signal, and collects the sound wave signal output by array element 3 at target sampling point a,

[0127]

number

[0128] (i.e., the transfer function of array element 3 at target sampling point a) is obtained. Similarly, the transfer function from each array element to each sampling point can be obtained. The transfer functions corresponding to the plurality of first sampling points are given by

[0129]

number

[0130] and the transfer functions corresponding to the second sampling points may be expressed as:

[0131]

number

[0132] It should be noted that the term "internal" can be expressed as:

[0133] Step S302: Step S302: Determine the filter corresponding to each array element based on a preset algorithm.

[0134] Specifically, based on the above acquired transfer function data, the filter parameters corresponding to each array element can be calculated using a preset algorithm (eg, a neural network algorithm).

[0135] For example, in a scenario where the electronic device 100 includes three array elements, to ensure that the sound waves generated by the array elements can be superimposed and cancelled out within a first preset area (i.e., a peripheral area), the filter parameters (i.e., the preset amplitude adjustment and phase adjustment parameters described above) corresponding to array element 2 and array element 3 may be determined based on transfer functions respectively corresponding to the plurality of first sampling points. Suppose the plurality of first sampling points includes four points a, b, c, and d, and the transfer functions respectively corresponding to the first sampling points are:

[0136]

number

[0137] Assume that the filter parameter w2 corresponding to array element 2 and the filter parameter w3 corresponding to array element 3 can be determined separately based on Equation 1.

[0138]

number

[0139] Individually, i can be a, b, c, or d. w2 and w3 can be calculated comprehensively by individually substituting the transfer functions into Equation 1. Because multiple first collection points in the first preset area are taken into account when w2 and w3 are calculated, it can be ensured that when any audio signal is processed based on w2 and w3, superposition and cancellation between the sound wave signals output by the second type array elements and the first type array elements can be achieved at multiple points in the first preset area, thereby realizing completely private calls and improving user experience.

[0140] In addition, to ensure that the sound reproduction effect within the second preset area (i.e., the sound reproduction area) remains unchanged, the filter parameters (i.e., the above-mentioned preset amplitude adjustment and phase adjustment parameters) corresponding to array element 1 can be determined based on transfer functions respectively corresponding to multiple second sampling points.

[0141] For example, the plurality of second sampling points includes four points e, f, g, and h, and the transfer functions corresponding to the second sampling points respectively are as follows:

[0142]

number

[0143] The filter parameter w1 corresponding to array element 1 can be determined based on Equation 2.

[0144]

number

[0145] where H is a frequency sweep signal, and i can be e, f, g, or h individually. w1 can be comprehensively calculated by individually substituting the transfer functions into Equation 2. Because multiple second collection points in the second preset area are taken into account when calculating w1, it can be ensured that when any audio signal is processed based on w1, the interference caused by the sound waves output by the second type array elements on the sound waves output by the first type array elements can be canceled out at multiple points in the second preset area (audio reproduction area), so that the audio reception effect in the audio reproduction area remains unchanged and thereby improves the user experience.

[0146] After w1 corresponding to array element 1, w2 corresponding to array element 2, and w3 corresponding to array element 3 are determined, these filter parameters may be pre-stored locally within electronic device 100. After electronic device 100 enables quiet mode, the pre-stored filter parameters may be invoked to process the initial audio signal received by electronic device 100 to achieve quiet talk and improve the user experience.

[0147] For example, as shown in Figures 16(a) and 16(b), Figures 16(a) and 16(b) are diagrams of frequency response curves in the human ear area and the peripheral area according to an embodiment of this application. The frequency response curve in the peripheral area in Figure 16(a) (solid line marked with an o) is lower than the frequency response curve in the peripheral area before the implementation of this application (solid line marked with an x), and the frequency response curves in the human ear area are basically identical (solid and dashed lines). This indicates that the technical solution provided in this application can reduce sound leakage from a mobile phone to the peripheral area as much as possible without changing the user's hearing sensation. Figure 16(b) shows an acoustic contrast (AC) curve. The acoustic contrast is the average sound pressure level in the in-ear area minus the average sound pressure level in the peripheral area. A lower acoustic contrast indicates a more serious sound leakage problem. FIG. 16(b) shows that after the solution of this application is implemented, the acoustic contrast is significantly increased, indicating that the volume of the leakage sound is significantly reduced.

[0148] Referring to Fig. 17, an embodiment of this application provides a sound leakage prevention method applied to an electronic device. The electronic device includes a display, an audio processing unit, a first type of array elements, and a second type of array elements. The first type of array elements includes M first array elements, and the second type of array elements includes N second array elements, where M and N are integers greater than 0.

[0149] Step S401: When the electronic device is in a call, display a first interface on the display.

[0150] Specifically, the first interface may be the user interface 22 in Fig. 3b(a). For a detailed description, please refer to the above related description of the user interface 22. The details will not be described again here.

[0151] Step S402: In response to a user's preset operation on the preset area in the first interface, a second interface is displayed.

[0152] Specifically, the preset area may be the area 204 in the user interface 22. The preset operation may be a downward sliding operation in the preset area. The second interface may be the user interface 23 in Fig. 3b(b). For a detailed description, please refer to the above related description of the user interface 23. The details will not be described again here.

[0153] Step S403: Receive and respond to a touch operation on the first control in the second interface.

[0154] Specifically, the first control may be a control 205 in the user interface 23 .

[0155] Step S404: Receive an initial audio signal through the audio processing unit, and determine a first type audio signal and a second type audio signal according to the initial audio signal.

[0156] The first type of audio signal includes M first audio signals, and the second type of audio signal includes N second audio signals.

[0157] Step S405: Send a first type of audio signal to the first type of array element, and send a second type of audio signal to the second type of array element.

[0158] One audio signal corresponds to one array element.

[0159] Step S406: Output M first sound wave signals through the M first array elements in the first type array element according to the corresponding first audio signals.

[0160] Step S407: Output N second sound wave signals through the N second array elements in the second type array elements according to the corresponding second audio signals.

[0161] Specifically, the N second acoustic signals are used to overlap and cancel with the M first acoustic signals at multiple points within the first preset area.

[0162] In this application, a plurality of array elements may be configured on an electronic device, and the plurality of array elements may include first-type array elements and second-type array elements. During a call process, the audio processing unit may process an initial audio signal to be played to obtain M first audio signals and N second audio signals, and transmit the M first audio signals to corresponding first array elements and the N second audio signals to corresponding second array elements. Furthermore, the first array elements and the second array elements may simultaneously output different sound wave signals based on the received audio signals, so that the N second audio wave signals output by the N second-type array elements are superimposed and cancelled out with the leakage sounds of the first-type array elements at multiple points within the sound leakage prevention area (i.e., the area surrounding the electronic device). In this way, the sound leakage effect in the sound leakage prevention area is reduced, thereby realizing private calls and improving user experience.

[0163] Referring to Fig. 18, an embodiment of this application provides a sound leakage prevention method applied to an electronic device. The electronic device includes an audio processing unit, a first type of array elements, and a second type of array elements. The first type of array elements includes M first array elements, and the second type of array elements includes N second array elements, where M and N are integers greater than 0.

[0164] Step S501: Receive an initial audio signal through an audio processing unit, and determine a first type of audio signal and a second type of audio signal according to the initial audio signal.

[0165] The first type of audio signal includes M first audio signals, and the second type of audio signal includes N second audio signals.

[0166] Step S502: Send a first type of audio signal to the first type of array element, and send a second type of audio signal to the second type of array element.

[0167] Specifically, one audio signal corresponds to one array element.

[0168] Step S503: Output M first sound wave signals through M first array elements in the first type array element according to the corresponding first audio signals.

[0169] Step S504: Output N second sound wave signals through N second array elements in the second type array elements according to the corresponding second audio signals.

[0170] Specifically, the N second acoustic signals are used to overlap and cancel with the M first acoustic signals at multiple points within the first preset area.

[0171] In some embodiments, the electronic device further includes M first filters, and the method further includes a step of performing a first filtering process on the initial audio signal using each first filter to obtain M first audio signals, wherein the M first audio signals are used to cancel out interference of N second audio signals with the M first audio signals at multiple points within the second preset area, and the first filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal, and the audio reception effect of the initial audio signal after processing remains unchanged within the second preset area.

[0172] In some embodiments, the first preset area is a sound leakage prevention area and the second preset area is an audio reproduction area, and the first preset area is larger than the second preset area.

[0173] In some embodiments, the electronic device further includes N second filters, and the method further includes a step of performing a second filtering process on the initial audio signal using each second filter to obtain N second audio signals, wherein the second filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal, and the sound leakage prevention effect of the processed initial audio signal within the first preset area is reduced.

[0174] In some embodiments, the electronic device includes Q array elements, where Q is greater than or equal to M+N, and the method further includes obtaining determination information, where the determination information includes one or more of a current number of people in a first preset area, a current remaining battery level of the electronic device, or a current location of the electronic device, and determining, from the Q array elements, M first array elements in a first type of array element and N second array elements in a second type of array element based on the determination information.

[0175] In some embodiments, the value of N increases if the number of people currently in the first preset area increases; or If the current remaining battery level of the electronic device is low, the value of N is reduced, or If the current location of the electronic device is within a private area, the value of N is small.

[0176] In some embodiments, the electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponding to one audio signal, and the method further includes utilizing the M+N power amplifier circuits to amplify the M first audio signals and the N second audio signals, respectively, to obtain M processed first audio signals and N processed second audio signals, wherein the M first array elements in the first type of array element are specifically configured to output M first acoustic signals based on the processed first type of audio signals, and the second type of array element is specifically configured to output N second acoustic signals based on the processed second type of audio signals.

[0177] In summary, in this application, a plurality of array elements may be configured on an electronic device, and the plurality of array elements may include first-type array elements and second-type array elements. During a call process, the audio processing unit may process an initial audio signal to be played to obtain M first audio signals and N second audio signals, and transmit the M first audio signals to corresponding first array elements, respectively, and transmit the N second audio signals to corresponding second array elements, respectively. Furthermore, the first array elements and the second array elements may simultaneously output different sound wave signals based on the received audio signals, so that the N second audio wave signals output by the N second-type array elements are superimposed and canceled out with the leakage sounds of the first-type array elements at multiple points within the sound leakage prevention area (i.e., the area surrounding the electronic device). In this way, the sound leakage effect is reduced within the sound leakage prevention area, thereby realizing private calls and improving user experience.

[0178] This application provides a computer storage medium that stores a computer program, which, when executed by a processor, performs any one of the above sound leakage prevention methods.

[0179] An embodiment of the present application provides an electronic device. The electronic device includes a processor configured to support the electronic device and realize corresponding functions in any one of the above sound leakage prevention methods. The electronic device may further include a memory configured to be coupled to the processor and storing program instructions and data required for the electronic device. The electronic device may further include a communication interface used for communication between the electronic device and another device or a communication network.

[0180] This application provides a chip system. The chip system includes a processor configured to support an electronic device and perform the functions described above, such as generating or processing information in the sound leakage prevention method described above. In a possible design, the chip system further includes a memory configured to store program instructions and data required by the electronic device. The chip system may include a chip or may include a chip and other separate components.

[0181] This application provides a computer program, which includes instructions, and when executed by a computer, enables the computer to perform the above-mentioned sound leakage prevention method.

[0182] In the above embodiments, the description of the embodiments has its own focus, and for the parts not described in detail in the embodiments, please refer to the related descriptions in other embodiments.

[0183] It should be noted that for the sake of simplicity, the above method embodiments are expressed as a combination of a series of actions. However, those skilled in the art should recognize that this application is not limited to the order of the actions described, as some steps may be performed in other orders or simultaneously according to this application. In addition, those skilled in the art should also recognize that all embodiments described in the specification are preferred embodiments, and the associated actions and modules are not necessarily essential to this application.

[0184] In some embodiments provided in this application, it should be understood that the disclosed devices may be implemented in other ways. For example, the described device embodiments are merely examples. For example, the division into units is merely a logical functional division. In actual implementation, other division methods may exist. For example, multiple units or components may be combined or integrated into other systems, or some features may be omitted or not implemented. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be realized through some interfaces, and indirect connections or communication connections between devices or units may be implemented in electrical or other forms.

[0185] The units described as separate parts may or may not be physically separate, and the parts shown as units may or may not be physical units, and may be located in one place or distributed over multiple network units. Some or all of the units may be selected according to actual requirements to achieve the objectives of the solutions in the embodiments.

[0186] In addition, the functional units in the embodiments of this application may be integrated into one processing unit, each unit may exist physically independently, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0187] When an integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application may essentially be implemented in the form of a software product, or a portion of the technical solution, or all or a portion of the technical solution. The computer software product is stored in a storage medium and includes instructions for instructing a computer device (which may be a personal computer, a server, or a network device, specifically a processor in the computer device) to perform all or a portion of the steps of the above-mentioned methods described in the embodiments of this application. The storage medium may include any medium capable of storing program code, such as a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0188] The above embodiments are merely used to describe the technical solutions of this application, and do not limit the technical solutions of this application. Although this application has been described in detail in connection with the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or perform equivalent substitutions for some technical features. However, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions in the embodiments of this application.

Claims

1. 1. An electronic device comprising: the electronic device includes an audio processing unit, a first type of array elements, and a second type of array elements, the first type of array elements including M first array elements and the second type of array elements including N second array elements, where M and N are integers greater than 0; The audio processing unit receiving an initial audio signal; and determining a first type of audio signal and a second type of audio signal based on the initial audio signal, wherein the first type of audio signal includes M first audio signals and the second type of audio signal includes N second audio signals; configured to transmit the first type of audio signals to the first type of array elements and the second type of audio signals to the second type of array elements, one audio signal corresponding to one array element; the M first array elements in the first type of array element are configured to output M first sound wave signals based on the corresponding first audio signals; the N second array elements in the second type array element are configured to output N second sound wave signals based on the corresponding second audio signals, and the N second sound wave signals are used for superposition and cancellation with the M first sound wave signals at a plurality of points within a first preset area; Electronic devices.

2. the electronic device further includes M first filters; The audio processing unit and performing a first filtering process on the initial audio signal using each first filter to obtain the M first audio signals, the M first audio signals being used to cancel interference of the N second audio signals with the M first audio signals at a plurality of points within a second preset area, the first filtering process including performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signals. The device of claim 1 .

3. The first preset area is a sound leakage prevention area, and the second preset area is an audio playback area. The device of claim 2 .

4. the electronic device further includes N second filters; The audio processing unit and performing a second filtering process on the initial audio signal using each second filter to obtain the N second audio signals, wherein the second filtering process includes performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal. A device according to any one of claims 1 to 3.

5. the electronic device includes Q array elements, where Q is greater than or equal to M+N; The audio processing unit obtaining determination information, the determination information including one or more of a current number of people in the first preset area, a current remaining battery level of the electronic device, or a current location of the electronic device; determining, from the Q array elements, the M first array elements within the first type of array elements and the N second array elements within the second type of array elements based on the determination information; further configured as follows: A device according to any one of claims 1 to 4.

6. If the number of people currently in the first preset area is large, the value of N is large; or The value of N decreases if the current remaining battery level of the electronic device decreases; or If the current location of the electronic device is within a private area, the value of N is small. The device of claim 5.

7. a distance between the N second array elements in the second type of array element and the M first array elements in the first type of array element falls within a first range; 7. A device according to claim 5 or 6.

8. the electronic device further includes M+N power amplifier circuits, each power amplifier circuit corresponding to one audio signal; The audio processing unit further configured to utilize the M+N power amplifier circuits to amplify the M first audio signals and the N second audio signals, respectively, to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type array element are specifically configured to output the M first sound wave signals based on the processed first type audio signal; the second type array elements are specifically configured to output the N second sound wave signals based on the processed second type audio signals. A device according to any one of claims 1 to 7.

9. A sound leakage prevention method applied to an electronic device, the electronic device including a display, an audio processing unit, a first type of array elements, and a second type of array elements, the first type of array elements including M first array elements, and the second type of array elements including N second array elements, where M and N are integers greater than 0; The method comprises: When the electronic device is in a call, displaying a first interface on the display, receiving and responding to a user's preset operation on a preset area in the first interface, and displaying a second interface, receiving and responding to a user's touch operation on a first control in the second interface; receiving an initial audio signal through the audio processing unit; determining a first type of audio signal and a second type of audio signal based on the initial audio signal, wherein the first type of audio signal includes M first audio signals and the second type of audio signal includes N second audio signals; and transmitting the first type of audio signal to the first type array elements and the second type of audio signal to the second type array elements, wherein one audio signal corresponds to one array element; outputting M first sound wave signals through the M first array elements in the first type array element based on the corresponding first audio signals; outputting N second sound wave signals based on the corresponding second audio signals through the N second array elements in the second type array elements, the N second sound wave signals being used for superposition and cancellation with the M first sound wave signals at multiple points within a first preset area; A method comprising:

10. A sound leakage prevention method applicable to an electronic device, the electronic device including: an audio processing unit; a first type of array elements; and a second type of array elements, the first type of array elements including M first array elements and the second type of array elements including N second array elements, where M and N are integers greater than 0; The method comprises: receiving an initial audio signal through the audio processing unit; determining a first type of audio signal and a second type of audio signal based on the initial audio signal, wherein the first type of audio signal includes M first audio signals and the second type of audio signal includes N second audio signals; and transmitting the first type of audio signal to the first type array elements and the second type of audio signal to the second type array elements, wherein one audio signal corresponds to one array element; outputting M first sound wave signals through the M first array elements in the first type array element based on the corresponding first audio signals; outputting N second sound wave signals based on the corresponding second audio signals through the N second array elements in the second type array elements, the N second sound wave signals being used for superposition and cancellation with the M first sound wave signals at a plurality of points within a first preset area; A method comprising:

11. the electronic device further includes M first filters; The method comprises: The method further includes the step of: performing a first filtering process on the initial audio signal using each first filter to obtain the M first audio signals, wherein the M first audio signals are used to cancel interference of the N second audio signals with the M first audio signals at multiple points within a second preset area, the first filtering process including performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal, and the audio reception effect of the initial audio signal after processing in the second preset area remains unchanged. The method of claim 10.

12. the first preset area is a sound leakage prevention area, the second preset area is an audio reproduction area, and the first preset area is larger than the second preset area; The method of claim 11.

13. the electronic device further includes N second filters; The method comprises: The method further includes a step of performing a second filtering process on the initial audio signal using each second filter to obtain the N second audio signals, the second filtering process including performing an amplitude adjustment process and / or a phase adjustment process on the initial audio signal, and the sound leakage prevention effect of the processed initial audio signal within the first preset area is reduced. The method according to any one of claims 10 to 12.

14. the electronic device includes Q array elements, where Q is greater than or equal to M+N; The method comprises: obtaining determination information, the determination information including one or more of a current number of people in the first preset area, a current remaining battery level of the electronic device, or a current location of the electronic device; determining, from the Q array elements, the M first array elements within the first type of array elements and the N second array elements within the second type of array elements based on the determination information; further comprising: The method according to any one of claims 10 to 13.

15. If the number of people currently in the first preset area is large, the value of N is large; or The value of N decreases if the current remaining battery level of the electronic device decreases; or If the current location of the electronic device is within a private area, the value of N is small.

15. The method of claim 14.

16. a distance between the N second array elements in the second type of array element and the M first array elements in the first type of array element falls within a first range; 16. The method of claim 14 or 15.

17. the electronic device further includes M+N power amplifier circuits, each power amplifier circuit corresponding to one audio signal; The method comprises: further comprising: amplifying the M first audio signals and the N second audio signals using the M+N power amplifier circuits, respectively, to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type array element are specifically configured to output the M first sound wave signals based on the processed first type audio signal; the second type array elements are specifically configured to output the N second sound wave signals based on the processed second type audio signals. The method according to any one of claims 10 to 16.

18. 18. An electronic device comprising a memory and one or more processors, the memory coupled to the one or more processors, the memory configured to store computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions, whereby the electronic device performs the method of any one of claims 10 to 17.

19. A chip system comprising at least one processor, a memory, and an interface circuit, the memory, the interface circuit, and the at least one processor being interconnected through lines, the at least one memory storing instructions, and when the instructions are executed by the processor, the method of any one of claims 10 to 17 is performed.

20. A computer readable storage medium comprising instructions which, when executed on an electronic device, enable the electronic device to perform the method of any one of claims 10 to 17.

21. 18. A computer program product comprising computer instructions that, when executed on an electronic device, enable the electronic device to perform the method of any one of claims 10 to 17.

Images