Electronic device and related sound leakage prevention method

Abstract

Disclosed in the embodiments of the present application are an electronic device and a related sound leakage prevention method. The electronic device comprises an audio processing unit, a first-type array element and a second-type array element, wherein the audio processing unit is configured to receive an initial audio signal and determine a first-type audio signal and a second-type audio signal on the basis of the initial audio signal, the first-type audio signal comprising M first audio signals, and the second-type audio signal comprising N second audio signals, and send the first-type audio signal to the first-type array element, and send the second-type audio signal to the second-type array element, the first-type array element being used for outputting M first sound-wave signals on the basis of the corresponding first audio signals, the second-type array element being used for outputting N second sound-wave signals on the basis of the corresponding second audio signals, and the N second sound-wave signals being used for being superimposed with the M first sound-wave signals at a plurality of position points in a first preset region, so that the signals are cancelled out. By using the embodiments of the present application, a private call can be realized when an electronic device is used for performing calling, thereby improving the user experience.

Description

Electronic equipment and related sound leakage prevention method

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on August 18, 2023, with application number 202311050596.1, and priority to the Chinese patent application entitled “Electronic equipment and related anti-sound leakage methods”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of smart terminal technology, and in particular to electronic devices and related sound leakage prevention methods. Background Art

[0003] With the prevalence of full-screen phones, the receiver has been relocated to the top of the screen, exacerbating the problem of sound leakage during handheld calls. An effective sound leakage prevention solution can free users from the current situation of being forced to use headphones for private calls, enabling fully private conversations while holding their hands. Currently, various technical solutions can reduce sound leakage from mobile phones, but these solutions are not very effective. Therefore, improving sound leakage prevention is a current and future research direction.

[0004] Summary of the Invention

[0005] The embodiments of the present application provide electronic devices and related sound leakage prevention methods to ensure privacy when making calls using electronic devices and improve user experience.

[0006] In a first aspect, an embodiment of the present application provides an electronic device, comprising an audio processing unit, a first-type array element, and a second-type array element, wherein the first-type array element comprises M first array elements and the second-type array element comprises N second array elements, where M and N are integers greater than 0; the audio processing unit is configured to: receive an initial audio signal and determine a first-type audio signal and a second-type audio signal based on the initial audio signal; wherein the first-type audio signal comprises M first audio signals and the second-type audio signal comprises N second audio signals; send the first-type audio signal to the first-type array element and send the second-type audio signal to the second-type array element, with one audio signal corresponding to one array element; the M first array elements in the first-type array element are configured to: output M first sound wave signals based on the corresponding first audio signals; the N second array elements in the second-type array element are configured to: output N second sound wave signals based on the corresponding second audio signals; the N second sound wave signals are configured to be superimposed and canceled with the M first sound wave signals at multiple position points within a first preset area.

[0007] In an embodiment of the present application, a plurality of array elements may be configured on the electronic device, wherein the plurality of array elements may include first-type array elements and second-type array elements. During a call, the audio processing unit may process the initial audio signal to be played to obtain M first audio signals and N second audio signals, and may send the M first audio signals to the corresponding first array elements, and send the N second audio signals to the corresponding second array elements. Furthermore, the first array element and the second array element may respectively output different sound wave signals based on the received audio signal at the same time, so that the N second sound wave signals output by the N second-type array elements are superimposed and canceled with the sound leakage of the first-type array elements at multiple position points within the anti-leakage area (i.e., the surrounding area of ​​the electronic device), so that the audio leakage effect in the anti-leakage area is reduced, privacy calls are achieved, and the user experience is improved.

[0008] In some embodiments, the electronic device also includes M first filters and an audio processing unit, and is further used to: perform first filtering processing on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering processing includes amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0009] In an embodiment of the present application, the input of the first filter may be an initial audio signal, and the output may be a first audio signal. If M is an integer greater than 1, that is, the electronic device includes multiple first filters, then the preset amplitude modulation and phase modulation parameters corresponding to each first filter may be different. The first filter may perform amplitude modulation and / or phase modulation processing on the received initial audio signal based on the preset amplitude modulation and phase modulation parameters to obtain the first audio signal. The first array element does not directly output the initial audio signal, but outputs a processed audio signal to eliminate the interference of the sound waves output by the second type of array element on the sound waves output by the first type of array element at multiple positions within the audio playback area, so that the audio reception effect within the audio playback area remains unchanged, thereby improving the user experience.

[0010] In some embodiments, the first preset area is a sound leakage prevention area, and the second preset area is an audio playback area.

[0011] In some embodiments, the electronic device also includes N second filters and an audio processing unit, which is further used to: perform second filtering processing on the initial audio signal through each second filter to obtain N second audio signals; the second filtering processing includes amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0012] In an embodiment of the present application, different second filters may correspond to different preset amplitude modulation and phase modulation parameters, and the input of the second filter may be an initial audio signal, and the output may be a second audio signal. The second filter may process the initial audio signal based on the corresponding preset amplitude modulation and phase modulation parameters to obtain N second audio signals. Furthermore, the second type of array element may output a second audio signal respectively, so as to superimpose and cancel the leakage of the first type of array element at multiple positions in the anti-leakage area (i.e., the surrounding area), thereby reducing the audio leakage effect in the anti-leakage area, achieving privacy calls, and improving user experience.

[0013] In some embodiments, the electronic device includes Q array elements, where Q is greater than or equal to M+N, and the audio processing unit is further used to: obtain judgment information, the judgment information including one or more of the number of people in the current first preset area, the remaining power of the current electronic device, and the location of the current electronic device; based on the judgment information, determine M first array elements in the first category of array elements and N second array elements in the second category of array elements from the Q array elements.

[0014] In an embodiment of the present application, the electronic device can obtain decision information through the audio processing unit. This decision information may include, but is not limited to, the number of people within the first preset area, the remaining battery level of the electronic device, and the current location of the electronic device. Furthermore, based on the decision information, the electronic device can determine, from the Q array elements, M first array elements of the first category and N second array elements of the second category, to select different array elements for different application scenarios, thereby improving system performance.

[0015] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current electronic device is located in a private area, the smaller the value of N.

[0016] In an embodiment of the present application, if the number of people in the first preset area increases, the number of second-type elements can be appropriately increased to ensure that people in the first preset area cannot clearly hear the sound emitted by the electronic device, thereby achieving better quiet call quality. Alternatively, when the remaining battery power of the electronic device is low, the number of second-type elements can be appropriately reduced to reduce the power consumption of the electronic device. Alternatively, if the current electronic device is located in a private area of ​​the user, such as at home, and the user has lower requirements for quiet call quality, the number of second-type elements can be appropriately reduced to reduce the power consumption of the electronic device.

[0017] In some embodiments, the distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

[0018] In the embodiment of the present application, the closer the distance between the N second array elements and the M first array elements, that is, the closer the distance between each of the N second array elements and each of the M first array elements, the better the sound leakage prevention effect, and the improved user experience.

[0019] In some embodiments, the electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponding to one audio signal, and the audio processing unit is further used to: amplify the M first audio signals and the N second audio signals respectively through the M+N power amplifier circuits to obtain the processed M first audio signals and the processed N second audio signals; the M first array elements in the first type of array elements are specifically used to output the M first sound wave signals based on the processed first type audio signals; the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0020] In an embodiment of the present application, after the M first filters and the N second filters respectively perform amplitude modulation processing and / or phase modulation processing on the initial audio signal, M first audio signals and N second audio signals can be obtained. Then, the M first audio signals and the N second audio signals can be respectively input into corresponding power amplifier circuits for processing to amplify the audio signals and promote the sound of each array element. The user can hear clearer sound, thereby improving the user experience.

[0021] In a second aspect, an embodiment of the present application provides a method for preventing sound leakage, which is applied to an electronic device, wherein the electronic device includes a display screen, an audio processing unit, a first type of array element and a second type of array element, the first type of array element includes M first array elements, the second type of array element includes N second array elements, and M and N are integers greater than 0; when the electronic device is in a call, a first interface is displayed through the display screen; a preset operation of a user for a preset area in the first interface is received and responded to, and a second interface is displayed; a touch operation for a first control in the second interface is received and responded to; an initial audio signal is received through the audio processing unit, and a first type of audio signal is determined based on the initial audio signal. and a second type of audio signal; wherein the first type of audio signal includes M first audio signals, and the second type of audio signal includes N second audio signals; the first type of audio signal is sent to the first type of array element, and the second type of audio signal is sent to the second type of array element, and one audio signal corresponds to one array element; through the M first array elements in the first type of array elements, based on the corresponding first audio signal, M first sound wave signals are output; through the N second array elements in the second type of array elements, based on the corresponding second audio signal, N second sound wave signals are output; the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

[0022] In a third aspect, an embodiment of the present application provides a method for preventing sound leakage, which is applied to an electronic device, wherein the electronic device includes an audio processing unit, a first-class array element, and a second-class array element, the first-class array element includes M first array elements, the second-class array element includes N second array elements, and M and N are integers greater than 0; an initial audio signal is received through the audio processing unit, and a first-class audio signal and a second-class audio signal are determined based on the initial audio signal; wherein the first-class audio signal includes M first audio signals, and the second-class audio signal includes N second audio signals; the first-class audio signal is sent to the first-class array element, and the second-class audio signal is sent to the second-class array element, and one audio signal corresponds to one array element; M first array elements in the first-class array element output M first sound wave signals based on the corresponding first audio signal; N second array elements in the second-class array element output N second sound wave signals based on the corresponding second audio signal; the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within a first preset area.

[0023] In some embodiments, the electronic device also includes M first filters, and the method also includes: performing first filtering processing on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within the second preset area; the first filtering processing includes amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0024] In some embodiments, the first preset area is a sound leakage prevention area, and the second preset area is an audio playback area.

[0025] In some embodiments, the electronic device further includes N second filters, and the method further includes: performing a second filtering process on the initial audio signal through each second filter to obtain N second audio signals; the second filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0026] In some embodiments, the distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

[0027] In some embodiments, the electronic device includes Q array elements, where Q is greater than or equal to M+N, and the method further includes: obtaining judgment information, the judgment information including one or more of the number of people in the current first preset area, the remaining power of the current electronic device, and the current location of the electronic device; based on the judgment information, determining M first array elements in the first category of array elements and N second array elements in the second category of array elements from the Q array elements.

[0028] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current electronic device is located in a private area, the smaller the value of N.

[0029] In some embodiments, the electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponding to one audio signal, and the method further includes: amplifying the M first audio signals and the N second audio signals respectively by the M+N power amplifier circuits to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type of array elements are specifically used to output M first sound wave signals based on the processed first type audio signals; and the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0030] In a fourth aspect, an electronic device is provided, comprising: a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute a method such as the second aspect or any one of the embodiments of the second aspect, or the third aspect or any one of the embodiments of the third aspect.

[0031] In a fifth aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on an electronic device, cause the electronic device to execute a method according to the second aspect or any one of the embodiments of the second aspect, or a method according to the third aspect or any one of the embodiments of the third aspect.

[0032] In a sixth aspect, a computer program product is provided, which, when run on a computer, enables the computer to execute the method of the second aspect or any one of the embodiments of the second aspect, or the method of the third aspect or any one of the embodiments of the third aspect.

[0033] In the seventh aspect, a chip system is provided, which includes at least one processor for implementing the method of the second aspect or any one of the embodiments of the second aspect, or the method of the third aspect or any one of the embodiments of the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0035] FIG2 is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application.

[0036] Figures 3a-3e are a set of user interface schematic diagrams provided in an embodiment of the present application.

[0037] FIG4 is a schematic structural diagram of a smart phone provided in an embodiment of the present application.

[0038] FIG5 is a schematic structural diagram of a smart head-mounted device provided in an embodiment of the present application.

[0039] FIG6 is a schematic diagram of a call scenario provided in an embodiment of the present application.

[0040] FIG7 is a schematic diagram of an array element provided in an embodiment of the present application.

[0041] FIG8 is a schematic diagram of another array element provided in an embodiment of the present application.

[0042] FIG9 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0043] FIG10 is a schematic diagram of a filter provided in an embodiment of the present application.

[0044] FIG11 is a schematic diagram of another filter provided in an embodiment of the present application.

[0045] FIG12 is a schematic diagram of an anti-sound leakage effect provided by an embodiment of the present application.

[0046] FIG13 is a schematic diagram of a power amplifier circuit provided in an embodiment of the present application.

[0047] FIG14 is a flow chart of a method for determining filter parameters corresponding to each array element provided in an embodiment of the present application.

[0048] FIG15 is a schematic diagram of an audio sampling method according to an embodiment of the present application.

[0049] FIG16 is a frequency response curve diagram of a human ear area and surrounding areas provided in an embodiment of the present application.

[0050] FIG17 is a flow chart of a sound leakage prevention method provided in an embodiment of the present application.

[0051] FIG18 is a flow chart of another method for preventing sound leakage provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0053] The terms "first," "second," "third," and "fourth," etc., in the specification and claims of this application and the accompanying drawings are used to distinguish between different objects, rather than to describe a specific order. In addition, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0054] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0055] An embodiment of the present application provides an electronic device and a related method for preventing sound leakage. The electronic device may include but is not limited to smartphones, tablet personal computers (Tablet PCs), wearable electronic devices (such as smart glasses), smart head-mounted devices (such as VR glasses), etc.

[0056] When a traditional electronic device (such as a smartphone) is on a call, the electronic device is near the human ear and only the screen speaker makes sound. Therefore, the only way to reduce the external volume is to reduce the volume of the electronic device. However, this will also make the sound heard by the human ear smaller, and the user cannot hear the sound clearly. In the present application, the electronic device can be configured with multiple array elements (such as multiple speakers or multiple sound holes), and the filters corresponding to different array elements can be calculated by a preset algorithm. Furthermore, after the filter is applied to the multi-element system, the sound field formed by the superposition of the sound waves output by multiple speakers near the human ear is the same as the sound field formed when the screen speaker makes sound alone, ensuring that the volume and sound quality of the sound heard by the human ear remain unchanged, and the sound waves in the surrounding area are offset after superposition, reducing the sound leakage of the electronic device. In summary, the present application can greatly reduce the volume of sound leakage of the electronic device while ensuring that the sound quality and volume of the sound heard by the user remain unchanged.

[0057] Before introducing the method provided by the embodiment of the present application in detail, the electronic device provided by the embodiment of the present application is first introduced.

[0058] FIG1 shows a schematic structural diagram of an electronic device 100 .

[0059] The following embodiments are described in detail using electronic device 100 as an example. It should be understood that electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in the figure may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0060] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, multiple speakers 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a 3D camera module 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0061] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0062] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0063] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0064] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0065] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0066] The electronic device 100 can implement audio functions such as calls, music playback, and recording through the audio module 170, multiple speakers 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, and an application processor.

[0067] The audio module 170 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals.

[0068] The plurality of speakers 170A, also referred to as "speakers," are configured to convert audio electrical signals into sound signals.

[0069] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0070] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0071] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0072] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0073] FIG2 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.

[0074] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0075] The application layer can include a series of application packages.

[0076] As shown in FIG2 , the application package may include application programs (also referred to as applications) such as call, camera, gallery, calendar, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0077] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0078] As shown in FIG2 , the application framework layer may include a telephony manager, a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.

[0079] The phone manager is used to provide communication functions of the electronic device 100. For example, the management of call status (including answering, hanging up, etc.)

[0080] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0081] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0082] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0083] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0084] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads, message reminders, and so on. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog interfaces on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0085] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0086] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0087] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0088] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0089] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0090] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0091] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0092] A 2D graphics engine is a drawing engine for 2D drawings.

[0093] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0094] The following describes the user interface provided by the embodiments of the present application.

[0095] FIG3 a - FIG3 e are a set of user interfaces displayed on the electronic device 100 provided in an embodiment of the present application.

[0096] FIG. 3 a ( a ) exemplarily shows an exemplary user interface 20 for displaying installed applications on the electronic device 100 .

[0097] As shown in (a) in Figure 3a, the user interface 20 displays one or more installed application icons. For example, the user interface 20 can display phone 201, camera, gallery, clock, calendar, memo, file management, email, music, calculator, Huawei video, sports health, weather, browser, smart life, settings, recorder, etc.

[0098] As shown in (a) of FIG3a , the electronic device 100 can receive and respond to a user's touch operation on the phone 201 icon on the user interface 20 (i.e., an operation to open a call application), start the call application, and display a user interface 21 as shown in (b) of FIG3a on the display screen 194 of the electronic device 100. The user interface 21 can be a dialing interface, and the user interface 21 can include an area 202 and a control 203. The area 202 can be used to display multiple numeric controls to facilitate the user to enter a phone number; the control 203 can be used to dial the phone number entered by the user.

[0099] As shown in (b) of FIG3a , the electronic device 100 can receive and respond to a user's operation of inputting a phone number in area 202 of the user interface 21, and display the phone number input by the user on the user interface 21. The electronic device 100 can also receive and respond to a user's touch operation on a control 203 of the user interface 21, dial the phone number input by the user, and display the user interface 22 shown in (a) of FIG3b on the display screen 194 of the electronic device 100. The user interface 22 can be a call interface, and the user interface 22 can include area 204.

[0100] Optionally, as shown in (b) of FIG3a , the electronic device 100 may receive and respond to the user's operation of inputting a phone number in area 202 of the user interface 21, and display the phone number input by the user on the user interface 21. The electronic device 100 may also receive and respond to the user's touch operation on the control 203 of the user interface 21, dial the phone number input by the user, and automatically turn on the quiet mode. After turning on the quiet mode, only the user can hear the sound emitted by the speaker during the call, and people around cannot hear the sound emitted by the speaker, ensuring that the user can achieve privacy when using the electronic device 100 to make a call, thereby improving the user experience. In some embodiments, the quiet mode may also be referred to as a quiet call mode, a silent call mode, an anti-leakage call mode, or a privacy call mode.

[0101] As shown in (a) of FIG3b , the electronic device 100 can receive and respond to a preset operation by the user in area 204 of the user interface 22, such as a swipe down operation by the user in area 204, to activate the control center of the electronic device 100 and display the user interface 23 shown in (b) of FIG3b on the display screen 194 of the electronic device 100. The user interface 23 can be a control center interface and can include a control 205. The control 205 can be used to enable quiet mode during a call.

[0102] As shown in (b) of FIG3b , the electronic device 100 can also receive and respond to a user touch operation on the control 205 of the user interface 23 to enable a quiet mode. When the quiet mode is enabled, only the user can hear the sound emitted by the speaker during a call, while people around the user cannot hear the sound emitted by the speaker. This ensures that the user can achieve privacy when making calls using the electronic device 100 and improves the user experience. How the electronic device 100 implements the quiet mode will be described in detail later and will not be repeated here.

[0103] As shown in Figure 3c, if the silent mode is turned on during a user call, a silent prompt can be displayed on the user interface 22 to remind the user that the silent mode is currently turned on. During the call, only the user can hear the sound from the speaker, and people around cannot hear the sound from the speaker clearly, ensuring that the user can achieve privacy when making a call using the electronic device 100, thereby improving the user experience.

[0104] As shown in FIG3d , when the electronic device 100 is called and rings, the electronic device 100 may display a user interface 24 on the display 194 . The user interface 24 may be an incoming call display interface and may include a control 206 . The electronic device 100 may receive and respond to a user dragging and sliding the control 206 to the right, answering the call and displaying the user interface 22 shown in FIG3b (a) on the display 194 of the electronic device 100 . In some embodiments, the electronic device 100 may receive and respond to a user's preset operation in area 204 of the user interface 22 , such as a user sliding down in area 204 , to launch the control center of the electronic device 100 and display the user interface 23 shown in FIG3b (b) on the display 194 of the electronic device 100 . Furthermore, as shown in FIG3b (b) , the electronic device 100 may receive and respond to a user touch operation on the control 205 of the user interface 23 to activate silent mode. In some embodiments, the electronic device 100 may receive and respond to a user dragging and sliding the control 206 to the right, answering the call and automatically activating silent mode.

[0105] As shown in FIG3e , when the electronic device 100 enters a chat software (such as WeChat chat software) and opens a chat dialog box, the electronic device 100 can display a user interface 25 through the display screen 194. The user interface 25 can be a chat dialog box interface, and the user interface 25 can include a voice message sent by the chat partner. The electronic device 100 can receive and respond to the user's operation of clicking on the voice message, turn on the quiet mode and play the voice message, so that only the user can hear the sound from the speaker during the voice playback process, and people around cannot hear the sound from the speaker clearly, ensuring that the user can achieve privacy when playing voice messages using the electronic device 100, thereby improving the user experience.

[0106] The following is an introduction to an electronic device involved in an embodiment of the present application:

[0107] Please refer to Figure 4 . In Figure 4 , it is assumed that the electronic device 100 is a smartphone. The smartphone may be equipped with Q array elements and an audio processing unit, where Q is an integer greater than or equal to 2. Figure 4 shows only three array elements: array element 1, array element 2, and array element 3. The audio processing unit in Figure 4 may be composed of the audio module 170 in Figure 1 or the processor 110. It should be noted that an array element can be understood as a speaker or a sound outlet. Also, please refer to Figure 5 . In Figure 5 , it is assumed that the electronic device 100 is a smart head-mounted device (such as VR glasses). The smart head-mounted device may also be equipped with Q array elements and an audio processing unit, where Q is an integer greater than or equal to 2. Figure 5 shows only four array elements: array element 1, array element 2, array element 3, and array element 4. The audio processing unit in Figure 5 may be composed of the audio module 170 in Figure 1 or the processor 110. It is understood that the electronic device 100 in this application may include, but is not limited to, the two types of electronic devices exemplified in Figures 4 and 5 . For ease of description, the following description is made by taking the electronic device 100 as a smartphone as an example. The detailed description of the electronic device 100 is as follows:

[0108] In some embodiments, after the electronic device 100 dials the phone number entered by the user, it automatically turns on the quiet mode. With the quiet mode turned on, only the user can hear the sound coming from the speaker during the call, while people around them cannot hear the sound coming from the speaker. This ensures that the user can enjoy privacy when making calls using the electronic device 100, improving the user experience. For a detailed description, please refer to the description of (b) of FIG. 3a above, which will not be repeated here.

[0109] In some embodiments, the electronic device 100 may also receive and respond to a user operation during a call to activate the silent mode. Detailed descriptions can be found in the above description of (b) in FIG. 3b , which will not be repeated here.

[0110] In some embodiments, when the electronic device 100 is called and rings, the electronic device 100 can automatically enter the silent mode after the call is connected; the electronic device 100 can also receive a user operation to enter the silent mode during the call. For detailed description, please refer to the relevant description of Figure 3d above, which will not be repeated here.

[0111] In some embodiments, the electronic device 100 can turn on the silent mode when playing the voice message. Detailed description can be found in the above description of FIG. 3e, which will not be repeated here.

[0112] Next, the following describes how the electronic device 100 implements the silent mode, in which only the user can hear the sound emitted by the array element (e.g., speaker) during a call, while people around cannot hear the sound emitted by the array element. The detailed description is as follows:

[0113] In some embodiments, the electronic device 100 may obtain judgment information through an audio processing unit, where the judgment information includes one or more of the number of people in the current first preset area, the remaining power of the current electronic device 100, and the current position of the electronic device 100; based on the judgment information, M first array elements in the first type of array elements and N second array elements in the second type of array elements are determined from the Q array elements, where M and N are integers greater than 0.

[0114] Specifically, as shown in Figure 6, when the user holds the electronic device 100 to make a call or listen to voice, the first preset area can be understood as the anti-sound leakage area (i.e., the surrounding area). For example, the space within 1m of the user's shoulder width is called the personal area, and the space outside the personal area can be called the surrounding area. The purpose of this application is to leak the sound volume to the surrounding area (i.e., the first preset area) as low as possible. The second preset area can be understood as the audio playback area (i.e., the area inside the human ear), such as the space between the human auricle and the electronic device 100. The first preset area is larger than the second preset area. When the electronic device 100 starts the quiet mode, the electronic device 100 can obtain judgment information through the audio processing unit. The judgment information may include but is not limited to the number of people in the first preset area, the remaining power of the current electronic device 100, and the current position of the electronic device 100. Furthermore, the electronic device 100 can determine M first array elements in the first type of array elements and N second array elements in the second type of array elements from the Q array elements based on the judgment information.

[0115] For example, if the judgment information indicates that the number of people within the first preset area is four, and the electronic device 100 currently has a high remaining battery life, as shown in Figure 7 , the electronic device 100 can determine, based on this judgment information, that the first type of array element includes one element, element 1, which can be a screen speaker; and that the second type of array element includes two elements, element 2 and element 3. Since the electronic device 100 currently has a high remaining battery life and a large number of people within the first preset area, the user can appropriately increase the number of second type elements in this scenario to improve the quality of quiet calls and enhance the user experience.

[0116] For another example, if the judgment information indicates that the number of people in the first preset area is one, and the remaining battery of electronic device 100 is currently low, as shown in Figure 8 , electronic device 100 can determine, based on this judgment information, that the first type of array elements includes one element, element 1, which can be a screen speaker, and the second type of array elements includes one element, element 2. Since there are fewer people in the first preset area and the current battery level of electronic device 100 is low, the number of second type of array elements can be appropriately reduced, ensuring a quiet call for the user while also reducing power consumption and improving system performance.

[0117] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current electronic device is located in a private area, the smaller the value of N.

[0118] Specifically, as shown in FIG6 , if the number of people in the first preset area increases, the number of second-type elements can be appropriately increased to ensure that the people in the first preset area cannot clearly hear the sound emitted by the electronic device 100, thereby achieving better quiet call quality. Alternatively, when the remaining battery power of the electronic device 100 is low, the number of second-type elements can be appropriately reduced to reduce the power consumption of the electronic device 100. Alternatively, if the electronic device 100 is currently located in a user's private area, such as at home, and the user has lower requirements for quiet call quality, the number of second-type elements can be appropriately reduced to reduce the power consumption of the electronic device 100.

[0119] In some embodiments, the distance between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements is within a first range. Specifically, the first range may be 1 mm to 10 cm. The closer the distance between the N second array elements and the M first array elements, that is, the closer the distance between each of the N second array elements and each of the M first array elements, the better the sound leakage prevention effect, thereby improving the user experience.

[0120] The audio processing unit is configured to receive an initial audio signal and determine a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0121] Specifically, the first category of audio signals includes M first audio signals, and the second category of audio signals includes N second audio signals. When the electronic device 100 is in a call, the audio processing unit of the electronic device 100 can receive the initial audio signal via the antenna. Next, the audio processing unit can divide the initial audio signal into M+N signals, and each signal is identical, that is, has the same frequency and the same amplitude. Furthermore, the audio processing unit can obtain M first audio signals and N second audio signals based on the M+N signals.

[0122] In some embodiments, the audio processing unit is specifically configured to: divide the initial audio signal into M channels of signals, and determine the M channels of signals as M first audio signals. Specifically, after the electronic device 100 receives the initial audio signal through the audio processing unit and determines the first type of array element, it can divide the initial audio signal into M channels of signals, and determine the M channels of signals as the M first audio signals, so that after the first type of array element subsequently sounds, the user can clearly hear the call content (i.e., the call content corresponding to the initial audio signal) in the audio playback area.

[0123] In some embodiments, the electronic device 100 also includes M first filters and an audio processing unit, which is specifically used to: perform first filtering processing on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within the second preset area; the first filtering processing includes amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio reception effect of the processed initial audio signal within the second preset area remains unchanged.

[0124] Specifically, as shown in FIG10 , it is assumed that M is 1. The electronic device 100 includes a first filter, namely the first filter 1. The first filter 1 corresponds to preset amplitude modulation and phase modulation parameters. The input of the first filter 1 can be an initial audio signal, and the output can be a first audio signal. If M is an integer greater than 1, that is, the electronic device 100 includes multiple first filters, the preset amplitude modulation and phase modulation parameters corresponding to each first filter can be different. The first filter 1 can perform amplitude modulation and / or phase modulation processing on the received initial audio signal based on the preset amplitude modulation and phase modulation parameters to obtain a first audio signal. The first array element 1 does not directly output the initial audio signal, but outputs a processed audio signal to eliminate the interference of the sound waves output by the second type array element on the sound waves output by the first type array element at multiple locations within the audio playback area, so that the audio reception effect in the audio playback area remains unchanged, thereby improving the user experience.

[0125] In some embodiments, the electronic device 100 also includes N second filters and an audio processing unit, which is specifically used to: perform a second filtering process on the initial audio signal through each second filter to obtain N second audio signals; the second filtering process includes amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio leakage effect of the processed initial audio signal within the first preset area is reduced.

[0126] Specifically, as shown in FIG11 , it is assumed that N is 2. The electronic device 100 includes two second filters, namely the second filter 1 and the second filter 2. The second filter 1 and the second filter 2 correspond to different preset amplitude modulation and phase modulation parameters respectively. The input of the second filter 1 and the second filter 2 can both be the initial audio signal, and the output can be the second audio signal. The second filter 1 and the second filter 2 can process the initial audio signal based on their respective corresponding preset amplitude modulation and phase modulation parameters to obtain two second audio signals respectively. Furthermore, the second type of array element can output the second audio signal respectively to superimpose and cancel the leakage sound of the first type of array element at multiple position points in the anti-leakage area (i.e., the surrounding area), so that the audio leakage effect in the anti-leakage area is reduced, privacy calls are achieved, and the user experience is improved.

[0127] For example, as shown in Figure 12, if the second-type array element does not sound and only the first-type array element, such as array element 1, sounds, other people in the area around the user will hear the sound leakage from array element 1, and the privacy of the call cannot be guaranteed. In this application, the second-type array element is introduced to sound simultaneously with the first-type array element. At multiple locations in the area around the user, the sound waves output by the second-type array element will superimpose and cancel the sound waves output by the first-type array element. This reduces the sound pressure of the sound leakage from the first-type array element in the area around the user, and other people in the surrounding area cannot clearly hear the sound emitted by the first-type array element, achieving fully private calls and improving the user experience.

[0128] The audio processing unit is further configured to send the first type of audio signals to the first type of array elements and send the second type of audio signals to the second type of array elements.

[0129] Specifically, after the audio processing unit determines the first type of audio signal and the second type of audio signal based on the initial audio signal, the audio processing unit will also send the first type of audio signal to the first type of array element and the second type of audio signal to the second type of array element, and one audio signal corresponds to one array element.

[0130] For example, as shown in FIG9 , the audio processing unit can send the M first audio signals obtained from the first audio signal to the corresponding first array elements. At the same time, the audio processing unit can also send the N second audio signals obtained from the second audio signal to the corresponding second array elements, so that the first array elements and the second array elements can subsequently emit sound simultaneously. At multiple locations in the user's surrounding area, the sound waves output by the second array elements will superimpose and cancel each other with the sound waves output by the first array elements, thereby reducing the sound leakage pressure of the first array elements in the user's surrounding area. Other people in the surrounding area cannot clearly hear the sound emitted by the first array elements, thus achieving fully private calls and improving the user experience.

[0131] The M first array elements in the first type of array elements are configured to output M first sound wave signals based on the corresponding first audio signals.

[0132] Specifically, after receiving the first audio signal, each first-type array element in the first-type array element can convert the audio signal into a sound wave signal and output it, so that the user can clearly hear the call content (i.e., the call content corresponding to the original audio signal) in the audio playback area. In addition, if the first-type array element does not directly output the original audio signal, but instead outputs a processed audio signal, interference from the sound waves output by the second-type array element on the sound waves output by the first-type array element can be eliminated at multiple locations within the audio playback area, thereby maintaining the audio reception quality within the audio playback area and improving the user experience.

[0133] The N second array elements in the second type of array elements are configured to output N second sound wave signals based on corresponding second audio signals.

[0134] Specifically, after receiving the second audio signal, each second array element in the second type of array element can convert the audio signal into a sound wave signal and output it simultaneously with the sound wave signal of the first type of array element, so that the sound waves output by the second type of array element can be superimposed and canceled with the leakage sound of the first type of array element at multiple positions in the anti-leakage area (i.e., the surrounding area), so that the audio leakage effect in the anti-leakage area is reduced, that is, the leakage sound pressure of the first type of array element in the area around the user is reduced, and other people in the surrounding area cannot hear the sound emitted by the first type of array element, thereby realizing full privacy calls and improving user experience.

[0135] In some embodiments, as shown in Figure 13, the electronic device 100 also includes M+N power amplifier circuits, one power amplifier circuit corresponding to one audio signal, and the audio processing unit is further used to: amplify the M first audio signals and the N second audio signals through the M+N power amplifier circuits, respectively, to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type of array elements are specifically used to output M first sound wave signals based on the processed first type audio signals; and the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0136] Specifically, after the M first filters and N second filters respectively perform amplitude modulation processing and / or phase modulation processing on the initial audio signal, M first audio signals and N second audio signals can be obtained. Then, the M first audio signals and N second audio signals can be respectively input into corresponding power amplifier circuits for processing to amplify the audio signals and promote the sound of each array element. The user can hear clearer sound, thereby improving the user experience.

[0137] Next, a method for determining filter parameters corresponding to each array element provided by an embodiment of the present application will be described with reference to FIG14 .

[0138] Step S301: collecting transfer functions from each array element to each region.

[0139] Specifically, a first preset area (surrounding area) and a second preset area (audio playback area) can be first determined, and multiple first sampling points can be determined from the first preset area, and multiple second sampling points can be determined from the second preset area. Furthermore, the electronic device 100 can play the same swept frequency signal through each of the multiple array elements and collect the sound wave signal output by each array element at each sampling point to obtain a transfer function from each array element to each sampling point.

[0140] For example, as shown in FIG15 , the target sampling point a is one of the multiple first sampling points. The electronic device 100 is provided with three array elements, namely array element 1, array element 2, and array element 3. Array element 1 is a first-type array element, and array elements 2 and 3 are second-type array elements. The electronic device 100 plays a sweep frequency signal through array element 1 and collects the sound wave signal output by array element 1 at the target sampling point a to obtain (i.e., the transfer function of array element 1 at the target sampling point a); the electronic device 100 plays the sweep signal through array element 2, collects the acoustic wave signal output by array element 2 at the target sampling point a, and obtains (ie, the transfer function of array element 2 at the target sampling point a); the electronic device 100 plays the sweep signal through array element 3, collects the acoustic wave signal output by array element 3 at the target sampling point a, and obtains (i.e. the transfer function of the array element 3 at the target sampling point a). By analogy, the transfer function from each array element to each sampling point can be obtained. It should be noted that the transfer functions corresponding to the multiple first sampling points can be expressed as Represented; the transfer functions corresponding to multiple second sampling points can be expressed as express.

[0141] Step S302: Determine the filter corresponding to each array element based on a preset algorithm.

[0142] Specifically, based on the transfer function data obtained above, the filter parameters corresponding to each array element can be calculated using a preset algorithm (such as a neural network algorithm).

[0143] For example, in a scenario where the electronic device 100 includes three array elements, to ensure that the sound waves generated by each array element can be superimposed and canceled in a first preset area (i.e., the surrounding area), the filter parameters corresponding to array element 2 and array element 3 (i.e., the preset amplitude modulation and phase modulation parameters mentioned above) can be determined based on the transfer functions corresponding to the multiple first sampling points. Assume that the multiple first sampling points include four points a, b, c, and d, and the corresponding transfer functions are: The filter parameter w2 corresponding to array element 2 and the filter parameter w3 corresponding to array element 3 can be determined based on formula 1.

[0144] Where i can be a, b, c, or d, respectively. Substituting the transfer functions into Formula 1, we can obtain w2 and w3. Because the calculation of w2 and w3 takes into account multiple first acquisition points within the first preset area, this ensures that when processing any audio signal based on w2 and w3, the acoustic wave signals output by the second-type array element and the acoustic wave signals output by the first-type array element can be superimposed and canceled at multiple locations within the first preset expectation, achieving fully private calls and improving the user experience.

[0145] At the same time, in order to ensure that the audio playback effect in the second preset area (i.e., the audio playback area) remains unchanged, the filter parameters corresponding to array element 1 (i.e., the preset amplitude modulation and phase modulation parameters mentioned above) can be determined based on the transfer functions corresponding to the multiple second sampling points.

[0146] For example, the plurality of second sampling points include four points e, f, g, and h, and the corresponding transfer functions are: The filter parameter w1 corresponding to array element 1 can be determined based on formula 2.

[0147] Where H is the swept frequency signal, and i can be e, f, g, or h, respectively. Substituting the transfer functions into Formula 2, we can obtain w1. Because the calculation of w1 takes into account multiple second acquisition points within the second preset area, this ensures that when processing any audio signal based on w1, interference from the sound waves output by the second-type array element on the sound waves output by the first-type array element can be eliminated at multiple locations within the second preset area (audio playback area). This ensures that the audio reception quality within the audio playback area remains unchanged, improving the user experience.

[0148] After determining w1 corresponding to array element 1, w2 corresponding to array element 2, and w3 corresponding to array element 3, these filter parameters can be stored locally in the electronic device 100 in advance. When the electronic device 100 starts the quiet mode, the pre-stored filter parameters can be called to process the initial audio signal received by the electronic device 100 to achieve quiet calls and improve user experience.

[0149] For example, as shown in FIG16 , FIG16 is a frequency response curve diagram of the human ear area and the surrounding area provided by an embodiment of the present application. In FIG16 (a), the frequency response curve of the surrounding area (solid line with o) is lower than the frequency response curve of the surrounding area before the implementation of the present application (solid line with x), while the frequency response curves of the human ear area are basically the same (solid line and dotted line), which shows that the technical solution provided by the present application can reduce the sound leakage of the mobile phone to the surrounding area as much as possible without changing the user's hearing sense. FIG16 (b) is an acoustic contrast (AC) curve. The acoustic contrast is the average sound pressure level in the ear area minus the average sound pressure level in the surrounding area. The lower the acoustic contrast, the more serious the sound leakage problem. FIG16 (b) shows that the acoustic contrast increases significantly after the implementation of the solution of the present application, indicating that the volume of the leaked sound has been significantly reduced.

[0150] Please refer to Figure 17. An embodiment of the present application provides a method for preventing sound leakage, which is applied to an electronic device. The electronic device includes a display screen, an audio processing unit, a first-type array element and a second-type array element. The first-type array element includes M first array elements, and the second-type array element includes N second array elements. M and N are integers greater than 0.

[0151] Step S401: When the electronic device is in a call, a first interface is displayed on the display screen.

[0152] Specifically, the first interface may be the user interface 22 in (a) of Figure 3b. Detailed descriptions can be found in the above description of the user interface 22, which will not be repeated here.

[0153] Step S402: receiving and responding to a preset operation of the user on a preset area in the first interface, displaying the second interface.

[0154] Specifically, the preset area may be area 204 in the user interface 22. The preset operation may be a swipe down operation on the preset area. The second interface may be the user interface 23 in FIG. 3 b (b). For a detailed description, please refer to the above description of the user interface 23, which will not be repeated here.

[0155] Step S403: receiving and responding to a touch operation on the first control in the second interface.

[0156] Specifically, the first control may be the control 205 on the user interface 23 .

[0157] Step S404: receiving an initial audio signal through the audio processing unit, and determining a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0158] The first type of audio signals includes M first audio signals, and the second type of audio signals includes N second audio signals.

[0159] Step S405: sending the first type of audio signal to the first type of array element, and sending the second type of audio signal to the second type of array element.

[0160] Among them, one audio signal corresponds to one array element.

[0161] Step S406: outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements.

[0162] Step S407: outputting N second sound wave signals based on the corresponding second audio signals through N second array elements in the second type of array elements.

[0163] Specifically, the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

[0164] In the present application, a plurality of array elements may be configured on an electronic device, wherein the plurality of array elements may include first-type array elements and second-type array elements. During a call, the audio processing unit may process the initial audio signal to be played to obtain M first audio signals and N second audio signals, and may send the M first audio signals to the corresponding first array elements, and send the N second audio signals to the corresponding second array elements. Furthermore, the first array element and the second array element may respectively output different sound wave signals simultaneously based on the received audio signal, so that the N second sound wave signals output by the N second-type array elements are superimposed and canceled with the sound leakage of the first-type array elements at multiple position points within the anti-leakage area (i.e., the surrounding area of ​​the electronic device), so that the audio leakage effect in the anti-leakage area is reduced, privacy calls are achieved, and the user experience is improved.

[0165] Please refer to Figure 18. An embodiment of the present application provides a method for preventing sound leakage, which is applied to an electronic device. The electronic device includes an audio processing unit, a first-type array element, and a second-type array element. The first-type array element includes M first array elements, and the second-type array element includes N second array elements. M and N are integers greater than 0.

[0166] Step S501: receiving an initial audio signal through an audio processing unit, and determining a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0167] The first type of audio signals includes M first audio signals, and the second type of audio signals includes N second audio signals.

[0168] Step S502: sending the first type of audio signal to the first type of array element, and sending the second type of audio signal to the second type of array element.

[0169] Specifically, one audio signal corresponds to one array element.

[0170] Step S503: outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements.

[0171] Step S504: outputting N second sound wave signals based on the corresponding second audio signal through N second array elements in the second type of array elements.

[0172] Specifically, the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

[0173] In some embodiments, the electronic device also includes M first filters, and the method also includes: performing first filtering processing on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within the second preset area; the first filtering processing includes amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio reception effect of the processed initial audio signal within the second preset area remains unchanged.

[0174] In some embodiments, the first preset area is a sound leakage prevention area, the second preset area is an audio playback area, and the first preset area is larger than the second preset area.

[0175] In some embodiments, the electronic device also includes N second filters, and the method also includes: performing a second filtering process on the initial audio signal through each second filter to obtain N second audio signals; the second filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio leakage effect of the processed initial audio signal within the first preset area is reduced.

[0176] In some embodiments, the electronic device includes Q array elements, where Q is greater than or equal to M+N, and the method further includes: obtaining judgment information, the judgment information including one or more of the number of people in the current first preset area, the remaining power of the current electronic device, and the current location of the electronic device; based on the judgment information, determining M first array elements in the first category of array elements and N second array elements in the second category of array elements from the Q array elements.

[0177] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current electronic device is located in a private area, the smaller the value of N.

[0178] In some embodiments, the electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponding to one audio signal, and the method further includes: amplifying the M first audio signals and the N second audio signals respectively by the M+N power amplifier circuits to obtain M processed first audio signals and N processed second audio signals; the M first array elements in the first type of array elements are specifically used to output M first sound wave signals based on the processed first type audio signals; and the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0179] In summary, in the present application, a plurality of array elements may be configured on the electronic device, wherein the plurality of array elements may include first-type array elements and second-type array elements. During a call, the audio processing unit may process the initial audio signal to be played to obtain M first audio signals and N second audio signals, and may send the M first audio signals to the corresponding first array elements, and send the N second audio signals to the corresponding second array elements. Furthermore, the first array element and the second array element may respectively output different sound wave signals simultaneously based on the received audio signal, so that the N second sound wave signals output by the N second-type array elements are superimposed and canceled with the sound leakage of the first-type array elements at multiple position points within the sound leakage prevention area (i.e., the surrounding area of ​​the electronic device), so that the audio leakage effect in the sound leakage prevention area is reduced, privacy calls are achieved, and the user experience is improved.

[0180] The present application provides a computer storage medium, characterized in that the computer storage medium stores a computer program, and when the computer program is executed by a processor, any one of the above-mentioned sound leakage prevention methods is implemented.

[0181] An embodiment of the present application provides an electronic device, comprising a processor configured to support the electronic device in implementing the corresponding functions of any of the aforementioned sound leakage prevention methods. The electronic device may further comprise a memory coupled to the processor and storing program instructions and data necessary for the electronic device. The electronic device may further comprise a communication interface for communicating with other devices or a communication network.

[0182] The present application provides a chip system that includes a processor for supporting an electronic device in implementing the aforementioned functions, such as generating or processing information involved in the aforementioned sound leakage prevention method. In one possible design, the chip system also includes a memory for storing program instructions and data necessary for the electronic device. The chip system can be composed of a chip or can include a chip and other discrete components.

[0183] The present application provides a computer program, characterized in that the computer program includes instructions, and when the computer program is executed by a computer, the computer is caused to execute the above-mentioned sound leakage prevention method.

[0184] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0185] It should be noted that for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0186] In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the above-mentioned units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0187] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0188] In addition, the functional units in the embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0189] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to execute all or part of the steps of the above-mentioned methods of each embodiment of the present application. Among them, the aforementioned storage medium may include: U disk, mobile hard disk, magnetic disk, optical disk, read-only memory (Read-Only Memory, abbreviated: ROM) or random access memory (Random Access Memory, abbreviated: RAM) and other media that can store program codes.

[0190] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An electronic device, characterized in that: The electronic device comprises an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprises M first array elements, the second type of array element comprises N second array elements, and M and N are integers greater than 0; The audio processing unit is used for: Receive an initial audio signal, and determine a first-category audio signal and a second-category audio signal based on the initial audio signal; wherein the first-category audio signal includes M first audio signals, and the second-category audio signal includes N second audio signals; Sending the first-type audio signal to the first-type array element, and sending the second-type audio signal to the second-type array element, wherein one audio signal corresponds to one array element; The M first array elements in the first type of array elements are used to: Based on the corresponding first audio signal, output M first sound wave signals; The N second array elements in the second type of array elements are used to: Based on the corresponding second audio signal, N second sound wave signals are output; the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

2. The device according to claim 1, characterized in that The electronic device further includes M first filters, and the audio processing unit is further used for: The initial audio signal is subjected to a first filtering process by each of the first filters to obtain the M first audio signals; the M first audio signals are used to eliminate interference of the N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal.

3. The device according to claim 2, characterized in that The first preset area is a sound leakage prevention area, and the second preset area is an audio playback area.

4. The device according to any one of claims 1 to 3, characterized in that: The electronic device further includes N second filters, and the audio processing unit is further used for: The N second audio signals are obtained by performing a second filtering process on the initial audio signal through each of the second filters; the second filtering process includes performing an amplitude modulation process and / or a phase modulation process on the initial audio signal.

5. The device according to any one of claims 1 to 4, characterized in that: The electronic device includes Q array elements, where Q is greater than or equal to M+N, and the audio processing unit is further used for: Obtaining decision information, wherein the decision information includes one or more of the number of people currently in the first preset area, the remaining power of the current electronic device, and the current position of the electronic device; Based on the decision information, the M first array elements in the first type of array elements and the N second array elements in the second type of array elements are determined from the Q array elements.

6. The device according to claim 5, characterized in that The more people there are in the first preset area, the larger the value of N; or, the lower the remaining power of the electronic device, the smaller the value of N; or, the electronic device is currently located in a private area, the smaller the value of N.

7. The device according to claim 5 or 6, characterized in that The distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

8. The device according to any one of claims 1 to 7, characterized in that: The electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the audio processing unit is further used for: Amplifying the M first audio signals and the N second audio signals respectively through the M+N power amplifier circuits to obtain processed M first audio signals and processed N second audio signals; The M first array elements in the first type of array elements are specifically configured to output the M first sound wave signals based on the processed first type of audio signals; The second type of array element is specifically used to output the N second sound wave signals based on the processed second type of audio signal.

9. A method for preventing sound leakage, characterized in that: Applied to an electronic device, the electronic device comprises a display screen, an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprises M first array elements, the second type of array element comprises N second array elements, M and N are integers greater than 0; the method comprises: When the electronic device is in a call, the first interface is displayed through the display screen; a preset operation of the user on a preset area in the first interface is received and responded to, and a second interface is displayed; a touch operation for a first control in the second interface is received and responded to; An initial audio signal is received through the audio processing unit, and a first-category audio signal and a second-category audio signal are determined based on the initial audio signal; wherein the first-category audio signal includes M first audio signals, and the second-category audio signal includes N second audio signals; the first-category audio signal is sent to the first-category array element, and the second-category audio signal is sent to the second-category array element, and one audio signal corresponds to one array element; Outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements; N second array elements in the second type of array elements are used to output N second sound wave signals based on the corresponding second audio signal; the N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple position points within the first preset area.

10. A method for preventing sound leakage, characterized in that: Applied to an electronic device, the electronic device comprises an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprises M first array elements, the second type of array element comprises N second array elements, M and N are integers greater than 0; the method comprises: An initial audio signal is received through the audio processing unit, and a first-category audio signal and a second-category audio signal are determined based on the initial audio signal; wherein the first-category audio signal includes M first audio signals, and the second-category audio signal includes N second audio signals; the first-category audio signal is sent to the first-category array element, and the second-category audio signal is sent to the second-category array element, and one audio signal corresponds to one array element; Outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements; N second array elements in the second type of array elements are used to output N second sound wave signals based on the corresponding second audio signal; the N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple position points within the first preset area.

11. The method according to claim 10, characterized in that The electronic device further includes M first filters, and the method further includes: The initial audio signal is subjected to a first filtering process by each of the first filters to obtain the M first audio signals; the M first audio signals are used to eliminate interference of the N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio reception effect of the processed initial audio signal within the second preset area remains unchanged.

12. The method according to claim 11, characterized in that The first preset area is a sound leakage prevention area, the second preset area is an audio playback area, and the first preset area is larger than the second preset area.

13. The method according to any one of claims 10 to 12, characterized in that: The electronic device further includes N second filters, and the method further includes: The initial audio signal is subjected to a second filtering process by each of the second filters to obtain the N second audio signals; the second filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio leakage effect of the processed initial audio signal within the first preset area is reduced.

14. The method according to any one of claims 10 to 13, characterized in that: The electronic device includes Q array elements, Q is greater than or equal to M+N, and the method further includes: Obtaining decision information, wherein the decision information includes one or more of the number of people currently in the first preset area, the remaining power of the current electronic device, and the current position of the electronic device; Based on the decision information, the M first array elements in the first type of array elements and the N second array elements in the second type of array elements are determined from the Q array elements.

15. The method according to claim 14, characterized in that The more people there are in the first preset area, the larger the value of N; or, the lower the remaining power of the electronic device, the smaller the value of N; or, the electronic device is currently located in a private area, the smaller the value of N.

16. The method according to claim 14 or 15, characterized in that The distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

17. The method according to any one of claims 10 to 16, characterized in that: The electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the method further includes: Amplifying the M first audio signals and the N second audio signals respectively through the M+N power amplifier circuits to obtain processed M first audio signals and processed N second audio signals; The M first array elements in the first type of array elements are specifically configured to output the M first sound wave signals based on the processed first type of audio signals; The second type of array element is specifically used to output the N second sound wave signals based on the processed second type of audio signal.

18. An electronic device, characterized in that: include: A memory, one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method as described in any one of claims 10-17.

19. A chip system, characterized in that: The chip system includes at least one processor, a memory and an interface circuit. The memory, the interface circuit and the at least one processor are interconnected by lines. Instructions are stored in the at least one memory. When the instructions are executed by the processor, the method described in any one of claims 10-17 is implemented.

20. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method as claimed in any one of claims 10 to 17.

21. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method as claimed in any one of claims 10 to 17.

Images