Electronic equipment and related sound leakage prevention method

Abstract

The embodiment of the invention discloses electronic equipment and a related sound leakage prevention method. The electronic equipment comprises an audio processing unit, a first type of array elements and a second type of array elements, the audio processing unit is used for receiving an initial audio signal and determining a first type of audio signals and a second type of audio signals based on the initial audio signal; the first type of audio signals comprise M first audio signals, and the second type of audio signals comprise N second audio signals; sending the first type of audio signals to the first type of array elements, and sending the second type of audio signals to the second type of array elements; the first type of array elements are used for outputting M first sound wave signals based on corresponding first audio signals; the second type of array elements are used for outputting N second sound wave signals based on corresponding second audio signals; the N second sound wave signals are used for superposition and cancellation with the M first sound wave signals at a plurality of position points in the first preset area. According to the embodiment of the invention, the privacy conversation can be realized when the electronic equipment is used for conversation, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of smart terminal technology, and in particular to electronic devices and related sound leakage prevention methods. Background Art

[0002] With the popularity of full-screen mobile phones, the position of the mobile phone receiver has to be moved to the top of the screen, which makes the problem of sound leakage during handheld calls more serious. An effective anti-sound leakage solution for mobile phone calls can allow users to get rid of the current situation where they can only use headphones for private calls and achieve full privacy calls in handheld state. At present, there are many technical solutions that can reduce the sound leakage of mobile phones, but the effect of these technical solutions in reducing sound leakage is not significant. Therefore, how to improve the anti-sound leakage effect of calls is the current and future research direction. Summary of the invention

[0003] The embodiments of the present application provide an electronic device and a related method for preventing sound leakage, thereby ensuring privacy when making calls using the electronic device and improving the user experience.

[0004] In a first aspect, an embodiment of the present application provides an electronic device, the electronic device comprising an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprising M first array elements, the second type of array element comprising N second array elements, M and N being integers greater than 0; the audio processing unit, used to: receive an initial audio signal, and determine the first type of audio signal and the second type of audio signal based on the initial audio signal; wherein the first type of audio signal comprises M first audio signals, and the second type of audio signal comprises N second audio signals; the first type of audio signal is sent to the first type of array element, and the second type of audio signal is sent to the second type of array element, and one audio signal corresponds to one array element; the M first array elements in the first type of array element are used to: output M first sound wave signals based on the corresponding first audio signal; the N second array elements in the second type of array element are used to: output N second sound wave signals based on the corresponding second audio signal; the N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple position points within a first preset area.

[0005] In an embodiment of the present application, a plurality of array elements may be configured on the electronic device, wherein the plurality of array elements may include first-type array elements and second-type array elements. During a call, the audio processing unit may process the initial audio signal to be played to obtain M first audio signals and N second audio signals, and may send the M first audio signals to the corresponding first array elements, and send the N second audio signals to the corresponding second array elements. Furthermore, the first array element and the second array element may respectively output different sound wave signals simultaneously based on the received audio signal, so that the N second sound wave signals output by the N second-type array elements are superimposed and canceled with the sound leakage of the first-type array element at multiple position points within the sound leakage prevention area (i.e., the surrounding area of ​​the electronic device), so that the audio leakage effect in the sound leakage prevention area is reduced, so as to achieve private calls and improve user experience.

[0006] In some embodiments, the electronic device also includes M first filters, an audio processing unit, and is further used to: perform a first filtering process on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0007] In an embodiment of the present application, the input of the first filter may be an initial audio signal, and the output may be a first audio signal. If M is an integer greater than 1, that is, the electronic device includes multiple first filters, then the preset amplitude modulation and phase modulation parameters corresponding to each first filter may be different. The first filter may perform amplitude modulation and / or phase modulation processing on the received initial audio signal based on the preset amplitude modulation and phase modulation parameters to obtain a first audio signal. The first array element does not directly output the initial audio signal, but outputs a processed audio signal to eliminate the interference of the sound waves output by the second type of array element on the sound waves output by the first type of array element at multiple positions within the audio playback area, so that the audio reception effect within the audio playback area remains unchanged, thereby improving the user experience.

[0008] In some embodiments, the first preset area is a sound leakage prevention area, and the second preset area is an audio playback area.

[0009] In some embodiments, the electronic device also includes N second filters, and the audio processing unit is further used to: perform second filtering processing on the initial audio signal through each second filter to obtain N second audio signals; the second filtering processing includes amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0010] In an embodiment of the present application, different second filters may correspond to different preset amplitude modulation and phase modulation parameters, respectively. The input of the second filter may be an initial audio signal, and the output may be a second audio signal. The second filter may process the initial audio signal based on the preset amplitude modulation and phase modulation parameters corresponding to each other to obtain N second audio signals. Furthermore, the second type of array elements may output second audio signals respectively to superimpose and cancel the leakage of the first type of array elements at multiple positions in the anti-leakage area (i.e., the surrounding area), so that the audio leakage effect in the anti-leakage area is reduced, privacy calls are achieved, and the user experience is improved.

[0011] In some embodiments, the electronic device includes Q array elements, Q is greater than or equal to M+N, and the audio processing unit is further used to: obtain judgment information, the judgment information including one or more of the number of people in the current first preset area, the remaining power of the current electronic device, and the position of the current electronic device; based on the judgment information, determine M first array elements in the first category of array elements and N second array elements in the second category of array elements from the Q array elements.

[0012] In the embodiment of the present application, the electronic device can obtain the decision information through the audio processing unit, and the decision information may include but is not limited to the number of people in the first preset area, the remaining power of the current electronic device, and the location of the current electronic device. Further, the electronic device can determine M first array elements in the first type of array elements and N second array elements in the second type of array elements from the Q array elements based on the decision information, so as to select different array elements to work in different application scenarios, thereby improving system performance.

[0013] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current location of the electronic device is in a private area, the smaller the value of N.

[0014] In the embodiment of the present application, if there are more people in the first preset area, in order to ensure that people in the first preset area cannot hear the sound emitted by the electronic device, the number of the second type of array elements can be appropriately increased to obtain better quiet call quality. Or, when the remaining power of the electronic device is lower, the number of the second type of array elements can be appropriately reduced to reduce the power consumption of the electronic device. Or, the current location of the electronic device is in the user's private area, such as at home, and the user has a lower requirement for the quality of quiet calls, and the number of the second type of array elements can be appropriately reduced to reduce the power consumption of the electronic device.

[0015] In some embodiments, the distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

[0016] In the embodiment of the present application, the closer the distance between the N second array elements and the M first array elements, that is, the closer the distance between each of the N second array elements and each of the M first array elements, the better the sound leakage prevention effect is, thereby improving the user experience.

[0017] In some embodiments, the electronic device also includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the audio processing unit is further used to: respectively amplify the M first audio signals and the N second audio signals through the M+N power amplifier circuits to obtain the processed M first audio signals and the processed N second audio signals; the M first array elements in the first type of array elements are specifically used to output the M first sound wave signals based on the processed first type audio signals; the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0018] In an embodiment of the present application, after the M first filters and the N second filters respectively perform amplitude modulation processing and / or phase modulation processing on the initial audio signal, M first audio signals and N second audio signals can be obtained, and then the M first audio signals and the N second audio signals can be respectively input into the corresponding power amplifier circuits for processing to amplify the audio signals and promote each array element to make a sound, so that the user can hear clearer sound and improve the user experience.

[0019] In a second aspect, an embodiment of the present application provides a method for preventing sound leakage, which is applied to an electronic device, wherein the electronic device includes a display screen, an audio processing unit, a first type of array element and a second type of array element, wherein the first type of array element includes M first array elements, and the second type of array element includes N second array elements, where M and N are integers greater than 0; when the electronic device is in a call, a first interface is displayed through the display screen; a preset operation of a user on a preset area in the first interface is received and responded to, and a second interface is displayed; a touch operation for a first control in the second interface is received and responded to; an initial audio signal is received through the audio processing unit, and a first type of audio signal is determined based on the initial audio signal. and a second type of audio signal; wherein the first type of audio signal includes M first audio signals, and the second type of audio signal includes N second audio signals; the first type of audio signal is sent to the first type of array element, and the second type of audio signal is sent to the second type of array element, and one audio signal corresponds to one array element; through the M first array elements in the first type of array elements, based on the corresponding first audio signal, M first sound wave signals are output; through the N second array elements in the second type of array elements, based on the corresponding second audio signal, N second sound wave signals are output; the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

[0020] In a third aspect, an embodiment of the present application provides a method for preventing sound leakage, which is applied to an electronic device, wherein the electronic device includes an audio processing unit, a first-class array element and a second-class array element, the first-class array element includes M first array elements, the second-class array element includes N second array elements, and M and N are integers greater than 0; an initial audio signal is received through the audio processing unit, and a first-class audio signal and a second-class audio signal are determined based on the initial audio signal; wherein the first-class audio signal includes M first audio signals, and the second-class audio signal includes N second audio signals; the first-class audio signal is sent to the first-class array element, and the second-class audio signal is sent to the second-class array element, and one audio signal corresponds to one array element; based on the corresponding first audio signal, M first sound wave signals are output through the M first array elements in the first-class array elements; based on the corresponding second audio signal, N second sound wave signals are output through the N second array elements in the second-class array elements; the N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple position points within a first preset area.

[0021] In some embodiments, the electronic device also includes M first filters, and the method also includes: performing a first filtering process on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0022] In some embodiments, the first preset area is a sound leakage prevention area, and the second preset area is an audio playback area.

[0023] In some embodiments, the electronic device further includes N second filters, and the method further includes: performing a second filtering process on the initial audio signal through each second filter to obtain N second audio signals; the second filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal.

[0024] In some embodiments, the distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

[0025] In some embodiments, the electronic device includes Q array elements, Q is greater than or equal to M+N, and the method also includes: obtaining judgment information, the judgment information including one or more of the number of people in the current first preset area, the remaining power of the current electronic device, and the position of the current electronic device; based on the judgment information, determining M first array elements in the first category of array elements and N second array elements in the second category of array elements from the Q array elements.

[0026] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current location of the electronic device is in a private area, the smaller the value of N.

[0027] In some embodiments, the electronic device also includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the method also includes: amplifying the M first audio signals and the N second audio signals respectively by the M+N power amplifier circuits to obtain the processed M first audio signals and the processed N second audio signals; the M first array elements in the first type of array elements are specifically used to output M first sound wave signals based on the processed first type audio signals; the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0028] In a fourth aspect, an electronic device is provided, comprising: a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute a method such as the second aspect or any one of the embodiments of the second aspect, or the third aspect or any one of the embodiments of the third aspect.

[0029] In a fifth aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on an electronic device, cause the electronic device to execute a method according to the second aspect or any one of the embodiments of the second aspect, or a method according to the third aspect or any one of the embodiments of the third aspect.

[0030] In a sixth aspect, a computer program product is provided. When the computer program product runs on a computer, it enables the computer to execute a method according to the second aspect or any one of the embodiments of the second aspect, or a method according to the third aspect or any one of the embodiments of the third aspect.

[0031] In the seventh aspect, a chip system is provided, the chip system comprising at least one processor for implementing the method of the second aspect or any one of the embodiments of the second aspect, or the method of the third aspect or any one of the embodiments of the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0033] Figure 2 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application.

[0034] Figure 3a-3eA set of user interface schematic diagrams provided for embodiments of the present application.

[0035] Figure 4 A schematic diagram of the structure of a smart phone provided in an embodiment of the present application.

[0036] Figure 5 A schematic diagram of the structure of a smart head-mounted device provided in an embodiment of the present application.

[0037] Figure 6 A schematic diagram of a call scenario provided in an embodiment of the present application.

[0038] Figure 7 A schematic diagram of an array element provided in an embodiment of the present application.

[0039] Figure 8 A schematic diagram of another array element provided in an embodiment of the present application.

[0040] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0041] Fig.10 A schematic diagram of a filter provided in an embodiment of the present application.

[0042] Fig.11 A schematic diagram of another filter provided in an embodiment of the present application.

[0043] Fig.12 A schematic diagram of an anti-sound leakage effect provided in an embodiment of the present application.

[0044] Fig.13 A schematic diagram of a power amplifier circuit provided in an embodiment of the present application.

[0045] Fig.14 A flow chart of a method for determining filter parameters corresponding to each array element provided in an embodiment of the present application.

[0046] Fig.15 A schematic diagram of audio sampling provided in an embodiment of the present application.

[0047] Fig.16 A frequency response curve diagram of the human ear area and surrounding area provided in an embodiment of the present application.

[0048] Fig.17 A flowchart of a sound leakage prevention method provided in an embodiment of the present application.

[0049] Fig.18 A flowchart of another sound leakage prevention method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0051] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0052] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0053] An electronic device and a related sound leakage prevention method provided in an embodiment of the present application, the electronic device may include but is not limited to a smart phone, a tablet personal computer (Tablet PC), a wearable electronic device (such as smart glasses), a smart head-mounted device (such as VR glasses), etc.

[0054] When a traditional electronic device (such as a smart phone) is on a call, the electronic device is near the human ear, and only the screen speaker makes sound. Therefore, the only way to reduce the volume of the electronic device is to reduce the volume of the outside world. However, this will also make the sound heard by the human ear smaller, and the user cannot hear the sound clearly. In the present application, the electronic device can be configured with multiple array elements (such as multiple speakers or multiple sound outlets), and the filters corresponding to different array elements can be calculated by a preset algorithm. Furthermore, after the filter is applied to the multi-element system, the sound field formed by the superposition of the sound waves output by multiple speakers near the human ear is the same as the sound field formed when the screen speaker makes sound alone, ensuring that the volume and sound quality of the sound heard by the human ear remain unchanged, and the sound waves in the surrounding area are offset after superposition, reducing the sound leakage of the electronic device. In summary, the present application can greatly reduce the volume of sound leakage of the electronic device while ensuring that the sound quality and volume of the sound heard by the user remain unchanged.

[0055] Before introducing the method provided by the embodiment of the present application in detail, the electronic device provided by the embodiment of the present application is first introduced.

[0056] Figure 1 A schematic structural diagram of an electronic device 100 is shown.

[0057] The embodiment is described in detail below by taking the electronic device 100 as an example. It should be understood that the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0058] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a plurality of speakers 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a 3D camera module 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0059] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0060] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0061] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0062] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0063] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0064] The electronic device 100 can implement audio functions such as calls, music playback, and recording through the audio module 170, multiple speakers 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor.

[0065] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0066] The plurality of speakers 170A, also referred to as "speakers", are used to convert audio electrical signals into sound signals.

[0067] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0068] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0069] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0070] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0071] Figure 2 1 is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0072] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0073] The application layer can include a series of application packages.

[0074] like Figure 2As shown, the application package may include call, camera, gallery, calendar, map, navigation, WLAN, Bluetooth, music, video, short message and other applications (also referred to as applications).

[0075] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0076] like Figure 2 As shown, the application framework layer may include a phone manager, a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.

[0077] The phone manager is used to provide communication functions of the electronic device 100. For example, the management of call status (including answering, hanging up, etc.).

[0078] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0079] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0080] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0081] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0082] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications from applications running in the background, or a notification that appears on the screen in the form of a dialogue interface. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0083] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0084] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0085] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0086] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0087] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0088] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0089] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0090] A 2D graphics engine is a drawing engine for 2D drawings.

[0091] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0092] The following introduces the user interface provided by the embodiments of the present application.

[0093] Figure 3a-3e A set of user interfaces displayed on the electronic device 100 provided in an embodiment of the present application.

[0094] Figure 3a (a) in FIG. 1 shows an exemplary user interface 20 for displaying installed applications on the electronic device 100 .

[0095] like Figure 3aAs shown in (a), the user interface 20 displays one or more installed application icons. For example, the user interface 20 can display phone 201, camera, gallery, clock, calendar, memo, file management, email, music, calculator, Huawei video, sports health, weather, browser, smart life, settings, recorder, etc.

[0096] like Figure 3a As shown in (a) of FIG. 1 , the electronic device 100 can receive and respond to a user's touch operation on the phone 201 icon of the user interface 20 (i.e., an operation of opening a call application), start the call application, and display the following information on the display screen 194 of the electronic device 100: Figure 3a The user interface 21 shown in (b) may be a dialing interface, and the user interface 21 may include an area 202 and a control 203. The area 202 may be used to display a plurality of digital controls to facilitate the user to input a phone number; the control 203 may be used to dial the phone number input by the user.

[0097] like Figure 3a As shown in (b), the electronic device 100 can receive and respond to the user's input phone number operation in the area 202 of the user interface 21, and display the phone number input by the user on the user interface 21. The electronic device 100 can also receive and respond to the user's touch operation on the control 203 of the user interface 21, dial the phone number input by the user, and display the phone number on the display screen 194 of the electronic device 100 as shown in FIG. Figure 3b The user interface 22 shown in (a) may be a call interface, and the user interface 22 may include an area 204.

[0098] Optional, such as Figure 3a As shown in (b), the electronic device 100 can receive and respond to the user's input phone number operation in the area 202 of the user interface 21, and display the phone number input by the user on the user interface 21. The electronic device 100 can also receive and respond to the user's touch operation on the control 203 of the user interface 21, dial the phone number input by the user, and automatically turn on the quiet mode. After turning on the quiet mode, only the user can hear the sound from the speaker during the call, and the people around cannot hear the sound from the speaker, ensuring that the user can achieve privacy when using the electronic device 100 to make a call, thereby improving the user experience. In some embodiments, the quiet mode can also be called a quiet call mode, a silent call mode, an anti-leakage call mode, or a privacy call mode.

[0099] like Figure 3bAs shown in (a) of FIG. 1 , the electronic device 100 can receive and respond to a preset operation of the user in the area 204 of the user interface 22, such as a sliding operation of the user in the area 204, start the control center of the electronic device 100, and display the following information on the display screen 194 of the electronic device 100: Figure 3b The user interface 23 shown in (b) in FIG. 1 may be a control center interface, and the user interface 23 may include a control 205. The control 205 may be used to enable a silent mode during a call.

[0100] like Figure 3b As shown in (b) in the figure, the electronic device 100 can also receive and respond to the user's touch operation on the control 205 of the user interface 23 to turn on the quiet mode. After the quiet mode is turned on, only the user can hear the sound from the speaker during the call, and people around cannot hear the sound from the speaker, ensuring that the user can achieve privacy when using the electronic device 100 to make a call, thereby improving the user experience. How the electronic device 100 implements the quiet mode will be described in detail later, so it will not be repeated here.

[0101] like Figure 3c As shown, if the silent mode is turned on during a user call, a silent mode prompt can be displayed on the user interface 22 to remind the user that the silent mode is currently turned on. During the call, only the user can hear the sound from the speaker, while people around cannot hear the sound from the speaker, ensuring that the user can achieve privacy when using the electronic device 100 to make a call, thereby improving the user experience.

[0102] like Figure 3d As shown, when the electronic device 100 is called and rings, the electronic device 100 can display the user interface 24 on the display screen 194. The user interface 24 can be a caller ID interface, and the user interface 24 can include a control 206. The electronic device 100 can receive and respond to the user's operation of dragging the control 206 and sliding it to the right, answer the call, and display the following on the display screen 194 of the electronic device 100: Figure 3b In some embodiments, the electronic device 100 may receive and respond to a preset operation of the user in the area 204 of the user interface 22, such as a sliding operation of the user in the area 204, start the control center of the electronic device 100, and display the following information on the display screen 194 of the electronic device 100: Figure 3b The user interface 23 shown in (b) in FIG. Figure 3bAs shown in (b) of FIG. 2 , the electronic device 100 may receive and respond to a user's touch operation on the control 205 of the user interface 23 to turn on the silent mode. In some embodiments, the electronic device 100 may receive and respond to a user's operation of dragging the control 206 and sliding it to the right to answer a call and automatically turn on the silent mode.

[0103] like Figure 3e As shown, when the electronic device 100 enters the chat software (such as WeChat chat software) and opens the chat dialog box, the electronic device 100 can display the user interface 25 through the display screen 194. The user interface 25 can be a chat dialog interface, and the user interface 25 can include a voice message sent by the chat partner. The electronic device 100 can receive and respond to the user's operation of clicking on the voice message, turn on the quiet mode and play the voice message, so that only the user can hear the sound from the speaker during the voice playback process, and the people around cannot hear the sound from the speaker clearly, ensuring that the user can play the voice message privately when using the electronic device 100 to improve the user experience.

[0104] The following is an introduction to an electronic device involved in an embodiment of the present application:

[0105] Please see attached Figure 4 , Figure 4 It is assumed that the electronic device 100 is a smart phone, and the smart phone may be provided with Q array elements and an audio processing unit, where Q is an integer greater than or equal to 2. Figure 4 Only three array elements are shown, namely, array element 1, array element 2 and array element 3; Figure 4 The audio processing unit in the above Figure 1 The audio module 170 in the embodiment of the present invention is composed of the above-mentioned processor 110. It should be noted that the array element can be understood as a speaker or a sound outlet. Figure 5 , Figure 5 It is assumed that the electronic device 100 is a smart head-mounted device (such as VR glasses), and the smart head-mounted device may also be provided with Q array elements and an audio processing unit, where Q is an integer greater than or equal to 2. Figure 5 Only four array elements are shown, namely, array element 1, array element 2, array element 3 and array element 4; Figure 5 The audio processing unit in the above Figure 1 The audio module 170 in the embodiment of the present invention may be composed of the above-mentioned processor 110. It is understood that the electronic device 100 in the present application may include but is not limited to Figure 4 and Figure 5 Two types of electronic devices are provided by way of example. For ease of description, the electronic device 100 is taken as an example of a smart phone, and a detailed description of the electronic device 100 is as follows:

[0106] In some embodiments, after the electronic device 100 dials the phone number input by the user, the silent mode is automatically turned on. After the silent mode is turned on, only the user can hear the sound from the speaker during the call, and people around cannot hear the sound from the speaker, ensuring that the user can make a private call when using the electronic device 100 to improve the user experience. Figure 3a The relevant description of (b) will not be repeated here.

[0107] In some embodiments, the electronic device 100 may also receive and respond to a user's operation during a call to turn on the silent mode. Figure 3b The relevant description of (b) in FIG. 1 is not repeated here.

[0108] In some embodiments, when the electronic device 100 is called and rings, the silent mode can be automatically turned on when the electronic device 100 answers the call; the electronic device 100 can also receive a user operation during the call to turn on the silent mode. Figure 3d The relevant description will not be repeated here.

[0109] In some embodiments, the electronic device 100 can turn on the silent mode when playing the voice message. Figure 3e The relevant description will not be repeated here.

[0110] Next, the following will describe how the electronic device 100 can realize that after the silent mode is turned on, only the user can hear the sound emitted by the array element (such as a speaker) during a call, while people around cannot hear the sound emitted by the array element. The detailed description is as follows:

[0111] In some embodiments, the electronic device 100 may obtain judgment information through an audio processing unit, where the judgment information includes one or more of the number of people in the current first preset area, the remaining power of the current electronic device 100, and the current position of the electronic device 100; based on the judgment information, M first array elements in the first category of array elements and N second array elements in the second category of array elements are determined from the Q array elements, where M and N are integers greater than 0.

[0112] Specifically, Figure 6As shown, when the user holds the electronic device 100 to make a call or listen to voice, the first preset area can be understood as the anti-sound leakage area (i.e., the surrounding area). For example, the space within the user's shoulder width of 1m is called the personal area, and the space outside the personal area can be called the surrounding area. The purpose of this application is to leak the sound volume to the surrounding area (i.e., the first preset area) as low as possible. The second preset area can be understood as the audio playback area (i.e., the area inside the human ear), such as the space between the human auricle and the electronic device 100. The first preset area is larger than the second preset area. When the electronic device 100 starts the quiet mode, the electronic device 100 can obtain the judgment information through the audio processing unit, and the judgment information may include but is not limited to the number of people in the first preset area, the remaining power of the current electronic device 100, and the current position of the electronic device 100. Further, the electronic device 100 can determine M first array elements in the first type of array elements and N second array elements in the second type of array elements from the Q array elements based on the judgment information.

[0113] For example, the judgment information is that the number of people in the first preset area is 4, and the current remaining power of the electronic device 100 is relatively large. Figure 7 As shown, the electronic device 100 can determine, based on the judgment information, that the first type of array elements includes one array element, which is array element 1, and array element 1 can be a screen speaker; and the second type of array elements includes two array elements, which are array element 2 and array element 3. Since the remaining power of the current electronic device 100 is relatively large, and there are many people in the first preset area, the user can appropriately increase the number of the second type of array elements in this scenario to improve the quality of quiet calls when using the electronic device to improve the user experience.

[0114] For another example, the judgment information is that the number of people in the first preset area is 1, and the remaining power of the current electronic device 100 is small. Figure 8 As shown, the electronic device 100 can determine, based on the judgment information, that the first type of array elements includes one array element, which is array element 1, and array element 1 can be a screen speaker; and the second type of array elements includes one array element, which is array element 2. Since there are fewer people in the first preset area and the current power of the electronic device 100 is low, the number of the second type of array elements can be appropriately reduced to ensure that the user can have a quiet call while reducing power consumption and improving system performance.

[0115] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current location of the electronic device is in a private area, the smaller the value of N.

[0116] Specifically, Figure 6As shown, if there are more people in the first preset area, in order to ensure that the people in the first preset area cannot hear the sound emitted by the electronic device 100, the number of the second type of array elements can be appropriately increased to obtain better quiet call quality. Or, when the remaining power of the electronic device 100 is lower, the number of the second type of array elements can be appropriately reduced to reduce the power consumption of the electronic device 100. Or, the current location of the electronic device 100 is in the user's private area, such as at home, and the user has a lower requirement for the quality of quiet calls, and the number of the second type of array elements can be appropriately reduced to reduce the power consumption of the electronic device 100.

[0117] In some embodiments, the distance between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements is within a first range. Specifically, the first range may be 1 mm to 10 cm. The closer the distance between the N second array elements and the M first array elements, that is, the closer the distance between each second array element in the N second array elements and each first array element in the M first array elements, the better the sound leakage prevention effect is, and the user experience is improved.

[0118] The audio processing unit is used to receive an initial audio signal and determine a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0119] Specifically, the first type of audio signal includes M first audio signals, and the second type of audio signal includes N second audio signals. When the electronic device 100 is in a call, the audio processing unit of the electronic device 100 can receive the initial audio signal through the antenna. Next, the audio processing unit can divide the initial audio signal into M+N signals, and each signal is the same, that is, the same frequency and the same amplitude. Further, the audio processing unit can obtain M first audio signals and N second audio signals based on the M+N signals.

[0120] In some embodiments, the audio processing unit is specifically used to: divide the initial audio signal into M-channel signals, and determine the M-channel signals as M first audio signals. Specifically, after the electronic device 100 receives the initial audio signal through the audio processing unit and determines the first type of array element, the initial audio signal can be divided into M-channel signals, and the M-channel signals can be used as M first audio signals, so that after the first type of array element sounds later, the user can clearly hear the call content (i.e., the call content corresponding to the initial audio signal) in the audio playback area.

[0121] In some embodiments, the electronic device 100 also includes M first filters and an audio processing unit, which are specifically used to: perform a first filtering process on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within the second preset area; the first filtering process includes amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio reception effect of the processed initial audio signal in the second preset area remains unchanged.

[0122] Specifically, Fig.10 As shown, it is assumed that M is 1. The electronic device 100 includes a first filter, which is the first filter 1. The first filter 1 corresponds to preset amplitude modulation and phase modulation parameters. The input of the first filter 1 can be an initial audio signal, and the output can be a first audio signal. If M is an integer greater than 1, that is, the electronic device 100 includes multiple first filters, the preset amplitude modulation and phase modulation parameters corresponding to each first filter can be different. The first filter 1 can perform amplitude modulation and / or phase modulation processing on the received initial audio signal based on the preset amplitude modulation and phase modulation parameters to obtain a first audio signal. The first array element 1 does not directly output the initial audio signal, but outputs the processed audio signal to eliminate the interference of the sound waves output by the second type of array element on the sound waves output by the first type of array element at multiple position points in the audio playback area, so that the audio reception effect in the audio playback area remains unchanged, thereby improving the user experience.

[0123] In some embodiments, the electronic device 100 also includes N second filters and an audio processing unit, which is specifically used to: perform a second filtering process on the initial audio signal through each second filter to obtain N second audio signals; the second filtering process includes amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio leakage effect of the processed initial audio signal within the first preset area is reduced.

[0124] Specifically, Fig.11 As shown, it is assumed that N is 2. The electronic device 100 includes two second filters, namely the second filter 1 and the second filter 2, respectively. The second filter 1 and the second filter 2 correspond to different preset amplitude modulation and phase modulation parameters, respectively. The input of the second filter 1 and the second filter 2 can be the initial audio signal, and the output can be the second audio signal. The second filter 1 and the second filter 2 can process the initial audio signal based on their respective corresponding preset amplitude modulation and phase modulation parameters to obtain two second audio signals respectively. Furthermore, the second type of array elements can output second audio signals respectively to superimpose and cancel the leakage of the first type of array elements at multiple position points in the anti-leakage area (i.e., the surrounding area), so that the audio leakage effect in the anti-leakage area is reduced, privacy calls are achieved, and the user experience is improved.

[0125] For example, Fig.12 As shown, if the second type of array element does not make a sound, and only the first type of array element, for example, array element 1, makes a sound, other people in the area around the user will hear the sound leakage of array element 1, and the privacy of the call cannot be guaranteed. In this application, the second type of array element is introduced to make a sound at the same time as the first type of array element, and the sound waves output by the second type of array element at multiple positions in the area around the user will be superimposed and canceled with the sound waves output by the first type of array element, so that the sound pressure of the sound leakage of the first type of array element in the area around the user is reduced, and other people in the surrounding area cannot hear the sound emitted by the first type of array element, so that a fully private call is achieved and the user experience is improved.

[0126] The audio processing unit is further used to send the first type of audio signals to the first type of array elements, and send the second type of audio signals to the second type of array elements.

[0127] Specifically, after the audio processing unit determines the first type of audio signal and the second type of audio signal based on the initial audio signal, the audio processing unit will also send the first type of audio signal to the first type of array element and the second type of audio signal to the second type of array element, and one audio signal corresponds to one array element.

[0128] For example, Fig. 9 As shown, the audio processing unit can send the M first audio signals in the obtained first audio signal to the corresponding first array element. At the same time, the audio processing unit can also send the N second audio signals in the obtained second audio signal to the corresponding second array element, so that the first array element and the second array element can make sounds at the same time, and the sound waves output by the second array element at multiple positions in the user's surrounding area will be superimposed and canceled with the sound waves output by the first array element, so that the sound pressure of the first array element in the user's surrounding area is reduced, and other people in the surrounding area cannot hear the sound emitted by the first array element, so that full privacy calls are achieved and the user experience is improved.

[0129] The M first array elements in the first type of array elements are used to output M first sound wave signals based on the corresponding first audio signals.

[0130] Specifically, after receiving the first audio signal, each first array element in the first type of array elements can convert the audio signal into a sound wave signal and output it, so that the user can clearly hear the call content (i.e., the call content corresponding to the initial audio signal) in the audio playback area. In addition, if the first type of array elements do not directly output the initial audio signal, but output the processed audio signal, the interference of the sound waves output by the second type of array elements on the sound waves output by the first type of array elements can be eliminated at multiple positions in the audio playback area, so that the audio reception effect in the audio playback area remains unchanged, thereby improving the user experience.

[0131] The N second array elements in the second type of array elements are used to output N second sound wave signals based on the corresponding second audio signals.

[0132] Specifically, after receiving the second audio signal, each second array element in the second type of array element can convert the audio signal into a sound wave signal and output it simultaneously with the sound wave signal of the first type of array element, so that the sound wave output by the second type of array element can be superimposed and canceled with the leakage sound of the first type of array element at multiple positions in the anti-leakage area (i.e., the surrounding area), so that the audio leakage effect in the anti-leakage area is reduced, that is, the leakage sound pressure of the first type of array element in the area around the user is reduced, and other people in the surrounding area cannot hear the sound emitted by the first type of array element, thereby realizing full privacy calls and improving user experience.

[0133] In some embodiments, Fig.13 As shown, the electronic device 100 also includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the audio processing unit is further used to: respectively amplify the M first audio signals and the N second audio signals through the M+N power amplifier circuits to obtain the processed M first audio signals and the processed N second audio signals; the M first array elements in the first type of array elements are specifically used to output M first sound wave signals based on the processed first type audio signals; the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0134] Specifically, after the M first filters and the N second filters respectively perform amplitude modulation processing and / or phase modulation processing on the initial audio signal, M first audio signals and N second audio signals can be obtained, and then the M first audio signals and the N second audio signals can be respectively input into the corresponding power amplifier circuits for processing to amplify the audio signals and drive each array element to make a sound, so that the user can hear clearer sound and improve the user experience.

[0135] Next, we will combine the attached Fig.14 , describes a method for determining filter parameters corresponding to each array element provided by an embodiment of the present application.

[0136] Step S301: collecting transfer functions from each array element to each region.

[0137] Specifically, first, a first preset area (surrounding area) and a second preset area (audio playback area) may be determined, and a plurality of first sampling points may be determined from the first preset area, and a plurality of second sampling points may be determined from the second preset area. Further, the electronic device 100 may play the same frequency sweep signal through each of the plurality of array elements, and collect the sound wave signal output by each array element at each sampling point, so as to obtain a transfer function from each array element to each sampling point.

[0138] For example, Fig.15 As shown, the target sampling point a is one of the multiple first sampling points, and the electronic device 100 is provided with three array elements, namely, array element 1, array element 2, and array element 3, and array element 1 is a first type array element, and array element 2 and array element 3 are second type array elements. The electronic device 100 plays a sweep signal through array element 1, collects the sound wave signal output by array element 1 at the target sampling point a, and obtains (i.e., the transfer function of array element 1 at the target sampling point a); the electronic device 100 plays the sweep signal through array element 2, collects the sound wave signal output by array element 2 at the target sampling point a, and obtains (i.e., the transfer function of array element 2 at the target sampling point a); the electronic device 100 plays the sweep signal through array element 3, collects the sound wave signal output by array element 3 at the target sampling point a, and obtains (i.e., the transfer function of array element 3 at target sampling point a). By analogy, the transfer function from each array element to each sampling point can be obtained. It should be noted that the transfer functions corresponding to the multiple first sampling points can be expressed as The transfer functions corresponding to multiple second sampling points can be expressed as express.

[0139] Step S302: determining the filter corresponding to each array element based on a preset algorithm.

[0140] Specifically, based on the transfer function data obtained above, the filter parameters corresponding to each array element can be calculated by a preset algorithm (such as a neural network algorithm).

[0141] For example, in a scenario where the electronic device 100 includes three array elements, in order to ensure that the sound waves generated by each array element can be superimposed and canceled in the first preset area (i.e., the surrounding area), the filter parameters corresponding to array element 2 and array element 3 respectively (i.e., the preset amplitude modulation and phase modulation parameters mentioned above) can be determined based on the transfer functions corresponding to the multiple first sampling points respectively. Assume that the multiple first sampling points include four points a, b, c, and d, and the corresponding transfer functions are, The filter parameter w2 corresponding to the array element 2 and the filter parameter w3 corresponding to the array element 3 may be determined based on formula 1.

[0142]

[0143] Where i can be a, b, c, d respectively. Substituting the transfer function into Formula 1 respectively, w2 and w3 can be obtained comprehensively. Since multiple first acquisition points in the first preset area are taken into account when calculating w2 and w3, it can be ensured that when any audio signal is processed based on w2 and w3, the sound wave signal output by the second type of array element and the sound wave signal output by the first type of array element can be superimposed and cancelled at multiple position points within the first preset expectation, thereby achieving full privacy calls and improving user experience.

[0144] At the same time, in order to ensure that the audio playback effect in the second preset area (i.e., the audio playback area) remains unchanged, the filter parameters corresponding to the array element 1 (i.e., the preset amplitude modulation and phase modulation parameters mentioned above) can be determined based on the transfer functions corresponding to the multiple second sampling points.

[0145] For example, the plurality of second sampling points include four points e, f, g, and h, and the corresponding transfer functions are: The filter parameter w1 corresponding to the array element 1 can be determined based on formula 2.

[0146]

[0147] Wherein, H is the frequency sweep signal, and i can be e, f, g, and h respectively. Substituting the transfer function into Formula 2 respectively, w1 can be obtained comprehensively. Since multiple second acquisition points in the second preset area are taken into account when calculating w1, it can be ensured that when any audio signal is processed based on w1, the interference of the sound waves output by the second type of array element on the sound waves output by the first type of array element can be eliminated at multiple position points in the second preset area (audio playback area), so that the audio reception effect in the audio playback area remains unchanged, thereby improving the user experience.

[0148] After determining w1 corresponding to element 1, w2 corresponding to element 2, and w3 corresponding to element 3, these filter parameters can be stored locally in the electronic device 100 in advance. When the electronic device 100 starts the quiet mode, the filter parameters stored in advance can be called to process the initial audio signal received by the electronic device 100 to achieve quiet calls and improve user experience.

[0149] For example, Fig.16 As shown, Fig.16 A frequency response curve diagram of a human ear area and surrounding area provided in an embodiment of the present application, Fig.16The frequency response curve of the surrounding area in (a) (solid line with o) is lower than the frequency response curve of the surrounding area before the implementation of the present application (solid line with x), while the frequency response curve of the human ear area is basically the same (solid line and dotted line), which shows that the technical solution provided by the present application can reduce the sound leakage of the mobile phone to the surrounding area as much as possible without changing the user's hearing sense. Fig.16 (b) is the Acoustic Contrast (AC) curve. The AC is the average sound pressure level in the ear area minus the average sound pressure level in the surrounding area. The lower the AC, the more serious the sound leakage problem. Fig.16 (b) shows that the sound contrast ratio increases significantly after the implementation of the solution of the present application, indicating that the volume of the leaked sound is significantly reduced.

[0150] See also Fig.17 An embodiment of the present application provides a sound leakage prevention method, which is applied to an electronic device, wherein the electronic device includes a display screen, an audio processing unit, a first type of array element and a second type of array element, wherein the first type of array element includes M first array elements, and the second type of array element includes N second array elements, where M and N are integers greater than 0.

[0151] Step S401: When the electronic device is in a call, a first interface is displayed on the display screen.

[0152] Specifically, the first interface can be Figure 3b The user interface 22 in (a) of FIG. For a detailed description, please refer to the above description of the user interface 22, which will not be repeated here.

[0153] Step S402: receiving and responding to a preset operation of the user on a preset area in the first interface, and displaying a second interface.

[0154] Specifically, the preset area may be the area 204 in the user interface 22. The preset operation may be a sliding operation on the preset area. The second interface may be Figure 3b The user interface 23 in (b) of FIG. For a detailed description, please refer to the above description of the user interface 23, which will not be repeated here.

[0155] Step S403: receiving and responding to a touch operation on the first control in the second interface.

[0156] Specifically, the first control may be the control 205 on the user interface 23 .

[0157] Step S404: receiving an initial audio signal through an audio processing unit, and determining a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0158] The first type of audio signals includes M first audio signals, and the second type of audio signals includes N second audio signals.

[0159] Step S405: sending the first type of audio signals to the first type of array elements, and sending the second type of audio signals to the second type of array elements.

[0160] Among them, one audio signal corresponds to one array element.

[0161] Step S406: outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements.

[0162] Step S407: outputting N second sound wave signals based on the corresponding second audio signals through N second array elements in the second type of array elements.

[0163] Specifically, the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

[0164] In the present application, a plurality of array elements may be configured on an electronic device, wherein the plurality of array elements may include a first type of array element and a second type of array element. During a call, the audio processing unit may process the initial audio signal to be played to obtain M first audio signals and N second audio signals, and may send the M first audio signals to the corresponding first array elements, and send the N second audio signals to the corresponding second array elements. Furthermore, the first array element and the second array element may respectively output different sound wave signals simultaneously based on the received audio signal, so that the N second sound wave signals output by the N second type of array elements are superimposed and canceled with the sound leakage of the first type of array element at multiple position points within the sound leakage prevention area (i.e., the surrounding area of ​​the electronic device), so that the audio leakage effect in the sound leakage prevention area is reduced, so as to achieve privacy calls and improve user experience.

[0165] Please see attached Fig.18 An embodiment of the present application provides a sound leakage prevention method, which is applied to an electronic device, wherein the electronic device includes an audio processing unit, a first type of array element and a second type of array element, wherein the first type of array element includes M first array elements, and the second type of array element includes N second array elements, where M and N are integers greater than 0.

[0166] Step S501: receiving an initial audio signal through an audio processing unit, and determining a first type of audio signal and a second type of audio signal based on the initial audio signal.

[0167] The first type of audio signals includes M first audio signals, and the second type of audio signals includes N second audio signals.

[0168] Step S502: sending the first type of audio signals to the first type of array elements, and sending the second type of audio signals to the second type of array elements.

[0169] Specifically, one audio signal corresponds to one array element.

[0170] Step S503: outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements.

[0171] Step S504: outputting N second sound wave signals based on the corresponding second audio signals through N second array elements in the second type of array elements.

[0172] Specifically, the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

[0173] In some embodiments, the electronic device also includes M first filters, and the method also includes: performing a first filtering process on the initial audio signal through each first filter to obtain M first audio signals; the M first audio signals are used to eliminate the interference of N second sound wave signals on the M first sound wave signals at multiple position points within the second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio reception effect of the processed initial audio signal within the second preset area remains unchanged.

[0174] In some embodiments, the first preset area is a sound leakage prevention area, the second preset area is an audio playback area, and the first preset area is larger than the second preset area.

[0175] In some embodiments, the electronic device also includes N second filters, and the method also includes: performing a second filtering process on the initial audio signal through each second filter to obtain N second audio signals; the second filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio leakage effect of the processed initial audio signal within the first preset area is reduced.

[0176] In some embodiments, the electronic device includes Q array elements, Q is greater than or equal to M+N, and the method also includes: obtaining judgment information, the judgment information including one or more of the number of people in the current first preset area, the remaining power of the current electronic device, and the position of the current electronic device; based on the judgment information, determining M first array elements in the first category of array elements and N second array elements in the second category of array elements from the Q array elements.

[0177] In some embodiments, the more people there are in the current first preset area, the larger the value of N; or, the lower the remaining power of the current electronic device, the smaller the value of N; or, the current location of the electronic device is in a private area, the smaller the value of N.

[0178] In some embodiments, the electronic device also includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the method also includes: amplifying the M first audio signals and the N second audio signals respectively by the M+N power amplifier circuits to obtain the processed M first audio signals and the processed N second audio signals; the M first array elements in the first type of array elements are specifically used to output M first sound wave signals based on the processed first type audio signals; the second type of array elements are specifically used to output N second sound wave signals based on the processed second type audio signals.

[0179] In summary, in the present application, a plurality of array elements may be configured on the electronic device, wherein the plurality of array elements may include first-class array elements and second-class array elements. During a call, the audio processing unit may process the initial audio signal to be played to obtain M first audio signals and N second audio signals, and may send the M first audio signals to the corresponding first array elements, and send the N second audio signals to the corresponding second array elements. Furthermore, the first array element and the second array element may respectively output different sound wave signals simultaneously based on the received audio signal, so that the N second sound wave signals output by the N second-class array elements are superimposed and canceled with the sound leakage of the first-class array elements at multiple position points within the sound leakage prevention area (i.e., the surrounding area of ​​the electronic device), so that the audio leakage effect in the sound leakage prevention area is reduced, so as to achieve privacy calls and improve user experience.

[0180] The present application provides a computer storage medium, characterized in that the computer storage medium stores a computer program, and when the computer program is executed by a processor, any one of the above-mentioned sound leakage prevention methods is implemented.

[0181] An embodiment of the present application provides an electronic device, which includes a processor, and the processor is configured to support the electronic device to implement the corresponding functions in any of the above-mentioned sound leakage prevention methods. The electronic device may also include a memory, which is coupled to the processor and stores the necessary program instructions and data of the electronic device. The electronic device may also include a communication interface for the electronic device to communicate with other devices or a communication network.

[0182] The present application provides a chip system, which includes a processor for supporting an electronic device to implement the functions involved above, for example, generating or processing information involved in the above-mentioned sound leakage prevention method. In a possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the electronic device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0183] The present application provides a computer program, characterized in that the computer program includes instructions, and when the computer program is executed by a computer, the computer executes the above-mentioned sound leakage prevention method.

[0184] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0185] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0186] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the above-mentioned units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0187] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0188] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0189] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform all or part of the steps of the above-mentioned methods of each embodiment of the present application. Among them, the aforementioned storage medium may include: U disk, mobile hard disk, magnetic disk, optical disk, read-only memory (Read-Only Memory, abbreviated: ROM) or random access memory (Random Access Memory, abbreviated: RAM) and other media that can store program codes.

[0190] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An electronic device, characterized in that: The electronic device comprises an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprises M first array elements, the second type of array element comprises N second array elements, and M and N are integers greater than 0; The audio processing unit is used for: Receive an initial audio signal, and determine a first-category audio signal and a second-category audio signal based on the initial audio signal; wherein the first-category audio signal includes M first audio signals, and the second-category audio signal includes N second audio signals; Sending the first-type audio signal to the first-type array element, and sending the second-type audio signal to the second-type array element, wherein one audio signal corresponds to one array element; The M first array elements in the first type of array elements are used to: Based on the corresponding first audio signal, output M first sound wave signals; The N second array elements in the second type of array elements are used to: Based on the corresponding second audio signal, N second sound wave signals are output; the N second sound wave signals are used to superimpose and cancel each other with the M first sound wave signals at multiple position points within the first preset area.

2. The device according to claim 1, characterized in that The electronic device further includes M first filters, and the audio processing unit is further used for: The initial audio signal is subjected to a first filtering process by each of the first filters to obtain the M first audio signals; the M first audio signals are used to eliminate interference of the N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal.

3. The device according to claim 2, characterized in that The first preset area is a sound leakage prevention area, and the second preset area is an audio playback area.

4. The device according to any one of claims 1 to 3, characterized in that: The electronic device further includes N second filters, and the audio processing unit is further used for: The N second audio signals are obtained by performing a second filtering process on the initial audio signal through each of the second filters; the second filtering process includes performing amplitude modulation process and / or phase modulation process on the initial audio signal.

5. The device according to any one of claims 1 to 4, characterized in that: The electronic device includes Q array elements, where Q is greater than or equal to M+N, and the audio processing unit is further used for: Obtaining decision information, wherein the decision information includes one or more of the number of people currently in the first preset area, the remaining power of the current electronic device, and the current position of the electronic device; Based on the decision information, the M first array elements in the first type of array elements and the N second array elements in the second type of array elements are determined from the Q array elements.

6. The device according to claim 5, characterized in that The more people there are in the first preset area, the larger the value of N; or, the lower the remaining power of the electronic device, the smaller the value of N; or, the electronic device is currently located in a private area, the smaller the value of N.

7. The device according to claim 5 or 6, characterized in that The distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

8. The device according to any one of claims 1 to 7, characterized in that: The electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the audio processing unit is further used for: Amplifying the M first audio signals and the N second audio signals respectively through the M+N power amplifier circuits to obtain processed M first audio signals and processed N second audio signals; The M first array elements in the first type of array elements are specifically configured to output the M first sound wave signals based on the processed first type of audio signals; The second type of array element is specifically used to output the N second sound wave signals based on the processed second type of audio signal.

9. A method for preventing sound leakage, characterized in that: Applied to an electronic device, the electronic device comprises a display screen, an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprises M first array elements, the second type of array element comprises N second array elements, M and N are integers greater than 0; the method comprises: When the electronic device is in a call, the first interface is displayed through the display screen; a preset operation of the user on a preset area in the first interface is received and responded to, and a second interface is displayed; a touch operation for a first control in the second interface is received and responded to; An initial audio signal is received through the audio processing unit, and a first-category audio signal and a second-category audio signal are determined based on the initial audio signal; wherein the first-category audio signal includes M first audio signals, and the second-category audio signal includes N second audio signals; the first-category audio signal is sent to the first-category array element, and the second-category audio signal is sent to the second-category array element, and one audio signal corresponds to one array element; Outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements; N second array elements in the second type of array elements are used to output N second sound wave signals based on the corresponding second audio signal; the N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple position points within the first preset area.

10. A method for preventing sound leakage, characterized in that: Applied to an electronic device, the electronic device comprises an audio processing unit, a first type of array element and a second type of array element, the first type of array element comprises M first array elements, the second type of array element comprises N second array elements, M and N are integers greater than 0; the method comprises: An initial audio signal is received through the audio processing unit, and a first-category audio signal and a second-category audio signal are determined based on the initial audio signal; wherein the first-category audio signal includes M first audio signals, and the second-category audio signal includes N second audio signals; the first-category audio signal is sent to the first-category array element, and the second-category audio signal is sent to the second-category array element, and one audio signal corresponds to one array element; Outputting M first sound wave signals based on the corresponding first audio signal through M first array elements in the first type of array elements; N second array elements in the second type of array elements are used to output N second sound wave signals based on the corresponding second audio signal; the N second sound wave signals are used to superimpose and cancel the M first sound wave signals at multiple position points within the first preset area.

11. The method according to claim 10, characterized in that The electronic device further includes M first filters, and the method further includes: The initial audio signal is subjected to a first filtering process by each of the first filters to obtain the M first audio signals; the M first audio signals are used to eliminate interference of the N second sound wave signals on the M first sound wave signals at multiple position points within a second preset area; the first filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio reception effect of the processed initial audio signal within the second preset area remains unchanged.

12. The method according to claim 11, characterized in that The first preset area is a sound leakage prevention area, the second preset area is an audio playback area, and the first preset area is larger than the second preset area.

13. The method according to any one of claims 10 to 12, characterized in that: The electronic device further includes N second filters, and the method further includes: The initial audio signal is subjected to a second filtering process by each of the second filters to obtain the N second audio signals; the second filtering process includes performing amplitude modulation processing and / or phase modulation processing on the initial audio signal, and the audio leakage effect of the processed initial audio signal within the first preset area is reduced.

14. The method according to any one of claims 10 to 13, characterized in that: The electronic device includes Q array elements, Q is greater than or equal to M+N, and the method further includes: Obtaining decision information, wherein the decision information includes one or more of the number of people currently in the first preset area, the remaining power of the current electronic device, and the current position of the electronic device; Based on the decision information, the M first array elements in the first type of array elements and the N second array elements in the second type of array elements are determined from the Q array elements.

15. The method according to claim 14, characterized in that The more people there are in the first preset area, the larger the value of N; or, the lower the remaining power of the electronic device, the smaller the value of N; or, the electronic device is currently located in a private area, the smaller the value of N.

16. The method according to claim 14 or 15, characterized in that The distances between the N second array elements in the second type of array elements and the M first array elements in the first type of array elements are within a first range.

17. The method according to any one of claims 10 to 16, characterized in that: The electronic device further includes M+N power amplifier circuits, one power amplifier circuit corresponds to one audio signal, and the method further includes: Amplifying the M first audio signals and the N second audio signals respectively through the M+N power amplifier circuits to obtain processed M first audio signals and processed N second audio signals; The M first array elements in the first type of array elements are specifically configured to output the M first sound wave signals based on the processed first type of audio signals; The second type of array element is specifically used to output the N second sound wave signals based on the processed second type of audio signal.

18. An electronic device, characterized in that: include: A memory, one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method as described in any one of claims 10-17.

19. A chip system, characterized in that: The chip system includes at least one processor, a memory and an interface circuit. The memory, the interface circuit and the at least one processor are interconnected by lines. Instructions are stored in the at least one memory. When the instructions are executed by the processor, the method described in any one of claims 10-17 is implemented.

20. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method as claimed in any one of claims 10 to 17.

21. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method as claimed in any one of claims 10 to 17.

Images