Screen sounding device protection method and apparatus, and electronic device

Abstract

The application provides a screen sound production device protection method and device and electronic equipment, and belongs to the technical field of loudspeakers. The method comprises the following steps: acquiring a first audio signal and a state parameter of a screen sound production device; determining a frequency point parameter of each frequency point in the first audio signal based on the first audio signal; determining a protection threshold of each frequency point based on the state parameter; in the case that the first audio signal comprises at least one overvalue frequency point, determining a first filtering parameter corresponding to each overvalue frequency point based on the frequency point parameter of the overvalue frequency point and the protection threshold of the overvalue frequency point; performing filtering processing on the first audio signal based on the first filtering parameter corresponding to each overvalue frequency point, so as to reduce the frequency point parameter of the overvalue frequency point; and playing the first audio through the screen sound production device based on the filtered first audio signal. In this way, the method does not need to be connected with a protection resistor, and can perform fine control on different frequency points in the input audio signal, so as to maximize the performance of each frequency band of the screen sound production device.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of loudspeakers, and particularly relates to a screen sound production device protection method and device and electronic equipment. BACKGROUND

[0002] At present, voice communication, music playing, video playing and the like have become important functions of electronic equipment such as mobile phones. In the process of providing voice communication, music playing, video playing and the like for users, the electronic equipment such as mobile phones can convert an audio signal into a sound signal through a loudspeaker and output the sound signal.

[0003] A conventional coil type loudspeaker needs to open a sound hole on a front panel of the electronic equipment such as mobile phones, so that the user can receive the sound output by the loudspeaker. However, with the increasing requirement of screen ratio of the electronic equipment such as mobile phones, in order to reduce the occupied area of the sound hole, some electronic equipment such as mobile phones uses a screen sound production device as a loudspeaker. The screen sound production device can be connected to the back of the screen, and then sound is produced by driving the screen of the electronic equipment such as mobile phones to vibrate, so that the screen sound production device does not need to open a sound hole on the electronic equipment such as mobile phones, and can meet the requirement of high screen ratio.

[0004] At present, in order to prevent the screen sound production device from being overloaded and damaged, a protection resistor is usually connected in series on the screen sound production device, or the input audio signal is subjected to amplitude limiting processing. However, connecting the protection resistor in series on the screen sound production device or subjecting the input audio signal to the amplitude limiting processing will cause the full-band attenuation of the input audio signal, and further cause the distortion of the audio signal, thereby affecting the user's listening experience. SUMMARY

[0005] The application provides a screen sound production device protection method and device and electronic equipment, which do not need to connect a protection resistor in series, and can finely control different frequency points in the input audio signal, so as to maximize the performance of each frequency band of the screen sound production device.

[0006] In a first aspect, a method for protecting a screen sound production device is provided. The method is applied to an electronic device including a screen sound production device. The method includes obtaining a first audio signal and a state parameter of the screen sound production device; determining a frequency point parameter of each frequency point in the first audio signal based on the first audio signal; determining a protection threshold of each frequency point based on the state parameter; in a case where the first audio signal includes at least one over-value frequency point, determining a first filter parameter corresponding to each over-value frequency point based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point, wherein the frequency point parameter of the over-value frequency point is greater than the protection threshold of the over-value frequency point; performing filter processing on the first audio signal based on the first filter parameter corresponding to each over-value frequency point to reduce the frequency point parameter of the over-value frequency point; and playing the first audio based on the filtered first audio signal through the screen sound production device.

[0007] In this way, by performing filter processing on the over-value frequency point, the energy value or amplitude of the over-value frequency point is reduced, and the screen sound production device is prevented from being overloaded. In this way, the energy value or amplitude of the non-over-value frequency point does not need to be reduced, thereby realizing fine control of different frequency points in the first audio signal, maximizing the performance of each frequency band of the screen sound production device, and improving user experience. In addition, the protection threshold corresponding to each frequency point is set according to different state parameters. In this way, the protection threshold corresponding to the current state parameter is used to determine whether the first audio signal includes an over-value frequency point, which can ensure that the determination result is more accurate.

[0008] In a possible implementation, the determining of the protection threshold of each frequency point based on the state parameter includes determining a frequency band protection threshold corresponding to each frequency band in the first audio signal based on the state parameter; and determining the frequency band protection threshold of the frequency band in which each frequency point is located as the protection threshold of each frequency point.

[0009] In this way, the frequency band protection threshold of each frequency band is determined by dividing the frequency bands of the first audio signal. Then, the frequency band protection threshold of the frequency band in which each frequency point is located is determined as the protection threshold of each frequency point, thereby reducing the calculation amount of determining the protection threshold of each frequency point.

[0010] In a possible implementation, the determining the protection threshold of each frequency point based on the state parameter comprises: determining a standard protection threshold of each frequency band in the first audio signal based on the state parameter, wherein the standard protection threshold is obtained based on a standard screen sound generating device test; determining a gain parameter of the screen sound generating device, the gain parameter comprising a plurality of frequency bands and a compensation gain corresponding to each of the frequency bands, wherein the compensation gain is used to represent a difference between a frequency response corresponding to the screen sound generating device and a standard frequency response of the standard screen sound generating device; determining a frequency band protection threshold corresponding to each of the frequency bands based on the standard protection threshold and the gain parameter; and determining the frequency band protection threshold of the frequency band in which each frequency point is located as the protection threshold of each frequency point.

[0011] In this way, only the standard protection threshold of the standard screen sound generating device needs to be tested on the production line, and the protection threshold of each screen sound generating device does not need to be tested on the production line, thereby reducing the workload of testing on the production line.

[0012] In a possible implementation, the determining the first filter parameter corresponding to each of the overvalue frequency points based on the frequency point parameter of the overvalue frequency point and the protection threshold of the overvalue frequency point comprises: determining a protection gain of each of the overvalue frequency points based on the frequency point parameter of the overvalue frequency point and the protection threshold of the overvalue frequency point; and determining the first filter parameter corresponding to each of the overvalue frequency points based on the protection gain of the overvalue frequency point.

[0013] In a possible implementation, the determining the protection gain of each of the overvalue frequency points based on the frequency point parameter of the overvalue frequency point and the protection threshold of the overvalue frequency point comprises: determining a difference between the overvalue frequency point and the protection threshold as the protection gain corresponding to each of the overvalue frequency points.

[0014] In a possible implementation, the determining the protection gain of each of the overvalue frequency points based on the frequency point parameter of the overvalue frequency point and the protection threshold of the overvalue frequency point comprises: determining an overvalue frequency band corresponding to each of the overvalue frequency points; determining a maximum protection gain corresponding to each of the overvalue frequency bands, wherein the maximum protection gain is a maximum value of the protection gain of each of the overvalue frequency points in the overvalue frequency band, and the protection gain is a difference between the overvalue frequency point and the protection threshold; and determining the maximum protection gain as the protection gain of each of the overvalue frequency points in each of the overvalue frequency bands.

[0015] In a possible implementation, the determining the first filter parameter corresponding to each of the overvalue frequency points comprises: determining a filter parameter corresponding to each of the overvalue frequency bands based on the maximum protection gain; and determining the filter parameter of the overvalue frequency band in which each of the overvalue frequency points is located as the first filter parameter corresponding to each of the overvalue frequency points.

[0016] In this way, subsequent filtering processing can be performed on each frequency band, and the first filtering parameter can be determined to make the frequency point parameter of each frequency point of the filtered first audio signal less than or equal to the corresponding protection gain with the maximum protection gain.

[0017] In a possible implementation, the method further includes: determining a gain parameter of the screen sound generating device, the gain parameter including a plurality of frequency bands and compensation gains corresponding to the plurality of frequency bands; the compensation gain is used to represent the difference between the frequency response corresponding to the screen sound generating device and the standard frequency response; determining compensation gains of each frequency band in the first audio signal based on the gain parameter; determining second filtering parameters based on the compensation gains of the each frequency band; and performing filtering processing on the first audio signal based on the second filtering parameters, so that the frequency response corresponding to the filtered first audio signal meets the standard frequency response.

[0018] In this way, the consistency of the frequency response of different screen sound generating devices can be ensured, and the user experience can be improved.

[0019] In a possible implementation, the determination of the gain parameter of the screen sound generating device includes: determining the gain parameter of the screen sound generating device based on the state parameter.

[0020] In a possible implementation, the electronic device further includes a coil type loudspeaker, and the method further includes: obtaining a second audio signal; correcting the second audio signal based on the first filtering parameter; and playing the second audio through the coil type loudspeaker based on the corrected second audio signal.

[0021] In this way, the coil type loudspeaker can correct the second audio signal in the playback link where the coil type loudspeaker is located based on the first filtering parameter, so that the overall effect of the two playback links is relatively stable after the overload protection mechanism is triggered, and the phenomenon of abrupt change is prevented.

[0022] In a possible implementation, the frequency point parameter is an energy value or an amplitude value.

[0023] In a possible implementation, the state parameter includes a parameter affecting the load and / or the frequency response of the screen sound generating device, and the state parameter includes at least one of a temperature of the screen sound generating device, a power of the electronic device, a feedback voltage of the screen sound generating device, and a feedback current of the screen sound generating device.

[0024] In a possible implementation, the method further includes: performing screen sound generating device failure detection based on the feedback voltage and / or the feedback current; and controlling the playback link of the screen sound generating device to be disconnected in a case where the screen sound generating device fails.

[0025] In a second aspect, the present application also provides a device for protecting a screen sound production device, the device comprising: an obtaining module configured to obtain a first audio signal and a state parameter of the screen sound production device; a frequency point parameter determination module configured to determine frequency point parameters of each frequency point in the first audio signal based on the first audio signal; a protection threshold determination module configured to determine protection thresholds of the each frequency point based on the state parameter; a first filter parameter determination module configured to, in a case where the first audio signal comprises at least one over-value frequency point, determine first filter parameters corresponding to the each over-value frequency point based on the frequency point parameters of the over-value frequency point and the protection thresholds of the over-value frequency point; wherein the frequency point parameter of the over-value frequency point is greater than the protection threshold of the over-value frequency point; a filtering module configured to perform filtering processing on the first audio signal based on the first filter parameters corresponding to the each over-value frequency point, so as to reduce the frequency point parameters of the over-value frequency point; and an audio playing module configured to play the first audio based on the filtered first audio signal through the screen sound production device.

[0026] In a possible implementation, the protection threshold determination module is specifically configured to determine a frequency band protection threshold corresponding to each frequency band in the first audio signal based on the state parameter; and determine the protection threshold of each frequency point as the frequency band protection threshold of the frequency band in which the frequency point is located.

[0027] In a possible implementation, the protection threshold determination module is specifically configured to determine a standard protection threshold of each frequency band in the first audio signal based on the state parameter; wherein the standard protection threshold is obtained based on a standard screen sound production device test; determine a gain parameter of the screen sound production device, the gain parameter comprising a plurality of frequency bands and a compensation gain corresponding to each frequency band; wherein the compensation gain is used to represent a difference between a frequency response corresponding to the screen sound production device and a standard frequency response of the standard screen sound production device; determine a frequency band protection threshold corresponding to each frequency band based on the standard protection threshold and the gain parameter; and determine the protection threshold of each frequency point as the frequency band protection threshold of the frequency band in which the frequency point is located.

[0028] In a possible implementation, the first filter parameter determination module is specifically configured to determine a protection gain of each over-value frequency point based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point; and determine the first filter parameter corresponding to each over-value frequency point based on the protection gain of the over-value frequency point.

[0029] In a possible implementation, the first filter parameter determination module is specifically configured to determine a difference between the over-value frequency point and the protection threshold as the protection gain corresponding to each over-value frequency point.

[0030] In a possible implementation, the first filter parameter determination module is specifically configured to determine a super value frequency band corresponding to each of the super value frequency points; determine a maximum protection gain corresponding to each of the super value frequency bands; the maximum protection gain is a maximum value of protection gains of the super value frequency points in the super value frequency band, and the protection gain is a difference between the super value frequency point and the protection threshold; and determine the maximum protection gain as the protection gain of each of the super value frequency points in each of the super value frequency bands.

[0031] In a possible implementation, the first filter parameter determination module is specifically configured to determine a filter parameter corresponding to each of the super value frequency bands based on the maximum protection gain; and determine the filter parameter of the super value frequency band in which each of the super value frequency points is located as the first filter parameter corresponding to each of the super value frequency points.

[0032] In a possible implementation, the method further includes: a frequency response calibration module configured to determine a gain parameter of the screen sound generating device, the gain parameter including a plurality of frequency bands and compensation gains corresponding to the plurality of frequency bands; wherein the compensation gain is used to represent a difference between a corresponding frequency response of the screen sound generating device and a standard frequency response; determine a compensation gain of each frequency band in the first audio signal based on the gain parameter; determine a second filter parameter based on the compensation gain of each frequency band; and perform filter processing on the first audio signal based on the second filter parameter, so that a frequency response corresponding to the filtered first audio signal meets the standard frequency response.

[0033] In a possible implementation, the frequency response calibration module is specifically configured to determine the gain parameter of the screen sound generating device based on the state parameter.

[0034] In a possible implementation, the method further includes: a correction module configured to obtain a second audio signal; correct the second audio signal based on the first filter parameter; and play the second audio through the coil-type loudspeaker based on the corrected second audio signal.

[0035] In a possible implementation, the method further includes: a failure detection module configured to detect failure of the screen sound generating device based on the feedback voltage and / or the feedback current; and control a play link of the screen sound generating device to be disconnected in a case where the screen sound generating device fails.

[0036] In a third aspect, the present application further provides an electronic device including a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, the computer program code includes computer instructions, when the processor executes the computer instructions, the electronic device executes the method in any one of the first aspect.

[0037] In a fourth aspect, the present application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program or instructions, and when the computer program or instructions are executed on a computer, the computer is caused to perform the method according to any one of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0039] Figure 1 A structural schematic diagram of an electronic device is provided for the embodiments of the present application.

[0040] Figure 2 A scene diagram of a screen sound emitting device as a loudspeaker is provided for the embodiments of the present application.

[0041] Figure 3 A hardware structural schematic diagram of an electronic device 100 is provided for the embodiments of the present application.

[0042] Figure 4 A software structural block diagram of an electronic device 100 is provided for the embodiments of the present application.

[0043] Figure 5 A flowchart of a screen sound emitting device protection method is provided for the embodiments of the present application.

[0044] Figure 6 A flowchart of frequency response calibration of a first audio signal is provided for the embodiments of the present application.

[0045] Figure 7 A flowchart of determining a protection threshold of each frequency point is provided for the embodiments of the present application.

[0046] Figure 8 An interaction diagram of a screen sound emitting device protection method is provided for the embodiments of the present application.

[0047] Figure 9 A structural block diagram of a screen sound emitting device protection apparatus is provided for the embodiments of the present application.

[0048] Figure 10 A structural block diagram of a chip is provided for the embodiments of the present application. DETAILED DESCRIPTION

[0049] With reference to the drawings of the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments of the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of the present application.

[0050] Hereinafter, the terms "first" and "second" are used only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first" and "second" can explicitly or implicitly include one or more of the features. In the description of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0051] At present, voice communication, music playing, video playing and the like have become important functions of electronic devices such as mobile phones. In the process of providing voice communication, music playing, video playing and the like for users by electronic devices such as mobile phones, the electronic devices such as mobile phones can convert audio signals into sound signals through a loudspeaker and output the sound signals.

[0052] A conventional coil-type loudspeaker needs to open a sound hole on the front panel of the electronic device such as a mobile phone, so that the user can receive the sound output by the loudspeaker. However, with the increasing requirement of screen ratio of the electronic device such as a mobile phone, in order to reduce the occupied area of the sound hole, some electronic devices such as mobile phones use a screen sound emitting device as a loudspeaker. The screen sound emitting device can be a vibration source connected to the back of the screen, such as a piezoelectric ceramic or the like. The capacitive device can vibrate under the control of a current signal to drive the screen to vibrate, thereby realizing screen sound emission. In this way, the screen sound emitting device does not need to open a sound hole on the electronic device such as a mobile phone, and can meet the requirement of high screen ratio.

[0053] For example, as shown in Figure 1 , the electronic device 100 includes two loudspeakers, one of which is a coil-type loudspeaker 101, and the other of which is a screen sound emitting device 102. The coil-type loudspeaker 101 is located at the top of the electronic device, and the screen sound emitting device 102 is located at the back of the screen 103. In use, the coil-type loudspeaker 101 can be used to play sound alone, the screen sound emitting device 102 can be used to play sound alone, or the coil-type loudspeaker 101 and the screen sound emitting device 102 can be used to play sound simultaneously. For example, as shown in Figure 2 , the electronic device 100 plays sound alone through the screen sound emitting device 102, specifically, the sound is emitted through the vibration of the screen, and then transmitted to the ear of the user 200.

[0054] The loudspeaker works in cooperation with an audio power amplifier. The audio power amplifier is used to raise the voltage to drive the loudspeaker to output higher volume. With the increase of the working voltage and output power of the loudspeaker, the loudness of the electronic device is greatly improved. However, the increase of the working voltage and output power is easy to cause the overload of the loudspeaker, resulting in the damage of the loudspeaker.

[0055] At present, the audio power amplifier technology for the overload protection of the conventional coil type loudspeaker is mature. However, due to the different working principles of the conventional coil type loudspeaker and the screen sound generating device, the overload protection scheme of the coil type loudspeaker is not completely suitable for the screen sound generating device.

[0056] In order to prevent the overload of the screen sound generating device and cause the damage of the screen sound generating device, two schemes are mainly used at present. The first scheme is to connect a protection resistor in series on the screen sound generating device, and the second scheme is to perform amplitude limiting processing on the input audio signal. The first scheme has many negative effects, such as the easy heating of the series resistor, the occupation of the area affecting the circuit design, and the attenuation of the full frequency band of the input audio signal, thereby causing the distortion of the audio signal. The second scheme can solve the problems of the easy heating of the series resistor and the occupation of the area affecting the circuit design, but the amplitude limiting processing on the input audio signal still causes the attenuation of the full frequency band of the input audio signal, thereby causing the distortion of the audio signal and affecting the user's listening experience.

[0057] To solve the above technical problems, the present application provides a screen sound generating device protection method. The method does not need to connect a protection resistor in series, and can perform fine control on different frequency points of the input audio signal, so as to maximize the performance of each frequency band of the screen sound generating device and improve the user experience.

[0058] The screen sound generating device protection method provided by the embodiments of the present application can be applied to any electronic device with a screen sound generating device, such as a personal computer, a tablet, a mobile phone, a bracelet, a watch, etc.

[0059] The specific structure of the electronic device 100 will be exemplarily described below taking the electronic device 100 as a mobile phone as an example.

[0060] As shown in FIG. 1, the electronic device 100 includes a screen sound generating device 101, a processor 102, a memory 103, a power management module 104, a display module 105, a communication module 106, a sensor module 107, and a power supply module 108. Figure 3As shown, the electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0061] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0062] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.

[0063] The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0064] The processor 110 can also include a memory that stores instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The cache memory can hold instructions or data that the processor 110 has recently used or is likely to use again. If the processor 110 needs to use the instructions or data again, it can be retrieved directly from the cache memory. This avoids repeated accesses to the main memory, reducing the latency of the processor 110 and thus improving the efficiency of the system.

[0065] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0066] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface and implement the touch function of the electronic device 100.

[0067] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled to the audio module 170 through the I2S bus, enabling communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface, enabling the function of answering a phone call through a Bluetooth headset.

[0068] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 can be coupled with the wireless communication module 160 through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, realizing the function of answering a phone call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0069] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface, realizing the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, realizing the function of playing music through a Bluetooth headset.

[0070] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes the camera serial interface (CSI), the display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface, realizing the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface, realizing the display function of the electronic device 100.

[0071] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0072] The USB interface 130 is an interface that meets the USB standard specification, which can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0073] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a limitation on the structure of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0074] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 and also supply power to the electronic device through the power management module 141.

[0075] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be arranged in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be arranged in the same device.

[0076] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

[0077] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0078] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and radiate as electromagnetic waves through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0079] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and disposed in the same device as the mobile communication module 150 or other function modules.

[0080] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.

[0081] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0082] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0083] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0084] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0085] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0086] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0087] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0088] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0089] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0090] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external memory card.

[0091] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phonebook, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various function applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in the memory disposed in the processor.

[0092] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0093] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functions of the audio module 170 can be disposed in the processor 110.

[0094] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A. Multiple speakers 170A can be disposed in the electronic device 100, for example, in an embodiment of the present application, both of the speakers 170A can be screen sound generating devices, or one of the speakers 170A can be a screen sound generating device and the other speaker 170A can be a coil type speaker. One speaker 170A can also be disposed in the electronic device 100, and the one speaker 170A can be a screen sound generating device. Among them, the coil type speaker can be disposed at the top or bottom of the electronic device 100, and the screen sound generating device can be disposed at the back of the screen.

[0095] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the receiver 170B can be used to listen to the voice by being close to the ear of a person. In some embodiments, the speaker 170A and the receiver 170B can be disposed as one component, and the present application does not limit this.

[0096] The microphone 170C, also referred to as a "microphone", "sound collector", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user can speak into the microphone 170C by bringing the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, noise reduction functions can also be realized. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, to realize the collection of sound signals, noise reduction, and also to identify the source of the sound, to realize the function of directional recording, etc.

[0097] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0098] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0099] The gyroscope sensor 180B can be configured to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.

[0100] The barometric pressure sensor 180C is configured to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude, assists positioning and navigation based on the air pressure value measured by the barometric pressure sensor 180C.

[0101] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can detect the opening and closing of a flip cover by using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Further, based on the detected opening and closing state of the cover or the opening and closing state of the flip cover, the electronic device 100 can set a feature such as automatic unlocking of the flip cover.

[0102] The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in each direction (typically, three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the electronic device posture, applied to the landscape / portrait screen switching, pedometer, etc.

[0103] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance by infrared or laser. In some embodiments, the electronic device 100 can measure distance by using the distance sensor 180F to achieve fast focusing when shooting a scene.

[0104] The proximity light sensor 180G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode can be an infrared light-emitting diode. The electronic device 100 emits infrared light outwardly through the light-emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using the photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to achieve the purpose of power saving. The proximity light sensor 180G can also be used for automatic unlocking and locking of the screen in the case of a holster mode and a pocket mode.

[0105] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the display screen 194 brightness according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when shooting. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent false touch.

[0106] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application lock, fingerprint shooting, fingerprint answering calls, etc.

[0107] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to perform temperature processing strategies. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold value, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold value, the electronic device 100 performs voltage boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0108] Touch sensor 180K, also referred to as "touch device". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 form a touch screen, also referred to as "touch panel". Touch sensor 180K is configured to detect touch operations applied to or near the touch sensor 180K. The touch sensor can transmit the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position where display screen 194 is located.

[0109] Bone conduction sensor 180M can obtain vibration signals. In some embodiments, bone conduction sensor 180M can obtain vibration signals of the human body sound vibration bone block. Bone conduction sensor 180M can also contact the human body pulse to receive blood pressure pulsation signals. In some embodiments, bone conduction sensor 180M can also be disposed in a headset to form a bone conduction headset. Audio module 170 can analyze voice signals based on the vibration signals of the sound vibration bone block obtained by the bone conduction sensor 180M to realize voice functions. The application processor can analyze heart rate information based on the blood pressure pulsation signals obtained by the bone conduction sensor 180M to realize heart rate detection functions.

[0110] Keys 190 include power on / off keys, volume keys, and the like. Keys 190 can be mechanical keys. They can also be touch keys. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100.

[0111] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. Touch operations applied to different regions of display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, received messages, alarms, games, etc.) can also correspond to different vibration feedback effects. Touch vibration feedback effects can also be customizable.

[0112] Indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, and also to indicate messages, missed calls, notifications, and the like.

[0113] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0114] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0115] Figure 4 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application.

[0116] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0117] The application layer can include a series of application packages.

[0118] like Figure 4 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0119] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0120] like Figure 4 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0121] The window manager is used to manage windows programs. The window manager can acquire the display screen size, determine whether there is a status bar, lock the screen, and intercept the screen, etc.

[0122] The content provider is used to store and acquire data, and make the data accessible to the application program. The data can include video, image, audio, dialed and received phone, browsing history and bookmark, phone book, etc.

[0123] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, etc. The view system can be used to build an application program. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0124] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including call connection, call hang-up, etc.).

[0125] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc.

[0126] The notification manager makes the application program display notification information in the status bar, which can be used to convey a type of message, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform the completion of the download, message reminder, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application program running in the background, and can also be a notification in the form of a dialogue window appearing on the screen. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device is vibrated, the indicator light flashes, etc.

[0127] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0128] The core library contains two parts: one part is the function function called by the java language, and the other part is the core library of Android.

[0129] The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java file of the application program layer and the application program framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0130] The system library can include a plurality of functional modules. For example, a surface manager, media libraries, a three-dimensional graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), etc.

[0131] The surface manager is used to manage a display subsystem and provides fusion of 2D and 3D layers for a plurality of applications.

[0132] The media libraries support a plurality of commonly used audio, video format playback and recording, and static image files, etc. The media libraries can support a plurality of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0133] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0134] The 2D graphics engine is a drawing engine for 2D drawing.

[0135] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0136] The following describes a screen sound emitting device protection method provided by an embodiment of the present application, taking an electronic device including a screen sound emitting device and a coil type loudspeaker as an example.

[0137] Figure 5 A flowchart of a screen sound emitting device protection method provided by an embodiment of the present application is shown in FIG. 3. As shown in FIG. 3, the protection method can include the following steps. Figure 5

[0138] In step 301, a first audio signal and a state parameter of the screen sound emitting device are acquired.

[0139] In the case that the electronic device includes a screen sound emitting device and a coil type loudspeaker, the electronic device can include two playback links. One playback link plays audio through the screen sound emitting device, and the other playback link plays audio through the coil type loudspeaker.

[0140] The electronic device can convert an analog audio signal into a digital audio signal by using an audio processing module, so as to facilitate algorithm processing on the digital audio signal. The converted digital audio signal can be divided into a first audio signal and a second audio signal. The first audio corresponding to the first audio signal is played through the screen sound emitting device, and the second audio corresponding to the second audio signal is played through the coil type loudspeaker.

[0141] ​The state parameter of the screen sound production device in the embodiments of the present application can include a parameter affecting the load and / or frequency response of the screen sound production device. For example, the state parameter can include at least one of the temperature of the screen sound production device, the power of the electronic device, the feedback voltage of the screen sound production device, and the feedback current of the screen sound production device.

[0142] The temperature of the screen sound production device can affect the load and frequency response of the screen sound production device. The higher the temperature of the screen sound production device, the greater the load of the screen sound production device; the corresponding frequency response of the screen sound production device can be different at different temperatures.

[0143] The power of the electronic device can affect the load of the screen sound production device. The lower the power of the electronic device, the more the load of the screen sound production device needs to be reduced to save power.

[0144] The feedback voltage of the screen sound production device and the feedback current of the screen sound production device can also reflect the load of the screen sound production device. In some embodiments, the failure of the screen sound production device can be detected based on the feedback voltage of the screen sound production device and / or the feedback current of the screen sound production device. In the case where the failure of the screen sound production device is detected, the playback link of the screen sound production device can be controlled to be disconnected to prevent the audio played by the screen sound production device from being poor and affecting the user experience.

[0145] It should be understood that the embodiments of the present application can continue to perform the following steps 302 to 307 in the case where it is detected that the screen sound production device is not failed. Otherwise, in the case where it is detected that the screen sound production device is failed, the playback link of the screen sound production device is controlled to be disconnected, i.e., the subsequent steps 302 to 307 will not be performed.

[0146] Step 302, calibrating the frequency response of the first audio signal.

[0147] Due to production, environment, and other factors, the frequency responses of different screen sound production devices can be inconsistent. The frequency response refers to the degree of response of a system to different frequencies. It can be understood as the degree of gain or level of sound output by the screen sound production device at different frequency bands. Therefore, in order to ensure the consistency of the frequency responses of different screen sound production devices and improve the user experience, the embodiments of the present application can first calibrate the frequency response of the first audio signal.

[0148] In some embodiments, as shown in FIG. 3, the calibration of the frequency response of the first audio signal can be implemented by the following steps: Figure 6

[0149] Step 3021, determining the gain parameter of the screen sound production device.

[0150] ​The gain parameter includes a plurality of frequency bands and compensation gains corresponding to the plurality of frequency bands. The compensation gain is used to represent the difference between the frequency response of the screen sound production device and the standard frequency response. Since the frequency response includes a plurality of frequency bands and the gain corresponding to each frequency band, the difference between the frequency response of the screen sound production device and the standard frequency response can be the gain difference (for example, the difference value of the gain) corresponding to each frequency band. In the embodiments of the present application, the gain difference corresponding to each frequency band is referred to as the compensation gain corresponding to each frequency band.

[0151] In some embodiments, the gain parameter of the screen sound production device installed in the electronic device can be pre-stored in the electronic device. The gain parameter includes a plurality of frequency bands and compensation gains corresponding to the plurality of frequency bands. In this way, the gain parameter of the screen sound production device can be determined by checking the gain parameter of the screen sound production device installed in the electronic device pre-stored in the electronic device.

[0152] In some embodiments, it is considered that the frequency response of the screen sound production device is different under different state parameters. For example, the frequency response of the screen sound production device is different at different temperatures. Based on this consideration, the gain parameter of the screen sound production device installed in the electronic device corresponding to different state parameters can be obtained first. Then, the gain parameter corresponding to different state parameters is stored in the electronic device. In this way, the gain parameter of the screen sound production device corresponding to the current state parameter can be determined by obtaining or checking the gain parameter corresponding to different state parameters pre-stored in the electronic device.

[0153] The gain parameter corresponding to each state parameter can be obtained based on the frequency response of the screen sound production device under the corresponding state parameter and the standard frequency response under the corresponding state parameter. For example, the frequency response of the screen sound production device under state 1 and the standard frequency response under state 1 are obtained respectively. Then, the compensation gain of each frequency band is calculated based on the frequency response of the screen sound production device under state 1 and the standard frequency response under state 1. In this way, the compensation gain corresponding to each frequency band calculated is the gain parameter corresponding to state 1.

[0154] In step 3022, the compensation gain of each frequency band in the first audio signal is determined based on the gain parameter of the screen sound production device.

[0155] In some embodiments, the gain parameter of the screen sound production device can include a full frequency band and a compensation gain corresponding to the full frequency band. The first audio signal can include part of the full frequency band, and therefore, the compensation gain of each frequency band included in the first audio signal can be determined based on the gain parameter of the screen sound production device.

[0156] In step 3023, the filter parameter (which can be referred to as the second filter parameter in the embodiments of the present application) is determined based on the compensation gain of each frequency band.

[0157] The step of determining the second filtering parameters is equivalent to designing a filter for filtering the first audio signal. The filter can be a finite impulse response (FIR) filter or an infinite impulse response (IIR) filter. FIR filters have more stable phase; therefore, if the effect of phase fluctuations is considered, an FIR filter can be used.

[0158] This application does not limit the design method of the filter used to filter the first audio signal. For example, the window function method can be used to design the filter, thereby obtaining the second filtering parameters.

[0159] The following example illustrates the design of an FIR filter using the window function method.

[0160] The window function method for designing FIR filters mainly involves designing a filter with a frequency response of H(e^(-1 / 2)). jw The target FIR filter h(n) is used to approximate the ideal FIR filter h. d (n). Among them, the impulse response of an ideal FIR filter is non-causal and infinitely long, while the window function method starts from the time domain and uses the causal and finite-length impulse response to approximate the non-causal and infinitely long ideal FIR filter.

[0161] Suppose there exists an ideal low-pass filter with a frequency response of H. d (e jw ), for H d (e jw The low-pass filter h is obtained by Fourier transform. d (n), h d (n) satisfies the following relation (1):

[0162]

[0163] Due to h d Since (n) is non-causal and infinitely long, a finite-length window function w(n) can be used for truncation to obtain the target filter h(n). The truncated h(n) satisfies the following relationship (2):

[0164] h(n) = h d (n)w(n) (2)

[0165] For a specific example, if we need to design a cutoff frequency of w... c A low-pass filter has a passband gain (i.e., the compensated gain in this embodiment) of GdB and a group delay of α. The frequency response H of the ideal filter is then... d (ejw ) can be expressed as the following relationship (3):

[0166]

[0167] to H d (e jw ) Fourier transform to get the ideal filter h d (n), the ideal filter h d (n) satisfies the following relationship (4):

[0168]

[0169] However, h d (n) is still non-causal infinite length, consider using a length of N causal rectangular window to be truncated, also to meet the symmetric structure of the FIR filter, the symmetric center is (N-1) / 2. At this time, consider matching the ideal filter is also delayed (N-1) / 2, that is, the delay α satisfies the following relationship (5):

[0170] α = (N-1) / 2 (5)

[0171] Thus, the ideal filter h d (n) after delay satisfies the following relationship (6):

[0172]

[0173] Again using the window function to truncate h d (n) to get the finite length of the target filter h(n), h(n) satisfies the following relationship (7):

[0174]

[0175] After the above design process, the expected low-pass filter h(n) can be obtained, wherein the use of the window function is selected and designed according to specific needs.

[0176] In the embodiment of the application, the second filter parameter for the frequency response calibration of the first audio signal can be regarded as a series of bandpass filters corresponding to different compensation gains in different frequency bands, and the design of the bandpass filter is the subtraction of the low-pass filter. Therefore, the actual designed frequency response is:

[0177]

[0178] In this way, Fourier transform of the above relationship (8) can obtain the bandpass or low-pass filter h m (n) for different frequency bands, that is, the second filter parameter corresponding to different frequency bands, wherein M is the total number of divided frequency bands.

[0179] At step 3024, the first audio signal is filtered based on the second filter parameters, so that the frequency response corresponding to the filtered first audio signal meets the standard frequency response.

[0180] In this way, the first audio signal is filtered based on the filter obtained based on the above design (i.e., the second filter parameters of each frequency band), so that the frequency response corresponding to the filtered first audio signal meets the standard frequency response.

[0181] It should be noted that, in order to facilitate algorithm processing on the first audio signal, in some embodiments, the first audio signal can be subjected to time-frequency conversion first to obtain a frequency domain signal corresponding to the first audio signal. In this case, since the second filter parameters corresponding to each frequency band obtained based on the above relationship (8) are time domain parameters, the second filter parameters can be subjected to time-frequency conversion to convert the time domain parameters into frequency domain parameters before processing the first audio signal, and then the frequency domain signal is filtered based on the converted frequency domain parameters.

[0182] It should be further noted that the embodiments of the present application only exemplarily illustrate the steps of calibrating the frequency response of the first audio signal, and do not limit the method for protecting the screen sounding device. For example, the method for protecting the screen sounding device provided by the embodiments of the present application can not include the above step 302. Therefore, in the following steps, the first audio signal can be an audio signal subjected to frequency response calibration, or can be an audio signal not subjected to frequency response calibration, which is not limited in the present application.

[0183] It should be further noted that the embodiments of the present application can also calibrate the frequency response of the second audio signal, and the method for calibrating the frequency response of the second audio signal can refer to the above description of calibrating the frequency response of the first audio signal, which is not described herein.

[0184] At step 303, the frequency point parameters of each frequency point in the first audio signal are determined based on the first audio signal.

[0185] It should be understood that if the first audio signal is subjected to frequency response calibration processing before step 303, the first audio signal in step 303 and subsequent steps is the first audio signal subjected to frequency response calibration processing. If the first audio signal is not subjected to frequency response calibration processing before step 303, the first audio signal in step 303 and subsequent steps is the first audio signal not subjected to frequency response calibration processing.

[0186] In some embodiments, the first audio signal can be subjected to time-frequency conversion first to obtain a frequency domain signal corresponding to the first audio signal, so as to facilitate subsequent algorithm processing. Further, the frequency point parameters of each frequency point in the frequency domain signal can be determined based on the frequency domain signal.

[0187] In the embodiments of the present application, the frequency point parameter refers to a parameter used for monitoring whether the overload protection mechanism needs to be triggered. For example, the frequency point parameter can be an amplitude value corresponding to a frequency point or an energy value corresponding to a frequency point.

[0188] wherein the amplitude value of the frequency point Amp(h) = |X[k]|, and the energy value of the frequency point Energy(k) = X[k] 2 wherein k represents a frequency point.

[0189] In step 304, the protection threshold of each frequency point is determined based on the state parameter.

[0190] The embodiments of the present application consider that the protection threshold corresponding to different frequency points is different under different state parameters. Therefore, the embodiments of the present application set the protection threshold corresponding to each frequency point for different state parameters, so that the judgment result can be more accurate.

[0191] The embodiments of the present application do not limit the specific implementation manner of determining the protection threshold of each frequency point based on the state parameter.

[0192] In some embodiments, the protection threshold of each frequency point can be determined based on the state parameter in the following manner: testing each electronic device on the production line to obtain the limit energy value or amplitude value corresponding to each frequency point when the screen sound emitting device does not occur overload under different state parameters. Then, the limit energy value or amplitude value corresponding to each frequency point is determined as the protection threshold corresponding to each frequency point under different state parameters.

[0193] Based on the above test, the mapping relationship between the state parameter, the frequency point and the protection threshold can be obtained. In some embodiments, the mapping relationship between the above three can be stored in the corresponding electronic device. In this way, when the mapping relationship between the above three is needed, the protection threshold of each frequency point in the first audio signal under the current state parameter can be determined by obtaining or checking the mapping relationship between the state parameter, the frequency point and the protection threshold pre-stored in the electronic device.

[0194] For example, as shown in Table 1, taking the temperature of the screen sound emitting device as an example of the state parameter, it is assumed that two states, state 1 and state 2, are included. For example, state 1 is that the temperature of the screen sound emitting device is a first temperature, and state 2 is that the temperature of the screen sound emitting device is a second temperature, and the first temperature and the second temperature are different temperatures. In the case of the state parameter being state 1, the test obtains the protection threshold values corresponding to the frequency points F1 to Fn, for example, the protection threshold value corresponding to the frequency point F1 is A1, the protection threshold value corresponding to the frequency point F2 is A2, and the protection threshold value corresponding to the frequency point Fn is An. Similarly, in the case of the state parameter being state 2, the test obtains the protection threshold values corresponding to the frequency points F1 to Fn, for example, the protection threshold value corresponding to the frequency point F1 is B1, the protection threshold value corresponding to the frequency point F2 is B2, and the protection threshold value corresponding to the frequency point Fn is Bn. Wherein, under the same state parameter, the protection threshold values corresponding to different frequency points can be different, for example, the values of A1, A2,..., An are different. Under different state parameters, the protection threshold values corresponding to the same frequency point can also be different, for example, A1 and B1 can be different, A2 and B2 can be different, and An and Bn can be different.

[0195] Table 1: Mapping relationship table of state parameter, frequency point and protection threshold value

[0196]

[0197] In some embodiments, in order to reduce the test workload, based on the state parameter, the protection threshold values of the frequency points can be determined in the following manner: the audio signal is divided into frequency bands according to a preset frequency band division rule. Correspondingly, on the production line, the limit energy values or amplitudes corresponding to each frequency band when the screen sound emitting device does not overload under different state parameters of each electronic device are tested. Then, the limit energy values or amplitudes corresponding to each frequency band are determined as the protection threshold values corresponding to each frequency band under different state parameters. Since each frequency band includes one or more continuous frequency points, the protection threshold value of the frequency band in which each frequency point is located (which can also be referred to as the frequency band protection threshold value in the embodiments of the present application) can be determined as the protection threshold value of the frequency point.

[0198] Based on the above test, the mapping relationship between the state parameter, the frequency band and the protection threshold value can be obtained. In some embodiments, the mapping relationship between the above three can be stored in the corresponding electronic device. In this way, when the mapping relationship between the above three is needed to be used, the protection threshold values of each frequency band in the first audio signal under the current state parameter can be determined by obtaining or checking the mapping relationship between the state parameter, the frequency band and the protection threshold value. Further, based on the correspondence between the frequency band and each frequency point, the frequency band in which each frequency point in the first audio signal is located can be determined. Then, the protection threshold value of the frequency band in which each frequency point in the first audio signal is located is determined as the protection threshold value of the frequency point.

[0199] It should be understood that the above embodiments can also store the mapping relationship between the state parameters, the frequency bands, the frequency points, and the protection thresholds in the corresponding electronic devices, which is not limited in the present application.

[0200] For example, as shown in Table 2, taking the temperature of the screen sound emitting device as the state parameter, assuming that there are two states, state 1 and state 2. For example, state 1 is that the temperature of the screen sound emitting device is a first temperature, and state 2 is that the temperature of the screen sound emitting device is a second temperature, and the first temperature and the second temperature are different temperatures. In the case of state parameter being state 1, a plurality of frequency bands are included, for example, frequency bands M1-Mn are included. Each of M1-Mn corresponds to a protection threshold, for example, the protection threshold corresponding to M1 is A1, the protection threshold corresponding to M2 is A2, and the protection threshold corresponding to Mn is An. Wherein, each frequency band corresponds to a plurality of continuous frequency points, for example, the frequency points corresponding to M1 are F1-Fa, the frequency points corresponding to M2 are Fb-Fc, and the frequency points corresponding to Mn are Fd-Fe. In this way, the protection threshold corresponding to F1-Fa is A1, the protection threshold corresponding to Fb-Fc is A2, and the protection threshold corresponding to Fd-Fe is A3. Similarly, in the case of state parameter being state 2, each frequency band corresponds to a protection threshold, which is not described here. Wherein, under the same state parameter, the protection thresholds corresponding to different frequency bands can be different, for example, the values of A1, A2,..., and An are different. Under different state parameters, the protection thresholds corresponding to the same frequency band can also be different, for example, A1 and B1 can be different, A2 and B2 can be different, and An and Bn can be different.

[0201] Table 2 Mapping relationship table of state parameters, frequency bands, frequency points, and protection thresholds

[0202]

[0203] In some embodiments, in order to reduce the test workload, based on the state parameters, the protection thresholds of the frequency points are determined, which can also be realized in the following way: the standard protection thresholds of the frequency points or the frequency bands under different state parameters of the standard screen sound emitting device are tested in advance. Then, based on the difference between the screen sound emitting device and the standard screen sound emitting device, the standard protection threshold is corrected to the protection threshold suitable for the screen sound emitting device in the current electronic device. Wherein, the standard screen sound emitting device refers to a standard prototype of the screen sound emitting device that has completed device calibration (such as frequency response calibration). The frequency response corresponding to the standard screen sound emitting device is the standard frequency response.

[0204] The mapping relationship among the state parameter, the frequency point, and the standard protection threshold (which can be referred to the description of Table 1, and details are not described herein again) or the mapping relationship among the state parameter, the frequency band, and the standard protection threshold (which can be referred to the description of Table 2, and details are not described herein again) can be obtained based on the test on the standard screen sounding device.

[0205] In this way, the mapping relationship among the state parameter, the frequency point (or the frequency band), and the standard protection threshold can be stored in different electronic devices. When the mapping relationship among the three is needed, the mapping relationship among the state parameter, the frequency band, and the standard protection threshold pre-stored in the electronic device can be obtained or viewed, and the standard protection threshold of each frequency point (or the frequency band) in the first audio signal under the current state parameter is determined. Further, the standard protection threshold is corrected to the protection threshold suitable for the screen sounding device in the current electronic device.

[0206] The method for determining the protection threshold of each frequency point provided in the embodiment is described in detail below taking the standard protection threshold including the standard protection threshold of each frequency band under different state parameters as an example.

[0207] Figure 7 A flowchart for determining the protection threshold of each frequency point provided in the embodiment is shown in FIG. 4. As shown in FIG. 4, the method can include the following steps. Figure 7

[0208] In step 3041, the standard protection threshold corresponding to each frequency band in the first audio signal is determined based on the state parameter.

[0209] In the case that the mapping relationship among the state parameter, the frequency band, and the standard protection threshold is pre-stored in the electronic device, the pre-stored mapping relationship among the state parameter, the frequency band, and the standard protection threshold can be obtained first. Then, the standard protection threshold corresponding to each frequency band under the current state parameter is determined in the obtained mapping relationship.

[0210] In step 3042, the gain parameter of the screen sounding device is determined, and the gain parameter includes a plurality of frequency bands and the compensation gain corresponding to each frequency band.

[0211] The step of determining the gain parameter of the screen sounding device can be specifically referred to the description of step 3021, and details are not described herein again.

[0212] In step 3043, the frequency band protection threshold corresponding to each frequency band is determined based on the standard protection threshold of each frequency band and the gain parameter.

[0213] Specifically, the standard protection threshold of each frequency band is corrected according to the corresponding relationship between each frequency band and the compensation gain in the gain parameter, and the frequency band protection threshold corresponding to each frequency band is obtained.

[0214] ​For example, the standard protection threshold is X(x1,x2,x3…x M ), where x1, x2, x3…x M These represent the standard protection thresholds corresponding to each frequency band. The gain parameter is Y(y1,y2,y3…y…). M ), where y1, y2, y3…y M These represent the gain parameters corresponding to each frequency band. Thus, based on the standard protection threshold and the gain parameters, the determined frequency band protection threshold is X+Y, i.e., (x1+y1, x2+y2, x3+y3, ..., x...). M +y M ).

[0215] Step 3044: Determine the frequency band protection threshold of each frequency point as the protection threshold of each frequency point.

[0216] Based on the correspondence between frequency bands and frequency points, the frequency band protection threshold of each frequency point can be determined as the protection threshold of each frequency point.

[0217] Thus, the method for determining the protection threshold of each frequency point provided in this embodiment only requires testing the protection threshold of the standard screen sound-emitting device on the production line, rather than testing the protection threshold of each screen sound-emitting device on the production line, thereby reducing the workload of testing on the production line.

[0218] It should be noted that the above is only based on Figure 6 The corresponding embodiment (determining the protection threshold of each frequency point based on the protection threshold of the frequency band) is described by way of example and does not imply a limitation on the method of determining the protection threshold of each frequency point. For example, the standard protection threshold of each frequency point in the first audio signal can be determined based on the state parameters; then, the gain parameters of the screen sound-emitting device are determined, the gain parameters including multiple frequency points and the compensation gain corresponding to each frequency point; finally, the frequency band protection threshold corresponding to each frequency point is determined based on the standard protection threshold of each frequency point and the gain parameters.

[0219] It should be noted that the above embodiments are only illustrative of two states and do not imply a limitation on the number of states. For example, there may be five, ten, twenty, or other different states.

[0220] It should also be noted that in the embodiments of this application, the protection threshold corresponds to the frequency parameter. For example, when the frequency parameter is an amplitude value, the corresponding protection threshold is also an amplitude value. As another example, when the frequency parameter is an energy value, the corresponding protection threshold is also an energy value.

[0221] Step 305: Based on the protection threshold and frequency parameters, determine whether the first audio signal includes an excessive frequency.

[0222] Step 306, in the case that the first audio signal includes at least one over-value frequency point, based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point, determine the first filter parameter corresponding to each over-value frequency point.

[0223] The over-value frequency point refers to a frequency point whose frequency point parameter is greater than the protection threshold of the over-value frequency point. For example, the over-value frequency point refers to a frequency point whose amplitude or energy value is greater than the protection threshold. The following is an exemplary description taking the energy value as the frequency point parameter. For example, as shown in Table 1, assuming that the energy value corresponding to the frequency point F1 in the first audio signal is greater than the energy value threshold A1, then the frequency point F1 in the first audio signal is an over-value frequency point.

[0224] If the first audio signal including the over-value frequency point is directly output through the screen sound emitting device, it will cause the screen sound emitting device to be overloaded, which may damage the screen sound emitting device. Therefore, in the case of the first audio signal, the embodiment of the present application performs a screen sound emitting device overload protection mechanism, that is, filters the first audio signal to reduce the energy value of each over-value frequency point in the first audio signal, so that the energy value of each frequency point in the filtered first audio signal is less than or equal to the corresponding protection threshold, thereby realizing the screen sound emitting device overload protection.

[0225] Therefore, in order to realize the filtering of the first audio signal and reduce the energy value of each over-value frequency point in the first audio signal, it is necessary to first determine the first filter parameter for filtering the first audio signal. The first filter parameter refers to the filter parameter corresponding to each over-value frequency point.

[0226] In some embodiments, based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point, the first filter parameter corresponding to each over-value frequency point can be determined in the following manner: first, based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point, determine the protection gain of each over-value frequency point. Then, based on the protection gain of the over-value frequency point, determine the first filter parameter corresponding to each over-value frequency point. Wherein, the protection gain of each over-value frequency point can be understood as the gain that each over-value frequency point needs to attenuate.

[0227] In some embodiments, the protection gain of each over-value frequency point can be determined in the following manner: the difference between the over-value frequency point and the corresponding protection threshold can be determined as the protection gain corresponding to each over-value frequency point.

[0228] For example, as shown in Table 1, assuming that the over-value frequency points in the first audio signal include F1 and F2. In this way, the protection gain corresponding to the over-value frequency point F1 is the difference between the energy value of the over-value frequency point F1 and A1, and the protection gain corresponding to the over-value frequency point F2 is the difference between the energy value of the over-value frequency point F2 and A2. It should be understood that the protection gain of the frequency point in the first audio signal that does not exceed the protection threshold is 0 dB.

[0229] In some embodiments, the protection gain of each overvalue frequency point can also be determined in the following manner: first, determine the overvalue frequency bands corresponding to each overvalue frequency point; then, determine the maximum protection gain corresponding to each overvalue frequency band, the maximum protection gain being the maximum value of the protection gain of each overvalue frequency point in the overvalue frequency band, the protection gain being the difference between the overvalue frequency point and the protection threshold; and finally, determine each maximum protection gain as the protection gain of each overvalue frequency point in each overvalue frequency band.

[0230] For example, in combination with Table 2, assume that the overvalue frequency points in the first audio signal include F1, Fa, Fb and Fc. Among them, the protection gain G1 corresponding to the overvalue frequency point F1 is the difference between the energy value of the overvalue frequency point F1 and A1, the protection gain Ga corresponding to the overvalue frequency point Fa is the difference between the energy value of the overvalue frequency point Fa and A1, the protection gain Gb corresponding to the overvalue frequency point Fb is the difference between the energy value of the overvalue frequency point Fb and A2, and the protection gain Gc corresponding to the overvalue frequency point Fc is the difference between the energy value of the overvalue frequency point Fc and A2. In this way, the larger one of the protection gain G1 and the protection gain Ga is determined as the protection gain of the overvalue frequency band M1, and correspondingly, the protection gain of each overvalue frequency point (F1 and Fa) in the overvalue frequency band M1 is determined as the larger one of the protection gain G1 and the protection gain Ga. Similarly, the larger one of the protection gain Gb and the protection gain Gc is determined as the protection gain of the overvalue frequency band M2, and correspondingly, the protection gain of each overvalue frequency point (Fb and Fc) in the overvalue frequency band M2 is determined as the larger one of the protection gain Gb and the protection gain Gc.

[0231] Further, the filter parameters corresponding to each overvalue frequency band can be determined based on the maximum protection gain. Then, the filter parameters of the overvalue frequency band in which each overvalue frequency point is located are determined as the first filter parameters corresponding to each overvalue frequency point. That is, in this implementation manner, the first filter parameters corresponding to each overvalue frequency point in the same frequency band are the same.

[0232] The method for determining the first filter parameters of each overvalue frequency band based on the protection gain of each overvalue frequency band can refer to the description of step 3023 about determining the second filter parameters based on the compensation gain of each frequency band, which will not be repeated here.

[0233] Step 307: filtering the first audio signal based on the first filter parameters corresponding to each overvalue frequency point to reduce the frequency point parameters of the overvalue frequency points.

[0234] Step 308: playing the first audio through the screen sound emitting device based on the filtered first audio signal.

[0235] It should be noted that the embodiment of the present application can re-determine whether the filtered first audio signal includes the over-value frequency point based on the filtered first audio signal after each execution of step 307. If the filtered first audio signal includes the over-value frequency point, steps 306 to 307 are executed again until the filtered first audio signal does not include the over-value frequency point. In this way, the corresponding audio is played by the screen sound emitting device based on the filtered first audio signal which does not include the over-value frequency point.

[0236] It should be further noted that after obtaining the first audio signal which does not include the over-value frequency point, the first audio signal which does not include the over-value frequency point can also be processed by other algorithms before the corresponding audio is played by the screen sound emitting device, for example, privacy call algorithm processing.

[0237] In the case where the electronic device includes two playback links, for example, in the case where the electronic device includes the screen sound emitting device and the coil type loudspeaker, in order to ensure the stability of the subsequent two playback link algorithm processing, the first filter parameter can also be synchronized to the coil type loudspeaker. In this way, the coil type loudspeaker can correct the second audio signal of the playback link where the coil type loudspeaker is located based on the first filter parameter. Then, the second audio signal is played by the coil type loudspeaker based on the corrected second audio signal, so that the overall effect of the two playback links after triggering the overload protection mechanism is relatively stable, and the phenomenon of sudden change is prevented.

[0238] In some embodiments, the gain reduction amplitude of the second audio signal can be corrected to be consistent with that of the first audio signal. For example, in step 307, the gains of the frequency band M1 and the frequency band M2 of the first audio signal are reduced, and the corresponding reduced gain values are 2dB and 4dB, respectively. In this way, the gains of the frequency band M1 and the frequency band M2 of the second audio signal can be correspondingly reduced, and the corresponding reduced gain values are also 2dB and 4dB, respectively. In this way, the audio output by the two playback links can be consistent.

[0239] In some embodiments, the second audio signal can also be corrected so that the corrected second audio signal is complementary to the filtered first audio signal, thereby making the overall effect of the two playback links relatively stable. For example, in step 307, the gains of the frequency band M1 and the frequency band M2 of the first audio signal are reduced, and the corresponding reduced gain values are 2dB and 4dB, respectively. In this way, the gains of the frequency band M1 and the frequency band M2 of the second audio signal can be correspondingly increased, and the corresponding increased gain values are also 2dB and 4dB, respectively. In this way, the overall effect of the two playback links can be relatively stable, and the phenomenon of sudden change can be prevented.

[0240] In conclusion, the screen sounding device protection method provided by the embodiments of the present application reduces the energy value or amplitude of the over-value frequency point by filtering the over-value frequency point, prevents the screen sounding device from overloading, and thus does not need to reduce the energy value or amplitude of the non-over-value frequency point, so as to realize fine control of different frequency points in the first audio signal and maximize the performance of each frequency band of the screen sounding device, thereby improving the user experience. In addition, the embodiments of the present application set the protection threshold corresponding to each frequency point for different state parameters, so that the protection threshold corresponding to the current state parameter is used to determine whether the first audio signal includes an over-value frequency point, which can ensure that the determination result is more accurate.

[0241] In order to further facilitate the understanding of the screen sounding device protection method provided by the embodiments of the present application, Figure 8 An interaction diagram of a screen sounding device protection method provided by the embodiments of the present application is shown. As shown in Figure 8 The electronic device can include an audio processing module 401, a first frequency response calibration module 402, a second frequency response calibration module 403, a protection module 404, a correction module 405, a remaining algorithm module 406, a remaining algorithm module 407, a failure detection module 408 of a screen sounding device, a smart power amplifier Smart PA 409 of the screen sounding device, a smart power amplifier Smart PA 410 of a coil type loudspeaker, a state control module 411, a screen sounding device 412, and a coil type loudspeaker 413.

[0242] As shown in Figure 8 After the audio processing module 401 receives the analog audio, it can convert the analog audio into a digital audio signal, and then generate two audio signals, a first audio signal and a second audio signal, based on the digital audio signal. The first audio signal goes through a playback link where the screen sounding device 412 is located, and the second audio signal goes through a playback link where the coil type loudspeaker 413 is located.

[0243] In some embodiments, the first audio signal and the second audio signal are first input into the respective first frequency response calibration module 402 and the second frequency response calibration module 403 for frequency response calibration. The frequency response calibration method can refer to the description of step 302, which will not be described here.

[0244] The Smart PA 409 can detect the current and voltage of the screen sounding device 412 in real time and feed back the detected current and voltage to the failure detection module 408. In this way, the failure detection module 408 can detect whether the screen sounding device 412 is failed according to the received feedback voltage and feedback current. The failure detection module 408 can also be used to collect some state parameters, such as the temperature of the screen sounding device 412.

[0245] Then, the failure detection module 408 can report the failure detection result and the collected state parameter to the state control module 411.

[0246] If the failure detection result received by the state control module 411 is "failure", the state control module 411 can control to disconnect the playing link where the screen sounding device 412 is located. If the failure detection result received by the state control module 411 is "normal", the state control module 411 can determine the protection threshold corresponding to the current state parameter based on the received state parameter, and issue the frequency point protection threshold to the protection module 404. Alternatively, the state control module 411 can also issue the protection threshold corresponding to different state parameters and the state parameter to the protection module 404. In this way, the protection module 404 can determine the protection threshold corresponding to the current state parameter according to the protection threshold corresponding to different state parameters and the state parameter received.

[0247] The protection module 404 can first determine the frequency point parameter of each frequency point in the first audio signal based on the received first audio signal; then, determine whether to trigger the protection mechanism based on the frequency point parameter and the protection threshold. If it is determined to trigger the protection mechanism, steps 306 to 307 are executed. If it is determined to trigger the protection mechanism, the first audio signal is output to the other algorithm module 406 for subsequent processing until the corresponding audio is played through the screen sounding device 412. The condition for triggering the protection mechanism can refer to the description of steps 305 to 306 in the above embodiments, which will not be described here.

[0248] In some embodiments, if the protection mechanism is triggered, the first filter parameter can be further synchronized to the correction module 405. In this way, the correction module 405 can correct the second audio signal based on the received first filter parameter.

[0249] Correspondingly, the corrected second audio signal is output to the other algorithm module 407 for subsequent processing until the corresponding audio is played through the coil type loudspeaker 413.

[0250] In combination Figure 8 It can be known that the screen sounding device protection method provided in the embodiments of the present application performs protection processing on the first audio signal before the Smart PA 409, so as to prevent the first audio signal from being overloaded and damaging the screen sounding device.

[0251] It should be noted that the above embodiments are only exemplarily described by taking an electronic device including one screen sounding device and one coil type loudspeaker as an example, and do not limit the application scenarios of the screen sounding device protection method provided in the embodiments of the present application. For example, the screen sounding device protection method provided in the embodiments of the present application can also be applied to a scenario including only one screen sounding device or including two or more screen sounding devices.

[0252] For example, if the electronic device includes two screen sounding devices, the playing links corresponding to the two screen sounding devices can share one first frequency response calibration module 402, one protection module 404 and the rest algorithm modules.

[0253] The various method embodiments described herein can be independent solutions or combined according to inherent logic, and these solutions fall within the protection scope of the present application.

[0254] It can be understood that, in the various method embodiments described above, the methods and operations implemented by the test electronic device can also be implemented by components (such as chips, modules or circuits) that can be used for testing the electronic device.

[0255] The above embodiments introduce the screen sounding device protection method provided by the present application. It can be understood that, in order to implement the above functions, the electronic device includes hardware structures and / or software modules corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0256] The present application embodiments can divide the functional modules of the electronic device according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated in one processing module. The above integrated module can be implemented in the form of hardware or software functional module. It should be noted that the division of modules in the present application embodiments is illustrative, and is only a logical function division. Actual implementation can have another division manner.

[0257] The above, in combination with Figures 1 to 8 The screen sounding device protection method provided by the present application embodiments is described in detail. In the following, in combination with Figure 9 and Figure 10 The device provided by the present application embodiments is described in detail. It should be understood that the description of the device embodiments corresponds to the description of the method embodiments, and therefore, the content not described in detail can be referred to the above method embodiments. In order to be brief, the description is not repeated here.

[0258] Referring to Figure 9 , Figure 9This is a structural block diagram of a screen sound-emitting device protection device provided in an embodiment of this application. This device can be part of an electronic device and applied within it. Alternatively, it can be an electronic device in itself; this application does not limit this. Figure 9 As shown, the device 500 may include: an acquisition module 501, a frequency point parameter determination module 502, a protection threshold determination module 503, a first filter parameter determination module 504, a filtering module 505, and an audio playback module 506. The frequency point parameter determination module 502, the protection threshold determination module 503, the first filter parameter determination module 504, and the filtering module 505 may be sub-modules of the protection module 404. The device 500 can perform the above-described... Figures 1 to 8 The operation performed by the electronic device in any of the method embodiments shown.

[0259] For example, in an optional embodiment of this application, the acquisition module 501 is used to acquire a first audio signal and state parameters of the screen sound-emitting device; the frequency parameter determination module 502 is used to determine the frequency parameters of each frequency point in the first audio signal based on the first audio signal; the protection threshold determination module 503 is used to determine the protection threshold of each frequency point based on the state parameters; the first filtering parameter determination module 504 is used to determine the first filtering parameter corresponding to each of the excess frequency points based on the frequency parameters of the excess frequency points and the protection threshold of the excess frequency points when the first audio signal includes at least one excess frequency point; wherein the frequency parameters of the excess frequency points are greater than the protection threshold of the excess frequency points; the filtering module 505 is used to filter the first audio signal based on the first filtering parameters corresponding to each of the excess frequency points to reduce the frequency parameters of the excess frequency points; and the audio playback module 506 is used to play the first audio signal through the screen sound-emitting device based on the filtered first audio signal.

[0260] In other words, the device 500 can achieve the corresponding Figures 1 to 8 The steps or processes performed by the electronic device in any of the screen sound device protection method embodiments shown may include the device 500 for performing the steps or processes. Figures 1 to 7 The above describes the modules of the method executed by the electronic device in any of the embodiments of the screen sound-emitting device protection method. It should be understood that the specific process of each module executing the corresponding steps described above has been explained in detail in the embodiments of the screen sound-emitting device protection method, and will not be repeated here for the sake of brevity.

[0261] This application also provides a processing apparatus, which includes at least one processor and a communication interface. The communication interface is used to provide information input and / or output to the at least one processor, which is used to execute the methods described in the above method embodiments.

[0262] It should be understood that the aforementioned processing device can be a chip. For example, see Figure 10 , Figure 10 This is a structural block diagram of a chip provided in an embodiment of this application. Figure 10 The chip shown can be a general-purpose processor or a special-purpose processor. The chip 600 may include at least one processor 601. The at least one processor 601 can be used to support... Figure 9 The device shown performs Figures 1 to 8 The technical solution shown in any one of the embodiments.

[0263] Optionally, the chip 600 may also include a transceiver 602, which is used to receive control from the processor 601 for supporting... Figure 9 The device shown performs Figures 1 to 8 The technical solution shown in any of the embodiments. Optionally, Figure 10 The chip 600 shown may also include a storage medium 603. Specifically, the transceiver 602 may be replaced by a communication interface that provides information input and / or output to the at least one processor 601.

[0264] It should be noted that, Figure 10 The chip 600 shown can be implemented using the following circuits or devices: one or more field programmable gate arrays (FPGAs), programmable logic devices (PLDs), application-specific integrated circuits (ASICs), system-on-chips (SoCs), central processors (CPUs), network processors (NPs), digital signal processors (DSPs), microcontrollers (MCUs), controllers, state machines, gate logic, discrete hardware components, any other suitable circuits, or any combination of circuits capable of performing the various functions described throughout this application.

[0265] In the implementation process, each step of the above method can be completed by integrated logic circuit of hardware in the processor or instruction in the form of software. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as hardware processor execution completion, or executed by hardware and software module combination in the processor. The software module can be located in the mature storage medium in the art such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, register, etc. The storage medium is located in the memory, and the processor reads the information in the memory, and combines the hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.

[0266] It can be understood that the memory in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be read-only memory (read-only memory, ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically EPROM (electrically EPROM, EEPROM) or flash memory. The volatile memory can be random access memory (random access memory, RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memory of the system and method described herein is intended to include but not limited to these and any other suitable type of memory.

[0267] According to the method provided in the embodiments of the present application, the embodiments of the present application also provide a computer program product, which comprises a computer program or instructions, when the computer program or instructions run on a computer, make the computer execute the method of any one of the embodiments shown. Figures 1 to 8 The method of any one of the embodiments shown.

[0268] According to the method provided in the embodiments of the present application, the embodiments of the present application further provide a computer storage medium storing computer programs or instructions, when the computer programs or instructions are run on a computer, the computer is caused to execute the method of any one of the embodiments shown in the embodiments. Figures 1 to 8 The method of any one of the embodiments shown in the embodiments.

[0269] According to the method provided in the embodiments of the present application, the embodiments of the present application further provide an electronic device. The electronic device includes but is not limited to a mobile phone, a tablet computer, a personal computer, a workstation device, a large-screen device (for example, a smart screen, a smart television, etc.), a handheld game console, a home game console, a virtual reality device, an augmented reality device, a mixed reality device, a vehicle-mounted intelligent terminal, etc. The electronic device can include the screen sounder device protection apparatus provided in the above embodiments of the present application.

[0270] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device module and electronic device described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0271] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and actual implementation can have another division manner, for example, a plurality of modules or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed each other can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0272] The modules described as separate components can or can not be physically separated, and the components shown as modules can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. According to actual needs, part or all of the units can be selected to achieve the purpose of the embodiments of the present application.

[0273] In addition, each functional module in each embodiment of the present application can be integrated in one processing unit, or each module can be physically present separately, or two or more modules can be integrated in one unit.

[0274] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0275] The screen sound generating device protection apparatus, system, processing apparatus, chip, computer storage medium, computer program product, and electronic device provided by the embodiments of the present application are used to execute the method provided above, and thus the beneficial effects that can be achieved are referable to the beneficial effects of the method provided above, which will not be described herein again.

[0276] It should be understood that in the various embodiments of the present application, the execution order of each step should be determined according to its function and inherent logic, and the size of the serial number of each step does not mean the execution order, and does not limit the implementation process of the embodiments.

[0277] Each part of the specification is described in a progressive manner, and the same or similar parts between each embodiment can be referred to each other, and each embodiment mainly introduces the difference from other embodiments. Especially, for the embodiments of the screen sound generating device protection apparatus, system, chip, computer storage medium, computer program product, and electronic device, since they are basically similar to the method embodiments, the description is relatively simple, and the related parts can be referred to the description in the method embodiments.

[0278] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to the embodiments once they know the basic creative concept. Therefore, the appended claims are intended to include the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0279] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A screen sounder device protection method, characterized by, The method is applied to an electronic device comprising a screen sounding device, and comprises: obtaining a first audio signal and a state parameter of the screen sounding device; determining a frequency point parameter of each frequency point in the first audio signal based on the first audio signal; determining a protection threshold of each frequency point based on the state parameter; in a case where the first audio signal comprises at least one over-value frequency point, determining a first filter parameter corresponding to each over-value frequency point based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point, wherein the frequency point parameter of the over-value frequency point is greater than the protection threshold of the over-value frequency point; performing filter processing on the first audio signal based on the first filter parameter corresponding to each over-value frequency point, so as to reduce the frequency point parameter of the over-value frequency point; playing a first audio through the screen sounding device based on the filtered first audio signal.

2. The method of claim 1, wherein, The method further comprises: determining a frequency band protection threshold corresponding to each frequency band in the first audio signal based on the state parameter; determining the protection threshold of each frequency point as the frequency band protection threshold of the frequency band in which the frequency point is located.

3. The method of claim 1, wherein, The method further comprises: determining a standard protection threshold of each frequency band in the first audio signal based on the state parameter, wherein the standard protection threshold is obtained based on a standard screen sounding device test; determining a gain parameter of the screen sounding device, wherein the gain parameter comprises a plurality of frequency bands and a compensation gain corresponding to each frequency band, and the compensation gain is used to represent a difference between a frequency response corresponding to the screen sounding device and a standard frequency response of the standard screen sounding device; determining a frequency band protection threshold corresponding to each frequency band based on the standard protection threshold and the gain parameter; determining the protection threshold of each frequency point as the frequency band protection threshold of the frequency band in which the frequency point is located.

4. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: determining a protection gain of each over-value frequency point based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point; determining a first filter parameter corresponding to each over-value frequency point based on the protection gain of the over-value frequency point.

5. The method of claim 4, wherein, The method further comprises: determining a difference between the over-value frequency point and the protection threshold as the protection gain corresponding to each over-value frequency point.

6. The method of claim 4, wherein, The method further comprises: determining an over-value frequency band corresponding to each over-value frequency point; determining a maximum protection gain corresponding to each over-value frequency band, wherein the maximum protection gain is a maximum value of the protection gain of each over-value frequency point in the over-value frequency band, and the protection gain is a difference between the over-value frequency point and the protection threshold; determining the maximum protection gain as the protection gain of each over-value frequency point in each over-value frequency band.

7. The method of claim 6, wherein, The determining of the first filter parameter corresponding to each of the over-value frequency points comprises: The determining of the filter parameter corresponding to each of the over-value frequency bands based on the maximum protection gain; The filter parameter of the over-value frequency band in which each of the over-value frequency points is located is determined as the first filter parameter corresponding to each of the over-value frequency points.

8. The method of claim 1, wherein, The method further comprises: The gain parameter of the screen sound generating device is determined, the gain parameter comprising a plurality of frequency bands and compensation gains corresponding to the plurality of frequency bands; wherein the compensation gain is used to represent the difference between the frequency response corresponding to the screen sound generating device and a standard frequency response; The compensation gain of each frequency band in the first audio signal is determined based on the gain parameter; The second filter parameter is determined based on the compensation gain of each frequency band; The first audio signal is filtered based on the second filter parameter, so that the frequency response corresponding to the filtered first audio signal meets the standard frequency response.

9. The method according to claim 3 or 8, characterized in that, The determination of the gain parameter of the screen sound generating device comprises: The gain parameter of the screen sound generating device is determined based on the state parameter.

10. The method of claim 1, wherein, The electronic device further comprises a coil type loudspeaker, and the method further comprises: A second audio signal is obtained; The second audio signal is corrected based on the first filter parameter; The second audio is played through the coil type loudspeaker based on the corrected second audio signal.

11. The method of claim 1, wherein, The frequency point parameter is an energy value or an amplitude value.

12. The method of claim 1, wherein, The state parameter comprises a parameter affecting the load and / or frequency response of the screen sound generating device, and the state parameter comprises at least one of the temperature of the screen sound generating device, the power of the electronic device, the feedback voltage of the screen sound generating device, and the feedback current of the screen sound generating device.

13. The method of claim 12, wherein, The method further comprises: The screen sound generating device failure is detected based on the feedback voltage and / or the feedback current; In the case of failure of the screen sound generating device, the playing link of the screen sound generating device is controlled to be disconnected.

14. A screen sounder device protection apparatus, characterized by, The device comprises: An acquisition module is configured to acquire a first audio signal and a state parameter of a screen sound generating device; A frequency point parameter determination module is configured to determine a frequency point parameter of each frequency point in the first audio signal based on the first audio signal; A protection threshold determination module is configured to determine a protection threshold of each frequency point based on the state parameter; A first filter parameter determination module is configured to, in the case that the first audio signal comprises at least one over-value frequency point, determine a first filter parameter corresponding to each of the over-value frequency points based on the frequency point parameter of the over-value frequency point and the protection threshold of the over-value frequency point; wherein the frequency point parameter of the over-value frequency point is greater than the protection threshold of the over-value frequency point; A filtering module is configured to filter the first audio signal based on the first filter parameter corresponding to each of the over-value frequency points, so as to reduce the frequency point parameter of the over-value frequency point; An audio playing module is configured to play the first audio through the screen sound generating device based on the filtered first audio signal.

15. An electronic device, comprising: An electronic device comprising a memory and a processor; the memory and the processor are coupled; the memory is configured to store computer program codes, the computer program codes comprising computer instructions, when the processor executes the computer instructions, the electronic device performs the method as claimed in any one of claims 1-13.

16. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer programs or instructions, when the computer programs or instructions run on the computer, the computer executes the method as claimed in any one of claims 1-13.

Images