Screen sounding device protection method and device and electronic equipment

By obtaining the status parameters of the audio signal and screen sounding device and filtering for the super-value frequency points, the problem of overloading of screen sounding devices is solved, and refined control of different frequency points is achieved, which improves user experience and the quality of audio signals. .

CN119071685AActive Publication Date: 2024-12-03HONOR DEVICE CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202310654080.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-06-02
Publication Date
2024-12-03
Estimated Expiration
2043-06-02

AI Technical Summary

Technical Problem

When preventing screen sounding devices from being overloaded, the prior art often passes series protection resistors or limiting processing, resulting in full-band attenuation of audio signals, affecting user listening experience, and being unable to finely control the performance of different frequency points.

Method used

By obtaining the status parameters of the audio signal and screen sounding device, determine the frequency point parameters and protection thresholds of each frequency point, filter the super-value frequency point, reduce its energy value or amplitude, avoid overloading of screen sounding device, and set different The protection threshold corresponding to the status parameters is used to finely control the audio signal.

Benefits of technology

It realizes effective protection of screen sounding devices, avoids full-band attenuation of audio signals, improves user experience, and maximizes the performance of screen sounding devices in various frequency bands.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071685A_ABST
    Figure CN119071685A_ABST
Patent Text Reader

Abstract

The invention provides a screen sound production device protection method and device and electronic equipment, and belongs to the technical field of loudspeakers, and the method comprises the steps: obtaining a first audio signal and a state parameter of a screen sound production device; determining a frequency point parameter of each frequency point in the first audio signal based on the first audio signal; determining a protection threshold value of each frequency point based on the state parameters; under the condition that the first audio signal comprises at least one over-value frequency point, determining a first filtering parameter corresponding to each over-value frequency point based on a frequency point parameter of the over-value frequency point and a protection threshold value of the over-value frequency point; performing filtering processing on the first audio signal based on the first filtering parameter corresponding to each over-value frequency point so as to reduce the frequency point parameter of the over-value frequency point; and based on the filtered first audio signal, playing the first audio through the screen sounding device. Therefore, the method does not need to connect a protection resistor in series, and can perform fine control on different frequency points in the input audio signal so as to maximize the performance of each frequency band of the screen sounding device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the technical field of loudspeakers, and in particular to a method, device and electronic device for protecting a screen sound-generating device. Background Art

[0002] At present, voice communication, music playback, video playback, etc. have become important functions of mobile phones and other electronic devices. In the process of mobile phones and other electronic devices providing users with voice communication, music playback, video playback and other functions, mobile phones and other electronic devices can convert audio signals into sound signals through speakers and output sound signals.

[0003] Conventional coil-type speakers need to have sound holes on the front panel of electronic devices such as mobile phones so that users can receive the sound output by the speakers. However, as the screen-to-body ratio requirements of electronic devices such as mobile phones increase, in order to reduce the area occupied by the sound holes, some electronic devices such as mobile phones use screen sound devices as speakers. The screen sound device can be connected to the back of the screen, and then drive the screen of electronic devices such as mobile phones to vibrate to produce sound. In this way, the screen sound device does not need to have sound holes on electronic devices such as mobile phones, and can meet the requirements of high screen-to-body ratio.

[0004] At present, in order to prevent the screen sound device from being overloaded and causing damage to the screen sound device, a protective resistor is usually connected in series with the screen sound device, or the input audio signal is limited. However, connecting a protective resistor in series with the screen sound device or limiting the input audio signal will cause the full-band attenuation of the input audio signal, thereby causing the audio signal to be distorted, affecting the user's hearing experience. Summary of the invention

[0005] The present application provides a screen sound device protection method, device and electronic device, which do not require a series protection resistor and can perform fine control on different frequency points in the input audio signal to maximize the performance of each frequency band of the screen sound device.

[0006] In a first aspect, the present application provides a screen sound device protection method, which is applied to an electronic device, wherein the electronic device includes a screen sound device, and the method includes: obtaining a first audio signal and state parameters of the screen sound device; based on the first audio signal, determining the frequency parameters of each frequency point in the first audio signal; based on the state parameters, determining the protection threshold of each frequency point; in the case where the first audio signal includes at least one excess frequency point, determining the first filtering parameters corresponding to each excess frequency point based on the frequency parameters of the excess frequency point and the protection threshold of the excess frequency point; wherein the frequency parameters of the excess frequency point are greater than the protection threshold of the excess frequency point; based on the first filtering parameters corresponding to each excess frequency point, filtering the first audio signal to reduce the frequency parameters of the excess frequency point; and based on the filtered first audio signal, playing the first audio through the screen sound device.

[0007] In this way, by filtering the excess frequency points, the energy value or amplitude of the excess frequency points is reduced to prevent the screen sound device from overloading. In this way, there is no need to reduce the energy value or amplitude of the non-excess frequency points, thereby achieving refined control of different frequency points in the first audio signal to maximize the performance of each frequency band of the screen sound device and improve the user experience. In addition, for different state parameters, the protection threshold corresponding to each frequency point is set respectively. In this way, the protection threshold corresponding to the current state parameter is used to determine whether the first audio signal includes an excess frequency point, which can ensure that the judgment result is more accurate.

[0008] In a possible implementation, determining the protection threshold of each frequency point based on the state parameter includes: determining the frequency band protection threshold corresponding to each frequency band in the first audio signal based on the state parameter; and determining the frequency band protection threshold of the frequency band where each frequency point is located as the protection threshold of each frequency point.

[0009] In this way, by dividing the frequency band of the first audio signal, the frequency band protection threshold of each frequency band is determined. Then, the frequency band protection threshold of the frequency band where each frequency point is located is determined as the protection threshold of each frequency point, so that the calculation amount of determining the protection threshold of each frequency point can be reduced.

[0010] In a possible implementation, determining the protection threshold of each frequency point based on the state parameter includes: determining a standard protection threshold of each frequency band in the first audio signal based on the state parameter; wherein the standard protection threshold is obtained based on a test of a standard screen sound device; determining a gain parameter of the screen sound device, the gain parameter including multiple frequency bands and a compensation gain corresponding to each of the frequency bands; wherein the compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response of the standard screen sound device; determining a frequency band protection threshold corresponding to each frequency band based on the standard protection threshold and the gain parameter; and determining the frequency band protection threshold of the frequency band where each frequency point is located as the protection threshold of each frequency point.

[0011] In this way, it is only necessary to test the standard protection threshold of the standard screen sound device on the production line, rather than to test the protection threshold of each screen sound device on the production line, thereby reducing the workload of testing on the production line.

[0012] In a possible implementation, the first filtering parameter corresponding to each of the excess frequency points is determined based on the frequency parameters of the excess frequency points and the protection threshold of the excess frequency points, including: determining the protection gain of each of the excess frequency points based on the frequency parameters of the excess frequency points and the protection threshold of the excess frequency points; determining the first filtering parameter corresponding to each of the excess frequency points based on the protection gain of the excess frequency points.

[0013] In a possible implementation, the protection gain of each excess frequency point is determined based on the frequency parameters of the excess frequency point and the protection threshold of the excess frequency point, including: determining the difference between the excess frequency point and the protection threshold as the protection gain corresponding to each excess frequency point.

[0014] In a possible implementation, the protection gain of each of the excess frequency points is determined based on the frequency parameters of the excess frequency points and the protection threshold of the excess frequency points, including: determining the excess frequency band corresponding to each of the excess frequency points; determining the maximum protection gain corresponding to each of the excess frequency bands; the maximum protection gain is the maximum value of the protection gain of each of the excess frequency points in the excess frequency band, and the protection gain is the difference between the excess frequency point and the protection threshold; the maximum protection gain is determined as the protection gain of each of the excess frequency points in the excess frequency band.

[0015] In a possible implementation, determining the first filtering parameters corresponding to each of the excess frequency points includes: determining the filtering parameters corresponding to each of the excess frequency bands based on the maximum protection gain; and determining the filtering parameters of the excess frequency band where each of the excess frequency points is located as the first filtering parameters corresponding to each of the excess frequency points.

[0016] In this way, filtering processing can be performed on each frequency band subsequently, and the first filtering parameter can be determined with the maximum protection gain so that the frequency point parameter of each frequency point of the filtered first audio signal can be reduced to less than or equal to the corresponding protection gain.

[0017] In a possible implementation, the method also includes: determining a gain parameter of the screen sound device, the gain parameter including multiple frequency bands and compensation gains corresponding to the multiple frequency bands; wherein the compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response; based on the gain parameter, determining the compensation gain of each frequency band in the first audio signal; based on the compensation gain of each frequency band, determining a second filtering parameter; based on the second filtering parameter, filtering the first audio signal so that the frequency response corresponding to the filtered first audio signal meets the standard frequency response.

[0018] In this way, the consistency of frequency response of different screen sound devices can be ensured, improving user experience.

[0019] In a possible implementation, determining a gain parameter of the screen sound emitting device includes: determining the gain parameter of the screen sound emitting device based on the state parameter.

[0020] In a possible implementation, the electronic device also includes a coil-type speaker, and the method also includes: acquiring a second audio signal; modifying the second audio signal based on the first filtering parameter; and playing the second audio through the coil-type speaker based on the modified second audio signal.

[0021] In this way, the coil-type speaker can correct the second audio signal of the playback link where the coil-type speaker is located based on the first filtering parameter, so that the overall effect of the two playback links is relatively stable after the overload protection mechanism is triggered, preventing sudden changes.

[0022] In a possible implementation manner, the frequency point parameter is an energy value or an amplitude.

[0023] In one possible implementation, the state parameters include parameters that affect the load and / or frequency response of the screen sound device, and the state parameters include at least one of the temperature of the screen sound device, the power of the electronic device, the feedback voltage of the screen sound device, and the feedback current of the screen sound device.

[0024] In a possible implementation, the method further includes: detecting failure of the screen sound device based on the feedback voltage and / or the feedback current; and controlling the playback link of the screen sound device to be disconnected when the screen sound device fails.

[0025] In the second aspect, the present application also provides a screen sound device protection device, the device comprising: an acquisition module, used to acquire the state parameters of the first audio signal and the screen sound device; a frequency parameter determination module, used to determine the frequency parameters of each frequency point in the first audio signal based on the first audio signal; a protection threshold determination module, used to determine the protection threshold of each frequency point based on the state parameters; a first filtering parameter determination module, used to determine the first filtering parameters corresponding to each super-value frequency point based on the frequency parameters of the super-value frequency point and the protection threshold of the super-value frequency point when the first audio signal includes at least one super-value frequency point; wherein the frequency parameter of the super-value frequency point is greater than the protection threshold of the super-value frequency point; a filtering module, used to filter the first audio signal based on the first filtering parameters corresponding to each super-value frequency point to reduce the frequency parameters of the super-value frequency point; an audio playing module, used to play the first audio through the screen sound device based on the filtered first audio signal.

[0026] In a possible implementation, the protection threshold determination module is specifically configured to determine, based on the state parameter, a frequency band protection threshold corresponding to each frequency band in the first audio signal; and determine the frequency band protection threshold of the frequency band where each frequency point is located as the protection threshold of each frequency point.

[0027] In a possible implementation, the protection threshold determination module is specifically used to determine the standard protection threshold of each frequency band in the first audio signal based on the state parameter; wherein the standard protection threshold is obtained based on the test of a standard screen sound device; determine the gain parameter of the screen sound device, the gain parameter includes multiple frequency bands and compensation gains corresponding to each of the frequency bands; wherein the compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response of the standard screen sound device; based on the standard protection threshold and the gain parameter, determine the frequency band protection threshold corresponding to each frequency band; determine the frequency band protection threshold of the frequency band where each frequency point is located as the protection threshold of each frequency point.

[0028] In a possible implementation, the first filtering parameter determination module is specifically used to determine the protection gain of each of the excess frequency points based on the frequency parameters of the excess frequency points and the protection threshold of the excess frequency points; and determine the first filtering parameter corresponding to each of the excess frequency points based on the protection gain of the excess frequency points.

[0029] In a possible implementation manner, the first filtering parameter determination module is specifically configured to determine the difference between the excess frequency point and the protection threshold as the protection gain corresponding to each of the excess frequency points.

[0030] In a possible implementation, the first filtering parameter determination module is specifically used to determine the super-value frequency band corresponding to each of the super-value frequency points; determine the maximum protection gain corresponding to each of the super-value frequency bands; the maximum protection gain is the maximum value of the protection gain of each of the super-value frequency points in the super-value frequency band, and the protection gain is the difference between the super-value frequency point and the protection threshold; the maximum protection gain is determined as the protection gain of each of the super-value frequency points in the super-value frequency band.

[0031] In a possible implementation, the first filtering parameter determination module is specifically used to determine the filtering parameters corresponding to each of the excess frequency bands based on the maximum protection gain; and determine the filtering parameters of the excess frequency band where each of the excess frequency points is located as the first filtering parameters corresponding to each of the excess frequency points.

[0032] In a possible implementation, it also includes: a frequency response calibration module, used to determine the gain parameters of the screen sound device, the gain parameters include multiple frequency bands and compensation gains corresponding to the multiple frequency bands; wherein the compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response; based on the gain parameters, determining the compensation gain of each frequency band in the first audio signal; based on the compensation gain of each frequency band, determining the second filtering parameter; based on the second filtering parameter, filtering the first audio signal so that the frequency response corresponding to the filtered first audio signal meets the standard frequency response.

[0033] In a possible implementation, the frequency response calibration module is specifically used to determine the gain parameter of the screen sound device based on the state parameter.

[0034] In a possible implementation, the method further includes: a correction module for acquiring a second audio signal; correcting the second audio signal based on the first filtering parameter; and playing the second audio through the coil-type speaker based on the corrected second audio signal.

[0035] In a possible implementation, it also includes: a failure detection module, which is used to detect the failure of the screen sound device based on the feedback voltage and / or the feedback current; when the screen sound device fails, the playback link of the screen sound device is controlled to be disconnected.

[0036] In a third aspect, the present application also provides an electronic device, comprising a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, the computer program code comprises computer instructions, and when the processor executes the computer instructions, the electronic device executes a method as described in any one of the first aspects.

[0037] In a fourth aspect, the present application further provides a computer-readable storage medium, wherein a computer program or instruction is stored in the computer-readable storage medium. When the computer program or instruction is executed on a computer, the computer executes the method as described in any one of the first aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0039] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0040] Figure 2 A scene diagram of using a screen sound device as a speaker provided in an embodiment of the present application;

[0041] Figure 3 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0042] Figure 4 A software structure block diagram of an electronic device 100 provided in an embodiment of the present application;

[0043] Figure 5 A flow chart of a screen sound device protection method provided in an embodiment of the present application;

[0044] Figure 6 A flow chart of calibrating the frequency response of a first audio signal provided in an embodiment of the present application;

[0045] Figure 7 A flowchart for determining a protection threshold for each frequency point provided in an embodiment of the present application;

[0046] Figure 8 An interactive diagram of a screen sound device protection method provided in an embodiment of the present application;

[0047] Fig. 9 A structural block diagram of a screen sound-generating device protection device provided in an embodiment of the present application;

[0048] Fig.10 A structural block diagram of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0050] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0051] At present, voice communication, music playback, video playback, etc. have become important functions of mobile phones and other electronic devices. In the process of mobile phones and other electronic devices providing users with voice communication, music playback, video playback and other functions, mobile phones and other electronic devices can convert audio signals into sound signals through speakers and output sound signals.

[0052] Conventional coil-type speakers need to have sound holes on the front panel of electronic devices such as mobile phones so that users can receive the sound output by the speakers. However, as the screen-to-body ratio requirements of electronic devices such as mobile phones increase, in order to reduce the area occupied by the sound holes, some mobile phones and other electronic devices use screen sound-generating devices as speakers. The screen generating device can be a vibration source connected to the back of the screen, for example, a capacitive device such as piezoelectric ceramics. The capacitive device can vibrate under the control of a current signal to drive the screen to vibrate, thereby achieving screen sound. In this way, the screen sound-generating device does not need to have sound holes on electronic devices such as mobile phones, and can meet the requirements of a high screen-to-body ratio.

[0053] For example, Figure 1 As shown, the electronic device 100 includes two speakers, one is a coil-type speaker 101, and the other is a screen generating device 102. The coil-type speaker 101 is located at the top of the electronic device, and the screen generating device 102 is located behind the screen 103. During use, the sound can be played through the coil-type speaker 101 alone, the sound can be played through the screen generating device 102 alone, or the coil-type speaker 101 and the screen generating device 102 can be used to play the sound at the same time. For example, Figure 2 As shown, the electronic device 100 plays sound through the screen generating device 102 alone. Specifically, the sound is emitted through the vibration of the screen, and then the sound is transmitted to the ears of the user 200 .

[0054] The speaker needs to be used in conjunction with an audio power amplifier, which is used to raise the voltage to drive the speaker to output a higher volume. With the increase in the operating voltage and output power of the speaker, the loudness of electronic devices has been greatly improved. However, the increase in operating voltage and output power can easily cause speaker overload, resulting in speaker damage.

[0055] At present, the audio power amplifier technology for overload protection of conventional coil-type speakers is already very mature. However, due to the different working principles of conventional coil-type speakers and screen sound devices, the overload protection solution of coil-type speakers is not fully suitable for screen sound devices.

[0056] In order to prevent the screen sound device from overloading and causing damage to the screen sound device, two main solutions are currently used: the first solution is to connect a protective resistor in series on the screen sound device, and the second solution is to limit the input audio signal. Among them, the first solution will bring more negative effects. For example, the series resistor is prone to heat up, the occupied area affects the circuit design, and the series resistor will also cause the full-band attenuation of the input audio signal, which will cause the audio signal to be distorted. Although the second solution can solve the problems of the series resistor being prone to heat up and the occupied area affecting the circuit design, the limiting processing of the input audio signal will still cause the full-band attenuation of the input audio signal, which will cause the audio signal to be distorted, affecting the user's hearing experience.

[0057] In order to solve the above technical problems, the present application provides a screen sound device protection method, which does not require a series protection resistor and can perform fine control of different frequency points in the input audio signal to maximize the performance of each frequency band of the screen sound device and improve the user experience.

[0058] The screen sound device protection method provided in the embodiment of the present application can be applied to any electronic device with a screen sound device, such as personal computers, tablets, mobile phones, bracelets, watches, etc.

[0059] The following takes the electronic device 100 as a mobile phone as an example to exemplify the specific structure of the electronic device 100.

[0060] like Figure 3As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0061] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0062] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0063] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0064] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0065] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0066] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0067] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0068] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0069] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0070] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0071] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0072] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0073] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0074] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0075] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0076] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0077] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0078] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0079] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0080] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0081] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0082] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0083] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0084] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0085] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0086] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0087] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0088] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0089] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0090] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0091] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0092] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0093] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0094] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A. Multiple speakers 170A can be set in the electronic device 100. For example, in the embodiment of the present application, the two speakers 170A can both be screen generating devices, or one speaker 170A can be a screen generating device and the other speaker 170A can be a coil-type speaker. A speaker 170A can also be set in the electronic device 100, and the one speaker 170A is a screen generating device. Among them, the coil-type speaker can be set at the top or bottom of the electronic device 100, and the screen generating device is set on the back of the screen.

[0095] The receiver 170B, also called a "receiver", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the receiver 170B can be placed close to the human ear to receive the voice. In some embodiments, the speaker 170A and the receiver 170B can also be set as one component, which is not limited in the present application.

[0096] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0097] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0098] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0099] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0100] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0101] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0102] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0103] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0104] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0105] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0106] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0107] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0108] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0109] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0110] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0111] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0112] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0113] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0114] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0115] Figure 4 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0116] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0117] The application layer can include a series of application packages.

[0118] like Figure 4 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0119] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0120] like Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0121] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0122] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0123] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0124] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0125] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0126] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0127] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0128] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0129] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0130] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0131] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0132] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0133] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0134] A 2D graphics engine is a drawing engine for 2D drawings.

[0135] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0136] The following is an example of an electronic device including a screen sound generating device and a coil-type speaker to illustrate the screen sound generating device protection method provided in an embodiment of the present application.

[0137] Figure 5 A schematic diagram of a screen sound device protection method provided in an embodiment of the present application. Figure 5 As shown, the protection method may include the following steps:

[0138] Step 301, obtaining a first audio signal and state parameters of a screen sound-generating device.

[0139] In the case where the electronic device includes a screen generating device and a coil-type speaker, the electronic device may include two playback links, one playback link plays audio through the screen generating device, and the other playback link plays audio through the coil-type speaker.

[0140] The electronic device can use the audio processing module to convert the analog audio signal into a digital audio signal so as to perform algorithmic processing on the digital audio signal. The converted digital audio signal can be divided into a first audio signal and a second audio signal, wherein the first audio corresponding to the first audio signal is played through the screen sound device, and the second audio corresponding to the second audio signal is played through the coil-type speaker.

[0141] In the embodiment of the present application, the state parameters of the screen sound device may include parameters that affect the load and / or frequency response of the screen sound device. For example, the state parameters may include at least one of the temperature of the screen sound device, the power of the electronic device, the feedback voltage of the screen sound device, and the feedback current of the screen sound device.

[0142] Among them, the temperature of the screen sound device can affect the load and frequency response of the screen sound device. The higher the temperature of the screen sound device, the greater the load of the screen sound device; at different temperatures, the corresponding frequency response of the screen sound device may be different.

[0143] The power of an electronic device can affect the load of the screen sound device. The lower the power of the electronic device, the more it needs to reduce the load of the screen sound device to save power.

[0144] The feedback voltage of the screen sound device and the feedback current of the screen sound device can also reflect the load condition of the screen sound device. In some embodiments, the failure of the screen sound device can be detected based on the feedback voltage of the screen sound device and / or the feedback current of the screen sound device. When the failure of the screen sound device is detected, the playback link of the screen sound device can be controlled to be disconnected to prevent the audio effect played by the screen sound device from being poor and affecting the user experience.

[0145] It should be understood that the embodiment of the present application can continue to perform the following steps 302 to 307 when it is detected that the screen sound device is not invalid. Otherwise, when it is detected that the screen sound device is invalid, the playback link of the screen sound device is controlled to be disconnected, that is, the subsequent steps 302 to 307 will not be performed.

[0146] Step 302: calibrate the frequency response of the first audio signal.

[0147] Due to production, environmental and other factors, the frequency responses of different screen sound devices may be inconsistent. Frequency response refers to the degree of response of the system to different frequencies. It can be understood as the degree of gain or level of sound output by the screen sound device in different frequency bands. Therefore, in order to ensure the consistency of the frequency response of different screen sound devices and improve the user experience, the embodiment of the present application can first calibrate the frequency response of the first audio signal.

[0148] In some embodiments, Figure 6 As shown, the frequency response calibration of the first audio signal can be implemented by the following steps:

[0149] Step 3021, determine the gain parameters of the screen sound device.

[0150] The gain parameter includes multiple frequency bands and compensation gains corresponding to the multiple frequency bands. The compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response. Since the frequency response includes multiple frequency bands and the gains corresponding to each frequency band, the difference between the frequency response of the screen sound device and the standard frequency response can be the gain difference corresponding to each frequency band (for example, it can be the difference in gain). In the embodiment of the present application, the gain difference corresponding to each frequency band is referred to as the compensation gain corresponding to each frequency band.

[0151] In some embodiments, the gain parameters of the screen sound device installed in the electronic device may be pre-stored in the electronic device, and the gain parameters include multiple frequency bands and compensation gains corresponding to each frequency band. In this way, the gain parameters of the screen sound device installed in the electronic device may be determined by checking the gain parameters of the screen sound device pre-stored in the electronic device.

[0152] In some embodiments, it is considered that the frequency response of the screen sound device is different under different state parameters. For example, the frequency response of the screen sound device is different under different temperatures. Based on this consideration, the gain parameters corresponding to the screen sound device installed in the electronic device under different state parameters can be obtained first. Then, the gain parameters corresponding to the different state parameters are stored in the electronic device. In this way, the gain parameters corresponding to the screen sound device under the current state parameters can be determined by obtaining or viewing the gain parameters corresponding to the different state parameters pre-stored in the electronic device.

[0153] Among them, the gain parameters corresponding to each state parameter can be obtained based on the frequency response of the screen sound device under the corresponding state parameter and the standard frequency response under the corresponding state parameter. For example, the frequency response of the screen sound device under state 1 and the standard frequency response under state 1 are obtained respectively; then, based on the frequency response of the screen sound device under state 1 and the standard frequency response under state 1, the compensation gain of each frequency band is calculated. In this way, the calculated compensation gain corresponding to each frequency band is the gain parameter corresponding to state 1.

[0154] Step 3022: Determine the compensation gain of each frequency band in the first audio signal based on the gain parameter of the screen sound-emitting device.

[0155] In some embodiments, the gain parameter of the screen sound device may include the full frequency band and the compensation gain corresponding to the full frequency band. The first audio signal may include a partial frequency band in the full frequency band, and therefore, the compensation gain of each frequency band included in the first audio signal may be determined based on the gain parameter of the screen sound device.

[0156] Step 3023: Determine a filtering parameter (which may be referred to as a second filtering parameter in the embodiment of the present application) based on the compensation gain of each frequency band.

[0157] The step of determining the second filter parameter is equivalent to the process of designing a filter for filtering the first audio signal. The filter can be a finite impulse response filter (FIR) or an infinite impulse response filter (IIR). The phase of FIR is more stable, so if the influence of phase fluctuation is considered, FIR filter can be used.

[0158] The embodiment of the present application does not limit the design method of the filter used for filtering the first audio signal. For example, the filter can be designed by using a window function method to obtain the second filtering parameters.

[0159] The following is an example of designing an FIR filter using a window function method.

[0160] The window function method is used to design FIR filters, which mainly designs a frequency response of H(e jw ) to approximate the ideal FIR filter h d (n). The impulse response of an ideal FIR filter is non-causal and infinite in length. The window function method starts from the time domain and uses a causal, finite-length impulse response to approximate an ideal FIR filter that is non-causal and infinite in length.

[0161] Assume that there is an ideal low-pass filter with a frequency response of H d (e jw ), for H d (e jw ) Fourier transform to obtain the low-pass filter h d (n), h d (n) satisfies the following relationship (1):

[0162]

[0163] Because h d (n) is non-causal and infinite in length, so a finite-length window function w(n) can be used for truncation to obtain the target filter h(n). The h(n) obtained by truncation satisfies the following relationship (2):

[0164] h(n)=h d (n)w(n) (2)

[0165] For example, if you need to design a cutoff frequency of w c The low-pass filter has a passband gain (i.e., compensation gain in the embodiment of the present application) of GdB and a group delay of α. Then, the frequency response H of the ideal filter is d (ejw ) can be expressed as the following relation (3):

[0166]

[0167] For H d (e jw ) Fourier transform to get the ideal filter h d (n), ideal filter h d (n) satisfies the following relation (4):

[0168]

[0169] However, h d (n) is still non-causal and infinite, so consider using a causal rectangular window of length N to truncate, and at the same time satisfy the symmetric structure of the FIR filter, whose symmetry center is (N-1) / 2. At this time, considering matching, the ideal filter also delays (N-1) / 2, that is, the delay α satisfies the following relationship (5):

[0170] α=(N-1) / 2 (5)

[0171] In this way, the ideal filter h after delay is obtained d (n) satisfies the following relation (6):

[0172]

[0173] Then use the window function to h d (n) is truncated to obtain a finite-length target filter h(n), which satisfies the following relationship (7):

[0174]

[0175] After the above design processing, the expected low-pass filter h(n) can be obtained, wherein the use of the window function is selected and designed according to specific needs.

[0176] In the embodiment of the present application, the second filter parameter for calibrating the frequency response of the first audio signal can be regarded as a superposition of a series of bandpass filters corresponding to different compensation gains in different frequency bands, and the design of the bandpass filter is the subtraction of the low-pass filter. Therefore, the actual designed frequency response is:

[0177]

[0178] Thus, the Fourier transform of the above relationship (8) can be used to obtain the bandpass or low-pass filter h for different frequency bands: m (n), that is, obtaining the second filtering parameters corresponding to different frequency bands, where M is the total number of divided frequency bands.

[0179] Step 3024: filter the first audio signal based on the second filtering parameter so that the frequency response of the filtered first audio signal meets the standard frequency response.

[0180] In this way, by filtering the first audio signal based on the filter designed above (ie, including the second filter parameters of each frequency band), the frequency response of the filtered first audio signal can meet the standard frequency response.

[0181] It should be noted that, in order to facilitate algorithmic processing of the first audio signal, in some embodiments, the first audio signal may be firstly subjected to time-frequency conversion to obtain a frequency domain signal corresponding to the first audio signal. In this case, since the second filter parameters corresponding to each frequency band obtained based on the above relationship (8) are time domain parameters, before processing the first audio signal, the second filter parameters may be first subjected to time-frequency conversion to convert the time domain parameters into frequency domain parameters, and then the frequency domain signal may be filtered based on the converted frequency domain parameters.

[0182] It should also be noted that the embodiment of the present application is only illustrative of the step of calibrating the frequency response of the first audio signal, and does not limit the screen sound device protection method. For example, the screen sound device protection method provided in the embodiment of the present application may not include the above-mentioned step 302. Therefore, in the following steps, the first audio signal can be an audio signal that has undergone frequency response calibration, or an audio signal that has not undergone frequency response calibration, and the present application does not specifically limit this.

[0183] It should also be noted that the embodiment of the present application can also calibrate the frequency response of the second audio signal, wherein the method for calibrating the frequency response of the second audio signal can refer to the above description of the frequency response calibration of the first audio signal, which will not be repeated here.

[0184] Step 303: Based on the first audio signal, determine the frequency parameter of each frequency point in the first audio signal.

[0185] It should be understood that if the first audio signal is subjected to frequency response calibration processing before step 303, the first audio signal in step 303 and subsequent steps is the first audio signal subjected to frequency response calibration processing. If the first audio signal is not subjected to frequency response calibration processing before step 303, the first audio signal in step 303 and subsequent steps is the first audio signal not subjected to frequency response calibration processing.

[0186] In some embodiments, the first audio signal may be first time-frequency converted to obtain a frequency domain signal corresponding to the first audio signal for subsequent algorithm processing. Further, frequency point parameters of each frequency point in the frequency domain signal may be determined based on the frequency domain signal.

[0187] In the embodiment of the present application, the frequency point parameter refers to a parameter used to monitor whether the overload protection mechanism needs to be triggered. For example, the frequency point parameter may be an amplitude corresponding to the frequency point or an energy value corresponding to the frequency point.

[0188] Among them, the amplitude of the frequency point Amp(h)=|X[k]|, the energy value of the frequency point Energy(k)=X[k] 2 . Wherein, k represents the frequency point.

[0189] Step 304: Determine the protection threshold of each frequency point based on the state parameter.

[0190] The embodiment of the present application takes into account that different frequency points have different corresponding protection thresholds under different state parameters. Therefore, the embodiment of the present application sets the protection threshold corresponding to each frequency point for different state parameters, so that the judgment result can be guaranteed to be more accurate.

[0191] The embodiment of the present application does not limit the specific implementation method of determining the protection threshold of each frequency point based on the state parameter.

[0192] In some embodiments, the protection threshold of each frequency point is determined based on the state parameters, which can be implemented in the following manner: each electronic device is tested on the production line under different state parameters, and the limit energy value or amplitude corresponding to each frequency point when the screen sound device is not overloaded. Then, the limit energy value or amplitude corresponding to each frequency point is determined as the protection threshold corresponding to each frequency point under different state parameters.

[0193] Based on the above test, the mapping relationship between the state parameter, the frequency point and the protection threshold can be obtained. In some embodiments, the mapping relationship between the above three can be stored in the corresponding electronic device. In this way, when it is necessary to use the mapping relationship between the above three, the protection threshold of each frequency point in the first audio signal under the current state parameter can be determined by obtaining or viewing the mapping relationship between the state parameter, the frequency point and the protection threshold pre-stored in the electronic device.

[0194] Exemplarily, as shown in Table 1, taking the state parameter as the temperature of the screen sound device as an example, it is assumed that there are two states, state 1 and state 2. For example, state 1 is that the temperature of the screen sound device is the first temperature, and state 2 is that the temperature of the screen sound device is the second temperature, and the first temperature and the second temperature are different temperatures. When the state parameter is state 1, the protection thresholds corresponding to the frequency points F1 to Fn are obtained by testing, for example, the protection threshold corresponding to the frequency point F1 is A1, the protection threshold corresponding to the frequency point F2 is A2, and the protection threshold corresponding to the frequency point Fn is An. Similarly, when the state parameter is state 2, the protection thresholds corresponding to the frequency points F1 to Fn are obtained by testing, for example, the protection threshold corresponding to the frequency point F1 is B1, the protection threshold corresponding to the frequency point F2 is B2, and the protection threshold corresponding to the frequency point Fn is Bn. Among them, under the same state parameter, the protection thresholds corresponding to different frequency points may be different, for example, the values ​​of A1, A2...An are different. Under different state parameters, the protection threshold corresponding to the same frequency point may also be different. For example, A1 and B1 may be different, A2 and B2 may be different, and An and Bn may be different.

[0195] Table 1 Mapping relationship between state parameters, frequency points and protection thresholds

[0196]

[0197] In some embodiments, in order to reduce the testing workload, the protection threshold of each frequency point is determined based on the state parameters, which can be implemented in the following way: the audio signal is divided into frequency bands according to the preset frequency band division rules. Correspondingly, each electronic device is tested on the production line under different state parameters, and the limit energy value or amplitude corresponding to each frequency band is determined when the screen sound device is not overloaded. Then, the limit energy value or amplitude corresponding to each frequency band is determined as the protection threshold corresponding to each frequency band under different state parameters. Since each frequency band includes one or more continuous frequency points, the protection threshold of the frequency band where each frequency point is located (also referred to as the frequency band protection threshold in the embodiment of the present application) can be determined as the protection threshold of the frequency point.

[0198] Based on the above test, the mapping relationship between the state parameter, the frequency band and the protection threshold can be obtained. In some embodiments, the mapping relationship between the above three can be stored in the corresponding electronic device. In this way, when it is necessary to use the mapping relationship between the above three, the protection threshold of each frequency band in the first audio signal under the current state parameter can be determined by obtaining or viewing the mapping relationship between the state parameter, the frequency band and the protection threshold. Further, based on the correspondence between the frequency band and each frequency point, the frequency band where each frequency point in the first audio signal is located can be determined. Then, the protection threshold of the frequency band where each frequency point in the first audio signal is located is determined as the protection threshold of the frequency point.

[0199] It should be understood that the above embodiment may also store the mapping relationship between the state parameter, frequency band, frequency point and protection threshold in the corresponding electronic device, and this application does not limit this.

[0200] Exemplarily, as shown in Table 2, taking the state parameter as the temperature of the screen sound device as an example, it is assumed that there are two states, state 1 and state 2. For example, state 1 is that the temperature of the screen sound device is the first temperature, and state 2 is that the temperature of the screen sound device is the second temperature, and the first temperature and the second temperature are different temperatures. When the state parameter is state 1, multiple frequency bands are included, for example, frequency bands M1 to Mn. Each frequency band of M1 to Mn corresponds to a protection threshold, for example, the protection threshold corresponding to frequency band M1 is A1, the protection threshold corresponding to M2 is A2, and the protection threshold corresponding to Mn is An. Among them, each frequency band corresponds to multiple continuous frequency points, for example, the frequency points corresponding to frequency band M1 are F1 to Fa, the frequency points corresponding to frequency band M2 are Fb to Fc, and the frequency points corresponding to frequency band Mn are Fd to Fe. In this way, the protection thresholds corresponding to frequency points F1 to Fa are all A1, the protection thresholds corresponding to frequency points Fb to Fc are all A2, and the protection thresholds corresponding to frequency points Fd to Fe are all A3. Similarly, when the state parameter is state 2, each frequency band corresponds to a protection threshold one by one, which will not be repeated here. Among them, under the same state parameter, the protection thresholds corresponding to different frequency bands may be different, for example, the values ​​of A1, A2...An are different. Under different state parameters, the protection thresholds corresponding to the same frequency band may also be different, for example, A1 and B1 may be different, A2 and B2 may be different, and An and Bn may be different.

[0201] Table 2 Mapping relationship between status parameters, frequency bands, frequency points and protection thresholds

[0202]

[0203] In some embodiments, in order to reduce the testing workload, the protection threshold of each frequency point is determined based on the state parameters, which can also be implemented in the following way: pre-test the standard protection threshold of each frequency point or frequency band under different state parameters of the standard screen sound device. Then, based on the difference between the screen sound device and the standard screen sound device, the standard protection threshold is corrected to be the protection threshold applicable to the screen sound device in the current electronic device. Among them, the standard screen sound device refers to a standard prototype of a screen sound device that has completed device calibration (such as frequency response calibration). The frequency response corresponding to the standard screen sound device is the standard frequency response.

[0204] Among them, based on the test of the standard screen sound device, the mapping relationship between the state parameters, frequency points and standard protection thresholds can be obtained (refer to the description of Table 1, which will not be repeated here), or the mapping relationship between the state parameters, frequency bands and standard protection thresholds can be obtained (refer to the description of Table 2, which will not be repeated here).

[0205] In this way, the mapping relationship between the state parameters, frequency points (or frequency bands) and standard protection thresholds can be stored in different electronic devices. When the mapping relationship between the above three is needed, the mapping relationship between the state parameters, frequency bands and standard protection thresholds pre-stored in the electronic device can be obtained or viewed to determine the standard protection thresholds of each frequency point (or frequency band) in the first audio signal under the current state parameters. Furthermore, the standard protection threshold is modified to be the protection threshold applicable to the screen sound device in the current electronic device.

[0206] The following describes in detail the method for determining the protection threshold of each frequency point provided in this embodiment by taking the standard protection threshold including the standard protection threshold of each frequency band under different state parameters as an example.

[0207] Figure 7 A flowchart for determining the protection threshold of each frequency point provided in an embodiment of the present application. Figure 7 As shown, the following steps may be included:

[0208] Step 3041: Determine a standard protection threshold corresponding to each frequency band in the first audio signal based on the state parameter.

[0209] In the case where the mapping relationship among the state parameters, frequency bands and standard protection thresholds is pre-stored in the electronic device, the mapping relationship among the state parameters, frequency bands and standard protection thresholds can be obtained first. Then, the standard protection threshold corresponding to each frequency band under the current state parameter is determined in the obtained mapping relationship.

[0210] Step 3042, determining the gain parameters of the screen sound device, where the gain parameters include multiple frequency bands and the compensation gain corresponding to each frequency band.

[0211] Among them, the step of determining the gain parameters of the screen sound device can be specifically referred to the description of step 3021, which will not be repeated here.

[0212] Step 3043: Determine the frequency band protection threshold corresponding to each frequency band based on the standard protection threshold and gain parameter of each frequency band.

[0213] Specifically, according to the corresponding relationship between each frequency band and the compensation gain in the gain parameter, the standard protection threshold of each frequency band is corrected to obtain the frequency band protection threshold corresponding to each frequency band.

[0214] For example, the standard protection threshold is X(x1, x2, x3…x M ), where x1,x2,x3…x M They represent the standard protection thresholds corresponding to each frequency band. The gain parameters are Y(y1,y2,y3…y M ), where y1,y2,y3…y M In this way, based on the standard protection threshold and the gain parameter, the determined frequency band protection threshold is X+Y, that is, (x1+y1,x2+y2,x3+y3,…,x M +y M ).

[0215] Step 3044: determine the frequency band protection threshold of the frequency band where each frequency point is located as the protection threshold of each frequency point.

[0216] Based on the correspondence between the frequency band and the frequency point, the frequency band protection threshold of the frequency band where each frequency point is located can be determined as the protection threshold of each frequency point.

[0217] In this way, the method for determining the protection threshold of each frequency point provided by this embodiment only needs to test the protection threshold of the standard screen sound device on the production line, without having to test the protection threshold of each screen sound device on the production line, thereby reducing the workload of testing on the production line.

[0218] It should be noted that the above is only Figure 6 The corresponding embodiment (determining the protection threshold of each frequency point based on the protection threshold of the frequency band) is provided for illustrative purposes only and does not limit the method of determining the protection threshold of each frequency point. For example, the standard protection threshold of each frequency point in the first audio signal can also be determined based on the state parameter; then, the gain parameter of the screen sound device is determined, and the gain parameter includes multiple frequency points and the compensation gain corresponding to each frequency point; finally, the frequency band protection threshold corresponding to each frequency point is determined based on the standard protection threshold of each frequency point and the gain parameter.

[0219] It should be noted that the above embodiment is only illustrative of two states, and does not limit the number of states. For example, five, ten, twenty, etc. different states may be included.

[0220] It should also be noted that the protection threshold and the frequency parameter in the embodiment of the present application correspond to each other. For example, when the frequency parameter is an amplitude, the corresponding protection threshold is also an amplitude. For another example, when the frequency parameter is an energy value, the corresponding protection threshold is also an energy value.

[0221] Step 305: Based on the protection threshold and the frequency parameter, determine whether the first audio signal includes an excess frequency.

[0222] Step 306: When the first audio signal includes at least one excess frequency point, determine the first filtering parameter corresponding to each excess frequency point based on the frequency point parameter of the excess frequency point and the protection threshold of the excess frequency point.

[0223] An over-value frequency point refers to a frequency point whose frequency point parameter is greater than the protection threshold of the over-value frequency point. For example, an over-value frequency point refers to a frequency point whose amplitude or energy value is greater than the protection threshold. The following is an exemplary description using the frequency point parameter as the energy value. For example, in combination with Table 1, assuming that the energy value corresponding to the frequency point F1 in the first audio signal is greater than the energy value threshold A1, the frequency point F1 in the first audio signal is the over-value frequency point.

[0224] If the first audio signal including the overvalue frequency point is directly output through the screen sound device, it will cause the screen sound device to be overloaded, which may damage the screen sound device. Therefore, in the case of the first audio signal, the embodiment of the present application executes the screen sound device overload protection mechanism, that is, the first audio signal is filtered to reduce the energy value of each overvalue frequency point in the first audio signal, so that the energy value of each frequency point in the first audio signal after filtering is less than or equal to the corresponding protection threshold, thereby realizing overload protection of the screen sound device.

[0225] Therefore, in order to filter the first audio signal and reduce the energy value of each excess frequency point in the first audio signal, it is necessary to first determine the first filter parameter for filtering the first audio signal. The first filter parameter refers to the filter parameter corresponding to each excess frequency point.

[0226] In some embodiments, the first filtering parameter corresponding to each super-value frequency point is determined based on the frequency parameter of the super-value frequency point and the protection threshold of the super-value frequency point, which can be implemented in the following manner: first, the protection gain of each super-value frequency point is determined based on the frequency parameter of the super-value frequency point and the protection threshold of the super-value frequency point. Then, based on the protection gain of the super-value frequency point, the first filtering parameter corresponding to each super-value frequency point is determined. Among them, the protection gain of each super-value frequency point can be understood as the gain that each super-value frequency point needs to be attenuated.

[0227] In some embodiments, the protection gain of each excess frequency point may be determined in the following manner: the difference between the excess frequency point and the corresponding protection threshold may be determined as the protection gain corresponding to each excess frequency point.

[0228] Exemplarily, in combination with Table 1, it is assumed that the excess frequency points in the first audio signal include F1 and F2. In this way, the protection gain corresponding to the excess frequency point F1 is the difference between the energy value of the excess frequency point F1 and A1, and the protection gain corresponding to the excess frequency point F2 is the difference between the energy value of the excess frequency point F2 and A2. It should be understood that the protection gain for the frequency points in the first audio signal that do not exceed the protection threshold is 0dB.

[0229] In some embodiments, the protection gain of each excess frequency point can also be determined in the following manner: first determine the excess frequency band corresponding to each excess frequency point; then, determine the maximum protection gain corresponding to each excess frequency band, the maximum protection gain being the maximum value of the protection gain of each excess frequency point in the excess frequency band, and the protection gain being the difference between the excess frequency point and the protection threshold; finally, determine each maximum protection gain as the protection gain of each excess frequency point in each excess frequency band.

[0230] Exemplarily, in combination with what is shown in Table 2, it is assumed that the super-value frequency points in the first audio signal include F1, Fa, Fb and Fc. Among them, the protection gain G1 corresponding to the super-value frequency point F1 is the difference between the energy value of the super-value frequency point F1 and A1, the protection gain Ga corresponding to the super-value frequency point Fa is the difference between the energy value of the super-value frequency point Fa and A1, the protection gain Gb corresponding to the super-value frequency point Fb is the difference between the energy value of the super-value frequency point Fb and A2, and the protection gain Gc corresponding to the super-value frequency point Fc is the difference between the energy value of the super-value frequency point Fc and A2. In this way, the larger of the protection gain G1 and the protection gain Ga is determined as the protection gain of the super-value frequency band M1, and correspondingly, the protection increase of all super-value frequency points (F1 and Fa) in the super-value frequency band M1 is determined as the larger of the protection gain G1 and the protection gain Ga. Similarly, the larger of the protection gain Gb and the protection gain Gc is determined as the protection gain of the excess frequency band M2, and correspondingly, the protection increase of all excess frequency points (Fb and Fc) in the excess frequency band M2 is determined as the larger of the protection gain Gb and the protection gain Gc.

[0231] Furthermore, based on each maximum protection gain, the filter parameters corresponding to each super-value frequency band can be determined. Then, the filter parameters of the super-value frequency band where each super-value frequency point is located are determined as the first filter parameters corresponding to each super-value frequency point. That is to say, in this implementation, the first filter parameters corresponding to each super-value frequency point in the same frequency band are the same.

[0232] Among them, the method for determining the first filtering parameters of each excess frequency band based on the protection gain of each excess frequency band can refer to the description of determining the second filtering parameters based on the compensation gain of each frequency band in step 3023, which will not be repeated here.

[0233] Step 307: filtering the first audio signal based on the first filtering parameters corresponding to the excess frequency points to reduce the frequency parameters of the excess frequency points.

[0234] Step 308: Play the first audio through the screen sound device based on the filtered first audio signal.

[0235] It should be noted that, each time step 307 is executed once in the embodiment of the present application, it can be re-determined whether the filtered first audio signal includes an excess frequency point based on the filtered first audio signal. If the filtered first audio signal includes an excess frequency point, steps 306 to 307 are executed again until the filtered first audio signal does not include an excess frequency point. In this way, based on the filtered first audio signal that does not include an excess frequency point, the corresponding audio is played through the screen sound device.

[0236] It should also be noted that after obtaining the first audio signal that does not include the excess frequency point, before playing the corresponding audio through the screen sound device, the first audio signal that does not include the excess frequency point can also be processed by other algorithms, such as privacy call algorithm processing.

[0237] In the case where the electronic device includes two playback links, for example, the electronic device includes a screen sound device and a coil-type speaker, in order to ensure the stability of the subsequent two-way playback link algorithm processing, the first filter parameter can also be synchronized to the coil-type speaker. In this way, the coil-type speaker can correct the second audio signal of the playback link where the coil-type speaker is located based on the first filter parameter. Then, based on the corrected second audio signal, the second audio signal is played through the coil-type speaker, so that the overall effect of the two-way playback link is relatively stable after the overload protection mechanism is triggered, preventing the occurrence of sudden changes.

[0238] In some embodiments, the gain reduction range of the second audio signal and the first audio signal can be corrected to be consistent. For example, in step 307, the gain of the frequency band M1 and the frequency band M2 of the first audio signal is reduced, and the corresponding gain reduction values ​​are 2dB and 4dB respectively. In this way, the gain of the frequency band M1 and the frequency band M2 of the second audio signal can be reduced accordingly, and the corresponding gain reduction values ​​are also 2dB and 4dB respectively. In this way, the audio output by the two playback links can be made consistent.

[0239] In some embodiments, the second audio signal can also be corrected so that the corrected second audio signal complements the filtered first audio signal, so that the overall effect of the two-way playback link is relatively stable. For example, in step 307, the gain of the frequency band M1 and the frequency band M2 of the first audio signal is reduced, and the corresponding reduced gain values ​​are 2dB and 4dB respectively. In this way, the gain of the frequency band M1 and the frequency band M2 of the second audio signal can be correspondingly increased, and the corresponding increased gain values ​​are also 2dB and 4dB respectively. In this way, the overall effect of the two-way playback link can be relatively stable without sudden changes.

[0240] In summary, the screen sound device protection method provided in the embodiment of the present application performs filtering processing on the excess frequency points to reduce the energy value or amplitude of the excess frequency points, thereby preventing the screen sound device from being overloaded. In this way, there is no need to reduce the energy value or amplitude of the non-excess frequency points, thereby achieving refined control of different frequency points in the first audio signal, so as to maximize the performance of each frequency band of the screen sound device and improve the user experience. In addition, the embodiment of the present application sets the protection threshold corresponding to each frequency point for different state parameters, so that the protection threshold corresponding to the current state parameter is used to determine whether the first audio signal includes an excess frequency point, which can ensure that the judgment result is more accurate.

[0241] To further facilitate the understanding of the screen sound device protection method provided in the embodiment of the present application, Figure 8 An interactive diagram of a screen sound device protection method provided by an embodiment of the present application is shown. Figure 8 As shown, the electronic device may include an audio processing module 401, a first frequency response calibration module 402, a second frequency response calibration module 403, a protection module 404, a correction module 405, other algorithm modules 406, other algorithm modules 407, a failure detection module 408 of a screen sound device, a smart power amplifier Smart PA 409 of the screen sound device, a smart power amplifier Smart PA 410 of a coil-type speaker, a state control module 411, a screen sound device 412 and a coil-type speaker 413.

[0242] like Figure 8 As shown, after receiving the analog audio, the audio processing module 401 can convert the analog audio into a digital audio signal, and then generate two audio signals based on the digital audio signal, namely, a first audio signal and a second audio signal. The first audio signal goes through the playback link where the screen generating device 412 is located, and the second audio signal goes through the playback link where the coil-type speaker 413 is located.

[0243] In some embodiments, the first audio signal and the second audio signal are first input into the corresponding first frequency response calibration module 402 and second frequency response calibration module 403 for frequency response calibration. The frequency response calibration method can refer to the description of step 302 and will not be described again here.

[0244] Smart PA 409 can detect the current and voltage of the screen sound device 412 in real time, and feed back the detected current and voltage to the failure detection module 408. In this way, the failure detection module 408 can detect whether the screen sound device 412 is failed according to the received feedback voltage and feedback current. The failure detection module 408 can also be used to collect some state parameters, such as the temperature of the screen sound device 412.

[0245] Afterwards, the failure detection module 408 may report the failure detection result and the collected state parameters to the state control module 411 .

[0246] If the failure detection result received by the state control module 411 is "failed", the state control module 411 can control the disconnection of the playback link where the screen generating device 412 is located. If the failure detection result received by the state control module 411 is "normal", the state control module 411 can determine the protection threshold corresponding to the current state parameter based on the received state parameter, and send the frequency point protection threshold to the protection module 404. Alternatively, the state control module 411 can also send the protection threshold and state parameters corresponding to different state parameters to the protection module 404. In this way, the protection module 404 can determine the protection threshold corresponding to the current state parameter based on the received protection threshold and state parameters corresponding to different state parameters.

[0247] The protection module 404 may first determine the frequency parameters of each frequency point in the first audio signal based on the received first audio signal; then, based on the frequency parameters and the protection threshold, determine whether to trigger the protection mechanism. If it is determined that the protection mechanism is triggered, steps 306 to 307 are executed. If it is determined that the protection mechanism is triggered, the first audio signal is output to the other algorithm module 406 for subsequent processing until the corresponding audio is played through the screen sound device 412. Among them, the conditions for triggering the protection mechanism can refer to the description of steps 305 to 306 in the above embodiment, which will not be repeated here.

[0248] In some embodiments, if the protection mechanism is triggered, the first filter parameter may be further synchronized to the modification module 405. In this way, the modification module 405 may modify the second audio signal based on the received first filter parameter.

[0249] Correspondingly, the modified second audio signal is output to the other algorithm module 407 for subsequent processing until the corresponding audio is played through the coil-type speaker 413.

[0250] Combination Figure 8 It can be seen that the screen sound device protection method provided in the embodiment of the present application performs protection processing on the first audio signal before Smart PA409 to prevent the first audio signal from being overloaded and damaging the screen sound device.

[0251] It should be noted that the above embodiment is only illustrative of an electronic device including a screen generating device and a coil-type speaker, and does not limit the application scenario of the screen sound generating device protection method provided in the embodiment of the present application. For example, the screen sound generating device protection method provided in the embodiment of the present application can also be applied to a scenario including only one screen generating device or including two or more screen generating devices.

[0252] For example, if the electronic device includes two screen generating devices, the playback links corresponding to the two screen generating devices may share a first frequency response calibration module 402 , a protection module 404 and other algorithm modules 408 .

[0253] The various method embodiments described in this document may be independent solutions or may be combined according to internal logic, and these solutions all fall within the protection scope of this application.

[0254] It can be understood that in the above-mentioned various method embodiments, the methods and operations implemented by the test electronic device can also be implemented by components (such as chips, modules or circuits) that can be used to test the electronic device.

[0255] The above embodiments introduce the screen sound device protection method provided by the present application. It is understandable that in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0256] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0257] Above, combined Figures 1 to 8 The screen sound device protection method provided by the embodiment of the present application is described in detail. Fig. 9 and Fig.10 The device provided in the embodiment of the present application is described in detail. It should be understood that the description of the device embodiment corresponds to the description of the method embodiment, so the contents not described in detail can be referred to the method embodiment above, and for the sake of brevity, they will not be repeated here.

[0258] See also Fig. 9 , Fig. 9This is a structural block diagram of a screen sound device protection device provided in an embodiment of the present application. The device can be a part of an electronic device and applied in an electronic device. It can also be an electronic device, which is not limited by the present application. Fig. 9 As shown, the device 500 may include: an acquisition module 501, a frequency parameter determination module 502, a protection threshold determination module 503, a first filter parameter determination module 504, a filter module 505, and an audio playback module 506. The frequency parameter determination module 502, the protection threshold determination module 503, the first filter parameter determination module 504, and the filter module 505 may be submodules in the protection module 404. The device 500 may perform the above Figures 1 to 8 The operations performed by the electronic device in any one of the method embodiments shown.

[0259] For example, in an optional embodiment of the present application, an acquisition module 501 is used to acquire state parameters of a first audio signal and a screen sound device; a frequency parameter determination module 502 is used to determine frequency parameters of each frequency point in the first audio signal based on the first audio signal; a protection threshold determination module 503 is used to determine the protection threshold of each frequency point based on the state parameters; a first filter parameter determination module 504 is used to determine the first filter parameter corresponding to each super-value frequency point based on the frequency parameter of the super-value frequency point and the protection threshold of the super-value frequency point when the first audio signal includes at least one super-value frequency point; wherein the frequency parameter of the super-value frequency point is greater than the protection threshold of the super-value frequency point; a filtering module 505 is used to filter the first audio signal based on the first filter parameter corresponding to each super-value frequency point to reduce the frequency parameter of the super-value frequency point; an audio playback module 506 is used to play the first audio through the screen sound device based on the filtered first audio signal.

[0260] That is, the device 500 can realize the corresponding Figures 1 to 8 The steps or processes performed by the electronic device in any of the embodiments of the screen sound device protection method shown in the figure may include a method for performing Figures 1 to 7 The modules of the method executed by the electronic device in any one of the embodiments of the screen sound device protection method are shown. It should be understood that the specific process of each module executing the above corresponding steps has been described in detail in the above embodiment of the screen sound device protection method, and will not be repeated here for the sake of brevity.

[0261] The embodiment of the present application further provides a processing device, which includes at least one processor and a communication interface. The communication interface is used to provide information input and / or output to the at least one processor, and the at least one processor is used to execute the method in the above method embodiment.

[0262] It should be understood that the above-mentioned processing device can be a chip. Fig.10 , Fig.10 A structural block diagram of a chip provided in an embodiment of the present application. Fig.10 The chip shown may be a general-purpose processor or a dedicated processor. The chip 600 may include at least one processor 601. The at least one processor 601 may be used to support Fig. 9 The device shown performs Figures 1 to 8 The technical solution shown in any one of the embodiments.

[0263] Optionally, the chip 600 may further include a transceiver 602, which is used to accept the control of the processor 601 and to support Fig. 9 The device shown performs Figures 1 to 8 The technical solution shown in any one of the embodiments. Optionally, Fig.10 The chip 600 shown may further include a storage medium 603. Specifically, the transceiver 602 may be replaced by a communication interface, and the communication interface provides information input and / or output for the at least one processor 601.

[0264] It should be noted that Fig.10 The chip 600 shown can be implemented using the following circuits or devices: one or more field programmable gate arrays (FPGA), programmable logic devices (PLD), application specific integrated circuits (ASIC), system on chip (SoC), central processor unit (CPU), network processor (NP), digital signal processor (DSP), micro controller unit (MCU), controller, state machine, gate logic, discrete hardware components, any other suitable circuits, or any combination of circuits capable of performing the various functions described throughout the present application.

[0265] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0266] It can be understood that the memory in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0267] According to the method provided in the embodiment of the present application, the embodiment of the present application also provides a computer program product, which includes: a computer program or instruction, when the computer program or instruction is run on a computer, the computer executes Figures 1 to 8 A method according to any one of the embodiments shown.

[0268] According to the method provided in the embodiment of the present application, the embodiment of the present application also provides a computer storage medium, which stores a computer program or instruction, and when the computer program or instruction is run on a computer, the computer executes Figures 1 to 8 A method according to any one of the embodiments shown.

[0269] According to the method provided in the embodiment of the present application, the embodiment of the present application also provides an electronic device. The electronic device includes but is not limited to mobile phones, tablet computers, personal computers, workstation devices, large-screen devices (e.g., smart screens, smart TVs, etc.), handheld game consoles, home game consoles, virtual reality devices, augmented reality devices, mixed reality devices, in-vehicle smart terminals, etc. The electronic device may include the screen sound device protection device provided in the above embodiment of the present application.

[0270] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, device modules and electronic devices can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0271] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0272] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0273] In addition, each functional module in each embodiment of the present application may be integrated into one processing unit, or each module may exist physically separately, or two or more modules may be integrated into one unit.

[0274] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0275] The screen sound device protection device, system, processing device, chip, computer storage medium, computer program product, and electronic device provided in the above-mentioned embodiments of the present application are all used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the corresponding beneficial effects of the method provided above, and will not be repeated here.

[0276] It should be understood that in each embodiment of the present application, the execution order of each step should be determined by its function and internal logic, and the size of the sequence number of each step does not mean the order of execution and does not limit the implementation process of the embodiment.

[0277] Each part of this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the embodiments of the screen sound device protection device, system, chip, computer storage medium, computer program product, and electronic device, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

[0278] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0279] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A method for protecting a screen sound-generating device, characterized in that: Applied to an electronic device, the electronic device includes a screen sound-generating device, and the method includes: Acquire a first audio signal and state parameters of the screen sound-generating device; Based on the first audio signal, determining a frequency parameter of each frequency point in the first audio signal; Based on the state parameter, determining the protection threshold of each frequency point; In the case where the first audio signal includes at least one excess frequency point, determining a first filtering parameter corresponding to each excess frequency point based on a frequency parameter of the excess frequency point and a protection threshold of the excess frequency point; wherein the frequency parameter of the excess frequency point is greater than the protection threshold of the excess frequency point; Based on the first filtering parameters corresponding to the excess frequency points, filtering the first audio signal to reduce the frequency parameters of the excess frequency points; Based on the filtered first audio signal, the first audio is played through the screen sound device.

2. The method according to claim 1, characterized in that: The determining, based on the state parameter, the protection threshold of each frequency point includes: Determining, based on the state parameter, a frequency band protection threshold corresponding to each frequency band in the first audio signal; The frequency band protection threshold of the frequency band where each frequency point is located is determined as the protection threshold of each frequency point.

3. The method according to claim 1, characterized in that The determining, based on the state parameter, the protection threshold of each frequency point includes: Based on the state parameter, determining a standard protection threshold value for each frequency band in the first audio signal; wherein the standard protection threshold value is obtained based on a test of a standard screen sound-generating device; Determine a gain parameter of the screen sound device, wherein the gain parameter includes a plurality of frequency bands and a compensation gain corresponding to each of the frequency bands; wherein the compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response of the standard screen sound device; Determining a frequency band protection threshold corresponding to each frequency band based on the standard protection threshold and the gain parameter; The frequency band protection threshold of the frequency band where each frequency point is located is determined as the protection threshold of each frequency point.

4. The method according to any one of claims 1 to 3, characterized in that The determining, based on the frequency point parameters of the excess frequency points and the protection thresholds of the excess frequency points, the first filtering parameters corresponding to the excess frequency points comprises: Determining a protection gain of each of the excess frequency points based on the frequency parameters of the excess frequency points and the protection threshold of the excess frequency points; Based on the protection gains of the excess frequency points, a first filtering parameter corresponding to each of the excess frequency points is determined.

5. The method according to claim 4, characterized in that The determining, based on the frequency parameter of the excess frequency point and the protection threshold of the excess frequency point, the protection gain of each excess frequency point comprises: The difference between the excess frequency point and the protection threshold is determined as the protection gain corresponding to each of the excess frequency points.

6. The method according to claim 4, characterized in that The determining, based on the frequency parameter of the excess frequency point and the protection threshold of the excess frequency point, the protection gain of each excess frequency point comprises: Determine the super-value frequency band corresponding to each of the super-value frequency points; Determine the maximum protection gain corresponding to each of the excess frequency bands; the maximum protection gain is the maximum value of the protection gain of each of the excess frequency points in the excess frequency band, and the protection gain is the difference between the excess frequency point and the protection threshold; The maximum protection gain is determined as the protection gain of each of the excess frequency points in each of the excess frequency bands.

7. The method according to claim 6, characterized in that The determining of the first filtering parameter corresponding to each of the excess frequency points includes: Based on the maximum protection gain, determining the filtering parameters corresponding to each of the excess frequency bands; The filtering parameters of the super-value frequency band where each of the super-value frequency points is located are determined as the first filtering parameters corresponding to each of the super-value frequency points.

8. The method according to claim 1, characterized in that The method further comprises: Determine a gain parameter of the screen sound device, wherein the gain parameter includes a plurality of frequency bands and compensation gains corresponding to the plurality of frequency bands; wherein the compensation gain is used to characterize the difference between the frequency response corresponding to the screen sound device and the standard frequency response; Based on the gain parameter, determining a compensation gain for each frequency band in the first audio signal; Determining a second filtering parameter based on the compensation gain of each frequency band; Based on the second filtering parameter, the first audio signal is filtered so that a frequency response corresponding to the filtered first audio signal meets the standard frequency response.

9. The method according to claim 3 or 8, characterized in that: The step of determining a gain parameter of the screen sound generating device comprises: Based on the state parameters, a gain parameter of the screen sound emitting device is determined.

10. The method according to claim 1, characterized in that The electronic device further includes a coil-type speaker, and the method further includes: Acquire a second audio signal; modifying the second audio signal based on the first filtering parameter; Based on the modified second audio signal, the second audio is played through the coil type speaker.

11. The method according to claim 1, characterized in that: The frequency point parameter is an energy value or an amplitude.

12. The method according to claim 1, characterized in that The state parameters include parameters that affect the load and / or frequency response of the screen sound device, and the state parameters include at least one of the temperature of the screen sound device, the power of the electronic device, the feedback voltage of the screen sound device, and the feedback current of the screen sound device.

13. The method according to claim 12, characterized in that The method further comprises: Based on the feedback voltage and / or the feedback current, detecting failure of the screen sound-generating device; When the screen sound device fails, the playback link of the screen sound device is controlled to be disconnected.

14. A screen sound device protection device, characterized in that: The device comprises: An acquisition module, used to acquire the first audio signal and the state parameters of the screen sound-generating device; a frequency parameter determination module, configured to determine frequency parameters of each frequency point in the first audio signal based on the first audio signal; A protection threshold determination module, used to determine the protection threshold of each frequency point based on the state parameter; A first filtering parameter determination module is used to determine, when the first audio signal includes at least one excess frequency point, a first filtering parameter corresponding to each excess frequency point based on a frequency parameter of the excess frequency point and a protection threshold of the excess frequency point; wherein the frequency parameter of the excess frequency point is greater than the protection threshold of the excess frequency point; a filtering module, configured to filter the first audio signal based on the first filtering parameters corresponding to the excess frequency points, so as to reduce the frequency parameters of the excess frequency points; The audio playing module is used to play the first audio through the screen sound device based on the filtered first audio signal.

15. An electronic device, characterized in that: It comprises a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, the computer program code comprises computer instructions, and when the processor executes the computer instructions, the electronic device executes the method as described in any one of claims 1-13.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program or instruction. When the computer program or instruction is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 13.

Citation Information

Patent Citations

  • Adjusting the perceived elevation of an audio image on a solid cinema screen

    CN109391895A

  • Screen sounding equipment and method

    CN111984220A

  • Audio playing method, failure detection method of screen sounding device and electronic equipment

    CN115686425A

  • Method and system of acoustic dereverberation factoring the actual non-ideal acoustic environment

    US20180240471A1