Loudspeaker control method and apparatus, electrical appliance and computer readable storage medium

Abstract

The application provides a loudspeaker control method and device, a television and a computer readable storage medium. The method comprises: if a hearing detection instruction issued by a current user is acquired, playing hearing detection audio of different frequency bands; acquiring hearing feedback information of the current user for the hearing detection audio of different frequency bands; generating a hearing curve corresponding to the current user according to the hearing feedback information; and controlling audio playing of the loudspeaker according to the hearing curve. The loudspeaker control method provided by the application can judge the hearing condition of the user for different audio according to the sound feedback of the user in different audio, so that a unique sound signal that can be clearly heard by the user can be generated according to the hearing feedback information of the user for different sound frequency bands, and finally the loudspeaker plays the sound signal that can be clearly heard by the user. Therefore, the application can solve the problem that people with hearing impairment cannot hear clearly, and effectively improves the sound playing effect.

Description

Technical Field

[0001] This application relates to the field of electrical appliances, specifically to a loudspeaker control method, apparatus, electrical equipment, and computer-readable storage medium. Background Technology

[0002] With the widespread application of computers in home appliances, various appliances have become intelligent, enabling the real-time implementation of sound signal processing algorithms on different appliances, such as televisions and stereos with speakers. However, current technology for the sound output of these speaker-equipped appliances is based on the assumption that the user has normal hearing. Its purpose is to provide users with different auditory experiences, such as "standard sound," "cinema mode," "music mode," "sports mode," "Dolby sound," "bass emphasis," and "treble emphasis." However, "being able to hear clearly" is a crucial need for people with hearing impairments, yet this has not been addressed. Therefore, how to enable people with hearing impairments to clearly hear the sounds emitted from speakers has become a problem that needs to be solved. Summary of the Invention

[0003] This application provides a speaker control method that can adjust parameters such as frequency of different audio based on user feedback, so that users who are not sensitive to audio can also hear the audio.

[0004] In a first aspect, this application provides a speaker control method, the method comprising:

[0005] If a hearing test command is received from the current user, play hearing test audio in different frequency bands;

[0006] Obtain the hearing feedback information of the current user for the hearing test audio of the different frequency bands;

[0007] Based on the hearing feedback information, a hearing curve corresponding to the current user is generated;

[0008] The audio playback from the speaker is controlled based on the hearing curve.

[0009] In some embodiments of this application, obtaining the hearing feedback information of the current user for the hearing test audio of the different frequency bands includes:

[0010] Using one of the hearing test audios from the different frequency bands as the target hearing test audio, the system detects whether the current user provides corresponding hearing feedback information in response to the target hearing test audio.

[0011] If the corresponding hearing feedback information is not detected, re-detect whether the current user provides the corresponding hearing feedback information to the target hearing detection audio.

[0012] If the corresponding hearing feedback information is detected, detect whether the target user responds to the hearing feedback information corresponding to the next hearing test audio feedback;

[0013] The process continues until every single hearing test audio in the different frequency bands has been tested, and then the current user's hearing feedback information for the hearing test audio in the different frequency bands is obtained.

[0014] In some embodiments of this application, controlling the audio playback of the speaker according to the hearing curve includes:

[0015] Analyze the hearing curve to obtain the gain frequency point and the loss frequency point;

[0016] If the audio to be played by the current user is obtained, the frequency points in the audio that are the same as the gain frequency point are amplified to obtain amplified audio;

[0017] Audio compression is performed on the frequency points in the played audio that are the same as the loss frequency points to obtain compressed audio;

[0018] The speaker's audio playback is controlled based on the amplified audio and the compressed audio.

[0019] In some embodiments of this application, controlling the audio playback of the speaker based on the amplified audio and the compressed audio includes:

[0020] The amplified audio and the compressed audio are subjected to delay alignment processing to obtain delayed aligned playback audio;

[0021] The audio playback of the speaker is controlled according to the time-aligned audio playback.

[0022] In some embodiments of this application, controlling the audio playback of the speaker according to the time-aligned audio playback includes:

[0023] Calculate the sound pressure levels of the delayed-aligned audio playback;

[0024] By aligning the sound pressure inputs of the delayed playback audio with preset sound pressure input-output curves, the sound pressure processed playback audio is obtained.

[0025] The audio is played according to the sound pressure processing, and the audio playback of the speaker is controlled.

[0026] In some embodiments of this application, the step of controlling the audio playback of the speaker based on the sound pressure processing includes:

[0027] The sound pressure level processed audio is subjected to a fidelity enhancement process to obtain fidelity-enhanced audio.

[0028] The audio is controlled to be played through the speaker.

[0029] In some embodiments of this application, before playing hearing test audio of different frequency bands upon receiving a hearing test command from the current user, the method further includes:

[0030] Detect whether the current user has issued the hearing test command;

[0031] If the current user does not issue the hearing detection command, the speaker is controlled to play audio in the default mode.

[0032] Secondly, this application also provides a loudspeaker control device, the device comprising:

[0033] The playback module is used to play hearing test audio in different frequency bands if it receives a hearing test command from the current user.

[0034] The acquisition module is used to acquire the hearing feedback information of the current user for the hearing test audio of the different frequency bands;

[0035] The generation module is used to generate a hearing curve based on the hearing feedback information;

[0036] The control module is used to control the audio playback of the speaker according to the hearing curve.

[0037] In some embodiments of this application, the acquisition module is specifically used for:

[0038] Using one of the hearing test audios from the different frequency bands as the target hearing test audio, the system detects whether the current user provides corresponding hearing feedback information in response to the target hearing test audio.

[0039] If the corresponding hearing feedback information is not detected, re-detect whether the current user provides the corresponding hearing feedback information to the target hearing detection audio.

[0040] If the corresponding hearing feedback information is detected, detect whether the target user responds to the hearing feedback information corresponding to the next hearing test audio feedback;

[0041] The process continues until every single hearing test audio in the different frequency bands has been tested, and then the current user's hearing feedback information for the hearing test audio in the different frequency bands is obtained.

[0042] In some embodiments of this application, the control module is specifically used for:

[0043] Analyze the hearing curve to obtain the gain frequency point and the loss frequency point;

[0044] If the audio to be played by the current user is obtained, the frequency points in the audio that are the same as the gain frequency point are amplified to obtain amplified audio;

[0045] Audio compression is performed on the frequency points in the played audio that are the same as the loss frequency points to obtain compressed audio;

[0046] The speaker's audio playback is controlled based on the amplified audio and the compressed audio.

[0047] In some embodiments of this application, the control module is further configured to:

[0048] The amplified audio and the compressed audio are subjected to delay alignment processing to obtain delayed aligned playback audio;

[0049] The audio playback of the speaker is controlled according to the time-aligned audio playback.

[0050] In some embodiments of this application, the control module is further configured to:

[0051] Calculate the sound pressure levels of the delayed-aligned audio playback;

[0052] By aligning the sound pressure inputs of the delayed playback audio with preset sound pressure input-output curves, the sound pressure processed playback audio is obtained.

[0053] The audio is played according to the sound pressure processing, and the audio playback of the speaker is controlled.

[0054] In some embodiments of this application, the control module is further configured to:

[0055] The sound pressure level processed audio is subjected to a fidelity enhancement process to obtain fidelity-enhanced audio.

[0056] The audio is controlled to be played through the speaker.

[0057] Thirdly, this application also provides an electrical device, the electrical device including a speaker, a processor, a memory, and a computer program stored in the memory and executable on the processor, the processor executing the computer program to implement the steps in any of the speaker control methods described above.

[0058] Fourthly, this application also provides a computer-readable storage medium storing a computer program that is executed by a processor to implement the steps of any of the speaker control methods described above.

[0059] The speaker control method provided in this application can determine a user's hearing level for different audio frequencies based on the user's sound feedback. It can then generate a unique sound signal that the user can hear clearly based on this feedback, ultimately controlling the speaker to play the same clear sound signal. Therefore, this application can solve the problem of hearing impairment in people and effectively improve the sound playback quality. Attached Figure Description

[0060] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0061] Figure 1 This is a schematic diagram of a scenario for the loudspeaker control system provided in an embodiment of this application;

[0062] Figure 2 This is a schematic flowchart of one embodiment of the speaker control method in this application;

[0063] Figure 3 This is a schematic diagram of the sound pressure input-output curve of the loudspeaker control method in an embodiment of this application;

[0064] Figure 4 This is a schematic diagram of a functional module of the speaker control device in an embodiment of this application;

[0065] Figure 5 This is a schematic diagram of the electrical equipment in the embodiments of this application. Detailed Implementation

[0066] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0067] In the description of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0068] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0069] This application provides a speaker control method, apparatus, television set, and computer-readable storage medium, which are described in detail below.

[0070] First, let's introduce some concepts that appear in this application:

[0071] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0072] In the description of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0073] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0074] This application provides a speaker control method, apparatus, television set, and computer-readable storage medium, which are described in detail below.

[0075] First, let's introduce some concepts that appear in this application:

[0076] Hearing threshold: Hearing threshold, also known as the minimum audible level, is the lowest sound intensity that the human ear can just hear, or the lowest sound intensity required for a person to distinguish the presence of a sound. Because the normal hearing threshold is not a fixed value, and the hearing threshold varies at different frequencies, for ease of measurement, the reference equivalent threshold sound pressure level (RETSPL)—that is, the sound pressure level corresponding to the median (median) hearing threshold of a sufficient number of normal otolaryngologists aged 18-25 years in a specified signal, specified sound delivery method, and within a specified acoustic coupling cavity—is artificially defined as the "0" reference for hearing threshold.

[0077] Sound pressure level: From the weakest audible sound to a sound strong enough to cause pain, the absolute value of sound intensity differs by a factor of ten quadrillion. Clearly, expressing sound volume using absolute sound intensity is inconvenient. For ease of application, based on the human ear's response to changes in sound intensity, a logarithmic quantity was derived to represent sound volume—this is sound intensity level. The square of sound pressure is proportional to sound intensity, so sound intensity level can be converted to sound pressure level. In air, the reference sound pressure level p is generally taken as 2E-5 Pa (frequency 1kHz). This value is the sound pressure level at which a normal human ear can just barely detect a mechanical wave with a wavelength of 1.4m (250Hz), which is the minimum audible sound pressure level for a mechanical wave with a wavelength of 1.4m (250Hz). Generally speaking, below this sound pressure level, the human ear can no longer detect the mechanical wave. Obviously, the sound pressure level of this audible threshold sound pressure is zero decibels.

[0078] Please see Figure 1 , Figure 1 This is a schematic diagram of a speaker control system provided in an embodiment of this application. The speaker control system may include an electrical device 100 and a storage device 200, and the storage device 200 may transmit data to the electrical device 100. Figure 1 The electrical device 100 in the storage device 200 can obtain user feedback information on each audio value stored in the storage device 200 to execute the speaker control method in this application.

[0079] In this embodiment of the application, the electrical equipment 100 includes, but is not limited to, flat-screen TVs, CRT (Cathode Ray Tube) TVs, rear-projection TVs, projection TVs, and other electrical equipment that can be equipped with speakers.

[0080] In the embodiments of this application, the electrical device 100 and the storage device 200 can communicate through any communication method, including but not limited to mobile communication based on the 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), and Worldwide Interoperability for Microwave Access (WiMAX), or computer network communication based on the TCP / IP Protocol Suite (TCP / IP) and User Datagram Protocol (UDP).

[0081] It should be noted that, Figure 1The schematic diagram of the loudspeaker control system shown is merely an example. The loudspeaker control system and scenario described in this application are intended to more clearly illustrate the technical solutions of this application and do not constitute a limitation on the technical solutions provided in this application. As those skilled in the art will know, with the evolution of loudspeaker control systems and the emergence of new business scenarios, the technical solutions provided in this application are also applicable to similar technical problems.

[0082] like Figure 2 As shown, Figure 2 This is a schematic flowchart of one embodiment of the loudspeaker control method in this application. The loudspeaker control method may include the following steps 201 to 204:

[0083] 201. If a hearing test command is received from the current user, play hearing test audio of different frequency bands.

[0084] In specific application scenarios, without a hearing test, it's impossible to know the user's hearing ability, and therefore impossible to control the speaker based on that ability. Therefore, a hearing test is necessary before obtaining information about the user's hearing.

[0085] Generally speaking, speakers don't exist independently; they are usually attached to other devices, such as stereos or televisions, that need to play sound. Taking a television as an example, when the television is turned on, it may prompt the user on the display panel whether they want to take a hearing test. At this time, the user can click the corresponding button on the television remote control, select the OK button, and start the hearing test.

[0086] After the user selects to enable the hearing test, the different frequency bands of the hearing test audio stored on the TV will be played one by one. Modern TVs can also be equipped with an app, so the hearing test audio can also be played through the app installed on the TV. If using an app to play the hearing test audio, a mobile phone can be used instead of a remote control to control the app. The specific method of playing the audio can be set according to the specific situation and is not limited here.

[0087] 202. Obtain the hearing feedback information of the current user for hearing test audio of different frequency bands.

[0088] Because different users have varying abilities to recognize different frequency bands, especially those with hearing impairments, some users may not be able to hear certain frequency ranges clearly or at all. For example, some users might be able to hear frequencies between 20Hz and 1000Hz, or 2000Hz and 4000Hz, but not other frequencies. Therefore, it's necessary to play audio from different frequency bands. It's important to note that these different frequency band audio files can be multiple or a single file. When there's only one file, it simply consists of a single audio file with increasing frequency. If there are multiple files, each audio file is played sequentially, and user feedback is collected for each band. Playing multiple audio files of different frequency bands allows for feedback to be collected after each file is played. This method is more accurate than playing a single, continuous audio file with increasing frequency.

[0089] Simultaneously, when playing hearing test audio in different frequency bands, such as the 20Hz-1000Hz band, the sound decibel level needs to be increased gradually to detect the user's hearing threshold in this frequency range and obtain the lowest audible decibel level within that band. Similarly, each test audio is played in ascending order of decibel level to obtain the hearing threshold for each different frequency band. This allows us to observe that during a hearing test in the 20Hz-1000Hz range, the user may initially be unable to hear the audio at the initial decibel level, but gradually become able to hear it as the decibel level increases.

[0090] In addition, when playing audio from different frequency bands, after each audio track is played, the TV screen will display a message indicating whether the audio can be heard. Users can then select whether the audio can be heard or not using the corresponding buttons on the TV remote, thus transmitting auditory feedback information to the TV.

[0091] Therefore, in order to better implement the embodiments of this application, in one embodiment of this application, obtaining the hearing feedback information of the current user for hearing test audio of different frequency bands may include the following steps 2021-2024:

[0092] 2021. Using one hearing test audio from different frequency bands as the target hearing test audio, detect whether the current user provides corresponding hearing feedback information in response to the target hearing test audio.

[0093] As shown in step 202 above, collecting user hearing feedback is more convenient and accurate when multiple audio files are played. Therefore, it is sufficient to play audio files of different frequency bands one by one. It should be noted that user feedback on different audio files can also be provided using the feedback method described in step 202 above.

[0094] 2022. If no corresponding hearing feedback information is detected, re-detect whether the current user has provided corresponding hearing feedback information to the target hearing test audio.

[0095] Sometimes, after a hearing test audio clip finishes playing, the user may not immediately provide feedback, requiring a certain period of waiting. Therefore, if no user feedback is received, the test needs to be repeated to prevent unpredictable errors from occurring if the system fails to receive user feedback after the user has completed the test.

[0096] 2023. If the corresponding hearing feedback information is detected, check whether the target user has responded to the hearing feedback information corresponding to the next hearing test audio feedback.

[0097] Once user feedback on the currently playing hearing test audio is detected, since there are multiple audio tracks, the remaining audio tracks need to be played to obtain user feedback on all of them. It's important to note that previously played audio tracks are not replayed.

[0098] 2024. Until every hearing test audio in different frequency bands has been tested, obtain the current user's hearing feedback information for the hearing test audio in different frequency bands.

[0099] Once each hearing test audio is completed, the user's hearing feedback information for each audio can be obtained, such as hearing feedback information for 20Hz-1000Hz, hearing feedback information for 1001Hz-3000Hz, etc. This allows us to clearly know which frequency bands the user can hear and which frequency bands they cannot hear.

[0100] It should be noted that when playing audio in different frequency bands, each audio needs to be played in order of increasing volume from low to high. The purpose is the same as in step 202 above, which is to discover the user's hearing threshold in each frequency band.

[0101] 203. Generate the hearing curve corresponding to the current user based on the hearing feedback information.

[0102] To facilitate the analysis of different hearing feedback information, the frequencies in the hearing test video can be arranged from smallest to largest. Based on the user's hearing feedback on different frequency bands, audible frequencies are represented by 1, and inaudible frequencies by 0, thus forming a hearing curve corresponding to the current user. Simultaneously, the hearing thresholds of the sound frequency bands that the current user can hear are marked.

[0103] 204. Control the audio playback of the speaker according to the hearing curve.

[0104] Once the corresponding hearing curve is generated, the speaker can be controlled based on this curve to play audio in the frequency range that the user can hear. For example, if the user cannot hear sounds between 20Hz and 1000Hz, the audio to be played can be detected, and the 20Hz-1000Hz range can be processed. For instance, the frequency of the 20Hz-1000Hz sound can be increased to above 1000Hz, so that the user can hear sounds below 1000Hz.

[0105] Alternatively, if a user cannot hear something at 20 decibels in the 20-1000Hz frequency range, but can hear it at 25 decibels in the 20-1000Hz frequency range, then when the audio to be played contains sounds in the 20-1000Hz frequency range below 25 decibels, raising all sounds in the 20-1000Hz frequency range to above 25 decibels will make it audible to the user.

[0106] To better implement the embodiments of this application, in one embodiment, controlling the audio playback of the speaker according to the hearing curve includes:

[0107] Analyze the hearing curve to obtain the gain and loss frequency points; if the audio to be played by the current user is obtained, amplify the frequency points in the audio that are the same as the gain frequency points to obtain amplified audio; compress the frequency points in the audio that are the same as the loss frequency points to obtain compressed audio; control the audio playback of the speaker based on the amplified and compressed audio.

[0108] As can be seen from the above embodiments, a user's hearing threshold may differ in different frequency bands. Therefore, based on users who have undergone hearing tests, their specific hearing thresholds in different frequency bands can be obtained. Since this has already been explained in the above embodiments, it will not be repeated here.

[0109] However, it should be noted that excessively loud noise may damage a user's hearing. Since the hearing test mentioned above reveals the user's specific hearing threshold in different audio frequency ranges, the volume of the sound can be appropriately reduced when excessively loud noise occurs, in order to protect the user's hearing.

[0110] Sounds with frequencies exceeding a certain level and decibel levels exceeding a certain level require compression. These types of sounds are represented as gain frequencies in a hearing curve. For example, if a user has a hearing threshold above 20 decibels in the 15000Hz-17000Hz range and no hearing threshold in the 17001Hz-20000Hz range (meaning they cannot hear any sound in this frequency band regardless of its decibel level), and the currently playing audio contains sounds in the 17001Hz-20000Hz range at 70 decibels, then the 70 decibel sound in the 17001Hz-20000Hz range can be appropriately gain-compressed. This would reduce the frequency of the 17001Hz-20000Hz sound to between 15000Hz and 17000Hz, and lower the decibel level from 70 to above 20 decibels.

[0111] Similarly, sounds with frequencies below a certain level and decibel levels below a certain level require amplification; these sounds are represented as gain frequencies in an audiometry chart. The amplification method is the same as the compression method described above for loss frequencies, but in reverse; details will not be elaborated here. After amplifying and compressing the audio to be played, the speaker can be controlled to play the processed audio.

[0112] However, in some cases, when the audio to be played is amplified and compressed, the sound may become misaligned, so it is necessary to align the sound.

[0113] Therefore, in order to better implement the embodiments of this application, in one embodiment of this application, controlling the audio playback of the speaker according to amplified audio and compressed audio includes:

[0114] The amplified and compressed audio are processed with delay alignment to obtain delayed-aligned playback audio; the audio playback of the speaker is controlled according to the delayed-aligned playback audio.

[0115] When performing time-delay alignment, you can find the time points in each audio file that has undergone gain or loss processing that need to be aligned, and then align them sequentially according to the order of their arrangement on the timeline.

[0116] However, when performing time alignment on multiple processed sounds, since even after time alignment at a selected location, time differences may still exist at other locations covered by the two sounds, the Haas effect can be introduced. Considering the Haas priority effect, we need to consider a range to set the delay alignment, for example: ΔSPL (sound pressure level difference) ≤ 10dB, ΔDelay ≤ 15~25ms (here we take 20ms, ms is millisecond). That is, when the SPL difference between two sounds is within 10dB, and the arrival time difference is within 20ms, we consider there to be no delay, or a delay that is negligible; in fact, most people cannot hear this delay. When the SPL difference between two sounds is within 10dB, and the arrival time difference is greater than 20ms, we consider the delay to require corresponding alignment. When the ΔSPL between two sounds is greater than 10dB, regardless of the ΔDelay, it can be considered "no delay".

[0117] After the delay processing is performed, the audio that needs to be played through the TV's speakers can be controlled.

[0118] However, as can be seen from the above embodiments, it is necessary to perform gain or loss processing on the sound, including decibel processing of the audio to be played, i.e., sound pressure processing. In order to improve the accuracy of sound pressure processing, in one embodiment of this application, the audio playback of the speaker is controlled according to the delay alignment of the audio playback, including:

[0119] Calculate the sound pressure levels of the delayed-aligned audio playback; input the sound pressure levels of the delayed-aligned audio playback into a preset sound pressure input-output curve to obtain the sound pressure-processed playback audio; control the audio playback of the speaker according to the sound pressure-processed playback audio.

[0120] The sound pressure input-output curves in the embodiments of this application can be as follows: Figure 3 As shown, this uses sound in the 20Hz-1000Hz frequency band to... Figure 3 The sound pressure input and output curves in the diagram are used to illustrate this. Figure 3 From the silent zone, if the audio to be played contains a sound A, and sound A is between 20Hz and 1000Hz and less than 20 decibels, then the sound is considered silent if the x-axis value is less than 20. Figure 3 When x2 is reached, sound A is reduced to 0 dB; if there exists a sound B, which is still between 20Hz and 1000Hz, but its decibel level is between 20 and 35 dB, that is, when the x-coordinate of sound B is between x2 and x3, according to... Figure 3The curve in the diagram can be used to amplify the decibel level of sound B. If there exists a sound C, still ranging from 20Hz to 1000Hz, but with a decibel level between 26 and 80 decibels (i.e., the x-coordinate of sound C is between x3 and x4), then according to... Figure 3 The curve in the diagram can be used to compress the decibel level of sound C. If there exists a sound D, which is still between 20Hz and 1000Hz, but its decibel level is above 81 decibels (i.e., the horizontal coordinate of sound D is between x4 and x5), then sound D can be uniformly output at 100 decibels. This allows for sound pressure level control of the output sound, enabling the speaker to play the audio according to the adjusted sound pressure level. Similarly, the sound pressure output method for different audio frequency bands is the same as the output method in the embodiments of this application, and will not be elaborated further here.

[0121] The output method for calculating sound pressure can be obtained from the curve mentioned above, or it can be calculated using the following formula:

[0122]

[0123] SPL = 20 × log 10 (rms)……②

[0124] In formula ①, n represents the sequence number of sound wave sampling points in a sound wave; for example, when n is 100, it represents the 100th sampling point. N is the total number of sampling points. 2 (n) represents the sound wave value at the nth sampling point. Additionally, SPL represents the output sound pressure level, or decibels.

[0125] Once the sound pressure level of the audio to be played is determined, the TV speakers can be controlled to play the audio according to the sound pressure level.

[0126] However, sometimes, even after sound pressure processing, the energy changes in the audio are still not stable enough and appear discontinuous. The root mean square (RMS) energy changes in each frame cannot reflect the true rate of change in speech, causing significant distortion. Here, the RMS energy of each frame is the result calculated in formula ① above. Therefore, to better implement the embodiments of this application, in one embodiment, playing audio based on sound pressure processing and controlling the audio playback of the speaker includes:

[0127] The sound pressure level processed audio is subjected to a fidelity enhancement process to obtain fidelity playback audio; the fidelity playback audio is then controlled to be played through a speaker.

[0128] Since the distortion problem is related to the calculation results in formula ① above, specifically the root mean square of energy, the root mean square of energy for each frame (i.e., each sampling point at n) is treated as a time series. A moving average is then applied to the series to smooth the rate of change. The gain calculated from the smoothed root mean square of energy is then used to adjust the data for each frame. This essentially produces a sound with dynamic changes similar to normal speech, reducing signal distortion.

[0129] Once the distortion problem is resolved, the device equipped with a speaker can save the current hearing test results and control the speaker to play the corrected audio based on those results.

[0130] The speaker control method provided in this application can determine a user's hearing level for different audio frequencies based on the user's sound feedback. It can then generate a unique sound signal that the user can hear clearly based on this feedback, ultimately controlling the speaker to play the same clear sound signal. Therefore, this application can solve the problem of hearing impairment in people and effectively improve the sound playback quality.

[0131] To better implement the embodiments of this application, in one embodiment of this application, before playing hearing test audio of different frequency bands after obtaining the hearing test command issued by the current user, the method further includes:

[0132] Detect whether the current user has issued a hearing test command; if the current user has not issued a hearing test command, control the speaker to play audio in the default mode.

[0133] In real-world usage scenarios, such as television being typically used by a single household, multiple users may be using the same television. Therefore, users without hearing impairments do not need to undergo hearing tests; conversely, users with hearing impairments who have already undergone hearing tests and do not require further testing do not need to undergo another hearing test.

[0134] If the above embodiment is still followed, when the user turns on the TV, the TV screen will prompt the user whether a hearing test is required. If the user selects no, the TV will directly play audio in the default mode.

[0135] It should be noted that the default mode here can be either the normal audio playback mode of the TV or the audio playback mode based on the hearing test results. When the user does not perform a hearing test, the TV can switch to the audio playback mode selection interface. As shown in the above embodiment, the TV saves the hearing test results for users who have completed the test. Therefore, the next time the user uses the TV, they do not need to perform a hearing test again; they can directly select to play audio based on the previously saved hearing test results. In other words, when the user does not choose to perform a hearing test, they can choose to play audio normally or according to the previous hearing test results.

[0136] To better implement the speaker control method in the embodiments of this application, a speaker control device is also provided in the embodiments of this application, such as... Figure 4 As shown, the device 400 includes:

[0137] The playback module 401 is used to play hearing test audio of different frequency bands if it receives a hearing test command issued by the current user.

[0138] The acquisition module 402 is used to acquire the hearing feedback information of the current user's hearing test audio for different frequency bands;

[0139] The generation module 403 is used to generate a hearing curve based on the hearing feedback information;

[0140] The control module 404 is used to control the audio playback of the speaker according to the hearing curve.

[0141] The speaker control device provided in this application can first perform a hearing test on the user using the playback module 401, and then acquire the user's sound feedback on different audio frequencies using the acquisition module 402, thereby determining the user's hearing level for different audio frequencies. Based on the user's hearing feedback information for different audio frequencies, the generation module 403 generates a hearing curve, that is, generates a unique sound signal that the user can hear clearly. Finally, the control module 404 controls the speaker to play the sound signal that the user can hear clearly. Therefore, this application can solve the problem of hearing impairment for people with hearing loss and effectively improve the sound playback effect.

[0142] In some embodiments of this application, the acquisition module 402 is specifically used for:

[0143] Using one hearing test audio from different frequency bands as the target hearing test audio, the system detects whether the current user provides corresponding hearing feedback information in response to the target hearing test audio.

[0144] If no corresponding hearing feedback information is detected, re-detect whether the current user has given corresponding hearing feedback information to the target hearing test audio.

[0145] If the corresponding hearing feedback information is detected, detect whether the target user responds to the hearing feedback information corresponding to the next hearing test audio feedback;

[0146] The process continues until every single audio recording in the hearing test audio of different frequency bands has been tested, and then the user's hearing feedback information for the different frequency bands is obtained.

[0147] In some embodiments of this application, the control module 404 is specifically used for:

[0148] Analyze the hearing curve to obtain the gain and loss frequency points;

[0149] If the audio to be played by the current user is obtained, the frequency points in the audio that are the same as the gain frequency points are amplified to obtain amplified audio.

[0150] Compress the audio at the frequency points in the played audio that are the same as the loss frequency points to obtain compressed audio;

[0151] Control the audio playback from the speaker by amplifying and compressing the audio.

[0152] In some embodiments of this application, the control module 404 is further configured to:

[0153] The amplified and compressed audio are subjected to delay alignment processing to obtain delayed-aligned playback audio.

[0154] The audio playback is controlled by aligning the audio playback with the delay.

[0155] In some embodiments of this application, the control module 404 is further configured to:

[0156] Calculate the sound pressure levels of the audio to be played with the delay aligned;

[0157] The preset sound pressure input and output curves of each sound pressure input are aligned with the delay to obtain the sound pressure processed playback audio.

[0158] The audio is played based on sound pressure level, controlling the audio playback from the speaker.

[0159] In some embodiments of this application, the control module 404 is further configured to:

[0160] The audio played by sound pressure level processing is subjected to a real-fidelity processing process to obtain a real-fidelity playback audio.

[0161] Control the playback of audio through the speakers.

[0162] This application also provides an electrical device, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor. The processor executes the computer program to implement the steps of the speaker control method according to any one of the embodiments of this application. This electrical device integrates any one of the speaker control methods provided in the embodiments of this application, such as... Figure 5 As shown, it illustrates a structural schematic diagram of the electrical equipment involved in the embodiments of this application. Specifically:

[0163] The electrical device may include components such as a processor 501 with one or more processing cores, a memory 502 with one or more computer-readable storage media, a power supply 503, and an input unit 504. Those skilled in the art will understand that... Figure 5 The electrical equipment structure shown does not constitute a limitation on the electrical equipment and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0164] The processor 501 is the control center of the electrical device. It connects various parts of the device via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 502, and by calling data stored in the memory 502, thereby providing overall monitoring of the electrical device. Optionally, the processor 501 may include one or more processing cores; the processor 501 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor. Preferably, the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and application programs, and the modem processor mainly handles wireless communication. It is understood that the aforementioned modem processor may not be integrated into the processor 501.

[0165] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and data processing by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created based on the use of the electrical device, etc. In addition, the memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.

[0166] The electrical equipment also includes a power supply 503 that supplies power to various components. Preferably, the power supply 503 can be logically connected to the processor 501 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 503 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0167] The electrical device may also include an input unit 504, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0168] The electrical device may also include a speaker 505, which can play corresponding audio based on the audio processed by the processor 501.

[0169] Although not shown, the electrical device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 501 in the electrical device loads the executable files corresponding to the processes of one or more application programs into the memory 502 according to the following instructions, and the processor 501 runs the application programs stored in the memory 502 to realize various functions, such as:

[0170] If a hearing test command is received from the current user, play hearing test audio in different frequency bands;

[0171] Obtain hearing feedback information from the current user's hearing test audio for different frequency bands;

[0172] Based on the hearing feedback information, generate the hearing curve corresponding to the current user;

[0173] The audio playback from the speaker is controlled based on the hearing curve.

[0174] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0175] Therefore, embodiments of this application provide a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the speaker control methods provided in embodiments of this application. For example, the computer program loaded by the processor can execute the following steps:

[0176] If a hearing test command is received from the current user, play hearing test audio in different frequency bands;

[0177] Obtain hearing feedback information from the current user's hearing test audio for different frequency bands;

[0178] Based on the hearing feedback information, generate the hearing curve corresponding to the current user;

[0179] The audio playback from the speaker is controlled based on the hearing curve.

[0180] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.

[0181] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0182] The above provides a detailed description of a speaker control method and apparatus provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A loudspeaker control method, characterized in that, The method includes: If a hearing test command is received from the current user, play hearing test audio in different frequency bands; Obtain the hearing feedback information of the current user for the hearing test audio of the different frequency bands; Based on the hearing feedback information, a hearing curve corresponding to the current user is generated; Analyze the hearing curve to obtain the gain frequency point and the loss frequency point; If the audio to be played by the current user is obtained, the frequency points in the audio that are the same as the gain frequency point are amplified to obtain amplified audio; Audio compression is performed on the frequency points in the played audio that are the same as the loss frequency points to obtain compressed audio; The amplified audio and the compressed audio are subjected to delay alignment processing to obtain delayed aligned playback audio; The audio playback of the speaker is controlled according to the time-aligned audio playback.

2. The loudspeaker control method according to claim 1, characterized in that, The step of obtaining the hearing feedback information of the current user for the hearing test audio of the different frequency bands includes: Using one of the hearing test audios from the different frequency bands as the target hearing test audio, the system detects whether the current user provides corresponding hearing feedback information in response to the target hearing test audio. If the corresponding hearing feedback information is not detected, re-detect whether the current user provides the corresponding hearing feedback information to the target hearing detection audio. If the corresponding hearing feedback information is detected, detect whether the current user has received hearing feedback information corresponding to the next hearing test audio feedback; The process continues until every single hearing test audio in the different frequency bands has been tested, and then the current user's hearing feedback information for the hearing test audio in the different frequency bands is obtained.

3. The loudspeaker control method according to claim 2, characterized in that, The step of controlling the audio playback of the speaker according to the time-aligned audio playback includes: Calculate the sound pressure levels of the delayed-aligned audio playback; By aligning the sound pressure inputs of the delayed playback audio with preset sound pressure input-output curves, the sound pressure processed playback audio is obtained. The audio is played according to the sound pressure processing, and the audio playback of the speaker is controlled.

4. The loudspeaker control method according to claim 3, characterized in that, The step of playing audio based on the sound pressure processing and controlling the audio playback of the speaker includes: The sound pressure level processed audio is subjected to a fidelity enhancement process to obtain fidelity-enhanced audio. The audio is controlled to be played through the speaker.

5. The loudspeaker control method according to claim 1, characterized in that, Before playing hearing test audio of different frequency bands after receiving the hearing test command issued by the current user, the method further includes: Detect whether the current user has issued the hearing test command; If the current user does not issue the hearing detection command, the speaker is controlled to play audio in the default mode.

6. A loudspeaker control device, characterized in that, The device includes: The playback module is used to play hearing test audio in different frequency bands if it receives a hearing test command from the current user. The acquisition module is used to acquire the hearing feedback information of the current user for the hearing test audio of the different frequency bands; The generation module is used to generate a hearing curve based on the hearing feedback information; The control module is used for: Analyze the hearing curve to obtain the gain frequency point and the loss frequency point; If the audio to be played by the current user is obtained, the frequency points in the audio that are the same as the gain frequency point are amplified to obtain amplified audio; Audio compression is performed on the frequency points in the played audio that are the same as the loss frequency points to obtain compressed audio; The amplified audio and the compressed audio are subjected to delay alignment processing to obtain delayed aligned playback audio; The audio playback of the speaker is controlled according to the time-aligned audio playback.

7. An electrical appliance, characterized in that, The electrical device includes a speaker, a processor, a memory, and a computer program stored in the memory and executable on the processor, the processor executing the computer program to implement the steps of the speaker control method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that is executed by a processor to implement the steps of the speaker control method according to any one of claims 1 to 5.

Images