Audio data playing method, device and electronic device

Abstract

The embodiments of the present application provide a method, device, and electronic device for playing audio data, relating to the field of multimedia technology. The method is capable of playing audio data based on the hearing condition of the user listening to the audio data, thereby resolving the problem that the played audio data cannot be properly heard by elderly users or is heard incorrectly. The method includes: collecting a facial image of the user currently using the electronic device; obtaining the user's playback parameters based on the facial image; and adjusting the audio parameters of first audio data in the audio data to be played to a corresponding second value based on the user's playback parameters before playing, where the first audio data is the audio data in the audio data to be played whose audio parameters have the first value.

Description

Technical Field

[0001] The present application relates to the field of multimedia technology, and in particular to a method, device and electronic device for playing audio data. Background Art

[0002] With the popularity of electronic products, more and more users listen to audio data through electronic products. Currently, electronic devices usually play audio data at a fixed frequency and fixed loudness.

[0003] However, the users who listen to audio data played by electronic devices are not fixed, and include young users, elderly users, etc. For young users, their hearing has not declined, and the audio data played by electronic devices at a fixed frequency and loudness can be well heard by young users. For elderly users, due to their hearing decline, the audio data played by electronic devices at a fixed frequency and loudness may not be well heard by them or may be heard incorrectly. Summary of the Invention

[0004] The present application provides a method, device and electronic device for playing audio data, which can play audio data according to the hearing condition of the user listening to the audio data, so as to solve the problem that the played audio data cannot be well heard by the elderly users or is heard incorrectly.

[0005] To achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, the present application provides a method for playing audio data, the method comprising: collecting a facial image of a user currently using an electronic device; obtaining the user's playback parameters based on the facial image; the user's playback parameters comprising: at least one first value and at least one second value of the intermediate frequency of the audio parameters, and at least one first value and at least one second value of the loudness when the electronic device plays the audio data; the audio data played when the audio parameters are the first values ​​cannot meet the user's hearing needs, the second value is the value of the audio parameters adjusted to the corresponding first value to meet the user's hearing needs, the audio parameters comprising: frequency and loudness; according to the user's playback parameters, adjusting the audio parameters of the first audio data in the audio data to be played to the corresponding second values ​​and then playing, the first audio data being the audio data in the audio data to be played whose audio parameters are the first values.

[0007] In the above example, the audio data played by the electronic device when the audio parameter is at the first value cannot meet the user's hearing needs, resulting in a poor user experience. Subsequently, the audio data playback method provided in this application adjusts the first value of the audio parameter so that the audio data played by the electronic device when the audio parameter is at the second value can meet the user's hearing needs. This improves the user experience.

[0008] For example, consider an elderly user currently using an electronic device. Due to hearing loss, audio data played by the electronic device at a fixed frequency and loudness may not be properly heard by the elderly user, or may be heard incorrectly. To address this issue, the present application provides a method for playing audio data. By determining whether audio data played by the electronic device when the audio parameter is at a first value meets the user's hearing needs, the method can determine the first value that does not meet the user's hearing needs. The method then adjusts the first value so that audio data played by the electronic device when the audio parameter is at a second value can meet the user's hearing needs. In this manner, the electronic device captures a facial image of the user currently using the electronic device. If the facial image corresponds to the elderly user, the electronic device obtains the user's playback parameters based on the facial image. Based on the user's playback parameters, the audio parameters of the first audio data in the audio data to be played are adjusted to the corresponding second value before playing. In this way, the electronic device can play audio data based on the hearing condition of the user listening to the audio data, thereby resolving the issue of the elderly user not being able to hear the played audio data properly or hearing it incorrectly.

[0009] In combination with the first aspect, in a possible implementation, the above-mentioned "obtaining the user's playback parameters based on the facial image" includes: when the user is determined to be a new user based on the facial image, performing the following operations for each of all the to-be-tested values ​​of the audio parameter: controlling the electronic device to play audio data multiple times with the to-be-tested value as the audio parameter; receiving feedback data from the user each time the electronic device plays audio data with the to-be-tested value as the audio parameter, the feedback data being used to indicate whether the user can hear clearly the audio data played with the to-be-tested value as the audio parameter; determining, based on the user's multiple feedback data, the probability of the user not hearing clearly the audio data played with the to-be-tested value as the audio parameter; when the user's probability of not hearing clearly is greater than or equal to a first threshold, obtaining a second value corresponding to the to-be-tested value to obtain the user's playback parameters; the to-be-tested value corresponding to the user's probability of not hearing clearly being greater than or equal to the first threshold is the first value.

[0010] In the above example, when the electronic device is playing audio data, it cannot determine the hearing condition of the user who is currently listening to the audio data. Therefore, when the electronic device determines that the user corresponding to the face image is a new user based on the face image, it needs to play the audio data with the value to be tested as the audio parameter multiple times and receive multiple feedback data from the user. And based on the multiple feedback data of the user, it determines the probability that the user did not hear the audio data played with the value to be tested as the audio parameter; when the user's probability of not hearing is greater than or equal to the first threshold, the second value corresponding to the value to be tested is obtained to obtain the user's playback parameters. In this way, the electronic device can play audio data with playback parameters suitable for the user according to the user's hearing condition to ensure the user's experience.

[0011] In combination with the first aspect, in a possible implementation, before receiving user feedback data each time the electronic device plays audio data with the value to be tested as the audio parameter, the audio data playback method provided in the present application also includes: after the electronic device plays the audio data with the value to be tested as the audio parameter, displaying a first prompt window, the first prompt window including a first control and a second control; the first control is used for the user to confirm that he can hear the audio data played with the value to be tested as the audio parameter, and the second control is used for the user to confirm that he cannot hear the audio data played with the value to be tested as the audio parameter; the feedback data is the user's triggering operation on the first control or the second control; based on multiple feedback data from the user, determining the probability that the user did not hear the audio data played with the value to be tested as the audio parameter, including: obtaining the number of times the user triggers the second control based on multiple feedback data from the user; and determining the probability that the user did not hear the audio data based on the number of times the second control is triggered and the total amount of feedback data.

[0012] In the above example, if the electronic device determines based on the facial image that the user is a new user, it can display a first prompt window and, based on the user's triggering of the first and second controls in the first prompt window, determine the user's hearing condition. The electronic device can then play audio data using playback parameters appropriate for the user based on the user's hearing condition, ensuring a superior user experience.

[0013] In combination with the first aspect, in a possible implementation, the above-mentioned "obtaining the user's playback parameters based on the facial image" includes: when the user is determined to be a new user based on the facial image, performing the following operations for each of all the to-be-tested values ​​of the audio parameter: controlling the electronic device to play audio data with the to-be-tested value as the audio parameter multiple times; receiving the trigger operation of the user pressing the volume key for the first time each time the electronic device plays audio data with the to-be-tested value as the audio parameter; the trigger operation is used by the user to confirm that the audio data played with the to-be-tested value is not heard clearly; based on the total number of audio data played with the to-be-tested value as the audio parameter and the total number of trigger operations, determining the probability of the user not hearing the audio data played with the to-be-tested value as the audio parameter; when the user's probability of not hearing clearly is greater than or equal to a first threshold, obtaining a second value corresponding to the to-be-tested value to obtain the user's playback parameter; the to-be-tested value corresponding to the user's probability of not hearing clearly being greater than or equal to the first threshold is the first value.

[0014] In the above example, when the electronic device determines that the user corresponding to the facial image is a new user based on the facial image, it controls the electronic device to play audio data with the value to be tested as the audio parameter for multiple times. Then, by receiving the user's first trigger operation of pressing the volume button each time the audio data is played with the value to be tested as the audio parameter, it can determine the total number of times the user confirms that he cannot hear the audio data played with the value to be tested as the audio parameter. Afterwards, based on the total number of audio data played with the value to be tested as the audio parameter and the total number of trigger operations, the probability of the user not hearing the audio data played with the value to be tested as the audio parameter is determined; when the user's probability of not hearing is greater than or equal to the first threshold, a second value corresponding to the value to be tested is obtained to obtain the user's playback parameters. In this way, the electronic device can play audio data with playback parameters suitable for the user according to the user's hearing condition to ensure the user's experience.

[0015] In combination with the first aspect, in one possible implementation, the above-mentioned "obtaining a second value corresponding to the value to be tested" includes: querying the second value corresponding to the value to be tested in a pre-stored correspondence relationship; or obtaining the second value corresponding to the value to be tested from the server.

[0016] In the above example, the electronic device pre-stores the correspondence between the value to be tested and the second value, so that after the electronic device determines the probability of the user not hearing the audio data played with the value to be tested as the audio parameter, if the user's probability of not hearing is greater than or equal to the first threshold, it can query the second value corresponding to the value to be tested in the pre-stored correspondence. After that, the electronic device can play the audio data with the playback parameters suitable for the user according to the hearing condition of the user, thereby ensuring the user experience. In addition, the electronic device can also obtain the second value corresponding to the value to be tested from the server, so that each time the electronic device needs to obtain the second value corresponding to the value to be tested, it can directly obtain it from the server without having to store all the second values ​​corresponding to the value to be tested locally, thereby reducing the occupancy rate of the internal memory of the electronic device.

[0017] In combination with the first aspect, in a possible implementation, the audio data playback method provided in the present application also includes: when the user is determined to be a new user based on the facial image, the user's facial image and the user's playback parameters are correspondingly stored.

[0018] In the above example, if the electronic device determines that the user corresponding to the facial image is a new user, it will store the user's facial image and the user's playback parameters. This way, the next time the user uses the electronic device, the electronic device can play audio data using playback parameters suitable for the user based on the user's hearing condition, ensuring a better user experience.

[0019] In combination with the first aspect, in one possible implementation, the above-mentioned "obtaining the user's playback parameters based on the facial image" includes: when it is determined based on the facial image that the user is not a new user, obtaining the user's playback parameters locally based on the facial image; wherein the electronic device stores facial images of users who have used the electronic device and corresponding playback parameters.

[0020] In the above example, when the electronic device determines that the user corresponding to the facial image is a new user based on the facial image, it stores the user's facial image and the user's playback parameters accordingly. In this way, the electronic device locally stores the facial image and playback parameters of each user who has used the electronic device. In this way, the next time the user uses the electronic device, the electronic device can determine that the user corresponding to the facial image is not a new user based on the facial image. In this way, the electronic device can obtain the user's playback parameters locally based on the facial image. The electronic device can then play audio data with playback parameters suitable for the user based on the user's hearing condition, ensuring the user experience.

[0021] In a second aspect, the present application provides a device for playing audio data, comprising: an acquisition unit and a processing unit. The acquisition unit is used to acquire a facial image of a user currently using an electronic device; the processing unit is used to obtain the user's playback parameters based on the facial image acquired by the acquisition unit; the user's playback parameters include: at least one first value and at least one second value of the mid-frequency of the audio parameter when the electronic device plays the audio data, and at least one first value and at least one second value of the loudness; the audio data played when the audio parameter is the first value cannot meet the user's hearing needs, and the second value is the value of the audio parameter adjusted to the corresponding first value to meet the user's hearing needs, and the audio parameters include: frequency and loudness; the processing unit is also used to adjust the audio parameters of the first audio data in the audio data to be played to the corresponding second value according to the user's playback parameters, and then play it, and the first audio data is the audio data with the first value of the audio parameter in the audio data to be played.

[0022] In combination with the second aspect, in a possible implementation, the audio data playback device also includes an acquisition unit; a processing unit, specifically used to, when it is determined that the user is a new user based on the facial image collected by the acquisition unit, perform the following operations for each of all the to-be-tested values ​​of the audio parameter: control the electronic device to play audio data with the to-be-tested value as the audio parameter multiple times; receive feedback data from the user each time the electronic device plays audio data with the to-be-tested value as the audio parameter, the feedback data being used to indicate whether the user can hear the audio data played with the to-be-tested value as the audio parameter; the processing unit, specifically used to determine, based on multiple feedback data from the user, the probability of the user not hearing the audio data played with the to-be-tested value as the audio parameter; the processing unit, specifically used to control the acquisition unit to obtain a second value corresponding to the to-be-tested value to obtain the user's playback parameter when the user's probability of not hearing is greater than or equal to a first threshold; the to-be-tested value corresponding to the user's probability of not hearing is greater than or equal to the first threshold is the first value.

[0023] In conjunction with the second aspect, in one possible implementation, the audio data playback device further includes a display unit 104. The processing unit is further configured to control the display unit 104 to display a first prompt window after the electronic device plays the audio data with the value to be tested as the audio parameter, the first prompt window including a first control and a second control; the first control is used for the user to confirm that they can clearly hear the audio data played with the value to be tested as the audio parameter, and the second control is used for the user to confirm that they cannot clearly hear the audio data played with the value to be tested as the audio parameter; the feedback data is the user's triggering operation on the first control or the second control; the processing unit is specifically configured to obtain the number of times the user triggers the second control based on multiple feedback data of the user; and the processing unit is specifically configured to determine the probability of the user not hearing clearly based on the number of times the second control is triggered and the total amount of feedback data.

[0024] In conjunction with the second aspect, in one possible implementation, the audio data playback device further includes an acquisition unit. The processing unit is specifically configured to, when determining that the user is a new user based on the facial image collected by the acquisition unit, perform the following operations for each of all to-be-tested values ​​of the audio parameter: controlling the electronic device to play audio data with the to-be-tested value as the audio parameter multiple times; receiving a trigger operation of the user pressing the volume up key for the first time each time the electronic device plays audio data with the to-be-tested value as the audio parameter; the trigger operation is used by the user to confirm that the audio data played with the to-be-tested value as the audio parameter cannot be heard clearly; the processing unit is specifically configured to determine the user's probability of not hearing the audio data played with the to-be-tested value as the audio parameter based on the total number of audio data played with the to-be-tested value as the audio parameter and the total number of trigger operations; the processing unit is specifically configured to, when the user's probability of not hearing clearly is greater than or equal to a first threshold, control the acquisition unit to obtain a second value corresponding to the to-be-tested value to obtain the user's playback parameter; the to-be-tested value corresponding to the user's probability of not hearing clearly greater than or equal to the first threshold is the first value.

[0025] In conjunction with the second aspect, in one possible implementation, the audio data playback device further includes an acquisition unit. A processing unit is specifically configured to query a pre-stored correspondence for a second value corresponding to the value to be tested; or the processing unit is specifically configured to control the acquisition unit to acquire the second value corresponding to the value to be tested from a server.

[0026] In combination with the second aspect, in a possible implementation, the processing unit is further configured to, when it is determined that the user is a new user based on the facial image collected by the collection unit, correspondingly store the user's facial image and the user's playback parameters.

[0027] In combination with the second aspect, in one possible implementation, the processing unit is specifically used to obtain the user's playback parameters locally based on the facial image collected by the collection unit when it is determined that the user is not a new user based on the facial image collected by the collection unit; wherein the electronic device stores facial images of users who have used the electronic device and corresponding playback parameters.

[0028] In a third aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used to store computer-executable instructions, and when the electronic device is running, the processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the audio data playback method as described in any one of the above-mentioned first aspects.

[0029] In a fourth aspect, an electronic device is provided, comprising: a processor; the processor is configured to be coupled to a memory, and after reading instructions in the memory, execute the audio data playback method as described in any one of the above-mentioned first aspects according to the instructions.

[0030] In a fifth aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer can execute the audio data playing method described in any one of the above-mentioned first aspects.

[0031] In a sixth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the audio data playing method described in any one of the above-mentioned first aspects.

[0032] In a seventh aspect, a device (for example, a chip system) is provided, which includes a processor for supporting an electronic device to implement the functions involved in the first aspect above, such as collecting a facial image of a user currently using the electronic device. In one possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device. When the device is a chip system, it can be composed of a chip, or it can include a chip and other discrete devices.

[0033] Among them, the technical effects brought about by any design method in the third to seventh aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 Schematic diagram of the curve of hearing change of males and females with age in the prior art.

[0035] Figure 2 This is one of the scenario diagrams of a method for playing audio data provided in an embodiment of the present application.

[0036] Figure 3 This is one of the structural diagrams of an electronic device provided in an embodiment of the present application.

[0037] Figure 4 This is a second structural diagram of an electronic device provided in an embodiment of the present application.

[0038] Figure 5 A flowchart of a method for playing audio data provided in an embodiment of the present application.

[0039] Figure 6 The present invention provides a second scenario diagram of a method for playing audio data according to an embodiment of the present application.

[0040] Figure 7 The present invention provides a third scenario diagram of a method for playing audio data provided in an embodiment of the present application.

[0041] Figure 8The fourth scenario diagram of a method for playing audio data provided in an embodiment of the present application.

[0042] Figure 9 This is a third structural diagram of an electronic device provided in an embodiment of the present application.

[0043] Figure 10 A schematic diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0045] As we all know, the pitch of a sound is called its pitch. The factor that determines the pitch of a sound is the frequency of the sound-producing body's vibration. That is, higher frequencies result in higher pitch, while lower frequencies result in lower pitch. The strength of a sound is called its loudness (or, how loud it is perceived). Loudness describes the loudness of a sound, representing the subjective perception of the sound by the human ear. Its unit of measurement is the sone, with 1kHz and a pure tone with a sound pressure level of 40dB being considered 1 sone. Frequency refers to the number of periodic changes per second and is measured in Hertz (Hz). The number of times a sound source vibrates in one second is denoted as f.

[0046] Generally speaking, the decibel value of the minimum audible value of the human ear is about 0-20dB. When the decibel value of the minimum audible value of the human ear is greater than 20dB, it means that the human ear has hearing loss. For example, Figure 1The following graph shows how hearing changes with age for men and women. Taking men as an example: for men over 50, the minimum audible decibel value for sounds with a frequency greater than 6kHz is greater than 20dB, for men over 60, the minimum audible decibel value for sounds with a frequency greater than 3kHz is greater than 20dB, and for men over 70, the minimum audible decibel value for sounds with a frequency greater than 2kHz is greater than 20dB. Taking women as an example: for women over 60, the minimum audible decibel value for sounds with a frequency greater than 6kHz is greater than 20dB, and for women over 70, the minimum audible decibel value for sounds with a frequency greater than 3kHz is greater than 20dB. As can be seen from the above, when men over 50 hear sounds with a frequency greater than 2kHz, their minimum audible decibel value will be greater than 20dB, resulting in hearing loss in men. When women hear sounds with a frequency greater than 2kHz after about 55, their minimum audible decibel value will be greater than 20dB, resulting in hearing loss in men. Eventually, hearing loss for both men and women gradually decreases to the point where they can only hear sounds with a frequency of around 8kHz. This decline is often referred to as presbycusis. Because electronic devices typically play audio data at a fixed frequency and loudness when playing video content, elderly people with hearing loss may not be able to hear the audio data properly or may hear it incorrectly when playing audio data at a fixed frequency and loudness greater than or equal to 2kHz.

[0047] In order to solve the above problems, the audio data playback method provided in the embodiment of the present application obtains the hearing data corresponding to the facial image, and determines the frequency (such as called the first frequency) at which the user corresponding to the facial image has hearing loss based on the hearing data. Then, the playback parameters corresponding to the first frequency are determined. The playback parameters include at least one first value, and a second value corresponding to each first value. When the electronic device plays audio data with an audio parameter of the first value, the audio data played by the electronic device cannot meet the user's hearing needs; when the electronic device plays audio data with an audio parameter of the second value, the audio data played by the electronic device can meet the user's hearing needs, and the second value is a value adjusted corresponding to the first value. Audio parameters include: frequency and loudness. Afterwards, the sound with the first frequency in the received audio data is played according to the playback parameters to ensure that the sound with the first frequency in the audio data played by the electronic device can be heard by elderly users. For example, Figure 2As shown, for elderly users who have lost their hearing, when using large-screen products (such as TVs), the TV plays audio data at a fixed frequency and loudness. For example, the TV plays audio data at a fixed frequency and loudness of 8kHz. At this time, the audio data played by the electronic device cannot be well heard by the elderly user or is heard incorrectly. The audio data playback method provided in the embodiment of the present application obtains the hearing data corresponding to the facial image of the elderly user, and determines the frequency (such as 8kHz) of the hearing loss of the user corresponding to the facial image based on the hearing data. Then, the TV determines the playback parameters corresponding to 8kHz. Afterwards, the TV plays the sound with a frequency of 8kHz in the received audio data according to the playback parameters to ensure that the sound with a frequency of 8kHz in the audio data played by the electronic device can be heard by the elderly user.

[0048] In some examples, an embodiment of the present application provides a method for playing audio data, which can be applied to an electronic device including an image acquisition device and a playback device. The image acquisition device can be a built-in camera or an external camera, and the playback device can be any one of a built-in speaker, a Bluetooth speaker, and a wired speaker. In this method, the electronic device captures the current facial image through a camera. Then, the electronic device obtains the hearing data corresponding to the facial image. Then, the electronic device determines the first frequency corresponding to the facial image based on the hearing data. Then, the electronic device determines the playback parameters corresponding to the first frequency. Afterwards, the sound with the first frequency in the received audio data is played according to the playback parameters to ensure that the sound with the first frequency in the audio data played by the electronic device can be heard by the elderly user.

[0049] For example, the electronic device in the embodiments of the present application may be a television, a tablet computer, a projector, a mobile phone, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) / virtual reality (VR) device, an in-vehicle device, and other devices including a display screen and a microphone. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0050] The following describes the structure of an electronic device using a television as an example. Figure 3 , is a schematic diagram of the structure of a television 100 provided in an embodiment of the present application. Figure 3As shown, the TV 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a power management module 140, an antenna, a wireless communication module 160, an audio module 170, a speaker 170A, a sensor module 180, a button 190, an indicator 191, a display screen 192 and a camera 193, etc.

[0051] The sensor module 180 may include a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and other sensors.

[0052] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the television 100. In other embodiments, the television 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0053] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0054] The power management module 140 is used to connect to a power source.

[0055] The wireless communication function of the television 100 can be implemented through an antenna and a wireless communication module 160. Among them, the wireless communication module 160 can provide wireless communication solutions applied to the television 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc. The wireless communication module 160 can be one or more devices integrating at least one communication processing module.

[0056] The internal memory 121 may be used to store computer executable program codes, which include instructions. For example, the internal memory 121 may be a random access memory (RAM).

[0057] The television 100 can implement audio functions through the audio module 170, the speaker 170A, and the application processor. For example, music playback, etc. The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110. The speaker 170A, also known as a "speaker", is used to convert audio electrical signals into sound signals. Among them, the speaker 170A can be built into the television 100, or the speaker 170A can be connected to the television 100 via a wired or wireless method. For example, the speaker 170A can be set at the lower edge of the display screen 192 of the television 100. Of course, the embodiment of the present application does not limit the position of the speaker 170A on the television 100. Alternatively, the television 100 may not include the speaker 170A, that is, the speaker 170A is not provided in the television 100. The television 100 may be connected to an external speaker 170A (also referred to as a speaker) via an interface (such as the USB interface 130). The external speaker may be fixed to the television 100 via an external fixing member (such as a camera bracket with a clip). For example, the external speaker may be fixed to an edge of the display screen 192 of the television 100, such as the upper edge, via an external fixing member.

[0058] Buttons 190 include a power button, a volume up button, and the like.

[0059] The indicator 191 may be an indicator light, which may be used to indicate whether the television 100 is in a power-on state, a standby state, or a power-off state.

[0060] The display screen 192 is used to display images, videos, etc. The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the television 100.

[0061] The camera 193 is used to capture still images or videos. In some embodiments, the television 100 may include one or N cameras 193, where N is a positive integer greater than 1. The camera 193 may be built into the television 100, or the camera 193 may be connected to the television 100 via a wired or wireless method. For example, Figure 2 As shown, the camera 193 can be arranged at the upper edge of the display screen 192 of the television 100. Of course, the embodiment of the present application does not limit the position of the camera 193 on the television 100. Alternatively, the television 100 may not include a camera, that is, the above-mentioned camera 193 is not arranged in the television 100. The television 100 can be connected to an external camera 193 through an interface (such as a USB interface 130). The external camera 193 can be fixed to the television 100 by an external fixing member (such as a camera bracket with a clip). For example, the external camera 193 can be fixed to the edge of the display screen 192 of the television 100, such as the upper edge, by an external fixing member.

[0062] Typically, the television 100 is provided with a remote control. The remote control is used to control the television 100. The remote control may include: a plurality of buttons, such as a power button, a volume button, and a plurality of other selection buttons. The buttons on the remote control may be mechanical buttons or touch buttons. The remote control may receive key inputs, generate key signal inputs related to user settings and function control of the television 100, and send corresponding control signals to the television 100 to control the television 100. For example, the remote control may send control signals to the television 100 via infrared signals, etc. The remote control may also include a battery storage cavity for installing batteries to power the remote control.

[0063] It is understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the television 100. Figure 3 The more or less components shown in the figure may be combined with two or more components, or may have different component configurations. For example, the television may also include components such as a sound box. Figure 3The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing or application specific integrated circuits.

[0064] Take the operating system of the TV 100 as an example, Figure 4 As shown, the TV set 100 can be logically divided into an application layer 21 , a kernel layer 22 and a hardware layer 23 .

[0065] Among them, the hardware layer 23 may include Figure 3 The internal memory 121, camera 193 and speaker 170A shown in FIG. The internal memory 121 is used to store the face image captured by the camera 193 and the playback parameters corresponding to the face image.

[0066] The kernel layer 22 serves as software middleware between the hardware layer 23 and the application layer 21, and is used to manage and control hardware and software resources. For example, the kernel layer 22 includes a camera management module 220 and an audio management module 221. The camera management module 220 is used to capture the current user's facial image via the camera 193, and the audio management module 221 is used to play received audio data according to playback parameters and control the speaker 170A to play the processed audio data.

[0067] The application layer 21 includes one or more applications. These applications can be system applications or third-party applications. For example, the application layer 21 includes a test application 1. Test application 1 is used to query the internal memory 121 for playback parameters corresponding to a facial image captured by the camera management module 220. Test application 1 sends these playback parameters to the audio management module 221.

[0068] The methods in the following embodiments can all be implemented in the television 100 having the above hardware structure. In the following embodiments, the methods of the present application are described by taking the above electronic device as the television 100 and the playback device as the speaker 170A as an example.

[0069] The present application provides a method for playing audio data. Figure 5 As shown, the method for playing the audio data may include S11-S18.

[0070] S11 . The TV 100 uses the camera 193 to capture a current facial image through the camera management module 220 .

[0071] In some examples, when a user uses the television 100 for the first time, the test application 1 of the television 100 controls the television 100 to display information indicating whether the user agrees to collect facial images and hearing data. The test application 1 of the television 100 can only obtain the user's facial image and hearing data after receiving the user's confirmation operation of agreeing to collect facial images and hearing data. For example, when a user uses the television 100 for the first time, the test application 1 of the television 100 controls the television 100 to display information indicating whether the user agrees to collect facial images and hearing data. After the test application 1 of the television 100 receives the user's confirmation operation of agreeing to collect facial images and hearing data, the next time the user uses the television 100, the television 100 uses the camera 193 through the camera management module 220 to collect the current facial image. Afterwards, when the TV set 100 receives the power-on operation from the user, the TV set 100 enters a specified state. The specified state can be a play state or an interactive state. For example, the play state can be playing a TV program or playing a video file, and the interactive state can be a video call or voice interaction. Afterwards, after the TV set 100 enters the specified state, the test application 1 of the TV set 100 can control the camera 193 to start working, triggering the camera 193 to collect the facial image of the user who is currently listening to the audio data played by the TV set 100. For example: After the TV set 100 receives the power-on operation from the user, the TV set 100 enters a play state, such as playing a TV program. Afterwards, as Figure 6 As shown in (a), when the TV set 100 is playing a TV program, the test application 1 of the TV set 100 collects the facial image of the user currently listening to the audio data played by the TV set 100 through the camera 193. Alternatively, after the TV set 100 receives the user's power-on operation, the TV set 100 enters an interactive state, such as a video call. Figure 6 As shown in (b), when the TV set 100 is making a video call, the test application 1 of the TV set 100 collects the facial image of the user currently listening to the audio data played by the TV set 100 through the camera 193. Alternatively, after the TV set 100 receives the user's power-on operation, the TV set 100 enters an interactive state, such as voice interaction. Figure 6 As shown in (c) , during the voice interaction process of the TV 100 , the test application 1 of the TV 100 collects the facial image of the user who is currently listening to the audio data played by the TV 100 through the camera 193 .

[0072] After capturing the facial image of the current user, the camera 193 of the TV 100 transmits the facial image to the camera management module 220. The camera management module 220 then sends the facial image captured by the camera 193 to the test application 1. In this way, the test application 1 obtains the current facial image.

[0073] After obtaining the current face image, the test application 1 of the TV 100 can determine corresponding playback parameters based on the face image, which can specifically include the following steps S12-S16.

[0074] S12 : The camera management module 220 of the TV 100 sends the facial image currently captured by the camera 193 to the test application 1 .

[0075] S13 . The test application 1 of the TV 100 receives the facial image sent by the camera management module 220 , and determines whether the user corresponding to the facial image is a new user based on the facial image.

[0076] In some examples, TV 100 stores facial image data for multiple users. When test application 1 of TV 100 determines that the user corresponding to the facial image is not a new user, it can directly obtain the playback parameters corresponding to the facial image. Therefore, after receiving the facial image sent by camera management module 220, test application 1 of TV 100 needs to determine whether the user corresponding to the facial image is a new user.

[0077] For example, the test application 1 of the television 100 can determine whether there is a facial image matching the facial image sent by the camera management module 220 in the facial image data stored by the television 100. If the test application 1 of the television 100 determines that there is a facial image matching the facial image sent by the camera management module 220 in the facial image data stored by the television 100, it can be determined that the user corresponding to the facial image is not a new user. The television 100 can then execute S17-S18. If the test application 1 of the television 100 determines that there is no facial image matching the facial image sent by the camera management module 220 in the facial image data stored by the television 100, it can be determined that the user corresponding to the facial image is a new user. The television 100 can then execute S14-S18.

[0078] Specifically, the facial image can be pre-recorded by the user into the television 100, or recorded when the user first uses the television 100. For example, after the television 100 is turned on for the first time, no facial image of any user is stored in the internal memory 121 of the television 100. Therefore, the test application 1 of the television 100 can prompt the user to enter a facial image after the television 100 is turned on for the first time. After obtaining the user's consent to enter the facial image, the test application 1 uses the camera 193 through the camera management module 220 to capture the current facial image, and stores the captured facial image in the internal memory 121 of the television 100 in the form of facial image data.

[0079] S14 . The test application 1 of the TV 100 records the facial image sent by the camera management module 220 and collects hearing data corresponding to the facial image.

[0080] In some examples, when the test application 1 of the television 100 determines that the user corresponding to the facial image is a new user, since the facial image and playback parameters of the new user are not stored in the television 100, the test application 1 of the television 100 can control the television 100 to display a prompt message to prompt the user to enter the facial image and collect the hearing data corresponding to the facial graphics to facilitate subsequent users to identify the user when using the television 100. The hearing data includes the user's operation data received by the test application 1 of the television 100 when the test application 1 of the television 100 plays the test sound at different frequencies and different loudnesses. The operation data includes the operation of the volume up key or the operation of the second control.

[0081] Furthermore, when the test application 1 of the television 100 collects hearing data, it can complete the collection within a single test cycle or over multiple test cycles. The test cycle can be a specified time period. For example, taking the example of a date displayed in a 24-hour format and the hearing data being collected by the test application 1 of the television 100 as a prompt, the test cycle can be a specified time period within any calendar day. For example, the specified time period can be from 0:0:0 to 23:59:59 on any calendar day, such as 0:0:0 to 23:59:59 on November 26, 2021. During this period, after the television 100 receives a power-on operation from the user, the test application 1 of the television 100 can control the television 100 to display a prompt message. After receiving the user's operation to confirm the recording of hearing data, the test application 1 of the television 100 plays test sounds at different frequencies and loudness levels. Afterwards, the test application 1 of the television 100 records the number of times the user operates the first control and the second control at each frequency and different loudness of the played test sound, thereby obtaining hearing data.

[0082] Alternatively, taking the example of a case where the date is displayed in a 24-hour format and the hearing data is collected while the user is using the television 100, the test application 1 of the television 100 only collects hearing data of one frequency and one loudness in each test cycle. For example, the test application 1 of the television 100 needs to collect hearing data of the user at a frequency of 8kHz and loudnesses of 10, 20, and 30. Since it needs to collect hearing data of three different loudnesses at a frequency of 8kHz, the test application 1 of the television 100 needs to collect hearing data of each loudness at a frequency of 8kHz through three test cycles. For example, the test application 1 of the television 100 collects hearing data of a frequency of 8kHz and a loudness of 10 in the first test cycle. At this point, after the television 100 enters the specified state, the test application 1 controls the television 100 to play the received audio data at a frequency of 8kHz and a loudness of 10. During this period (e.g., X minutes, where X is greater than or equal to 0), the test application 1 of the television 100 receives the user's first volume-up key press to determine hearing data at a frequency of 8 kHz and a loudness of 10. Subsequently, the test application 1 of the television 100 collects hearing data at a frequency of 8 kHz and a loudness of 20 during the second test cycle. At this point, after the television 100 enters the specified state, the test application 1 controls the television 100 to play the received audio data at a frequency of 8 kHz and a loudness of 20. During this period, the test application 1 of the television 100 receives the user's first volume-up key press to determine hearing data at a frequency of 8 kHz and a loudness of 20. Finally, the test application 1 of the television 100 collects hearing data at a frequency of 8 kHz and a loudness of 30 during the first test cycle. At this point, after the television 100 enters the specified state, the test application 1 controls the television 100 to play the received audio data at a frequency of 8 kHz and a loudness of 30. During this period, the test application 1 of the TV 100 receives the user's first operation of the volume up key to determine hearing data with a frequency of 8 kHz and a loudness of 30.

[0083] For example, when testing application 1 of television 100 collects hearing data within a test cycle, testing application 1 controls television 100 to play audio data multiple times using the audio parameters of the test values, and receives user feedback each time television 100 plays audio data using the test values ​​as the audio parameters. The test values ​​are shown in Table 1, including frequency and loudness.

[0084] Table 1

[0085]

[0086]

[0087] Specifically, if the test application 1 of the television 100 determines that the user corresponding to the facial image is a new user, it stores the facial image in RAM and prompts the user to enter hearing data. When entering hearing data, the test application 1 of the television 100 needs to play test sounds at different loudness levels for each frequency. Specifically, the test application 1 of the television 100 performs the following operations when playing the test sounds at each loudness level for each frequency:

[0088] When playing a test sound at each loudness at each frequency, the loudness is adjusted to the corresponding loudness, and the test sound at that frequency is played. After the test sound is played, a first prompt window is displayed. The first prompt window includes a first control and a second control. The first control is used for the user to confirm that they can clearly hear the audio data played with the audio parameter to be tested as the value to be tested, and the second control is used for the user to confirm that they cannot clearly hear the audio data played with the audio parameter to be tested as the value to be tested. For example, the first control is a "Yes" button, and the second control is a "No" button. When the test application 1 of the television set 100 receives a user confirmation button click on the "Yes" button, it indicates that the user has clearly heard the test sound. The test application 1 of the television set 100 then plays the next test sound at the same loudness at the same frequency. If the loudness is the last loudness, the test sound at the next frequency and different loudness is played. For example, when the test application 1 of the television set 100 receives a user confirmation button click on the "No" button, it indicates that the user did not clearly hear the test sound, and the loudness failure count for that frequency is incremented by 1. Afterwards, the test application 1 of the TV 100 plays a test sound of the next loudness at the frequency.

[0089] Afterwards, the test application 1 of the TV 100 receives statistics on the user's selection results for the test sound at each loudness at each frequency (for example, after the test application 1 of the TV 100 plays the test sound with a frequency of 8kHz and a loudness of 10, the user presses the "Yes" button and the "No" button to confirm whether he heard the option clearly) to determine the hearing data.

[0090] The above example uses the example of the TV 100 test application 1 counting "Yes" and "No" button confirmation operations for the "Can Hear Clearly" option to determine hearing data. In other examples, to improve user interaction efficiency, the user can press the volume up button on the remote control instead of the "No" button confirmation operation. In this way, when determining hearing data, the TV 100 test application 1 can determine hearing data based on the "Yes" button confirmation operation for the "Can Hear Clearly" option, the "No" button confirmation operation, and the received user's "Volume Up" button selection operation.

[0091] For example, in conjunction with Table 1, assuming that the user uses the TV 100 for the first time, the process of the test application 1 of the TV 100 recording the current user's facial image and collecting the hearing data corresponding to the facial image is as follows:

[0092] As can be seen from Table 1, the frequencies that the test application 1 of the TV set 100 currently needs to test include 8kHz, 6kHz, and 4kHz, and the loudness that needs to be collected for the three frequencies include: 10, 20, 30, 40, 45, 50, 60, 70, and 80. In this way, if the test application 1 of the TV set 100 determines that the user corresponding to the face image is a new user, it stores the face image in RAM and displays it as follows: Figure 7 The interface 701 shown in (a) of FIG. 701 includes an icon 7010 prompting the user to perform a "hearing test", and a "yes" button 7011 and a "no" button 7012 for determining whether to perform the "hearing test". After receiving the user's selection operation on the "no" button 7012, the TV 100 exits the "hearing test". The next time the user uses the TV 100, the TV 100 displays the following information: Figure 7 After receiving the user's selection operation on the "Yes" button 7011, the TV 100 displays the following Figure 7 The interface 702 shown in (b) of FIG. The interface 702 includes an icon 7020 of "8kHz, 10". As shown in Table 1, when the test application 1 of the television 100 plays a test sound with a frequency of 8kHz and a loudness of 10, the loudness needs to be adjusted to 10 and the test sound with a frequency of 8kHz needs to be played. After playing the test sound, the television 100 displays the following Figure 7 Interface 703 shown in (c) in FIG. Interface 703 includes an icon 7020 of “8kHz, 10”, an icon 7030 of “Did you hear clearly” (i.e., the first prompt window provided in the embodiment of the present application) for prompting the user whether he or she heard clearly the test sound played by “8kHz, 10”, and a “Yes” button 7031 and a “No” button 7032 for confirming “Did you hear clearly”. After the test application 1 of the TV set 100 receives the user’s selection operation on the “Yes” button 7031, the test application 1 of the TV set 100 plays a test sound with a frequency of 8kHz and a loudness of 10. At this time, the TV set 100 displays the following: Figure 7 The interface 704 shown in (d) of FIG. The interface 704 includes an icon 7040 of "8kHz, 20". After the test application 1 of the television 100 receives the user's selection operation of the "No" button 7032, the number of times "8kHz, 10" was not heard clearly increases by 1, and the display is as follows: Figure 7 The interface 704 shown in (d) in FIG. 1 is thus displayed. In this way, the test application 1 of the TV set 100 completes the test on “8kHz, 10”.

[0093] Specifically, the detection process of the remaining frequencies and loudness (such as: "8kHz, 20", "8kHz, 30", "8kHz, 40", "8kHz, 45", "8kHz, 50", "8kHz, 60", "8kHz, 70", "8kHz, 80", "6kHz, 10", "6kHz, 20", "6kHz, 30", "6kHz, 40", "6kHz, 45", "6kHz, 50", "6kHz, 60", "6kHz, 70", "6kHz, 80", "4kHz, 10", "4kHz, 20", "4kHz, 30", "4kHz, 40", "4kHz, 45", "4kHz, 50", "4kHz, 60", "4kHz, 70", "4kHz, 80") of the test application 1 of the television 100 is similar to the detection process of "8kHz, 10" of the test application 1 of the television 100, and will not be repeated here.

[0094] After that, the test application 1 of the television 100 plays the remaining test sounds of frequencies and loudness, and obtains the hearing data of the face image according to the user's selection result of the test sound of each loudness at each frequency.

[0095] The above examples are explained by taking the example of the test application 1 of the TV 100 obtaining facial images and collecting hearing data by prompting. In some other examples, the test application 1 of the TV 100 can obtain facial images and collect hearing data through the user in the process of using the TV 100. For example: the test application 1 of the TV 100 obtains facial images and collects hearing data corresponding to the facial images while the user is watching TV programs, or the test application 1 of the TV 100 obtains facial images and collects hearing data corresponding to the facial images while the user is making a video call, or the test application 1 of the TV 100 obtains facial images and collects hearing data corresponding to the facial images while the user is making a voice interaction.

[0096] For example, taking the example of the test application 1 of the television 100 acquiring a facial image and collecting hearing data corresponding to the facial image while the user is watching a television program, the implementation process of the test application 1 of the television 100 acquiring the facial image and collecting hearing data corresponding to the facial image is as follows:

[0097] like Figure 8As shown in (a), when the user is watching a TV program, if the TV 100 determines that the user corresponding to the facial image is a new user, the facial image is stored in the RAM. At this time, the test application 1 of the TV 100 only collects hearing data of one frequency and one loudness in each test cycle, so that the hearing data of the facial image can be obtained through multiple test cycles. For example, in combination with the example given in Table 1, taking the date displayed in 24-hour format as an example, after the TV 100 enters the specified state, the test application 1 controls the TV 100 to play the received audio data at a frequency of 8kHz and a loudness of 10. During this period, if the test application 1 of the TV 100 does not receive the user's operation on the volume key (such as increasing the loudness or decreasing the loudness), then in the next test cycle, after the TV 100 enters the specified state, the test application 1 controls the TV 100 to play the received audio data at a frequency of 8kHz and a loudness of 20. As Figure 8 As shown in (b) of the figure, during this period, if the test application 1 of the TV set 100 receives a user volume key press (e.g., increasing or decreasing the loudness), the number of unheard counts for "8kHz, 10" increases by 1, and the "8kHz, 10" detection is exited. In the next test cycle, after the TV set 100 enters the specified state, the test application 1 controls the TV set 100 to play the received audio data at a frequency of 8kHz and a loudness of 20. In this way, the test application 1 of the TV set 100 completes the "8kHz, 10" detection while the user is watching a TV program. Test application 1 of the TV set 100.

[0098] Specifically, the detection process of the remaining frequencies and loudness (such as: "8kHz, 20", "8kHz, 30", "8kHz, 40", "8kHz, 45", "8kHz, 50", "8kHz, 60", "8kHz, 70", "8kHz, 80", "6kHz, 10", "6kHz, 20", "6kHz, 30", "6kHz, 40", "6kHz, 45", "6kHz, 50", "6kHz, 60", "6kHz, 70", "6kHz, 80", "4kHz, 10", "4kHz, 20", "4kHz, 30", "4kHz, 40", "4kHz, 45", "4kHz, 50", "4kHz, 60", "4kHz, 70", "4kHz, 80") of the test application 1 of the television 100 is similar to the detection process of "8kHz, 10" of the test application 1 of the television 100, and will not be repeated here.

[0099] After that, the test application 1 of the television 100 plays the remaining test sounds of frequencies and loudness, and obtains the hearing data of the face image according to the user's selection result of the test sound of each loudness at each frequency.

[0100] At this point, the test application 1 of the television 100 has obtained the hearing data corresponding to the facial image. In order to reduce the operating volume of the television 100, the audio data playback method provided in the embodiment of the present application divides the loudness into one or more loudness intervals and counts the number of times the audio is not heard clearly in each loudness interval (such as the number of times the user triggers the second control, or the total number of times the user triggers the volume up key for the first time when the television 100 plays audio data with the test value as the audio parameter), thereby reducing the amount of calculation. For example, taking the loudness as 100 levels from large to small, with each loudness corresponding to one level, the loudness is divided into three loudness intervals, namely, the loudness interval greater than or equal to 0 and less than or equal to 35 is classified as low loudness; the loudness interval greater than 35 and less than or equal to 50 is classified as medium loudness; and the loudness interval greater than 50 and less than or equal to 100 is classified as high loudness. In this way, by counting the number of inaudible times in each loudness interval, the amount of calculation of the television 100 can be reduced.

[0101] For example, taking the loudness as an example, which is divided into three loudness intervals, namely low loudness, medium loudness and high loudness, the hearing data of the face image is shown in Table 2.

[0102] Table 2

[0103]

[0104]

[0105] S15. The test application 1 of the television 100 determines the inaudible probability corresponding to each loudness of each frequency according to the hearing data, and obtains detection items greater than the first probability from the multiple inaudible probabilities.

[0106] Wherein, one detection item corresponds to one frequency and one or more loudnesses, and the first probability may be a pre-set probability, for example, input by a tester and stored in the RAM of the television 100 before the television 100 is used for the first time.

[0107] In some examples, taking the case where a detection item corresponds to a frequency and a loudness, the probability of not hearing clearly can refer to the ratio of the number of times a certain frequency in the hearing data is not heard clearly at a certain loudness to the total number of detection items corresponding to the frequency. As shown in Table 2, for a sound with a frequency of 8kHz, the number of times it is not heard clearly is 3 when the loudness is 10, and the total number of detection items corresponding to the frequency of 8kHz is 9. Therefore, the probability of not hearing clearly for a detection item with a frequency of 8kHz and a loudness of 10 is

[0108] In some other examples, taking the case where one detection item corresponds to one frequency and multiple loudnesses, the loudness is divided into one or more loudness intervals, and the probability of not hearing clearly may refer to the ratio of the number of times a certain frequency in a loudness interval in the hearing data is not heard clearly to the total number of detection items contained in the loudness interval. In this way, the loudness intervals that the user does not hear clearly can be refined to ensure the user experience. For example, in combination with the example of S14 above, the loudness is divided into three loudness intervals, namely, loudness high, loudness medium, and loudness low. As can be seen from Table 2, when the frequency is 8kHz and the loudness interval is small loudness, the number of times of not hearing clearly is 3. When the frequency is 8kHz and the total number of detection items contained in the loudness interval corresponding to small loudness is 3. Therefore, the probability of not hearing clearly corresponding to the detection item with a frequency of 8kHz and a loudness interval of small loudness is

[0109] Then, the test application 1 of the television 100 determines the detection items whose probability of inaudibility is greater than the first probability. For example, in conjunction with the above example, taking a detection item corresponding to a frequency and a loudness as an example, assuming that the first probability is 70%, the frequency is 8 kHz, and the probability of inaudibility corresponding to the detection item with a loudness of 10 is 33.33%, then the detection item with a frequency of 8 kHz and a loudness of 10 is determined not to be a detection item with a probability greater than the first probability. If the first probability is 20%, the frequency is 8 kHz, and the probability of inaudibility corresponding to the detection item with a loudness of 10 is 33.33%, then the detection item with a frequency of 8 kHz and a loudness of 10 is determined to be a detection item with a probability greater than the first probability.

[0110] Alternatively, taking the example of a detection item corresponding to one frequency and multiple loudnesses, assuming a first probability of 70%, a frequency of 8 kHz, and a 100% probability of not hearing the detection item with a low loudness interval, then the detection item with a frequency of 8 kHz and a low loudness interval is determined to be a detection item with a probability greater than the first probability. If the first probability is 20%, a frequency of 8 kHz, and a 33.33% probability of not hearing the detection item with a low loudness interval, then the detection item with a frequency of 8 kHz and a low loudness interval is determined to be a detection item with a probability greater than the first probability.

[0111] S16 . The test application 1 of the television 100 determines the playback parameters corresponding to the detection items for which the probability of unclear hearing is greater than the first probability.

[0112] Specifically, the first value includes a first value of frequency and a first value of loudness, and the second value includes a second value of frequency and a second value of loudness. The first value of frequency corresponds to the second value of frequency, and the first value of loudness corresponds to the second value of loudness. In this embodiment of the present application, one detection item corresponds to one first value, and each detection item corresponds to a different first value.

[0113] In some examples, the television 100 stores facial images of users who have used the television 100 and corresponding playback parameters locally (e.g., in the internal memory 121). Thus, after determining a detection item with a probability of not being heard clearly greater than a first probability, the test application 1 of the television 100 queries the internal memory 121 for the playback parameters corresponding to the detection item, thereby determining the playback parameters corresponding to the facial image. For example, the playback parameters corresponding to the detection items with a frequency of 8 kHz and a loudness of 10 stored in the internal memory 121 of the television 100 are shown in Table 3.

[0114] Table 3

[0115] frequency Loudness Playback Parameters 8kHz 10 Playback parameters 1

[0116] For example, taking a detection item corresponding to a frequency and a loudness as an example, when the test application 1 of the television 100 determines that the probability of inaudibility corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is greater than the first probability, by querying the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 in the internal memory 121, it can be found that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is playback parameter 1.

[0117] In other examples, the differences between the playback parameters corresponding to the detection items in the same loudness interval are small. Therefore, the playback parameters corresponding to all the detection items in the same loudness interval can be set as one playback parameter. For example, the playback parameters corresponding to different detection items stored in the internal memory 121 of the television 100 are shown in Table 4.

[0118] Table 4

[0119]

[0120] For example, taking a detection item corresponding to a frequency and multiple loudnesses as an example, when the test application 1 of the television 100 determines that the probability of inaudibility corresponding to the detection item with a frequency of 8 kHz and a loudness interval of low loudness is greater than the first probability, by querying the playback parameters corresponding to the detection item with a frequency of 8 kHz and a loudness interval of low loudness in the internal memory 121, it can be found that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness interval of low loudness is playback parameter 1.

[0121] The above example is based on the case where the test application 1 of the television 100 determines that the detection item with a probability of inaudibility greater than a first probability includes one detection item. In other examples, when the test application 1 of the television 100 determines that there are multiple detection items with a probability of inaudibility greater than the first probability, it is necessary to determine the playback parameters corresponding to the multiple detection items. For example, the playback parameters corresponding to the multiple detection items are shown in Table 5.

[0122] Table 5

[0123]

[0124]

[0125] For example, taking the example of a detection item corresponding to a frequency and a loudness, the test application 1 of the television 100 determines that the probability of inaudibility corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is greater than the first probability, and the test application 1 of the television 100 determines that the probability of inaudibility corresponding to the detection item with a frequency of 6 kHz and a loudness of 30 is greater than the first probability. The test application 1 of the television 100 searches the internal memory 121 for the playback parameters corresponding to the detection item with a frequency of 8 kHz and a loudness of 10, and the detection item with a frequency of 6 kHz and a loudness of 30, and finds that the playback parameters corresponding to the detection item with a frequency of 8 kHz and a loudness of 10, and the detection item with a frequency of 6 kHz and a loudness of 30 are playback parameters 3.

[0126] The above example is described by taking one detection item corresponding to one frequency and one loudness as an example. In other examples, the playback parameters corresponding to all detection items in the same loudness range are set as one playback parameter.

[0127] Exemplarily, the playback parameters corresponding to the multiple detection items are shown in Table 6.

[0128] Table 6

[0129]

[0130] For example, if the test application 1 of the television 100 determines that the probability of inaudibility corresponding to the detection item with a frequency of 8 kHz and a loudness interval of low loudness is greater than a first probability, and the test application 1 of the television 100 determines that the probability of inaudibility corresponding to the detection item with a frequency of 6 kHz and a loudness interval of low loudness is greater than the first probability, the test application 1 of the television 100 can determine that the playback parameters corresponding to the detection item with a frequency of 8 kHz and a loudness interval of low loudness and the detection item with a frequency of 6 kHz and a loudness interval of low loudness are playback parameter 1 by querying the internal memory 121 for the playback parameters corresponding to the detection item with a frequency of 8 kHz and a loudness interval of low loudness and the detection item with a frequency of 6 kHz and a loudness interval of low loudness.

[0131] It should be noted that the above example is based on the example that the internal memory 121 of the TV 100 stores playback parameters corresponding to different detection items. Figure 9 As shown, the server 2 stores playback parameters corresponding to different detection items. After the TV 100 determines that the detection item with a probability of not hearing clearly is greater than the first probability, it needs to send a detection message carrying the detection item with a probability of not hearing clearly greater than the first probability to the server 2. The detection message is used to instruct the server 2 to determine the playback parameters corresponding to the detection item. After determining the playback parameters corresponding to the detection item, the server 2 sends the sound curve to the TV 100. After receiving the playback parameters, the TV 100 saves the playback parameters to the internal memory 121 so that the next time the facial image is detected, the playback parameters corresponding to the facial image are executed.

[0132] In some examples, for the same facial image, after the test application 1 of the television 100 determines that a detection item with a probability of not being heard clearly is greater than a first probability (such as a detection item with a frequency of 8 kHz and a loudness of 10), it sends a detection message carrying the identifier of the detection item to the server 2. After receiving the detection message carrying the identifier of the detection item, the server 2 determines the playback parameter corresponding to the detection item (such as playback parameter 1). The server 2 sends the playback parameter 1 to the television 100. After receiving the playback parameter 1 corresponding to the detection item sent by the server 2, the test application 1 of the television 100 stores the playback parameter 1 in the internal memory 121. Thereafter, after the test application 1 of the television 100 determines that another detection item with a probability of not being heard clearly is greater than the first probability (such as a detection item with a frequency of 6 kHz and a loudness of 10), it needs to send a detection message carrying both the identifier of the detection item with a frequency of 8 kHz and a loudness of 10 and the identifier of the detection item with a frequency of 6 kHz and a loudness of 10 to the server. After receiving the detection message for both the identification of the detection item with a frequency of 8 kHz and a loudness of 10 and the identification of the detection item with a frequency of 6 kHz and a loudness of 10, server 2 determines the corresponding playback parameters (e.g., playback parameter 2) for the detection item with a frequency of 8 kHz and a loudness of 10 and the detection item with a frequency of 6 kHz and a loudness of 10. Server 2 then sends playback parameter 2 to television 100. After receiving the detection message for both the identification of the detection item with a frequency of 8 kHz and a loudness of 10 and the identification of the detection item with a frequency of 6 kHz and a loudness of 10, television 100 replaces playback parameter 1 with playback parameter 2 and stores playback parameter 2 in internal memory 121.

[0133] Specifically, the process of the server 2 determining the playback parameters corresponding to the detection items is similar to the process of the test application 1 of the TV 100 determining the playback parameters corresponding to the detection items, which will not be repeated here.

[0134] S17 : The test application 1 of the TV 100 sends playback parameters to the audio management module 221 .

[0135] In some examples, when the test application 1 of the television set 100 determines that the current user's facial image is a new user, after executing steps S14-S16 above, it determines the playback parameters corresponding to the current facial image. Subsequently, the test application 1 of the television set 100 sends the playback parameters to the audio management module 221. For example, when the test application 1 of the television set 100 determines that the current user's facial image is a new user, after executing steps S14-S16 above, it determines that the playback parameters corresponding to the current facial parameters are curve parameters 1. Subsequently, the test application 1 of the television set 100 sends curve parameters 1 to the audio management module 221.

[0136] When the test application 1 of the TV 100 determines that the current facial image is not a new user, since the internal memory 121 of the TV 100 has stored the playback parameters corresponding to the facial image. Therefore, the test application 1 of the TV 100 can query the playback parameters corresponding to the facial image in the internal memory 121. Afterwards, the test application 1 of the TV 100 sends the playback parameters to the audio management module 221. For example: the test application 1 of the TV 100 determines that the current facial image is not a new user, and the test application 1 of the TV 100 queries the playback parameters corresponding to the facial image in the internal memory 121. After querying the playback parameters corresponding to the facial image (such as playback parameter 1), the test application 1 of the TV 100 sends playback parameter 1 to the audio management module 221.

[0137] S18: The audio management module 221 of the television 100 controls the speaker 170A to adjust the audio parameter of the first audio data in the audio data to be played to the corresponding second value according to the user's playback parameter and then play the first audio data.

[0138] In some examples, the sound contained in the audio data corresponds to multiple frequencies and loudnesses. When the audio management module 221 controls the speaker 170A to play the audio data according to the playback parameters, it is necessary to adjust the audio parameters of the first audio data in the audio data to be played to the corresponding second value based on the user's playback parameters before playing. For example, the playback parameters include a first value and a second value, the first value includes a first value of frequency and a first value of loudness, and the second value includes a second value of frequency and a second value of loudness. For example, the first value of frequency can be referred to as the frequency before adjustment, the first value of loudness can be referred to as the loudness before adjustment, the second value of frequency can be referred to as the frequency after adjustment, and the second value of loudness can be referred to as the loudness after adjustment. The audio management module 221 of the television 100 controls the speaker 170A to play the sound in the audio data having the frequency before adjustment and the loudness before adjustment according to the adjusted frequency and the adjusted loudness.

[0139] For example, the corresponding relationship among the frequency before adjustment, the loudness before adjustment, the frequency after adjustment, and the loudness after adjustment in the playback parameters is shown in Table 7.

[0140] Table 7

[0141]

[0142] The frequency before adjustment and the frequency after adjustment may be the same or different, and the loudness after adjustment may be the same or different.

[0143] For example, based on the above example, let's assume that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is playback parameter 1. As shown in Table 7, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters corresponds to a frequency of 6 kHz and a loudness of 10 after adjustment. Thus, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 in the audio data at a frequency of 6 kHz and a loudness of 10. Alternatively, based on the above example, let's assume that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is playback parameter 2. As shown in Table 7, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters corresponds to a frequency of 8 kHz and a loudness of 40 after adjustment. Thus, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 in the audio data at a frequency of 8 kHz and a loudness of 40. Alternatively, in conjunction with the above example, assume that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is playback parameter 1. As can be seen from Table 7, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters corresponds to a frequency of 6 kHz and a loudness of 40 after adjustment. In this way, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 in the audio data at a frequency of 6 kHz and a loudness of 40.

[0144] The above example uses a playback parameter corresponding to a pre-adjusted frequency, a pre-adjusted loudness, a post-adjusted frequency, and a post-adjusted loudness as an example. In other examples, the playback parameter may correspond to a pre-adjusted frequency, multiple pre-adjusted loudnesses, a post-adjusted frequency, and a post-adjusted loudness. For example, if the playback parameter includes a pre-adjusted frequency, multiple pre-adjusted loudnesses, a post-adjusted frequency, and an adjusted loudness, the audio management module 221 of the television 100 controls the speaker 170A to play a sound in the audio data having a pre-adjusted frequency and multiple pre-adjusted loudnesses according to the adjusted frequency and adjusted loudness.

[0145] For example, the corresponding relationship among the frequency before adjustment, multiple loudnesses before adjustment, the frequency after adjustment, and the loudness after adjustment in the playback parameters is shown in Table 8.

[0146] Table 8

[0147]

[0148] For example, based on the above example, let's assume that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 10 is playback parameter 1. As shown in Table 8, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters corresponds to a frequency of 6 kHz and a loudness of 40 after adjustment. Thus, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 in the audio data at a frequency of 6 kHz and a loudness of 40. Alternatively, based on the above example, let's assume that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 20 is playback parameter 1. As shown in Table 8, the sound with a frequency of 8 kHz and a loudness of 20 before adjustment in the playback parameters corresponds to a frequency of 6 kHz and a loudness of 40 after adjustment. Thus, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 20 in the audio data at a frequency of 6 kHz and a loudness of 40. Alternatively, in conjunction with the above example, assuming that the playback parameter corresponding to the detection item with a frequency of 8 kHz and a loudness of 30 is playback parameter 1. As can be seen from Table 8, the sound with a frequency of 8 kHz and a loudness of 30 before adjustment in the playback parameters corresponds to an adjusted frequency of 6 kHz and a loudness of 40. In this way, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 30 in the audio data at a frequency of 6 kHz and a loudness of 40.

[0149] The above example uses a playback parameter corresponding to a pre-adjusted frequency, multiple pre-adjusted loudnesses, a post-adjusted frequency, and an adjusted loudness as an example. In other examples, the playback parameter may correspond to multiple pre-adjusted frequencies, a pre-adjusted frequency, a post-adjusted frequency, and an adjusted loudness. For example, if the playback parameter includes multiple pre-adjusted frequencies, a pre-adjusted loudness, a post-adjusted frequency, and an adjusted loudness, the audio management module 221 of the television 100 controls the speaker 170A to play a sound in the audio data having a frequency of any of the multiple pre-adjusted frequencies and multiple pre-adjusted loudnesses according to the adjusted frequency and adjusted loudness.

[0150] For example, the corresponding relationship among the multiple frequencies before adjustment, the loudness before adjustment, the frequency after adjustment, and the loudness after adjustment in the playback parameters is shown in Table 9.

[0151] Table 9

[0152]

[0153] For example, in conjunction with the above example, assuming that the detection items of frequency 8kHz, loudness 10, and frequency 6kHz, loudness 10 correspond to playback parameter 1. As can be seen from Table 9, the sound with a frequency of 8kHz and loudness 10 before adjustment and the sound with a frequency of 6kHz and loudness 10 before adjustment in the playback parameters correspond to an adjusted frequency of 6kHz and loudness of 50. In this way, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8kHz and loudness 10 and the sound with a frequency of 6kHz and loudness 10 in the audio data at a frequency of 6kHz and loudness of 50. Alternatively, in conjunction with the above example, assuming that the detection items of frequency 8kHz, loudness 10, and frequency 6kHz, loudness 20 correspond to playback parameter 2. As can be seen from Table 9, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters, and the sound with a frequency of 6 kHz and a loudness of 20 before adjustment, both correspond to an adjusted frequency of 6 kHz and a loudness of 40. Thus, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 and the sound with a frequency of 6 kHz and a loudness of 20 in the audio data at a frequency of 6 kHz and a loudness of 40. Alternatively, based on the above example, assuming that the detection items with a frequency of 8 kHz and a loudness of 10 and a frequency of 6 kHz and a loudness of 30 correspond to playback parameter 3. As can be seen from Table 9, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters, and the sound with a frequency of 6 kHz and a loudness of 30 before adjustment, both correspond to an adjusted frequency of 6 kHz and a loudness of 30. In this way, the audio management module 221 of the TV 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 and the sound with a frequency of 6 kHz and a loudness of 30 in the audio data at a frequency of 6 kHz and a loudness of 30.

[0154] The above example uses a playback parameter corresponding to multiple pre-adjusted frequencies, one pre-adjusted frequency, one post-adjusted frequency, and one post-adjusted loudness as an example. In other examples, the playback parameter may correspond to multiple pre-adjusted frequencies, multiple pre-adjusted frequencies, one post-adjusted frequency, and one post-adjusted loudness. For example, if the playback parameter includes multiple pre-adjusted frequencies, one pre-adjusted loudness, one post-adjusted frequency, and one post-adjusted loudness, the audio management module 221 of the television 100 controls the speaker 170A to play a sound in the audio data having a frequency of any one of the multiple pre-adjusted frequencies and a loudness of any one of the multiple pre-adjusted loudnesses according to the adjusted frequency and the adjusted loudness.

[0155] For example, the corresponding relationship among the multiple frequencies before adjustment, the multiple loudnesses before adjustment, the frequencies after adjustment, and the loudness after adjustment in the playback parameters is shown in Table 10.

[0156] Table 10

[0157]

[0158] For example, in conjunction with the above example, assuming that the frequency is 8kHz, the loudness is 10, and the frequency is 6kHz, the loudness is 10, the corresponding playback parameter of the detection item is playback parameter 1. As can be seen from Table 10, the sound with a frequency of 8kHz and a loudness of 10 before adjustment in the playback parameters, and the sound with a frequency of 6kHz and a loudness of 10 before adjustment, both correspond to an adjusted frequency of 6kHz and a loudness of 40. In this way, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8kHz and a loudness of 10 and the sound with a frequency of 6kHz and a loudness of 10 in the audio data at a frequency of 6kHz and a loudness of 40. Alternatively, in conjunction with the above example, assuming that the playback parameter corresponding to the detection item with a frequency of 8kHz and a loudness of 10 and a frequency of 6kHz and a loudness of 20 is playback parameter 1. As can be seen from Table 10, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters, and the sound with a frequency of 6 kHz and a loudness of 20 before adjustment, both correspond to an adjusted frequency of 6 kHz and a loudness of 40. Thus, the audio management module 221 of the television 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 and the sound with a frequency of 6 kHz and a loudness of 20 in the audio data at a frequency of 6 kHz and a loudness of 40. Alternatively, based on the above example, assuming that the detection items with a frequency of 8 kHz and a loudness of 10 and a frequency of 6 kHz and a loudness of 30 correspond to playback parameter 1. As can be seen from Table 10, the sound with a frequency of 8 kHz and a loudness of 10 before adjustment in the playback parameters, and the sound with a frequency of 6 kHz and a loudness of 30 before adjustment, both correspond to an adjusted frequency of 6 kHz and a loudness of 40. In this way, the audio management module 221 of the TV 100 controls the speaker 170A to play the sound with a frequency of 8 kHz and a loudness of 10 and the sound with a frequency of 6 kHz and a loudness of 30 in the audio data at a frequency of 6 kHz and a loudness of 40.

[0159] It should be noted that the above example is based on the example of the test application 1 of the television 100 determining the playback parameters based on the current facial image. In other examples, the test application 1 of the television 100 can also determine the playback parameters based on the age and hearing data input by the user. In addition, the test application 1 of the television 100 can also determine the playback parameters based on the age, gender, and hearing data input by the user. In this way, the playback parameters of the facial image can be determined more accurately to ensure the user experience.

[0160] It is understandable that, in order to realize the above functions, the above electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should appreciate that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0161] The embodiment of the present application can divide the functional modules of the above-mentioned electronic device according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0162] In one example, see Figure 9 , is a schematic diagram of the composition of an electronic device 10 provided in an embodiment of the present application. Figure 9 As shown, the electronic device 10 may include: a collection unit 101 and a processing unit 102 .

[0163] The acquisition unit 101 is configured to acquire a facial image of a user currently using an electronic device; the processing unit 102 is configured to obtain the user's playback parameters based on the facial image acquired by the acquisition unit 101; the user's playback parameters include: at least one first value of a mid-frequency and at least one first value of a loudness of an audio parameter when the electronic device plays audio data, and a second value corresponding one-to-one to the first value of each of the above-mentioned frequencies, and a second value corresponding one-to-one to the first value of each of the loudness; the audio data played when the audio parameter is the first value cannot meet the user's hearing needs, and the second value is the value of the audio parameter adjusted to the corresponding first value to meet the user's hearing needs, the audio parameters including: frequency and loudness; the processing unit 102 is further configured to adjust the audio parameters of first audio data in the audio data to be played to the corresponding second value based on the user's playback parameters, and then play the audio data, where the first audio data is the audio data in the audio data to be played whose audio parameter is the first value.

[0164] In one possible implementation, the audio data playback device also includes an acquisition unit 103; a processing unit 102, specifically configured to, when it is determined that the user is a new user based on the facial image collected by the acquisition unit 101, perform the following operations for each of all to-be-tested values ​​of the audio parameter: control the electronic device to play audio data with the to-be-tested value as the audio parameter multiple times; receive feedback data from the user each time the electronic device plays audio data with the to-be-tested value as the audio parameter, the feedback data being used to indicate whether the user can hear the audio data played with the to-be-tested value as the audio parameter; the processing unit 102, specifically configured to determine, based on multiple feedback data from the user, a probability of the user not hearing the audio data played with the to-be-tested value as the audio parameter; the processing unit 102, specifically configured to, when the user's probability of not hearing is greater than or equal to a first threshold, control the acquisition unit 103 to obtain a second value corresponding to the to-be-tested value to obtain the user's playback parameter; the to-be-tested value corresponding to the user's probability of not hearing is greater than or equal to the first threshold is the first value.

[0165] In one possible implementation, the audio data playback device further includes a display unit 104. The processing unit 102 is further configured to control the display unit 104 to display a first prompt window after the electronic device plays the audio data with the value to be tested as the audio parameter, the first prompt window including a first control and a second control; the first control is used for the user to confirm that the audio data played with the value to be tested is clearly audible, and the second control is used for the user to confirm that the audio data played with the value to be tested is not clearly audible; the feedback data is the user's triggering operation on the first control or the second control; the processing unit 102 is specifically configured to obtain the number of times the user triggers the second control based on multiple feedback data of the user; the processing unit 102 is specifically configured to determine the probability of the user not hearing clearly based on the number of times the second control is triggered and the total amount of feedback data.

[0166] In one possible implementation, the audio data playback device further includes an acquisition unit 103. The processing unit 102 is specifically configured to, when determining that the user is a new user based on the facial image captured by the acquisition unit 101, perform the following operations for each of all to-be-tested values ​​of the audio parameter: controlling the electronic device to play audio data multiple times using the to-be-tested value as the audio parameter; receiving a trigger operation of the user pressing the volume up key each time the electronic device plays audio data using the to-be-tested value as the audio parameter; the trigger operation being used by the user to confirm that the audio data played using the to-be-tested value is not clearly heard; the processing unit 102 is specifically configured to determine a probability of the user not hearing the audio data played using the to-be-tested value as the audio parameter based on a total number of audio data played using the to-be-tested value as the audio parameter and a total number of trigger operations; the processing unit 102 is specifically configured to, when the user's probability of not hearing the audio data is greater than or equal to a first threshold, control the acquisition unit 103 to obtain a second value corresponding to the to-be-tested value to obtain the user's playback parameter; the to-be-tested value corresponding to the user's probability of not hearing the audio data greater than or equal to the first threshold is the first value.

[0167] In one possible implementation, the audio data playback device further includes an acquisition unit 103. The processing unit 102 is specifically configured to query a pre-stored correspondence for a second value corresponding to the value to be tested; or the processing unit 102 is specifically configured to control the acquisition unit 103 to acquire the second value corresponding to the value to be tested from a server.

[0168] In a possible implementation, the processing unit 102 is further configured to, when it is determined that the user is a new user based on the facial image collected by the collection unit 101 , correspondingly store the user's facial image and the user's playback parameters.

[0169] In one possible implementation, the processing unit 102 is specifically configured to obtain the user's playback parameters locally based on the facial image collected by the collection unit 101 when it is determined that the user is not a new user based on the facial image collected by the collection unit 101; wherein the electronic device stores facial images of users who have used the electronic device and corresponding playback parameters.

[0170] Of course, the electronic device 10 provided in the embodiment of the present invention includes but is not limited to the above modules. For example, the electronic device 10 may further include a storage unit 105. The storage unit 105 may be used to store program codes of the electronic device 10, and may also be used to store data generated during operation of the electronic device 10, such as data in a write request.

[0171] The embodiment of the present application also provides an electronic device, which may include: a memory and one or more processors. The memory and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the various functions or steps performed by the television 100 in the above method embodiment. Of course, the electronic device includes but is not limited to the above memory and one or more processors. For example, the structure of the electronic device can refer to Figure 3 The structure of the television 100 is shown.

[0172] The present application also provides a chip system, which can be applied to the electronic devices in the above embodiments. Figure 10 As shown, the chip system includes at least one processor 1501 and at least one interface circuit 1502. The processor 1501 can be the processor in the above-mentioned electronic device. The processor 1501 and the interface circuit 1502 can be interconnected via a line. The processor 1501 can receive and execute computer instructions from the memory of the above-mentioned electronic device through the interface circuit 1502. When the computer instructions are executed by the processor 1501, the electronic device can execute the various steps performed by the television 100 in the above-mentioned embodiment. Of course, the chip system can also include other discrete components, which are not specifically limited in this embodiment of the present application.

[0173] The embodiment of the present application further provides a computer-readable storage medium for storing computer instructions executed by the above-mentioned electronic device (such as the television 100).

[0174] An embodiment of the present application further provides a computer program product, comprising computer instructions executed by the above-mentioned electronic device (such as the television 100 ).

[0175] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0176] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0177] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0178] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0179] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0180] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for playing audio data, characterized in that: Used in electronic equipment, including: Collecting a facial image of a user currently using the electronic device; Obtaining playback parameters of the user based on the facial image; the user playback parameters include: at least one first value and at least one second value of frequency, and at least one first value and at least one second value of loudness, among audio parameters when the electronic device plays audio data; if the audio data played with the audio parameter at the first value does not meet the hearing needs of the user, the second value is the value of the audio parameter adjusted corresponding to the first value to meet the hearing needs of the user; Wherein, obtaining the playback parameter of the user based on the facial image includes: when the user is determined to be a new user based on the facial image, for each of all the to-be-tested values ​​of the audio parameter, if it is determined that the probability of the user not hearing clearly when the audio data is played with the to-be-tested value as the audio parameter is greater than or equal to a first threshold, obtaining a second value corresponding to the to-be-tested value to obtain the playback parameter of the user; the to-be-tested value corresponding to the user's to-be-tested probability greater than or equal to the first threshold is the first value; The value to be tested includes a frequency and multiple loudnesses, the multiple loudnesses are divided into one or more loudness intervals, and the inaudible probability includes: a ratio of the number of inaudible times of a certain frequency in a loudness interval to the total number of loudnesses in the loudness interval; According to the user's playback parameter, the audio parameter of the first audio data in the audio data to be played is adjusted to the corresponding second value and then played, wherein the first audio data is the audio data in the audio data to be played whose audio parameter has the first value.

2. The method for playing audio data according to claim 1, wherein: If it is determined that the probability that the user did not hear the audio data played with the value to be tested as the audio parameter is greater than or equal to a first threshold, obtaining a second value corresponding to the value to be tested to obtain the playback parameter of the user includes: controlling the electronic device to play audio data multiple times with the value to be tested as the audio parameter; receiving feedback data from the user each time the electronic device plays the audio data with the value to be tested as the audio parameter, the feedback data being used to indicate whether the user can clearly hear the audio data played with the value to be tested as the audio parameter; Determining, based on the plurality of feedback data of the user, a probability that the user did not hear clearly the audio data played with the audio parameter having the value to be tested; When the probability of the user not hearing clearly is greater than or equal to a first threshold, a second value corresponding to the value to be tested is obtained to obtain the playback parameter of the user.

3. The method for playing audio data according to claim 2, wherein: Before receiving the user's feedback data each time the electronic device plays audio data with the value to be tested as the audio parameter, the method further includes: After the electronic device plays audio data with the value to be tested as the audio parameter, displaying a first prompt window, the first prompt window including a first control and a second control; the first control is used for the user to confirm that the audio data played with the value to be tested is clearly audible, and the second control is used for the user to confirm that the audio data played with the value to be tested is not clearly audible; The feedback data is a triggering operation of the user on the first control or the second control; The determining, based on the plurality of feedback data of the user, a probability that the user did not hear clearly the audio data played with the to-be-tested value as the audio parameter, includes: Acquire, according to the plurality of feedback data of the user, the number of times the user triggers the second control; The probability of the user not hearing clearly is determined according to the number of times the second control is triggered and the total amount of the feedback data.

4. The method for playing audio data according to claim 1, wherein: If it is determined that the probability that the user did not hear the audio data played with the value to be tested as the audio parameter is greater than or equal to a first threshold, obtaining a second value corresponding to the value to be tested to obtain the playback parameter of the user includes: controlling the electronic device to play audio data multiple times using the value to be tested as the audio parameter; receiving a trigger operation of the user pressing the volume up key for the first time each time the electronic device plays audio data using the value to be tested as the audio parameter; the trigger operation being used by the user to confirm that the audio data played using the value to be tested is not clearly heard; Determining a probability that the user did not hear clearly the audio data played with the audio parameter set to the test value based on the total number of audio data played with the audio parameter set to the test value and the total number of trigger operations; When the probability of the user not hearing clearly is greater than or equal to a first threshold, a second value corresponding to the value to be tested is obtained to obtain the playback parameter of the user.

5. The method for playing audio data according to claim 1 or 4, characterized in that: The obtaining of a second value corresponding to the value to be tested includes: Querying a pre-stored correspondence for a second value corresponding to the value to be tested; or, A second value corresponding to the value to be tested is obtained from the server.

6. The method for playing audio data according to claim 2, wherein: The method further comprises: In the case where the user is determined to be a new user based on the facial image, the facial image of the user and the playback parameters of the user are correspondingly stored.

7. The method for playing audio data according to claim 1, wherein: The acquiring the playback parameters of the user according to the facial image includes: When it is determined based on the facial image that the user is not a new user, the playback parameters of the user are obtained locally based on the facial image; wherein the electronic device stores facial images and corresponding playback parameters of users who have used the electronic device.

8. An electronic device, characterized in that: include: Communication interface, processor, memory, bus; The memory is used to store computer-executable instructions, and the processor is connected to the memory via the bus; When the electronic device is running, the processor executes the computer-executable instructions stored in the memory, so that the electronic device executes the audio data playing method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the audio data playing method according to any one of claims 1 to 7.

Images