Audio playing method, audio playing device, storage medium and electronic equipment

Abstract

An audio playing method, an audio playing device, a storage medium and an electronic device, which relate to the field of audio processing, can adjust the volume according to the music being played, thereby protecting the hearing of a user. The audio playing method comprises the following steps: detecting the transmission distance in the ear canal of a user, determining the resonance frequency of the ear canal of the user, and obtaining a set of sound pressure level gains corresponding to the ear canal of the user according to the resonance frequency; obtaining the current volume of the earphone and the audio information of the music being currently played, determining a set of actual sound pressure levels corresponding to the audio information of the music being currently played according to the set of sound pressure level gains; obtaining the playing duration under the current volume of the earphone, calculating the hearing damage value of the playing duration period according to the set of actual sound pressure levels corresponding to the audio information of the music being currently played, comparing the hearing damage value with a hearing damage threshold, and adjusting the volume of the music being played.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of audio processing, in particular to an audio playing method, an audio playing device, a storage medium and an electronic device. BACKGROUND

[0002] With the rapid popularization of true wireless TWS earphones, more and more consumers choose to wear Bluetooth earphones for voice calls and music playing, and many users wear earphones for a long time, which causes strong dependence on earphones. Medical research shows that long-term wearing of earphones can cause irreversible damage to human hearing under the condition of poor volume control.

[0003] At present, the solution to volume control and protection of human hearing mainly detects the intensity decibel (db) of the earphone playing volume: when the intensity is too large to exceed the threshold, an alarm information is generated or the volume is forcibly reduced. However, different people have different feelings for the same volume intensity, and the earphone volume is not necessarily safe after being adjusted, and the volume is not adjusted in time and the adjustment method is not accurate. SUMMARY

[0004] The present application provides an audio playing method, an audio playing device, a storage medium and an electronic device, which can more accurately quantify the user's feeling for the sound volume of different users, thereby providing more accurate hearing protection.

[0005] In a first aspect, the present application provides an audio playing method, comprising:

[0006] detecting the transmission distance in the user's ear canal, determining the resonance frequency of the user's ear canal, and obtaining a set of sound pressure level gains corresponding to the user's ear canal according to the resonance frequency;

[0007] obtaining the current volume of the earphone and the audio information of the currently played music, and determining a set of actual sound pressure levels corresponding to the audio information of the currently played music according to the set of sound pressure level gains;

[0008] obtaining the playing duration under the current volume of the earphone, calculating the hearing damage value of the playing duration period according to the set of actual sound pressure levels corresponding to the audio information of the currently played music, comparing with the hearing damage threshold, and adjusting the volume of the played music.

[0009] According to the audio playing method in the embodiment, when the user wears the earphone, the transmission distance of the sound in the user's ear canal can be detected, the resonance frequency of the ear canal is determined according to the transmission distance, the set of sound pressure level gains of the sound in the user's ear is determined under the resonance frequency, and based on the current volume of the earphone and the audio information, the influence of the volume on the user's ear during song playing can be more accurately determined, so that the volume can be more accurately adjusted and more effective hearing protection can be improved.

[0010] In an example embodiment, the obtaining the set of sound pressure level gains in the ear canal of the user corresponding to the resonance frequency comprises:

[0011] dividing different frequency ranges based on the resonance frequency to obtain a set of sound pressure level gains corresponding to the user, the set of sound pressure level gains being used to indicate a plurality of sound pressure level gains in the ear canal of the user at different frequency ranges, wherein the sound pressure level gain is the largest when the frequency is the resonance frequency;

[0012] generating a corresponding gain amplitude reference table according to the set of sound pressure level gains and storing the gain amplitude reference table in a database.

[0013] In an example embodiment, the audio information is an audio frequency in the currently played music and a total time of the currently played music, the obtaining the current volume of the earphone and the audio information of the currently played music, and determining a set of actual sound pressure levels corresponding to the audio information of the currently played music according to the set of sound pressure level gains comprises:

[0014] dividing the currently played music into a plurality of audio segments according to different audio frequencies;

[0015] querying a sound pressure level gain corresponding to each audio segment from the gain amplitude reference table according to an audio frequency of each audio segment;

[0016] obtaining a corresponding sound pressure level played by a loudspeaker of the earphone based on the current volume of the earphone, and obtaining an actual sound pressure level of each audio segment according to the sound pressure level gain corresponding to each audio segment, wherein the set of actual sound pressure levels represents a plurality of actual sound pressure levels corresponding to different audio segments.

[0017] In an example embodiment, an average sound pressure level of the currently played music is calculated according to the actual sound pressure level of each audio segment , and the calculation formula is:

[0018]

[0019] wherein N is the total time of the currently played music, is the actual sound pressure level of each audio segment;

[0020] obtaining a playing duration at the current volume of the earphone, and calculating a hearing damage value of the playing duration period according to the set of actual sound pressure levels corresponding to the audio information of the currently played music comprises:

[0021] calculating a hearing damage value of the currently played song according to the average sound pressure level L and the total time of the currently played music;

[0022] The hearing impairment value of the played music and the corresponding playing time are accumulated to obtain a hearing impairment value of a playing duration period at a current volume.

[0023] In an example embodiment, the volume of the played music is adjusted in comparison with the hearing impairment threshold, specifically comprising:

[0024] If the hearing impairment value reaches 60%-80% of the hearing impairment threshold, an audio volume attenuation curve is obtained, and the current volume is reduced according to the audio volume attenuation curve.

[0025] In an example embodiment, the volume of the played music is adjusted in comparison with the hearing impairment threshold, specifically comprising:

[0026] When the hearing impairment value reaches the hearing impairment threshold, the current volume is reduced and a prompt is issued.

[0027] In an example embodiment, further comprising:

[0028] A music playlist is obtained, and a hearing impairment value of each music in the playlist is determined;

[0029] The order of the music to be played in the playlist is adjusted according to the hearing impairment value of the current playing duration period;

[0030] A learning model is generated based on the playing habits of the user, and a music order model of the user playlist is stored in the learning model.

[0031] In a second aspect, the present application provides an audio playing device, comprising:

[0032] A sound pressure level gain obtaining module is configured to detect the transmission distance in the ear canal of the user, determine the resonance frequency of the ear canal of the user, and obtain a sound pressure level gain set corresponding to the ear canal of the user according to the resonance frequency;

[0033] A sound pressure level determining module is configured to obtain the current volume of the earphone and the audio information of the currently played music, and determine a set of actual sound pressure levels corresponding to the audio information of the currently played music according to the sound pressure level gain set;

[0034] A calculation and adjustment module is configured to obtain a playing duration at the current volume of the earphone, calculate a hearing impairment value of a playing duration period according to the set of actual sound pressure levels corresponding to the audio information of the currently played music, and adjust the volume of the played music in comparison with the hearing impairment threshold.

[0035] In a third aspect, the present application provides an electronic device, comprising a memory and one or more processors. Wherein the memory stores one or more computer programs, and the computer programs comprise instructions which, when executed by the processor, cause the electronic device to perform the audio playing method in the first aspect.

[0036] In a fourth aspect, the present application provides a computer-readable storage medium, which stores instructions, and when the instructions are run on an electronic device, cause the electronic device to perform the audio playing method in the first aspect.

[0037] In a fifth aspect, the present application provides a computer program product, which, when run on an electronic device, causes the electronic device to perform the audio playing method in the first aspect.

[0038] It can be understood that the beneficial effects of the audio playing device, the electronic device, the computer-readable storage medium, and the computer program product provided above can refer to the beneficial effects of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0039] Figure 1 Flowchart of the audio playing method provided by the embodiments of the present application;

[0040] Figure 2 Schematic diagram of the human ear structure in the audio playing method provided by the embodiments of the present application;

[0041] Figure 3 Schematic diagram of the structure of the audio playing device provided by the embodiments of the present application;

[0042] Figure 4 Schematic diagram of the structure of the electronic device provided by the embodiments of the present application. DETAILED DESCRIPTION

[0043] For the convenience of clearly describing the technical solutions of the embodiments of the present application, in the embodiments of the present application, the terms "first", "second", etc. are used to distinguish the same or similar items with basically the same function and role. For example, the first chip and the second chip are merely used to distinguish different chips, and do not limit the sequence. Those skilled in the art can understand that the terms "first", "second", etc. do not limit the quantity and execution sequence, and the terms "first", "second", etc. also do not necessarily mean different. It should be noted that in the embodiments of the present application, the words "exemplary" or "for example" are used to represent an example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the words "exemplary" or "for example" are used to present the relevant concept in a specific manner. In the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more.

[0044] It should be noted that "at" in the embodiments of the present application can be at the moment when a certain condition occurs, or within a period of time after a certain condition occurs, which is not limited in the embodiments of the present application.

[0045] The implementation of the embodiments will be described in detail below with reference to the drawings.

[0046] The embodiments provide an audio playing method, which can provide more accurate hearing protection for a user.

[0047] Figure 1 A flowchart of an audio playing method provided by the embodiments of the present application is shown.

[0048] As Figure 1 shown, the audio playing method can include the following steps:

[0049] Step 101: detecting a transmission distance in an ear canal of a user, determining a resonance frequency of the ear canal of the user, and obtaining a set of sound pressure level gains corresponding to the ear canal of the user according to the resonance frequency.

[0050] The transmission distance refers to the distance between the sound outlet of the earphone and the eardrum. In the embodiments, the earphone sound outlet position has a microphone and a loudspeaker. After the user wears the earphone, the loudspeaker of the earphone sound outlet sends a low-frequency signal to the eardrum through the ear canal and the reflected signal is reflected back. The microphone of the earphone sound outlet receives the reflected signal of the low-frequency signal, and then calculates the transmission distance of the sound in the ear canal through the internal processor of the earphone. Alternatively, a distance sensor such as an optical sensor or an ultrasonic sensor is used to measure the transmission distance of the ear canal.

[0051] Sound pressure level gain refers to the degree to which the intensity (loudness) of sound increases within the ear; different resonant frequencies correspond to different sound pressure level gains. When resonance occurs, the amplitude of an object's vibration increases, thereby enhancing the sound intensity. For example... Figure 2 As shown, when headphones are worn, the audio signal travels through the ear canal to the eardrum. Due to the cavity formed by the ear canal and eardrum, the external auditory canal has a resonant pressure-boosting effect. The actual sound pressure at the eardrum is greater than the sound pressure emitted from the ear canal and headphones than the sound pressure emitted from the ear canal. For example, if the length of an adult's ear canal is 2.5cm, the resonant frequency of the external auditory canal can be calculated as follows: Resonant frequency = Speed ​​of sound / Wavelength of sound. The length of the external auditory canal is approximately 2.5cm, and the wavelength of the sound wave is four times that length. The speed of sound is 340m / s. Therefore, the resonant frequency of the external auditory canal is (1000 x 340) / (4 x 25) = 3400Hz. At this resonant frequency, the sound pressure in the external auditory canal can be increased by approximately 10-15dB before reaching the eardrum. Experimental data shows that the external auditory canal provides the most significant sound pressure level gain at frequencies between 2000-7000Hz. The sound pressure level gain set is the set of different amplification levels of the sound pressure in the external auditory canal at different frequencies after the resonant frequency is determined.

[0052] It should be noted that different users have different ear canal structures and distances. Users of different age groups, such as adults, teenagers, and children, have different distances in their ear canals. Furthermore, different headphone wearing methods will also affect the sound transmission distance in the ear canal, such as the depth of the headphones in the ear and the tightness of the fit. Therefore, users can re-acquire the transmission distance each time they wear headphones; or, the transmission distance can be re-acquired at regular intervals. If the fluctuation of the transmission distance exceeds the preset range, the transmission distance value is reset; if the fluctuation does not exceed the preset range, it remains unchanged.

[0053] Step 102: Obtain the current volume of the headphones and the audio information of the currently playing music, and determine the actual sound pressure level set corresponding to the audio information of the currently playing music based on the sound pressure level gain set.

[0054] The current volume of the headphones is the current volume set by the playback device. For example, if a pair of headphones is connected to a mobile phone and the volume is set to 60%, the sound pressure level output by the headphone speaker is 50dB. Music, such as songs, includes pop songs and instrumental songs. Pop songs include rock and soothing songs, and their frequency ranges are different. The closer the frequency is to the resonant frequency of the audio, the stronger the amplification gain effect at the eardrum. Any audio played from the headphone speaker will be amplified through the ear canal to reach the eardrum. Therefore, the actual sound pressure level set corresponding to the audio information of the currently played music can be determined by the sound pressure level gain set, that is, the actual sound pressure level that reaches the user's eardrum.

[0055] Step 103: Obtain the playing duration at the current volume of the earphone, calculate the hearing damage value of the playing duration period according to the actual sound pressure level set corresponding to the audio information of the currently played music, compare with the hearing damage threshold, and adjust the volume of the played music.

[0056] The hearing damage is determined by the sound pressure level of the currently played music and the playing duration of the earphone. After knowing the actual sound pressure level reaching the eardrum, the hearing damage value of the whole music song to the eardrum can be obtained in combination with the continuous playing time. Compared with the hearing damage threshold set by the user in advance, if the threshold is reached, it indicates that the user has reached the hearing damage threshold by using the earphone to listen to music. If the current volume continues to be used, it will cause damage to the hearing. Therefore, the volume is reduced to protect the hearing. The hearing damage can be more accurately controlled, and the protection of the hearing is realized.

[0057] The present scheme realizes real-time calculation of the sound pressure level set actually acting on the eardrum, accurate calculation of the hearing damage value of the played music, ensures the accuracy and scientificity of the volume adjustment, avoids the hearing damage risk caused by individual differences, reduces the potential damage to the hearing caused by long-term wearing of the earphone through continuous monitoring and adjustment of the volume, can timely adjust the volume when the user uses the earphone for a long time, realizes accurate protection of the hearing of the user, and improves the intelligent level of the earphone and the user experience.

[0058] Specifically, after the resonance frequency of the ear canal of the user is determined, the gain of the ear canal to the audio frequency at the resonance frequency is the largest. Different frequency ranges are divided based on the resonance frequency, and a sound pressure level gain set corresponding to the user is obtained. The sound pressure level gain set is used to indicate a plurality of sound pressure level gains of the user's ear canal at different frequency ranges. When the frequency is the resonance frequency, the sound pressure level gain is the largest.

[0059] In the embodiment, the frequency range is divided according to the preset frequency range interval starting from the resonance frequency, different frequency grades can be obtained, each frequency grade corresponds to a frequency range, and the gain corresponding to each frequency grade is determined in sequence. For example, the resonance frequency of the user's ear canal is 3400 Hz, the gain of the audio frequency of 3400 Hz in the music is the largest, and the sound pressure can be increased by 15 dB at the eardrum. With the decrease or increase of the frequency, the sound pressure level amplification effect gradually weakens. In this way, the sound pressure level gain corresponding to each frequency grade can be obtained according to the relationship that each 1000 Hz corresponds to a sound pressure level gain, that is, the gain degree of the user's ear canal to different audio frequencies. Since the receptor causing hearing damage of the human ear is closest to the eardrum, the size of the sound pressure level acting on the eardrum is judged, which is more real, and the calculation of the hearing damage value is more scientific and accurate.

[0060] After obtaining the corresponding relationship between each audio frequency and the sound pressure level gain, the sound pressure level gain set obtained can be used to generate a corresponding gain amplitude reference table, which is stored in the database; the gain amplitude reference table corresponding to the user is saved, and in subsequent use, the corresponding sound pressure level gain can be directly called from the database. Moreover, there can be multiple gain amplitude reference tables, which are all distinguished by the resonance frequency calculated based on the ear canal distance of the user, that is, each different resonance frequency corresponds to a different gain amplitude reference table.

[0061] Exemplarily, the gain amplitude reference table is shown in Table 1:

[0062] Table 1

[0063]

[0064] The frequency range of a complete song depends on the type of song, musical instruments, vocals, and production methods. Generally, the frequency range of a song can be from 20 Hz to 20,000 Hz (20 kHz), which is the complete frequency range that can be perceived by the human ear, however, different types of music and audio content cover different frequency ranges.

[0065] Further, the currently played music is divided into several audio segments according to different audio frequencies; generally, a complete song contains a total of audio segments, such as low frequency frequency segment (20-200 Hz), medium frequency frequency segment (200-5 kHz), and high frequency frequency segment (5 kHz-20 kHz). In this embodiment, the song is segmented according to the preset frequency range, that is, the audio of the song is divided into corresponding audio segments according to the range of the gain amplitude reference table, and according to the frequency segments <1000, 1000-2000, 2000-3000, 3000-3400, 3400, 3400-4000, 4000-5000, 5000-8000, >8000, reference Table 1.

[0066] Further, the sound pressure level gain corresponding to each audio segment is queried from the gain amplitude reference table according to the audio frequency of each audio segment; based on the current volume of the earphone, the corresponding sound pressure level played by the earphone speaker is obtained, and the actual sound pressure level of each audio segment is obtained according to the sound pressure level gain corresponding to each audio segment, wherein the actual sound pressure level set represents a plurality of actual sound pressure levels corresponding to different audio segments.

[0067] According to the frequency of each audio segment, the corresponding sound pressure level gain is queried from the gain amplitude table, and the sound pressure level gain information in different frequency segments of the song is obtained. In an embodiment, if the earphone volume is set to 60%, the sound pressure level of the earphone speaker output is 50dB, and the sound pressure level gain in the 3400Hz frequency segment is 15dB, then the actual sound pressure level reaching the eardrum is 65dB. The sound pressure level gain in other frequency segments can also be obtained from the gain amplitude table, that is, the corresponding sound pressure level gain of each frequency segment in a complete song is obtained, and based on the basis of 50dB, the actual sound pressure level set of each audio segment is obtained, that is, the amplified sound pressure level reaching the eardrum. Similarly, if the earphone volume is set to 70% and 80%, the actual sound pressure level will also change accordingly. The gain amplification of a song can be accurately obtained, and the sound pressure level gain of each frequency segment reaching the eardrum in the played song can be better judged.

[0068] More specifically, the average sound pressure level of the currently played music is calculated according to the actual sound pressure level of each audio segment The calculation formula is:

[0069]

[0070] Wherein, N is the total time of the currently played music, is the actual sound pressure level of each audio segment, and i represents the i-th audio segment.

[0071] In a complete song, different and discontinuous sound pressure levels are distributed, the scattered sound pressure levels are integrated, the continuous equivalent sound level is represented by the average sound pressure level, that is, the actual acting energy sound pressure level in a song is represented by L.

[0072] In an embodiment, after the gain amplitude table is determined, if the time of a song is 135 seconds, the actual sound pressure levels obtained after frequency division, gain compensation and amplification are 60db for a time period of 10 seconds, 70db for a time period of 45 seconds, 75db for a time period of 35 seconds, and 65db for a time period of 45 seconds. According to the above formula, the average sound pressure level of the song is:

[0073]

[0074]

[0075] Therefore, the average sound pressure level of the whole song is 71dB. Since each song generally has a short time, and the sound pressure level changes and is discontinuous and scattered, the average sound pressure level is used to determine the energy acting on the eardrum after listening to a song, that is, the actual average sound pressure level of each song, which is more scientific and accurate.

[0076] The hearing impairment value is determined by the sound pressure level and the duration. The average sound pressure level of the current song and the total playing time of the current song can be used to calculate the hearing impairment value of the current song. Similarly, the hearing impairment value of each song can be obtained by the above method, and the cumulative hearing impairment value of the user listening to the song at the current volume can be obtained. In this way, the hearing impairment value can be determined more accurately for each song or even the playing progress of each song, and the hearing impairment value of the user listening to the music continuously can be more accurately determined.

[0077] After obtaining the cumulative hearing impairment value of the user for the duration, the volume of the playing music is adjusted by comparing the hearing impairment value with the hearing impairment threshold.

[0078] In an embodiment, if the hearing impairment value reaches 60%-80% of the hearing impairment threshold, a volume attenuation curve is obtained, and the current volume is reduced according to the volume attenuation curve. Generally, when the hearing impairment threshold is reached, it means that continued listening at this volume will cause hearing impairment. Even if the volume is reduced, the hearing impairment value will continue to accumulate if the user continues to listen, and there will still be a risk of hearing impairment. Generally, the user will be prompted to stop using the earphone and rest after a short time, and such interruption will affect the user's experience. Therefore, a threshold of advance amount is set, and when the hearing impairment reaches 60%-80%, the current volume can be reduced according to the preset volume attenuation curve.

[0079] In this embodiment, according to the threshold of the advance amount, the volume adjustment function is started more accurately and scientifically after the hearing impairment received during the duration, the effect of hearing protection is achieved, and the listening time of the user is also prolonged. The current volume is reduced by the volume attenuation curve, which can gradually reduce the volume and reduce the impact on the user's experience. The threshold of the advance amount can be set according to the user's needs, such as 50%, 60%, 70%, 80%, etc.

[0080] The volume attenuation curve can be determined according to the actual volume and the hearing impairment threshold. For example, the attenuation curve can be x = t / T(S-S0), where x is the attenuation size of the volume, t is the duration of the song segment, T is the maximum safe duration, S is the actual volume, and S0 is the hearing impairment threshold. The maximum safe duration refers to the safe duration of listening to music within a certain frequency range. The safe duration corresponding to different frequency levels can be different, for example, 8 hours for low frequency, 6 hours for medium frequency, and 2 hours for high frequency.

[0081] In an embodiment, when the hearing impairment value reaches the hearing impairment threshold, the current volume is reduced and a prompt is issued. For example, when the cumulative hearing impairment value reaches the hearing impairment threshold, the current volume is immediately reduced and a prompt is issued to the user, reminding the user to pay attention to the earphone use time and rest in time to protect the hearing.

[0082] In an example embodiment, the method further comprises: adjusting the order of the music to be played in the playlist by the hearing impairment value of the current playing duration; and generating a learning model based on the user's playing habits, and storing the music order model of the user's playlist in the learning model.

[0083] The earphone can obtain the song playlist in the user's player, determine the sound pressure level gain corresponding to each audio segment of each song to be played according to the gain amplitude table corresponding to the user's resonance frequency. According to the frequency and the corresponding duration of the segmented audio, the resonance frequency calculated by comparing the user's ear canal, and the actual volume actually played by the earphone, the actual volume and the duration set actually reaching the eardrum are estimated by the preset gain amplitude table. The closer the audio frequency to the resonance frequency, the stronger the amplification gain effect reaching the eardrum, so that the sound pressure level size and the time set of a song acting on the eardrum can be obtained, and the average sound pressure level and the hearing impairment value of the song are calculated by the calculation formula.

[0084] According to the set, the hearing impairment can be quantified, and a learning model is generated by training based on the hearing impairment value of each song to be played. The hearing impairment value of the candidate song is determined by the learning model, and the volume of the candidate song is adjusted according to the hearing impairment value.

[0085] The candidate song can include the song currently played by the user, or any song in the playlist of other users. After calculating the hearing impairment value of each song to be played, these songs to be played can be used as training samples to build a learning model. The song information of the song to be played, such as audio information and song type, is used as the input of the learning model, and the hearing impairment value is used as the output to train the learning model. The trained learning model can predict the hearing impairment value of the candidate song according to the song information of the subsequent song input.

[0086] After calculating the hearing impairment value of each song to be played, the order of the song to be played can be adjusted. For example, the user's list of songs is played according to the hearing impairment value, or the song with a small hearing impairment value is played after a period of time with a large hearing impairment value, or a playlist for a certain period of time is generated according to the user's listening habits. If the user loops a single song or listens to songs with high hearing impairment values, the volume can be dynamically adjusted according to the volume decay curve within a set playing time, and gradually reduced.

[0087] The embodiment quantifies the relationship between hearing impairment according to the actual volume at the eardrum, the frequency and the duration of the song, and dynamically adjusts the volume of the output audio of the earphone, which can reduce the hearing impairment of the user.

[0088] Furthermore, this embodiment also provides an audio playback device that can be used to execute the above-described audio playback method. For example... Figure 3 As shown, the audio playback device 300 includes: a sound pressure level gain acquisition module 301, used to detect the transmission distance in the user's ear canal, determine the resonant frequency of the user's ear canal, and acquire a set of sound pressure level gains corresponding to the user's ear canal based on the resonant frequency; a sound pressure level determination module 302, used to acquire the current volume of the headphones and the audio information of the currently played music, and determine the actual sound pressure level set corresponding to the audio information of the currently played music based on the set of sound pressure level gains; and a calculation and adjustment module 303, used to acquire the playback duration at the current volume of the headphones, calculate the hearing impairment value of the playback duration based on the actual sound pressure level set corresponding to the audio information of the currently played music, compare it with the hearing impairment threshold, and adjust the volume of the played music.

[0089] In one exemplary embodiment, the sound pressure level gain acquisition module 301 is specifically used to divide different frequency ranges based on the resonant frequency to obtain a sound pressure level gain set corresponding to the user. The sound pressure level gain set is used to indicate multiple sound pressure level gains in the ear canal of the corresponding user at different frequency ranges, wherein the sound pressure level gain is the largest when the frequency is the resonant frequency. A corresponding gain amplitude lookup table is generated according to the sound pressure level gain set and stored in the database.

[0090] In one exemplary embodiment, the audio information is the audio frequency in the currently playing music and the total duration of the currently playing music. The sound pressure level determination module 302 is specifically used to divide the currently playing music into several audio segments according to different audio frequencies; look up the sound pressure level gain corresponding to each audio segment from the gain amplitude lookup table according to the audio frequency of each audio segment; obtain the corresponding sound pressure level played by the headphone speaker based on the current volume of the headphone; and obtain the actual sound pressure level of each audio segment according to the sound pressure level gain corresponding to each audio segment. The actual sound pressure level set represents multiple actual sound pressure levels corresponding to different audio segments.

[0091] In one exemplary embodiment, the average sound pressure level of the currently played music is calculated based on the actual sound pressure level of each audio segment. The calculation formula is:

[0092]

[0093] Where N is the total duration of the currently playing music. The actual sound pressure level of each audio segment; based on this, the adjusting module is specifically configured to: calculate a hearing damage value of the currently played song according to the average sound pressure level L and the total time of the currently played music; and accumulate the hearing damage value of the played music and the corresponding playing time to obtain a hearing damage value of a playing duration segment at the current volume.

[0094] In an example embodiment, the calculating adjusting module is further configured to: if the hearing damage value reaches 60%-80% of the hearing damage threshold, obtain a volume attenuation curve, and reduce the current volume according to the volume attenuation curve.

[0095] In an example embodiment, the calculating adjusting module is further configured to: when the hearing damage value reaches the hearing damage threshold, reduce the current volume and issue a prompt.

[0096] In an example embodiment, the apparatus further comprises a model generating module, which is specifically configured to: obtain a music playlist, determine a hearing damage value of each music in the playlist; adjust the order of the music to be played in the playlist through the hearing damage value of the current playing duration segment; generate a learning model based on the playing habits of the user, and store the music order model of the user playlist in the learning model.

[0097] The specific details of the modules or units in the above audio playing apparatus have been described in detail in the corresponding audio playing method, and thus will not be described here again.

[0098] Embodiments of the present application also provide an electronic device, Figure 4 A structural schematic diagram of an electronic device suitable for implementing embodiments of the present disclosure is shown. Figure 4 The electronic device 600 shown is only an example, and should not impose any limitation on the functions and use range of embodiments of the present disclosure.

[0099] As shown in Figure 4 The electronic device 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 602 or programs loaded from a storage portion 608 to a random access memory (RAM) 603. In the RAM 603, various programs and data required for system operation are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0100] The following components are connected to the I / O interface 605: an input section 606 including a keyboard and mouse, etc.; an output section 607 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as necessary. A removable media 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is attached to the drive 610 as necessary, so that a computer program read out therefrom is installed in the storage section 608 as necessary.

[0101] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable storage medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network by the communication section 609, and / or installed from the removable media 611. When the computer program is executed by the central processing unit (CPU) 601, the above-described functions defined in the embodiments of the present disclosure are executed.

[0102] For example, when the computer program is executed by the central processing unit (CPU) 601, the following can be performed: detecting a transmission distance in an ear canal of a user, determining a resonance frequency of the ear canal of the user, obtaining a set of sound pressure level gains corresponding to the ear canal of the user according to the resonance frequency; obtaining a current volume of a headset and audio information of currently played music, determining a set of actual sound pressure levels corresponding to the audio information of the currently played music according to the set of sound pressure level gains; obtaining a playing duration at the current volume of the headset, calculating a hearing damage value for a playing duration period according to the set of actual sound pressure levels corresponding to the audio information of the currently played music, comparing the hearing damage value with a hearing damage threshold, and adjusting a volume of the played music.

[0103] Note that the computer-readable medium shown in the disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium, for example, can be, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any combination thereof. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device. In the disclosure, the computer-readable signal medium can include a data signal that propagates in a baseband or as part of a carrier wave, in which the computer-readable program code is carried. Such a propagated data signal can take a variety of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium that is not a storage medium and that can be used to carry or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including, but not limited to, wireless, wireline, optical fiber, RF, etc., or any suitable combination of the above.

[0104] The flow diagrams and block diagrams in the drawings are illustrations of possible architectures, functions, and operations of systems, methods, and computer program products in accordance with various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code that comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or combinations of special purpose hardware and computer instructions.

[0105] The units described in the embodiments of the present disclosure can be implemented by software, or by hardware, or by a combination of software and hardware. The units described can also be located in a single processor. In some cases, the names of the units do not constitute a limitation on the units themselves.

[0106] As another aspect, the present application also provides a computer readable medium, which can be included in the electronic device described in the above embodiments, or can exist independently without being assembled into the electronic device. The computer readable medium carries one or more programs, which include instructions that, when executed by the electronic device, cause the electronic device to implement the method described in the above embodiments.

[0107] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, such division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units.

[0108] The above merely describes the specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An audio playback method, characterized in that, Applied to headphones, including: The transmission distance within the user's ear canal is detected, the resonant frequency of the user's ear canal is determined, and the sound pressure level gain set within the corresponding user's ear canal is obtained based on the resonant frequency. This includes: dividing different frequency ranges based on the resonant frequency to obtain a set of sound pressure level gains corresponding to the user, wherein the set of sound pressure level gains is used to indicate the various sound pressure level gains in the ear canal of the corresponding user at different frequency ranges, wherein the sound pressure level gain is the largest when the frequency is the resonant frequency; generating a corresponding gain amplitude lookup table based on the set of sound pressure level gains and storing it in a database; The system acquires the current volume of the headphones and the audio information of the currently playing music, and determines the actual sound pressure level set corresponding to the audio information of the currently playing music based on the sound pressure level gain set. The audio information includes the audio frequencies and total playback time of the currently playing music. The process involves acquiring the current headphone volume and the audio information of the currently playing music, and determining the actual sound pressure level set corresponding to the audio information of the currently playing music based on the sound pressure level gain set. Specifically, this includes: dividing the currently playing music into several audio segments according to different audio frequencies; looking up the sound pressure level gain corresponding to each audio segment from the gain amplitude lookup table according to the audio frequency of each audio segment; obtaining the corresponding sound pressure level played by the headphone speaker based on the current volume of the headphone; and obtaining the actual sound pressure level of each audio segment according to the sound pressure level gain corresponding to each audio segment, wherein the set of actual sound pressure levels represents multiple actual sound pressure levels corresponding to different audio segments; The system obtains the playback duration at the current headphone volume, calculates the average sound pressure level of the currently playing music based on the actual sound pressure level of each audio segment, calculates the hearing impairment value of the currently playing song based on the average sound pressure level and the total playback time of the currently playing music, accumulates the hearing impairment value of the already played music with the corresponding playback time to obtain the hearing impairment value of the playback duration at the current volume, compares it with the hearing impairment threshold, and adjusts the volume of the playing music accordingly.

2. The audio playback method according to claim 1, characterized in that, The average sound pressure level L of the currently playing music is calculated based on the actual sound pressure level of each audio segment. The calculation formula is as follows: Where N is the total duration of the currently playing music, and L i The actual sound pressure level for each audio segment.

3. The audio playback method according to claim 2, characterized in that, Compared to the hearing impairment threshold, adjust the volume of the music being played, specifically including: If the hearing loss value reaches 60%-80% of the hearing loss threshold, obtain the volume attenuation curve and reduce the current volume according to the volume attenuation curve.

4. The audio playback method according to claim 2, characterized in that, Compared to the hearing impairment threshold, adjust the volume of the music being played, specifically including: When the hearing loss value reaches the hearing loss threshold, the current volume is reduced and a prompt is issued.

5. The audio playback method according to claim 2, characterized in that, Also includes: Get the music playlist and determine the hearing impairment value of each song in the playlist; The order of music to be played in the playlist is adjusted based on the hearing impairment value during the current playback duration. A learning model is generated based on the user's playback habits, and the music order model of the user's playlist is stored in the learning model.

6. An audio playback device, characterized in that, include: The sound pressure level gain acquisition module is used to detect the transmission distance within the user's ear canal, determine the resonant frequency of the user's ear canal, and acquire a set of sound pressure level gains corresponding to the user's ear canal based on the resonant frequency. This includes: dividing different frequency ranges based on the resonant frequency to obtain a set of sound pressure level gains corresponding to the user; the set of sound pressure level gains indicates various sound pressure level gains within the user's ear canal at different frequency ranges, wherein the sound pressure level gain is maximum when the frequency is the resonant frequency; generating a corresponding gain amplitude lookup table based on the sound pressure level gain set and storing it in a database. The sound pressure level (SPL) determination module is used to acquire the current volume of the headphones and the audio information of the currently playing music, and determine the actual SPL set corresponding to the audio information of the currently playing music based on the SPL gain set. The audio information includes the audio frequencies in the currently playing music and the total playback time. The process of acquiring the current volume of the headphones and the audio information of the currently playing music, and determining the actual SPL set corresponding to the audio information of the currently playing music based on the SPL gain set, is described in the original text. Specifically, this includes: dividing the currently playing music into several audio segments according to different audio frequencies; looking up the sound pressure level gain corresponding to each audio segment from the gain amplitude lookup table according to the audio frequency of each audio segment; obtaining the corresponding sound pressure level played by the headphone speaker based on the current volume of the headphone; and obtaining the actual sound pressure level of each audio segment according to the sound pressure level gain corresponding to each audio segment, wherein the set of actual sound pressure levels represents multiple actual sound pressure levels corresponding to different audio segments; The calculation and adjustment module obtains the playback duration at the current volume of the headphones, calculates the average sound pressure level of the currently played music based on the actual sound pressure level of each audio segment, and calculates the hearing impairment value of the currently played song based on the average sound pressure level and the total playback time of the music. The hearing impairment value of the played music and the corresponding playback time are accumulated to obtain the hearing impairment value of the playback duration at the current volume, which is compared with the hearing impairment threshold to adjust the volume of the played music.

7. A computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the audio playback method as described in any one of claims 1 to 5.

8. An electronic device, characterized in that, The device includes a processor and a memory, the memory storing one or more computer programs, the one or more computer programs including instructions that, when executed by the electronic device, cause the electronic device to perform the audio playback method of any one of claims 1 to 5.

Images