Audio compensation method, device, equipment and medium based on the internal shape of the human ear

Abstract

The present application discloses an audio compensation method, device, equipment and medium based on the internal shape of the human ear, wherein the audio compensation method based on the internal shape of the human ear includes: detecting the thickness of the ear canal and the eardrum to generate the internal three-dimensional shape of the human ear, and obtaining the internal sound field of the human ear based on the internal three-dimensional shape of the human ear; comparing the internal three-dimensional shape of the human ear with the internal standard model of the human ear to obtain the area to be repaired; obtaining the audio frequency band of the area to be repaired corresponding to the internal sound field of the human ear; comparing the audio frequency band of the area to be repaired with the regional standard audio frequency band, and obtaining the difference between the damaged frequency band of the area as the audio compensation frequency band. This method can quickly, easily and individually solve the problem of limited hearing due to the internal shape of the human ear, without the need for expensive camera equipment, and can adapt to compensate for limited audio frequency bands, so that people with limited hearing can hear the audio frequency bands affected by the internal shape of the human ear again.

Description

Technical Field

[0001] The present invention relates to the technical field of audio information processing, and in particular to an audio compensation method, device, equipment and medium based on the internal shape of a human ear. Background Art

[0002] The human ear is divided into the inner auricle, ear canal and eardrum. The auricle has the function of determining the direction of the sound source and collecting and amplifying sound waves. The sound coming from the front enters the ear directly, while the sound coming from the back is blocked by the auricle, so it has a certain effect on sound positioning. The funnel-shaped auricle is conducive to collecting and amplifying sound waves. For example, in order to hear more clearly, people often curl up their palms and put them on top of the auricle to increase the length of the auricle and enhance the sound collection function of the auricle. For sounds in the 4000-5000Hz frequency band, the auricle can make the sound gain an additional enhancement of about 10dB (decibel), and the enhancement is related to the depth and cross-sectional area of ​​the auricle; the edge of the auricle also has a gain of several decibels on the sound pressure. The inner ear canal and eardrum are sound wave conduction channels. According to the principles of physics, a pipe with one end sealed has a resonance amplification effect on sound waves that are 4 times its length. Because the inner auditory canal and eardrum end in an elastic eardrum, which are S-shaped curved tubes, plus the resonance amplification effect of the concha, the inner auditory canal and eardrum can more obviously enhance the high-frequency portion of the incoming sound source, which helps the human ear to distinguish and understand the speech information in the sound.

[0003] When the auricle is deformed, even if the ear canal and eardrum are completely normal, it will also have a certain degree of impact on hearing; or if part of the ear canal or eardrum is blocked or closed, sound energy cannot be transmitted normally through the air and bone tissue. Currently, the detection of how the inside of the human ear affects hearing requires the use of large equipment such as CT or X-ray to take pictures of the inside of the human ear, which is costly and difficult to detect hearing defects in time. How to detect growth defects in the human ear in time and repair hearing has become an urgent problem to be solved. Summary of the invention

[0004] The embodiments of the present invention provide an audio compensation method, device, equipment and medium based on the internal shape of the human ear, so as to solve the problem of timely discovering growth defects inside the human ear and repairing hearing.

[0005] An audio compensation method based on the internal shape of a human ear, comprising:

[0006] Detect the thickness of the ear canal and eardrum to generate the three-dimensional shape of the inside of the human ear, and obtain the sound field inside the human ear based on the three-dimensional shape of the inside of the human ear;

[0007] Compare the three-dimensional shape of the inside of the human ear with the standard model of the inside of the human ear to obtain the area to be repaired;

[0008] Obtaining the audio frequency band of the area to be repaired corresponding to the sound field inside the human ear of the area to be repaired;

[0009] The audio frequency band of the area to be repaired is compared with the regional standard audio frequency band, and the difference between the damaged frequency bands of the area is obtained as the audio compensation frequency band.

[0010] Furthermore, the thickness of the ear canal and eardrum is detected to generate the three-dimensional shape of the inside of the human ear, including:

[0011] Use any of infrared, laser, infrasound and ordinary sound field detection methods to detect the internal shape of the human ear by measuring the thickness of the ear canal and eardrum, and obtain three-dimensional detection data of the internal part of the human ear;

[0012] Three-dimensional reconstruction is performed based on the three-dimensional detection data inside the human ear to generate the three-dimensional shape of the inside of the human ear.

[0013] Furthermore, based on the three-dimensional shape of the human ear, the sound field inside the human ear is obtained, including:

[0014] The sound field audio energy amplitude of the three-dimensional shape of the sound wave entering the human ear is simulated, and the sound field inside the human ear is generated based on the sound field audio energy amplitude.

[0015] Furthermore, the three-dimensional shape of the human ear is compared with the standard model of the human ear to obtain the area to be repaired, including:

[0016] The sound energy field comparison tool is used to compare the three-dimensional shape of the inside of the human ear with the standard model of the inside of the human ear one by one according to the sound field division area, and the area where the sound energy field difference is greater than the regional deformation difference threshold is obtained as the area to be repaired.

[0017] Furthermore, before comparing the audio frequency band of the area to be repaired with the regional standard audio frequency band, the method further includes:

[0018] Delimit the standard model inside the human ear to obtain multiple sound field division areas;

[0019] The standard sound field audio energy amplitude of the sound wave entering each sound field division area is simulated, and based on the standard sound field audio energy amplitude, a regional standard audio frequency band corresponding to each sound field division area is generated.

[0020] Furthermore, the audio frequency band of the area to be repaired is compared with the regional standard audio frequency band to obtain the difference of the damaged frequency band of the area as the audio compensation frequency band, including:

[0021] Obtain the frequency band difference between the audio frequency band of the area to be repaired and the standard audio frequency band;

[0022] The frequency band difference is used as the regional damaged frequency band difference.

[0023] Furthermore, the human ear internal standard model includes sound field division regions and a regional deformation difference threshold corresponding to each sound field division region;

[0024] After obtaining the area to be repaired, it also includes:

[0025] Acquire a corresponding sound field division area based on the area to be repaired, and a regional deformation difference threshold corresponding to the sound field division area;

[0026] The deformation gap threshold corresponding to each area to be repaired and the area to be repaired is recorded to generate a detection result of the internal shape of the human ear to be repaired.

[0027] An audio compensation device based on the internal shape of a human ear, comprising:

[0028] A module for obtaining the sound field inside the human ear is used to detect the thickness of the ear canal and the eardrum, generate a three-dimensional shape inside the human ear, and obtain the sound field inside the human ear based on the three-dimensional shape inside the human ear;

[0029] A module for obtaining an area to be repaired is used to compare the three-dimensional shape of the inside of the human ear with a standard model of the inside of the human ear to obtain an area to be repaired;

[0030] An audio frequency band acquisition module is used to acquire the audio frequency band of the area to be repaired corresponding to the sound field inside the human ear of the area to be repaired;

[0031] The compensation frequency band acquisition module is used to compare the audio frequency band of the area to be repaired with the regional standard audio frequency band, and obtain the difference between the damaged frequency bands in the area as the audio compensation frequency band.

[0032] A device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned audio compensation method based on the internal shape of the human ear when executing the computer program.

[0033] A computer-readable medium stores a computer program, and when the computer program is executed by a processor, the audio compensation method based on the internal shape of the human ear is implemented.

[0034] The above-mentioned audio compensation method, device, equipment and medium based on the internal shape of the human ear obtain the three-dimensional shape of the inside of the human ear by detecting the thickness of the ear canal and the eardrum, and obtain the audio frequency band of the area to be repaired on the area to be repaired after comparing it with the standard model of the inside of the human ear, thereby directly obtaining the audio compensation frequency band, which can quickly, easily and personalized solve the problem of limited hearing due to the internal shape of the human ear, without the need to use expensive photographic equipment, and can adapt to compensate for limited audio frequency bands, so that people with limited hearing can hear the audio frequency bands affected by the internal shape of the human ear again. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0036] Figure 1 A schematic diagram of an application environment of an audio compensation method based on the internal shape of a human ear according to an embodiment of the present invention is shown;

[0037] Figure 2 A first flow chart of an audio compensation method based on the internal shape of a human ear in a first embodiment of the present invention is shown;

[0038] Figure 3 A second flow chart of the audio compensation method based on the internal shape of the human ear in the second embodiment of the present invention is shown;

[0039] Figure 4 A third flow chart of an audio compensation method based on the internal shape of a human ear in a third embodiment of the present invention is shown;

[0040] Figure 5 A fourth flow chart of an audio compensation method based on the internal shape of a human ear in a fourth embodiment of the present invention is shown;

[0041] Figure 6 A fifth flow chart of an audio compensation method based on the internal shape of a human ear in a fifth embodiment of the present invention is shown;

[0042] Figure 7 A schematic diagram of an audio compensation device based on the internal shape of a human ear according to an embodiment of the present invention is shown;

[0043] Figure 8 A schematic diagram of an apparatus according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] The audio compensation method based on the internal shape of the human ear provided by the embodiment of the present invention can be applied in the following aspects: Figure 1In an application environment, the audio compensation method based on the internal shape of the human ear is applied in an audio compensation system based on the internal shape of the human ear, and the audio compensation system based on the internal shape of the human ear includes a client and a server, wherein the client communicates with the server through a network. The client, also known as the user end, refers to a program corresponding to the server that provides local services to the client. Furthermore, the client is a computer-side program, an APP program for a smart device, or a third-party applet embedded in other APPs. The client can be installed on, but not limited to, various personal computers, laptops, smart phones, tablet computers, portable wearable devices and other devices. The server can be implemented with an independent server or a server cluster consisting of multiple servers.

[0046] In one embodiment, if Figure 2 As shown, a method for audio compensation based on the internal shape of the human ear is provided, and the method is applied in Figure 1 The server in the example is used as an example, and the specific steps include the following:

[0047] S10. Detect the thickness of the ear canal and the eardrum, generate the three-dimensional shape of the inside of the human ear, and obtain the sound field inside the human ear based on the three-dimensional shape of the inside of the human ear.

[0048] The human ear includes the ear canal and eardrum, which are structures that collect sound. After the ear canal and eardrum collect the sound, they transmit it to the eardrum. The auricle is mainly composed of cartilage and skin. The inner ear canal and the outer part of the eardrum are part of the cartilage. The ear canal and eardrum of an adult are about 2.5 to 3.5 cm long, and there is a part of the bone structure inside. In addition to the bone structure, there are skin and mucous membranes, and relatively less subcutaneous tissue.

[0049] The ear canal and eardrum are long from the anterior lower wall (3.1cm) to the posterior upper wall (2.5cm). The outer 1 / 3 of the ear canal and eardrum are cartilaginous, and the inner 2 / 3 are based on bones, which are bony inner ear canal and eardrum. The two junctions are relatively narrow; the narrow part is about 2cm away from the ear opening. The narrowest part of the inner ear canal and eardrum is called the isthmus, which can prevent some foreign objects from entering the inner ear canal and eardrum and prevent damage to the eardrum.

[0050] The auricle is a part of the human ear that collects sound waves. Most of it is supported by elastic cartilage and covered with skin. The subcutaneous tissue is small and dense, rich in blood vessels and nerves.

[0051] Sound is a mechanical wave (sound wave) with a certain wavelength range that is emitted by an object. The human auricle-type satellite receiver can receive mechanical waves (sound waves) and gather them into the ear canal and eardrum, and then transmit them to the eardrum, causing mechanical fluctuations in the eardrum. The mechanical fluctuations of the eardrum can drive the ossicles connected to it, and the movement of the ossicles can mechanically fluctuate the oval window membrane, the portal of the inner ear, so that the lymph fluid in the inner ear produces mechanical fluctuations, which reaches the basilar membrane of the inner ear and stimulates the sound-sensitive cells (hair cells) on the basilar membrane that are sensitive to different wavelengths to produce corresponding potential changes. At this time, the sound energy is converted into biological signals (electrical energy).

[0052] The electrical signals corresponding to the sound are gathered in the auditory nerve, and then transmitted to the auditory center in the brain through the auditory nerve. At this time, people can "hear" the sound. The auditory center is similar to an intelligence research institute, which classifies, numbers and analyzes the transmitted bioelectric signals so that the brain can understand the meaning of the received sound waves and then respond.

[0053] The three-dimensional shape of the inside of the human ear is the displayable simulated three-dimensional appearance of a listener's ear canal and eardrum.

[0054] The sound field inside the human ear is the area inside the human ear where sound waves exist. The physical quantities that describe the sound field can be sound pressure, particle vibration velocity, displacement or medium density, etc., which are generally functions of position and time. The relationship between the changes of these physical quantities in the sound field with spatial position and with time is described by the acoustic wave equation. Solving the sound wave equation that satisfies the boundary conditions can reveal the distribution of the sound field with space, its changes with time, and its energy relationship.

[0055] S20. Compare the three-dimensional shape of the interior of the human ear with the standard model of the interior of the human ear to obtain the area to be repaired.

[0056] Among them, the standard model of the human ear is the average value of the anatomical shape of the ear constructed according to the internal shape of the human ear such as age, gender, etc. It can be understood that if the prerequisites for the average value of the internal shape of the human ear are sufficient, the standard model of the human ear is accurate. The standard adult ear has a complex standard: the auricle is symmetrical on both sides, located on both sides of the skull, about 6.0cm long, about 3.2cm wide, and the length-to-width ratio is about 7:4. When viewed from the side, the angle between the auricle and the median perpendicular line of the face is about 8-10°; when viewed from the back, the angle between the auricle and the side wall of the skull is about 30°; the upper edge of the auricle is flush with the horizontal line of the eyebrows, and the lower edge is flush with the horizontal line of the base of the columella. The line connecting the upper edge of the auricle and the eyebrows is the same as the line connecting the lower edge of the auricle and the base of the columella, which roughly form two parallel lines.

[0057] Specifically, some listeners have internal ear deformities, which are mainly manifested by deformities and distortions of the auricle cartilage and abnormal morphology of certain substructures, including: protruding ears, cup-shaped ears, hidden ears, butterfly ears, ape ears, attached ears, shell ears, and oversized tragus. Listeners with milder deformities only show that the outer periphery of the auricle is not smooth enough and the shape is not beautiful. Patients with severe deformities may show more serious symptoms such as drooping ears and hidden ears, which affect hearing. Auricle deformities can be congenital or acquired. Among them, congenital causes are often not simply deformities of the auricle, but also accompanied by abnormalities in the thickness of the inner auditory canal, eardrum, middle ear and other structures. Acquired factors such as auricle trauma and infection can also cause severe auricle deformities, some of which can be complicated by stenosis or closure of the inner auditory canal, thickening of the eardrum, etc. Changes in the thickness of the auricle, inner auditory canal, and eardrum can also produce hearing loss of about 60dB.

[0058] In this embodiment, by comparing the three-dimensional shape of the inside of the human ear with a standard model of the inside of the human ear, an area whose deformation exceeds an acceptable deformation range is obtained and set as an area to be repaired, so as to repair the hearing impairment problem caused by the area to be repaired.

[0059] S30. Obtaining the audio frequency band of the area to be repaired corresponding to the sound field inside the human ear of the area to be repaired.

[0060] The audio frequency band of the area to be repaired is the sum of the audio frequency bands propagated in the area to be repaired.

[0061] Specifically, since the area to be repaired is deformed relative to the normal internal shape of the human ear, the deformed position may constitute a restriction in audio propagation. In order to locate the impact of changes in sound sensitivity characteristics such as the auricle structure, sound hole, wall thickness, etc. on the audio frequency band composition, it is necessary to obtain a propagation simulation of the audio frequency band of sound waves in the internal sound field of the human ear within the area.

[0062] S40. Compare the audio frequency band of the area to be repaired with the regional standard audio frequency band, and obtain the difference between the damaged frequency bands of the area as the audio compensation frequency band.

[0063] Among them, the regional standard audio frequency band is specifically subdivided according to the internal shape of the human ear, and the average audio frequency band in each area is obtained by dividing the internal area of ​​the human ear according to the areas where similar waveforms or frequency bands are located.

[0064] Specifically, the sound frequency range that a normal human ear can perceive is between 20-20000Hz, but this does not mean that all these sounds can be heard. The frequency of ordinary people's speech sounds is mainly concentrated in 500-4000Hz, so if a person's hearing loss decreases in these frequency ranges, it will be more obvious and will obviously affect daily language communication, making it easier to be discovered. Protecting the hearing range of 500-4000Hz will not affect daily language communication.

[0065] Audio has low frequency, medium frequency and high frequency bands. Among them, low frequency: also known as the low frequency band, includes the frequency band of audio emitted by bass drums, bass drums, bass guitars, double bass, electric bass, etc. The sounds of cellos, male voices, pianos, guitars, etc. also extend to the low frequency band.

[0066] Good bass will give people a shocking feeling when it reaches the ears through resonance. The real high-quality bass output is not distorted, not mixed or scattered, powerful and clean. It is concentrated at one point and has a high-quality effect.

[0067] Mid-frequency: The mid-frequency band is the most important band and the band to which the human ear is most sensitive. No matter how good the high and low frequencies are, if there is a problem with the mid-frequency, there is no room for recovery. If the mid-frequency is good, even if there are slight problems with the high and low frequencies, they are often audible. The mid-frequency affects the brightness, clarity and transparency of the sound. A good mid-frequency creates a mellow auditory effect.

[0068] High frequency: In addition to high audio frequency, good high frequency should also be smooth, free of burrs and extendable.

[0069] The audio compensation frequency band provided in this embodiment can compensate for the generally missing audio segments, and can also be enhanced according to the auditory effects of the low, medium and high frequencies to achieve a good auditory enhancement effect. For example, compensating for the bass can create a shocking auditory effect, compensating for the medium frequency segment can create a mellow auditory effect, and compensating for the high frequency can create an auditory effect that can extend and prolong the sound effect.

[0070] The audio compensation method based on the internal shape of the human ear provided in this embodiment obtains the three-dimensional shape of the inside of the human ear by detecting the shape of the ear canal and the thickness of the eardrum, and obtains the audio frequency band of the area to be repaired on the area to be repaired after comparing it with the standard model of the inside of the human ear, thereby directly obtaining the audio compensation frequency band, which can quickly, easily and personalized solve the problem of limited hearing due to the internal shape of the human ear, without the need to use expensive photographic equipment, and can adapt to compensate for limited audio frequency bands, so that people with limited hearing can hear the audio frequency bands affected by the internal shape of the human ear again.

[0071] In a specific embodiment, if Figure 3 As shown, in step S10, the thickness of the ear canal and the eardrum is detected to generate the three-dimensional shape of the inside of the human ear, which specifically includes the following steps:

[0072] S11. Use any one of infrared, laser, infrasound and ordinary sound field detection methods to detect the thickness of the ear canal and eardrum to detect the internal shape of the human ear and obtain three-dimensional detection data of the inside of the human ear.

[0073] S12. Perform three-dimensional reconstruction based on the three-dimensional detection data of the inside of the human ear to generate the three-dimensional shape of the inside of the human ear.

[0074] Among them, the detection methods that can be used to detect the thickness of the ear canal and the eardrum and the internal shape of the human ear include infrasound, infrared, laser, ordinary 20-20KHZ sound field detection methods, etc.

[0075] Specifically, sound waves have penetrating properties and can be used to detect the internal structure of elastic media, such as human tissue. This embodiment can obtain the thermal radiation signal, laser light spot, infrasound vibration signal or ordinary sound field energy vibration signal of the sound wave inside the human ear as the three-dimensional detection data inside the human ear through any one of infrared, laser, infrasound and ordinary sound field detection methods, and redraw the three-dimensional detection data inside the human ear through three-dimensional reconstruction tools such as openMVS, etc., to obtain and store the three-dimensional shape of the human ear corresponding to the listener.

[0076] This embodiment does not need to use expensive CT or X-ray photography equipment to obtain the three-dimensional shape of the inside of the listener's ear, which reduces the cost of generating the three-dimensional shape of the inside of the human ear and is conducive to wide application.

[0077] In a specific embodiment, in step S10, based on the three-dimensional shape of the human ear, the sound field inside the human ear is obtained, which specifically includes the following steps:

[0078] S13. Simulate the three-dimensional sound field audio energy amplitude of the sound wave entering the human ear, and generate the sound field inside the human ear based on the sound field audio energy amplitude.

[0079] Specifically, the process of sound wave propagation in an elastic medium can be modeled as the process of elastic medium particles moving under force, similar to the propagation process of water waves. The propagation process of sound waves in elastic media such as the three-dimensional shape inside the human ear is simulated and modeled. Sound waves propagate in the three-dimensional shape inside the human ear. Through the sound wave receiver, the sound wave signal reflected by the three-dimensional shape inside the human ear can be received, and a series of redrawings of the reflected sound wave signal can generate the sound field inside the human ear, depicting the specific audio frequency bands where the sound wave propagates and reflects at each position inside the human ear.

[0080] In a specific embodiment, in step S20, the three-dimensional shape of the interior of the human ear is compared with a standard model of the interior of the human ear to obtain the area to be repaired, which specifically includes the following steps:

[0081] S21. Use the sound energy field comparison tool to compare the three-dimensional shape of the human ear and the standard model of the human ear one by one according to the sound field division area, and obtain the area where the sound energy field difference is greater than the regional deformation difference threshold as the area to be repaired.

[0082] Among them, the sound field division area is the area where the same audio frequency band is relatively concentrated in the sound field inside the human ear due to the shape of the inner and outer surfaces of the human ear, which is the area divided by the same sound field.

[0083] The regional deformation difference threshold is the threshold of the maximum acceptable range of change in a certain sound field division area. For example, the acceptable range of change of the wall thickness at a certain position of the three-dimensional shape inside the human ear is 0.1%. If the listener's wall thickness variation range in this area is greater or less than 0.1% of the standard model inside the human ear at the same position, then the area should be determined as an area to be repaired and recorded and reported.

[0084] Specifically, in this embodiment, the three-dimensional shape of the interior of the human ear may be cut into regions according to the sound field divisions and then compared one by one with the outer surface shape of the standard model of the interior of the human ear.

[0085] In a specific embodiment, if Figure 4 As shown, before step S20, that is, before comparing the audio frequency band of the area to be repaired with the regional standard audio frequency band, the following steps are specifically included:

[0086] S201. Delimit the standard model inside the human ear to obtain multiple sound field division areas.

[0087] S202. Simulate the standard sound field audio energy amplitude of the sound wave entering each sound field divided area, and generate a regional standard audio frequency band corresponding to each sound field divided area based on the standard sound field audio energy amplitude.

[0088] Specifically, the process of simulating the standard sound field audio energy amplitude of sound waves entering each sound field division area in this embodiment is the same as the process of producing the sound field inside the human ear, which will not be repeated here, that is, the process of obtaining the sound field corresponding to the standard model inside the human ear.

[0089] The sound field corresponding to the standard model inside the human ear is divided according to the sound field division areas, and the regional standard audio frequency band corresponding to each sound field division area can be obtained, which is used for subsequent comparison with the audio frequency band that the listener can actually hear in each area, so as to obtain the frequency band range of audio loss caused by the sound obstruction caused by the shape of the internal and external surfaces of the human ear.

[0090] In a specific embodiment, if Figure 5 As shown, in step S40, the audio frequency band of the area to be repaired is compared with the regional standard audio frequency band, and the difference between the regional damaged frequency band is obtained as the audio compensation frequency band, which specifically includes the following steps:

[0091] S41. Obtain a frequency band difference between the audio frequency band of the area to be repaired and the standard audio frequency band.

[0092] S42. Use the frequency band difference as the regional damaged frequency band difference.

[0093] Specifically, the frequency band difference between the audio frequency band of the area to be repaired and the standard audio frequency band is the frequency band difference of the damaged area that needs to be compensated for the sound of the listener.

[0094] Furthermore, the difference in the damaged frequency band in the area can be accurately compensated or enhanced based on the application scenario. For example, for conversation, accurate compensation can be performed to achieve normal communication; for listening to music and other scenarios, in addition to accurately compensating the difference in the damaged frequency band in the area, the sound effects of the audio frequency band can also be enhanced based on the set sound effects according to the sound effects set by the listener.

[0095] In a specific embodiment, the human ear internal standard model includes sound field division regions and a regional deformation difference threshold corresponding to each sound field division region. Figure 6 As shown, after step S20, that is, after obtaining the area to be repaired, the following steps are specifically included:

[0096] S203. Acquire the corresponding sound field division area based on the area to be repaired, and the regional deformation difference threshold corresponding to the sound field division area.

[0097] S204. Record each area to be repaired and the deformation gap threshold corresponding to the area to be repaired, and generate a detection result of the internal shape of the human ear to be repaired.

[0098] Specifically, this embodiment can record each area to be repaired and the deformation difference threshold corresponding to the area to be repaired, and generate a detection result to be repaired of the internal shape of the human ear, so that the listener can find the repair mechanism according to the detection result to be repaired for targeted physical repair, etc., thereby reducing the cost of using expensive photographic equipment to obtain the lesion area.

[0099] The audio compensation method based on the internal shape of the human ear provided in this embodiment obtains the three-dimensional shape of the inside of the human ear by detecting the thickness of the ear canal and the eardrum, and obtains the audio frequency band of the area to be repaired on the area to be repaired after comparing it with the standard model of the inside of the human ear, thereby directly obtaining the audio compensation frequency band. The problem of limited hearing due to the internal shape of the human ear can be solved quickly, easily and personalized without the need to use expensive photographic equipment, and the limited audio frequency band can be adapted to compensate, so that people with limited hearing can hear the audio frequency band affected by the internal shape of the human ear again.

[0100] This embodiment clearly detects the auricle and hearing impairment of the human body, and then matches the corresponding electronic equipment on-site or automatically to improve the hearing effect, achieve dedicated use for specific people, and reproduce beautiful hearing and musical melody.

[0101] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0102] In one embodiment, an audio compensation device based on the internal shape of a human ear is provided, and the audio compensation device based on the internal shape of a human ear corresponds one-to-one with the audio compensation method based on the internal shape of a human ear in the above embodiment. Figure 7 As shown, the audio compensation device based on the internal shape of the human ear includes a module 10 for obtaining the internal sound field of the human ear, a module 20 for obtaining the area to be repaired, a module 30 for obtaining the audio frequency band, and a module 40 for obtaining the compensation frequency band. The functional modules are described in detail as follows:

[0103] The module 10 for obtaining the sound field inside the human ear is used to detect the thickness of the ear canal and the eardrum, generate the three-dimensional shape of the inside of the human ear, and obtain the sound field inside the human ear based on the three-dimensional shape of the inside of the human ear.

[0104] The module 20 for obtaining the area to be repaired is used to compare the three-dimensional shape of the inside of the human ear with the standard model of the inside of the human ear to obtain the area to be repaired.

[0105] The audio frequency band obtaining module 30 is used to obtain the audio frequency band of the area to be repaired corresponding to the sound field inside the human ear of the area to be repaired.

[0106] The compensation frequency band acquisition module 40 is used to compare the audio frequency band of the area to be repaired with the regional standard audio frequency band, and obtain the difference between the regional damaged frequency band as the audio compensation frequency band.

[0107] For the specific definition of the audio compensation device based on the internal shape of the human ear, please refer to the definition of the audio compensation method based on the internal shape of the human ear mentioned above, which will not be repeated here. Each module in the above-mentioned audio compensation device based on the internal shape of the human ear can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the device in the form of hardware, or can be stored in the memory in the device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0108] In one embodiment, a device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 8 As shown. The device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the device is used to provide computing and control capabilities. The memory of the device includes a non-volatile medium and an internal memory. The non-volatile medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile medium. The database of the device is used for data related to an audio compensation method based on the internal shape of the human ear. The network interface of the device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an audio compensation method based on the internal shape of the human ear is implemented.

[0109] In one embodiment, a device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the audio compensation method based on the internal shape of the human ear of the above embodiment is implemented, for example Figure 2 Alternatively, when the processor executes the computer program, the functions of each module / unit of the audio compensation device based on the internal shape of the human ear in the above-mentioned embodiment are realized, for example Figure 7 The functions of the modules 10 to 40 are shown in Figure 1. To avoid repetition, they will not be described in detail here.

[0110] In one embodiment, a computer readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the audio compensation method based on the internal shape of the human ear of the above embodiment is implemented, for example Figure 2 Alternatively, when the computer program is executed by the processor, the functions of each module / unit in the audio compensation device based on the internal shape of the human ear in the above device embodiment are realized, for example Figure 7 The functions of the modules 10 to 40 are shown in Figure 1. To avoid repetition, they will not be described in detail here.

[0111] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments of the present application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0112] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0113] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention.

Claims

1. An audio compensation method based on the internal shape of the human ear, characterized in that: include: Detecting the thickness of the ear canal and the eardrum to generate a three-dimensional shape of the inside of the human ear, and obtaining the sound field inside the human ear based on the three-dimensional shape of the inside of the human ear; Comparing the three-dimensional shape of the interior of the human ear with a standard model of the interior of the human ear to obtain an area to be repaired; Acquire the audio frequency band of the area to be repaired corresponding to the sound field inside the human ear of the area to be repaired; The audio frequency band of the area to be repaired is compared with the regional standard audio frequency band, and the difference between the damaged frequency bands of the area is obtained as the audio compensation frequency band.

2. The audio compensation method based on the internal shape of the human ear according to claim 1, characterized in that: The detecting of the thickness of the ear canal and the eardrum to generate the three-dimensional shape of the inside of the human ear includes: Use any of infrared, laser, infrasound and ordinary sound field detection methods to detect the internal shape of the human ear by measuring the thickness of the ear canal and eardrum, and obtain three-dimensional detection data of the internal part of the human ear; Three-dimensional reconstruction is performed based on the three-dimensional detection data of the inside of the human ear to generate the three-dimensional shape of the inside of the human ear.

3. The audio compensation method based on the internal shape of the human ear according to claim 1, characterized in that: The step of obtaining the sound field inside the human ear based on the three-dimensional shape inside the human ear includes: The audio energy amplitude of the sound field of the three-dimensional shape of the sound wave entering the human ear is simulated, and the sound field inside the human ear is generated based on the audio energy amplitude of the sound field.

4. The audio compensation method based on the internal shape of the human ear according to claim 1, characterized in that: The step of comparing the three-dimensional shape of the interior of the human ear with a standard model of the interior of the human ear to obtain the area to be repaired includes: A sound energy field comparison tool is used to compare the three-dimensional shape of the human ear and the standard model of the human ear one by one according to the sound field division area, and the area where the sound energy field difference is greater than the regional deformation difference threshold is obtained as the area to be repaired.

5. The audio compensation method based on the internal shape of the human ear according to claim 1, characterized in that: Before comparing the audio frequency band of the area to be repaired with the regional standard audio frequency band, the method further includes: Delimiting the standard model inside the human ear to obtain a plurality of sound field division areas; The standard sound field audio energy amplitude of the sound wave entering each of the sound field division areas is simulated, and based on the standard sound field audio energy amplitude, a regional standard audio frequency band corresponding to each of the sound field division areas is generated.

6. The audio compensation method based on the internal shape of the human ear according to claim 1, characterized in that: The step of comparing the audio frequency band of the area to be repaired with the regional standard audio frequency band to obtain the difference between the damaged frequency bands of the area as the audio compensation frequency band includes: Obtaining a frequency band difference between the audio frequency band of the area to be repaired and the standard audio frequency band; The frequency band difference is used as the damaged frequency band difference of the area.

7. The audio compensation method based on the internal shape of the human ear according to claim 1, characterized in that: The human ear internal standard model includes sound field division areas and a regional deformation gap threshold corresponding to each of the sound field division areas; After obtaining the area to be repaired, the method further includes: Acquire the corresponding sound field division area based on the area to be repaired, and the regional deformation difference threshold corresponding to the sound field division area; Record each of the to-be-repaired regions and the deformation gap threshold corresponding to the to-be-repaired region, and generate a to-be-repaired detection result of the internal shape of the human ear.

8. An audio compensation device based on the internal shape of the human ear, characterized in that: include: A module for obtaining the sound field inside the human ear is used to detect the thickness of the ear canal and the eardrum, generate a three-dimensional shape inside the human ear, and obtain the sound field inside the human ear based on the three-dimensional shape inside the human ear; A module for obtaining an area to be repaired is used to compare the three-dimensional shape of the inside of the human ear with a standard model of the inside of the human ear to obtain an area to be repaired; An audio frequency band acquisition module is used to acquire the audio frequency band of the area to be repaired corresponding to the sound field inside the human ear of the area to be repaired; The compensation frequency band acquisition module is used to compare the audio frequency band of the area to be repaired with the regional standard audio frequency band, and obtain the difference between the damaged frequency bands in the area as the audio compensation frequency band.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the audio compensation method based on the internal shape of the human ear is implemented as claimed in any one of claims 1 to 7.

10. A computer-readable medium storing a computer program, characterized in that: When the computer program is executed by a processor, the audio compensation method based on the internal shape of the human ear as claimed in any one of claims 1 to 7 is implemented.

Images