Method for monitoring hearing by using visual data
Through the visual data monitoring method, utilizing the computer, auditory encoding device and display device in the hearing monitoring system, combined with visual and auditory stimulation, efficient and accurate monitoring of hearing status is achieved, solving the problem of low efficiency in detecting hearing status in the existing technology.
Patent Information
- Application Number
- CN202511084163.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-04
- Publication Date
- 2025-10-03
AI Technical Summary
The existing methods for detecting hearing status are single and inefficient, and are unable to detect hearing loss in a timely manner and conduct early intervention.
Through the visual data monitoring method, using the computer, auditory encoding device, sound device and display device in the hearing monitoring system, combined with visual and auditory stimulation, the subjects perform pointing operations based on sounds and graphic images, the computer judges the hearing status based on the response, and uses visual data to obtain hearing data.
The hearing monitoring process is made easier and more accurate, and the accuracy and reference value of the hearing data are improved based on the subjects' autonomous operations and visual data.
Smart Images

Figure CN120732403A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of hearing monitoring, and in particular relates to a method for monitoring hearing using visual data. Background Art
[0002] Age and exposure to loud noise are the two primary factors that lead to hearing loss. Hearing loss occurs and develops unconsciously. By the time an individual experiences significant hearing impairment, the degree of hearing loss has become severe and can lead to a series of side effects.
[0003] Therefore, detecting hearing status, timely detection and early intervention can effectively delay the progression of hearing loss.
[0004] Currently, there is only one way to detect hearing status on the market, generally pure tone detection, which is traditional and inefficient. Summary of the Invention
[0005] The object of the present invention is to provide a method for monitoring hearing using visual data to solve the problems raised in the above background technology.
[0006] To achieve the above objectives, the present invention provides the following technical solution: a method for monitoring hearing using visual data, based on a hearing monitoring system, the hearing monitoring system comprising at least: computer; an auditory encoding device connected to a computer; a sound-generating device, electrically connected to the auditory encoding device, for generating sound; A display device for displaying graphic images; A host computer is connected to a computer. The host computer includes a PCBA mainboard and a counter, a timer, and a memory integrated in the PCBA mainboard. Respond to the button and be electrically connected to the PCBA mainboard; There are multiple display devices and multiple response buttons; The method for monitoring hearing using visual data is implemented by the following steps: S1, using dedicated software to control the sound device to play a set of sounds and the display device to display graphics and images; S2. The subject points to the image displayed on the display device based on the sound heard and the image seen by the subject by pressing the corresponding response button on the display device; In this step, a group of sounds includes multiple words, and multiple display devices respectively display multiple correct graphic images corresponding to the multiple words; Alternatively, a group of sounds includes only one word, and a plurality of display devices display a plurality of graphic images, wherein one of the display devices displays a correct graphic image corresponding to the word; S3. The computer determines whether the identification is correct based on the subject's response operation. If the identification is correct, the process proceeds to step S4; if the identification is incorrect, the process proceeds to step S5; S4, the computer controls the sound-generating device to reduce the sound pressure and then play another set of sounds and corresponding graphic images, and then repeats steps S2-S3; S5. Determine whether the cumulative number of identification errors exceeds 3 times. If yes, the test ends. If not, proceed to step S6. S6, the computer controls the sound-generating device to increase the sound pressure and then play the same set of sounds and corresponding graphic images, and then proceeds to step S7; S7, the subject points by operating the response button based on the sound heard and the graphic image displayed on the display device; S8. The computer determines whether the identification is correct based on the subject's response operation. If the identification is correct, the test ends. If the identification is incorrect, the process proceeds to step S5.
[0007] In some embodiments, the hearing monitoring system further comprises a data line, and the host is electrically connected to the computer via the data line, so that the data of the timer and the counter can be fed back to the computer via the data line and stored.
[0008] In some embodiments, the sound-producing device is an earmuff or an insert earphone.
[0009] In some embodiments, multiple display devices are connected in series and are electrically connected to a host, and the computer controls the display content and display format of each display device.
[0010] In some embodiments, the counter is used to record the number of times the sound of the sound-emitting device is played and the number of times the screen display content of the display device is played.
[0011] In some embodiments, the timer is used to record the sound playback duration of the sound-generating device and the screen display duration of the display device.
[0012] In some embodiments, the response button is connected to a counter and a timer. The counter can record the number of responses, and the timer can record the duration of the response.
[0013] In some implementations, the memory stores at least an independent graphic image file package, an independent sound file package, or a mixed file package of graphic images and sounds.
[0014] In some embodiments, the transformation of the graphic image displayed by the display device can drive the change of the pull bar of the display interface of the auditory encoding device.
[0015] In some embodiments, a computer can be used to control the display device to first play the graphic image and then play the sound through the sound device, or to first play the sound through the sound device and then play the graphic image on the display device.
[0016] Beneficial effects of the present invention: The present invention discloses a novel method for monitoring hearing using visual data, wherein a computer controls a display device to play a set of graphic images, and simultaneously plays sounds in a file package through a sound-generating device. The subject operates a response button to identify the graphic image according to the sounds heard. When the identification is correct, the sound-generating device reduces the sound pressure and plays another set of sounds. At the same time, the display device displays the corresponding graphic image. The subject touches the response button again to identify the image according to the sounds heard. After the second identification is correct, the sound-generating device further reduces the sound pressure and plays the sound again. The above operation is repeated until an identification error occurs. When an identification error occurs, the sound-generating device first increases the sound pressure, and then repeatedly plays the graphic image and sound when the identification error occurs. The subject identifies according to the sounds heard. If the identification is correct, the test ends. If the identification is wrong, the sound-generating device further increases the sound pressure, and then repeatedly plays the graphic image and sound when the identification error occurs. The subject identifies according to the sounds heard. The above operation is repeated. If the identification is correct, the test ends. If the identification error accumulates to three times, the test ends directly. During the test, the subject's gaze moves according to the graphics displayed on the display device. For example, when two words are played, the subject's gaze moves from one display device to another. Therefore, the subject's visual data is actually obtained during the test. Through the above method, the subject's hearing data can be obtained while the subject observes the graphic images on the display device and responds by pressing the response button, thereby realizing hearing monitoring. Not only is the process easy, but also the hearing data is highly accurate and has strong reference value based on the subject's autonomous operation and visual data. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 A simplified system framework diagram of the hearing monitoring system of the present invention; Figure 2 for Figure 1 The hearing monitoring system shown is a further refined system framework diagram; Figure 3 for Figure 2 The physical diagram of the hearing monitoring system shown; Figure 4 It is the operation logic block diagram of the present invention; Figure 5 This is one of the interface diagrams displayed on the display screen of the auditory encoding device of the present invention.
[0018] In the figure: 1-computer; 2-auditory encoding device; 3-sounding device; 4-display device; 5-host; 6-response button; 51-PCBA mainboard; 52-counter; 53-timer; 54-memory. DETAILED DESCRIPTION
[0019] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.
[0020] See also Figure 1-Figure 5 As shown, the present invention provides the following technical solutions: A method for monitoring hearing using visual data is based on a hearing monitoring system, the hearing monitoring system comprising at least: Computer 1; An auditory encoding device 2 is connected to the computer 1 via a wired or wireless connection; A sound generating device 3, electrically connected to the auditory encoding device 2, for generating sound; Display device 4, for displaying graphic images; A host 5 is connected to the computer 1 and the auditory encoding device 2 by wire or wirelessly. The host 5 includes a PCBA mainboard 51 and a counter 52, a timer 53, and a memory 54 integrated in the PCBA mainboard 51. Response button 6 is electrically connected to the PCBA main board 51; There are multiple display devices 4 and multiple response buttons 6; The method for monitoring hearing using visual data is implemented by the following steps: S1, using dedicated software to control the sound device 3 to play a set of sounds and the display device 4 to display graphic images; Before step S1, the method further includes: S01, installing dedicated software in computer 1; S02, start the dedicated software; S2, the subject points by operating the response button 6 according to the sound heard and the graphic image displayed by the display device 4; S3. The computer 1 determines whether the identification is correct based on the subject's response operation. If the identification is correct, the process proceeds to step S4. If the identification is incorrect, the process proceeds to step S5. S4, the computer 1 controls the sound-generating device 3 to reduce the sound pressure and then plays another set of sounds and corresponding graphic images, and then repeats steps S2-S3; S5. Determine whether the cumulative number of identification errors exceeds 3 times. If yes, the test ends. If not, proceed to step S6. S6, the computer 1 controls the sound device 3 to increase the sound pressure and then plays the same set of sounds and corresponding graphic images, and then proceeds to step S7; S7, the subject points by operating the response button 6 according to the sound heard and the graphic image displayed by the display device 4; S8. The computer 1 determines whether the identification is correct based on the subject's response operation. If the identification is correct, the test ends. If the identification is incorrect, the process proceeds to step S6.
[0021] Preferably, the hearing monitoring system further comprises a data line, and the host 5 is electrically connected to the computer 1 via the data line. Thus, the data of the timer 53 and the counter 52 can be fed back to the computer 1 via the data line and stored.
[0022] Preferably, the sound-generating device 3 is an earmuff-type earphone or an insert earphone commonly used in the market.
[0023] Preferably, multiple display devices 4 are connected in series and are electrically connected to the host 5, and the computer 1 controls the screen display content and screen display format of each display device 4. The display device 4 is a display screen.
[0024] Preferably, the counter 52 is used to record the number of times the sound of the sound-generating device 3 is played and the number of times the screen display content of the display device 4 is played.
[0025] Preferably, the timer 53 is used to record the sound playing time of the sound-generating device 3 and the screen display time of the display device 4 .
[0026] Preferably, the response button 6 is connected to a counter 52 and a timer 53 , and the counter 52 can record the number of responses, and the timer 53 can record the duration of the response.
[0027] Preferably, the memory 54 stores at least an independent graphic image file package, an independent sound file package, or a mixed file package of graphic images and sounds.
[0028] Preferably, the change of the graphic image displayed by the display device 4 can drive the change of the pull rod of the display interface of the auditory encoding device 2. The auditory encoding device 2 is an existing device, which has an independent display screen and a control chip, and can be a tablet computer. The pull rod is an adjuster displayed on the display screen of the auditory encoding device 2, which can perform encoding control on the sound generating device 3, etc. Figure 5 As shown, it is one of the display interfaces of the display screen of the auditory encoding device 2.
[0029] Preferably, the dedicated software of the computer 1 can be used to control the display device 4 to play the graphic image first and then play the sound through the sound device 3, or to play the sound on the sound device 3 first and then play the graphic image on the display device 4.
[0030] The present invention discloses a novel method for monitoring hearing using visual data. The method controls a display device 4 to play a set of graphic images (for example, displaying "bread," "strawberry," and "banana" on three display devices 4 in sequence). At the same time, a sound in a file package (for example, "strawberry," "bread," and "banana") is played through a sound generating device 3. The subject operates a response button 6 according to the sounds heard to identify the graphic images (for example, pressing response button B, response button A, and response button C in sequence, with response button B corresponding to the display device displaying the "strawberry" image, response button A corresponding to the display device displaying the "bread" image, and response button C corresponding to the display device displaying the "banana" image). When all the identifications are correct, the computer 1 controls the sound generating device 3 to reduce the sound pressure and play another set of sounds (for example, "milk," "apple," etc.). "Orange"), and the display device 4 will display the corresponding graphic image ("milk" graphic, "apple graphic, "orange" graphic), and the subject will touch the response button 6 again to identify the image according to the sound heard. After the second identification is correct, the sound-emitting device 3 will further reduce the sound pressure and give sound again, and repeat the above operation until an identification error occurs; when an identification error occurs, the sound-emitting device 3 will first increase the sound pressure, and then repeatedly play the graphic image and sound when the identification error occurs, and the subject will identify according to the sound heard. If it is confirmed to be correct, the test is terminated; if the identification is wrong, the sound-emitting device 3 will further increase the sound pressure, and then repeatedly play the graphic image and sound when the identification error occurs, and the subject will identify according to the sound heard; repeat the above action, and if it is confirmed to be correct, the test is terminated; if the identification error accumulates to three times, the test is also terminated directly.
[0031] A group of sounds may include multiple words, and multiple display devices 4 may display multiple correct graphic images corresponding to the multiple words respectively. A group of sounds may also include one word, and multiple display devices 4 may display multiple graphic images. Among the multiple display devices 4, only one of the display devices 4 needs to display the correct graphic image, and the other display devices 4 are interference options.
[0032] Any error will be considered as an identification error, and it will be considered as a correct identification only when all the identifications are correct.
[0033] Through the above method, the subject's hearing data can be obtained in the process of observing the graphic image on the display device 4 and responding through the response button 6, thereby realizing hearing monitoring. Not only is the process easy, but also based on the subject's autonomous operation and visual data, the hearing data is highly accurate and has strong reference value.
[0034] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.
Claims
1. A method for monitoring hearing using visual data, based on a hearing monitoring system, characterized in that: The hearing monitoring system comprises at least: Computer (1); an auditory encoding device (2) connected to the computer (1); a sound-generating device (3), electrically connected to the auditory encoding device (2), and configured to generate sound; a display device (4) for displaying graphic images; A host (5) is connected to the computer (1), wherein the host (5) includes a PCBA mainboard (51) and a counter (52), a timer (53) and a memory (54) integrated in the PCBA mainboard (51); A response button (6) is electrically connected to the PCBA mainboard (51); There are multiple display devices (4) and multiple response buttons (6); The method for monitoring hearing using visual data is implemented by the following steps: S1, controlling the sound generating device (3) to play a set of sounds and controlling the display device (4) to display graphic images through the computer (1); S2, the subject points out the image displayed on the display device (4) based on the sound heard and the image seen by the subject by operating the response button (6) corresponding to the display device; In this step, a group of sounds includes multiple words, and multiple display devices 4 respectively display multiple correct graphic images corresponding to the multiple words; Alternatively, a group of sounds includes only one word, and multiple display devices 4 display multiple graphic images, wherein one display device 4 displays a correct graphic image corresponding to the word; S3. The computer (1) determines whether the identification is correct according to the subject's response operation. If the identification is correct, the process proceeds to step S4; if the identification is incorrect, the process proceeds to step S5. S4, the computer (1) controls the sound-generating device (3) to reduce the sound pressure and then plays another set of sounds and corresponding graphic images, and then repeats steps S2-S3; S5. Determine whether the cumulative number of identification errors exceeds 3 times. If yes, the test ends. If not, proceed to step S6. S6, the computer (1) controls the sound generating device (3) to increase the sound pressure and then plays the same set of sounds and corresponding graphic images, and then proceeds to step S7; S7, the subject points according to the sound heard and the graphic image displayed by the display device (4) by operating the response button (6); S8. The computer (1) determines whether the identification is correct based on the subject's response operation. If the identification is correct, the test ends. If the identification is wrong, the process proceeds to step S5.
2. The method for monitoring hearing using visual data according to claim 1, characterized in that: The hearing monitoring system further comprises a data line, and the host (5) is electrically connected to the computer (1) via the data line.
3. The method for monitoring hearing using visual data according to claim 1, wherein: The sound-generating device (3) is an earmuff-type earphone or an insert-type earphone.
4. The method for monitoring hearing using visual data according to claim 1, wherein: The plurality of display devices (4) are connected in series and are all electrically connected to the host (5), and the computer (1) controls the screen display content and screen display format of each display device (4).
5. The method for monitoring hearing using visual data according to claim 1, wherein: The counter (52) is used to record the number of times the sound of the sound-generating device (3) is played and the number of times the screen display content of the display device (4) is played.
6. The method for monitoring hearing using visual data according to claim 1, wherein: The timer (53) is used to record the sound playing time of the sound generating device (3) and the screen display time of the display device (4).
7. The method for monitoring hearing using visual data according to claim 1, wherein: The response button (6) is connected to the counter (52) and the timer (53). The number of responses can be recorded through the counter (52), and the response duration can be recorded through the timer (53).
8. The method for monitoring hearing using visual data according to claim 1, wherein: The memory (54) stores at least an independent graphic image file package, an independent sound file package, or a mixed file package of graphic images and sound.
9. The method for monitoring hearing using visual data according to claim 1, wherein: The transformation of the graphic images displayed by the display device (4) can drive the change of the pull rod of the display interface of the auditory encoding device (2).
10. The method for monitoring hearing using visual data according to claim 1, wherein: The computer (1) can be controlled to first play a graphic image on the display device (4) and then play a sound through the sound-generating device (3), or first play a sound on the sound-generating device (3) and then play a graphic image on the display device (4).
