Hearing test method and device based on wearable device

Abstract

The invention discloses a hearing test method and device based on wearable equipment, and the method comprises the steps: obtaining a test mode selected by a user, guiding the user to complete the test calibration and hearing preheating according to the test mode selected by the user, generating an audio signal of the hearing test after the hearing preheating of the user is completed, and transmitting the audio signal to the wearable equipment. And testing the hearing of the user according to the audio signal of the hearing test and the collected environmental noise, and generating a personalized hearing report. The hearing test of the user is realized through the wearable device, and the adaptive hearing test is realized through the detection of the environmental noise, so that the convenience of the hearing test can be realized, the cost of the hearing test is reduced, the time of the user is saved, and the timeliness of finding hearing problems is improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of wearable devices, and in particular to a method and apparatus for hearing testing based on wearable devices. Background Art

[0002] In recent years, wearable devices have become very popular. Wearable devices are portable devices that are worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not just hardware devices, but also powerful functions achieved through software support, data interaction, and cloud interaction. Wearable devices will bring great changes to our lives and perceptions.

[0003] At present, hearing tests are usually conducted in professional medical institutions. The testing process is cumbersome and requires high testing scenarios. It relies on expensive professional equipment, such as pure tone audiometers, and professional testers' guidance. This not only limits the convenience of testing, but also increases the financial burden on users. With the popularization of smart devices and technological advances, mobile health has received increasing attention, but there is a lack of efficient and accurate hearing test applications on the market, especially those that can provide professional-grade pure tone testing functions. Summary of the invention

[0004] The embodiments of the present invention provide a method and apparatus for hearing testing based on a wearable device, which can realize a personal and convenient hearing test, timely discover hearing problems, promote early intervention and treatment, and improve the user's attention to and management ability of hearing health.

[0005] In a first aspect, an embodiment of the present invention provides a method for hearing testing based on a wearable device, comprising:

[0006] Get the test mode selected by the user;

[0007] According to the test mode selected by the user, guiding the user to complete the test calibration and hearing warm-up;

[0008] After confirming that the user's hearing preheating is completed, generating an audio signal for the hearing test;

[0009] The hearing of the user is tested based on the audio signal of the hearing test and the collected environmental noise, and a personalized hearing report is generated.

[0010] Optionally, guiding the user to complete test calibration and hearing warm-up according to the test mode selected by the user includes:

[0011] When the test mode is the headphone mode, guiding the user to complete the headphone calibration, and playing the hearing warm-up audio to the user in a countdown manner; or

[0012] When the test mode is the normal mode, the user is guided to complete the distance calibration, and the hearing warm-up audio is played to the user in a countdown manner.

[0013] Optionally, generating an audio signal for a hearing test comprises:

[0014] Set audio parameters;

[0015] According to the audio parameters, an audio signal for the hearing test is generated using a sine wave formula.

[0016] Optionally, the testing the hearing of the user according to the audio signal of the hearing test and the collected environmental noise includes:

[0017] Collecting the user's environmental noise and determining the noise level of the current environment;

[0018] Automatically adjusting the volume of the audio signal playing the hearing test according to the noise level;

[0019] Record the volume of the audio signal heard at each frequency point as reported by the user.

[0020] Optionally, collecting the environmental noise of the user and determining the noise level of the current environment includes:

[0021] Periodically collecting the user's environmental noise and preprocessing the environmental noise;

[0022] Perform fast Fourier transform on the pre-processed environmental noise;

[0023] Performing spectrum analysis on the result of the fast Fourier transform to determine frequency components and their corresponding energy levels;

[0024] The noise level of the current environment is estimated based on the result of the spectrum analysis.

[0025] Optionally, automatically adjusting the volume of the audio signal of the hearing test according to the noise level includes:

[0026] comparing the noise level to a noise threshold;

[0027] If the noise level is greater than the noise threshold, adjusting the volume of the audio signal played for the hearing test according to a preset compensation rule;

[0028] The noise threshold is determined by analyzing the audio signal of historical environmental noise.

[0029] Optionally, analyzing the audio signal of historical environmental noise to determine the noise threshold value includes:

[0030] Obtain a historical audio signal set of environmental noise;

[0031] Processing the audio signals in the audio signal set to obtain an energy level corresponding to each audio signal;

[0032] Determine the average value and standard deviation of the energy levels corresponding to the audio signals;

[0033] The noise threshold is determined according to the mean value and the standard deviation.

[0034] In a second aspect, an embodiment of the present invention provides a device for hearing testing based on a wearable device, comprising:

[0035] An acquisition unit, used for acquiring a test mode selected by a user;

[0036] The processing unit is used to guide the user to complete the test calibration and hearing warm-up according to the test mode selected by the user; after confirming that the user's hearing warm-up is completed, generate an audio signal for the hearing test; test the user's hearing according to the audio signal of the hearing test and the collected environmental noise, and generate a personalized hearing report.

[0037] Optionally, the processing unit is specifically configured to:

[0038] When the test mode is the headphone mode, guiding the user to complete the headphone calibration, and playing the hearing warm-up audio to the user in a countdown manner; or

[0039] When the test mode is the normal mode, the user is guided to complete the distance calibration, and the hearing warm-up audio is played to the user in a countdown manner.

[0040] Optionally, the processing unit is specifically configured to:

[0041] Set audio parameters;

[0042] According to the audio parameters, an audio signal for the hearing test is generated using a sine wave formula.

[0043] Optionally, the processing unit is specifically configured to:

[0044] Collecting the user's environmental noise and determining the noise level of the current environment;

[0045] Automatically adjusting the volume of the audio signal playing the hearing test according to the noise level;

[0046] Record the volume of the audio signal heard at each frequency point as reported by the user.

[0047] Optionally, the processing unit is specifically configured to:

[0048] Periodically collecting the user's environmental noise and preprocessing the environmental noise;

[0049] Perform fast Fourier transform on the pre-processed environmental noise;

[0050] Performing spectrum analysis on the result of the fast Fourier transform to determine frequency components and their corresponding energy levels;

[0051] The noise level of the current environment is estimated based on the result of the spectrum analysis.

[0052] Optionally, the processing unit is specifically configured to:

[0053] comparing the noise level to a noise threshold;

[0054] If the noise level is greater than the noise threshold, adjusting the volume of the audio signal played for the hearing test according to a preset compensation rule;

[0055] The noise threshold is determined by analyzing the audio signal of historical environmental noise.

[0056] Optionally, the processing unit is specifically configured to:

[0057] Obtain a historical audio signal set of environmental noise;

[0058] Processing the audio signals in the audio signal set to obtain an energy level corresponding to each audio signal;

[0059] Determine the average value and standard deviation of the energy levels corresponding to the audio signals;

[0060] The noise threshold is determined according to the mean value and the standard deviation.

[0061] In a third aspect, an embodiment of the present invention further provides a computing device, including:

[0062] A memory for storing program instructions;

[0063] The processor is used to call the program instructions stored in the memory and execute the above-mentioned method of hearing test based on the wearable device according to the obtained program.

[0064] In a fourth aspect, an embodiment of the present invention further provides a computer-readable non-volatile storage medium, comprising computer-readable instructions. When a computer reads and executes the computer-readable instructions, the computer executes the above-mentioned method of hearing test based on a wearable device.

[0065] In the embodiment of the present invention, the test mode selected by the user is obtained, and the user is guided to complete the test calibration and hearing warm-up according to the test mode selected by the user. After confirming that the user's hearing warm-up is completed, an audio signal for the hearing test is generated, and the user's hearing is tested according to the audio signal of the hearing test and the collected environmental noise, and a personalized hearing report is generated. The hearing test of the user is implemented through a wearable device, and an adaptive hearing test is implemented by detecting the environmental noise, which can realize the convenience of the hearing test, reduce the cost of the hearing test, save the user's time, and improve the timeliness of the discovery of hearing problems. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0067] Figure 1 A schematic diagram of a system architecture provided for an embodiment of the present invention;

[0068] Figure 2 A flowchart of a method for hearing testing based on a wearable device provided in an embodiment of the present invention;

[0069] Figure 3 A schematic diagram of the structure of an apparatus for hearing testing based on a wearable device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0070] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0071] First, Figure 1 The structure shown is used as an example to introduce the wearable device applicable to the embodiment of the present invention. In the embodiment of the present invention, the wearable device 100 may include, but is not limited to, a radio frequency (RF) circuit 110, a memory 120, an input unit 130, a WiFi module 170, a display unit 140, a sensor 150, an audio circuit 160, a processor 180, and a motor 190.

[0072] Among them, those skilled in the art can understand that Figure 1The structure of the wearable device 100 shown in the figure is only an example and not a limitation. The wearable device 100 may also include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0073] The RF circuit 110 can be used to receive and send signals during the process of sending and receiving information or making calls. In particular, after receiving the downlink information of the base station, it is processed by the processor 180; in addition, the uplink data of the wearable device 100 is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA, LowNoiseAmplifier), a duplexer, etc. In addition, the RF circuit 110 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to the Global System for Mobile communication (GlobalSystem for Mobile communication, referred to as "GSM"), General Packet Radio Service (General PacketRadio Service, referred to as "GPRS"), Code Division Multiple Access (Code Division Multiple Access, referred to as "CDMA"), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, referred to as "WCDMA"), Long Term Evolution (Long Term Evolution, referred to as "LTE"), email, Short Messaging Service (Short Messaging Service, referred to as "SMS"), etc.

[0074] The memory 120 can be used to store software programs and modules, and the processor 180 executes various functional applications and data processing of the wearable device 100 by running the software programs and modules stored in the memory 120. The memory 120 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the wearable device 100 (such as audio data, a phone book, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0075] The input unit 130 can be used to receive input digital or character information, and to generate key signals related to user settings and function control of the wearable device 100. Specifically, the input unit 130 may include a touch panel 131, a camera 132, and other input devices 133. The camera 132 can take pictures of the images to be acquired, thereby transmitting the images to the processor 180 for processing, and finally presenting the graphics to the user through the display panel 141. The touch panel 131, also known as a touch screen, can collect the user's touch operations on or near it (such as the user's operation on the touch panel 131 or near the touch panel 131 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 131 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 180, and can receive the command sent by the processor 180 and execute it. In addition, the touch panel 131 can be implemented in various types such as resistive, capacitive, infrared and surface acoustic wave. In addition to the touch panel 131 and the camera 132, the input unit 130 can also include other input devices 133. Specifically, other input devices 132 can include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a joystick, etc.

[0076] Among them, the display unit 140 can be used to display information input by the user or information provided to the user and various menus of the wearable device 100. The display unit 140 may include a display panel 141. Optionally, the display panel 141 may be configured in the form of a liquid crystal display unit (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-Emitting Diode), etc. Further, the touch panel 131 may cover the display panel 141. When the touch panel 131 detects a touch operation on or near it, it is transmitted to the processor 180 to determine the type of touch event, and then the processor 180 provides a corresponding visual output on the display panel 141 according to the type of touch event.

[0077] Among them, the visual output external display panel 141 that can be recognized by the human eye can be used as a display device in the embodiment of the present invention to display text information or image information. Figure 1In the embodiment, the touch panel 131 and the display panel 141 are used as two independent components to implement the input and output functions of the wearable device 100. However, in some embodiments, the touch panel 131 and the display panel 141 can be integrated to implement the input and output functions of the wearable device 100.

[0078] In addition, the wearable device 100 may further include at least one sensor 150, such as a posture sensor, a distance sensor, a light sensor, and other sensors.

[0079] Specifically, the attitude sensor can also be called a motion sensor, and as one of the motion sensors, an angular velocity sensor (also called a gyroscope) can be listed. When it is configured in the wearable device 100, it is used to measure the rotational angular velocity of the wearable device 100 in motion when it deflects or tilts. Thus, the gyroscope can accurately analyze and determine the actual action of the user using the wearable device 100, and then perform corresponding operations on the wearable device 100. For example: somatosensory, shake (shaking the wearable device 100 to achieve some functions), and inertial navigation based on the motion state of the object when there is no signal from the Global Positioning System (GPS) (such as in a tunnel).

[0080] The sensor may also be a light sensor, which is mainly used to collect information such as the wavelength and intensity of various light rays to adjust the backlight intensity of the display panel 141 .

[0081] In addition, in the embodiment of the present invention, as the sensor 150, other sensors such as a barometer, a hygrometer, a thermometer and an infrared sensor may also be configured, which will not be described in detail here.

[0082] The light sensor may further include a proximity sensor, which may turn off the display panel 141 and / or the backlight when the wearable device 100 is moved to the ear.

[0083] The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the wearable device 100. The audio circuit 160 can transmit the electrical signal converted from the received audio data to the speaker 161, which is converted into a sound signal for output; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and converted into audio data, and then the audio data is output to the processor 180 for processing, and then sent to, for example, another wearable device 100 through the RF circuit 110, or the audio data is output to the memory 120 for further processing.

[0084] WiFi is a short-range wireless transmission technology. The wearable device 100 can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 170. It provides users with wireless broadband Internet access. Figure 1 A WiFi module 170 is shown, but it is understandable that it is not a necessary component of the wearable device 100 and can be omitted as needed without changing the essence of the invention.

[0085] The processor 180 is the control center of the wearable device 100. It uses various interfaces and lines to connect various parts of the entire wearable device 100, and executes various functions and processes data of the wearable device 100 by running or executing software programs and / or modules stored in the memory 120, and calling data stored in the memory 120, so as to monitor the wearable device 100 as a whole. Optionally, the processor 180 may include one or more processing units; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications.

[0086] It is understandable that the above-mentioned modem processor may not be integrated into the processor 180.

[0087] The wearable device 100 may further include at least one motor 190. Since the wearable device 100 is a power-consuming device, the motor 190 may be a small motor. Meanwhile, a plurality of motors may be configured for the wearable device 100 according to the power that the motor can provide.

[0088] The wearable device 100 also includes a power supply (not shown) for supplying power to various components.

[0089] Preferably, the power supply can be logically connected to the processor 180 through a power management system, so that the power management system can manage charging, discharging, power consumption, etc. Although not shown, the wearable device 100 can also include a Bluetooth module, etc., which will not be repeated here.

[0090] It should be noted that the above Figure 1 The structure shown is only an example and is not limited to this embodiment of the present invention.

[0091] Figure 2 A process of a hearing test based on a wearable device provided by an embodiment of the present invention is exemplarily shown. The process can be executed by an apparatus for a hearing test based on a wearable device, and the apparatus can be a wearable device or can be located in the wearable device.

[0092] like Figure 2 As shown in the figure, the process specifically includes:

[0093] Step 201, obtaining a test mode selected by a user.

[0094] In an embodiment of the present invention, the test mode may include a headphone mode and a normal mode, where the user may be prompted to select the test mode through a user interface, for example, the name and a brief introduction of the application may be displayed first. A "Start Test" button is provided. The user may select the headphone mode or the normal mode (using the device speaker). If the headphone mode is selected, the user is prompted to insert the headphone and confirm that the headphone is properly connected.

[0095] Step 202: guiding the user to complete test calibration and hearing warm-up according to the test mode selected by the user.

[0096] Specifically, when the test mode is headphone mode, the user is guided to complete headphone calibration, and hearing warm-up audio is played to the user in a countdown manner; or when the test mode is normal mode, the user is guided to complete distance calibration, and hearing warm-up audio is played to the user in a countdown manner.

[0097] Among them, the headphone calibration may include: if the headphone mode is selected, displaying a prompt requiring the user to wear the headphones and clicking a "Weared" button on the screen.

[0098] Distance calibration may include: if the device supports and the normal mode is selected, using a built-in distance sensor to detect the distance between the user's ear and the device, and giving appropriate prompts to allow the user to maintain the correct distance.

[0099] After the calibration is completed, the audio for hearing warm-up can be played in a countdown manner. That is, a soft background music or white noise is provided for a period of time (e.g., 1 minute) to help the user relax the ears. The countdown is displayed and the next stage is automatically entered after the end.

[0100] Step 203: after confirming that the user's hearing preheating is complete, generate an audio signal for the hearing test.

[0101] After the hearing warm-up is completed, the audio signal for the hearing test can be generated, that is, a series of pure tone audio signals at frequency points. Specifically, set the audio parameters;

[0102] Based on the audio parameters, the sine wave formula is used to generate the audio signal for the hearing test.

[0103] In actual implementation, the audio signal can be generated in the following ways:

[0104] First, set the audio parameters: including sampling rate, channel configuration, audio format, and buffer size.

[0105] SAMPLE_RATE = 44100; / / sampling rate, for example 44100;

[0106] CHANNEL_CONFIG = AudioFormat.CHANNEL_OUT_MONO; / / Channel settings;

[0107] AUDIO_FORMAT = AudioFormat.ENCODING_PCM_16BIT; / / 16-bit PCM encoding;

[0108] AMPLITUDE = 32767; / / Amplitude, corresponding to the maximum value of 16-bit PCM;

[0109] FREQUENCY=440; / / frequency, for example 440Hz;

[0110] MIN_BUFFER_SIZE = 7696; / / buffer size, for example 7696;

[0111] Then, generate the audio data: use the sine wave formula to calculate the audio samples.

[0112] byte[]buffer=new byte[MIN_BUFFER_SIZE];

[0113] int bufferSizeInShorts=buffer.length / 2;

[0114] for(int i=0; i <bufferSizeInShorts;i++){

[0115] / / Calculate the value of the sine wave;

[0116] short sample=(short)(AMPLITUDE*Math.sin(2*Math.PI*FREQUENCY*i / SAMPLE_RATE));

[0117] / / Store the value in the buffer;

[0118] buffer[i*2]=(byte)(sample&0x00FF);

[0119] buffer[i*2+1]=(byte)((sample&0xFF00)>>>>8);

[0120] }

[0121] After obtaining the audio signals at each frequency point, the generated audio signals can be played through the AudioTrack object.

[0122] Step 204: Test the hearing of the user based on the audio signal of the hearing test and the collected environmental noise, and generate a personalized hearing report.

[0123] Specifically, it is first necessary to collect the user's environmental noise and determine the noise level of the current environment, then automatically adjust the volume of the audio signal played for the hearing test based on the noise level, and finally record the volume of the audio signal heard at each frequency point as reported by the user.

[0124] Among them, when determining the noise level, it is necessary to periodically collect the user's environmental noise and pre-process the environmental noise; perform fast Fourier transform on the pre-processed environmental noise; perform spectral analysis on the results of the fast Fourier transform to determine the frequency components and their corresponding energy levels; and estimate the noise level of the current environment based on the results of the spectral analysis.

[0125] When playing the audio signal, the noise level and the noise threshold value may be compared first, and if the noise level is greater than the noise threshold value, the volume of the audio signal playing the hearing test is adjusted according to a preset compensation rule. The preset compensation rule may be set based on experience.

[0126] When determining the noise threshold value, you can refer to the spectrum analysis process and determine it by analyzing the audio signals of historical environmental noise. Specifically, you can first obtain a set of audio signals of historical environmental noise; process the audio signals in the audio signal set to obtain the energy level corresponding to each audio signal; determine the average value and standard deviation of the energy level corresponding to each audio signal; and determine the noise threshold value based on the average value and standard deviation.

[0127] The process of dynamically adjusting the volume of the audio signal for the hearing test will be described in detail below with a specific implementation method, which specifically includes the following:

[0128] Environmental noise monitoring:

[0129] Use the built-in microphone of your smart device to continuously collect ambient audio signals.

[0130] The audio signal is analyzed by an algorithm to calculate the noise level of the current environment (in decibels dB).

[0131] Noise level classification:

[0132] The ambient noise level is divided into several levels, each level corresponding to a preset compensation value. For example, the ambient noise level can be divided into three levels: low, medium, and high.

[0133] Test volume compensation:

[0134] Automatically adjust the test volume according to the ambient noise level so that the test volume is always a certain amount of decibels higher than the ambient noise.

[0135] The compensation value should be large enough to ensure that the test volume can be clearly heard in the environment, but not too loud to avoid causing hearing damage or distorting the test results.

[0136] Real-time adjustment mechanism:

[0137] When the ambient noise changes, the system is able to quickly detect the change and adjust the test volume accordingly.

[0138] To prevent frequent adjustments from causing test instability, a minimum adjustment interval or threshold can be set so that adjustments are made only when the noise level changes by more than a certain amount.

[0139] User feedback:

[0140] The system can provide the user with information about the current ambient noise level and whether it is appropriate to continue with the test.

[0141] Specifically, the built-in microphone of the device is used to collect audio signals, and generally a segment of audio data is collected at a fixed time interval (eg, every several seconds).

[0142] The collected audio signal is preprocessed, such as removing DC offset and applying a window function (such as a Hamming window) to reduce spectral leakage.

[0143] The Fast Fourier Transform (FFT) algorithm is used to convert the time domain signal into a frequency domain signal. The result of the FFT is an array of complex numbers that represent the amplitude and phase information of each frequency component.

[0144] Analyze the FFT results to determine the main frequency components and their corresponding energy levels.

[0145] Calculate the power spectral density of the spectrum, which is an indicator of the energy size of each frequency component.

[0146] Based on the results of spectrum analysis, the noise level of the current environment is estimated. This can be done by finding the part of the spectrum where the energy is more evenly distributed, i.e. the noise band, and then calculating its average energy level.

[0147] The test volume is dynamically adjusted according to the estimated noise level to ensure that the test volume is higher than the noise level by a certain number of decibels (eg, 5-10 dB).

[0148] It should be noted that noise thresholding is a technique for distinguishing between signals and noise by setting a threshold value. This method is simple and effective and is suitable for real-time applications.

[0149] Specifically, a microphone is used to collect audio signals. The collected audio signals are processed, such as sampling and filtering, to obtain their energy level or amplitude. The energy level of the audio signal is continuously monitored over a period of time, and the average value and standard deviation over this period of time are calculated. A noise threshold value is set based on the average value and the standard deviation. For example, the noise threshold can be set to the average energy level plus several times the standard deviation (such as the average value + 2×standard deviation).

[0150] Compare the energy level of the current audio signal with the noise threshold. If the signal energy level is lower than the noise threshold, it is considered to be in a noise state; otherwise, it is considered to have a signal.

[0151] When a high noise level is detected, the test volume is adjusted according to a preset compensation rule to make it higher than the current noise level by a certain number of decibels.

[0152] Based on the above test process, after recording the volume of the audio signal heard at each frequency point as reported by the user, an audiogram may be generated based on the data of the user's lowest audible threshold (volume) at each frequency point.

[0153] The basic structure of the audiogram includes:

[0154] X-axis (horizontal axis): Displays frequency, increasing from left to right, usually from 250Hz to 8000Hz.

[0155] Y-axis (vertical axis): represents the volume (hearing threshold), which increases gradually from top to bottom, and the unit is decibel (dB HL). 0dBHL represents the normal hearing threshold, which is the lightest sound that a healthy young person can hear.

[0156] Listening also includes the level of listening. The listening grading standards are as follows:

[0157] Normal hearing: 0dB HL to 25dB HL.

[0158] Within this range, most people are able to hear nearly all everyday sounds without hearing impairment.

[0159] Mild hearing loss: 26dB HL to 40dB HL.

[0160] People with mild hearing loss may find it difficult to hear soft sounds, but in most cases they can understand and communicate, especially in quiet environments.

[0161] Moderate hearing loss: 41dB HL to 55dB HL.

[0162] People with moderate hearing loss may have difficulty hearing in noisy environments and may even have trouble hearing in quiet environments.

[0163] Moderate to severe hearing loss: 56dB HL to 70dB HL.

[0164] In this condition, the individual finds it difficult to communicate in most social situations and may have problems even in one-on-one conversations.

[0165] Severe hearing loss: 71dB HL to 90dB HL.

[0166] Severe hearing loss makes it difficult for an individual to understand conversation without visual aids or assistive listening devices.

[0167] Profound hearing loss: greater than 90dB HL.

[0168] Profound hearing loss means that the individual can barely hear and understand normal conversation, even at close range.

[0169] In the specific implementation process, the above-mentioned hearing test includes the following interactive processes:

[0170] Launch the app: The user opens the app, reads a brief introduction, and clicks the "Start Testing" button.

[0171] Select Mode: User selects Headset Mode or Normal Mode.

[0172] Calibrate the device: If it is headphone mode, the user wears the headphones and confirms; if it is normal mode, the user adjusts the distance between the ear and the device.

[0173] Listening warm-up: Users listen to the warm-up audio and wait for the countdown to end.

[0174] Start the test: Play pure tones according to the predetermined frequency list, and the user clicks a button to record after hearing the sound.

[0175] Complete Test: Displays the test results and provides the option to save or retest.

[0176] The test process includes the following operations:

[0177] Frequency selection: List a series of frequency points (for example, from 250Hz to 8000Hz) and play them in sequence.

[0178] Sound playback: Play a pure tone at each frequency point for a few seconds. According to the user's response to the pure tone, the test volume is automatically adjusted up or down, and the test continues until the critical threshold of the frequency point is reached.

[0179] Record the sound heard: After hearing the sound, the user taps the "hear sound" button on the screen. The button should be large enough to be easily touched and responsive.

[0180] Visual feedback: After the user clicks the button, display a green checkmark or other positive visual feedback to confirm that their input was recorded.

[0181] Haptic feedback: The device vibrates to increase the user's sense of confirmation.

[0182] Progress bar: Displays the current test progress, letting users know how much of the test they have completed.

[0183] In the embodiment of the present invention, a modified "up-down method" is used to automatically adjust the test volume according to the user's response to pure tone, so as to quickly and accurately determine the user's hearing threshold. This process can be combined with a machine learning algorithm to continuously optimize the test path, reduce the number of tests, and improve test efficiency.

[0184] After the test, the system instantly generates a personalized report including a hearing curve graph, hearing loss area analysis and recommendations. The report can be stored in the cloud, allowing users to track hearing changes and provide it to professional doctors for reference.

[0185] The above embodiments show that the test mode selected by the user is obtained, and the user is guided to complete the test calibration and hearing warm-up according to the test mode selected by the user. After confirming that the user's hearing warm-up is completed, an audio signal for the hearing test is generated, and the user's hearing is tested based on the audio signal of the hearing test and the collected environmental noise, and a personalized hearing report is generated. The hearing test of the user is carried out through a wearable device, and an adaptive hearing test is carried out by detecting the environmental noise, which can realize the convenience of the hearing test, reduce the cost of the hearing test, save the user's time, and improve the timeliness of the discovery of hearing problems.

[0186] Based on the same technical concept, Figure 3 The structure of a device for hearing test based on a wearable device provided by an embodiment of the present invention is exemplarily shown, and the device can execute the process of hearing test based on a wearable device.

[0187] like Figure 3 As shown, the device may include:

[0188] An acquisition unit 301 is used to acquire a test mode selected by a user;

[0189] The processing unit 302 is used to guide the user to complete the test calibration and hearing warm-up according to the test mode selected by the user; after confirming that the user's hearing warm-up is completed, generate an audio signal for the hearing test; test the user's hearing according to the audio signal of the hearing test and the collected environmental noise, and generate a personalized hearing report.

[0190] Optionally, the processing unit 302 is specifically configured to:

[0191] When the test mode is the headphone mode, guiding the user to complete the headphone calibration, and playing the hearing warm-up audio to the user in a countdown manner; or

[0192] When the test mode is the normal mode, the user is guided to complete the distance calibration, and the hearing warm-up audio is played to the user in a countdown manner.

[0193] Optionally, the processing unit 302 is specifically configured to:

[0194] Set audio parameters;

[0195] According to the audio parameters, an audio signal for the hearing test is generated using a sine wave formula.

[0196] Optionally, the processing unit 302 is specifically configured to:

[0197] Collecting the user's environmental noise and determining the noise level of the current environment;

[0198] Automatically adjusting the volume of the audio signal playing the hearing test according to the noise level;

[0199] Record the volume of the audio signal heard at each frequency point as reported by the user.

[0200] Optionally, the processing unit 302 is specifically configured to:

[0201] Periodically collecting the user's environmental noise and preprocessing the environmental noise;

[0202] Perform fast Fourier transform on the pre-processed environmental noise;

[0203] Performing spectrum analysis on the result of the fast Fourier transform to determine frequency components and their corresponding energy levels;

[0204] The noise level of the current environment is estimated based on the result of the spectrum analysis.

[0205] Optionally, the processing unit 302 is specifically configured to:

[0206] comparing the noise level to a noise threshold;

[0207] If the noise level is greater than the noise threshold, adjusting the volume of the audio signal played for the hearing test according to a preset compensation rule;

[0208] The noise threshold is determined by analyzing the audio signal of historical environmental noise.

[0209] Optionally, the processing unit 302 is specifically configured to:

[0210] Obtain a historical audio signal set of environmental noise;

[0211] Processing the audio signals in the audio signal set to obtain an energy level corresponding to each audio signal;

[0212] Determine the average value and standard deviation of the energy levels corresponding to the audio signals;

[0213] The noise threshold is determined according to the mean value and the standard deviation.

[0214] Based on the same technical concept, an embodiment of the present invention further provides a computing device, including:

[0215] A memory for storing program instructions;

[0216] The processor is used to call the program instructions stored in the memory and execute the above-mentioned method of hearing test based on the wearable device according to the obtained program.

[0217] Based on the same technical concept, an embodiment of the present invention also provides a computer-readable non-volatile storage medium, including computer-readable instructions. When a computer reads and executes the computer-readable instructions, the computer executes the above-mentioned method of hearing test based on wearable device.

[0218] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0219] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0220] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0221] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0222] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for hearing testing based on a wearable device, characterized in that: include: Get the test mode selected by the user; According to the test mode selected by the user, guiding the user to complete the test calibration and hearing warm-up; After confirming that the user's hearing preheating is completed, generating an audio signal for the hearing test; The hearing of the user is tested based on the audio signal of the hearing test and the collected environmental noise, and a personalized hearing report is generated.

2. The method according to claim 1, characterized in that The step of guiding the user to complete test calibration and hearing warm-up according to the test mode selected by the user includes: When the test mode is the headphone mode, guiding the user to complete the headphone calibration, and playing the hearing warm-up audio to the user in a countdown manner; or When the test mode is the normal mode, the user is guided to complete the distance calibration, and the hearing warm-up audio is played to the user in a countdown manner.

3. The method according to claim 1, characterized in that The step of generating an audio signal for a hearing test comprises: Set audio parameters; According to the audio parameters, an audio signal for the hearing test is generated using a sine wave formula.

4. The method according to any one of claims 1 to 3, characterized in that The step of testing the hearing of the user according to the audio signal of the hearing test and the collected environmental noise includes: Collecting the user's environmental noise and determining the noise level of the current environment; Automatically adjusting the volume of the audio signal playing the hearing test according to the noise level; Record the volume of the audio signal heard at each frequency point as reported by the user.

5. The method according to claim 4, characterized in that The collecting the environmental noise of the user and determining the noise level of the current environment includes: Periodically collecting the user's environmental noise and preprocessing the environmental noise; Perform fast Fourier transform on the pre-processed environmental noise; Performing spectrum analysis on the result of the fast Fourier transform to determine frequency components and their corresponding energy levels; The noise level of the current environment is estimated based on the result of the spectrum analysis.

6. The method according to claim 4, characterized in that The step of automatically adjusting the volume of the audio signal of the hearing test according to the noise level includes: comparing the noise level to a noise threshold; If the noise level is greater than the noise threshold, adjusting the volume of the audio signal played for the hearing test according to a preset compensation rule; The noise threshold is determined by analyzing the audio signal of historical environmental noise.

7. The method according to claim 6, characterized in that The step of analyzing the audio signal of the historical environmental noise to determine the noise threshold value includes: Obtain a historical audio signal set of environmental noise; Processing the audio signals in the audio signal set to obtain an energy level corresponding to each audio signal; Determine the average value and standard deviation of the energy levels corresponding to the audio signals; The noise threshold is determined according to the mean value and the standard deviation.

8. A hearing test device based on a wearable device, characterized in that: include: An acquisition unit, used for acquiring a test mode selected by a user; The processing unit is used to guide the user to complete the test calibration and hearing warm-up according to the test mode selected by the user; after confirming that the user's hearing warm-up is completed, generate an audio signal for the hearing test; test the user's hearing according to the audio signal of the hearing test and the collected environmental noise, and generate a personalized hearing report.

9. A computing device, characterized in that include: A memory for storing program instructions; A processor, configured to call the program instructions stored in the memory, and execute the method according to any one of claims 1 to 7 according to the obtained program.

10. A computer-readable non-volatile storage medium, characterized in that: The method comprises computer-readable instructions, and when a computer reads and executes the computer-readable instructions, the computer is caused to execute the method according to any one of claims 1 to 7.

Images