Prompt tone adjusting device and system

Abstract

The invention provides a prompt tone adjusting device and system, and the device comprises a frame body which is used for integrating different function modules; the system comprises a prompt tone collection module, a visual detection module, an environment recording module, a signal transmission module, a prompt tone storage module, a playing module, a touch module and a controller. The system has the advantages that the problem that a driver neglects information prompted by prompt tones due to inattention or fatigue can be solved, the prompt tone collection module is arranged to collect the prompt tones, and the visual detection module is arranged to detect eye movement conditions of the driver, so that the driver is more intelligent. The environment recording module is arranged to record scenes in the visual range watched by a driver, the signal transmission module is arranged to transmit collected data to the controller in a wireless mode, and the prompt tone storage module is arranged to store different prompt tones. The playing module and the touch module can be used for playing prompt tone and reminding a driver to pay attention to the prompt tone, and the controller can detect eye movement condition signals of the driver and judge whether the driver pays attention to the prompt tone or not.

Description

Technical Field

[0001] The present invention belongs to the technical field of prompt sound, and in particular relates to a prompt sound adjustment device and system. Background Art

[0002] Car prompt sounds usually refer to voice or sound signals issued by cars under specific operations, which are used to remind drivers or passengers to pay attention to certain situations. For example, at certain times, car prompt sounds may include horn sounds, warning sounds, door closing confirmation sounds, etc. At present, drivers may ignore the information prompted by the prompt sounds due to inattention or fatigue, which may cause driving safety problems due to lack of information. Summary of the invention

[0003] In view of this, the present invention aims to provide a prompt sound adjustment device and system to solve the problem that the driver ignores the information prompted by the prompt sound due to lack of concentration or fatigue.

[0004] To achieve the above object, the technical solution of the present invention is achieved as follows:

[0005] In a first aspect, the present invention provides a prompt tone adjustment device, comprising:

[0006] The frame is used to integrate different functional modules;

[0007] A prompt sound collection module, used for collecting prompt sounds, and the prompt sound collection module is arranged on the two side legs of the frame;

[0008] A visual detection module, used to detect the driver's eye movement, the visual detection module is arranged in the middle of the frame;

[0009] An environment recording module, used to record the scene within the visual range of the driver, and the environment recording module is arranged at the central position of the frame;

[0010] The signal transmission module is used to transmit the data collected on the frame to the controller wirelessly;

[0011] A prompt tone storage module, used for storing different prompt tones;

[0012] Playback module, used for prompt tone playback;

[0013] A tactile module to alert the driver to the warning sound;

[0014] The controller has a judgment logic. The judgment logic judges whether the driver notices the prompt sound through the driver's eye movement signal detected by the visual detection module. If the driver notices it, the prompt sound remains unchanged; if the driver does not notice it, the prompt sound is switched.

[0015] Furthermore, the frame is configured as a glasses frame, and the glasses frame is worn by the driver.

[0016] Furthermore, the prompt sound collection module is a microphone arranged on the glasses frame.

[0017] Furthermore, at least two microphones are provided, and the microphones are mounted on the legs of the glasses frame.

[0018] Furthermore, the visual detection module includes a main eye tracker and an auxiliary eye tracker. The main eye tracker is installed on the mirror surface of the glasses frame, and the auxiliary eye tracker is installed on the frame directly in front of the driver's face.

[0019] Furthermore, the environment recording module is a camera, and the camera is installed in the middle position of the glasses frame.

[0020] Furthermore, the signal transmission device is Bluetooth, which is installed at the upper middle position of the glasses frame.

[0021] Furthermore, the judgment logic is specifically to judge whether the eyeball visual area falls within the set area;

[0022] When the warning tone is the front vehicle radar, the visual area should be the front windshield area;

[0023] When the prompt sound is the reversing radar, the visual area should be the reversing mirrors on both sides or the central control reversing image.

[0024] Furthermore, the judgment logic is specifically whether the driver's visual area is concentrated in the area that the prompt sound needs to remind attention;

[0025] When a person hears the prompt sound, their vision will focus on a specific area, their blinking speed will slow down, and their attention will be very focused.

[0026] Furthermore, the judgment logic also includes a judgment logic that the driver does not hear the prompt sound, and the judgment logic that the driver does not hear the prompt sound includes:

[0027] The controller microphone first determines whether the noise collected by the microphone at the human ear exceeds the sound pressure level of the prompt sound. If so, it switches to a prompt sound with a larger sound pressure level to remind the driver to pay attention to the prompt sound;

[0028] If the driver has not paid attention to the prompt tone, the playback frequency is adjusted based on the prompt tone after the sound pressure level is switched;

[0029] The visual detection module determines whether the driver pays attention to the speed limit sign and operates it;

[0030] If the driver reduces the vehicle speed to the required speed, the warning sound stops.

[0031] Furthermore, the microphone is used to detect and evaluate the ambient sound level, and the evaluation method is:

[0032] The noise collected at the human ear is denoised, and the denoised ambient sound is analyzed to determine whether the noise at the human ear is loud enough to cause the prompt tone to be inaudible.

[0033] Furthermore, the playback module is N pairs of speakers arranged on the legs of the glasses frame. When the prompt sound is played for the first time, a pair of speakers far away from the driver's ears are used to play the prompt sound. If the prompt sound is not heard, a pair of speakers close to the ears are added in turn to play.

[0034] Furthermore, the tactile module is a vibrator embedded in the frame leg; when the driver still does not notice the prompt information for the Mth time, the tactile module is enabled to vibrate to prompt the driver.

[0035] In a second aspect, based on the same concept, the present invention also provides a prompt sound adjustment system, including the prompt sound adjustment device.

[0036] Compared with the prior art, the prompt tone adjustment device and system described in the present invention have the following advantages:

[0037] The present invention discloses a prompt sound adjustment device and system, which can solve the problem that the driver ignores the prompt sound information due to inattention or fatigue. A prompt sound collection module is provided to collect prompt sounds, a visual detection module is provided to detect the driver's eye movement, an environment recording module is provided to record the scenes within the driver's visual range, a signal transmission module is provided to transmit the collected data (sound and vision) to a controller via wireless, a prompt sound storage module is provided to store different prompt sounds, a playback module and a tactile module are provided to play prompt sounds and remind the driver to pay attention to the prompt sounds, and a controller is provided to detect the driver's eye movement signal and determine whether the driver has noticed the prompt sound. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the accompanying drawings:

[0039] Figure 1 This is a schematic diagram of the principle of the prompt tone adjustment device according to an embodiment of the present invention;

[0040] Figure 2 It is a schematic diagram of the frame of the prompt sound adjustment device described in an embodiment of the present invention. DETAILED DESCRIPTION

[0041] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0042] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and the like are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", and the like may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0043] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood by specific circumstances.

[0044] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0045] like Figure 1 to Figure 2 As shown, a prompt tone adjustment device includes:

[0046] The frame is used to integrate different functional modules together;

[0047] The prompt sound collection module is used to collect the prompt sound and is arranged on the frame body, and the position is on the two side legs, such as Figure 2 As shown, the prompt sound collection module is a red circle, and the prompt sound collection module is installed on the outside of the temple of the glasses;

[0048] The visual detection module is used to detect the driver's eye movement and is arranged on the frame. Figure 2 As shown, the visual detection module is installed in the middle of the glasses;

[0049] The environment recording module is used to record the scene within the driver's visual range and is arranged in the central position of the frame; Figure 2As shown, the environment record module is a blue circle;

[0050] The signal transmission module is used to transmit the data (sound and vision) collected on the frame to the controller via wireless. Figure 2 As shown, the signal transmission module is a green circle.

[0051] A prompt tone storage module, used for storing different prompt tones;

[0052] Playback module, used for prompt tone playback;

[0053] A tactile module to alert the driver to the warning sound;

[0054] The controller has a judgment logic, which judges whether the driver notices the prompt sound through the driver's eye movement signal detected by the visual detection module, and if the driver notices it, the prompt sound remains unchanged. If the driver does not notice it, the prompt sound is switched.

[0055] In a preferred embodiment of the present invention, the frame is configured as a spectacle frame for the driver to wear. In actual use, the frame can also be other frames, such as a frame worn around the neck or a helmet frame, as long as it can be worn on the driver.

[0056] In a preferred embodiment of the present invention, the prompt sound collection module is a microphone arranged on the glasses frame.

[0057] In a preferred embodiment of the present invention, at least two microphones are provided and arranged on the legs of the glasses frame.

[0058] In a preferred embodiment of the present invention, the visual detection module includes a main eye tracker.

[0059] In a preferred embodiment of the present invention, the main eye tracker is arranged on the mirror surface of the spectacle frame.

[0060] In a preferred embodiment of the present invention, the visual detection module includes an auxiliary eye tracker.

[0061] In a preferred embodiment of the present invention, the auxiliary eye tracker is arranged on the vehicle frame directly in front of the driver's face.

[0062] In a preferred embodiment of the present invention, the environment is recorded by a camera, which is arranged in the middle of the glasses frame.

[0063] In a preferred embodiment of the present invention, the signal transmission device is Bluetooth and is arranged in the middle upper side of the glasses frame.

[0064] In a preferred embodiment of the present invention, the decibel of the prompt tone after switching increases or the frequency increases;

[0065] The logic for increasing the decibel of the prompt sound includes:

[0066] Set the original decibel level to X, and increase it by 0.1X;

[0067] Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased decibels.

[0068] If the original decibel setting of the prompt tone is 40 decibels, the prompt tone is increased by 4 decibels to 44 decibels for the first time; and the prompt tone is continuously detected to see whether the user notices the prompt tone. If the user has not noticed the prompt tone, the prompt tone is switched to be increased by 4 decibels to 48 decibels.

[0069] If the driver notices the warning tone for the first time, it will switch to an encouraging tone, which can be set as a game clearance sound effect;

[0070] If after N reminders and continuous detection, no prompt tone is heard, a final warning is issued. The final warning prompt tone is stored in advance. The final warning prompt tone can be a pre-recorded or personalized prompt tone, such as a voice recording of a relative, or a prompt tone with a higher frequency;

[0071] The logic for increasing the frequency of the prompt tone playback includes:

[0072] Set the original playback frequency to YHz, and increase it by Y;

[0073] Detect whether the driver notices the prompt sound, if the driver notices the prompt sound, stop switching the prompt sound, if the driver does not notice the prompt sound, continue switching the prompt sound with increased playback frequency;

[0074] For example: If the playback frequency of a certain prompt tone is 1Hz, increase it by 1Hz for the first time, and continue to check whether the prompt tone is heard. If it is not noticed, switch to a 3Hz prompt tone;

[0075] If the driver notices the prompt sound for the first time, it will switch to an encouraging sound. The encouraging sound can be set as a game clearance sound effect to increase fun and interactivity. The game clearance sound effect will bring joy and a sense of accomplishment to the driver, and the game clearance sound effect often carries a strong sense of joy.

[0076] After N reminders and continuous detection, if the driver still does not hear the prompt tone, a final warning will be issued. The final warning prompt tone is stored in advance. The final warning prompt tone can be recorded in advance or a personalized prompt tone, such as a voice recording of a relative; or a prompt tone with a higher playback frequency;

[0077] In addition, the judgment logic in the controller includes a continuous detection feedback function, which not only switches the prompt tone, but can continuously detect the prompt tone and switch the prompt tone stored in advance. For example, users can preset N reminders in advance according to different habits, not limited to three reminders.

[0078] In a preferred embodiment of the present invention, the judgment logic is specifically to judge whether the eye visual area falls within a specific area.

[0079] In a preferred embodiment of the present invention, when the playing prompt sound is the front vehicle radar, the visual area should be the front windshield area;

[0080] When the prompt sound is the reversing radar, the visual area should be the side mirrors or the central control reversing image;

[0081] In a preferred embodiment of the present invention, the judgment logic is specifically whether the driver's visual area is concentrated on the area that the prompt sound needs to remind attention.

[0082] In a preferred embodiment of the present invention, when a prompt sound is heard, a person's vision will be focused on a specific area, and the blinking speed will be reduced, and the attention will be very focused.

[0083] In a preferred embodiment of the present invention, the playing module is N pairs of speakers arranged on the legs of the glasses frame. When the prompt sound is played for the first time, a pair of speakers far away from the driver's ears is used to play the prompt sound. If the prompt sound is not heard, a pair of speakers close to the ears is added in sequence to play the prompt sound. Figure 2 As shown, the play module is an orange circle.

[0084] In a preferred embodiment of the present invention, the tactile module is a vibrator embedded in the frame leg. When the driver has not noticed the prompt information for the Mth time (which can be set to three or more times), the tactile module is enabled to vibrate to prompt the driver. In actual use, the vibration amplitude and frequency of the vibrator can also be adjusted by a controller, which can be large or small, fast or slow. The vibration is transmitted to the driver's face or ears through the temples. While increasing the tactile warning, the vibration can also produce sound. The vibration sensation, the sound generated by the vibration, and the prompt sound played by the playback module together provide prompts, thereby increasing the prompt sound effect.

[0085] The present invention also provides a prompt tone adjustment system, comprising the prompt tone adjustment device.

[0086] The present invention can solve the problem that the driver ignores the information prompted by the prompt sound due to lack of concentration or fatigue.

[0087] Example 1

[0088] After the driver gets in the car, he needs to wear the frame on his eyes. The frame automatically recognizes the human wearing action, automatically turns on the switch, and starts the working mode. When the driver is driving on the highway, the vehicle recognizes the speeding situation and issues a warning sound to remind the driver to reduce the speed. At this time, the microphone set on the frame collects the noise at the driver's ear, the environmental recording module set on the frame is used to record and identify the speed limit sign, and the visual detection module detects the human eye movement and the focus position. If the driver hears the warning sound, the warning sound will be played according to the original setting until the speed is controlled within the required range. If the driver has not performed any operation and the eyes have not moved their sight to the speed limit sign, the controller first determines whether the noise collected by the microphone set on the frame at the human ear is too large, exceeding the warning sound sound pressure level so that the warning sound is not heard, and it is necessary to switch to a warning sound with a larger sound pressure level for playback. If no operation has been performed, the playback frequency is adjusted based on the larger warning sound from the original 500ms playback interval to 200ms playback interval. At this time, the visual detection module is used to determine whether the driver pays attention to the speed limit sign and performs corresponding operations. If the driver reduces the speed to the required speed, the warning sound stops. The warning sound is a speeding warning sound or a speed limit warning sound. The microphone on the frame is used to detect and evaluate the size of the ambient sound. The specific evaluation method is to denoise when collecting noise near the human ear, that is, to remove the prompt sound played at that time, and analyze the data in the interval between the prompt sounds. Here is the ambient noise after the driver removes the prompt sound. Analyze the denoised ambient sound to determine whether it is loud enough to make the prompt sound inaudible.

[0089] Example 2

[0090] When driving, the driver is particularly likely to ignore the situation that the rear door is not closed properly, which is very likely to cause a dangerous situation. When this happens, the vehicle will issue a warning sound to remind the driver to close the door. At this time, the microphone installed on the frame collects the noise at the driver's ear, the environment recording module installed on the frame is used for recording and identification, and the visual detection module detects the movement of the human eye and the position of attention; if the driver hears the prompt sound reminder, the prompt sound will be played according to the original setting until the rear door is closed; if the driver has not performed any operation and the eyes have not moved their sight to the rear door position, the controller will first determine whether the noise collected by the microphone installed on the frame at the human ear is too loud, exceeding the sound pressure level of the prompt sound and causing the prompt sound to not be heard, then it is necessary to switch to a prompt sound with a larger sound pressure level for playback; if no operation has been performed, the playback frequency is adjusted based on the larger prompt sound from the original 500ms playback interval to 200ms playback interval, and then the visual detection module is used to determine whether the driver has paid attention to the prompt sound that the rear door is not closed, and perform corresponding operations, if the driver stops the vehicle and closes the rear door, the prompt sound stops.

[0091] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A prompt tone adjustment device, characterized in that: include: The frame is used to integrate different functional modules; A prompt sound collection module, used for collecting prompt sounds, and the prompt sound collection module is arranged on the two side legs of the frame; A visual detection module, used to detect the driver's eye movement, the visual detection module is arranged in the middle of the frame; An environment recording module, used to record the scene within the visual range of the driver, and the environment recording module is arranged at the central position of the frame; The signal transmission module is used to transmit the data collected on the frame to the controller wirelessly; A prompt tone storage module, used for storing different prompt tones; Playback module, used for prompt tone playback; A tactile module to alert the driver to the warning sound; The controller has a judgment logic, and the judgment logic judges whether the driver notices the prompt sound through the driver's eye movement signal detected by the visual detection module, and if the driver notices it, the prompt sound remains unchanged; If you don't notice it, switch the reminder tone.

2. A prompt tone adjustment device according to claim 1, characterized in that: The frame is configured as a spectacle frame, and the spectacle frame is worn by the driver.

3. A prompt tone adjustment device according to claim 2, characterized in that: The visual detection module includes a main eye tracker and an auxiliary eye tracker. The main eye tracker is installed on the mirror surface of the glasses frame, and the auxiliary eye tracker is installed on the frame directly in front of the driver's face.

4. The prompt tone adjustment device according to claim 2, characterized in that: The judgment logic is specifically to judge whether the eyeball visual area falls within the set area; When the warning tone is the front vehicle radar, the visual area should be the front windshield area; When the prompt sound is the reversing radar, the visual area should be the reversing mirrors on both sides or the central control reversing image.

5. A prompt tone adjustment device according to claim 4, characterized in that: The judgment logic is specifically whether the driver's visual area is concentrated in the area that the prompt sound needs to remind attention; When a tone is heard, a person's vision is focused on a specific area and their blinking speed is reduced.

6. The prompt tone adjustment device according to claim 5, characterized in that: The judgment logic also includes the judgment logic that the driver did not hear the prompt sound, and the judgment logic that the driver did not hear the prompt sound includes: The controller microphone first determines whether the noise collected by the microphone at the human ear exceeds the sound pressure level of the prompt sound. If so, it switches to a prompt sound with a larger sound pressure level to remind the driver to pay attention to the prompt sound; If the driver has not paid attention to the prompt tone, the playback frequency is adjusted based on the prompt tone after the sound pressure level is switched; The visual detection module determines whether the driver pays attention to the speed limit sign and operates it; If the driver reduces the vehicle speed to the required speed, the warning sound stops.

7. The prompt tone adjustment device according to claim 1, characterized in that: The microphone is used to detect and evaluate the ambient sound level. The evaluation method is: The noise collected at the human ear is denoised, and the denoised ambient sound is analyzed to determine whether the noise at the human ear is loud enough to cause the prompt tone to be inaudible.

8. The prompt tone adjustment device according to claim 2, characterized in that: The playback module is N pairs of speakers arranged on the legs of the glasses frame. When the prompt sound is played for the first time, a pair of speakers far away from the driver's ears is used to play the prompt sound. If the prompt sound is not heard, a pair of speakers close to the ears are added in sequence to play.

9. The prompt tone adjustment device according to claim 8, characterized in that: The tactile module is a vibrator embedded in the frame leg; when the driver still does not notice the prompt information for the Mth time, the tactile module is activated to vibrate to prompt the driver.

10. A prompt tone adjustment system, characterized in that: A prompt tone adjustment system comprising any one of claims 1-8.

Images