Prompt tone adjusting method and system and storage medium

Abstract

The invention provides a prompt tone adjusting method and system and a storage medium. The prompt tone adjusting method comprises the steps that prompt tones are collected; detecting eye and head movement conditions and eye closing conditions of the driver; different prompt tones are stored; and judging whether the driver notices the warning tone or not according to the eye and head movement condition and eye closing condition signals detected by the logic, if so, keeping the warning tone unchanged, and if not, switching the warning tone. The system has the advantages that the problem of accidents caused by inattention of a driver can be solved, the warning tone collection module is arranged to collect warning tones and remove impurities, the efficiency and accuracy are improved, the visual detection module is arranged to detect the eye and head movement conditions of the driver, and the warning tone storage module is arranged to store the warning tones. Different prompt tones can be stored, and the controller is arranged and has judgment logic.

Description

Technical Field

[0001] The present invention belongs to the technical field of prompt sounds, and in particular relates to a prompt sound adjustment method, system and storage medium. Background Art

[0002] With the rapid development of the smart car industry in recent years, sound is gradually becoming an important medium for the future interaction between people and cars and between cars and the external environment. As the most important component, whether the prompt sound can intelligently provide users with accurate prompt information and the quality of the sound are gradually becoming factors that consumers consider when buying cars. At the same time, the country has also issued corresponding regulations for the external prompt sound, but there is still the problem of accidents caused by drivers' lack of concentration. Summary of the invention

[0003] In view of this, the present invention aims to provide a prompt tone adjustment method, system and storage medium to solve the problem of accidents caused by driver's lack of concentration.

[0004] To achieve the above object, the technical solution of the present invention is achieved as follows:

[0005] A prompt tone adjustment method, comprising:

[0006] S1, collect prompt tones;

[0007] S2, detecting the driver's eye and head movement and eye closure;

[0008] S3, storing different prompt tones;

[0009] S4. The judgment logic detects the driver's eye and head movement and eye closure signals to determine whether the driver notices the prompt tone. If so, the prompt tone remains unchanged; if not, the prompt tone is switched.

[0010] Furthermore, the decibel of the prompt sound increases after the switch, and the logic of increasing the decibel of the prompt sound includes:

[0011] Set the original decibel level to X, and increase it by 0.1X;

[0012] Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased decibels.

[0013] Furthermore, if the original decibel setting of the prompt tone is 40 decibels, the prompt tone is increased by 4 decibels to 44 decibels for the first time; and whether the prompt tone is noticed is continuously detected. If not noticed, the prompt tone is switched to be increased by 4 decibels to 48 decibels.

[0014] Furthermore, the frequency of the prompt tone playback increases after the switch, and the logic of increasing the frequency of the prompt tone playback includes:

[0015] Set the original playback frequency to YHz, and increase it by Y;

[0016] Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased playback frequency.

[0017] Furthermore, if the driver notices the reminder tone the first time, it switches to an encouraging tone;

[0018] If the driver still does not heed the reminder tone after N reminders, a final warning tone will be issued.

[0019] Furthermore, the ultimate warning prompt tone is stored in the prompt tone storage module, and the ultimate warning prompt tone includes a personalized prompt tone or a relative voice prompt tone or a high-playing frequency prompt tone.

[0020] Furthermore, the judgment logic specifically includes judging the tilt angle of the eyeball, the movement of the head, and the closure of the eyes;

[0021] When the sound playing is the left turn signal, the head and eyes turn left 0-20° to observe the front through the front windshield and the left side of the vehicle through the left rearview mirror;

[0022] When the prompt sound is the right turn prompt sound, the head and eyes turn right 20-80 degrees. Because the driver's seat is close to the left rearview mirror, if you observe through the right rearview mirror, you need to turn more angles; it is used to observe the front situation through the front windshield and the right side of the vehicle through the right rearview mirror at the same time.

[0023] Furthermore, the judgment logic specifically includes judging whether the eyeballs and the head are moving, and whether they are moving to the corresponding area;

[0024] The judgment logic specifically also includes judging the eye closure status.

[0025] Furthermore, in judging the eye closure situation, it is necessary to record the user's eye opening and closing data in normal driving status in advance. The opening and closing data includes the maximum distance H between the upper and lower eyelids. When it is detected that the distance is lower than the preset distance, it is necessary to judge whether the driver notices the prompt sound. If not, the prompt sound is switched.

[0026] A prompt tone adjustment system, comprising:

[0027] A prompt sound collection module, used for collecting prompt sounds;

[0028] A visual detection module, used to detect the driver's eye and head movements and eye closure;

[0029] A prompt sound storage module is used to store different prompt sounds. The prompt sound storage module can be a USB flash drive or a memory card, which stores different audios;

[0030] The controller has judgment logic.

[0031] Furthermore, the prompt sound collection module is a microphone, and the microphone is a MEMS microphone, a capacitor microphone, or a dynamic microphone.

[0032] Furthermore, two microphones are provided and arranged on both sides of the driver's seat headrest.

[0033] Furthermore, the visual detection module is a motion detector.

[0034] Furthermore, the visual detection module is arranged in front of the face.

[0035] A storage medium is a computer-readable storage medium, storing a computer program, and the computer program implements the prompt tone adjustment method when executed by a processor.

[0036] Compared with the prior art, the prompt tone adjustment method, system and storage medium described in the present invention have the following advantages:

[0037] The present invention discloses a prompt sound adjustment method, system and storage medium, which can solve the problem of accidents caused by driver's lack of concentration. A prompt sound collection module is provided to remove impurities from prompt sound collection to improve efficiency and accuracy. A visual detection module is provided to detect the driver's eye and head movement. A prompt sound storage module is provided to store different prompt sounds. A controller is provided. The controller has judgment logic. The judgment logic can judge whether the driver has noticed the prompt sound through the driver's eye and head movement signal detected by the visual detection module. If the driver has noticed, the prompt sound remains unchanged. If the driver has not noticed, the prompt sound is switched. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the accompanying drawings:

[0039] Figure 1 A schematic diagram of the method flow of the embodiment of the present invention;

[0040] Figure 2 A schematic diagram of the system principle described in an embodiment of the present invention;

[0041] Figure 3 A schematic diagram of the horizontal plane field of view and the vertical plane field of view according to an embodiment of the present invention;

[0042] Figure 4 This is a schematic diagram of the physical scene described in Example 1 of the present invention;

[0043] Figure 5 This is a schematic diagram of the physical scene described in Example 2 of the present invention. DETAILED DESCRIPTION

[0044] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0045] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and the like are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", and the like may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0046] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood by specific circumstances.

[0047] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0048] like Figures 1 to 5 As shown, a prompt tone adjustment method includes:

[0049] S1, collect prompt tones;

[0050] S2, detecting the driver's eye and head movement and eye closure;

[0051] S3, storing different prompt tones;

[0052] S4. The judgment logic detects the driver's eye and head movement and eye closure signals to determine whether the driver notices the prompt tone. If so, the prompt tone remains unchanged; if not, the prompt tone is switched.

[0053] In a preferred embodiment of the present invention, the decibel of the prompt sound after switching is increased, and the logic of increasing the decibel of the prompt sound includes:

[0054] Set the original decibel level to X, and increase it by 0.1X;

[0055] Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased decibels.

[0056] If the original decibel setting of the prompt tone is 40 decibels, the prompt tone is increased by 4 decibels to 44 decibels for the first time; and the prompt tone is continuously detected to see whether the user notices the prompt tone. If the user has not noticed the prompt tone, the prompt tone is switched to be increased by 4 decibels to 48 decibels.

[0057] If the driver notices the prompt sound for the first time, it will switch to an encouraging sound. The encouraging sound can be set as a game passing sound effect to increase fun and interactivity.

[0058] If after three reminders and continuous detection, no prompt tone is heard, a final warning is issued. The final warning prompt tone is stored in advance. The final warning prompt tone can be recorded in advance or a personalized prompt tone, such as a voice recording of a relative, or a prompt tone with a higher frequency;

[0059] In addition, the judgment logic in the controller includes a continuous detection feedback function, which not only switches the prompt tone, but can continuously detect the prompt tone and switch the prompt tone stored in advance. For example, users can preset N reminders in advance according to different habits, not limited to three reminders.

[0060] In this embodiment, according to the hearing characteristics of the human ear, for every 10dB increase in sound pressure level, the loudness heard by the human ear increases by about 1 times. Therefore, on the basis of the original sound pressure level of the prompt sound, another 10dB will be increased, so that the driver will subjectively have a significant increase in loudness, so that he can perceive the prompt sound and respond accordingly.

[0061] In a preferred embodiment of the present invention, the frequency of playing the prompt tone after switching is increased, and the logic of increasing the frequency of playing the prompt tone includes:

[0062] Set the original playback frequency to YHz, and increase it by Y;

[0063] Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased playback frequency.

[0064] For example: If the playback frequency of a certain prompt tone is 1Hz, increase it by 1Hz for the first time, and continue to check whether the prompt tone is heard. If it is not noticed, switch to a 3Hz prompt tone;

[0065] If the driver notices the prompt sound for the first time, it will switch to an encouraging sound, which can be set as a game-clearing sound effect to increase fun and interactivity. The game-clearing sound effect will bring joy and a sense of accomplishment to the driver.

[0066] After three reminders and continuous detection, if no prompt tone is heard, a final warning tone is issued. The final warning tone is stored in advance and can be a pre-recorded or personalized prompt tone, such as a voice recording of a relative; or a prompt tone with a higher playback frequency;

[0067] In addition, the judgment logic in the controller includes a continuous detection feedback function, which not only switches the prompt tone, but can continuously detect the prompt tone and switch the prompt tone stored in advance. For example, users can preset N reminders in advance according to different habits, not limited to three reminders.

[0068] In this embodiment, the frequency of the prompt sound playback can be increased according to the hearing characteristics of the human ear (for example, the playback interval is changed from 500ms to 100ms), thereby creating a subjective feeling of urgency and tension, thereby prompting the driver to perform corresponding operations.

[0069] In a preferred embodiment of the present invention, the judgment logic specifically includes judging the tilt angle of the eyeball, the movement of the head and the closure of the eyes.

[0070] For example, Figure 3 As shown in the figure, when the sound playing is the left turn sound, the head and eyes turn left together by 0-20° to observe the front situation through the front windshield, and observe the left side of the vehicle through the left rearview mirror, so as to ensure the safety of left turn driving;

[0071] When the sound is a right turn signal, the head and eyes turn right 20-80 degrees, because the driver's seat is closer to the left rearview mirror, if you look through the right rearview mirror, you need to turn more. It is used to observe the front through the front windshield and the right side of the vehicle through the right rearview mirror, so as to ensure the safety of right turn driving.

[0072] The judgment logic specifically includes judging whether the eyeballs and the head are moving, and whether they move to the corresponding area. The judgment logic judges through the image of the camera, and the movement of the eyeballs is considered movement, and the movement of the head is considered head movement.

[0073] The judgment logic also includes judging the eye closure:

[0074] In judging the eye closure situation, it is necessary to record the user's eye opening and closing data in normal driving status in advance. The opening and closing data includes but is not limited to the maximum distance H between the upper and lower eyelids. When it is detected that the distance is lower than the preset distance (such as 0.2H), it is judged whether the driver notices the prompt sound. If not, the prompt sound is switched.

[0075] In addition, the user's eye opening and closing data in normal driving status is recorded in advance here, and H is continuously learned and corrected during use; different users can store memories as Ha, Hb, Hc, which respectively represent the opening and closing data of users a, b, and c as the main drivers.

[0076] In a preferred embodiment of the present invention, when a prompt sound is heard, a person's blinking speed decreases and the person keeps his eyes open for a long time to observe the surrounding environment and possible dangerous situations. When the prompt sound is heard, the driver's eyes are focused on whether the visual area prompted by the prompt sound is correct.

[0077] The present invention provides a prompt tone adjustment system, comprising:

[0078] A prompt sound collection module, used for collecting prompt sounds;

[0079] A visual detection module, used to detect the driver's eye and head movements and eye closure;

[0080] A prompt sound storage module is used to store different prompt sounds. The prompt sound storage module can be a USB flash drive or a memory card, which stores different audios;

[0081] The controller has a judgment logic. The judgment logic judges whether the driver notices the prompt sound through the driver's eye and head movement signals detected by the visual detection module. If the driver notices it, the prompt sound remains unchanged; if not, the prompt sound is switched.

[0082] In a preferred embodiment of the present invention, the prompt sound collection module is a microphone, and a MEMS microphone, a condenser microphone and a dynamic microphone can be used.

[0083] In a preferred embodiment of the present invention, two microphones are provided, which are arranged on both sides of the driver's seat headrest. At the same time, the microphone has a de-cluttering algorithm, which can remove useless information, reduce the complexity of calculation, and improve efficiency and accuracy. The microphone has an existing algorithm for de-cluttering, which can collect human voices, road noise, wind noise and other noises in the car. These noises need to be removed, and only the sound of the prompt tone is retained.

[0084] In a preferred embodiment of the present invention, the visual detection module is a motion detector.

[0085] In a preferred embodiment of the present invention, the visual detection module is arranged in front of the human face.

[0086] The present invention provides a storage medium, which is a computer-readable storage medium and stores a computer program. When the computer program is executed by a processor, the prompt tone adjustment method is implemented.

[0087] The invention can solve the problem of accidents caused by the driver's lack of concentration.

[0088] Example 1

[0089] like Figure 4 As shown, when the driver needs to turn left during driving, he needs to turn the steering rod to trigger the left turn signal and the turn prompt sound. At this time, the driver needs to observe the outside environment through the front windshield and the left rearview mirror to see if there are any safety hazards, and then make a left turn.

[0090] Before the driver is ready to make a left turn, he needs to turn the left steering rod to trigger the turn signal sound and turn signal to remind the driver that the function has been successfully turned on. At the same time, the turn signal outside the car has also been successfully turned on. At this time, the driver needs to observe through the front windshield and the left rearview mirror. At this time, the action detector set in front of the driver is used to detect whether the driver observes the surrounding environment according to the predetermined operation, such as detecting whether the head and eyes are shifted, and whether the eyes observe the left rearview mirror. If the detected angle value of the driver's rotation is consistent with the original set angle, the logic controller controls the left turn signal sound according to the original sound pressure level; if the detector determines that the shift angle does not meet the predetermined requirement (20±3°), the original prompt sound pressure level is switched to a prompt sound with a 10dB increase, or switched to a prompt sound with a higher prompt sound playback frequency (for example, from a playback interval of 500ms to 100ms), thereby creating a subjective feeling of urgency and tension, thereby prompting the driver to perform corresponding operations.

[0091] If the driver receives this prompt information and responds accordingly, the prompt sound will switch to its original state until the driver completes the turning action, and the prompt sound will stop working.

[0092] Example 2

[0093] like Figure 5As shown, when the driver is reversing, he needs to observe the rearview mirror and the reversing image under normal circumstances to prevent the vehicle from hitting the obstacle. At present, a reversing radar is set at the rear of the vehicle to measure the distance between the vehicle and the obstacle. At the same time, the reversing radar prompt sound will be triggered if the vehicle is too close to the obstacle and there is a risk of collision. When the vehicle is too close to the obstacle, a prompt sound will be emitted in the car to remind the driver of the danger. However, when the driver does not pay attention to the content prompted by the prompt sound, the logic judgment system will detect whether the head and eyes are shifted, and whether the eyes are observing the left rearview mirror. If the detected angle of the driver's rotation is consistent with the original set angle, the logic controller will control the left turn prompt sound according to the original sound pressure level; if the detector determines that the transfer angle does not meet the predetermined requirement (20±3°), the original prompt sound pressure level will be switched to a prompt sound with a 10dB increase, or switched to a prompt sound with a higher prompt sound playback frequency (for example, from a playback interval of 500ms to 100ms), thereby creating a subjective feeling of haste and tension, thereby prompting the driver to perform corresponding operations.

[0094] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A prompt tone adjustment method, characterized in that: include: S1, collect prompt tones; S2, detecting the driver's eye and head movement and eye closure; S3, storing different prompt tones; S4. The judgment logic detects the driver's eye and head movement and eye closure signals to determine whether the driver notices the prompt tone. If so, the prompt tone remains unchanged; if not, the prompt tone is switched.

2. A prompt tone adjustment method according to claim 1, characterized in that: After switching, the decibel of the prompt sound increases, and the logic of increasing the decibel of the prompt sound includes: Set the original decibel level to X, and increase it by 0.1X; Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased decibels.

3. A prompt tone adjustment method according to claim 2, characterized in that: If the original decibel setting of the prompt tone is 40 decibels, the prompt tone is increased by 4 decibels to 44 decibels for the first time; and the prompt tone is continuously detected to see whether the user notices the prompt tone. If the user has not noticed the prompt tone, the prompt tone is switched to be increased by 4 decibels to 48 decibels.

4. The method for adjusting the prompt tone according to claim 1, characterized in that: After switching, the frequency of the prompt tone playback increases, and the logic of increasing the frequency of the prompt tone playback includes: Set the original playback frequency to YHz, and increase it by Y; Detect whether the driver notices the prompt sound. If the driver notices the prompt sound, stop switching the prompt sound. If the driver does not notice the prompt sound, continue switching the prompt sound with increased playback frequency.

5. A prompt tone adjustment method according to claim 2 or 4, characterized in that: If the driver notices the warning tone the first time, it switches to an encouraging tone; If the driver still does not heed the reminder tone after N reminders, a final warning tone will be issued.

6. A prompt tone adjustment method according to claim 5, characterized in that: The ultimate warning prompt tone is stored in the prompt tone storage module, and the ultimate warning prompt tone includes a personalized prompt tone, a relative voice prompt tone, or a high-playing frequency prompt tone.

7. A prompt tone adjustment method according to claim 1, characterized in that: The judgment logic specifically includes judging the tilt angle of the eyeball, the movement of the head, and the closure of the eyes; When the sound playing is the left turn signal, the head and eyes will turn left 0-20° to observe the front through the front windshield and the left side of the vehicle through the left rearview mirror, thus ensuring the safety of left turn driving; When the sound playing is the right turn sound, the head and eyes turn right 20-80 degrees, because the driver's seat is closer to the left rearview mirror, if you look through the right rearview mirror, you need to turn more angles; it is used to observe the front situation through the front windshield and the right side of the vehicle through the right rearview mirror, so as to ensure the safety of right turn driving; The judgment logic specifically includes judging whether the eyeballs and the head are moving, and whether they are moving to the corresponding area; The judgment logic specifically also includes judging whether the eyes are closed.

8. A prompt tone adjustment method according to claim 6, characterized in that: In judging the eye closure situation, it is necessary to record the user's eye opening and closing data in normal driving status in advance. The opening and closing data includes the maximum distance H between the upper and lower eyelids. When it is detected that the distance is lower than the preset distance, it is necessary to judge whether the driver notices the prompt sound. If not, the prompt sound is switched.

9. A prompt tone adjustment system, characterized in that: The prompt tone adjustment method applied to any one of claims 1 to 8, the system comprising: A prompt sound collection module, used for collecting prompt sounds; A visual detection module, used to detect the driver's eye and head movements and eye closure; A prompt sound storage module is used to store different prompt sounds. The prompt sound storage module can be a USB flash drive or a memory card, which stores different audios; The controller has judgment logic.

10. A storage medium, which is a computer-readable storage medium, storing a computer program, characterized in that: When the computer program is executed by a processor, the prompt tone adjustment method according to any one of claims 1 to 8 is implemented.

Images