Attention monitoring and reminding system based on retina tracking

Abstract

The invention relates to the technical field of biological characteristic monitoring, in particular to an attention monitoring and reminding system based on retina tracking, which comprises an image acquisition module, a transmission module, a processor module, a retina imaging processing module, an attention analysis module, a controller module, a reminding module, an encryption module, a tamper-proof module and a voice assistant module, the transmission module is connected with the image acquisition module, the processor module is connected with the transmission module, the retina imaging module is connected with the processor module, the attention analysis module is connected with the retina imaging processing module, and the controller module is connected with the attention analysis module. In this way, the technical problem that in the prior art, a driver attention detection and reminding method, such as detection based on brain waves or a vehicle movement mode, has certain effects but also has limitations in precision and real-time performance is solved.

Description

Technical Field

[0001] The present invention relates to the field of biometric monitoring technology, and in particular to an attention monitoring and reminder system based on retinal tracking. Background Art

[0002] With the development of the economy and the improvement of people's living standards, the number of motor vehicles continues to grow rapidly, and in some areas the traffic flow has increased and the quality of drivers is uneven, which has led to an increase in road traffic accidents. With the increase in road traffic accidents, the driver's attention has become a key factor in safe driving, so it is necessary to detect and remind the driver's attention.

[0003] Traditional driver attention detection and reminder methods, such as those based on brainwave or vehicle motion pattern detection, are effective to a certain extent, but they are still limited in accuracy and real-time performance. Summary of the invention

[0004] The purpose of the present invention is to provide an attention monitoring and reminder system based on retinal tracking, aiming to solve the technical problems that the driver attention detection and reminder methods in the prior art, such as detection based on brain waves or vehicle motion patterns, have certain effects but still have limitations in accuracy and real-time performance.

[0005] To achieve the above-mentioned objectives, the present invention adopts an attention monitoring and reminder system based on retinal tracking, including an image acquisition module, a transmission module, a processor module, a retinal imaging processing module, an attention analysis module, a controller module, a reminder module, an encryption module, an anti-tampering module and a voice assistant module. The transmission module is connected to the image acquisition module, the processor module is connected to the transmission module, the retinal imaging module is connected to the processor module, the attention analysis module is connected to the retinal imaging processing module, the controller module is connected to the attention analysis module, the reminder module is connected to the controller module, the encryption module is connected to the transmission module, the anti-tampering module is connected to the encryption module, the voice assistant module is connected to the processor module, and the voice assistant module includes a voice acquisition submodule and an execution submodule.

[0006] The reminder module includes a sound reminder submodule, a vibration reminder submodule and a dashboard reminder submodule, and the sound reminder submodule, the vibration reminder submodule and the dashboard reminder submodule are all connected to the controller module.

[0007] Among them, the image acquisition module is a retinal tracking device, which is installed inside the vehicle and can capture the driver's eye movements and visual focus in real time.

[0008] Among them, the attention monitoring and reminder system based on retinal tracking also includes a fatigue level analysis module and an early warning module, the fatigue level analysis module is connected to the processor module, and the early warning module is connected to the fatigue level analysis module.

[0009] Among them, the attention monitoring and reminder system based on retinal tracking also includes an emotion recognition module and a regulation module, the emotion recognition module is connected to the processor module, and the regulation module is connected to the emotion recognition module.

[0010] The adjustment module includes a music soothing submodule and a soothing suggestion submodule, and both the music soothing submodule and the soothing suggestion submodule are connected to the emotion recognition module.

[0011] Among them, the attention monitoring and reminder system based on retinal tracking also includes an auxiliary decision-making module, and the auxiliary decision-making module is also connected to the processor module.

[0012] Among them, the attention monitoring and reminder system based on retinal tracking also includes an environment sensing module and an adjustment module, the environment sensing module is connected to the processor module, and the adjustment module is connected to the environment sensing module.

[0013] Wherein, the attention monitoring and reminder system based on retinal tracking also includes a monitoring module, and the monitoring module is connected to the controller module.

[0014] Among them, the attention monitoring and reminder system based on retinal tracking also includes an energy-saving driving suggestion module, and the energy-saving driving suggestion module is also connected to the processor module.

[0015] The attention monitoring and reminder system based on retinal tracking of the present invention, when used specifically, captures and analyzes the retinal image of the driver's eyes in real time through the image acquisition module, and transmits it to the processor module through the transmission module. The processor module processes the image information and transmits it to the attention analysis module. The attention analysis module can accurately judge the driver's gaze direction and concentration by identifying the fine blood vessel structure and movement trajectory on the retina, and can comprehensively consider multiple indicators such as the driver's gaze time, blinking frequency, pupil changes, etc., comprehensively evaluate the driver's attention state, and set a reasonable distraction threshold. When it is detected that the driver's attention state is lower than the set distraction threshold, the controller module will control the reminder module to immediately start real-time reminders for the driver to adjust his attention. In this way, the driver's attention detection and reminder methods in the prior art, such as those based on brain wave or vehicle motion pattern detection, although have certain effects, still have technical problems of limitations in accuracy and real-time performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 It is a principle block diagram of the first embodiment of the present invention.

[0018] Figure 2 It is a principle block diagram of the second embodiment of the present invention.

[0019] Figure 3 It is a principle block diagram of the third embodiment of the present invention.

[0020] 101-image acquisition module, 102-transmission module, 103-processor module, 104-retinal imaging processing module, 105-attention analysis module, 106-controller module, 107-reminder module, 108-encryption module, 109-anti-tampering module, 110-voice assistant module, 111-fatigue analysis module, 112-warning module, 113-voice acquisition submodule, 114-execution submodule, 115-sound reminder submodule, 116-vibration reminder submodule, 117-dashboard prompt submodule, 201-emotion recognition module, 202-adjustment module, 203-decision support module, 204-music soothing submodule, 205-soothing suggestion submodule, 301-environmental sensing module, 302-adjustment module, 303-monitoring module, 304-energy-saving driving suggestion module. DETAILED DESCRIPTION

[0021] Embodiments of the present invention are described in detail below. Examples of the embodiments are shown in the accompanying drawings. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, but should not be construed as limiting the present invention.

[0022] The first embodiment of the present application is:

[0023] See also Figure 1 , Figure 1 It is a principle block diagram of the first embodiment of the present invention.

[0024] The present invention provides an attention monitoring and reminder system based on retinal tracking, including an image acquisition module 101, a transmission module 102, a processor module 103, a retinal imaging processing module 104, an attention analysis module 105, a controller module 106, a reminder module 107, an encryption module 108, an anti-tampering module 109, a voice assistant module 110, a fatigue level analysis module 111 and an early warning module 112, wherein the voice assistant module 110 includes a voice acquisition submodule 113 and an execution submodule 114, and the reminder module 107 includes a sound reminder submodule 115, a vibration reminder submodule 116 and a dashboard reminder submodule 117. The above-mentioned scheme solves the driver attention detection and reminder method in the prior art, such as detection based on brain waves or vehicle motion patterns, which has certain effects but still has technical problems of limitations in accuracy and real-time performance.

[0025] For this specific implementation, the transmission module 102 is connected to the image acquisition module 101, the processor module 103 is connected to the transmission module 102, the retinal imaging module is connected to the processor module 103, the attention analysis module 105 is connected to the retinal imaging processing module 104, the controller module 106 is connected to the attention analysis module 105, the reminder module 107 is connected to the controller module 106, the encryption module 108 is connected to the transmission module 102, the anti-tampering module 109 is connected to the encryption module 108, the voice assistant module 110 is connected to the processor module 103, and the voice assistant module 110 includes a voice acquisition submodule 113 and an execution submodule 114;

[0026] The image acquisition module 101 is a retinal tracking device, which is installed inside the vehicle and can capture the driver's eye movements and sight focus in real time;

[0027] During specific use, the image acquisition module 101 captures and analyzes the retinal image of the driver's eyes in real time, and transmits it to the processor module 103 through the transmission module 102. The processor module 103 processes the image information and transmits it to the attention analysis module 105. The attention analysis module 105 can accurately judge the driver's gaze direction and concentration by identifying the fine blood vessel structure and movement trajectory on the retina, and can comprehensively consider multiple indicators such as the driver's gaze time, blinking frequency, pupil changes, etc., comprehensively evaluate the driver's attention state, and set a reasonable distraction threshold. When it is detected that the driver's attention state is lower than the set distraction threshold, the controller module 106 will control the reminder module 107 to immediately start real-time reminders for the driver to adjust his attention. In this way, the existing driver attention detection and reminder methods, such as those based on brain waves or vehicle motion patterns, although have certain effects, still have technical problems of limitations in accuracy and real-time performance.

[0028] Among them, the sound reminder submodule 115, the vibration reminder submodule 116 and the dashboard reminder submodule 117 are all connected to the controller module 106, and the sound reminder submodule 115, the vibration reminder submodule 116 and the dashboard reminder submodule 117 remind the driver to concentrate through sound, vibration or dashboard lights.

[0029] Secondly, the fatigue level analysis module 111 is connected to the processor module 103, and the early warning module 112 is connected to the fatigue level analysis module 111. The fatigue level analysis module 111 combines retinal tracking data (such as blinking frequency, pupil reaction time, etc.) with facial recognition technology to analyze the driver's fatigue level. When it is detected that the driver is in a fatigue state, the early warning module 112 warns the driver "Fatigue driving, please take a rest."

[0030] When using the attention monitoring and reminder system based on retinal tracking of the present embodiment, the image acquisition module 101 captures and analyzes the retinal image of the driver's eyes in real time, and transmits it to the processor module 103 through the transmission module 102. The processor module 103 processes the image information and transmits it to the attention analysis module 105. The attention analysis module 105 can accurately judge the driver's gaze direction and concentration by identifying the fine blood vessel structure and movement trajectory on the retina, and can comprehensively consider multiple indicators such as the driver's gaze time, blinking frequency, pupil changes, etc., comprehensively evaluate the driver's attention state, and set a reasonable distraction threshold. When it is detected that the driver's attention state is lower than the set distraction threshold, the controller module 106 will control the reminder module 107 to immediately start real-time reminders for the driver to adjust his attention. In this way, the existing driver attention detection and reminder methods in the art, such as detection based on brain waves or vehicle motion patterns, although have certain effects, still have technical problems of limitations in accuracy and real-time performance.

[0031] The second embodiment of the present application is:

[0032] Based on the first embodiment, please refer to Figure 2 , Figure 2 It is a principle block diagram of the second embodiment of the present invention.

[0033] The present invention provides an attention monitoring and reminder system based on retinal tracking, which also includes an emotion recognition module 201, an adjustment module 202 and an auxiliary decision module 203. The adjustment module 202 includes a music soothing submodule 204 and a soothing suggestion submodule 205.

[0034] For this specific implementation, the emotion recognition module 201 is connected to the processor module 103, and the adjustment module 202 is connected to the emotion recognition module 201. When in specific use, the emotion recognition module 201 monitors the driver's emotional state in real time through facial expression analysis and voice recognition technology. When it is detected that the driver has negative emotions such as anger and anxiety, the adjustment module 202 plays soothing music and sends positive information to the vehicle-mounted display screen to soothe the emotions.

[0035] The soothing music submodule 204 and the soothing suggestion submodule 205 are both connected to the emotion recognition module 201 , and the soothing music submodule 204 performs part of the music for cleansing and soothing, while the soothing suggestion submodule 205 sends positive information to the vehicle display screen for emotion soothing.

[0036] Secondly, the auxiliary decision module 203 is also connected to the processor module 103. When the driver's attention is still distracted, the auxiliary decision module 203 will make auxiliary decisions, such as temporary pull-over parking.

[0037] When using the attention monitoring and reminder system based on retinal tracking of this embodiment, the emotion recognition module 201 monitors the driver's emotional state in real time through facial expression analysis and voice recognition technology. When it is detected that the driver has negative emotions such as anger and anxiety, the adjustment module 202 plays soothing music and sends positive information to the vehicle display screen to soothe the driver's emotions. When the driver's attention is still distracted, the auxiliary decision module 203 will make auxiliary decisions, such as temporary pull-over.

[0038] The third embodiment of the present application is:

[0039] Based on the second embodiment, please refer to Figure 3 , Figure 3 It is a principle block diagram of the third embodiment of the present invention.

[0040] The present invention provides an attention monitoring and reminder system based on retinal tracking, which also includes an environment sensing module 301, an adjustment module 302, a monitoring module 303 and an energy-saving driving suggestion module 304.

[0041] For this specific implementation, the environment sensing module 301 is connected to the processor module 103, and the adjustment module 302 is connected to the environment sensing module 301. The environment sensing module 301 obtains external light and weather conditions (such as rain, fog, and snow), and automatically adjusts the interior lighting, windshield transparency, and rearview mirror clarity through the adjustment module 302 to ensure a clear field of vision for the driver.

[0042] The monitoring module 303 is connected to the controller module 106 , and the monitoring module 303 is used to monitor the operating status of the controller.

[0043] Secondly, the energy-saving driving suggestion module 304 is also connected to the processor module 103. The energy-saving driving module provides energy-saving driving suggestions to the driver based on driving behavior and road condition information, such as optimizing acceleration and deceleration strategies, selecting a suitable driving speed, etc., to reduce fuel consumption and emissions.

[0044] Using the attention monitoring and reminder system based on retinal tracking of the present invention of this embodiment, the environmental sensing module 301 obtains external light and weather conditions (such as rain, fog, and snow), and automatically adjusts the interior lighting, windshield transparency, and rearview mirror clarity through the adjustment module 302 to ensure that the driver has a clear field of vision. The energy-saving driving module provides the driver with energy-saving driving suggestions based on driving behavior and road condition information, such as optimizing acceleration and deceleration strategies, selecting a suitable driving speed, etc., to reduce fuel consumption and emissions.

[0045] What is disclosed above is only a preferred embodiment of the present invention, and it certainly cannot be used to limit the scope of rights of the present invention. Ordinary technicians in this field can understand that all or part of the processes of the above embodiment and equivalent changes made according to the claims of the present invention still fall within the scope of the invention.

Claims

1. A retinal tracking-based attention monitoring and reminder system, characterized in that: It includes an image acquisition module, a transmission module, a processor module, a retinal imaging processing module, an attention analysis module, a controller module, a reminder module, an encryption module, an anti-tampering module and a voice assistant module. The transmission module is connected to the image acquisition module, the processor module is connected to the transmission module, the retinal imaging module is connected to the processor module, the attention analysis module is connected to the retinal imaging processing module, the controller module is connected to the attention analysis module, the reminder module is connected to the controller module, the encryption module is connected to the transmission module, the anti-tampering module is connected to the encryption module, the voice assistant module is connected to the processor module, and the voice assistant module includes a voice acquisition submodule and an execution submodule.

2. The attention monitoring and reminder system based on retinal tracking as claimed in claim 1, characterized in that: The reminder module includes a sound reminder submodule, a vibration reminder submodule and a dashboard reminder submodule, and the sound reminder submodule, the vibration reminder submodule and the dashboard reminder submodule are all connected to the controller module.

3. The attention monitoring and reminder system based on retinal tracking as claimed in claim 2, characterized in that: The image acquisition module is a retinal tracking device, which is installed inside the vehicle and can capture the driver's eye movements and visual focus in real time.

4. The attention monitoring and reminder system based on retinal tracking as claimed in claim 3, characterized in that: The attention monitoring and reminder system based on retinal tracking also includes a fatigue degree analysis module and an early warning module. The fatigue degree analysis module is connected to the processor module, and the early warning module is connected to the fatigue degree analysis module.

5. The attention monitoring and reminder system based on retinal tracking as claimed in claim 4, characterized in that: The attention monitoring and reminder system based on retinal tracking also includes an emotion recognition module and a regulation module, wherein the emotion recognition module is connected to the processor module, and the regulation module is connected to the emotion recognition module.

6. The attention monitoring and reminder system based on retinal tracking as claimed in claim 5, characterized in that: The adjustment module includes a music soothing submodule and a soothing suggestion submodule, and both the music soothing submodule and the soothing suggestion submodule are connected to the emotion recognition module.

7. The attention monitoring and reminder system based on retinal tracking as claimed in claim 6, characterized in that: The attention monitoring and reminder system based on retinal tracking also includes an auxiliary decision-making module, which is also connected to the processor module.

8. The attention monitoring and reminder system based on retinal tracking as claimed in claim 7, characterized in that: The attention monitoring and reminder system based on retinal tracking also includes an environment sensing module and an adjustment module. The environment sensing module is connected to the processor module, and the adjustment module is connected to the environment sensing module.

9. The attention monitoring and reminder system based on retinal tracking as claimed in claim 8, characterized in that: The attention monitoring and reminder system based on retinal tracking also includes a monitoring module, which is connected to the controller module.

10. The attention monitoring and reminder system based on retinal tracking as claimed in claim 9, characterized in that: The attention monitoring and reminder system based on retinal tracking also includes an energy-saving driving suggestion module, which is also connected to the processor module.

Images