Light scheduling system and method for automobile

Abstract

The invention discloses a light scheduling system and method for an automobile, and belongs to the technical field of automobile intelligence. The light scheduling system for the automobile comprises an acquisition module, an acquisition module, an analysis module, a control module and output equipment, the acquisition module is used for acquiring state information and driving information of a driver; the obtaining module is used for obtaining traffic light information in the vehicle driving direction. The analysis module is used for analyzing the fatigue type of the driver; the control module is used for processing the information transmitted by the acquisition module and the analysis module and sending a control instruction to the output equipment; the output device is used for outputting relaxation and prompt information according to the control instruction. According to the light scheduling system and method for the automobile, the state of a driver and traffic light information in the driving direction of the automobile can be monitored, different types of relaxation information are output, personalized relaxation experience is provided, the driver can relax the mind and body in the red light waiting period, fatigue is effectively relieved, and the driving state and driving safety are improved.

Description

Technical Field

[0001] The invention relates to a lighting scheduling system and method for an automobile, belonging to the technical field of automobile intelligence. Background Art

[0002] At present, with the development of industrialization, the number of cars has increased sharply, leading to frequent traffic accidents. Among them, fatigue driving accounts for about 20% of the total number of road traffic accidents, becoming one of the main causes of accidents. Many drivers use mobile phones and other devices while waiting for traffic lights, which distracts their attention and affects their driving status.

[0003] In the existing technology, when the driver is waiting for the traffic light, the traffic light information of the driver's status and the vehicle's driving direction cannot be monitored, and relaxation information cannot be provided according to the driver's fatigue state, which makes it impossible for the driver to relax while waiting for the traffic light, reduces the driving state, and is not conducive to safe driving. Summary of the invention

[0004] The technical problem to be solved by the present invention is to overcome the shortcomings of the prior art and provide a lighting scheduling system and method for a car, which can monitor the driver's status and traffic light information of the vehicle's driving direction, and output different types of relaxation information to provide a personalized relaxation experience, so that the driver can relax his body and mind while waiting at a red light, effectively relieve fatigue, and improve driving status and driving safety.

[0005] In order to solve the above technical problems, the technical solution of the present invention is:

[0006] In one aspect, the present invention provides a lighting scheduling system for a car, which includes a collection module, an acquisition module, an analysis module, a control module and an output device;

[0007] The collection module is used to collect the driver's status information and driving information;

[0008] The acquisition module is used to acquire traffic light information in the direction of vehicle travel;

[0009] The analysis module is used to analyze the driver's fatigue type;

[0010] The control module is used to process the information transmitted by the acquisition module and the analysis module and send control instructions to the output device;

[0011] The output device is used to output relaxation and prompt information according to the control instruction.

[0012] Further, the acquisition module includes a user status sensor and a driving information sensor;

[0013] The user status sensor is used to collect the driver's status information;

[0014] The driving information sensor is used to collect driving information.

[0015] Further, the acquisition module includes a vehicle status acquisition component and a body control module;

[0016] The vehicle status acquisition component is used to determine the vehicle's position, lane information, and traffic light information of the vehicle's travel direction;

[0017] The body control module is used to collect the vehicle's turn signal information.

[0018] Furthermore, the analysis module includes a fatigue discrimination model, and the fatigue discrimination model is trained based on user state data collected by the user state sensor and driving data collected by the driving information sensor.

[0019] Further, the control module includes a storage unit, an MCU unit, a wireless adapter and a driver;

[0020] The storage unit is used to collect and store information transmitted by the acquisition module and the analysis module;

[0021] The MCU unit is used to receive and process information transmitted by the acquisition module and the analysis module, and send control instructions to the driver through the wireless adapter;

[0022] The wireless adapter is used to send control instructions to the output device;

[0023] The driver is used to drive the output device.

[0024] Furthermore, the output devices include a central control screen, ambient lights, massage seats, speakers and a driver's position light group.

[0025] Another aspect of the present invention provides a scheduling method for a lighting scheduling system for an automobile, comprising the following steps:

[0026] Step S1, real-time monitoring of the driver's status information and driving information;

[0027] Step S2: When the vehicle approaches a traffic light intersection, the traffic light information in the direction of the vehicle's travel is monitored;

[0028] Step S3, judging whether the preset opening condition of the relaxation mode is met according to the driving information and the traffic light information of the vehicle's driving direction, if it is met, jumping to step S4, if it is not met, jumping to step S7;

[0029] Step S4, analyzing the driver's fatigue type;

[0030] Step S5, confirming the vehicle status;

[0031] Step S6: outputting relaxation information according to the driver's fatigue type;

[0032] Step S7, outputting prompt information according to the remaining waiting time of the red light;

[0033] Step S8: monitoring whether the vehicle meets the preset exit condition;

[0034] Step S9: After the preset exit condition is met, all output devices are closed.

[0035] Furthermore, in step S6, outputting relaxation information according to the driver's fatigue type specifically includes the following steps:

[0036] When the fatigue type is visual fatigue, outputting first mode relaxation information;

[0037] When the fatigue type is muscle fatigue, the second mode relaxation information is output;

[0038] When the fatigue type is attention fatigue, the third mode relaxation information is output;

[0039] When the fatigue type is mental fatigue, the fourth mode relaxation information is output;

[0040] When the fatigue type is insufficient sleep, the fifth mode relaxation information is output;

[0041] When the fatigue type is in a normal state, the sixth mode relaxation information is output.

[0042] Further, in step S7, outputting prompt information according to the remaining waiting time of the red light specifically includes the following steps:

[0043] When the remaining waiting time for the red light is the first duration, outputting the seventh mode prompt information;

[0044] When the remaining waiting time for the red light is the second duration, an eighth mode prompt message is output.

[0045] Furthermore, the scheduling method also includes the following steps: when the driver is severely fatigued, before the relaxation mode starts, the driver is prompted to take a rest through voice.

[0046] By adopting the above technical scheme, the present invention can collect the driver's status information and driving information by setting a collection module, can obtain the traffic light information of the vehicle's driving direction by setting an acquisition module, can analyze the driver's fatigue type by setting an analysis module, and can provide different modes of relaxation information and prompt information according to the driver's fatigue type by setting a control module and a variety of output devices, providing a personalized relaxation experience, so that the driver can relax his body and mind while waiting at a red light, effectively relieve fatigue, and improve driving status and driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 The principle block diagram of the lighting scheduling system for automobiles of the present invention;

[0048] Figure 2 The schematic diagram of the lighting scheduling system for automobiles of the present invention;

[0049] Figure 3 The figure is a flow chart of a scheduling method for a lighting scheduling system for an automobile according to the present invention. DETAILED DESCRIPTION

[0050] In order to make the contents of the present invention more clearly understood, the present invention is further described in detail below based on specific embodiments in conjunction with the accompanying drawings.

[0051] Embodiment 1

[0052] like Figure 1 As shown, this embodiment provides a lighting scheduling system for a car, which includes a collection module, an acquisition module, an analysis module, a control module and an output device;

[0053] The acquisition module is used to collect the driver's status information and driving information according to the fatigue monitoring instructions sent by the control module, and send the information to the analysis module, wherein the driver's status information includes head posture information, line of sight information, pulse information, body temperature information, limb strength information and breathing information, and the driving information includes driving time information, speed information, acceleration information, throttle usage information, brake application information and steering wheel operation information.

[0054] The acquisition module is used to obtain the lane and turn signal conditions of the vehicle, thereby obtaining the driving direction of the vehicle and the traffic light information in the driving direction of the vehicle, and sending the information to the control module. The traffic light information includes the color data and time data of the traffic light;

[0055] The analysis module is used to analyze the driver's fatigue type according to the driver's facial state information and driving information collected by the collection module, and the fatigue type includes visual fatigue, muscle fatigue, attention fatigue, mental fatigue, lack of sleep and no fatigue;

[0056] The control module is used to process the information transmitted by the acquisition module and the analysis module and send control instructions to the output device;

[0057] The output device is used to output relaxation and prompt information according to the control instructions.

[0058] like Figure 2 As shown, the acquisition module of this embodiment includes a user state sensor and a driving information sensor;

[0059] The user status sensor is used to collect the driver's status information. The user status sensor includes a vehicle-mounted front camera, an infrared sensor, a breathing sensor, a body temperature sensor, a blood pressure sensor, and a pulse sensor;

[0060] Driving information sensors are used to collect driving information. Driving information sensors include driving time sensors, driving speed sensors, and pressure sensors.

[0061] In this embodiment, the acquisition module uses the vehicle-mounted front camera to capture the driver's facial image and head posture. At the same time, the breathing, body temperature, blood pressure and pulse sensors provide data to assist in determining the driver's fatigue state. The infrared sensor is used to track the driver's line of sight to assess whether the driver's attention is focused on the road. The driving time sensor and the pedal and steering wheel pressure sensors are used to monitor driving behavior and assist in assessing muscle fatigue.

[0062] Facial image and head posture analysis includes eye movement analysis, eyelid opening and closing analysis, head nodding analysis, mouth yawning frequency analysis and gaze direction analysis, which are used to identify whether the driver is distracted, visually fatigued or sleep deprived. Head posture analysis is also used to identify whether the driver is dozing off due to lack of sleep or physiological fatigue, and gaze direction analysis is also used to ensure that the driver is paying attention to the road conditions.

[0063] The driving information sensor monitors the driving time, supplemented by speed, acceleration, throttle, brake and steering wheel operation data, and evaluates the fatigue type with the user status data collected by the user status sensor. By analyzing the stability of the steering wheel and pedal operations, the degree of muscle fatigue is indirectly evaluated. The driving speed sensor is used to confirm that the vehicle has stopped before outputting relaxation and prompt information to ensure driving safety.

[0064] like Figure 2 As shown, the acquisition module of this embodiment includes a vehicle state acquisition component and a body control module;

[0065] The vehicle status acquisition component is used to determine the precise location of the vehicle, lane information, and traffic light information of the vehicle's travel direction. The vehicle status acquisition component includes radar, high-definition map, vehicle-mounted navigation satellite system signal receiver, and camera. The vehicle determines the approximate location of the vehicle by receiving the signal from the vehicle-mounted navigation satellite system signal receiver, and the radar performs secondary positioning to determine the precise location;

[0066] The body control module is used to collect the vehicle's turn signal information and send it to the control module through the CAN bus. The control module determines the vehicle's driving direction based on the lane information and turn signal information.

[0067] In this embodiment, the traffic light information in the direction of vehicle travel can be captured by a camera and obtained by using an image processing algorithm, or by communicating with the traffic light using vehicle-to-everything (V2X) technology and obtained through DSRC, cellular network (such as 4G or 5G) technology, and a map that integrates traffic light information.

[0068] like Figure 2 As shown, the analysis module of this embodiment includes a fatigue discrimination model, which is trained based on the user state data collected by the user state sensor and the driving data collected by the driving information sensor, and analyzes the fatigue type. For example, it can be trained by a neural network model such as CNN, RNN, DNN, LSTM, etc.

[0069] Among them, user status data includes image data, gaze data, strength data, breathing data, body temperature data, blood pressure data, and pulse data; driving data includes driving time data, speed data, acceleration data, throttle depth data, brake depth data, and steering wheel angular velocity data.

[0070] like Figure 2 As shown, the control module of this embodiment includes a storage unit, an MCU unit, a wireless adapter and a driver;

[0071] The storage unit is used to collect and store information transmitted by the acquisition module and the analysis module;

[0072] The MCU unit is used to receive and process the information transmitted by the acquisition module and the analysis module, and send control instructions to the driver through the wireless adapter;

[0073] The wireless adapter is used to send control commands to the output device;

[0074] Drivers are used to drive output devices.

[0075] like Figure 2 As shown, the output devices of this embodiment include a central control screen, ambient lights, massage seats, speakers and a driving position light group. The driving position light group is installed inside the door, frame and other locations to assist the driver in visual relaxation.

[0076] Embodiment 2

[0077] like Figure 3 As shown, this embodiment provides a scheduling method for a lighting scheduling system for a car as in Embodiment 1, which comprises the following steps:

[0078] Step S1, real-time monitoring of the driver's status information and driving information;

[0079] Step S2: When the vehicle approaches a traffic light intersection, the traffic light information in the direction of the vehicle is monitored. The acquisition module is activated before the vehicle approaches the traffic light, and the lane position and turn signal status are monitored to determine the traffic light information in the direction of the vehicle, and the information is sent to the control module. In this embodiment, when the vehicle speed is lower than 10 km / h, the acquisition module will acquire the traffic light information;

[0080] Step S3, the control module determines whether the preset activation conditions of the relaxation mode are met according to the driving information and the traffic light information of the vehicle's driving direction. If the preset activation conditions of the relaxation mode are met, the control module jumps to step S4; if the preset activation conditions of the relaxation mode are not met, the control module jumps to step S7. In this embodiment, the preset activation conditions of the relaxation mode include the non-automatic driving mode, the red light state, and the remaining waiting time of the red light;

[0081] Step S4, analyzing the driver's fatigue type. In this embodiment, a neural network model may be used to analyze the fatigue type.

[0082] Step S5, confirm the vehicle status. If the vehicle stops, enter the relaxation mode. If the vehicle does not stop, reconfirm after an interval of 1 or 2 seconds.

[0083] Step S6: outputting relaxation information according to the driver's fatigue type;

[0084] Step S7, outputting prompt information according to the remaining waiting time of the red light;

[0085] Step S8, monitoring whether the vehicle meets a preset exit condition, the preset exit condition including the green light is on and the vehicle starts;

[0086] Step S9: After the preset exit condition is met, all output devices are turned off. In the partial relaxation mode, some output devices remain turned on, such as when the attention is fatigued, the music is reduced in volume and continues to play.

[0087] The lighting scheduling method of this embodiment also includes the following steps: when the driver is severely fatigued, before the relaxation mode starts, the driver is prompted to rest through voice. In this embodiment, a fatigue discrimination model is used to perform visual detection of the driver through a camera to determine whether the driver is severely fatigued.

[0088] Before step S2, the driver can turn on the vehicle's "relaxation reminder" function on the central control screen setting page or activate it by voice. After activation, the control module will send a control command to the acquisition module to obtain traffic light information.

[0089] In step S6 of this embodiment, outputting relaxation information according to the driver's fatigue type specifically includes the following steps:

[0090] When the fatigue type is visual fatigue, the first mode relaxation information is output, including playing visual fatigue relaxation voice prompts, randomly lighting up the driving position light group, adjusting the brightness of the ambient light, and the central control screen display;

[0091] The visual fatigue relaxation voice prompt will inform the driver that the visual fatigue relaxation mode has been activated. The driver can perform eye movements by tracking the randomly lit driving position light group, or relax their eyes according to the changes in the ambient light and voice prompts. The central control screen can play eye exercise videos, and the ambient light adjusts the brightness according to the rhythm of the video to provide the driver with a suitable relaxation environment. The driving position light group is installed around the driver, such as near the door, dashboard or sun visor, and the driver can select different visual relaxation modes through voice.

[0092] When the fatigue type is muscle fatigue, the second mode relaxation information is output, including playing muscle fatigue relaxation voice prompts, adjusting the ambient light and massage seats, and playing a muscle fatigue relief video on the central control screen;

[0093] The muscle fatigue relaxation voice prompt will inform the driver that the muscle fatigue relaxation mode has been activated. If it is fatigue in the hands, arms, legs or feet, the central control screen will play the corresponding video, and the ambient light will adjust the brightness according to the rhythm of the video. If it is fatigue in the waist, back or buttocks, the seat massage function will be activated, and the ambient light will adjust the brightness according to the massage intensity and speed.

[0094] When the fatigue type is attention fatigue, the third mode relaxation information is output, including playing attention fatigue relaxation voice prompts, adjusting the atmosphere light, and playing light music;

[0095] The attention fatigue relaxation voice prompt will inform the driver that the attention fatigue relaxation mode has been activated, the ambient light will adjust the brightness according to the rhythm of deep breathing, and the speaker will play light music. When the green light comes on and the vehicle starts, the speaker will be controlled to lower the volume and continue playing;

[0096] When the fatigue type is mental fatigue, outputting fourth mode relaxation information, including playing mental fatigue relaxation voice prompts, adjusting the atmosphere light, and playing music;

[0097] The mental fatigue relaxation voice prompt will inform the driver that the mental fatigue relaxation mode has been activated. The driver can choose the relaxation atmosphere type, such as forest mode. The atmosphere light will turn green, forest sounds will be played through the speakers, forest videos will be played on the central control screen, and the atmosphere light will adjust its brightness according to the rhythm of deep breathing.

[0098] When the fatigue type is insufficient sleep, the fifth mode relaxation information is output, including playing refreshing music, playing voice prompts to remind the driver to stop and rest, and adjusting the ambient light;

[0099] The ambient lighting is adjusted to a blue color that increases alertness, and the volume of the refreshing music is lowered when the vehicle is started;

[0100] When the fatigue type is in normal state, the sixth mode relaxation information is output, including playing relaxation voice prompts, adjusting the ambient light, adjusting the massage seat, adjusting the central control screen, and playing music;

[0101] When the relaxation voice prompt is played, the voice assistant will ask the driver which relaxation mode he needs and automatically activate the corresponding output device. The relaxation mode may include the first to fifth modes.

[0102] In step S7 of this embodiment, outputting prompt information according to the remaining waiting time for the red light specifically includes the following steps:

[0103] When the remaining waiting time for the red light is the first duration, the seventh mode prompt information is output, including adjusting the color and brightness of the ambient light. As the remaining waiting time for the red light decreases, the color of the ambient light changes from blue to green, and then to yellow-green, and the brightness changes every two seconds;

[0104] When the remaining waiting time for the red light is the second time length, the eighth mode prompt information is output, including adjusting the sound prompt frequency, the driving position light group and the ambient light according to the change of the remaining time of the red light, the color of the ambient light changes from yellow-green to yellow, and then to orange, and the brightness changes once per second. If the green light is on, the ambient light turns red, the brightness change frequency is accelerated, and the driving position light group flashes red;

[0105] Among them, the first duration is greater than the second duration. The driver can set the duration on the central control screen or use voice commands to adjust the duration.

[0106] The working principle of the present invention is as follows:

[0107] The acquisition module monitors the driver's status information and driving information in real time. When the vehicle approaches a traffic light intersection, the acquisition module monitors the traffic light information in the direction of the vehicle's travel. The control module determines whether the preset opening conditions of the relaxation mode are met based on the driving information and the traffic light information in the direction of the vehicle's travel. If not, the control module outputs prompt information based on the remaining waiting time of the red light. If it is met, the analysis module analyzes the driver's fatigue type and then confirms the vehicle status. After the vehicle stops, the relaxation mode is entered and relaxation information is output based on the driver's fatigue type. At the same time, the control module monitors whether the vehicle meets the preset exit conditions. If the conditions are met, the output device is turned off.

[0108] By setting the collection module, the driver's status information and driving information can be collected, by setting the acquisition module, the traffic light information of the vehicle's driving direction can be obtained, by setting the analysis module, the driver's fatigue type can be analyzed, and by setting the control module and various output devices, different modes of relaxation information and prompt information can be provided according to the driver's fatigue type, providing a personalized relaxation experience, so that the driver can relax his body and mind while waiting at a red light, effectively relieve fatigue, and improve driving status and driving safety.

[0109] The specific embodiments described above further illustrate the technical problems, technical solutions and beneficial effects solved by the present invention. It should be understood that the above are only specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A lighting scheduling system for a car, characterized in that: It includes a collection module, an acquisition module, an analysis module, a control module and an output device; The collection module is used to collect the driver's status information and driving information; The acquisition module is used to acquire traffic light information in the direction of vehicle travel; The analysis module is used to analyze the driver's fatigue type; The control module is used to process the information transmitted by the acquisition module and the analysis module and send control instructions to the output device; The output device is used to output relaxation and prompt information according to the control instruction.

2. The lighting scheduling system for automobiles according to claim 1, characterized in that: The acquisition module includes a user status sensor and a driving information sensor; The user status sensor is used to collect the driver's status information; The driving information sensor is used to collect driving information.

3. The lighting scheduling system for automobiles according to claim 2, characterized in that: The acquisition module includes a vehicle status acquisition component and a body control module; The vehicle status acquisition component is used to determine the vehicle's position, lane information, and traffic light information of the vehicle's travel direction; The body control module is used to collect the vehicle's turn signal information.

4. The lighting scheduling system for automobiles according to claim 3, characterized in that: The analysis module includes a fatigue discrimination model, and the fatigue discrimination model is trained based on user state data collected by a user state sensor and driving data collected by a driving information sensor.

5. The lighting scheduling system for automobiles according to claim 4, characterized in that: The control module includes a storage unit, an MCU unit, a wireless adapter and a driver; The storage unit is used to collect and store information transmitted by the acquisition module and the analysis module; The MCU unit is used to receive and process information transmitted by the acquisition module and the analysis module, and send control instructions to the driver through the wireless adapter; The wireless adapter is used to send control instructions to the output device; The driver is used to drive the output device.

6. The lighting scheduling system for automobiles according to claim 5, characterized in that: The output devices include a central control screen, ambient lights, massage seats, speakers and a driver's position light group.

7. A method for dispatching a lighting dispatching system for a vehicle according to any one of claims 1 to 6, characterized in that: It includes the following steps: Step S1, real-time monitoring of the driver's status information and driving information; Step S2: When the vehicle approaches a traffic light intersection, the traffic light information in the direction of the vehicle's travel is monitored; Step S3, judging whether the preset opening condition of the relaxation mode is met according to the driving information and the traffic light information of the vehicle's driving direction, if it is met, jumping to step S4, if it is not met, jumping to step S7; Step S4, analyzing the driver's fatigue type; Step S5, confirming the vehicle status; Step S6: outputting relaxation information according to the driver's fatigue type; Step S7, outputting prompt information according to the remaining waiting time of the red light; Step S8: monitoring whether the vehicle meets the preset exit condition; Step S9: After the preset exit condition is met, all output devices are closed.

8. The scheduling method according to claim 7, characterized in that: In step S6, outputting relaxation information according to the driver's fatigue type specifically includes the following steps: When the fatigue type is visual fatigue, outputting first mode relaxation information; When the fatigue type is muscle fatigue, the second mode relaxation information is output; When the fatigue type is attention fatigue, the third mode relaxation information is output; When the fatigue type is mental fatigue, the fourth mode relaxation information is output; When the fatigue type is insufficient sleep, the fifth mode relaxation information is output; When the fatigue type is in a normal state, the sixth mode relaxation information is output.

9. The scheduling method according to claim 7, characterized in that: In step S7, outputting prompt information according to the remaining waiting time of the red light specifically includes the following steps: When the remaining waiting time for the red light is the first duration, outputting the seventh mode prompt information; When the remaining waiting time for the red light is the second duration, an eighth mode prompt message is output.

10. The scheduling method according to claim 7, characterized in that: The method also includes the following steps: when the driver is severely fatigued, before the relaxation mode starts, the driver is prompted to take a rest through voice.

Images