Vehicle lighting interaction method and system

Abstract

The present application relates to a vehicle lighting interaction method and system. When the driver is in an abnormal physiological state, the vehicle is controlled to perform lighting interaction based on the abnormal value, so as to adjust the brightness and flashing frequency of the lights according to the driver's physical condition, warn the driver and other drivers, and improve road traffic safety; effectively prevent traffic accidents caused by abnormal conditions such as driver fatigue and tension. By providing more information to other drivers, driving safety is improved. At the same time, this breathing frequency-based lighting interaction method also enables the driver to better perceive and control his own physiological state during driving, thereby improving the driving experience.

Description

Technical Field

[0001] The present application relates to the technical field of automobile safety and driver interaction, and in particular to a vehicle lighting interaction method and system. Background Art

[0002] When a car is driving, a major safety hazard comes from sudden failures of the car itself, such as tire blowouts, engine stalls, steering failures, brake failures, etc., which are unpredictable and difficult to avoid for the driver. Another major safety hazard comes from the driver himself. The occurrence of many traffic accidents is inseparable from the driver's driving state. Specifically, when the driver's driving state is good (a good driving state is defined as the driver's hands are on the steering wheel and the driver's eyes are in front of the vehicle), he / she can respond in time to sudden traffic conditions, such as a vehicle in the adjacent lane cutting into the lane where the car is located, or a vehicle in front of the car in the same lane making an emergency stop, and thus take effective measures to avoid traffic accidents. However, when the driver's driving state is poor (a poor driving state is defined as the driver's hands are not on the steering wheel and / or the driver does not have eyes in front of the vehicle), he / she often reacts slowly to sudden traffic conditions, thereby causing traffic accidents.

[0003] Therefore, how to effectively prevent traffic accidents caused by fatigue driving and illness in order to reduce the incidence of traffic accidents is a problem we need to solve. Summary of the invention

[0004] The embodiments of the present application provide a vehicle lighting interaction method and system to solve the problem in the related art that it is difficult to effectively prevent traffic accidents caused by fatigue driving and illness.

[0005] In a first aspect, a vehicle lighting interaction method is provided, which comprises the following steps:

[0006] When the driver's physiological state is abnormal during vehicle driving, the vehicle's lights are controlled according to the abnormal value of the driver.

[0007] In some embodiments, determining the physiological state of the driver during vehicle driving includes the following steps:

[0008] Obtain physiological status monitoring values ​​and compare them with normal value ranges;

[0009] If the physiological status monitoring value is within the normal value range, it is a normal state;

[0010] If the physiological status monitoring value exceeds the normal value range, it means that the physiological status is abnormal;

[0011] Wherein, the physiological status monitoring value includes heart rate reading, pupil light reflectivity, pulse rate, respiratory rate or respiratory volume.

[0012] In some embodiments, obtaining the physiological status monitoring value comprises the following steps:

[0013] Using a vehicle camera or a physiological monitoring device worn by the driver to obtain monitoring information of the driver during vehicle driving; the monitoring information includes video stream information or information detected by the physiological monitoring device;

[0014] Based on the monitoring information, the driver's physiological status monitoring value is analyzed and obtained.

[0015] In some embodiments, the step of obtaining the physiological status monitoring value is performed once at every set time interval within a detection cycle;

[0016] Obtaining the abnormal value comprises the following steps:

[0017] After obtaining the physiological state monitoring value for the first time and determining that the driver is in an abnormal physiological state, summing the initial value and the set value to obtain a new abnormal value; the initial value of the abnormal value is zero;

[0018] After obtaining the physiological state monitoring value for the second time, the physiological state of the driver is judged; if the driver is still in an abnormal physiological state, the new abnormal value is summed with the set value to obtain an updated abnormal value; otherwise, the new abnormal value is cleared;

[0019] Repeat the above steps until the number of executions is greater than the set number of times, and then use the abnormal value obtained from the last acquired physiological status monitoring value as the abnormal value of this detection cycle;

[0020] Among them, after the previous detection cycle is completed and before the next detection cycle is executed, the abnormal value is cleared.

[0021] In some embodiments, the step of obtaining the physiological status monitoring value is performed once at every set time interval within a detection cycle;

[0022] Obtaining the abnormal value comprises the following steps:

[0023] After obtaining the physiological state monitoring value for the first time and determining that the driver is in an abnormal physiological state, summing the initial value and the set value to obtain a new abnormal value; the initial value of the abnormal value is zero;

[0024] After obtaining the physiological status monitoring value for the second time, determining whether the physiological status monitoring value is within a set difference range of a normal value range, and determining the physiological status of the driver;

[0025] If the driver is still in an abnormal physiological state and is outside the set difference range of the normal value range, the new abnormal value is summed with the set value to obtain an updated abnormal value;

[0026] If the driver is still in an abnormal physiological state and is within the set difference range of the normal value range, the new abnormal value is maintained unchanged;

[0027] If the driver is in a normal state, the new abnormal value is cleared to zero;

[0028] Repeat the above steps until the number of executions is greater than the set number of times, and then use the abnormal value obtained from the last acquired physiological status monitoring value as the abnormal value of this detection cycle;

[0029] Among them, after the previous detection cycle is completed and before the next detection cycle is executed, the abnormal value is cleared.

[0030] In some embodiments, the driver physiological state monitoring value includes a breathing rate;

[0031] Controlling the lights of the vehicle according to the abnormal value about the driver includes the following steps:

[0032] If the abnormal value is less than the standard value, the front and rear lights of the vehicle are controlled to flash at the driver's breathing frequency;

[0033] If the abnormal value is greater than the standard value, the front and rear lights of the vehicle are controlled to flash at a set number of times per second.

[0034] In some embodiments, the vehicle lighting interaction method further includes obtaining a vehicle speed; and controlling the vehicle lighting according to the vehicle speed and an abnormal value related to the driver, including the following steps:

[0035] If the abnormal value is less than the standard value and the vehicle speed is less than the set speed, the front and rear lights of the vehicle are controlled to flash at the breathing frequency of the driver;

[0036] If the abnormal value is smaller than the standard value and the vehicle speed is greater than the set speed, the interior ambient light of the vehicle is controlled to flash at the breathing frequency of the driver;

[0037] If the abnormal value is greater than the standard value and the vehicle speed is less than the set speed, the front and rear lights of the vehicle are controlled to flash at a set number of times per second;

[0038] If the abnormal value is greater than the standard value and the vehicle speed is greater than the set speed, the front and rear lights and the interior ambient lights of the vehicle are controlled to flash at a set number of times per second, and it is determined whether to enter the automatic driving mode.

[0039] In some embodiments, determining whether to enter the automatic driving mode includes the following steps:

[0040] Using the vehicle's steering electronic control unit to determine whether the driver is holding the steering wheel;

[0041] If the driver does not hold the steering wheel, the vehicle will start the automatic driving function;

[0042] If the driver holds the steering wheel, the vehicle warning component is controlled to warn the driver and surrounding vehicles and pedestrians; the vehicle warning component includes a vehicle buzzer and / or a vibration unit; the vibration unit is arranged on the vehicle seat and / or the vehicle steering wheel;

[0043] Wherein, after executing the step of controlling the interior ambient light of the vehicle to flash at the breathing frequency of the driver if the abnormal value is less than the standard value and the vehicle speed is greater than the set speed, if the driver is still in an abnormal physiological state, an emergency rescue signal is sent to an emergency contact;

[0044] After executing the steps of starting the vehicle's automatic driving function or controlling the vehicle's warning components to warn the driver and surrounding vehicles and pedestrians, if the driver is still in an abnormal physiological state, an emergency rescue signal is sent to emergency contacts.

[0045] In a second aspect, a vehicle lighting interaction system based on visual recognition is provided, which includes:

[0046] The control module is used to control the vehicle's lights according to abnormal values ​​of the driver when the driver's physiological state is abnormal during vehicle driving.

[0047] In some embodiments, a data acquisition module and a data processing module are also included;

[0048] The data acquisition module includes a camera or a physiological monitoring device; the data acquisition module is used to obtain monitoring information of the driver during the driving of the vehicle; the monitoring information includes video stream information or information detected by the physiological monitoring device; the data processing module is used to determine the physiological state monitoring value according to the monitoring information, and determine the abnormal value based on the physiological state monitoring value;

[0049] The data processing module and the control module are arranged in the driving recorder of the vehicle, and the control module is connected to the vehicle body controller via a CAN line; the driving recorder is used to store the acquired monitoring information.

[0050] The beneficial effects of the technical solution provided by this application include:

[0051] The embodiment of the present application provides a vehicle light interaction method and system, which uses the driver's monitoring information while driving to analyze the driver's physiological state monitoring value; the monitoring information includes video stream information or physiological monitoring information; according to the driver's physiological state monitoring value, it is determined whether the driver is in an abnormal physiological state and the abnormal value; so when it is determined that the driver is in an abnormal physiological state, the vehicle is controlled to perform light interaction operations based on the abnormal value; through the above settings, the brightness and flashing frequency of the lights are adjusted according to the driver's physical condition to warn the driver and other drivers to improve road traffic safety. Compared with traditional safety measures that only rely on the driver's self-judgment and reaction, it effectively prevents traffic accidents caused by abnormal conditions such as driver fatigue and tension. By providing more information to other drivers, driving safety is improved. At the same time, this light interaction method based on breathing frequency also enables the driver to better perceive and control his own physiological state during driving, thereby improving the driving experience and effectively preventing traffic accidents caused by fatigue driving and diseases. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0053] Figure 1 A schematic diagram of the architecture of a vehicle lighting interaction system based on visual recognition provided in an embodiment of the present application;

[0054] Figure 2 A general flow chart of the vehicle lighting interaction method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0056] The lighting control system is basically an "on / off" control mode, which is mainly used to provide vision and warn other drivers, or to provide the atmosphere in the car, which mainly depends on the vehicle's sensors or the driver's active operation. If the driver's physiological state, such as breathing rate, heart rate reading, pupil light reflex, skin conductance, pulse rate and breathing volume, are associated with the vehicle's lights to provide information about the driver's fatigue, tension and other states, it is of great significance to improve driving safety.

[0057] The embodiments of the present application provide a vehicle lighting interaction method and system to solve the problem in the related art that it is difficult to effectively prevent traffic accidents caused by fatigue driving and illness.

[0058] See also Figure 1 and Figure 2 , a vehicle lighting interaction method, comprising the following steps:

[0059] Step 100: determining the physiological state of the driver during vehicle driving;

[0060] Step 101: When the driver's physiological state is abnormal during vehicle driving, the vehicle's lights are controlled according to the abnormal value of the driver. Among them, the most critical thing is how to judge the physiological state and the abnormal value of the driver.

[0061] The driver's physiological state monitoring value is obtained by analyzing the driver's monitoring information while driving; the monitoring information includes video stream information or physiological monitoring information; according to the driver's physiological state monitoring value, it is determined whether the driver is in an abnormal physiological state and the abnormal value; when it is determined that the driver is in an abnormal physiological state, the vehicle is controlled to perform light interaction based on the abnormal value; through the above settings, the brightness and flashing frequency of the lights are adjusted according to the driver's physical condition to warn the driver and other drivers to improve road traffic safety. Compared with traditional safety measures that only rely on the driver's self-judgment and reaction, it effectively prevents traffic accidents caused by abnormal conditions such as driver fatigue and tension. By providing more information to other drivers, driving safety is improved. At the same time, this light interaction method based on breathing frequency also enables the driver to better perceive and control his own physiological state during driving, thereby improving the driving experience and effectively preventing traffic accidents caused by fatigue driving and diseases.

[0062] Embodiment 1

[0063] How to judge the physiological state of the driver during vehicle driving includes the following steps:

[0064] Obtain physiological status monitoring values ​​and compare them with normal value ranges;

[0065] If the physiological status monitoring value is within the normal value range, it is a normal state;

[0066] If the physiological status monitoring value exceeds the normal value range, it means that the physiological status is abnormal;

[0067] Wherein, the physiological status monitoring value includes heart rate reading, pupil light reflectivity, pulse rate, respiratory rate or respiratory volume.

[0068] Wherein, obtaining the physiological status monitoring value comprises the following steps:

[0069] Using a vehicle camera or a physiological monitoring device worn by the driver to obtain monitoring information of the driver during vehicle driving; the monitoring information includes video stream information or information detected by the physiological monitoring device;

[0070] Based on the monitoring information, the driver's physiological status monitoring value is analyzed and obtained.

[0071] Embodiment 2

[0072] The above abnormal values ​​are calculated based on the physiological status monitoring values ​​and the set rules. The specific steps are:

[0073] First form

[0074] The step of obtaining the physiological status monitoring value is performed once at a set time interval within a detection cycle; obtaining the abnormal value includes the following steps:

[0075] After obtaining the physiological state monitoring value for the first time and determining that the driver is in an abnormal physiological state, summing the initial value and the set value to obtain a new abnormal value; the initial value of the abnormal value is zero;

[0076] After obtaining the physiological state monitoring value for the second time, the physiological state of the driver is judged; if the driver is still in an abnormal physiological state, the new abnormal value is summed with the set value to obtain an updated abnormal value; otherwise, the new abnormal value is cleared;

[0077] Repeat the above steps until the number of executions is greater than the set number of times, and then use the abnormal value obtained from the last acquired physiological status monitoring value as the abnormal value of this detection cycle;

[0078] Among them, after the previous detection cycle is completed and before the next detection cycle is executed, the abnormal value is cleared.

[0079] Second form

[0080] The step of obtaining the physiological status monitoring value is performed once at a set time interval within a detection cycle;

[0081] Obtaining the abnormal value comprises the following steps:

[0082] After obtaining the physiological state monitoring value for the first time and determining that the driver is in an abnormal physiological state, summing the initial value and the set value to obtain a new abnormal value; the initial value of the abnormal value is zero;

[0083] After obtaining the physiological status monitoring value for the second time, determining whether the physiological status monitoring value is within a set difference range of a normal value range, and determining the physiological status of the driver;

[0084] If the driver is still in an abnormal physiological state and is outside the set difference range of the normal value range, the new abnormal value is summed with the set value to obtain an updated abnormal value;

[0085] If the driver is still in an abnormal physiological state and is within the set difference range of the normal value range, the new abnormal value is maintained unchanged;

[0086] If the driver is in a normal state, the new abnormal value is cleared to zero;

[0087] Repeat the above steps until the number of executions is greater than the set number of times, and then use the abnormal value obtained from the last acquired physiological status monitoring value as the abnormal value of this detection cycle;

[0088] Among them, after the previous detection cycle is completed and before the next detection cycle is executed, the abnormal value is cleared.

[0089] Through the above settings, in this embodiment, the abnormal value changes in real time with the detection cycle, can reflect the driver's status in real time, and more accurately indicate the driver's abnormality level, where the physiological status monitoring value can be heart rate reading, pupil light reflectivity, pulse rate, respiratory rate or respiratory volume.

[0090] Embodiment 3

[0091] Taking the respiratory rate as an example, the specific steps of controlling the vehicle lights according to the abnormal value of the driver are described as follows:

[0092] If the abnormal value is less than the standard value, the front and rear lights of the vehicle are controlled to flash at the driver's breathing frequency;

[0093] If the abnormal value is greater than the standard value, the front and rear lights of the vehicle are controlled to flash at a set number of times per second.

[0094] Embodiment 4

[0095] The vehicle lighting interaction method further includes obtaining a vehicle speed; and controlling the vehicle lighting according to the vehicle speed and an abnormal value related to the driver, including the following steps:

[0096] If the abnormal value is less than the standard value and the vehicle speed is less than the set speed, the front and rear lights of the vehicle are controlled to flash at the breathing frequency of the driver;

[0097] If the abnormal value is smaller than the standard value and the vehicle speed is greater than the set speed, the interior ambient light of the vehicle is controlled to flash at the breathing frequency of the driver;

[0098] If the abnormal value is greater than the standard value and the vehicle speed is less than the set speed, the front and rear lights of the vehicle are controlled to flash at a set number of times per second;

[0099] If the abnormal value is greater than the standard value and the vehicle speed is greater than the set speed, the front and rear lights and the interior ambient lights of the vehicle are controlled to flash at a set number of times per second, and it is determined whether to enter the automatic driving mode.

[0100] The step of determining whether to enter the automatic driving mode includes the following steps:

[0101] Using the vehicle's steering electronic control unit to determine whether the driver is holding the steering wheel;

[0102] If the driver does not hold the steering wheel, the vehicle will start the automatic driving function;

[0103] If the driver holds the steering wheel, the vehicle warning component is controlled to warn the driver and surrounding vehicles and pedestrians; the vehicle warning component includes a vehicle buzzer and / or a vibration unit; the vibration unit is arranged on the vehicle seat and / or the vehicle steering wheel;

[0104] Wherein, after executing the step of controlling the interior ambient light of the vehicle to flash at the breathing frequency of the driver if the abnormal value is less than the standard value and the vehicle speed is greater than the set speed, if the driver is still in an abnormal physiological state, an emergency rescue signal is sent to an emergency contact;

[0105] After executing the steps of starting the vehicle's automatic driving function or controlling the vehicle's warning components to warn the driver and surrounding vehicles and pedestrians, if the driver is still in an abnormal physiological state, an emergency rescue signal is sent to emergency contacts.

[0106] Through the above steps, according to the different states of the driver, other drivers can be warned, or the driver himself can be warned to prevent driver fatigue. The vehicle warning component can be understood as one of the following possible forms: auditory warning, tactile warning, visual warning, etc. However, in order to provide users with a richer interactive warning experience and ensure that the warning is in place, the dangerous driving warning is preferably a combination of multiple forms, such as a combination of auditory warning and tactile warning, or a combination of visual warning and tactile warning, or a combination of auditory warning, tactile warning, and visual warning, etc. After the warning operation is completed, the driver continues to be detected. If the driver is still in an abnormal physiological state, it proves that the driver is in a dangerous state, and an emergency rescue signal can be issued, and the vehicle can be automatically stopped in a safe area through the automatic driving function to avoid accidents. Among them, the emergency rescue signal should meet one condition, and the timing should be started from the beginning of the abnormal physiological state. If the timing time is exceeded and the abnormality is still exceeded, the emergency rescue signal is issued.

[0107] Through this embodiment, the driver's physiological state monitoring value is obtained by analyzing the driver's monitoring information while driving; the monitoring information includes video stream information or physiological monitoring information; according to the driver's physiological state monitoring value, it is determined whether the driver is in an abnormal physiological state and the abnormal value; when it is determined that the driver is in an abnormal physiological state, the vehicle is controlled to perform light interaction based on the vehicle speed and the abnormal value; through the above settings, the driver's physical condition and speed are combined and judged, and the brightness and flashing frequency of the lights are adjusted accordingly to warn the driver and other drivers to improve road traffic safety. Compared with traditional safety measures that only rely on the driver's self-judgment and reaction, it effectively prevents traffic accidents caused by abnormal conditions such as driver fatigue and tension. By providing more information to other drivers, driving safety is improved. At the same time, this light interaction method based on breathing frequency also enables the driver to better perceive and control his own physiological state during driving, thereby improving the driving experience and effectively preventing traffic accidents caused by fatigue driving and diseases.

[0108] The above settings achieve the following: when the driver is detected to be in an abnormal physiological state, the brightness or flashing frequency of the lights will be adjusted according to the current speed of the vehicle. For example, if the speed exceeds a certain threshold, the system will automatically adjust the lights to a higher brightness or higher flashing frequency to warn the driver and draw his attention. At the same time, the early warning module will sound an alarm to further warn the driver that they may be in a dangerous state. In addition, if the driver's condition continues to deteriorate, the system can also choose to start the automatic driving mode to ensure the safety of the driver and passengers.

[0109] This application also proposes a vehicle lighting interaction system based on visual recognition, which includes:

[0110] A control module, which is used to control the vehicle's lights according to abnormal values ​​of the driver when the driver's physiological state is abnormal during the vehicle's driving;

[0111] It also includes a data acquisition module and a data processing module;

[0112] The data acquisition module includes a camera or a physiological monitoring device; the data acquisition module is used to obtain monitoring information of the driver during the driving of the vehicle; the monitoring information includes video stream information or information detected by the physiological monitoring device; the data processing module is used to determine the physiological state monitoring value according to the monitoring information, and determine the abnormal value based on the physiological state monitoring value;

[0113] The data processing module and the control module are arranged in the driving recorder of the vehicle, and the control module is connected to the vehicle body controller via a CAN line; the driving recorder is used to store the acquired monitoring information.

[0114] Among them, it should be understood that this system is to set up a camera inside the vehicle, which is located on the A-pillar to capture the driver's facial image to obtain driver data. The camera is an infrared camera (IR). The dash cam uses the chip NT98323, and the health detection SDK with health detection related algorithms is integrated and deployed in the chip. The dash cam interacts with the body controller through the CAN line, and the body controller controls the response of related actuators through the CAN line to realize the function of this patent. The camera sends the facial image video stream to the dash cam. The health detection SDK in the dash cam calls the dash cam CPU computing power and uses remote pulse optical measurement (rPPG) technology and related algorithms to obtain the driver's breathing rate from the facial image to identify the driver's status.

[0115] Alternatively, similar to the previous setting, multiple cameras are set up inside the vehicle to obtain facial images of the driver from different angles. This can more accurately obtain the driver's breathing rate, especially when the driver moves his head or changes his posture. The other steps and settings are the same as the previous form.

[0116] Of course, in addition to using cameras and rPPG technology to obtain the driver's breathing rate, some physiological monitoring devices can also be used, such as respiratory sensors on the chest or abdomen, which can directly measure the driver's breathing rate. These devices then send the breathing rate information to the vehicle body controller wirelessly, and the vehicle body controller adjusts the flashing frequency of the lights based on the breathing rate information. The alternative is: in addition to expressing the driver's breathing rate through lights, other vehicle output devices can also be used, such as ambient lights and audio systems in the car, so that their output is synchronized with the driver's breathing rate, thereby enhancing the interaction between the driver and the vehicle.

[0117] As mentioned above, rPPG technology is a prior art. For details, please refer to the relevant patent documents provided below, such as DE112019002467T5, JP2020527088A and CN113827234B.

[0118] The present application provides an embodiment in which the physiological state monitoring value is the respiratory rate, specifically:

[0119] 1. The initial value of the outlier is p = 0;

[0120] 2. Detect the driver's breathing frequency f per minute, once per minute;

[0121] a) When the respiratory rate exceeds 30 times / min, or is lower than 8 times / min, the abnormal value p=p+1 begins to be accumulated;

[0122] b) When the respiratory rate is between 16 and 20 times / min, the abnormal value is cleared to 0: p = 0;

[0123] c) When the respiratory rate is between 8-15 times / min and 21-30 times / min, the abnormal value remains unchanged;

[0124] d) If the outlier value does not change for 10 consecutive times, the outlier value is cleared to 0: p = 0;

[0125] 3. When p>=5, it is judged that the driver is in an abnormal physiological state, otherwise it is in a normal state.

[0126] At the same time, the data processing module will collect vehicle speed data from the CAN line and control the subsequent logic according to the following rules:

[0127] 1) When p<5;

[0128] When the vehicle speed is >3km / h, the body control module (BCM) controls the interior ambient light to interact with the driver's breathing frequency;

[0129] When the vehicle speed is less than 3km / h, the body control module (BCM) controls the front and rear light strips to interact with the driver's breathing frequency;

[0130] 2) When p>5. The alarm is triggered and the buzzer sounds twice to remind the driver and surrounding vehicles and pedestrians:

[0131] When the vehicle speed is >3km / h, the steering electronic control unit determines whether the driver has taken over the steering wheel. If the driver has not taken over, the vehicle activates the automatic driving function for emergency takeover.

[0132] When the vehicle speed is less than 3km / h, the front and rear lights will flash once per second for 5 minutes (if p returns to 0 midway, the flashing will end early).

[0133] The present application also proposes a computer-readable storage medium, which is used to store and execute a vehicle light interaction method for visual recognition.

[0134] The present invention provides a car, which comprises a vehicle light interaction system based on visual recognition.

[0135] Among them, the car can be a fuel car or a new energy car, such as an electric car.

[0136] An automobile provided by an embodiment of the present invention can implement each process of the vehicle light interaction method for visual recognition as described in any of the above embodiments by running a driving status monitoring system, and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0137] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0138] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0139] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1The steps of the functions specified in the box or multiple boxes. In a typical configuration, the computing device includes one or more processors (CPU), input / output interfaces, network interfaces and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0140] In the description of the present application, it should be noted that the terms "upper", "lower", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. Unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be a connection between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances.

[0141] It should be noted that, in this application, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0142] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.

Claims

1. A vehicle lighting interaction method, characterized in that: It includes the following steps: Determining the physiological state of the driver during vehicle driving, which includes the following steps: obtaining a physiological state monitoring value and comparing it with a normal value range; if the physiological state monitoring value is within the normal value range, it is a normal state; if the physiological state monitoring value exceeds the normal value range, it is an abnormal physiological state; wherein the physiological state monitoring value includes a heart rate reading, pupil light reflectivity, pulse rate, respiratory rate or respiratory volume; During vehicle driving, when the driver's physiological state is abnormal, the vehicle's lights are controlled according to the abnormal value of the driver; the vehicle's lights are controlled according to the abnormal value of the driver, including the following steps: if the abnormal value is less than the standard value, the front and rear lights of the vehicle are controlled to flash at the driver's breathing frequency; if the abnormal value is greater than the standard value, the front and rear lights of the vehicle are controlled to flash at a set number of flashes per second; The above step of obtaining the physiological status monitoring value is performed once at a set interval within a detection cycle; obtaining the abnormal value includes the following steps: After obtaining the physiological state monitoring value for the first time and determining that the driver is in an abnormal physiological state, summing the initial value and the set value to obtain a new abnormal value; the initial value of the abnormal value is zero; After obtaining the physiological state monitoring value for the second time, the physiological state of the driver is judged; if the driver is still in an abnormal physiological state, the new abnormal value is summed with the set value to obtain an updated abnormal value; otherwise, the new abnormal value is cleared; Repeat the above steps until the number of executions is greater than the set number of times, and then use the abnormal value obtained from the last acquired physiological status monitoring value as the abnormal value of this detection cycle; Among them, after the previous detection cycle is completed and before the next detection cycle is executed, the abnormal value is cleared.

2. The vehicle lighting interaction method according to claim 1, characterized in that: Acquiring the physiological status monitoring value comprises the following steps: Using a vehicle camera or a physiological monitoring device worn by the driver to obtain monitoring information of the driver during vehicle driving; the monitoring information includes video stream information or information detected by the physiological monitoring device; Based on the monitoring information, the driver's physiological status monitoring value is analyzed and obtained.

3. The vehicle lighting interaction method according to claim 1, characterized in that: After obtaining the physiological status monitoring value for the second time, while judging the physiological status of the driver, it also judges whether the physiological status monitoring value is within a set difference range of a normal value range; If the driver is still in an abnormal physiological state and is outside the set difference range of the normal value range, the new abnormal value is summed with the set value to obtain an updated abnormal value; If the driver is still in an abnormal physiological state and is within the set difference range of the normal value range, the new abnormal value is maintained unchanged; If the driver is in a normal state, the new abnormal value is cleared to zero.

4. The vehicle lighting interaction method according to claim 1, characterized in that: The vehicle lighting interaction method further includes obtaining a vehicle speed; and controlling the vehicle lighting according to the vehicle speed and an abnormal value related to the driver, including the following steps: If the abnormal value is less than the standard value and the vehicle speed is less than the set speed, the front and rear lights of the vehicle are controlled to flash at the breathing frequency of the driver; If the abnormal value is smaller than the standard value and the vehicle speed is greater than the set speed, the interior ambient light of the vehicle is controlled to flash at the breathing frequency of the driver; If the abnormal value is greater than the standard value and the vehicle speed is less than the set speed, the front and rear lights of the vehicle are controlled to flash at a set number of times per second; If the abnormal value is greater than the standard value and the vehicle speed is greater than the set speed, the front and rear lights and the interior ambient lights of the vehicle are controlled to flash at a set number of times per second, and it is determined whether to enter the automatic driving mode.

5. The vehicle lighting interaction method according to claim 4, characterized in that: Determining whether to enter the automatic driving mode includes the following steps: Using the vehicle's steering electronic control unit to determine whether the driver is holding the steering wheel; If the driver does not hold the steering wheel, the vehicle will start the automatic driving function; If the driver holds the steering wheel, the vehicle warning component is controlled to warn the driver and surrounding vehicles and pedestrians; the vehicle warning component includes a vehicle buzzer and / or a vibration unit; the vibration unit is arranged on the vehicle seat and / or the vehicle steering wheel; Wherein, after executing the step of controlling the interior ambient light of the vehicle to flash at the breathing frequency of the driver if the abnormal value is less than the standard value and the vehicle speed is greater than the set speed, if the driver is still in an abnormal physiological state, an emergency rescue signal is sent to an emergency contact; After executing the steps of starting the vehicle's automatic driving function or controlling the vehicle's warning components to warn the driver and surrounding vehicles and pedestrians, if the driver is still in an abnormal physiological state, an emergency rescue signal is sent to emergency contacts.

6. A vehicle lighting interaction system based on visual recognition, characterized in that: It includes: The data acquisition module includes a camera or a physiological monitoring device; The data acquisition module is used to obtain monitoring information of the driver during vehicle driving; Monitoring information includes video stream information or information detected by physiological monitoring equipment; The data processing module is used to determine the physiological state monitoring value according to the monitoring information, and judge the physiological state of the driver during the driving of the vehicle, including the following steps: obtaining the physiological state monitoring value and comparing it with the normal value range; if the physiological state monitoring value is within the normal value range, it is a normal state; if the physiological state monitoring value exceeds the normal value range, it is an abnormal physiological state; wherein the physiological state monitoring value includes a heart rate reading, pupil light reflectivity, pulse rate, respiratory frequency or respiratory volume; the data processing module is used to determine an abnormal value based on the physiological state monitoring value; A control module is used to control the vehicle lights according to the abnormal value of the driver when the driver's physiological state is abnormal during vehicle driving; controlling the vehicle lights according to the abnormal value of the driver includes the following steps: if the abnormal value is less than the standard value, the front and rear lights of the vehicle are controlled to flash at the driver's breathing frequency; if the abnormal value is greater than the standard value, the front and rear lights of the vehicle are controlled to flash at a set number of flashes per second; the above steps of obtaining the physiological state monitoring value are performed once at intervals of a set time within a detection cycle; obtaining the abnormal value includes the following steps: obtaining the physiological state monitoring value for the first time, and judging whether the driver is After the physiological state is abnormal, the initial value is summed with the set value to obtain a new abnormal value; the initial value of the abnormal value is zero; after the physiological state monitoring value is obtained for the second time, the physiological state of the driver is judged; if the driver is still in an abnormal physiological state, the new abnormal value is summed with the set value to obtain an updated abnormal value; otherwise, the new abnormal value is cleared; repeat the above steps until the number of executions is greater than the set number, and then the abnormal value obtained after the last acquisition of the physiological state monitoring value is used as the abnormal value of this detection cycle; wherein, after the execution of the previous detection cycle ends and before the execution of the next detection cycle, the abnormal value is cleared; The data processing module and the control module are arranged in the driving recorder of the vehicle, and the control module is connected to the vehicle body controller via a CAN line; the driving recorder is used to store the acquired monitoring information.

Images