A method and device for determining a driver's driving state

Abstract

The application relates to a driver driving state judgment analysis method and a judgment device, and belongs to the technical field of train driver driving state judgment. Through orderly cooperation between various devices, the action frequency detection device is set as a normally open device, the starting cost of which is extremely low, and the operation cost of traditional video image recognition is greatly reduced. Moreover, the action frequency detection device is used as the first-stage detection judgment, the seat stress detection device is used as the second-stage detection judgment, the face information recognition device is used as the third-stage detection judgment, and the eye opening degree recognition device is used as the fourth-stage detection judgment. Through the four-stage detection judgment, the judgment accuracy of driver fatigue driving can be further improved. Moreover, the various devices are cooperatively and orderly operated, are not all normally open, and cannot cause the devices to collect too much invalid data.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of train driver driving state judgment, and particularly relates to a judgment method and device for obtaining a driver driving state. BACKGROUND

[0002] With the vigorous development of China's railway transportation industry and the continuous improvement of train driving speed, the safety problem of train operation is more prominent. There are many factors affecting the safe operation of trains, but the driving behavior of train drivers occupies an important position in the safe operation of trains. Therefore, researching and developing train driver fatigue driving detection technology can effectively prevent and reduce the safety hazards caused by improper driving behavior of train drivers.

[0003] At present, the judgment of train driver fatigue driving is all based on video image recognition, which judges whether the driver is in a fatigue driving state through face recognition. However, the video image recognition has high requirements for hardware and software, and the running cost of using video image recognition throughout the whole process is too high. Moreover, the judgment accuracy of driver fatigue driving by relying only on video image recognition is not the highest. Therefore, the running cost and judgment accuracy should be the focus of research.

[0004] Therefore, at present, a judgment method and device for obtaining a driver driving state need to be designed to solve the above problems. SUMMARY

[0005] The present application aims to provide a judgment method and device for obtaining a driver driving state to solve the technical problems existing in the prior art. At present, the judgment of train driver fatigue driving is all based on video image recognition, which judges whether the driver is in a fatigue driving state through face recognition. However, the video image recognition has high requirements for hardware and software, and the running cost of using video image recognition throughout the whole process is too high. Moreover, the judgment accuracy of driver fatigue driving by relying only on video image recognition is not the highest. Therefore, the running cost and judgment accuracy should be the focus of research.

[0006] To achieve the above-mentioned purpose, the technical solution of the present application is:

[0007] The application discloses a kind of to obtain the judging device of driver driving state, including action frequency detection device, seat stress detection device, facial information recognition device, eye open degree recognition device, dynamic alert refreshing device, fatigue relief massage device;The action frequency detection device is used to detect the real-time body movement frequency of train driver;The seat stress detection device is used to detect the real-time stress state of train driver to train seat;The facial information recognition device is used to detect the real-time facial dynamic information of train driver;The eye open degree recognition device is used to detect the real-time eye open degree information of train driver;The dynamic alert refreshing device is used to open dynamic atmosphere lamp and play dynamic music;The fatigue relief massage device is used to carry out fatigue relief massage to train driver by train seat;Wherein, the action frequency detection device is always open;The seat stress detection device, facial information recognition device, eye open degree recognition device, dynamic alert refreshing device, fatigue relief massage device are always closed;

[0008] When detecting that the real-time body movement frequency of train driver does not satisfy preset body movement frequency, the seat stress detection device is opened;When detecting that the real-time stress state of train driver to train seat does not change in first preset time period, the facial information recognition device is opened;When detecting that the real-time facial dynamic information of train driver does not change in second preset time period, the eye open degree recognition device is opened;When detecting that the real-time eye open degree information of train driver does not satisfy preset eye open degree information, the dynamic alert refreshing device and fatigue relief massage device are opened.

[0009] Further, the real-time body movement frequency of train driver does not satisfy preset body movement frequency, and the cumulative sum of the set time period of first preset time period and second preset time period does not exceed fatigue driving dangerous time period;The fatigue driving dangerous time period is obtained according to the historical data of train driver driving, and the time period with the possibility of causing fatigue driving danger.

[0010] Further, the action frequency detection device includes driver left infrared detector, driver right infrared detector and first controller.

[0011] The driver left infrared detector is used to detect the real-time body movement frequency of train driver left side, and is recorded as first real-time body movement frequency.

[0012] The driver right infrared detector is used to detect the real-time body movement frequency of train driver right side, and is recorded as second real-time body movement frequency.

[0013] When the first real-time body movement frequency and the second real-time body movement frequency do not satisfy preset body movement frequency, the first controller sends trigger signal to the seat stress detection device.

[0014] Further, the seat force detection device comprises a hip force detection device, a foot force detection device, and a second controller; the second controller receives the trigger signal sent by the first controller;

[0015] The hip force detection device is used to detect the real-time force state of the hip of the train driver on the train seat, which is recorded as a first real-time force state;

[0016] The foot force detection device is used to detect the real-time force state of the foot of the train driver on the train seat, which is recorded as a second real-time force state;

[0017] When the first real-time force state and the second real-time force state do not change within a first preset time period, the second controller sends a trigger signal to the face information recognition device.

[0018] Further, the face information recognition device comprises a first camera, a light detection device, a light adjustment device, and a third controller; the third controller receives the trigger signal sent by the second controller;

[0019] The first camera is used to detect the real-time face dynamic information of the train driver;

[0020] The light detection device is used to detect the real-time light data of the working environment of the first camera;

[0021] The light adjustment device is used to adjust the light of the working environment of the first camera;

[0022] When the face information recognition device is turned on, the third controller controls the first camera and the light detection device to be turned on, and controls the light adjustment device to be normally closed;

[0023] When the light detection device detects that the real-time light data of the working environment of the first camera does not meet the standard light data required for the normal operation of the first camera, the light adjustment device is turned on to adjust the real-time light data of the working environment of the first camera to the standard light data.

[0024] Further, the eye opening recognition device comprises a second camera, a focusing device, a distance measuring device, and a fourth controller; the fourth controller receives the trigger signal sent by the third controller;

[0025] The second camera is used to detect the real-time eye opening information of the train driver;

[0026] The focusing device is used to focus the second camera;

[0027] The ranging device is used for detecting the real-time distance between the train driver and the second camera device;

[0028] When the eye opening degree recognition device is turned on, the fourth controller controls the second camera device and the ranging device to be turned on, and controls the focusing device to be normally closed;

[0029] When the ranging device detects that the real-time distance between the train driver and the second camera device does not meet the default focal length of the second camera device, the fourth controller controls the focusing device to be turned on.

[0030] A judgment method for obtaining a driver driving state is judged and analyzed by using the judgment device for obtaining a driver driving state.

[0031] A storage medium has a computer program stored thereon, and the computer program is executed to perform the judgment method for obtaining a driver driving state.

[0032] Compared with the prior art, the present application has the beneficial effects that:

[0033] One of the beneficial effects of the present application is that the action frequency detection device, the seat force detection device, the face information recognition device, the eye opening degree recognition device, the dynamic warning refreshing device and the fatigue relieving massage device are sequentially matched and operated, the action frequency detection device is set as a normally open device, the start cost is extremely low, and the operation cost of the traditional video image recognition is greatly reduced; and the action frequency detection device is used as the first stage of detection and judgment, the seat force detection device is used as the second stage of detection and judgment, the face information recognition device is used as the third stage of detection and judgment, and the eye opening degree recognition device is used as the fourth stage of detection and judgment, so that the judgment accuracy of the driver fatigue driving can be further improved; and each device is sequentially operated, not all of which are normally open, so that the device does not collect too much invalid data. BRIEF DESCRIPTION OF DRAWINGS

[0034] Figure 1 It is a general step flow diagram of the embodiment of the present application.

[0035] Figure 2 It is a face information recognition device step principle diagram of the embodiment of the present application.

[0036] Figure 3 It is an eye opening degree recognition device step principle diagram of the embodiment of the present application. DETAILED DESCRIPTION

[0037] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application, that is, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. The components of the embodiments of the present application generally described and shown in the drawings can be arranged and designed in various different configurations.

[0038] Therefore, the detailed description of the embodiments of the present application provided below in the drawings is not intended to limit the scope of the claimed present application, but only represents selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application. It should be noted that the relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between the entities or operations.

[0039] Moreover, the term "comprising", "containing" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or device including the element.

[0040] The features and performances of the present application will be further described in detail below with reference to the embodiments.

[0041] At present, the judgment of train driver fatigue driving is all based on video image recognition, which judges whether the driver is in a fatigue driving state through face recognition of the driver; but the video image recognition has high requirements for hardware and software, the running cost of using video image recognition throughout the journey is too high, and the judgment accuracy of the driver fatigue driving by relying only on video image recognition is not the highest, so the running cost and judgment accuracy should be the focus of research.

[0042] As Figure 1As shown, a driver driving state acquisition device is provided, comprising a motion frequency detection device, a seat force detection device, a facial information recognition device, an eye opening degree recognition device, a dynamic alert refreshing device, and a fatigue relief massage device; the motion frequency detection device is used to detect the real-time body movement frequency of the train driver; the seat force detection device is used to detect the real-time force state of the train driver on the train seat; the facial information recognition device is used to detect the real-time facial dynamic information of the train driver; the eye opening degree recognition device is used to detect the real-time eye opening degree information of the train driver; the dynamic alert refreshing device is used to turn on the dynamic atmosphere lamp and play dynamic music; the fatigue relief massage device is used to relieve the fatigue of the train driver through the train seat; wherein the motion frequency detection device is always on; the seat force detection device, the facial information recognition device, the eye opening degree recognition device, the dynamic alert refreshing device, and the fatigue relief massage device are always off.

[0043] When the real-time body movement frequency of the train driver does not meet the preset body movement frequency, the seat force detection device is turned on; when the real-time force state of the train driver on the train seat does not change within the first preset time period, the facial information recognition device is turned on; when the real-time facial dynamic information of the train driver does not change within the second preset time period, the eye opening degree recognition device is turned on; when the real-time eye opening degree information of the train driver does not meet the preset eye opening degree information, the dynamic alert refreshing device and the fatigue relief massage device are turned on.

[0044] In the above scheme, through the orderly cooperation of the motion frequency detection device, the seat force detection device, the facial information recognition device, the eye opening degree recognition device, the dynamic alert refreshing device, and the fatigue relief massage device, the motion frequency detection device is set as a always-on device, which has extremely low startup cost, and the running cost of traditional video image recognition is greatly reduced; moreover, the motion frequency detection device is used as the first stage of detection and judgment, the seat force detection device is used as the second stage of detection and judgment, the facial information recognition device is used as the third stage of detection and judgment, and the eye opening degree recognition device is used as the fourth stage of detection and judgment, which can further improve the accuracy of driver fatigue driving judgment; moreover, each device is cooperatively and orderly operated, and is not always on, which will not cause the device to collect too much invalid data.

[0045] Further, the real-time body movement frequency of the train driver does not meet the preset body movement frequency, the first preset time period, and the second preset time period, and the cumulative total of the three does not exceed the fatigue driving dangerous time period; the fatigue driving dangerous time period is obtained from the historical data of the train driver driving, and is a time period that may cause fatigue driving danger.

[0046] The possibility of causing fatigue driving is extracted from the historical data of train driver driving, and the total of the four stage inspection judgment time lengths does not exceed the possibility time length, so as to reduce the accident rate.

[0047] Further, the action frequency detection device comprises a driver left infrared detector, a driver right infrared detector, and a first controller.

[0048] The driver left infrared detector is used to detect the real-time body action frequency of the left side of the train driver, which is recorded as a first real-time body action frequency.

[0049] The driver right infrared detector is used to detect the real-time body action frequency of the right side of the train driver, which is recorded as a second real-time body action frequency.

[0050] When the first real-time body action frequency and the second real-time body action frequency do not meet the preset body action frequency, the first controller sends a trigger signal to the seat force detection device.

[0051] In the above scheme, if only the front of the train driver is used to collect the body action related information, there will be errors, such as the body action in the opposite direction of the train driver cannot be collected, so it is necessary to detect and collect from two directions on the side to ensure the accuracy of body action detection.

[0052] Further, the seat force detection device comprises a hip force detection device, a foot force detection device, and a second controller; the second controller receives the trigger signal sent by the first controller.

[0053] The hip force detection device is used to detect the real-time force state of the hip of the train driver on the train seat, which is recorded as a first real-time force state.

[0054] The foot force detection device is used to detect the real-time force state of the foot of the train driver on the train seat, which is recorded as a second real-time force state.

[0055] When the first real-time force state and the second real-time force state do not change within a first preset time period, the second controller sends a trigger signal to the face information recognition device.

[0056] In the above scheme, the obvious force points of the train driver are the hips and the feet, so the real-time force states of the hips and the feet are detected at the same time to avoid the situation that the train driver changes only at one of the force points of the hips and the feet.

[0057] Furthermore, the facial recognition device includes a first camera device, a light detection device, a light adjustment device, and a third controller; the third controller receives a trigger signal sent by the second controller;

[0058] The first camera device is used to detect the real-time facial dynamic information of the train driver;

[0059] The light detection device is used to detect real-time light data of the working environment where the first camera device is located;

[0060] The light adjustment device is used to adjust the light in the working environment of the first camera device;

[0061] like Figure 2 As shown, when the facial recognition device is turned on, the third controller controls the first camera device and the light detection device to turn on, and controls the light adjustment device to remain normally closed;

[0062] When the light detection device detects that the real-time light data of the working environment where the first camera device is located does not meet the standard light data when the first camera device is working normally, the light adjustment device is activated to adjust the real-time light data of the working environment where the first camera device is located to the standard light data.

[0063] In the above scheme, considering the influencing factors (light) of the first camera device, ensuring the light required for the normal operation of the first camera device hardware is an effective way to reduce detection errors.

[0064] Furthermore, the eye opening degree recognition device includes a second camera device, a focusing device, a ranging device, and a fourth controller; the fourth controller receives a trigger signal sent by the third controller;

[0065] The second camera device is used to obtain real-time eye opening information from the train driver;

[0066] The focusing device is used to focus the second camera device;

[0067] The ranging device is used to detect the real-time distance between the train driver and the second camera device;

[0068] like Figure 3 As shown, when the eye opening degree recognition device is turned on, the fourth controller controls the second camera device and the ranging device to turn on, and controls the focusing device to remain normally closed;

[0069] When the ranging device detects that the real-time distance between the train driver and the second camera does not meet the default focal length of the second camera, the fourth controller controls the focusing device to turn on.

[0070] In the above scheme, the focal length required to ensure the normal operation of the third camera hardware is an effective way to reduce detection errors, considering the influence factor (distance) of the third camera.

[0071] A judgment method for obtaining a driver driving state is adopted to perform judgment analysis by using the above-mentioned judgment device for obtaining a driver driving state.

[0072] A storage medium has a computer program stored thereon, and the computer program performs the above-mentioned judgment method for obtaining a driver driving state when executed.

[0073] The above is the preferred embodiment of the present application, any changes made according to the technical solutions of the present application, as long as the generated function does not exceed the scope of the technical solutions of the present application, belongs to the protection scope of the present application.

Claims

1. A device for determining a driver's driving status, characterized in that, The device comprises a motion frequency detection device, a seat force detection device, a facial information recognition device, an eye opening degree recognition device, a dynamic alert refreshing device, and a fatigue relief massage device; the motion frequency detection device is used to detect the real-time body movement frequency of the train driver; the seat force detection device is used to detect the real-time force state of the train driver on the train seat; the facial information recognition device is used to detect the real-time facial dynamic information of the train driver; the eye opening degree recognition device is used to detect the real-time eye opening degree information of the train driver; the dynamic alert refreshing device is used to turn on the dynamic atmosphere lamp and play dynamic music; the fatigue relief massage device is used to relieve the fatigue of the train driver through the train seat; wherein the motion frequency detection device is always on; the seat force detection device, the facial information recognition device, the eye opening degree recognition device, the dynamic alert refreshing device, and the fatigue relief massage device are always off; When the real-time body movement frequency of the train driver does not meet the preset body movement frequency, the seat force detection device is turned on; when the real-time force state of the train driver on the train seat does not change within the first preset time period, the facial information recognition device is turned on; when the real-time facial dynamic information of the train driver does not change within the second preset time period, the eye opening degree recognition device is turned on; when the real-time eye opening degree information of the train driver does not meet the preset eye opening degree information, the dynamic alert refreshing device and the fatigue relief massage device are turned on; The preset time period, the first preset time period, and the second preset time period, in which the real-time body movement frequency of the train driver does not meet the preset body movement frequency, are cumulative and the total sum does not exceed the fatigue driving dangerous time period; the fatigue driving dangerous time period is obtained from the historical data of the train driver and is the time period in which the fatigue driving risk is likely to occur; The motion frequency detection device comprises a left driver infrared detector, a right driver infrared detector, and a first controller; The left driver infrared detector is used to detect the real-time body movement frequency of the left side of the train driver, which is recorded as the first real-time body movement frequency; The right driver infrared detector is used to detect the real-time body movement frequency of the right side of the train driver, which is recorded as the second real-time body movement frequency; When the first real-time body movement frequency and the second real-time body movement frequency do not meet the preset body movement frequency, the first controller sends a trigger signal to the seat force detection device; The seat force detection device comprises a hip force detection device, a foot force detection device, and a second controller; the second controller receives the trigger signal sent by the first controller; The hip force detection device is used to detect the real-time force state of the hip of the train driver on the train seat, which is recorded as the first real-time force state; The foot force detection device is used to detect the real-time force state of the foot of the train driver on the train seat, which is recorded as the second real-time force state; When the first real-time force state and the second real-time force state do not change within a first preset time period, the second controller sends a trigger signal to the face information recognition device.

2. The device for judging the driving state of a driver according to claim 1, wherein The face information recognition device comprises a first camera, a light detection device, a light adjustment device, and a third controller. The first camera is configured to detect real-time face dynamic information of the train driver. The light detection device is configured to detect real-time light data of the working environment of the first camera. The light adjustment device is configured to adjust the light of the working environment of the first camera. When the face information recognition device is turned on, the third controller controls the first camera and the light detection device to be turned on, and controls the light adjustment device to be always closed. When the light detection device detects that the real-time light data of the working environment of the first camera does not meet the standard light data required for the normal operation of the first camera, the light adjustment device is turned on to adjust the real-time light data of the working environment of the first camera to the standard light data.

3. The device for judging the driving state of a driver according to claim 2, wherein The eye openness recognition device comprises a second camera, a focusing device, a distance measurement device, and a fourth controller. The second camera is configured to detect real-time eye openness information of the train driver. The focusing device is configured to focus the second camera. The distance measurement device is configured to detect the real-time distance between the train driver and the second camera. When the eye openness recognition device is turned on, the fourth controller controls the second camera and the distance measurement device to be turned on, and controls the focusing device to be always closed. When the distance measurement device detects that the real-time distance between the train driver and the second camera does not meet the default focal length of the second camera, the fourth controller controls the focusing device to be turned on.

4. A method of obtaining a judgment analysis of a driver's driving state, characterized by The judgment device for obtaining the driving state of the driver is used for judgment analysis.

5. A storage medium, characterized by The storage medium stores a computer program, and the computer program is executed to perform the judgment analysis method for obtaining the driving state of the driver. The storage medium stores a computer program, and the computer program is executed to perform the judgment analysis method for obtaining the driving state of the driver.

Images