Fatigue driving monitoring system for ship driver

Abstract

The utility model discloses a ship driver fatigue driving monitoring system which comprises a driver fatigue detection module, a data processing unit, an alarm module and a rest room display screen. The driver fatigue detection module is used for detecting the fatigue state of the driver according to the acquired face image data of the driver, and the output end of the driver fatigue detection module is connected with the data processing unit; the data processing unit is connected with the alarm module and the rest room display screen. The system has the advantages that when the ship driver is detected to be in a fatigue state, the driver can be timely replaced by a shift changing worker, so that the potential safety hazard caused by continuous driving of the fatigue driver is avoided; a shift driver can be effectively notified through alarm and reality modes, and meanwhile, a reminding signal can be sent to a mobile phone of the shift driver through a network, a short message and the like, so that the shift driver can be reminded in time, and the driver can be replaced in time.

Description

Technical Field

[0001] The utility model relates to the field of automatic monitoring of ships, in particular to a monitoring system for fatigue driving of ship drivers. Background Art

[0002] Ship driving often adopts multiple drivers to take turns to drive, which can effectively avoid fatigue caused by long-term driving, thereby reducing safety accidents in ship driving. However, even if multiple crew members take turns to drive, there is still fatigue of the driver due to physical and environmental factors such as long-term driving or rest, that is, the driver starts to get tired before the shift change, which will cause safety hazards, such as ship deviation from the channel, collision accidents, etc. The prior art often uses automatic face recognition and other technologies for analysis to determine whether the driver is in a fatigue state, such as a fatigue detection method, system and server for ship drivers with patent application number 201510279711.1. Among them, the fatigue detection method includes: receiving a video stream collected by a wearable device; converting multiple video frames in the video stream into multiple image information; obtaining human eye areas in multiple image information; and performing fatigue analysis on the human eye areas in multiple image information to determine whether the ship driver is in a fatigue state, and sending the analysis results to the wearable device. The fatigue detection method of the embodiment of the present invention obtains the video image of the ship driver through the wearable device, which can avoid the influence of various objective factors, ensure the quality of the collected video image, and thus improve the reliability of server fatigue detection.

[0003] The above patent provides a method of judging whether the driver is fatigued by analyzing images in the video stream, and the driver's fatigue state can be realized by image acquisition and recognition. Although fatigue monitoring can be detected by image recognition, it is not possible to achieve the purpose of safe and reliable driving by simply reminding the driver after fatigue is recognized, because the reminder from the law enforcement department may not make the driver sober, and there is still a risk of safety accidents. Therefore, the control reminder scheme of the existing technology after fatigue is detected still has defects. Utility Model Content

[0004] The utility model aims to overcome the deficiencies of the prior art and provide a ship driver fatigue driving monitoring system, which not only reminds the fatigued driver after fatigue is detected, but also reminds the shift changer to change shifts in time, thereby reducing the driving safety hazards caused by driver fatigue.

[0005] In order to achieve the above-mentioned purpose, the technical solution adopted by the utility model is: a ship driver fatigue driving monitoring system, including a driver fatigue detection module, a data processing unit, an alarm module, and a lounge display screen; the driver fatigue detection module is used to detect the driver's fatigue state based on the collected driver's facial image data, and its output end is connected to the data processing unit; the data processing unit is respectively connected to the alarm module and the lounge display screen.

[0006] The alarm module is arranged in the cab and is used for issuing an alarm to remind a tired driver.

[0007] The lounge display screen is arranged in the shift driver lounge and is used to display the driver's fatigue status based on the control of the data processing unit.

[0008] The data processing unit is connected to the communication unit, and communication between the data processing unit and the personal mobile terminal of the driver on shift is established based on the communication unit, so as to send a shift reminder signal to the personal mobile terminal of the driver on shift.

[0009] The monitoring system further comprises a timer, which is connected to the data processing unit and is used for timing the fatigue duration.

[0010] The data processing unit is connected to the power system of the ship and is used to limit the power of the ship in a fatigue state.

[0011] The output end of the data processing unit is connected to the auxiliary driving system of the ship, and is used to control the driving of the ship through the auxiliary driving system in a fatigue state.

[0012] The data processing unit is connected to a sobering unit arranged in the driving cabin, and the sobering unit is used to stimulate the driver to restore the driver's sober state.

[0013] The output end of the data processing unit is connected to the ship's navigation light for issuing a warning signal.

[0014] The advantages of the utility model are: when it is detected that the ship driver is in a fatigued state, the driver can be replaced in time through the shift personnel in time to avoid the safety hazards of the fatigued driver continuing to drive; the shift driver can be effectively notified through alarm and reality, and a reminder signal can be sent to the mobile phone of the shift driver through the network, text messages, etc., so as to timely remind and replace the driver in time; at the same time, the driver's fatigue time is obtained by timing, and the power of the ship will be limited after the driver continues to drive for a certain period of time after being fatigued, so as to limit the ship's driving to improve safety, or the auxiliary driving can be started to remind the ship's driving safety at this time. After the fatigue driving state is detected, a variety of notification and control methods are used to further improve the driving safety of the ship after the fatigue state is detected. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The following is a brief description of the contents expressed in the drawings of the present invention and the symbols in the drawings:

[0016] Figure 1 This is a schematic diagram of the ship monitoring system of the present utility model. DETAILED DESCRIPTION

[0017] The specific implementation of the present invention will be further explained in detail below by describing the optimal embodiment with reference to the accompanying drawings.

[0018] Although the prior art can identify driver fatigue through image recognition, it is not possible to reliably remind a fatigued driver only through an alarm, because when a person is in a fatigued state, ordinary alarm reminders cannot make the fatigued driver sober, and if he continues to drive, it will cause safety risks. Therefore, this embodiment provides a processing solution after detecting driver fatigue, and timely replaces the driver to avoid the safety risks of fatigue driving. The specific details of the solution are as follows:

[0019] like Figure 1 As shown, a ship driver fatigue driving monitoring system includes a driver fatigue detection module, a data processing unit, an alarm module, and a lounge display screen;

[0020] The data processing module is developed using the STM32 series microcontroller, which has simple data processing and communication functions as well as drive control functions. The STM32 series microcontroller has the advantages of low cost and simple development, and is suitable for the development and use of controllers in systems such as application automation control.

[0021] The driver fatigue detection module adopts the image recognition analysis method mentioned in the background technology to detect whether the driver of the ship is in a fatigue state. The driver fatigue detection module includes a camera arranged in the cab, and the camera is used to collect image information of the driver (including images of the face). The image information collected by the camera is sent to the core processor in the fatigue detection module. The core processor runs the fatigue detection method of the prior art (such as the recognition detection method in the background technology) to realize the detection of fatigue state.

[0022] The output end of the driver fatigue status detection module is connected to the data processing unit, and the data processing unit controls the alarm module and the lounge display screen respectively based on the fatigue status, that is, the data processing unit is connected to the alarm module and the lounge display screen respectively, driving and controlling the alarm module and the lounge display screen to work.

[0023] The alarm module can be set in the driving room, the lounge and / or the captain's room respectively, and is used to send out an alarm to remind the tired driver, the shift driver in the lounge and the captain in the captain's room, so as to timely notify all related personnel. The alarm module uses an audible and visual alarm, which mainly emits sound and / or light to give an alarm reminder; the alarm module set in the driving room can send out a stimulating alarm sound with a high volume, thereby stimulating the tired driver to a certain extent, so that he can wake up briefly and avoid safety accidents; and the alarm in the lounge and the captain's room is to notify others that the driver is in a fatigued state. In the lounge, there are usually crew members and shift drivers resting, so the shift driver can be reminded through the alarm. Similarly, the captain's room can also notify the captain, and the shift driver can replace the fatigued driver in time. The captain can know the fatigue status in time to dispatch and arrange the crew and driver.

[0024] In order to better illustrate the alarm information, a lounge display screen can be set in the shift driver's lounge to display the driver's fatigue status based on the control of the data processing unit. When the alarm is triggered, the display screen is driven to display that the cause of the alarm is driver fatigue, which makes it convenient for shift drivers to know the cause of the alarm in time, realize shift changes in time, and improve safety.

[0025] In order to avoid missing information that the driver is in a fatigue state or missing alarm information from the shift driver, the fatigue state alarm information is sent to the mobile phone of the shift driver by information push. Due to the characteristics of ship driving, the ship is large and there are multiple drivers, so it is possible to drive the ship in shifts. Therefore, when the driver is tired at this time, another driver can be replaced in time and safely, thereby avoiding the driving safety hazards caused by the driver being in a fatigue state all the time. In order to better notify the shift driver, the data processing unit is connected to the communication unit, and the communication between the data processing unit and the personal mobile terminal of the shift driver is established based on the communication unit, which is used to send a shift reminder signal to the personal mobile terminal of the shift driver. The communication unit includes a 2G communication chip, a short message transceiver chip, etc., and can send fatigue alarm information to the shift driver through one of the methods such as the network or short message.

[0026] Under normal circumstances, after the fatigue state is detected, notifying the shift driver to replace can ensure the safety of ship driving, but it takes time from the detection of fatigue to the completion of replacement. If the time is long, there is still a safety risk. Therefore, the present application is provided with a timer, which is connected to the data processing unit to time the duration of fatigue. After the alarm, the duration of the fatigue state is timed. If it is still in a fatigue state and reaches the set time, such as 1 minute or even shorter, it is necessary to further restrict the ship to avoid ship accidents caused by driver fatigue driving. Therefore, in this scheme, the data processing unit is connected to the power system of the ship to limit the power of the ship in a fatigue state. When the fatigue duration is greater than the set time threshold, the data processing unit outputs a control signal to the power system of the ship to limit the power of the power system to avoid the occurrence of safety accidents. Further, if the ship is equipped with an auxiliary driving system, the system is started at this time, that is, the output end of the data processing unit is connected to the auxiliary driving system of the ship, which is used to control the ship's driving through the auxiliary driving system in a fatigue state. When the fatigue duration of the ship driver is greater than the set time, the auxiliary driving system of the ship is also started while limiting the power of the ship, thereby avoiding the safety of ship driving under fatigue.

[0027] Furthermore, since there are also light signals on the ship, when the ship is in an abnormal state due to driver fatigue, the lights can be used to remind other nearby ships to avoid, thereby further improving the safety of the ship in this state. That is, the output end of the data processing unit is connected to the ship's navigation lights for issuing warning signals. The navigation lights here can reuse existing lights on the ship or add new lights, mainly to remind surrounding ships by means of alarm lights.

[0028] In a preferred embodiment, the data processing unit is connected to a sobering unit provided in the cab, and the sobering unit is used to stimulate the driver to restore the driver's sober state. In order to improve safety, before the shift driver is replaced, the driver can be sobered in a variety of ways. Here, the sobering unit mainly stimulates the driver to achieve a short sobering of the tired driver. The sobering unit here includes stimulating sounds, stimulating lights, corresponding sound and light devices, or adding a vibration motor to the driver's seat to make the driver unable to sit comfortably in the chair and stand up, thereby waking up the tired driver to a certain extent.

[0029] Through the above scheme, this embodiment improves the driving safety of the ship after the fatigue state is detected through multiple control schemes after the driver is fatigued, and greatly reduces the occurrence of ship safety accidents caused by fatigue.

[0030] Obviously, the specific implementation of the present invention is not limited to the above-mentioned methods. As long as various non-substantial improvements are made using the method concept and technical solution of the present invention, they are all within the protection scope of the present invention.

Claims

1. A ship driver fatigue driving monitoring system, characterized in that : It includes a driver fatigue detection module, a data processing unit, an alarm module, and a lounge display screen; the driver fatigue detection module is used to detect the driver's fatigue state according to the collected driver's facial image data, and its output end is connected to the data processing unit; the data processing unit is respectively connected to the alarm module and the lounge display screen; the alarm module is arranged in the cab, and is used to send an alarm sound to remind the tired driver; the lounge display screen is arranged in the shift driver's lounge, and is used to display the driver's fatigue state based on the control of the data processing unit; the data processing unit is connected to the communication unit, and the communication between the data processing unit and the personal mobile terminal of the shift driver is established based on the communication unit, so as to send a shift reminder signal to the personal mobile terminal of the shift driver.

2. A ship driver fatigue driving monitoring system as claimed in claim 1, characterized in that :The monitoring system also includes a timer, which is connected to the data processing unit and is used to time the fatigue duration.

3. A ship driver fatigue driving monitoring system as claimed in claim 2, characterized in that :The data processing unit is connected to the power system of the ship and is used to limit the power of the ship in a fatigue state.

4. A ship driver fatigue driving monitoring system as claimed in claim 2, characterized in that The output end of the data processing unit is connected to the auxiliary driving system of the ship, and is used to control the ship's driving through the auxiliary driving system in a fatigue state.

5. A ship driver fatigue driving monitoring system as claimed in claim 2, characterized in that :The data processing unit is connected to a wake-up unit arranged in the cab, and the wake-up unit is used to stimulate the driver to restore the driver's wakefulness.

6. A ship driver fatigue driving monitoring system as claimed in claim 2, characterized in that The output end of the data processing unit is connected to the ship's navigation light for issuing a warning signal.

Images