Intelligent on-duty monitoring and grading alarm system for ship cab

Abstract

The invention relates to the technical field of ship safety and intelligent monitoring, in particular to a ship cab intelligent guarding monitoring and grading alarm system which comprises cab detection sensor equipment and a captain room host. The cab detection sensor equipment comprises a main control module, a camera, a laser radar, a flashing light, a vibration motor and a transmission module; a buzzer is mounted on the captain room host; the master control module judges the attention state of a driver based on an image collected by the camera, when the attention state is abnormal, the laser radar is started to conduct laser point cloud scanning on a driving position, a highlight flashing light, a vibration motor and a buzzer are triggered to give out alarms of different levels according to a grading time window in combination with a comprehensive result, and when the highest-level alarm is achieved, the laser radar is started to conduct laser point cloud scanning on the driving position. And the alarm state information is sent to the captain room host through the transmission module. Through cascade detection of the camera and the laser radar and graded early warning, high-precision detection and reminding of the state of the ship driver are realized, and the ship navigation safety is improved.

Description

Technical Field

[0001] This invention relates to the field of ship safety and intelligent monitoring technology, and more specifically to an intelligent monitoring and hierarchical alarm system for ship bridge. Background Technology

[0002] Existing shipboard duty alarm systems (BNWAS) primarily rely on inactivity timeout alarms or simple manual reset mechanisms to alert bridge watch personnel. This results in frequent alarms and a lack of accurate detection of "attention / sleep" states, leading to a high false alarm rate in low-light conditions or when multiple personnel experience brief visual shifts. Single-sensor solutions (motion sensing only or video analytics only) often lack robustness in the complex marine environment.

[0003] Currently, for ship operators, especially those on fishing vessels engaged in long-term maritime operations, fatigue and absence from duty are significant human factors contributing to maritime collisions. Existing monitoring methods have the following main shortcomings:

[0004] Limited technology: Some systems attempt to transplant driver monitoring systems from the automotive field, relying solely on a single camera for facial recognition. However, the marine driving environment is complex (with significant changes in lighting and severe shaking), which can easily lead to misjudgments (such as mistaking alertness for fatigue due to shaking or dim lighting) or missed judgments (such as when the driver is wearing sunglasses or a hat that obscures their vision).

[0005] Incomplete functionality: Simple pressure-sensing seat cushions can only detect whether there is someone in the seat, but cannot distinguish between "in place" and "on duty" status (i.e., cannot determine whether the driver is awake, asleep, or looking down to pick something up).

[0006] Ineffective alarm: The alarm method is limited to a single sound alarm. For drivers who are deeply fatigued, a sound alarm may not be sufficient to wake them up and may not be able to effectively report the emergency.

[0007] System isolation: The monitoring unit in the bridge is not linked with the command system in the captain's cabin, making remote monitoring and intervention impossible and posing a safety hazard.

[0008] Therefore, there is an urgent need for an intelligent monitoring solution that can adapt to the special environment of ships, provide accurate detection, effective alarms, and enable remote linkage. Summary of the Invention

[0009] In view of this, the present invention provides an intelligent monitoring and hierarchical alarm system for ship bridge, which achieves high-precision detection and alerts on the status of ship pilots through cascaded detection of cameras and lidar and hierarchical early warning, thereby improving ship navigation safety.

[0010] To achieve the above objectives, the present invention adopts the following technical solution:

[0011] A ship's bridge intelligent monitoring and hierarchical alarm system includes: a bridge detection sensor device and a captain's cabin main engine; the bridge detection sensor device includes a main control module, and a camera, lidar, flashing light, vibration motor and transmission module electrically connected to the main control module; a buzzer is installed on the captain's cabin main engine, and the buzzer is electrically connected to the main control module;

[0012] The camera is used to capture images of the driver's face, head, and posture;

[0013] The main control module determines the driver's attention state based on the images captured by the camera, and when the driver's attention state is abnormal, it activates the lidar to perform a laser point cloud scan on the driver's seat, and determines whether there is any movement of personnel within a preset time based on the laser point cloud scan results.

[0014] If both abnormal driver attention and abnormal laser point cloud scanning results are detected simultaneously, the main control module triggers the high-brightness flashing light, the vibration motor, and the buzzer to issue alarms of different levels within a graded time window. When the highest level alarm is reached, the alarm status information is sent to the main engine in the captain's cabin through the transmission module.

[0015] Furthermore, the main control module triggers the alarm device to issue different levels of alarms using tiered time windows, including:

[0016] Phase 1: Continuously control the flashlight to blink for the first preset duration. If it returns to normal within the first preset duration, control the flashlight to reset.

[0017] Phase 2: Continuously control the flashing light to blink within the second preset time period, and simultaneously control the vibration motor to vibrate. If the system returns to normal within the second preset time period, then control the flashing light and vibration motor to reset.

[0018] Phase 3: If the situation does not return to normal after the second preset time, the system will simultaneously control the flashing lights, the vibration motor to vibrate, and the buzzer to sound. The alarm status information will be sent to the main engine in the captain's cabin via the transmission module until the situation returns to normal or the alarm is manually canceled.

[0019] Furthermore, the camera is equipped with a supplementary light and covers a range of 50°-70° and 0.6m-1.8m directly in front of the driver's seat; the lidar is a short-range lidar with a scanning distance of 0.2m-5m.

[0020] Furthermore, abnormal driver attention states include: not detecting a face, detecting no one in the field, detecting a driver continuously looking down for a preset period of time, and detecting a driver with closed eyes.

[0021] Furthermore, the main control module detects the driver's attention state using a lightweight CNN network or EAR algorithm.

[0022] Furthermore, abnormal situations in laser point cloud scanning results include:

[0023] If the rate of change of the point cloud data in the driving area is less than the threshold or the centroid movement of the point cloud in the driving area is less than the threshold within multiple consecutive scanning cycles, it indicates that the driver has left his post or fallen asleep. In this case, it is determined that there is no movement of personnel in the driving area, and the laser point cloud scanning result is abnormal.

[0024] Furthermore, the vibration motor is mounted on the seat in the driver's cab.

[0025] Furthermore, the main engine in the captain's cabin also includes a parameter display screen, parameter setting buttons, a power switch, a vibration control module, and a communication interface; wherein, the vibration control module is electrically connected to the vibration motor; and the communication interface is electrically connected to the transmission module via an RS485 bus.

[0026] Furthermore, both the bridge detection sensor equipment and the captain's cabin main engine are equipped with status indicator lights.

[0027] Furthermore, the main control module, the camera, the lidar, the flash, and the transmission module are all integrated on the first housing; the buzzer, the parameter display screen, the parameter setting button, the power switch, the vibration control module, and the communication interface are all integrated on the second housing.

[0028] As can be seen from the above technical solution, compared with the prior art, the present invention has the following beneficial effects:

[0029] 1. This invention combines a camera and a short-range lidar to perform cascaded detection of the driver's status, effectively identifying dangerous states such as the driver leaving their post, falling asleep, or being distracted, reducing false alarms, and improving robustness in day and night and bumpy environments.

[0030] 2. This invention triggers flashing lights, vibrations, and buzzer alarms according to different time delays through graded time windows. This progressive, multimodal alarm method can achieve coordinated early warning between the bridge and the captain's cabin and enable local intervention, greatly improving the safety of ship navigation. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0032] Figure 1 A schematic diagram of the intelligent monitoring and hierarchical alarm system for the ship's bridge provided by the present invention;

[0033] Figure 2 The driver status detection and alarm flowchart provided by this invention;

[0034] Figure 3 A schematic diagram of a graded time window alarm provided by the present invention;

[0035] Figure 4 This is a schematic diagram of the cab detection sensor device provided by the present invention;

[0036] Figure 5 This is an exploded view of the cab detection sensor device provided by the present invention.

[0037] Figure 6 A schematic diagram of the main engine in the captain's cabin provided by the present invention. Detailed Implementation

[0038] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0039] like Figures 1-3 As shown, this invention discloses an intelligent monitoring and hierarchical alarm system for a ship's bridge, comprising: a bridge detection sensor device and a captain's cabin main unit; the bridge detection sensor device includes a main control module, and a camera, lidar, flashing light, vibration motor, and transmission module electrically connected to the main control module; a buzzer or horn is installed on the captain's cabin main unit, and the buzzer or horn is electrically connected to the main control module;

[0040] The camera is used to capture images of the driver's face, head, and posture;

[0041] The main control module determines the driver's attention state based on the images captured by the camera, and when the driver's attention state is abnormal, it activates the lidar to perform a laser point cloud scan of the driver's seat, and determines whether there is any movement of personnel within a preset time based on the laser point cloud scan results.

[0042] If abnormal driver attention is detected simultaneously, and the laser point cloud scan results are abnormal, the main control module will trigger high-brightness flashing lights, vibration motors and buzzers to issue alarms of different levels in a graded time window. When the highest level alarm is reached, the alarm status information will be sent to the main engine in the captain's cabin through the transmission module.

[0043] Specifically, the main control module triggers the alarm device to issue different levels of alarms using tiered time windows, including:

[0044] Phase 1: Continuously control the flashlight to blink for the first preset duration. If it returns to normal within the first preset duration, control the flashlight to reset.

[0045] Phase 2: Continuously control the flashing light to blink within the second preset time period, and simultaneously control the vibration motor to vibrate. If the system returns to normal within the second preset time period, then control the flashing light and vibration motor to reset.

[0046] Phase 3: If the situation does not return to normal after the second preset time, the system will simultaneously control the flashing lights, the vibration motor to vibrate, and the buzzer to sound. The alarm status information will be sent to the main engine in the captain's cabin via the transmission module until the situation returns to normal or the alarm is manually canceled.

[0047] For example:

[0048] Phase 1: Flash the lights for 30 seconds; if the lights return to normal, reset the flashing lights.

[0049] Phase 2: Vibration + flashing light for 1 minute; if it returns to normal, control the flashing light and vibration motor to reset.

[0050] Phase 3: Beep + Vibrate + Flashing lights and report to the main engine room in the captain's cabin until the problem is resolved or manually canceled.

[0051] If, at any stage, the main control module detects that the system has returned to normal based on real-time camera images and laser point cloud scanning results, it will stop the alarm and reset.

[0052] like Figures 4-5 As shown, the cab-mounted detection sensor device also includes a first status indicator light 101. The main control module 102, camera 103, lidar 104, flash light 105, transmission module 106, and the first status indicator light 101 are all integrated on a first housing 107. The first housing 107 also has a power supply interface 108. The transmission module 106 uses an RS485 interface. The vibration motor is mounted on the seat in the cab. The camera 102 is equipped with a supplementary light 109, covering a range of 50°-70° and 0.6m-1.8m directly in front of the driver's seat. The flash light 105 is a high-brightness flash light equipped with a lens 110. The lidar 103 is a short-range lidar with a scanning distance of 0.2m-5m. The main control module is an embedded processor that supports edge inference and RS-485 communication.

[0053] The main control module uses a lightweight CNN network or EAR algorithm to detect the driver's attention state, such as whether the driver is looking ahead, asleep, looking down, or turning their head. Short periods of looking down or looking up information are considered normal behavior (whitelist logic) and are not counted in the duration of eye closure, thus reducing false positives. When sleep is detected, timing and analysis are started directly, and the driver's eye closure state and head position are detected to determine whether the driver is looking ahead normally and is not fatigued.

[0054] When the camera detects an abnormal driver attention state, such as not detecting a face, detecting an empty space, detecting a driver continuously looking down for a preset period of time, or detecting a closed-eye state, the LiDAR is activated to perform a laser point cloud scan of the driver's seat. If the rate of change of the point cloud data in the driving area is less than a threshold or the centroid movement of the point cloud in the driving area is less than a threshold within multiple consecutive scanning cycles, it indicates that the driver has left his post or fallen asleep. In this case, it is determined that there is no movement of personnel in the driving area, and the laser point cloud scan result is abnormal.

[0055] Specifically, the point cloud cluster of the driver in the cab can be obtained through laser point cloud scanning data, and the centroid of the point cloud cluster can be identified. By detecting the distance of human movement (i.e., the distance of centroid movement), for example, judging the distance movement of consecutive points within the same angle at a time interval of 1 second, it can be determined whether there is a person. When the object movement reaches the preset judgment standard, it is considered that there is a person, and the abnormal timing is canceled.

[0056] In one embodiment, such as Figure 6 As shown, the captain's cabin main engine also includes a processing module, and a parameter display screen 201 (digital tube), parameter setting buttons 202, a power switch 203, a vibration control module 204, a communication interface 205, and a second status indicator 206, all electrically connected to the processing module. The vibration control module 204 is electrically connected to the vibration motor; the communication interface 205 is electrically connected to the transmission module via an RS485 bus. The buzzer 207, parameter display screen 201, parameter setting buttons 202, power switch 203, vibration control module 204, communication interface 205, and second status indicator 206 are all integrated into the second housing 208.

[0057] The bridge detection sensor equipment is the core component for detecting and determining whether an alarm is needed. When an abnormal state is detected, it sends a status indication to the captain's main engine via a transmission module. When the highest level is reached, the buzzer on the captain's main engine sounds, notifying the captain of the abnormality in the bridge. The vibration control module is installed on the captain's main engine primarily for ease of wiring. Of course, the vibration control module can also be integrated into the bridge detection sensor equipment. The captain's main engine is only used to display the status and set parameters. Furthermore, the main control module will only activate the buzzer on the captain's main engine to alert the captain when the secondary warnings in front of the bridge are ineffective.

[0058] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0059] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A ship bridge intelligent watch keeping monitoring and hierarchical alarming system, characterized in that, The application relates to a driving cabin detection sensor device and a captain's cabin host; the driving cabin detection sensor device comprises a master control module, and a camera, a laser radar, a flashing light, a vibrating motor and a transmission module which are electrically connected with the master control module respectively; a buzzer is installed on the captain's cabin host, and the buzzer is electrically connected with the master control module. The camera is used for collecting facial, head and posture images of a driver. The master control module judges the attention state of the driver based on the images collected by the camera, and when the attention state of the driver is abnormal, the laser radar is started to perform laser point cloud scanning on a driving position, and whether personnel moves within a preset time is judged according to the laser point cloud scanning result. If the driver's attention is detected to be abnormal at the same time, and the laser point cloud scanning result is abnormal, the master control module triggers the high-brightness flashing light, the vibrating motor and the buzzer to issue different levels of alarms in a hierarchical time window, and when the highest level of alarm is reached, alarm state information is sent to the captain's cabin host through the transmission module. The master control module triggers the alarm device to issue different levels of alarms in a hierarchical time window, which comprises the following steps:

2. The intelligent watch keeping monitoring and hierarchical alarming system for bridge of marine vessels as claimed in claim 1 wherein, Stage one: the flashing light is continuously controlled to flash within a first preset time length, and if the driver returns to normal within the first preset time length, the flashing light is reset; Stage two: the flashing light is continuously controlled to flash within a second preset time length, and the vibrating motor is simultaneously controlled to vibrate, and if the driver returns to normal within the second preset time length, the flashing light and the vibrating motor are reset; Stage three: if the driver does not return to normal after the second preset time length, the flashing light, the vibrating motor and the buzzer are simultaneously controlled to flash, vibrate and buzz respectively, and alarm state information is sent to the captain's cabin host through the transmission module until the driver returns to normal or the alarm is manually cancelled. The camera is provided with a light supplement lamp, and covers a range of 50-70 degrees and 0.6-1.8 meters in front of the driving position; the laser radar is a short-range laser radar, and the scanning distance is 0.2-5 meters.

3. The intelligent watch keeping monitoring and hierarchical alarming system for bridge of marine vessels as claimed in claim 1 wherein, The situations in which the attention state of the driver is abnormal include: no facial state is detected, no personnel state is detected, the driver is detected to continuously lower his head within a preset time length and the driver is detected to close his eyes.

4. The intelligent watch keeping monitoring and hierarchical alarming system for bridge of marine vessels as claimed in claim 1 wherein, The master control module detects the attention state of the driver through a lightweight CNN network or an EAR algorithm.

5. The intelligent watch keeping monitoring and hierarchical alarming system for bridge of marine vessels as claimed in claim 1 wherein, The situations in which the laser point cloud scanning result is abnormal include:

6. The intelligent watch-keeping monitoring and hierarchical alarming system for a ship's bridge according to claim 1, characterized in that, In a plurality of continuous scanning periods, the point cloud data change rate of the driving area is less than a threshold value or the point cloud centroid movement amount of the driving area is less than a threshold value, which indicates that the driver is off duty or asleep, so that it is judged that no personnel moves in the driving area, and the laser point cloud scanning result is abnormal. The vibrating motor is installed on a seat in the driving cabin.

7. The intelligent watch keeping monitoring and hierarchical alarming system for bridge of marine vessels as claimed in claim 1 wherein, The captain's cabin host further comprises a parameter display screen, a parameter setting button, a power switch, a vibration control module and a communication interface; the vibration control module is electrically connected with the vibrating motor; and the communication interface is electrically connected with the transmission module through an RS485 bus.

8. The intelligent watch-keeping monitoring and hierarchical alarming system for a ship's bridge according to claim 1, characterized in that, State indicator lights are arranged on the driving cabin detection sensor device and the captain's cabin host.

9. The intelligent watch-keeping monitoring and hierarchical alarming system for a ship's bridge according to claim 1, characterized in that, ​ 10. The intelligent watch-keeping monitoring and hierarchical alarming system for a ship's bridge according to claim 8, characterized in that, The master module, the camera, the laser radar, the flash light and the transmission module are integrated on the first shell; the buzzer, the parameter display screen, the parameter setting key, the power switch, the vibration control module and the communication interface are integrated on the second shell.

Images