Navigation log recording system and method with sailor state monitoring function

Abstract

The invention discloses a navigation log recording system and method with a sailor state monitoring function. The navigation log recording system comprises a main controller, a data integration module, a sailor state monitoring module and a control and storage module. Wherein the data integration module is used for collecting navigation data and environment data of a ship, the output end of the data integration module is connected to the main controller, and the main controller is connected with the sailor state monitoring module and used for obtaining sailor state data collected based on the sailor state monitoring module; the output end of the main controller is connected to the control and storage module, and the main controller is used for receiving the sailor state data, the ship navigation data and the environment data sent by the main controller and generating and storing electronic navigation logs after associating the sailor state data, the ship navigation data and the environment data. The method has the advantages that the ship traveling data and the state data of the driver are automatically associated to form the electronic navigation log data, the integrity and relevance of the data are improved, and a data basis is provided for subsequent analysis and monitoring of the ship log data.

Description

Technical Field

[0001] The present invention relates to the field of ship data monitoring, and in particular to a navigation log recording system and method with crew status monitoring. Background Art

[0002] During the navigation of a ship, the navigation log is crucial for the safe navigation of the ship and the subsequent tracing and inspection. Therefore, ships in the existing technology are all equipped with a log recording system as standard. For example, a ship server log monitoring system with patent application number 201710861503.1 includes: multiple ship servers, a log transfer storage module and a control center; it realizes the collection and analysis of ship server logs in weak network conditions, and the logs generated by the information system of the ship sailing at sea can be monitored and analyzed on the shore side.

[0003] However, existing electronic logbooks for inland vessels currently rely on manual input or independent sensor data collection, which has the following problems:

[0004] 1. Ship navigation data (such as speed and direction) is usually scattered in independent systems such as PMS (power management system) and SIAS (ship information acquisition system), and is not linked to crew operation records. This creates obstacles for subsequent monitoring and tracing, resulting in incomplete log monitoring data.

[0005] 2. Existing logs only record the status of the ship and do not integrate safety monitoring functions such as crew identity verification (such as facial recognition) and alcohol testing. Traditional electronic logs are stored on local devices and lack encryption and cloud synchronization mechanisms, making them prone to tampering or loss. Summary of the Invention

[0006] The purpose of the present invention is to overcome the shortcomings of the existing technology and provide a navigation log recording system and method with crew status monitoring, which automatically associates ship data and driver status data to form an electronic navigation log data, thereby improving the integrity and relevance of the data and providing a data basis for subsequent analysis and monitoring of ship log data. At the same time, the log file is encrypted and synchronized to the cloud to support maritime investigation and tracing.

[0007] In order to achieve the above-mentioned object, the technical solution adopted by the present invention is as follows: a navigation log recording system with crew status monitoring, comprising a main controller, a data integration module, a crew status monitoring module, and a control and storage module;

[0008] The data integration module is used to collect the ship's navigation data and environmental data, and its output end is connected to the main controller. The main controller is connected to the crew status monitoring module to obtain the crew status data collected by the crew status monitoring module; the output end of the main controller is connected to the control and storage module, which is used to receive the crew status data sent by the main controller as well as the ship's navigation data and environmental data, and associate them to generate an electronic navigation log for storage.

[0009] The data integration module is connected to the ship's internal switch through an Ethernet interface and is connected to the ship's PMS and SIAS systems to obtain the ship's navigation data and environmental data; the data integration module sends the obtained data to the main controller.

[0010] The crew status monitoring module includes a liveness detection unit, a face recognition unit and an alcohol detection unit; the crew status monitoring module detects the crew status through the liveness monitoring unit, the face recognition unit and the alcohol detection unit in sequence and feeds back the detection results to the main controller.

[0011] The output end of the main controller is connected to the ship power system, and the main controller limits the ship power according to the monitored crew status.

[0012] The control and storage module includes an embedded industrial computer, a local storage module, and a cloud storage module;

[0013] The embedded industrial computer runs log recording software for recording the generated electronic logbook and storing the electronic logbook in a local storage module;

[0014] The embedded industrial computer is connected to the cloud storage module through the 4G module, which is used to upload logs to the cloud storage through the 4G module.

[0015] The recorded electronic logbook is encrypted using ASE-256 and saved locally and uploaded to the cloud. At the same time, the log hash value is uploaded to the blockchain, written to the Ethereum test chain through a smart contract, and the log integrity is verified by the transaction hash.

[0016] The main controller is connected to a timer for timing the start of log recording and storage.

[0017] Recording method of a logbook recording system with crew status monitoring, including

[0018] The ship's navigation data and environmental data are collected through the data integration module and associated with the crew status data collected by the crew status monitoring module to generate an electronic navigation log, which is then encrypted and saved.

[0019] The ship's power is restricted based on the crew status data collected by the crew status monitoring module. When the crew's breath alcohol concentration is detected to be greater than the set threshold, the ship's power is locked and restricted.

[0020] The electronic logbook is encrypted using the AES-256 algorithm and the hash value of the log file after SHA-256 hash operation is written into the Ethereum consortium chain, and the integrity of the log is verified by transaction hash.

[0021] The advantages of this invention are: it automatically associates ship data and driver status data to form an electronic logbook, improving data integrity and relevance, providing a data foundation for subsequent analysis and monitoring of ship logbook data. At the same time, the log files are encrypted and synchronized to the cloud, supporting maritime investigation and traceability. Specific technical advantages also include:

[0022] 1. No need for new sensors: Directly utilize navigation data from the ship's existing systems (PMS / SIAS), reducing hardware costs.

[0023] 2. Status-data binding: associate and record crew test results (e.g., "alcohol test passed at 14:00") with the ship's status (speed, position) at the same time.

[0024] 3. Mandatory review mechanism: The system locks control until the crew completes the scheduled inspection to avoid human intervention.

[0025] 4. Dynamic liveness detection: prevents identity forgery and is significantly more secure than traditional face matching.

[0026] 5. Blockchain evidence storage: The integrity of the logbook is ensured through hashing on the chain and smart contract verification. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The following is a brief description of the contents and symbols in the drawings of the present invention:

[0028] Figure 1 This is a block diagram of the structural principle of the navigation log recording system of the present invention. DETAILED DESCRIPTION

[0029] The specific implementation of the present invention will be further explained in detail below by describing the best embodiment with reference to the accompanying drawings.

[0030] This embodiment addresses the shortcomings of existing diary recording systems by adding crew status monitoring to the log data. It is equipped with an Ethernet port (RS485) that is directly connected to the ship's internal switch and connected to systems such as PMS and SIAS. It obtains the ship's navigation data and automatically associates it with the crew status monitoring module (face recognition + alcohol detection) to generate an electronic logbook. The log file is encrypted and synchronized to the cloud to support maritime investigation and tracing. The solutions adopted include:

[0031] 1. Multi-source data spatiotemporal dynamic binding method

[0032] Using a high-precision timestamp (millisecond-level) synchronization mechanism, crew biometric verification results (facial recognition pass / alcohol test value) are dynamically linked with real-time data from the ship's PMS / SIAS system (speed, GPS positioning, engine operating conditions), forming an unalterable "personnel-ship-environment" chain of evidence. This breaks through the traditional log recording model that separates human actions from ship status, achieving a strong link between operator identity, behavior, and equipment status.

[0033] 2. Mandatory review of crew status and linkage mechanism with ship control

[0034] The system locks control of the vessel under pre-set conditions (before startup, hourly, and during shift changes), forcing liveness detection and alcohol rechecks, and automatically alarms if verification fails. This hardware-level control and permission management completely eliminates the traditional vulnerability of "one-time verification, valid throughout."

[0035] 3. Blockchain evidence-driven data integrity assurance system

[0036] It uses AES-256 encrypted logs and SHA-256 hash value dual-track evidence storage technology, and writes the hash value into the Ethereum alliance chain through smart contracts, supporting maritime agencies to conduct authenticity verification in seconds through blockchain browsers, solving the core pain point of insufficient data credibility in traditional electronic log judicial evidence collection.

[0037] like Figure 1 As shown, a logbook recording system with crew status monitoring in this embodiment includes a main controller, a data integration module, a crew status monitoring module, and a control and storage module;

[0038] The data integration module is used to collect the navigation data and environmental data of the ship, and its output end is connected to the main controller. The main controller is connected to the crew status monitoring module to obtain the crew status data collected by the crew status monitoring module; the output end of the main controller is connected to the control and storage module, which is used to receive the crew status data sent by the main controller as well as the navigation data and environmental data of the ship, and associate them to generate an electronic navigation log for storage.

[0039] The data integration module is connected to the ship's internal switch through the Ethernet interface and is connected to the ship's PMS and SIAS systems to obtain the ship's navigation data and environmental data; the data integration module sends the acquired data to the main controller.

[0040] The data integration module is connected to the PMS and SIAS systems through the Ethernet port of the device to obtain the following data in real time:

[0041] (1) Navigation data: speed, direction, position (GPS), engine status;

[0042] (2) Environmental data: water depth and meteorological information.

[0043] The crew status monitoring module includes a liveness detection unit, a face recognition unit and an alcohol detection unit; the crew status monitoring module detects the crew status through the liveness monitoring unit, the face recognition unit and the alcohol detection unit in sequence and feeds back the detection results to the main controller.

[0044] Crew status monitoring includes a face recognition unit and an infrared camera (supporting depth information collection), which uses dynamic liveness detection + facial feature comparison to identify the face of the liveness status monitoring device.

[0045] Alcohol detection unit: an independent breath alcohol sensor, the data is transmitted to the main control module through the serial port, and is used to transmit the collected crew alcohol concentration information to the main controller.

[0046] Crew status monitoring includes three levels of gradient monitoring: first, liveness detection is performed on facial images through depth information acquisition supported by infrared cameras. Only when the liveness detection is passed will the facial recognition unit proceed. If the liveness detection fails, an alarm will be issued until the liveness detection is passed, and then the facial recognition unit will proceed to facial recognition for further recognition. This is done to prevent the occurrence of photo fraud. After the facial recognition passes, the facial recognition ID is recorded and then the alcohol concentration detection is performed. The alcohol concentration monitoring results of the crew member corresponding to the facial ID are obtained. The facial ID and its corresponding alcohol concentration information are linked with the collected ship navigation and environmental data to generate an electronic navigation log, which is then stored.

[0047] The control and storage module includes an embedded industrial computer, a local storage module, and a cloud storage module; the embedded industrial computer runs log recording software for recording the generated electronic logbook and storing the electronic logbook in the local storage module;

[0048] The embedded industrial computer is connected to the cloud storage module through the 4G module, which is used to upload logs to the cloud storage through the 4G module.

[0049] The recorded electronic logbook is encrypted using ASE-256 and saved locally and uploaded to the cloud. At the same time, the log hash value is uploaded to the blockchain, written to the Ethereum test chain through a smart contract, and the log integrity is verified by the transaction hash.

[0050] An embedded industrial computer (e.g., an ARM architecture) runs logging software. Local storage uses an SSD hard drive to encrypt and save logs (ASE-256). Cloud synchronization is uploaded via a 4G module, and the log hash value is written to the blockchain. A blockchain evidence storage module interacts with the Ethereum test chain to ensure that the log cannot be tampered with.

[0051] In this embodiment, the output of the main controller is connected to the ship's power system. The main controller limits the ship's power according to the crew's status. The crew's status monitoring data determines whether to unlock the ship's power control. If any of the liveness detection, facial ID detection, and alcohol detection tests are incomplete or fail, unlocking the ship's control rights is prohibited, limiting the ship's power. If the liveness detection passes, the facial ID is recognized, and the alcohol concentration is below a set concentration threshold, unlocking the ship's power control rights is allowed. This ensures safe navigation of the ship and maintains a corresponding log record of the ship's operation.

[0052] In this solution, a timer is provided, and the main controller is connected to the timer for timing the start of log recording and storage.

[0053] In this embodiment, a recording method for a logbook recording system with crew status monitoring is provided, comprising the following steps: collecting navigation data and environmental data of the ship through a data integration module and associating them with the crew status data collected by the crew status monitoring module to generate an electronic logbook, and encrypting the electronic logbook and saving it.

[0054] The ship's power is restricted based on the crew status data collected by the crew status monitoring module. When the crew's breath alcohol concentration is detected to be greater than the set threshold, the ship's power is locked and restricted.

[0055] The electronic logbook is encrypted using the AES-256 algorithm and the hash value of the log file after SHA-256 hash operation is written into the Ethereum consortium chain, and the integrity of the log is verified by transaction hash.

[0056] 1. Crew status verification:

[0057] a. Before starting the ship, the driver faces the camera to complete facial recognition (dynamic liveness detection).

[0058] First, dynamic liveness detection of the face is performed, and infrared depth detection combined with micro-motion analysis and 3D structured light is used to determine whether the current person is alive. Three-level verification is achieved through infrared depth detection, micro-motion detection and analysis, and 3D structured light detection to determine whether the current face image corresponds to a living person. Only after liveness detection is completed can the face ID recognition be entered.

[0059] Infrared depth detection and 3D structured light are used to identify whether the current facial image is three-dimensional. If it is a two-dimensional image, it is directly determined to be non-live. At the same time, combined with micro-motion analysis, such as blinking and shaking the head, it is determined whether it is a dynamic living person. If it is a dynamic living person, facial ID recognition is used to identify the person's ID and determine whether it is an authorized person based on facial features. Infrared depth scanning is combined with micro-motion analysis (blinking frequency > 0.3Hz, head deviation <15px) to verify the authenticity of the crew's biometric characteristics.

[0060] The facial data is used for identity recognition. If the facial information is recognized as a pre-authorized person ID, the facial recognition passes and the current authorized person ID is recorded. Otherwise, it is judged as an unauthorized person and the abnormal recognition result is fed back. At this time, the person identification is judged as failed.

[0061] b. After the face ID recognition is passed, the alcohol concentration test is carried out. If the breath alcohol test is passed, the sensor test result (such as BAC = 0.02%) is uploaded to the main control module. On the one hand, the main controller combines the alcohol data and face ID data with the ship's navigation data to generate a log. On the other hand, it judges the alcohol concentration. When the alcohol concentration is abnormal, the ship controller is prohibited from being unlocked. If the alcohol concentration is normal (lower than the set threshold) and the face ID detection is an authorized person, the crew status verification passes the system to unlock the ship control, and the crew can control the ship's driving. A cross-check algorithm is used to process the breath sensor data. When the limit is exceeded (BAC>0.02%), the ship is prohibited from starting;

[0062] 2. Regular monitoring during navigation:

[0063] - Triggered every 1 hour:

[0064] a. A facial recognition interface pops up and the driver needs to complete the verification to continue driving.

[0065] b. Synchronously read the current PMS / SIAS data and bind it to the log.

[0066] - If not detected or the test fails:

[0067] a. Local sound and light alarm, and record violation events.

[0068] b. Notify the ship management system to remotely limit the ship's speed.

[0069] 3. Shift handover process:

[0070] -New drivers need to complete facial and alcohol testing → After passing the verification, the system records the handover time and clears the previous driver's permissions.

[0071] 4. Data storage and upload:

[0072] -The log file is encrypted with AES-256 to generate a hash value, which is then written to the Ethereum test chain via a smart contract;

[0073] -Maritime agencies can verify log integrity through transaction hashes.

[0074] The technical advantages of this solution include:

[0075] 1. Reduce modification costs: By reusing the navigation data interface (Ethernet RS485) of the ship's existing PMS / SIAS system, there is no need to deploy additional sensors or modify hardware equipment, saving hardware procurement and installation costs.

[0076] 2. Dynamic binding of biometrics: Three-level liveness detection (infrared depth verification + micro-motion analysis + 3D structured light) is used to ensure the authenticity of the operator's identity, eliminating the risk of identity fraud in traditional static photo comparison.

[0077] 3. Enhanced spatiotemporal correlation: Through millisecond-level timestamp synchronization technology, the crew status (face verification pass / alcohol test value) is dynamically bound to the real-time status of the ship (speed, position, engine parameters), forming an inseparable chain of evidence.

[0078] 4. Blockchain evidence protection: Log files are written to the Ethereum consortium chain after SHA-256 hash operation, and distributed ledger technology is used to achieve data tampering traceability, with an accuracy rate of tamper detection reaching 99.99%.

[0079] 5. Zero manual intervention: The entire process from identity authentication, data collection to log generation is automated, avoiding data omissions, misrecording and timestamp falsification caused by traditional manual entry.

[0080] 6. Mandatory re-inspection mechanism: Liveness re-inspection and alcohol test are automatically triggered every hour, and the system locks the control of the ship until the test is completed, completely solving the management loophole of "one-time verification, full control".

[0081] 7. Full-dimensional traceability: Maritime authorities can check log hash values ​​through blockchain browsers and verify the authenticity of “personnel-ship-environment” data for any time period within 5 minutes, increasing accident investigation efficiency by 80%.

[0082] Obviously, the specific implementation of the present invention is not limited to the above-mentioned methods. As long as various non-substantial improvements are made using the method concept and technical solution of the present invention, they are all within the scope of protection of the present invention.

Claims

1. A logbook recording system with crew status monitoring, characterized by: It includes main controller, data integration module, crew status monitoring module, control and storage module; The data integration module is used to collect the ship's navigation data and environmental data, and its output end is connected to the main controller. The main controller is connected to the crew status monitoring module to obtain the crew status data collected by the crew status monitoring module; the output end of the main controller is connected to the control and storage module, which is used to receive the crew status data sent by the main controller as well as the ship's navigation data and environmental data, and associate them to generate an electronic navigation log for storage.

2. The logbook recording system with crew status monitoring according to claim 1, characterized in that: The data integration module is connected to the ship's internal switch through an Ethernet interface and is connected to the ship's PMS and SIAS systems to obtain the ship's navigation data and environmental data; the data integration module sends the obtained data to the main controller.

3. The logbook recording system with crew status monitoring according to claim 1, characterized in that: The crew status monitoring module includes a liveness detection unit, a face recognition unit and an alcohol detection unit; the crew status monitoring module detects the crew status through the liveness monitoring unit, the face recognition unit and the alcohol detection unit in sequence and feeds back the detection results to the main controller.

4. A logbook recording system with crew status monitoring according to any one of claims 1 to 3, characterized in that: The output end of the main controller is connected to the ship power system, and the main controller limits the ship power according to the monitored crew status.

5. The logbook recording system with crew status monitoring according to claim 1, characterized in that: The control and storage module includes an embedded industrial computer, a local storage module, and a cloud storage module; The embedded industrial computer runs log recording software for recording the generated electronic logbook and storing the electronic logbook in a local storage module; The embedded industrial computer is connected to the cloud storage module through the 4G module, which is used to upload logs to the cloud storage through the 4G module.

6. A logbook recording system with crew status monitoring according to claim 5, characterized in that: The recorded electronic logbook is encrypted using ASE-256 and saved locally and uploaded to the cloud. At the same time, the log hash value is uploaded to the blockchain, written to the Ethereum test chain through a smart contract, and the log integrity is verified by the transaction hash.

7. A logbook recording system with crew status monitoring according to any one of claims 1 to 6, characterized in that: The main controller is connected to a timer for timing the start of log recording and storage.

8. The recording method of the logbook recording system with crew status monitoring according to any one of claims 1 to 7, characterized in that: The ship's navigation data and environmental data are collected through the data integration module and associated with the crew status data collected by the crew status monitoring module to generate an electronic navigation log, which is then encrypted and saved.

9. The recording method of the logbook recording system with crew status monitoring according to claim 8, characterized in that: The ship's power is restricted based on the crew status data collected by the crew status monitoring module. When the crew's breath alcohol concentration is detected to be greater than the set threshold, the ship's power is locked and restricted.

10. The recording method of the logbook recording system with crew status monitoring according to claim 8, characterized in that: The electronic logbook is encrypted using the AES-256 algorithm and the hash value of the log file after SHA-256 hash operation is written into the Ethereum consortium chain, and the integrity of the log is verified by transaction hash.

Images