New energy ship power system data efficient transmission and storage method and system

Abstract

The invention provides a new energy ship power system data efficient transmission and storage method and system, and relates to the technical field of ship data processing. The method comprises the following steps: acquiring data generated by a new energy ship power system, acquiring the data at a preset high frequency through a data acquisition and storage module, and storing the data in a data recorder in real time; according to the ship docking state, connection is established through a data transmission module, and data stored in the data recorder is transmitted to an operation center in batches; the data processing module processes and analyzes the transmitted data to obtain operation information of the power system; according to the invention, ultrahigh fidelity acquisition and reliable storage of power system data are realized, the continuity and integrity of the data are improved, a shore-based data transmission channel with low cost, high efficiency and high reliability is constructed, the data transmission cost is remarkably reduced, and the power system reliability and operation safety of a new energy ship are improved.

Description

Technical Field

[0001] This invention relates to the field of ship data processing technology, and in particular to a method and system for efficient transmission and storage of data from a new energy ship power system. Background Technology

[0002] As the global shipping industry transforms towards green, low-carbon, and intelligent technologies, new energy ships are experiencing rapid development. As a core component, the ship's propulsion system's operational status directly impacts navigation safety, energy efficiency management, and maintenance costs. Therefore, high-frequency, comprehensive data collection, transmission, and analysis of the propulsion system are fundamental to achieving intelligent operation and maintenance and refined management.

[0003] Currently, two main data processing schemes are used: 1. Intermittent transmission scheme based on vehicle-mounted terminals (t-BOX): This scheme generally uses a low transmission frequency. Although it can meet basic status monitoring, it cannot capture transient, highly dynamic fault characteristics in the power system, such as instantaneous voltage drops and current spikes. This results in the inability to meet the needs of real-time data backtracking and in-depth fault diagnosis, creating blind spots in data recording and posing a hidden danger to the safe operation of ships. 2. Real-time transmission scheme based on 4G / 5G mobile networks: Although it can achieve a higher data transmission frequency, it faces two major challenges in practical applications: 1) High cost: The data volume of new energy ship power systems is huge: At a collection frequency of 100 milliseconds, the daily data volume of a single ship can reach tens of gigabytes; transmission through commercial mobile networks will incur huge traffic costs; 2) Insufficient reliability: In navigation areas far from the coastline, mobile network signal coverage is weak or unstable, making it difficult to guarantee the continuity and integrity of data transmission, which can easily lead to the loss of critical data. Third, with the increase in data collection frequency, shipboard storage devices need to have larger capacity and higher read and write speeds, but existing solutions are usually not optimized for massive high-frequency data, resulting in storage bottlenecks.

[0004] In conclusion, given the current nascent stage of the new energy ship industry and the extreme scarcity of power system sample data, developing a data transmission and storage method that can balance high-frequency acquisition, low cost, and high reliability is of paramount importance and has an urgent market demand for accelerating technological iteration, ensuring navigation safety, and improving operational efficiency. Summary of the Invention

[0005] The main objective of this invention is to provide a method and system for efficient data transmission and storage of new energy ship power systems, thereby solving the technical problems of insufficient signal stability, insufficient real-time performance, large storage limitations, and high cost in the prior art.

[0006] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is: a method for efficient transmission and storage of data in a new energy ship power system, comprising the following steps: Data generated by the new energy ship power system is acquired, and the data is collected at a preset high frequency through the data acquisition and storage module and stored in the data logger in real time. Based on the ship's berthing status, a connection is established through the data transmission module, and the data stored in the data recorder is transmitted in batches to the operations center. The data processing module processes and analyzes the transmitted data to obtain the operating information of the power system.

[0007] In a preferred embodiment, the step of acquiring the data at a preset high frequency and storing it in the data logger in real time via the data acquisition and storage module includes: The data acquisition and storage module collects power system data from the new energy ship power system and determines the acquisition frequency to ensure data real-time performance. Data on the power system is acquired based on the acquisition frequency, and the power system data is categorized and stored in the storage device of the data logger; The storage capacity of the storage device is monitored, and if the storage capacity reaches a preset threshold, the storage strategy is adjusted to maintain data integrity. The data logger processes the collected power system data to generate a time-series dataset for subsequent transmission preparation.

[0008] In the preferred embodiment, establishing a connection through the data transmission module and transmitting the data stored in the data logger in batches to the operations center includes: When a ship docks at a pier, the data transmission module detects the docking status and activates the ultra-long-range wireless bridge. The ultra-long-range wireless bridge searches for and connects to the router in the operations center to establish a stable transmission channel; Based on the established transmission channel, the stored data is extracted from the data logger and sent to the operation center at a preset transmission rate; If an interruption is detected during transmission, the connection is re-established and the remaining data is transmitted to ensure data continuity.

[0009] In the preferred embodiment, the step of processing and analyzing the transmitted data through the data processing module to obtain power system operating information includes: The data processing module receives data transmitted from the operation center and performs preliminary cleaning on the data to remove invalid parts; Based on the cleaned data, a filtering operation is performed to extract key indicators related to the power system; The operating status of the power system is determined by analyzing the key indicators. If the operating status exceeds the preset range, an early warning message is generated.

[0010] In a preferred embodiment, the step of acquiring the power system data according to the acquisition frequency and classifying and storing the power system data in the storage device of the data logger includes: For the aforementioned acquisition frequency, data streams including battery management and motor control are obtained from the new energy ship power system; The data stream is categorized by date and time and stored in the high-performance hard drive of the storage device; When data anomalies are detected during the classification process, the data stream is corrected. The storage device records the total amount of categorized data and updates the storage log.

[0011] In the preferred embodiment, the local storage device is a solid-state drive (SSD) with a capacity configured to store at least 20 days' worth of data.

[0012] In a preferred embodiment, the step of retrieving stored data from the data logger according to the established transmission channel and sending the data to the operation center at a preset transmission rate includes: After the transmission channel confirms a stable connection, it extracts the stored data categorized by time from the data logger. The stored data is sent in batches according to a preset transmission rate, and the transmission progress is monitored. If the transmission progress is slower than expected, adjust the transmission parameters to speed up data transmission; After the transmission is completed, verify the integrity of the stored data and send a confirmation signal to the operations center.

[0013] In the preferred embodiment, the step of determining the operating status of the power system by analyzing the key indicators, and generating early warning information if the operating status exceeds a preset range, includes: A pre-trained analysis model is applied to the key indicators to calculate the operating status values; If the operating status value exceeds the preset range, a warning message of the corresponding level will be generated according to the degree of deviation; The warning information is associated with specific power system components, and analysis logs are recorded. The thresholds of the key indicators are iteratively updated using the analytical model.

[0014] In the preferred embodiment, the collected data is the CAN bus data of the power system.

[0015] Secondly, the present invention provides a high-efficiency data transmission and storage system for new energy ship power systems, applicable to the aforementioned high-efficiency data transmission and storage method for new energy ship power systems, comprising: The data acquisition and storage module, deployed on new energy ships, includes a data logger and local storage devices, used for high-frequency acquisition and temporary storage of power system data; The data transmission module includes an ultra-long-range WiFi bridge deployed on board and a router deployed in the operations center, used to establish communication links and transmit data when the ship docks. The data processing module, deployed in the operations center, is a big data platform used to receive, store, and process data transmitted from ships.

[0016] This invention provides a method for efficient transmission and storage of data from a new energy ship power system. The method involves acquiring data generated by the new energy ship power system, using a data acquisition and storage module to collect the data at a preset high frequency and store it in real-time in a data logger. Based on the ship's berthing status, a data transmission module establishes a connection and transmits the data stored in the data logger in batches to the operations center. A data processing module processes and analyzes the transmitted data to obtain power system operating information. By acquiring data at a preset high frequency and storing it locally, and establishing a connection based on the ship's berthing status and the data transmission module for batch transmission, this method improves real-time transmission and signal stability, achieving efficient and low-cost data transmission and storage. It also solves the problem of storage limitations and improves data integrity and the efficiency of big data analysis. Attached Figure Description

[0017] The present invention will be further described below with reference to the accompanying drawings and embodiments: Figure 1 This is a schematic diagram of the method flow of the present invention. Detailed Implementation

[0018] Example 1 like Figure 1 As shown, a method for efficient data transmission and storage of new energy ship power systems includes the following steps: The system acquires data generated by the power system of new energy ships. Through the data acquisition and storage module, it collects the power system operation information data at a acquisition frequency of 100 milliseconds and stores it in the data logger in real time. Based on the ship's berthing status, a connection is established through the data transmission module, and the data stored in the power system operation information data recorder is transmitted in batches to the operation center. The data processing module processes and analyzes the transmitted data to obtain the operating information of the power system.

[0019] In this embodiment, the preset high frequency is a sampling frequency of 100 milliseconds.

[0020] This embodiment acquires data generated by the power system of a new energy ship. The data is collected at a frequency of 100 milliseconds by the data acquisition and storage module and stored in real time in the data logger. According to the ship's berthing status, a connection is established through the data transmission module and the stored data is transmitted in batches to the operation center. The data processing module processes and analyzes the transmitted data to obtain the power system operation information. This improves the real-time performance and signal stability of the transmission, realizes efficient and low-cost data transmission and storage, solves the problem of storage limitations, and improves data integrity and the efficiency of big data analysis.

[0021] In this embodiment, 1. The data acquisition and storage module includes a data logger and a storage device.

[0022] Operating principle: Data from the new energy ship's power system is collected every 100 milliseconds and stored in real time in the data logger. The daily data volume is approximately 8,640,000 records: assuming each record is 5KB, the daily data volume is approximately 43.2GB. The storage device uses a high-performance solid-state drive with a capacity of 1TB, meeting at least 20 days of data storage requirements.

[0023] 2. The data transmission module includes an ultra-long-range WiFi bridge and an operations center router.

[0024] Operating principle: After the ship docks, the ultra-long-range WiFi bridge automatically connects to the router at the operations center, establishing a stable data transmission channel. The WiFi bridge has a transmission rate of 300Mbps and a transmission distance of up to 5 kilometers.

[0025] 3. The data processing module includes a big data platform.

[0026] Operating principle: The transmitted data is processed and analyzed on the big data platform. The big data platform has powerful data processing capabilities, capable of processing a day's worth of data within one hour.

[0027] The specific steps in this embodiment are as follows: S1: Data Acquisition and Storage: A data recorder is installed in the power system of the new energy ship. During the ship's navigation, approximately 8,640,000 data points are collected in 100-millisecond intervals over a day of operation.

[0028] Data from the power system of the new energy vessel is continuously collected, and the obtained power system operation information data is stored in real time on the local storage device of the shipborne data logger, categorized by date and time. The solid-state drive in the data logger stores the data collected that day, with each data entry being approximately 5KB in size, and the total data volume for the day being approximately 43.2GB.

[0029] S2: Shore-based connection establishment: When the ship docks at the pier, it automatically searches for and connects to the router in the operations center via the ship's onboard ultra-long-range WiFi bridge to establish a wireless data transmission link.

[0030] The ultra-long-range WiFi bridge automatically connects to the operation center router 5 kilometers away within 5 minutes, establishing a stable data transmission channel.

[0031] In this embodiment, the transmission distance of the ultra-long-distance WiFi bridge is no less than 5 kilometers, and the transmission rate is no less than 300Mbps; the data transmitted in batches is all the data stored by the ship during a single voyage.

[0032] S3: Batch Data Transmission: Through the wireless data transmission link for obtaining power system operation information, historical data stored in the local storage device for obtaining power system operation information is transmitted in batches to the big data platform of the operation center.

[0033] After the connection is successfully established, 43.2G of data is transmitted to the big data platform of the operation center at an average transmission rate of 300Mbps, and the transmission time is less than 1 hour.

[0034] S4: Centralized Data Processing: The big data platform cleans, filters, and analyzes the received data to extract valuable information.

[0035] Within 45 minutes of receiving the data, the data platform completes the cleaning, filtering and analysis of the data, extracting key information such as the operating status and fault warnings of the power system.

[0036] In this embodiment, Low Power Wide Area Network (LPWAN) technology can be used to achieve low-power data transmission and storage. The LPWAN communication module is responsible for transmitting the collected data to the nearest gateway in a low-power manner through the LPWAN network.

[0037] In the preferred embodiment, the power system operation information data is acquired at a preset high frequency through a data acquisition and storage module and stored in the data logger in real time, including: The data acquisition and storage module for obtaining power system operation information collects power system data from the new energy ship power system and determines the acquisition frequency to ensure data real-time performance. Data on the power system is acquired based on the acquisition frequency, and the power system data is categorized and stored in the storage device of the data logger; The storage capacity of the storage device for obtaining power system operation information is monitored. If the storage capacity reaches a preset threshold, the storage strategy is adjusted to maintain data integrity. The power system operation information data recorder processes the collected power system operation information data to generate a dataset arranged in time series for subsequent transmission preparation.

[0038] In the preferred embodiment, the collected data is the CAN bus data of the power system; In the preferred embodiment, power system operation information data is acquired according to the acquisition frequency, and the acquired power system operation information data is categorized and stored in the storage device of the power system operation information data recorder, including: Based on the frequency of acquiring power system operation information, data streams including battery management and motor control are obtained from the power system of new energy ships. The obtained power system operation information data stream is categorized by date and time and stored in the high-performance hard drive of the power system operation information storage device; If data anomalies are detected during the classification process, the obtained power system operation information data stream is corrected to ensure storage accuracy. The total amount of data recorded and categorized by the power system operation information storage device is obtained, and the storage log is updated to support data backtracking.

[0039] In the preferred embodiment, the local storage device is a solid-state drive (SSD) with a capacity configured to store at least 20 days' worth of data.

[0040] In this embodiment, by using a preset high-frequency acquisition with a period of 100 milliseconds to capture data from the CAN bus of the power system, a leap in data acquisition density and quality is achieved. Compared with the traditional t-BOX scheme, the transient characteristics and microscopic changes of the power system are fully recorded, achieving ultra-high fidelity acquisition and reliable storage of power system data, and improving the integrity and accuracy of the data.

[0041] By classifying and storing data, monitoring and adjusting capacity, and using large-capacity solid-state drives as local storage media, a stable and reliable massive data buffer pool was built. This ensures that all high-frequency data can be stored completely, orderly, and securely during ship voyages, effectively addressing the risk of network interruption at sea and guaranteeing the continuity and integrity of data from the source.

[0042] In the preferred embodiment, a connection is established through the data transmission module, and the data stored in the power system operation information data recorder is transmitted in batches to the operation center, including: When a ship is docked at a pier, the power system operation information data transmission module detects the docking status and activates the ultra-long-range wireless bridge. The ultra-long-range wireless bridge obtains power system operation information, searches for and connects to the router in the operations center, and establishes a stable transmission channel. Based on the established transmission channel, the stored data is extracted from the power system operation information data recorder and sent to the power system operation information operation center at a preset transmission rate. If an interruption is detected during transmission, the connection is re-established and the remaining data is transmitted to ensure data continuity.

[0043] In this embodiment, by automatically establishing a connection and initiating batch data transmission only when the ship is docked at the pier, the fixed berthing period during ship operation is utilized, completely avoiding expensive mobile network traffic fees, significantly reducing data transmission costs, and improving economy and practicality.

[0044] In the preferred embodiment, based on the established transmission channel, the stored data is extracted from the power system operation information data recorder, and the power system operation information data is sent to the power system operation information operation center at a preset transmission rate, including: After confirming the stable connection of the power system operation information transmission channel, the stored data classified by time is extracted from the power system operation information data recorder. According to the preset transmission rate, the power system operation information storage data is sent in batches, and the transmission progress is monitored; If the transmission progress is slower than expected, adjust the transmission parameters to speed up data transmission; After the transmission is completed, verify the integrity of the stored power system operation information data and send a confirmation signal to the power system operation information operation center.

[0045] This embodiment establishes a stable transmission channel through an ultra-long-distance wireless bridge and automatically resumes transmission after interruption, ensuring high bandwidth and high reliability of data transmission in fixed scenarios. The batch transmission mechanism, combined with transmission progress monitoring and parameter adjustment, enables the efficient and complete uploading of tens of gigabytes of data in a short period of time (e.g., within one hour), solving the transmission problem caused by unstable mobile signals at sea.

[0046] In the preferred embodiment, the transmitted data is processed and analyzed by the data processing module to obtain the operating information of the power system, including: The power system operation information data processing module receives data transmitted from the power system operation information operation center and performs preliminary cleaning on the power system operation information data to remove invalid parts; Based on the cleaned data, a filtering operation is performed to extract key indicators related to the power system; The operating status of the power system is determined by analyzing key indicators of the power system's operating information. If the operating status of the power system exceeds the preset range, an early warning message is generated. By combining the obtained power system operation information and early warning information with the obtained power system operation status, a complete power system operation information is formed for system optimization.

[0047] In the preferred embodiment, the operating status of the power system is determined by analyzing key indicators of the power system's operating information. If the obtained operating status of the power system exceeds a preset range, an early warning message is generated, including: A pre-trained analytical model is applied to the key indicators of the obtained power system operation information to calculate the operation state values; If the obtained operating status value of the power system exceeds the preset range, a warning message of the corresponding level will be generated according to the degree of deviation. The system will associate early warning information about the operation of the power system with specific power system components and record and analyze the information in the logs. By iteratively updating the power system operation information analysis model, thresholds for key indicators of power system operation information are obtained to improve accuracy.

[0048] This embodiment transforms raw data into power system operation information that can be directly used for decision-making by performing cleaning, filtering, key indicator extraction and analysis on batch data in the operation center, including system status assessment and fault early warning.

[0049] By applying analytical models and dynamically updating thresholds, intelligent and precise diagnosis and early warning of the health status of the power system are achieved, enabling potential faults to be detected and dealt with in a timely manner, improving the management capability of the power system status, and thus significantly enhancing the reliability and operational safety of the power system of new energy ships.

[0050] Example 2 Further illustrating this with reference to Embodiment 1, a high-efficiency data transmission and storage system for a new energy ship power system, used to implement the method in Embodiment 1, includes: The data acquisition and storage module, deployed on new energy ships, includes a data logger and local storage devices, used for high-frequency acquisition and temporary storage of power system data.

[0051] The data transmission module includes an ultra-long-range WiFi bridge deployed on board and a router deployed in the operations center, used to establish communication links and transmit data when the ship is docked.

[0052] The data processing module, deployed in the operations center, is a big data platform used to receive, store, and process data transmitted from ships.

[0053] This embodiment provides a method for efficient data transmission and storage of new energy ship power systems. The working process, working details and technical effects can be found in Embodiment 1, and will not be repeated here.

[0054] The above embodiments are merely preferred technical solutions of the present invention and should not be considered as limitations on the present invention. The scope of protection of the present invention should be limited to the technical solutions described in the claims, including equivalent substitutions of the technical features described in the claims. That is, equivalent substitutions and improvements within this scope are also within the scope of protection of the present invention.

Claims

1. A method for efficient data transmission and storage of new energy ship power systems, characterized in that, Includes the following steps: Data generated by the new energy ship power system is acquired, and the data is collected at a preset high frequency through the data acquisition and storage module and stored in the data logger in real time. Based on the ship's berthing status, a connection is established through the data transmission module, and the data stored in the data recorder is transmitted in batches to the operations center. The data processing module processes and analyzes the transmitted data to obtain the operating information of the power system.

2. The method for efficient transmission and storage of data in a new energy ship power system according to claim 1, characterized in that, The process of acquiring and storing the data at a preset high frequency through the data acquisition and storage module and storing it in the data logger in real time includes: The data acquisition and storage module collects power system data from the new energy ship power system and determines the acquisition frequency to ensure data real-time performance. Data on the power system is acquired based on the acquisition frequency, and the power system data is categorized and stored in the storage device of the data logger; The storage capacity of the storage device is monitored, and if the storage capacity reaches a preset threshold, the storage strategy is adjusted to maintain data integrity. The data logger processes the collected power system data to generate a time-series dataset for subsequent transmission preparation.

3. The method for efficient transmission and storage of data in a new energy ship power system according to claim 1, characterized in that, The step of establishing a connection through the data transmission module and transmitting the data stored in the data logger in batches to the operation center includes: When a ship docks at a pier, the data transmission module detects the docking status and activates the ultra-long-range wireless bridge. The ultra-long-range wireless bridge searches for and connects to the router in the operations center to establish a stable transmission channel; Based on the established transmission channel, the stored data is extracted from the data logger and sent to the operation center at a preset transmission rate; If an interruption is detected during transmission, the connection is re-established and the remaining data is transmitted to ensure data continuity.

4. The method for efficient transmission and storage of data in a new energy ship power system according to claim 1, characterized in that, The process of processing and analyzing the transmitted data through the data processing module to obtain power system operating information includes: The data processing module receives data transmitted from the operation center and performs preliminary cleaning on the data to remove invalid parts; Based on the cleaned data, a filtering operation is performed to extract key indicators related to the power system; The operating status of the power system is determined by analyzing the key indicators. If the operating status exceeds the preset range, an early warning message is generated.

5. The method for efficient transmission and storage of data in a new energy ship power system according to claim 2, characterized in that, The step of acquiring the power system data according to the acquisition frequency and classifying and storing the power system data in the storage device of the data logger includes: For the aforementioned acquisition frequency, data streams including battery management and motor control are obtained from the new energy ship power system; The data stream is categorized by date and time and stored in the high-performance hard drive of the storage device; When data anomalies are detected during the classification process, the data stream is corrected. The storage device records the total amount of categorized data and updates the storage log.

6. The method for efficient transmission and storage of data in a new energy ship power system according to claim 5, characterized in that, The local storage device is a solid-state drive, and its capacity is configured to store at least 20 days' worth of data.

7. The method for efficient transmission and storage of data in a new energy ship power system according to claim 3, characterized in that, The step of retrieving stored data from the data logger according to the established transmission channel and sending the data to the operation center at a preset transmission rate includes: After the transmission channel confirms a stable connection, it extracts the stored data categorized by time from the data logger. The stored data is sent in batches according to a preset transmission rate, and the transmission progress is monitored. If the transmission progress is slower than expected, adjust the transmission parameters to speed up data transmission; After the transmission is completed, verify the integrity of the stored data and send a confirmation signal to the operations center.

8. The method for efficient transmission and storage of data in a new energy ship power system according to claim 4, characterized in that, The process involves analyzing key indicators to determine the operating status of the power system. If the operating status exceeds a preset range, an early warning message is generated, including: A pre-trained analysis model is applied to the key indicators to calculate the operating status values; If the operating status value exceeds the preset range, a warning message of the corresponding level will be generated according to the degree of deviation; The warning information is associated with specific power system components, and analysis logs are recorded. The thresholds of the key indicators are iteratively updated using the analytical model.

9. The method for efficient transmission and storage of data in a new energy ship power system according to claim 1, characterized in that, The collected data is CAN bus data from the power system.

10. A high-efficiency data transmission and storage system for new energy ship propulsion systems, suitable for implementing the method described in any one of claims 1 to 9, characterized in that, include: The data acquisition and storage module, deployed on new energy ships, includes a data logger and local storage devices, used for high-frequency acquisition and temporary storage of power system data; The data transmission module includes an ultra-long-range WiFi bridge deployed on board and a router deployed in the operations center, used to establish communication links and transmit data when the ship docks. The data processing module, deployed in the operations center, is a big data platform used to receive, store, and process data transmitted from ships.

Images