An automated terminal data center system and construction method

Abstract

The present invention relates to an automated terminal data center system and construction method, which solves the problem that the current automated terminal has multiple systems, scattered data, and is difficult to manage and call data in a unified manner. The system includes an automated terminal production flow module and a display module. The automated terminal production flow module includes stand-alone data, a real-time semi-structured database REDIS, a digital center structured database ORACLE, a terminal production database, and data processing; the display module includes front-end correction, a structured correction data table, and a display interface. The automated terminal data center construction method includes collecting real-time stand-alone data of the automated terminal, single-machine data conversion, single-machine data writing, single-machine data structured persistent storage, production business data collection, structured data correction, obtaining video streaming data, and data acquisition and display.

Description

Technical Field

[0001] The present application relates to the field of automated terminal data processing, and in particular to an automated terminal data center system and construction method. Background Art

[0002] In recent years, the degree of automation and intelligence has become an important indicator for measuring the competitiveness of ports. In order to seize the "smart" high point and compete in the "new track", major ports have seized the opportunity of the development of the digital economy, actively promoted the construction of smart ports, and led the development of global port intelligence. The construction of intelligent automation will transform the traditional port transformation mode that originally required reservation, pre-setting, and pre-installation from offline to online, and a large number of supporting production systems will appear. The digital center platform has become an indispensable part of each automated terminal.

[0003] The commonly used solution at present is: batch processing + scheduled collection, that is, the data of scattered sub-services is processed by the main service and then collected and stored in the data center at a scheduled time. The collection methods are divided into: calling the collection through the RESTFUL interface provided by the sub-service, the main service calls the RESTFUL interface provided by the sub-service to obtain data and save it to the digital center; data synchronization is performed through ETL tools, and the database synchronization tool synchronizes the sub-service database data to the digital center at a scheduled time; sub-service data collection is realized through MQ middleware, and the sub-service transmits the data to MQ and pushes it to the main service for collection in the data center. Summary of the invention

[0004] The present invention aims to overcome at least one defect of the above-mentioned prior art and provide an automated terminal data center system and construction method to solve the problem that the current automated terminals have multiple systems, scattered data, and difficulty in unified management and call of data.

[0005] In one aspect, the present invention provides an automated terminal data center system, the system comprising an automated terminal production flow module and a display module;

[0006] The automated terminal production flow module includes:

[0007] Stand-alone data, which is composed of multiple terminal subsystems and data generated by the interaction between the multiple terminal subsystems. The stand-alone data is real-time semi-structured data;

[0008] Real-time semi-structured database REDIS, used to implement real-time semi-structured data caching;

[0009] The digital center structured database ORACLE is used to implement the caching of structured data;

[0010] The terminal production database includes data generated by the intelligent system supporting the automated terminal and stored in a structured database, wherein the terminal production database is used to store structured data;

[0011] Data processing, which is used to convert real-time semi-structured data into persistent structured data. By setting a timing frequency, real-time semi-structured data is converted and stored;

[0012] The display module comprises:

[0013] Front-end correction, by checking and verifying the data content;

[0014] Structured correction data table, including ship record correction table, terminal departure container correction table, terminal customer correction table. The data in the correction table is used for display;

[0015] In the display interface, the real-time semi-structured data is directly displayed by calling the real-time semi-structured database REDIS, and the structured data is directly displayed by calling the structured modified data table.

[0016] On the other hand, the present invention also provides a method for constructing an automated terminal data center, the method comprising:

[0017] Collect real-time stand-alone data of automated terminals and integrate real-time stand-alone point data;

[0018] Single-machine data conversion, building a standard API interface;

[0019] Standalone data writing: By configuring the task scheduler to periodically call the standard API interface in the standalone data conversion to obtain the standalone real-time data, connect to the real-time semi-structured database REDIS, and store the data in REDIS. The task scheduler is used to uniformly control and adjust the frequency of data acquisition;

[0020] The single-machine data is structured and persistently stored, and the information of the automated quay crane, automated rail crane, and automated intelligent guided vehicle is converted and stored in the digital center structured database ORACLE;

[0021] Production business data collection, the automated terminal system includes TOS system, billing system, dispatching system, and customer system. The data generated by each system is integrated and stored in a structured database, and synchronized to the digital center structured database ORACLE;

[0022] Correction of structured data: set process functions in the structured database ORACLE of the digital center to delete duplicate data, and take the TOS system data as the standard;

[0023] Get video stream data;

[0024] Data acquisition and display: connect to the digital center structured database ORACLE, obtain the digital center structured data correction table to obtain data for statistical analysis; connect to the real-time semi-structured data REDIS to obtain real-time single-machine data for display and status detection; connect to the digital center structured database ORACLE to obtain single-machine equipment historical data for display and trajectory playback; the large screen obtains the video stream through the standard API interface provided by the digital center and plays it on the front end.

[0025] The technical effects produced by the present invention include:

[0026] 1. The frequency of data acquisition is uniformly controlled by the digital center and can be reasonably adjusted according to business needs and system operation conditions.

[0027] 2. The stand-alone data of the automation equipment is synchronized to the REDIS semi-structured database in the data center. The display program and other systems can directly obtain the real-time data of the stand-alone machine through REDIS, avoiding a large number of real-time data acquisition calls that may cause the automation equipment to freeze or malfunction.

[0028] 3. Produce structured data to store raw data, and then use system automatic cleaning and manual correction to ensure data reliability and traceability of abnormal data.

[0029] 4. Integrate real-time semi-structured data and production structured data and store them in the digital center for unified calling by display programs or other systems to avoid system anomalies caused by direct system requests. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 This is a schematic diagram of the production flow module of the present invention;

[0031] Figure 2 This is a schematic diagram showing a module of the present invention;

[0032] Figure 3 The present invention is a flow chart of a method for constructing an automated terminal data center.

[0033] The accompanying drawings of the present invention are marked as follows: 1: single machine data; 2: real-time semi-structured database REDIS; 3: data processing; 4: terminal production database; 5: digital center structured database ORACLE; 6: video streaming. DETAILED DESCRIPTION

[0034] The drawings of the present invention are only for illustrative purposes and should not be construed as limiting the present invention. In order to better illustrate the following embodiments, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product; it is understandable to those skilled in the art that some well-known structures and their descriptions in the drawings may be omitted.

[0035] A large amount of production business data is generated in automated terminals. The correct use and rational utilization of data is the key to analyzing problems and improving efficiency in automated terminals. However, there are many systems and scattered data in automated terminals, which makes it difficult to manage and call data in a unified manner. At the same time, automated terminals need to ensure the normal operation of automated equipment in production, and a large number of concurrent acquisitions of single-machine equipment data will cause single-machine program jams and downtime.

[0036] To solve the above problems, this embodiment provides an automated terminal data center system, such as Figure 1 and Figure 2 , the system includes an automated terminal production flow module and a display module;

[0037] The automated terminal production flow module includes:

[0038] Stand-alone data 1, the stand-alone data 1 is composed of multiple terminal subsystems and data generated by the interaction between the multiple terminal subsystems, and the stand-alone data 1 is real-time semi-structured data;

[0039] Real-time semi-structured database REDIS2, used to implement real-time semi-structured data caching;

[0040] The digital center structured database ORACLE5 is used to cache structured data;

[0041] The terminal production database 4 includes data generated by the intelligent system supporting the automated terminal and stored in a structured database, and the terminal production database 4 is used to store structured data;

[0042] Data processing 3, used to convert real-time semi-structured data into persistent structured data, and convert and store real-time semi-structured data by setting a timing frequency;

[0043] In some embodiments, the automated terminal production flow module includes:

[0044] Single-machine data 1: The automated terminal includes multiple terminal subsystems, including automated quay cranes, automated rail cranes, and automated intelligent guided vehicles. These terminal subsystems will generate a lot of single-machine equipment data during operation, such as the position information obtained by the automated quay crane during operation through the positioning system, the moving speed information obtained by the speed sensor, the descending height of the robot arm during operation, the grab and release mark, etc. PLC data collection is performed through sensors, input and output modules, etc., to collect equipment point information, and monitor and record various parameters and states in the production process in real time. Then, the PLC data of multiple single-machine devices is collected through OPC, and after centralized integration, the operating parameters and states of the same type of equipment are monitored in real time. During operation, the automated rail crane will also collect information such as the position, height, lifting weight, and whether it is locked based on sensors, weighing instruments, and other equipment; the automated intelligent guided vehicle (abbreviated as "IGV"), due to its automatic driving, also needs to collect information such as the path, destination, and driving method in real time. Not only does the terminal subsystem generate a lot of data itself, but there will be interactions between the terminal subsystems. For example, the arrival of the automated intelligent guided vehicle at the destination and the time will provide feedback to the automated rail crane. In this way, the automated rail crane can accurately know the location of the automated intelligent guided vehicle. The automated intelligent guided vehicle also needs the automated rail crane to confirm whether it is unlocked before it packs and leaves.

[0045] Single-machine data 1 acquisition service: You can use a data collection program developed in Java to create an OPC connection, read the point information in OPC, and integrate it into JSON format data in the collection program, for example, {"EQUIP_CODE":"QC101","TAG1":"SLand","TAG2":"CtrlOn"...}. The call frequency of the single-machine data 1 acquisition service is set by the QUARTZ task scheduling library integrated in the digital center program. The scheduled scheduling time for obtaining different OPC data can be configured in the digital center program according to the characteristics of the single-machine device. After the single-machine data 1 acquisition service collects and integrates the single-machine data 1, it connects to the REDIS database through Jedis and writes it to the real-time semi-structured database REDIS2. The number of the single-machine device is set as KEY. Each time the same single-machine device data is obtained, the previous data content will be overwritten to ensure that the single-machine data 1 in the real-time semi-structured database REDIS2 is the latest real-time data.

[0046] Real-time semi-structured database REDIS2: The number of the single-machine device is set as the KEY to store semi-structured data. The single-machine data 1 is acquired in a shorter time through a scheduled task to achieve real-time semi-structured data caching.

[0047] Scheduled tasks: The QUARTZ task scheduling library integrated into the digital center program can set interfaces or functional services for scheduled calls.

[0048] Data processing 3: Through the real-time semi-structured data conversion to persistent structured data function in the developed digital center program, the program connects to REDIS through Jedis, and the QUARTZ task scheduling library integrated in the digital center program sets the timing frequency to convert and store some real-time semi-structured data. For example, the historical path information of the intelligent guided vehicle is stored, and the corresponding entity class is set. The real-time semi-structured data is converted into structured data according to the entity class and connected to the ORACLE database through JDBC to store the structured data persistently.

[0049] Production database: data generated by the intelligent system supporting the automated terminal and stored in a structured database.

[0050] KETTLE: ETL tool, a tool for synchronizing structured databases. Through the KETTLE tool, the production database and the digital center structured database ORACLE5 are connected, the field mapping of the source table and the destination table is set, and then the scheduled tasks are set through the QUARTZ task scheduling library integrated with the digital center program. KETTLE is called regularly to synchronize the production database data to the digital center structured database ORACLE5.

[0051] Video stream acquisition 6: Get the real-time stream address of the surveillance camera through the SDK. Use the SDK to obtain the real-time stream address of the surveillance camera in RTSP format by writing a program. If you add cameras from different manufacturers later, use this solution to acquire the stream.

[0052] In this embodiment, a display module is also mentioned, including:

[0053] Front-end correction, by checking and verifying the data content;

[0054] Structured correction data table, including ship record correction table, terminal departure container correction table, terminal customer correction table. The data in the correction table is used for display;

[0055] In the display interface, the real-time semi-structured data directly calls the real-time semi-structured database REDIS2 for display, and the structured data directly calls the structured modified data table for display.

[0056] In some embodiments, other applications or programs can connect to the digital center structured database ORACLE5 through JDBC to obtain data for use, connect to the real-time semi-structured database REDIS2 through Jedis to obtain data for use, and obtain video surveillance data through the standard API interface provided by the digital center program.

[0057] Real-time semi-structured database REDIS2: By accurately and regularly acquiring the real-time data of a single machine and overwriting the content each time using the device number as the primary key, the timeliness and uniqueness of the single-machine data 1 in the real-time semi-structured database REDIS2 are guaranteed. The demonstration program connects to the real-time semi-structured database REDIS2 through Jedis to obtain data for use.

[0058] Production database: data generated by the intelligent system supporting the automated terminal and stored in a structured database.

[0059] Structured data source table: Data synchronized through the KETTLE tool are all original data, that is, the data format and content synchronized from the production database are consistent with the data before synchronization. However, the uncleaned and unprocessed data contains abnormal, redundant, and worthless data, which needs to be processed.

[0060] Processing rules: For some regular abnormal and redundant data generated by production databases, the data is cleaned and processed by setting ORACLE stored procedures, ORACLE triggers or digital center processing functions, and then stored in the revised data table. The data in the source data table will not be deleted immediately after processing. A certain retention time is set according to server resources and data size to solve the possible data loss after data processing 3 or the basis for data tracing.

[0061] Front-end correction: The data corrected by the established procedures can be displayed on the front-end, and the data content can be manually checked and verified. If abnormal data is found, the content can be adjusted through more intuitive front-end data check or more flexible SQL conditional statements. When data is adjusted incorrectly, the source data can be processed again through the rules to generate new corrected data and overwrite the incorrectly adjusted data.

[0062] Structured correction data table: It is the name of a type of table, which is different from the source table, such as the ship record correction table, the terminal departure container correction table, and the terminal customer correction table. The data in the correction table has been processed and can be provided to other programs or applications for display and use. Create a display user to grant the structured correction data table query permission. Other programs can directly connect to the display user of the correction data table through JDBC to obtain production structured data, or obtain data through the standard API interface provided by the digital center program.

[0063] Preferably, the single-machine data 1 includes data generated during the operation of an automated quay crane, an automated rail crane, and an automated intelligent guided vehicle, and the data during the operation of the automated terminal is acquired in real time through a collection device.

[0064] Preferably, the system also includes video stream 6 data, which is obtained by acquiring the real-time stream address of the surveillance camera, and the video stream 6 can be directly displayed.

[0065] In some embodiments, a method for constructing an automated terminal data center is proposed, comprising:

[0066] Collect real-time stand-alone data of automated terminals 1 and integrate real-time stand-alone point data;

[0067] Single machine data 1 conversion, building a standard API interface;

[0068] The stand-alone data 1 is written by configuring the task scheduler to periodically call the standard API interface in the stand-alone data 1 conversion to obtain the stand-alone real-time data, connect to the real-time semi-structured database REDIS2, and store the data in REDIS. The task scheduler is used to uniformly control and adjust the frequency of data acquisition;

[0069] Single machine data 1 structured persistent storage, converting and storing the information of automated quay cranes, automated rail cranes, and automated intelligent guided vehicles into the digital center structured database ORACLE5;

[0070] Production business data collection, the automated terminal system includes TOS system, billing system, dispatching system, and customer system. The data generated by each system is integrated and stored in a structured database, and synchronized to the digital center structured database ORACLE5;

[0071] Correction of structured data: set process functions in the digital center structured database ORACLE5 to delete duplicate data, and take the TOS system data as the standard;

[0072] Get video stream 6 data;

[0073] Data acquisition and display: connect to the digital center structured database ORACLE5, obtain the digital center structured data correction table to obtain data for statistical analysis; connect to the real-time semi-structured database REDIS2 to obtain real-time stand-alone data 1 for display and status detection; connect to the digital center structured database ORACLE5 to obtain stand-alone equipment historical data for display and trajectory playback; the large screen obtains the video stream 6 through the standard API interface provided by the digital center and plays it on the front end.

[0074] Preferably, the data transmission method in the method adopts 5G private network wireless transmission. Intelligent management of automated terminals is a trend, and 5G private networks can provide automated terminals with wide coverage, low latency, and high bandwidth services.

[0075] Preferably, the display further includes a push template for pushing the display content to a specific interface end.

[0076] Preferably, the data storage in the method includes a disaster recovery system for backing up the data of the automated terminal data center.

[0077] In some embodiments, a method for proposing an automated terminal digital center is provided, comprising:

[0078] Single-machine data collection 1: The automated terminal system is equipped with corresponding OPC services to integrate the real-time single-machine point data of automated equipment, including the GPS position, speed, direction, coordinates of automated equipment, the pitch angle of the boom of automated lifting equipment, the offset distance of the trolley, the rotation angle of the base, fault code, status and parameters, etc.

[0079] Stand-alone data 1 conversion: Integrate the point information of the OPC service into JSON format data through program development, and build a standard API interface to provide stand-alone real-time data for the digital center platform.

[0080] Task Scheduler: The digital center program integrates the QUARTZ task scheduling library, which can configure scheduled tasks with different strategies and bind calling tasks. It is used for unified control and flexible adjustment of the frequency of data acquisition.

[0081] Stand-alone data 1 writing: By configuring the task scheduler, the standard API interface in the stand-alone data 1 conversion is called regularly to obtain the stand-alone real-time data, and the real-time semi-structured database REDIS2 is connected through Jedis, and the data is stored in REDIS.

[0082] Stand-alone data 1 structured persistent storage: The time, location, coordinates, direction, speed and other information of the automated equipment intelligent guided vehicle are converted into Java entity classes and stored in the digital center structured database ORACLE5 to store the historical path records of the intelligent guided vehicle.

[0083] Production business data collection: The automated terminal system is equipped with various system programs, such as TOS system, billing system, dispatching system, etc. The system will generate task records, instruction records, on-site containers, ship berthing and departure records, etc. These records will be stored in a structured database. Because the structured data of different systems are stored in different databases, they need to be collected and integrated into the same database to facilitate data mining, analysis and use. The digital center platform uses the KETTLE tool to connect the system structured database of the automated terminal and the digital center structured database ORACLE5, and synchronize the data of the supporting system to the digital center structured database ORACLE5.

[0084] Structured data correction: Set up process functions in the digital center structured database ORACLE5 to delete duplicate data such as the same customer code, ship information, and order information in the TOS system and the billing system, and use the TOS system data as the standard. The corrected data can be displayed on the front end and checked and verified by data analysts. If abnormal or unreasonable data appears, it can be deleted and adjusted on the front end or corrected using SQL data.

[0085] Video stream acquisition 6: Get the real-time stream address of the surveillance camera through a third-party SDK. Write a Java program using Hikvision's official SDK to get the real-time stream address of the Hikvision surveillance camera in RTSP format.

[0086] Data acquisition and display: The terminal statistics system connects to the digital center structured database ORACLE5 through JDBC, obtains data from the digital center structured data correction table for statistical analysis; the GIS system connects to the real-time semi-structured database REDIS2 through Jedis to obtain real-time stand-alone data 1 for display and status detection, and connects to the digital center structured database ORACLE5 through JDBC to obtain stand-alone equipment historical data for display and trajectory playback, etc.; the large screen obtains the video stream 6 in RTSP format through the standard API interface provided by the digital center and plays it on the front end.

[0087] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the technical solution of the present invention, and are not intended to limit the specific implementation methods of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the claims of the present invention shall be included in the protection scope of the claims of the present invention.

Claims

1. An automated terminal data center system, characterized in that: The system includes an automated terminal production flow module and a display module; The automated terminal production flow module includes: Stand-alone data, which is composed of multiple terminal subsystems and data generated by the interaction between the multiple terminal subsystems. The stand-alone data is real-time semi-structured data; Real-time semi-structured database REDIS, used to implement real-time semi-structured data caching; The digital center structured database ORACLE is used to implement the caching of structured data; The terminal production database includes data generated by the intelligent system supporting the automated terminal and stored in a structured database, wherein the terminal production database is used to store structured data; Data processing, which is used to convert real-time semi-structured data into persistent structured data. By setting a timing frequency, real-time semi-structured data is converted and stored; The display module comprises: Front-end correction, by checking and verifying the data content; Structured correction data table, including ship record correction table, terminal departure container correction table, terminal customer correction table. The data in the correction table is used for display; In the display interface, the real-time semi-structured data is directly displayed by calling the real-time semi-structured database REDIS, and the structured data is directly displayed by calling the structured modified data table.

2. The automated terminal data center system according to claim 1, characterized in that: The single-machine data includes data generated during the operation of the automated quay crane, automated rail crane, and automated intelligent guided vehicle, and the data during the automated terminal operation is obtained in real time through a collection device.

3. The automated terminal data center system according to claim 1, characterized in that: The system also includes video stream data, which is obtained by acquiring the real-time stream address of the surveillance camera, and the video stream can be directly displayed.

4. A method for constructing an automated terminal data center, characterized in that: The method comprises: Collect real-time stand-alone data of automated terminals and integrate real-time stand-alone point data; Single-machine data conversion, building a standard API interface; Standalone data writing: By configuring the task scheduler to periodically call the standard API interface in the standalone data conversion to obtain the standalone real-time data, connect to the real-time semi-structured database REDIS, and store the data in REDIS. The task scheduler is used to uniformly control and adjust the frequency of data acquisition; The single-machine data is structured and persistently stored, and the information of the automated quay crane, automated rail crane, and automated intelligent guided vehicle is converted and stored in the digital center structured database ORACLE; Production business data collection, the automated terminal system includes TOS system, billing system, dispatching system, and customer system. The data generated by each system is integrated and stored in a structured database, and synchronized to the digital center structured database ORACLE; Correction of structured data: set process functions in the structured database ORACLE of the digital center to delete duplicate data, and take the TOS system data as the standard; Get video stream data; Data acquisition and display: connect to the digital center structured database ORACLE, obtain the digital center structured data correction table to obtain data for statistical analysis; connect to the real-time semi-structured database REDIS to obtain real-time single-machine data for display and status detection; connect to the digital center structured database ORACLE to obtain single-machine equipment historical data for display and trajectory playback; the large screen obtains the video stream through the standard API interface provided by the digital center and plays it on the front end.

5. The method for constructing an automated terminal data center according to claim 4, characterized in that: The stand-alone data conversion is achieved by integrating the point information into JSON format data.

6. The method for constructing an automated terminal data center according to claim 4, characterized in that: The production business data collection uses the KETTLE tool to connect the system structured database of the automated terminal and the digital center structured database ORACLE through the digital center platform, and synchronizes the data of the supporting system to the digital center structured database ORACLE.

7. The method for constructing an automated terminal data center according to claim 4, characterized in that: The video stream acquisition obtains the real-time stream address of the surveillance camera through the SDK, and uses the SDK to obtain the real-time stream address of the surveillance camera in RTSP format.

8. The method for constructing an automated terminal data center according to claim 4, characterized in that: In the method, data transmission adopts 5G private network wireless transmission.

9. The method for constructing an automated terminal data center according to claim 4, characterized in that: The presentation also includes a push template for pushing presentation content to a specific interface end.

10. The method for constructing an automated terminal data center according to claim 4, characterized in that: The data storage in the method includes a disaster recovery system for backing up the data of the automated terminal data center.

Images