Automated field bridge real-time monitoring system and method for customs intelligent monitoring

Abstract

The present invention discloses an automated yard bridge real-time monitoring system and method for customs intelligent monitoring. The equipment master PLC of the present invention is connected to the CMC PLC, the customs monitoring data platform includes the customs supervision data platform, terminal aggregation switch, customs monitoring system core switch, and independent OCR monitoring system connected in sequence, the customs monitoring system core monitor is connected to the customs monitoring system core switch, and the data exchange interface network The data interaction switch is connected to the customs monitoring system core switch; the customs monitoring terminal system includes the customs monitoring system video core processor, the customs monitoring system video data switch, and the MVR hard disk burner are connected in sequence, and the customs monitoring system video data switch is respectively connected to the top panoramic camera and the box number collection camera. The expansion and optimization of the present invention in the field of automated port machinery provides technical practice and innovative ideas, and realizes a standardized technical solution that is reproducible and promotable.

Description

Technical Field

[0001] The present invention relates to the field of network interconnected multi-data fusion, and more specifically, to a real-time monitoring and acquisition system for operation data based on an ARTG automated yard mode. Background Art

[0002] In recent years, as container business has become more and more extensive, customs has put forward more stringent requirements in the loading and unloading of import and export goods, strengthened supervision, and required real-time supervision of container terminal operation data, which must be set up independently from the production operation system. On the one hand, it is to avoid mutual interference with terminal production operations, and on the other hand, it is also for the confidentiality and accuracy of customs supervision of operation data. Operation monitoring data is mainly for operations within the yard, that is, monitoring of yard crane operations. It is necessary to take photos of the key positions of the hoisted containers, and at the same time, it is necessary to perform visual analysis and processing on the photos, extract the container number, and store the photos. At the same time, it is necessary to compare the location of the operating container in the yard with the information of the terminal production operation system through photos and store the photos. Finally, these operation data information are integrated through the statistical platform and regularly transmitted to the remote customs supervision platform through an independently set up network.

[0003] The system for real-time monitoring of container terminal operation data has an independent camera data acquisition system, including a video control core server, a camera video acquisition switch, a video hard disk recorder NVR, etc. The video control core server requires the signal of the field bridge PLC as a trigger and control signal.

[0004] The above system is relatively easy to implement for conventional manually operated yard cranes. The operating image data is collected and stored through the trigger camera of the PLC processor on the equipment, and the data is integrated through the data of box number recognition. Finally, the operating information is compared with the operating data in the TOS information, and all the data are summarized and compressed and transmitted back to the customs monitoring platform through the established industrial Ethernet.

[0005] However, for the automated field bridge, because the existing remote automated control system has been deployed, and the new customs operation data monitoring system needs to interact with the system, it is also necessary to ensure that the two systems do not affect each other, especially the automated remote system because it contains more control and security protection control processes. Once affected, there will be certain safety hazards. The need for the automated field bridge remote control system to set up a customs operation monitoring system lies in the data interaction and integration between the two independent network systems and the compatibility of the separation and security; the customs system needs to interact and confirm some PLC control information with the automated field bridge remote control system. Summary of the invention

[0006] The main purpose of the present invention is to design a real-time monitoring and collection system for operation data under the ARTG automated yard mode in response to the above-mentioned problems, and in particular to the application expansion and integration of network structures that are independent of each other and have data interaction under the existing automated yard network architecture mode, especially when two related systems need control logic for data interaction.

[0007] The present invention is used for the real-time monitoring system of automated field bridge operation for customs intelligent monitoring, which is composed of the following main components: an automated field bridge PLC network and a data exchange interface network, wherein the equipment master PLC of the automated field bridge PLC network is connected to the CMC PLC of the data exchange interface network, including a customs monitoring data platform and a customs monitoring terminal system, wherein the customs monitoring data platform includes a customs supervision data platform, a terminal aggregation switch, a customs monitoring system core switch, and an independent OCR monitoring system connected in sequence, wherein the customs monitoring system core monitor is connected to the customs monitoring system core switch, and the data interaction switch of the data exchange interface network is connected to the customs monitoring system core switch; the customs monitoring terminal system includes a customs monitoring system video core processor, a customs monitoring system video data switch, and an MVR hard disk recorder connected in sequence, and the customs monitoring system video data switch is respectively connected to a small vehicle frame camera and an OCR camera;

[0008] The automated field bridge PLC network includes equipment drive and control system and equipment remote control system network; the equipment drive and control system is data fused by the equipment master PLC and the slave PLC control system, and through the equipment master PLC and the drive inverter drive converter, the PLC controls the inverter of the main motion mechanisms such as hoisting, trolley and car, and the inverter drives the motor of each mechanism to achieve movement in different directions. At the same time, the data is transmitted back to the PLC through the detection devices such as real-time detection encoders installed on the moving parts of each mechanism, so as to realize closed-loop data control; the equipment remote control system network is driven by the remote control core PLC network through the equipment master PLC to control the TCP / IP communication interface and ACCS server; the equipment data monitoring system and CMS data interaction interface

[0009] The data exchange interface network is composed of CMS network, data exchange switch and TCP / IP conversion interface. The CMS network includes CMS data conversion platform and CMS PLC. The RCMS system platform and LCMS system platform are respectively linked to the CMS data conversion platform. The data exchange switch is connected to the CMS data conversion platform. The TCP / IP communication interface is connected to the CMS PLC.

[0010] The customs monitoring data platform consists of the customs monitoring system core switch, the customs monitoring system core controller, the independent OCR monitoring system, the terminal aggregation switch and the customs supervision data platform. The equipment-related data obtained through the CMS PLC and the independent OCR data information are aggregated through the customs monitoring system core switch and managed by the core controller. The relevant data of the real-time operation is collected and integrated, and each operation information is summarized;

[0011] The customs monitoring terminal system includes a video core control processor, a video data switch and an NVR hard disk recorder connected in sequence. The video data switch is connected to multiple cameras. The video core control processor is the control core of the video acquisition system, the NVR hard disk recorder is used to record and store video data, and the video data switch functions to aggregate and collect video data from installed cameras.

[0012] The top panoramic camera is installed on the top of the automated yard bridge trolley and uses a wide-angle camera. The container number collection camera is installed on the side door leg of the lane to shoot the lane direction and the side container number position of the corresponding container load for use by the OCR collection system.

[0013] The working method of the above-mentioned automated yard bridge operation real-time monitoring system for customs intelligent monitoring is carried out according to the following steps:

[0014] A. Target box information collection: The PLC data is used to obtain the spreader locking signal, and the yard crane successfully grabs the box. At this time, the real-time data of the trolley and lifting encoder is further read through the PLC data, and the position of the spreader is analyzed to obtain the position of the spreader, thereby obtaining the position information of the target box for the operation; according to the position of the spreader at this time, it is judged whether the target box is in the container area or on the towing lane side. If it is on the towing lane side, the trolley camera is used to capture the front of the vehicle; if it is on the container area side, the two cameras on the top of the trolley are used to capture the target position of the operation box area; if it is on the towing lane side, the OCR recognition system installed on the yard crane door leg is used to identify the container number, and the data is compared with the operation information; finally, the following data information is collected and integrated into the target operation information, including: panoramic image of the target container area, lane side photos, and target container number information;

[0015] B. Collection of operation information related to the destination location: As the lifting and trolley in the collected PLC data move long distances and pass the instruction layer data verification, the target box data collection is completed, and the information collection is activated after the next instruction is completed; when the spreader unlocking signal is detected, and the lifting distance exceeds 3 meters through the analysis of the lifting encoder data, the yard crane successfully releases the box; further read the real-time data of the trolley and lifting encoder during the spreader unlocking action through PLC data, and analyze the location of the spreader to obtain the operation destination site information; according to the position of the spreader at this time, it is determined whether the destination site is in the container area or on the towing lane side; if it is on the towing lane side, the trolley camera captures the front of the vehicle; if it is on the container area side, the two cameras on the top of the trolley capture the target position of the operation box area; if it is on the towing lane side, the container number is identified by the OCR recognition system installed on the yard crane door leg, and the data is compared with the operation information; the final collected data includes: panoramic image of the target container area, lane side photos, and target container number information;

[0016] C. Post-collection data integration: After the target box operation information and the destination site operation information data are collected, the relevant data will be intelligently checked and compared with the TOS instruction information. If any abnormality occurs, manual intervention will be performed, and the final data will be transmitted to the customs operation monitoring platform in the form of a list for real-time storage and access at any time;

[0017] D. Data acquisition signal description:

[0018] (1) Target box data collection: When the spreader completes the box grabbing operation and the lifting action exceeds 3 meters, it is considered that the target box is grabbed successfully. At this time, the collection of relevant video data begins, relying on the two foreground cameras on the top of the trolley to capture;

[0019] (2) Destination location operation information collection: Similar to the target box data collection process, when the spreader completes the box placement and the lifting action exceeds 3 meters, the box placement is considered successful. At this time, the panoramic camera on the top of the trolley captures the situation of the destination box position;

[0020] (3) When the box grabbing or box placing signal is triggered, the captured photo data is used for OCR box number recognition to form an operating box or complete box number information collection;

[0021] (4) Multi-dimensional data collection on the towing lane side

[0022] Through PLC data sampling, when the trolley is on the towing lane, after the opening and closing actions are completed, the panoramic capture lens on the top of the trolley is started to capture the towing lane in order to record the situation on the towing lane, especially the trailer situation, and record it;

[0023] (5) Collection of relevant bay level calculation data

[0024] When the movement distance of the trolley or lifting position is detected in the PLC and the opening and closing signal is triggered, the PLC will read the trolley and lifting position and calculate the position information such as the working box position. This information will be compared and verified with the information after image analysis, and finally approved with the TOS instruction information.

[0025] The real-time monitoring system of automated yard bridge operations for intelligent monitoring by customs can be divided into three major components according to functional modules, including: an independent operation identification and operation data collection system, an edge algorithm intelligent data collection platform, and an intelligent fusion basic data integration system.

[0026] An independent operation identification and data acquisition system is set up, which is based on the equipment basic control PLC data, video technology and industrial visual dynamic analysis technology, and has intelligent analysis and storage functions. It mainly includes two parts of data acquisition, one is based on video technology and industrial visual dynamic analysis technology, and the other is the equipment basic electric control PLC data. Video data can record the container position of the yard crane operation based on the yard location information, intelligently identify the container number of the operation, and organize and store it in combination with the three-dimensional data of the yard location information. The equipment basic electric control PLC data, that is, the basic data of the electric control, such as obtaining the real-time data of the trolley and the lifting mechanism by collecting the encoder data of different mechanisms to provide basic data information for the operation acquisition system, mainly from the PLC mainly recording multiple encoder data and lifting height, trolley absolute position, sling opening and closing action and status data. It is particularly noted that the independent operation identification system does not rely on the statistical and detection data of the existing automated yard crane system, and is independently deployed; data calculations are performed through the basic electric control information such as the encoder in the redundant yard crane electric control logic such as visual analysis technology and GPS positioning information of the trolley. And it has an independent OCR data recognition system.

[0027] An intelligent data collection and transmission platform based on the edge algorithm logic of terminal data processing; in order to reduce the network resources occupied by the customs data platform system, the data collection system adopts data processing on the yard bridge side, intelligently integrates the operation image photos, location information, container number collection data and identification data, forms a data table and transmits it back in real time according to the customs platform remote data transmission protocol. It is also summarized at the remote end and compared with TOS information to form a database for backup and filing.

[0028] This functional module mainly performs calculations on the field bridge equipment side, and classifies and calculates the video data and the basic equipment data. It uses dual-channel independent data links to perform calculation logic, and performs mutual data verification. The calculation results are summarized and packaged and then transmitted to the remote customs data platform, namely the fusion data compatible system.

[0029] The video data is integrated, and the operation information such as the stacking box, box number and vehicle number in the yard is deduced through visual analysis technology, and integrated and analyzed with TOS data at the remote end. For the basic data information of the equipment, this is calculated through the collected original control data of the equipment to obtain the operation position, field position and other information, and the field map information is preliminarily verified with the video analysis data, and the verification results are summarized at the remote end.

[0030] The intelligent and integrated basic data integration system integrates the data collected at the time and the data preliminarily calculated by the local edge and archives them for customs inspection. This part is basically completed in the remote data platform, mainly to compare all the data information of the operation with the TOS operation instruction information intervened remotely and store them in groups to form a complete operation list data, which is convenient for customs to monitor and track in real time. A complete network security protection mechanism is configured in the data transmission, and the security and stability of information transmission are fully considered.

[0031] The present invention realizes data interaction and clever data isolation by performing data interaction through the CMS PLC configuration network. In the basic electric control and automation control configuration of the field bridge, the network configuration of the CMS exists independently and does not participate in the equipment control system. The master PLC realizes data interaction with the CMS network configuration through the basic electrical communication protocol inside the PLC, and through the planning of the PLC electric control, only the CMS network is allowed to read the master PLC, while the port for writing parameters is shielded. The operation acquisition system of the intelligent data acquisition and transmission platform only reads data from the CMS network, and the operation acquisition system realizes the function of reading PLC data and cannot affect the control logic of the main control unit.

[0032] The beneficial effects of the present invention are:

[0033] The present invention is to expand and upgrade the existing automation network and electric control system, and there is mutual fusion and separation of independent networks, and there is also mutual interaction and fusion of PLC data. It has been exploratory practice and application in the expansion and compatibility of different networks, especially based on PLC data interaction, and has far-reaching significance. Technical accumulation and attempts have been made for the expansion of automated port machinery systems.

[0034] The customs monitoring system of the present invention is an independent operation data monitoring system, which innovatively adopts video acquisition and intelligent image compression, integrates OCR technology, and integrates the data interaction of the electric control PLC system to conduct a new attempt to collect the operation system. The present invention compares and verifies the three-dimensional positioning system of the operation box position through video technology and equipment parameters, and reduces the impact on network transmission bandwidth by optimizing data processing.

[0035] The present invention particularly relates to the expansion and integration of network structures that are compatible and independent of each other and have data interaction under the existing automated yard network architecture mode, especially when two related systems need control logic for data interaction. In short, by optimizing the design of different networks, the upgrade and optimization of the automated network is achieved, and technical practice and innovative ideas are provided for the expansion and optimization in the field of automated port machinery, and a standardized technical solution that is replicable and scalable is achieved. In particular, in the reading and integration of PLC system data, a new integration concept and idea is provided on the premise of ensuring the independence and security of different systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 Schematic diagram of the installation location of the automated field bridge and camera;

[0037] Figure 2 Schematic diagram of camera structure;

[0038] Figure 3 Schematic diagram of the composition of the real-time monitoring system;

[0039] Figure 4 Logic diagram of data collection and calculation in the detection system. DETAILED DESCRIPTION

[0040] The present invention will be further described below in conjunction with the accompanying drawings.

[0041] The invention discloses an automated field bridge operation real-time monitoring system for customs intelligent monitoring, which is composed of the following main components: an automated field bridge PLC network and a data exchange interface network, wherein the equipment master PLC of the automated field bridge PLC network is connected to the CMC PLC of the data exchange interface network, and comprises a customs monitoring data platform and a customs monitoring terminal system, wherein the customs monitoring data platform comprises a customs supervision data platform, a terminal aggregation switch, a customs monitoring system core switch, and an independent OCR monitoring system connected in sequence, wherein the customs monitoring system core monitor is connected to the customs monitoring system core switch, and the data interaction switch of the data exchange interface network is connected to the customs monitoring system core switch; and the customs monitoring terminal system comprises a customs monitoring system video core processor, a customs monitoring system video data switch, and an MVR hard disk recorder connected in sequence, and wherein the customs monitoring system video data switch is respectively connected to a trolley frame camera and an OCR camera.

[0042] The automated field bridge PLC network includes equipment drive and control system and equipment remote control system network; the equipment drive and control system is data fused by the equipment master PLC and the slave PLC control system, and through the equipment master PLC and the drive inverter drive converter, the PLC controls the inverter of the main motion mechanisms such as hoisting, trolley and car, and the inverter drives the motor of each mechanism to achieve movement in different directions. At the same time, the data is transmitted back to the PLC through the detection devices such as real-time detection encoders installed on the moving parts of each mechanism, so as to realize closed-loop data control; the equipment remote control system network is driven by the remote control core PLC network through the equipment master PLC to control the TCP / IP communication interface and ACCS server; the equipment data monitoring system and CMS data interaction interface

[0043] The data exchange interface network is composed of CMS network, data exchange switch and TCP / IP conversion interface. The CMS network includes CMS data conversion platform and CMS PLC. The RCMS system platform and LCMS system platform are respectively linked to the CMS data conversion platform. The data exchange switch is connected to the CMS data conversion platform. The TCP / IP communication interface is connected to the CMS PLC.

[0044] The customs monitoring data platform consists of the customs monitoring system core switch, the customs monitoring system core controller, the independent OCR monitoring system, the terminal aggregation switch and the customs supervision data platform. The equipment-related data obtained through the CMS PLC and the independent OCR data information are aggregated through the customs monitoring system core switch and managed by the core controller. The relevant data of the real-time operation is collected and integrated, and each operation information is summarized;

[0045] The customs monitoring terminal system includes a video core control processor, a video data switch and an NVR hard disk recorder connected in sequence. The video data switch is connected to multiple cameras. The video core control processor is the control core of the video acquisition system, the NVR hard disk recorder is used to record and store video data, and the video data switch functions to aggregate and collect video data from installed cameras.

[0046] The customs intelligent monitoring system is divided into functional modules and introduced one by one, including a brief description of some automated field bridges and CMS systems.

[0047] The customs operation monitoring system, based on multiple PLC interface protocols and settings, can realize data interaction and isolation, thereby achieving data security and sharing. It mainly reads the real-time operation data of the equipment through CMS PLC to establish independent network interaction.

[0048] 1. Description of the overall system composition

[0049] 1. Brief introduction of automation field bridge network

[0050] Field bridge automation is based on the electronic control and network upgrade of conventional field bridge equipment. The main control core of the equipment is the PLC network. Due to the PLC's multiple interface protocols and settings, it can realize the interaction of various different data, and the main PLC is the control core of the overall equipment configuration.

[0051] (1) Equipment drive and control system

[0052] This is the most basic control configuration of the field crane. It adopts a decentralized layout and centralized management mode. The master PLC and the slave PLC perform data fusion, and through the master PLC and the drive network architecture, the PLC controls the inverters of the main moving mechanisms such as the hoist, trolley, and car. The inverter drives the motors of each mechanism to achieve movements in different directions. At the same time, the data is transmitted back to the PLC through detection devices such as real-time detection encoders installed on the moving parts of each mechanism to achieve closed-loop data control.

[0053] (2) Network structure of equipment remote control system

[0054] The automated field bridge requires remote control system scheduling and intermittent remote control, which is mainly achieved by remote control ACCS controller through TCP / IP communication interface and interaction between remote PLC and equipment PLC control configuration. Through remote PLC control, the remote control console can realize the control and management function of single-machine equipment.

[0055] The TCP / IP communication conversion switch is mainly used to connect the PLC data signal with the ACCS controller and exchange data. It also isolates the PLC control configuration data based on the TCP / IP switch settings.

[0056] (3) Composition of the equipment data monitoring system and CMS data interaction interface

[0057] CMS, Crane Monitoring System, equipment monitoring system, is used to record the real-time operating status of the equipment and the driver's control instructions. As an important part of the equipment control system, CMS records in real time through PLC data signals. For equipment safety considerations, the CMS system sets up an independent PLC network, and is independently set up with the control PLC configuration. The CMS PLC network and the control PLC configuration are set in different network segments. The control PLC is network segment 1, and the CMS PLC is network segment 2. The two network segments are independent of each other and have setting permission protection. Based on the configuration characteristics of the PLC, the CMS PLC only communicates and interacts with the main PLC, and the CMS PLC only has data read permission for the control PLC, but no write permission, and cannot participate in the main control calculation of the equipment.

[0058] The secure connectivity of the PLC network configuration mode, two independent PLCs are networked and only allow data reading, not data writing to each other, thus ensuring the safety of the equipment and the stability of the CMS system. The basic data of the real-time monitoring and acquisition system for operation data is also derived from the CMS PLC, which also becomes one of the security isolation protections between the operation monitoring system and the automation equipment system.

[0059] 2. CMS system composition and brief description:

[0060] The CMS system consists of the LCMS equipment local monitoring platform and the RCMS remote control room centralized monitoring platform. The LCMS is deployed in the electrical room of the equipment, and the RCMS is centrally deployed in the equipment control room. The two subsystem platforms calculate and process data through the CMS data platform.

[0061] The basic data of the CMS data platform is obtained through processing of CMS PLC data and dedicated switch data. The dedicated data switch uses the TCP / IP protocol and the corresponding extended protocol interaction framework of the PLC. The PLC converts the data to the switch through a dedicated TCP / IP interface.

[0062] The dedicated data switch has data interaction functions, standardizes access rights to PLC data, strengthens security protection of equipment control systems, and improves the data independence of the data interaction system.

[0063] 3. Data interaction interface mode and data security isolation protection

[0064] The real-time operation monitoring system needs to retrieve data from the field crane equipment control system and cannot interact with the control system. It adopts a customized isolation protection mechanism and has a multiple protection system. All data is exchanged through a unique data link, including a TCP / IP conversion interface and a data exchange switch. The data exchange switch is also connected to the core switch of the customs monitoring system to realize the customs monitoring data platform.

[0065] (1) Through the access permission setting of CMS PLC, one-way reading of device control data is set.

[0066] (2) Through the data isolation setting with CMS PLC, the TCP / IP protocol interface of PLC and the configuration of data switch, a second layer of data isolation protection is formed.

[0067] (3) By implementing the setting of the core processor of the operation data monitoring system, it is blocked from forming control instructions, and the data is managed through an interactive protocol to achieve the setting of the third-layer protection isolation system for the equipment control system.

[0068] (4) The only data link that allows mutual access and implements data compatibility and security protection settings.

[0069] 4. Description of the composition of the customs monitoring data platform

[0070] The composition of the real-time operation monitoring system can be roughly divided into: positioning video monitoring data, OCR and data integration system, customs supervision data platform, etc.

[0071] (1) Composition of the customs monitoring terminal system

[0072] It consists of a video core control processor, a video data switch, a camera, and an NVR hard disk recorder. The video core control processor is the control core of the video acquisition system, the NVR hard disk recorder is used to record and store video data, and the video data switch functions to aggregate and collect video data from the installed cameras.

[0073] Camera installation location introduction: Figure 1 and Figure 2 As shown,

[0074] a. Top panoramic camera 1: Mainly on the top of the automated field bridge trolley, using a wide-angle camera (such as Figure 2 As shown in the figure), it is used to capture the overall situation video data of the operating box position, including the box area, lane side and trailer. It is arranged on the trolley frame in the left and right directions along the hoisting device.

[0075] b. Container number collection camera 2: It takes pictures of the lane direction at the side door leg of the lane, and takes pictures of the side container number position of the 20ft and 40ft container loads, which is used for the operation box information OCR collection system.

[0076] (2) Customs monitoring data platform

[0077] like Figure 3 As shown in the figure, the data interaction interface system is integrated by the core switch of the customs monitoring system, the core controller, the independent OCR monitoring system, the terminal aggregation switch, etc. The equipment-related data obtained through the CMS PLC and the independent OCR data information are aggregated through the data switch and managed by the core controller. The relevant data of the real-time operation is collected and integrated, and each operation information is summarized.

[0078] The main collected data include:

[0079] a. The positioning information in the operation is mainly calculated through PLC and encoder data. The operation box position data is calculated through certain operation logic and encoder data collected by PLC.

[0080] b. Operation container OCR data, used to confirm the operation container information

[0081] c. Interactive truck information collection, mainly through roof number video and photo information acquisition

[0082] (3) Customs supervision data platform

[0083] like Figure 3 As shown, the data summarized from real-time operation monitoring is integrated and formed into an operation data list information so that the customs can supervise and monitor the operation data at any time. This is the final presentation of the data after integration.

[0084] It is mainly achieved through data aggregation switches and customs supervision data platforms.

[0085] 2. Brief description of data link intercommunication and security protection:

[0086] Ensure data connectivity and independent and secure setup of each system, integrate data link settings in the system integration architecture, mainly reflected in the core data link composed of CMS PLC, TCP / IP conversion interface, data interaction switch, customs monitoring system core switch, customs system video data switch, etc. The core link setup ensures efficient, stable, secure and independent core data transmission.

[0087] II. Data Collection and Data Collection Instructions of Customs Intelligent Operation Monitoring System

[0088] The main algorithm of the system is to capture the video images of the main nodes in the operation, PLC data information, TOS operation information, box number recognition OCR and other data, and form an operation list to be sent back to the customs supervision integrated platform for recording in real time, and convenient for call and query. According to the comprehensive fusion and comparison of multi-dimensional data of different nodes, a complete operation data sequence is formed. If the actual operation data does not match the instruction information, it is necessary to manually reconfirm the operation instruction and correct the operation sequence information.

[0089] The idea of ​​statistical calculation for target container and destination site is roughly similar in data collection. The hoist opening and closing signal is used as the trigger mechanism, and the location information of the target container or destination site is calculated through the PLC data offset and the final positioning position, and then the camera system is triggered to collect data from the towing lane, the yard, under the trolley and the OCR system. After the video data is collected, industrial visual analysis and processing are performed to further obtain relevant operation data information.

[0090] The data information obtained through industrial visual analysis technology is logically checked with the PLC calculation data, and the operation data information of the operation box is initially integrated and transmitted back to the remote intelligent verification and comparison data platform. Through further integration and comparison with TOS data, complete operation data is obtained and finally transmitted to the customs operation supervision platform for storage and backup. Once an abnormality occurs in the automatic statistical comparison, it will automatically switch to manual intervention mode, and the data will be sorted out through manual inspection and stored again on the customs operation supervision platform.

[0091] The following is a detailed description of data collection: Figure 4 As shown:

[0092] The operation data comparison and operation sequence data integration are processed by the terminal side system of the yard crane. The customs operation monitoring platform will integrate all the yard crane operation data and form database information. The network connection between the terminal and the monitoring platform also relies on the network architecture within the port area.

[0093] 1. Target box information collection

[0094] The hoist locking signal is obtained through PLC data, which means that the yard crane has successfully grabbed the box. At this time, the real-time data of the trolley and lifting encoder are further read through PLC data, and the position of the hoist is analyzed to obtain the position information of the target box for the operation.

[0095] Based on the position of the spreader at this time, it is determined whether the target box is in the box area or on the towing track. If it is on the towing track, the front of the vehicle is captured by the camera of the trolley; if it is on the box area, the two cameras on the top of the trolley are used to capture the target position of the operating box area.

[0096] If it is on the tow lane side, the container number is identified by the OCR recognition system installed on the gate leg of the yard crane, and the data is compared with the operation information.

[0097] Finally, the following data information is collected and integrated into target operation information, including: panoramic image of target container area, lane side photos, target container number information, etc.

[0098] 2. Collection of relevant operation information at the destination

[0099] As the hoist and trolley move long distances in the collected PLC data and pass the instruction layer data verification, it means that the target box data collection is completed and the information collection is activated after the next instruction is completed.

[0100] When the spreader unlock signal is detected and the lifting distance exceeds 3 meters (the height of a standard container) through the analysis of the lifting encoder data, it means that the yard crane has successfully placed the container. At this time, the real-time data of the trolley and lifting encoder during the spreader unlocking action is further read through the PLC data, and the position of the spreader is analyzed to obtain the position information of the operation destination.

[0101] According to the position of the spreader at this time, it is determined whether the target site is in the container area or on the towing track. If it is on the towing track, the front of the vehicle is captured by the camera of the trolley; if it is on the container area, the two cameras on the roof of the trolley are used to capture the target position of the operating container area.

[0102] If it is on the tow lane side, the container number is identified by the OCR recognition system installed on the gate leg of the yard crane, and the data is compared with the operation information.

[0103] The final collected data includes: panoramic image of the target box area, lane side photos, target box number information, etc.

[0104] 3. Post-collection data information integration

[0105] After completing the data collection of the target box operation information and the destination site operation information, the relevant data will be intelligently checked and compared with the TOS instruction information. If any abnormality occurs, manual intervention will be required for verification. The final data will be transmitted to the customs operation monitoring platform in the form of a list, stored in real time, and can be called up at any time.

[0106] 4. Data acquisition signal description:

[0107] (1) Target box data collection: When the hoist completes the box grabbing operation and the lifting action exceeds 3 meters, it is considered that the target box is grabbed successfully, and the collection of relevant video data begins at this time. It mainly relies on the two foreground cameras on the top of the trolley to capture.

[0108] (2) Destination location operation information collection: Similar to the target box data collection process, when the hoist completes the box placement and the lifting action exceeds 3 meters, the box placement is considered successful. At this time, the panoramic camera on the top of the trolley captures the situation of the destination box position.

[0109] (3) When the box grabbing or box releasing signal is triggered, the captured photo data is used for OCR box number recognition to form an operating box or complete box number information collection.

[0110] (4) Multi-dimensional data collection on the towing lane side

[0111] Through PLC data sampling, when the trolley is on the towing lane side, after completing the opening and closing actions, the panoramic capture lens on the top of the trolley is started to capture the towing lane in order to record the situation on the towing lane side, especially the trailer situation, and record it.

[0112] (5) Collection of relevant bay level calculation data

[0113] When the movement distance of the trolley or lifting position is detected in the PLC and the opening and closing signal is triggered, the PLC will read the trolley and lifting position and calculate the position information such as the working box position. This information will be compared and verified with the information after image analysis, and finally approved with the TOS instruction information.

Claims

1. An automated field bridge real-time monitoring system for customs intelligent monitoring, comprising an automated field bridge PLC network and a data exchange interface network, wherein the equipment master PLC of the automated field bridge PLC network is connected to the CMC PLC of the data exchange interface network, and wherein: It includes a customs monitoring data platform and a customs monitoring terminal system. The customs monitoring data platform includes a customs monitoring data platform, a terminal aggregation switch, a customs monitoring system core switch, and an independent OCR monitoring system connected in sequence. The customs monitoring system core monitor is connected to the customs monitoring system core switch. The data exchange switch of the data exchange interface network is connected to the customs monitoring system core switch. The customs monitoring terminal system includes a customs monitoring system video core processor, a customs monitoring system video data switch, and an MVR hard disk burner connected in sequence. The customs monitoring system video data switch is respectively connected to the top panoramic camera and the box number collection camera. The automated field bridge PLC network includes an equipment drive and control system and an equipment remote control system network; the equipment drive and control system is a data fusion of the equipment master PLC and the slave station PLC control system, and through the equipment master PLC and the drive inverter drive converter, the PLC controls the inverter of the lifting, trolley and car motion mechanism, and the inverter drives the motor of each mechanism to achieve movements in different directions. At the same time, the real-time detection encoder detection device installed on the moving parts of each motion mechanism transmits data back to the PLC to achieve closed-loop data control; the equipment remote control system network is driven by the remote control core PLC network through the equipment master PLC to control the TCP / IP communication interface and the ACCS server; The data exchange interface network is composed of CMS network, data exchange switch and TCP / IP conversion interface. The CMS network includes CMS data conversion platform and CMS PLC. The RCMS system platform and LCMS system platform are respectively connected to the CMS data conversion platform. The data exchange switch is connected to the CMS data conversion platform. The TCP / IP communication interface is connected to the CMS PLC. The customs monitoring data platform consists of the customs monitoring system core switch, the customs monitoring system core controller, the independent OCR monitoring system, the terminal aggregation switch and the customs supervision data platform. The equipment-related data obtained through the CMS PLC and the independent OCR data information are aggregated through the customs monitoring system core switch and managed by the customs monitoring system core controller. The relevant data of the real-time operation is collected and integrated, and each operation information is summarized; The customs monitoring terminal system includes a customs monitoring system video core control processor, a customs monitoring system video data switch and a customs monitoring system NVR hard disk recorder which are connected in sequence, and the customs monitoring system video data switch is connected to multiple cameras; The customs monitoring system video core control processor is the control core of the video acquisition system. The customs monitoring system NVR hard disk burner is used to record and store video data. The customs monitoring system video data switch function is to aggregate the video data from the top panoramic camera and the box number collection camera.

2. The automated field bridge real-time monitoring system for customs intelligent monitoring according to claim 1 is characterized in that: The top panoramic camera is installed on the roof of the automated yard bridge trolley and uses a wide-angle camera.

3. The automated field bridge real-time monitoring system for customs intelligent monitoring according to claim 1 is characterized in that: The container number collection camera is installed at the side door leg of the lane to shoot the direction of the lane and the side container number position corresponding to the container load for use by the OCR collection system.

Images