An automatic ship loading control system
通过自动化装船控制系统,利用检测装置和集中远程控制终端,结合雷达和激光扫描仪,实现了装船机的自动化控制,解决了装船机智能化自动化水平不足的问题,提升了装船作业 efficiency and safety.
Patent Information
- Application Number
- CN202311834562.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-28
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2043-12-28
AI Technical Summary
The existing ship loader has insufficient intelligent automation level and relies on manual operations, resulting in low loading efficiency and safety.
Design an automated ship loading control system, including detection devices, local controllers and centralized remote control terminals, and realize the purpose of collecting ship form data in real time, building ship models, generating ship loading instructions, combining radar, laser scanner and attitude sensors. Automatic control of cabin, cabin change and stop action to prevent collisions and provide remote manual, semi-automatic and fully automatic operation modes.
It improves the automation control level of the loading machine, improves the intelligence and safety of loading operations, realizes all-weather unmanned ship loading operations, ensures loading efficiency and safety, and can be comparable to skilled workers' operations.
Smart Images

Figure CN117806223B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of automatic ship loading control, and in particular to an automatic ship loading control system. Background Art
[0002] Ship loaders are large bulk material machines used for loading bulk material at bulk material terminals. Generally, ship loaders are composed of booms, telescopic chutes, tail cars, traveling devices, gantry, towers, pitch devices, slewing devices, etc. However, the existing technology generally relies on manual operation and control of ship loaders to achieve loading, and its intelligent automation level is insufficient. Summary of the invention
[0003] In order to solve the problems existing in the above-mentioned prior art, the present invention provides an automated ship loading control system, which can effectively improve the automated control of the ship loader and further improve the automated and intelligent level of the ship loading operation.
[0004] In order to achieve the above technical objectives, the present invention provides the following technical solutions: an automated ship loading control system, comprising:
[0005] Detection devices, local controllers, centralized remote control terminals and ship loaders;
[0006] The detection device is arranged on the ship loader, and the local controller is connected to the detection device and the ship loader respectively, wherein the local controller is connected to the centralized remote control terminal;
[0007] The detection device is used to collect the morphological data and protection data of the ship in real time;
[0008] The local controller is used to receive and store the data collected by the detection device, and receive the loading instruction, and based on the loading instruction, control the loader to perform the tank adjustment action, tank change action and stop action through the protection data and the point cloud data to control the loader to load the ship;
[0009] The centralized remote control terminal is used to model the morphological data, construct a ship model, and generate a loading instruction based on the ship model.
[0010] Optionally, the detection device includes a plurality of positioning devices, radars, laser scanners and attitude sensors, wherein the positioning device, radar and laser rangefinder are arranged on the ship loader, and the attitude sensor is arranged on the loading hull.
[0011] Optionally, millimeter-wave radars are provided on both sides of the ship loader's walking track, on both sides of the boom, and on the front, back, left and right sides of the chute, wherein the millimeter-wave radars are used to collect the protection data, wherein the protection data is the distance data between the radar and the object, and a threshold judgment is performed on the protection data through local control, and a stop command is generated based on the judgment result to control the ship loader to stop to prevent a collision.
[0012] Optionally, the positioning device includes an absolute value encoder, a correction switch and a GNSS positioning device, wherein the positioning device is arranged on a walking wheel, a telescopic motor, a pitch motor, a chute rotating motor and a shovel swing shaft.
[0013] Optionally, in the centralized remote control terminal, the process of modeling the morphological data includes:
[0014] A laser scanner is arranged on the ship loader, and the ship loader is controlled to move through the laser scanner for laser scanning; three-dimensional modeling is performed on the point cloud data after the laser scanning to generate initial ship model data; the radar is arranged above the chute of the ship loader to collect the contour data of the hatch in real time during the loading operation, and the initial ship model data is updated according to the contour data, ship size data and posture data to generate real-time ship model data.
[0015] Optionally, both the local controller and the centralized remote control terminal are provided with an operation console, wherein manual operation is performed through the operation console.
[0016] Optionally, an automation control interface, a video monitoring interface and a ship database system interface are provided on the operating console, wherein the automation control interface is used to display the working status of the ship loader, the video monitoring interface is used to display the loading site video, and the ship database system interface is used to manually control the remote operation of the ship loader; wherein the operating console is also provided with a ship loader control device for remote manual control of the ship loader.
[0017] Optionally, a voice broadcasting system is also provided on the ship loader, wherein the voice broadcasting system is used for voice broadcasting, wherein the voice broadcasting system is an IP network-based broadcasting system, which uses the network communication TCP / IP protocol and is constructed based on an existing LAN / WAN network.
[0018] Optionally, in the local controller, the process of generating the cabin action, cabin change action and stop action includes:
[0019] receiving a loading instruction, wherein the loading instruction includes positions of different cabins in the ship model and a loading sequence;
[0020] Generate a cabin alignment command based on the ship's position through local control, control the cabin alignment command to move the chute of the ship loader to the corresponding chute position in the cabin, and detect the distance between the cabin and the chute based on the material radar, perform threshold judgment on the detection result, and implement the cabin alignment action based on the threshold judgment result;
[0021] After the cabin action is completed, the loading quantity is detected in real time. When the loading quantity reaches the required value, the cabin is changed. During the detection process, the protection data collected by the material radar is detected. When the protection data is within the operating height threshold, the operation is normal, otherwise the telescopic pitch adjustment of the chute is performed;
[0022] During the cabin change operation, the position of the chute corresponding to the next cabin is extracted, and the cabin transfer path is generated through the inverse kinematics solution method. The chute is controlled to perform the cabin transfer action according to the cabin transfer path.
[0023] Optionally, the centralized remote control terminal and the local controller include three operation control modes: fully automatic, remote semi-automatic, and remote manual.
[0024] The present invention has the following technical effects:
[0025] Through the above technical scheme of the present invention, the three-dimensional model to be loaded is obtained by using single-machine positioning technology, radar combined with laser detection and ranging scanning technology, multi-machine scanning mathematical fitting and ship type scanning system; combined with the current specific loading and unloading operation process, after background strategy analysis, a loading instruction is formed and transmitted to the single machine. After receiving the instruction, the single machine automatically aligns the cabin and automatically stretches and pitches to the predetermined position to operate; at the same time, during the operation, the laser scanning and mathematical simulation modeling technology are used to perform dynamic real-time scanning of the cabin and the materials in the cabin, and the database modeling and PLC control instructions are converted into system actions to realize dynamic adjustment of the system until all loading operations are completed, so as to effectively improve the automatic control of the loader and further improve the level of automatic intelligence of the loading operation, which has strong practicality. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0027] Figure 1 An overall design diagram of the solution provided for an embodiment of the present invention;
[0028] Figure 2 A diagram of the system software architecture provided by an embodiment of the present invention;
[0029] Figure 3 A simplified diagram of the location of newly added devices in the system provided by an embodiment of the present invention;
[0030] Figure 4 A three-dimensional effect diagram provided by an embodiment of the present invention;
[0031] Figure 5 Ship loading system architecture provided by an embodiment of the present invention;
[0032] Figure 6 A ship loading operation mode provided by an embodiment of the present invention;
[0033] Figure 7 A schematic diagram of a first outer rod provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0034] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0035] like Figure 1-2 The present invention provides an automated ship loading control system, comprising:
[0036] The main purpose is to transform the ship loader into a centralized control and automated operation system, and to transform the ship loader into an unmanned ship loading operation system. Through the posture detection of the ship loader and the three-dimensional data modeling of the ship, the remote unmanned operation of the ship loader is realized. At the same time, the existing operation and monitoring functions of the ship loader driver's room are transferred to the remote centralized control room, i.e. the remote centralized control terminal, and the ship loader operating system is integrated with the reclaimer and the central control system to realize unified operation and maintenance management.
[0037] The intelligent loading unmanned control system uses single-machine positioning technology, radar combined with laser detection and ranging scanning technology, multi-machine scanning mathematical fitting and ship type scanning system to obtain the three-dimensional model to be loaded; combined with the current specific loading and unloading operation process, after background strategy analysis, the loading instruction is formed and transmitted to the single machine. After receiving the instruction, the single machine automatically aligns the cabin and automatically stretches and pitches to the predetermined position for operation; at the same time, during the operation, the laser scanning and mathematical simulation modeling technology are used to dynamically scan the cabin and the materials in the cabin in real time, and the database modeling and PLC control instructions are converted into system actions to realize dynamic adjustment of the system until all loading operations are completed. During the operation, the real-time collision prevention system is used, and no driver is required on the single machine, and on-site patrol personnel are assigned as needed. Under normal circumstances, a driver can monitor the single machine in the control room. The entire intelligent loading operation process requires the coordinated control of multiple machines for the loader, belt conveyor and bucket wheel machine.
[0038] The automated loading and control system is comprehensive in functions. The system can effectively realize panoramic management of the ship loader in remote manual, automated and other operation modes. Under the premise of realizing various operation modes, it can collect, display, classify, store and query all status signals, fault signals and alarm signals of the ship loader in real time to meet the actual production requirements on site. The human-computer interaction system developed and designed based on the automated control platform should conform to the operation habits of on-site operations, and the style and layout of the interface should be humanized to make the operation interface more friendly and easy to use, with comprehensive functions and a stable and reliable system.
[0039] The design scope mainly includes: high-precision positioning system design; space intelligent anti-collision system design; identification and perception system design; ship database system design; video surveillance system transformation; voice broadcasting system design; control room system transformation design; central control software control system design; berth management system design.
[0040] High-precision positioning system hardware design:
[0041] An absolute encoder and correction switch are installed on the travel wheel, telescopic motor, pitch motor, chute rotary motor and shovel swing shaft of the ship loader to detect the posture of each mechanism of the ship loader in real time. The absolute encoder is used to measure information such as object position, speed and angle, and provide basic real-time data for the unmanned operation control system of the ship loader. It is planned to add a set of correction switches to the travel wheel, telescopic motor, pitch motor, chute rotary motor and shovel swing shaft to calibrate the value monitored by the absolute encoder at each extreme position to ensure the accuracy of the ship loader control.
[0042] Travel positioning: The positioning technology combining travel absolute encoder and GNSS positioning is adopted to achieve continuous and precise positioning, and the travel positioning accuracy reaches the centimeter level. Telescopic positioning: The positioning technology combining telescopic absolute encoder and GNSS positioning is adopted, and the limit correction switch is added at the same time to achieve continuous and precise positioning. Pitch positioning: In order to detect the pitch and tilt angle of the loader's boom, a dual-axis high-precision inclination sensor positioning device and GNSS pitch are combined, and the pitch and tilt positioning accuracy is less than 0.1 degrees. Chute rotation positioning: In order to detect the rotation angle of the loader's chute, the positioning technology combining absolute encoder and GNSS positioning is adopted to achieve continuous and precise positioning. The high-precision attitude detector is mainly installed on the hull to obtain high-precision attitude information of the hull.
[0043] Anti-collision system hardware design:
[0044] A total of two three-dimensional laser anti-collision radars are installed on the left and right sides of the lower part of the ship loader's boom. The three-dimensional laser anti-collision radars are used to scan the distance between the ship loader's boom and the hull cover to prevent collisions.
[0045] Two sets of three-dimensional laser anti-collision radars and four sets of anti-collision millimeter-wave radars are installed at the chute. Two sets of three-dimensional laser anti-collision radars are installed on the left and right sides of the chute maintenance platform; millimeter-wave radars are installed at the four corners (east, south, west, and north) of the chute maintenance platform, totaling four sets. Two sets of three-dimensional laser anti-collision radars and four sets of chute anti-collision radars are used to detect obstacles such as the docked ship body, hatch edges, and warehouse covers in real time during loading operations to avoid collisions between loading and obstacles. When the detection chute is close to the obstacle within 3 meters, an early warning signal is issued.
[0046] Four sets of pedestrian anti-collision millimeter-wave radars are installed at each of the four corners of the ship loader's door legs. The four sets of pedestrian anti-collision radars are used to warn of people approaching near the four corners of the ship loader's door legs during the ship loader's warehouse relocation process. At the same time, the pedestrian anti-collision radars are also used to detect the safe operating distance between the major machines during the ship loader's warehouse relocation process to avoid serious safety accidents such as large machine collisions. When a pedestrian is detected to be 2 meters away from the ship loader's door legs, a warning signal is issued.
[0047] A set of pedestrian anti-collision millimeter-wave radars are installed on the east and west sides of the belt edge of the tail car of the ship loader and on the left and right sides of the belt, totaling 4 sets. The pedestrian anti-collision radar at the belt is used to detect people approaching the belt during the ship loader's warehouse transfer process and issue an early warning signal when the pedestrian is 2 meters away from the detection point.
[0048] 3D laser scanning radar hardware design
[0049] All operation and monitoring functions of the ship loader cab are transferred to the remote centralized control terminal, and the ship loader operating system is integrated with the reclaimer, stacker, and central control system to unify operation and maintenance management.
[0050] During the loading period, two 3D laser scanning radars are installed near the driver's cab and their corresponding brackets are installed. The radars are set in different positions that can capture the panoramic view of the ship. The two 3D laser scanning radars are mainly used for overall modeling scanning of ships moored at the port, as well as real-time status of the ship during loading operations.
[0051] Ship loader material level detection system hardware design:
[0052] Four sets of high-frequency material height radars are installed, and corresponding equipment brackets are installed. One set of material height radars is installed at each of the four corners (east, south, west, and north) of the middle and lower section of the chute. The four sets of material height radars are used to detect the distance between the chute and the coal pile during the loading operation. It ensures that the height of the coal pile can be displayed in real time during the loading operation, and provides data for real-time dynamic adjustment of the distance between the chute and the coal pile, reducing dust during the loading operation, and also serves as protection data for collision prevention between the coal pile and the chute.
[0053] Ship loader data and control system hardware design
[0054] It is planned to add a cabinet in the ship loader room, which will contain: airborne industrial computer and hard disk recorder; the PLC control system will be installed in the original PLC control cabinet in the room. The airborne industrial computer is used for scanning, storage and calculation of anti-collision millimeter wave radar data, the hard disk recorder is used for video data conversion and backup, and the PLC control system includes CPU, communication module, input module, output module, etc.
[0055] The specific installation layout is as shown in the schematic diagram of the overall equipment installation location. Figure 3 The onboard industrial computer, hard disk recorder, and PLC control system are located as shown in the figure.
[0056] It is planned to add two electrical control cabinets on the ship loader platform for communication and power supply of nearby millimeter wave radar, encoder, correction switch, material height radar and other equipment. An emergency stop receiving station is installed nearby to receive the emergency stop handle signal. The specific installation layout is shown in the schematic diagram of the overall equipment installation position as shown in Figure 3: Two electrical control boxes are also set up; emergency stop receiving station.
[0057] Centralized control room operating console system
[0058] The material retrieving operation table of the production dispatching center is renovated, and a remote control workstation for the ship loader is added to enable it to have the centralized control and operation capability of loading and unloading. The operation table has a flexible switching function, so that any operation table can control any ship loader. The control interlock between the operation tables prevents two operation tables from controlling the same ship loader. The operation table can display the automation control interface, video monitoring interface and ship database system interface. The automation control interface is used for ship loader status monitoring, the video monitoring interface is used for on-site key video point display, and the ship database system interface is used to guide the remote operation of the ship loader; the operation table is equipped with a ship loader emergency stop button, a ground belt emergency stop button, a status indicator light, a ship loader walking / pitch / telescopic / chute rotation remote control handle, a chute swing button, a ship loader selection button, etc., which can realize the remote manual control of the ship loader by the production dispatching center, and can stop the operation of the ship loader cantilever belt or the corresponding ground belt in an emergency. The emergency stop signal from the central control station to the large machine is transmitted via a network line. The central control software system can collect various information and parameters generated during the operation of the monitored equipment, such as fault information, operating status parameters, etc., in real time and transmit them to the server in the central control room through the network. It can reflect the operating status of the equipment through various screen images, and provide three-dimensional visual simulation interaction functions for key parts. At the same time, the central control software system can control the front-end devices on the loader, such as lighting, track clamps, power supply, etc., and can also manually control the loader's travel, pitch, telescopic and other actions. It can automatically calculate the loading strategy and loading strategy according to the loading operation requirements and ship characteristics, and send them to the onboard system to execute automatic loading.
[0059] Software solution design:
[0060] Millimeter-wave anti-collision software design: The millimeter-wave anti-collision system includes multi-part protection. The system design installs multiple millimeter-wave radars on the ship loader's walking track mechanism, on both sides of the movable arm, and at various angles in front, behind, left and right of the chute, providing all-weather and all-round protection for the large machine during the loading operation.
[0061] (1) Track anti-collision: Four millimeter-wave radars are installed on both sides of the ship loader's track to provide anti-collision alarms for passing pedestrians, vehicles, and foreign objects near the track during operation.
[0062] (2) Anti-collision on both sides of the movable boom: A millimeter-wave radar is installed on each side of the movable boom of the ship loader to prevent collisions during the movement of the boom when the loader is moving or changing positions, thereby preventing the boom from colliding with the hull.
[0063] (3) Anti-collision of the chute: A millimeter-wave radar is installed in each of the four directions of the chute to prevent the chute from colliding with the ship when changing positions during operation.
[0064] The anti-collision system monitors the status of each area in real time, and uses multi-threading to connect the radar and PLC. The threads do not affect each other, which improves the stability of the program. Once an obstacle is detected in the monitoring area, the main machine stops the current action, and the system issues an alarm. The centralized control terminal uses the relevant video lens to view, make decisions, and issue troubleshooting instructions. After the alarm is lifted, the system continues to operate. The anti-collision equipment meets at least the IP66 protection level requirements, and a voice prompt device is installed on site for prompting dangerous areas.
[0065] The process is to connect to PLC, connect to millimeter-wave radar, start multi-threading, the sub-thread receives data, processes the data, and writes it to PLC, and repeats the execution of receiving data and processing data.
[0066] 3D radar anti-collision software design:
[0067] Millimeter-wave radar anti-collision mainly protects the area directly in front of the radar. In order to improve the safety of loading operations, a three-dimensional radar anti-collision system is added. A three-dimensional laser radar is installed on both sides of the chute and the boom to detect foreign objects approaching the chute and the boom during the operation. The three-dimensional spatial data returned by the radar is used to construct a virtual anti-collision range of the protected area. When foreign objects invade the area, an alarm is generated to achieve the purpose of anti-collision; the non-contact anti-collision area is achieved by adjusting the appropriate scanning angle of the detection equipment. At the same time, the equipment installation is designed to be stable and easy to access the maintenance equipment bearing base to avoid the risk of coal spilling above the equipment. In order to ensure the quality of loading and the efficiency of cabin transfer, the anti-collision protection shutdown threshold is 2m.
[0068] The system software process includes: connecting to PLC, connecting to radar, starting the data acquisition thread, monitoring the data processing thread, writing the alarm results to PLC, and repeating the data acquisition thread and processing thread monitoring after writing:
[0069] 3D laser scanner modeling software design:
[0070] The ship loader has added radar and laser scanning devices, which use a fusion method of radar mathematical modeling and laser scanning modeling. The scanning device uses the ship loader to scan the entire ship. The ship database system uses the scanning data to establish a ship model. The ship model includes three-dimensional spatial data such as the hull and its appendages, hatches, and hatch covers. The data update time is no more than 1 minute. The three-dimensional spatial data of the ship is sent to the automation control PLC to assist the ship loader in controlling the cabin and automatically moving the cabin. The scanned ship data is automatically stored and can be called later. The ship model in the ship model database supports manual and automatic generation.
[0071] The acquired ship point cloud data is directly uploaded to the ship model database. During the next operation, the ship modeling software system automatically determines the latest ship data, gives priority to the latest data for calculating the ship operation strategy, and updates it to the main database after the operation is completed.
[0072] Laser scanning modeling system:
[0073] Laser scanning modeling system based on laser scanner scanning berth ships:
[0074] The laser scanner is installed on the single machine of the ship loader. When scanning is needed, the single machine completes the laser scanning by walking above the berth ship. By collecting the scanner data and the position data of each mechanism of the single machine, the three-dimensional point cloud data is collected, and the three-dimensional ship data is generated through the dedicated point cloud processing software. The laser scanning modeling system can realize global or local modeling, such as Figure 4 As shown, the model can be normalized and stored in a unified modeling database shared with radar mathematical modeling.
[0075] Mathematical simulation modeling system
[0076] Since laser scanners are easily affected by weather, when there is a lot of dust on rainy, snowy or windy days, the laser scanner will be blocked, affecting the accuracy of laser modeling, and the normal operation of unmanned automatic loading in the later stage cannot be guaranteed. Therefore, in order to ensure the unmanned automatic loading operation in all weather, the present invention designs a mathematical simulation 3D modeling system based on radar feedback based on the existing relevant mathematical 3D modeling software.
[0077] Mathematical simulation modeling based on radar is to install a high-frequency modeling radar above the chute of the ship loader, collect the contour information of the hatch in real time during the operation, collect the size data and real-time posture data of each key part of the ship loader, and combine the information data of the static initial scan of the ship to complete the real-time modeling of the ship's three-dimensional data through the mathematical simulation modeling system. This method is completed in real time during the single-machine operation at the berth, does not occupy a separate time, and is not affected by bad weather, thus ensuring that it has an all-weather modeling function, thereby ensuring the normal progress of the subsequent all-weather unmanned loading work. The mathematical simulation modeling system mainly realizes loading modeling.
[0078] During the loading operation, the three-dimensional model of the ship to be loaded is obtained by using single-machine positioning technology, radar combined with laser detection and ranging scanning technology, multi-machine scanning mathematical fitting and ship type scanning system, and combined with the current specific loading and unloading operation process. In the initial preparation stage, a request is sent to the modeling system and dynamic walking scanning is started at the same time. The modeling system will establish a ship model based on the real-time point cloud data generated by the walking scanning of the large vehicle, and automatically generate coordinates such as hatches and heights of various areas, and send these coordinate information to the single-machine PLC. After the single machine walks to the predetermined position, it will automatically align the cabin after receiving the operation instruction.
[0079] The data link performs two-way communication detection and issues an alarm when a communication failure occurs, reminding the central control personnel to troubleshoot the fault. There is an operation log for troubleshooting. The interface displays the data information of each machine during its operation in separate pages.
[0080] In normal weather conditions, laser modeling is used, and in bad weather, it automatically switches to the mathematical simulation modeling system to ensure that the loader can perform unmanned automatic loading operations around the clock. At the same time, in normal weather conditions, laser scanning data is used to correct the accumulated errors of mathematical simulation modeling in real time.
[0081] Advantages of Multi-fusion Modeling System
[0082] The dual modeling method combining radar mathematical simulation modeling and laser scanning modeling can improve the efficiency of fully automatic operation of ship loaders.
[0083] In order to ensure all-weather unmanned automatic loading operations, a 3D modeling system based on radar mathematical simulation and laser scanning was designed. The laser scanner uses a correlation noise filtering algorithm to effectively respond to the radar.
[0084] The laser scanner has developed a multiple echo filtering function to reduce the interference of rain, snow, fog and dust. During the operation, the laser scans the hatches and accessories of the berthed ships, hatch covers, etc. The scanning data and the single-machine operation status value are sent to the remote system server via Ethernet, and the three-dimensional modeling is completed through the modeling software. At the same time, the scanning device is equipped with an electric opening and closing protective cover. The protective cover can be opened automatically when the single machine is working, and effective measures are taken to prevent the protective cover from being opened and closed due to watering and icing in winter. The hatch is automatically closed when the operation is stopped, which improves the protection level of the laser scanner, reduces the number of times the laser scanner lens is cleaned, and at the same time extends the service life of the equipment. It adapts to the harsh environment of the material yard with a lot of dust, a lot of vibration, high temperature and high humidity, and can operate stably for a long time.
[0085] High timeliness. The important role of digital modeling of ships is that during the operation, it is necessary to dynamically collect data, quickly calculate, and feed back the calculation results to the action of the ship loader. Therefore, there are time constraints. The digital modeling software of ships has an existing optimized model building algorithm. The real-time scanning delay should be controlled within 1 second.
[0086] Dynamic detection and refresh of coordinate information of ship hatch areas, etc. Real-time and accurate acquisition and calculation of coordinate data required for operation for operation use, dynamic refresh of hatch 3D data. Image refresh frequency should be controlled to be no less than 1HZ.
[0087] Modeling system performance, mathematical algorithms and execution efficiency of the modeling system software are the core components of this system. The modeling system of this project has the following characteristics:
[0088] High precision. The accuracy of modeling directly affects the accuracy of automatic loading. This software uses a combination of radar and laser scanners to obtain the three-dimensional coordinates and specific dimensions of the ship. The length and width of the three-dimensional model of the ship generated after scanning and imaging should be within 1m compared with the actual measured size of the ship, which not only avoids the influence of bad weather, but also improves the modeling accuracy.
[0089] High timeliness. The important role of this software is to collect data and perform rapid calculations on the modeling model during the loading process, and to feed back the calculation results to the action of the loader, so it has certain constraints on time. The high-frequency radar to be used in this project uses Ethernet communication for data transmission. The modeling software is based on the Microsoft VS development platform and uses the C++ high-efficiency programming language. It has high execution efficiency. The software internally performs deep optimization of the existing optimization methods for the model building algorithm, which is convenient for rapid reading of model data for three-dimensional display.
[0090] The technology used to process a large amount of 3D redundant data. Since the amount of data required for ship modeling is huge and redundant, the system needs to use relevant point cloud filtering algorithms to process it in order to obtain the required data and achieve real-time refresh.
[0091] Abstraction. The mathematical model needs to abstract the three-dimensional data into key data required for the ship loader operation, such as the coordinates of each hatch, the height of each area, etc., and send it to the stand-alone PLC once before the ship loader operation. It will be updated and transmitted back in real time during the intermediate operation. If the mathematical model server or network fails, it will not affect the automated operation of the ship loader on site. The process includes: connecting the relevant scanner, connecting the PLC, receiving the scanning start signal, collecting the scanner and the machine posture data, static modeling, writing the ship data into the PLC, real-time modeling to monitor the changes in the ship posture, generating the end signal of the installation completion, and ending the scanning and installation.
[0092] Software Design of Terminal Berth Management System
[0093] Establish a bulk terminal management system (BTMS), configure the terminal berths, allocate the loading sequence and rounds of the corresponding operation machines according to the berth production operation plan, establish a cabin data model converted from the three-dimensional model internally, and complete the automated operation instructions of the loader.
[0094] It has the function of manual entry and query of ship data. When a ship arrives at the port, the basic data of the ship can be queried and sent to the process control PLC. At the same time, the specific process of the current operation process can be edited and issued, and the real-time operation volume can be monitored to realize the allocation and recovery of the loader's operating authority, avoid freight quality accidents caused by loading on the wrong ship or the wrong hold, and reduce the risk of collision caused by cross-operation of single machines on the same ship.
[0095] This system adopts Web architecture, uses Java language for background service development, realizes data interaction between database and PLC through OPC protocol, can collect ship loader equipment data in real time, stable and efficient. The front page adds three-dimensional dynamic display to facilitate users to grasp the real-time data of equipment and ship loading. The internal three-dimensional model of the cabin data conversion is established to complete the automatic operation instructions of the ship loader.
[0096] Migrate all operation and monitoring functions in the ship loader driver's room to the remote control room, integrate the ship loader operating system with the central control system, and unify operation and maintenance management. Figure 5 shown.
[0097] Collaborative operation of loading and unloading (reserved spare interface)
[0098] During the automatic loading process, single-cabin operation, cabin change, water level adjustment and other links all require the coordination of the reclaimer, belt conveyor and loader to communicate data and improve operation efficiency. It is planned to add a reserved standby communication interface in the loader control system. The single-cabin loading operation will give the water level, modeling data and ship attitude to the reclaimer, and the reclaimer will feed back the reclaimed amount to the single-cabin loading operation. The cabin change operation will tell the reclaimer to suspend reclaiming, and the reclaimer will prepare for cabin change. The loader will adjust the water level, modeling, target cabin and operation amount to the server, and the server will communicate the operation amount to the reclaimer.
[0099] Ship loader operation mode switching
[0100] The operation mode switching switches at the central control and ship loader operator's cab operating stations are modified to realize manual operation mode, remote operation mode, and local operation mode on the ship loader, with a reserved fully automatic mode gear.
[0101] In order to ensure the accuracy of the mode switching logic, a mode switching switch is installed on the operating platform to realize remote manual, remote automatic and on-board manual operation modes. Figure 6 shown.
[0102] Loading process planning
[0103] The remote manual, remote semi-automatic and fully automatic operation modes of the ship loader can all adopt the following loading processes and methods. The process can be planned directly in the remote monitoring room to effectively utilize the storage space; according to the ship size and the direction of the ship docking, a variety of operation processes can be selected according to on-site needs to achieve higher loading efficiency and utilization. Figure 7 shown.
[0104] Ship attitude detection and cabin alignment
[0105] A ship attitude detector is placed on the ship to detect the ship attitude and ship type, and the detection results are transmitted to the ship loader control system. The ship loader determines the position of the tank according to the ship type data, ship attitude, etc., and performs the tank alignment operation.
[0106] In the cabin operation, the above-mentioned ship model is first received, and in the automated detection process, the hatch of the cabin is identified, and the ship model is identified using a deep learning model to generate the point cloud position coordinates of the center point of the cabin, and the position of the center point cloud of the cabin feature area is recorded. According to the relative position of the cabin feature area and the ship posture, the identified cabin is numbered;
[0107] During the numbering process, the center point of the cabin identified above is fine-tuned to align left and right, and the direction data in the ship's attitude data is used to determine the ship's docking direction. The ship's docking direction and a 90-degree left rotation are used as the basis for the lateral and vertical directions. The vertical cabin farthest in the lateral direction is numbered in sequence according to the vertical direction, and the numbered cabins are removed. The vertical cabin farthest away is then numbered according to the vertical direction until all numbering is completed.
[0108] After numbering, the order of the hatches that need to be loaded is selected according to the selected operation process, and the numbers are arranged, and the center coordinates of the hatches are recorded in sequence according to the above loading order. The recorded center coordinate positions and order of the hatches are reversely solved according to the height from the hatches required for loading and the attitude of the ship. The normal vector direction of the bottom of the cabin is determined by the attitude of the ship, and the position of the chute is taken as a certain distance in the normal vector direction. The distance is the distance from the chute to the hatch, which can be set through manual experience. This is used as the initial position of the chute unloading. The position of the corresponding chute is reversely calculated for each hatch, and the chute positions are numbered in sequence according to the above numbering order. For the initial chute position, the chute is controlled to the corresponding position by the controller, and the material height radar is used to detect the distance between the hatches. The threshold is used to determine whether the difference between different distances is too large, and the cabin is completed within the threshold range.
[0109] The present invention improves the existing deep learning model, wherein the improved deep learning model specifically uses a rotation alignment network to process the discretized point cloud model of the ship model, and the rotation alignment network includes a normalized T-net network and a matrix multiplication matrix, and the above input data is processed by the T-net network to generate a corresponding affine transformation matrix, and the reflection transformation matrix is multiplied by the input data through a matrix multiplier, and the final operation rotation alignment operation result is output, and the structural features of the three-dimensional local structure of the data are extracted from the above rotation alignment result through a 3D graph convolution network GCN, and the above rotation alignment is processed in parallel through a convolutional neural network CNN. Results: The point cloud features of the isolated points in the data point cloud are extracted, and the above structural features and point cloud features are weighted and fused. The weights can be pre-set according to artificial experience. The fusion result contains both local three-dimensional structural information and point cloud features of the point cloud itself. The fusion result is input into the next graph convolutional network, and the point cloud features are input into the next convolutional neural network. The output results of the next graph convolutional network and the convolutional neural network are weighted and fused again, and the weighted and fused results are input into the final graph convolutional network. The extracted output results are input into the fully connected layer for deep feature recognition, and the recognition finally outputs the point cloud position coordinates of the center point of the cabin.
[0110] Shipment volume detection and arrival volume warning technology
[0111] Using material flow tracking technology, 3D laser modeling technology, and material height detection in the hold, automatic hold change is completed after the single hold reaches the required quantity. Set up an early warning of the quantity reached, and communicate the loading operation information with the reclaimer and belt process to prepare for hold change, improve operation efficiency, and reduce the occurrence of coal spillage accidents.
[0112] The process includes: real-time calculation and detection of process material tracking, early warning of loading quantity, preparation for cabin change, completion of loading quantity, automatic cabin change, real-time calculation and detection of process material tracking, and dynamic detection of material height radar. Is it within the operating height threshold? If it is, it will operate normally, otherwise it will automatically adjust the extension and pitch of the chute.
[0113] Automatic tank alignment and change technology
[0114] After the ship scan is completed, the system can perform automatic tank alignment according to the loading operation plan prepared in advance by the operator. The loader will automatically complete the tank alignment according to the berth ship model, and perform automatic tank loading after confirmation by the operator. When the target loading tonnage reaches the preset tonnage, the automatic tank change operation is performed. In the process: the single tank loading volume reaches the quantity, the transfer path point calculation is completed, and the tank change action is performed.
[0115] After the single-chamber loading volume is reached at the initial chute position, the next chute position is extracted, and the moving path is generated through the inverse kinematics analysis of the robotic arm. The chute is moved to the next chute position, and the chute position is fine-tuned to align the cabin to achieve loading.
[0116] The ship's posture and model are used to carry out relevant tank alignment and tank change to achieve automated loading work. At the same time, the material tracking process is tracked in real time, and dynamic material height radar detection is performed to reduce the impact of dust and prevent material blockage during the material filling process.
[0117] The realization of remote centralized control of automated loading operations is achieved by installing laser scanning equipment as a detection device on the loader, performing real-time scanning of the ship's cabin, using a high-performance solution system to collect and process the scanner data, performing three-dimensional modeling of the real-time data, and calculating key operating parameters to achieve automated operation of the loader.
[0118] Remote operation in the control room is to realize remote manual operation and automatic operation monitoring of the ship loader in the control room through network planning and control programs.
[0119] 1) Realize remote operation of the ship loader. The ship loader's travel, pitch, extension, chute rotation and other auxiliary mechanisms can be controlled through the upper computer screen in the control room. The on-site manual operation function of the ship loader is retained, and it has manual and automatic switching functions to ensure that it can switch to manual mode regardless of the operating conditions. Remote and on-site switching switches are set in the ship loader's cab and the control room.
[0120] 2) The automatic system host computer workstation realizes the real-time display of the operating parameters and status of the ship loader equipment.
[0121] 3) Anti-collision alarm of the ship loader ensures safe operation.
[0122] 4) Realize fully automatic loading operation of the ship loader: Manually set the operation plan tasks, the automation system automatically reads the digital terminal berth database, obtains ship information, analyzes the operation plan content according to the loading operation instructions, calculates the action plan to be executed, and the ship loader moves to the set task, automatically rotates, pitches, and retracts, automatically starts the corresponding equipment according to the process, automatically performs loading operations, and feeds back relevant data to the digital berth ship database in real time, and monitors the loading operation. During the loading process, the automation system can be manually intervened at any time under any circumstances to remotely control the ship loader.
[0123] 5) The efficiency of fully automatic loading, material flow stability, loading flatness and other effects are no less than those of skilled workers.
[0124] The system can realize three operation control modes: fully automatic, remote semi-automatic, and remote manual. To facilitate system maintenance, the core process control logic of fully automatic, remote semi-automatic, and remote manual loading is all deployed in the PLC system, which receives operation instructions from the central control system before operation and feedbacks status information after operation, realizing functions such as belt start and stop, lighting system, and dust suppression system remote control.
[0125] In the fully automatic mode and remote manual / semi-automatic mode, the relevant operation information of the control room is transmitted by the real-time communication between the PLC in the control room and the single machine. At the same time, in order to ensure the stability of the system, it is independent of the newly added PLC system of the single machine.
[0126] Remote manual operation:
[0127] In this operation mode, the operator completely relies on the handles and buttons on the console to operate the equipment, monitors the movement of the equipment on site through the video monitoring screen, and checks the status parameters of the equipment through the human-machine interface. The remote control PLC system and the on-board PLC system provide corresponding interlocking control. This is similar to migrating the on-board manual operation function to the control room console.
[0128] In remote manual operation mode, the operation station is controlled one-to-one.
[0129] Remote semi-automatic loading operation:
[0130] Semi-automatic loading means that after the manual alignment is completed, the central control remote manual operation is used in the stage of finding the unloading point in the cabin, during which the video monitoring screen is used to assist the operation. When the alignment is completed, automatic control loading is adopted, during which some parameters can be adjusted during the semi-automatic operation.
[0131] In this operation mode, the operator inputs the relevant operation parameters through the HMI, and then uses the video monitoring screen to manually operate the relevant equipment at the key initial steps (such as the selection of the first loading cabin) with the help of the handles and buttons on the console, and the video monitoring screen is required to assist the operation. After completing the initial positioning and motion control of the equipment, it then enters the automatic loading process. The equipment automatically operates according to the input parameters. During this period, some parameters can be adjusted during the semi-automatic operation, and a prompt will be given after the semi-automatic operation is completed.
[0132] Remote automatic loading operation:
[0133] The remote centralized control system can collect various information and parameters generated during the operation of the monitored equipment, such as fault information and operating status parameters, in real time and transmit them to the server in the central control room through the network, and reflect the operating status of the equipment through various screen images. Large machinery can be monitored and diagnosed through a general browser, and functions such as status monitoring, fault analysis, parameter query, operation maintenance, trend viewing and production statistics can be realized at the same time, and historical playback and other functions can be provided. The above functions require recording and display in various forms such as pictures, charts, and various bar graphs. Key parts provide three-dimensional visual simulation interactive functions. Classify, store, count and categorize the recorded content. Provide the technical status of the equipment to equipment maintenance personnel and management departments in a timely manner, and provide real-time and accurate data basis for equipment maintenance and use, so as to achieve the purpose of remote monitoring and management of related equipment.
[0134] To meet the needs of the site, when the operator determines the loading operation unit based on the production plan and current unit status in the dock berth production management system, the loading system combines the cabin model and, after background strategy analysis, forms a loading instruction and transmits it to the unit. After receiving the instruction, the operating unit automatically aligns the cabin and automatically pitches and retracts to the predetermined position for operation. During the operation, the tilt of the operating hull is monitored in real time, and the adjusted dynamic coordinate information is given to adjust the absolute coordinate information of the operating point. Collision prevention and other operations are automatically performed until all loading operations are completed. The operating hull on the sea surface undergoes dynamic changes, and the action is adjusted through real-time feedback data and real-time strategy analysis by the background three-dimensional server.
[0135] Overall system design capabilities:
[0136] 1) The equipment is equipped with a slide anti-collision system, hardware sensors, and anti-scratch and collision devices and systems based on Beidou positioning and three-dimensional ship models.
[0137] 2) The equipment is equipped with a ship model monitoring system.
[0138] 3) The equipment's chute rotation, pitch, extension and travel use a reliable and accurate positioning system (the chute's positioning accuracy deviation in the x, y and z directions is no more than ±15cm), and the output update frequency is >10Hz.
[0139] 4) Network communication adopts optical fiber Ethernet communication mode, and the communication between the centralized control and the machine is carried out through the optical fiber required for the transmission of the ship loader's own control signal and video signal.
[0140] 5) Single-machine distributed sensors meet the needs of all-weather operation under port conditions.
[0141] Human-computer interaction interface design
[0142] This project intends to use virtual servers and operating systems for software development and deployment. The FactoryTalk SE platform is used for software development. The software adopts the client / server model to provide the necessary operation interface for centralized control operators to complete remote operation and intelligent operation.
[0143] The software has the following functions:
[0144] A complete set of fully automatic loading control procedures is developed based on the existing loading control process to achieve automatic loading with one-touch control, while also enabling disturbance-free switching between manual and automatic.
[0145] The remote monitoring system has real-time data display function, which collects data through OPC and other methods to display the current working status, location and other information of each device. The system can display the information of the device globally and locally.
[0146] The remote operation and intervention function controls the relevant mechanisms of the remote loader through the operation controls on the operation interface, sends remote operation or intervention instructions, and controls the operation of the equipment.
[0147] Establish an automated work order function, receive automated loading operations through the automated work order interface, set or adjust automated operation processes and parameters, start / stop automated operation tasks, and collect statistics on key indicators of automated operations.
[0148] Remote equipment maintenance function: monitor the operating status of each mechanism of the ship loader, manage the operating data of the equipment and related production statistics, etc. through the remote monitoring interface.
[0149] Safety protection sensor self-check and graphical display, laser scanner, millimeter wave radar, encoder and correction system, ultrasonic sensor, etc. can realize process self-check, early warning prompt in case of failure, and the correction system can warn of the missing correction block. The actual measurement values of laser scanner, millimeter wave radar, encoder and correction system can be graphically displayed on the remote control interface of the ship loader, and an early warning will be issued when a large abnormal value change occurs.
[0150] 7) Realize the operator employee number login function and automatically count the personnel operation data according to the operator employee number.
[0151] The control terminal of the present invention adopts a hyper-convergence solution
[0152] Hyper-convergence refers to the integration of all virtualized computing resources (CPU, storage, network, etc.) into a general-purpose X86 server, and can facilitate horizontal expansion of capacity. Compared with traditional cloud architecture, hyper-convergence private cloud does not require external storage and fiber switches. It greatly simplifies the architecture, saves a lot of money, and reduces management difficulty.
[0153] It provides unified graphical interface management software, which can complete the daily management of all virtual machines in one place, including control management, CPU memory management, user management, storage management, network management, cluster management, log collection, performance analysis, fault diagnosis, permission management, online maintenance, etc. It can also directly configure and manage storage arrays, and has multi-path management functions for storage arrays. It supports QoS capabilities and automatic service level management functions based on applications.
[0154] Provides HA function. When the host hardware or virtualization software in the cluster fails, the virtual machine on the host can be automatically restarted on other hosts in the cluster. When the guest operating system of the virtual machine fails, the guest operating system of the virtual machine can be automatically restarted to ensure business continuity. Automatic and cataloguable virtual machine restart can be achieved, and automatic restart of virtual machines can be achieved with the help of dependencies.
[0155] Supports multiple independent server local SSDs or disks to form a shared storage resource pool. Based on object-oriented storage architecture, it has structured and unstructured storage capabilities, is easy to manage, and supports horizontal expansion.
[0156] SSDs are used as high-speed read cache and write cache, and dynamically adjustable virtual machine-level read and write cache reservations are provided to ensure the read and write performance of important applications.
[0157] Hyper-convergence Solution Introduction
[0158] The hyper-converged cluster is configured with 2 nodes. An additional physical machine or virtual machine is required as the arbitration node (requires network interconnection with the hyper-converged node). The cluster enables the dual-copy strategy to ensure data security, and the available storage resources are about 30T. It supports online hot adding of disks or nodes to expand storage capacity and computing capacity. Adding new nodes does not affect the operation of existing services. After the expansion is completed, the business system can be migrated to the new node without stopping.
[0159] Two-node VSAN cluster expansion
[0160] Introduction to Two-Node VSAN
[0161] Generally, vSAN requires three servers to build a cluster. From the perspective of protecting data reliability, a copy of data is stored in two servers A and B in a mirrored manner, which can provide highly reliable data protection and provide server C to deal with network failures between servers A and B. In this case, servers A and B are both running normally, and server C plays the role of witness. vSAN will decide whether server C will re-form a new vSAN cluster with one of A and B based on the votes of the three servers. Because data is stored on both A and B, the data will not be lost, and a copy of the data will be copied to server C after the cluster is reorganized. Without a witness node, servers A and B will try to reorganize the vSAN cluster, which is called split-brain.
[0162] To help customers reduce hardware deployment costs as much as possible, vSAN supports dual-node cluster architecture starting from version 6.5. A complete vSphere / vSAN cluster environment can be built with at least two servers. Data is stored in mirrored form on two servers. The witness role is played by a virtual machine, which is generally run in the data center of the corporate headquarters and connected to the vSAN dual-node cluster of the branch through the network. It participates in the reorganization of the branch vSAN cluster when necessary. The witness virtual machine does not provide specific data services, so the requirements for the wide area network are relatively low.
[0163] vSAN specifically provides Witness Appliance to deploy witness virtual machines. Witness Appliance is a pre-made Linux virtual machine that contains all the functions of a witness server. You only need to download it, deploy it to the data center, and then configure some necessary parameters.
[0164] Expanding a two-node cluster to multiple nodes
[0165] When the workload increases in the future, the two-node vSAN cluster can also add more servers to become a three-node or four-node vSAN cluster. It should be noted here that the witness VM is only used in the two-node cluster scenario. When the cluster becomes three-node, the newly added server can take on the responsibility of witnessing, and the witness VM is no longer needed.
[0166] Video surveillance system
[0167] Combined with the actual situation on site, for remote monitoring, a digital high-definition PTZ camera is added to the single machine to monitor the tower top view, the driver's cab view (observing the cantilever belt, etc.), the chute rotating platform view, the cantilever belt view, the cable drum view, the tail car view, the driver's cab indoor view, the electrical room indoor view, the funnel baffle position or the chute view, the electrical room door view, etc. In addition to meeting the remote monitoring needs, the specific installation location adds a maintenance platform for subsequent maintenance according to the needs, and installs a set of NVR network hard disk recorders on the single machine to perform real-time recording on the machine to prevent the interruption of video recording when the remote network fails.
[0168] The newly added monitoring system realizes the functions of collecting, transmitting, controlling, processing, displaying, storing and querying the video signals of the ship loader. The video monitoring screen can be switched, adjusted and displayed according to different operations and pre-set settings.
[0169] Communication system network design
[0170] The communication system network includes industrial fieldbus network (control network), industrial Ethernet (ETHERNET network) and industrial TV network. Ethernet uses optical cable communication. These network technologies are used to realize data communication between laser scanners, central control servers, central control automation PLC systems, ship loader PLC systems, operation monitoring stations and other equipment, as well as to realize real-time video monitoring of ship loader operations.
[0171] Redundant communication methods such as optical fiber transmission and industrial wireless directional antenna (reuse) or 5G transmission are used to ensure reliable data transmission and smooth production.
[0172] The control communication and video communication from a single machine to the central control room use separate dual-channel optical fiber communications without affecting each other. The network optical fiber uses the existing optical fiber on site to establish an industrial Ethernet between the centralized control system and the single machine at the terminal, realizing information and data exchange and sharing between systems.
[0173] Ethernet communication is used between the central control PLC, central control computer system, onboard PLC, onboard server, and host computer configuration software. It is mainly used to issue loading instructions, modify loading parameters, adjust the rotation angle of the chute during loading, and adjust the loading point coordinates during the loader operation. When the loader starts to move, it obtains relevant information from the PLC. When the loader is ready to change cabins, it obtains the current working cabin information from the PLC. When the loading task starts or ends, it obtains the current walking, telescopic, pitching, chute rotation and other information from the PLC.
[0174] Voice broadcast system
[0175] A set of IP network-based broadcasting is added to the ship loader, taking advantage of the TCP / IP protocol for network communication, and built based on the existing LAN / WAN network. Each single machine is equipped with a remote sound amplification intercom system and is uniformly controlled by the control room, so that the control room operator can warn and drive away personnel who interfere with the operation. The sound amplification intercom system can be enabled by the control room according to the single machine selection, or it can be automatically broadcasted by the PLC of the on-site equipment. System configuration: At present, the ship loader broadcasting is mainly positioned as production service broadcasting, mainly covering the following: dock operation site, select high-quality speakers from the auditory point of view, and play a good sound effect.
[0176] Broadcast center room configuration:
[0177] The broadcast center is the core of the broadcast system. It imports digital audio files into the media library of the IP network broadcast software or collects external audio sources through the host sound card, converts analog signals into digital signals, transmits them to the audio terminal through the local area network LAN (can cross network segments and routers), and plays them out from the front-end speakers; install IP network active speakers in the broadcast room to monitor the content played in the broadcast system. On the dock loader: Design area: outdoor area; Speaker selection: Use outdoor waterproof sound columns and adopt wall-mounted installation; layout distance is 30 meters; meet the needs of employees ringing and leaving get off work on time, broadcasting and shouting, and playing safety information. Zoning: Zoning is carried out according to the outdoor area, and a total of 6 zones are designed; Wiring: Indoor broadcast lines use RVV2×1.5 sheathed speaker lines, and the lines are laid hidden in the ceiling through pipes;
[0178] The above are only preferred specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. An automated ship loading control system, characterized in that: include: Detection devices, local controllers, centralized remote control terminals and ship loaders; The detection device is arranged on the ship loader, and the local controller is connected to the detection device and the ship loader respectively, wherein the local controller is connected to the centralized remote control terminal; The detection device is used to collect the morphological data and protection data of the ship in real time; The local controller is used to receive and store the data collected by the detection device, and receive the loading instruction, and based on the loading instruction, control the loader to perform the tank adjustment action, tank change action and stop action through the protection data and the point cloud data to control the loader to load the ship; The centralized remote control terminal is used to model the morphological data, construct a ship model, and generate a loading instruction based on the ship model; In the local controller, the generation process of the cabin action, cabin change action and stop action includes: receiving a loading instruction, wherein the loading instruction includes positions of different cabins in the ship model and a loading sequence; Generate a cabin alignment command based on the ship's position through local control, control the cabin alignment command to move the chute of the ship loader to the corresponding chute position in the cabin, and detect the distance between the cabin and the chute based on the material radar, perform threshold judgment on the detection result, and implement the cabin alignment action based on the threshold judgment result; After the cabin action is completed, the loading quantity is detected in real time. When the loading quantity reaches the required value, the cabin is changed. During the detection process, the protection data collected by the material radar is detected. When the protection data is within the operating height threshold, the operation is normal, otherwise the telescopic pitch adjustment of the chute is performed; During the cabin change operation, the position of the chute corresponding to the next cabin is extracted, and the cabin transfer path is generated through the inverse kinematics solution method. The chute is controlled to perform the cabin transfer action according to the cabin transfer path; Ship attitude detection and cabin alignment Place a ship attitude detector on the ship to detect the ship attitude and ship type, and transmit the detection results to the ship loader control system. The ship loader determines the tank alignment position according to the ship type data and ship attitude, and performs tank alignment operations; In the cabin inspection operation, the ship model is first received. In the automated detection process, the hatch of the cabin is identified. The ship model is identified using a deep learning model. The coordinates of the center point cloud of the cabin are identified and generated. The position of the center point cloud of the cabin feature area is recorded. According to the relative position of the cabin feature area and the ship posture, the identified cabin is numbered. During the numbering process, the identified center point of the cabin is fine-tuned to align left and right, and the direction data in the ship's attitude data is used to determine the ship's docking direction. The docking direction of the ship and the left rotation of 90 degrees are used as the basis for the transverse direction and the vertical direction. The vertical cabin farthest from the transverse direction is numbered in sequence according to the vertical direction, and the numbered cabins are removed, and the farthest vertical cabin is numbered according to the vertical direction until all the numbering is completed; After numbering, the order of the hatches to be loaded is selected according to the selected operation process, and the center coordinates of the hatches are recorded in sequence according to the above loading order. The recorded center coordinate positions and order of the hatches are reversely solved according to the height from the hatches required for loading and the attitude of the ship. The normal vector direction of the bottom of the cabin is determined by the attitude of the ship, and the position of the chute is taken as the position of the chute at a certain interval in the normal vector direction. The interval is the interval from the chute to the hatch, which is used as the initial position of the chute unloading. The position of the corresponding chute is reversely calculated for each hatch. The chute positions are numbered in sequence according to the above numbering order. For the initial chute position, the chute is controlled to the corresponding position by the controller, and the material height radar is used to detect the distance between the hatches. The threshold is used to determine whether the difference between different distances is too large. If it is within the threshold range, the cabin is completed; The deep learning model specifically uses a rotation alignment network to process the discretized point cloud model of the ship model. The rotation network includes a normalized T-net network and a matrix multiplication matrix. The input data is processed through the T-net network to generate the corresponding affine transformation matrix. The reflection transformation matrix is multiplied by the input data through a matrix multiplier to output the final rotation alignment operation result. The structural features of the three-dimensional local structure of the data are extracted from the above rotation alignment results through the 3D graph convolution network GCN, and the data point cloud isolated points themselves are isolated from the above rotation alignment results in parallel through the convolutional neural network CNN. Point cloud feature extraction is performed, and the above structural features and point cloud features are weighted and fused. The weights can be pre-set according to manual experience. The fusion result contains both local 3D structural information and point cloud features of the point cloud itself. The fusion result is input into the next graph convolutional network, and the point cloud features are input into the next convolutional neural network. The output results of the next graph convolutional network and the convolutional neural network are weighted and fused again, and the weighted and fused results are input into the final graph convolutional network. The extracted output results are input into the fully connected layer for deep feature recognition, and the recognition finally outputs the point cloud position coordinates of the center point of the cabin.
2. The system according to claim 1, characterized in that: The detection device includes a plurality of positioning devices, radars, laser scanners and attitude sensors, wherein the positioning devices, radars and laser rangefinders are arranged on the ship loader, and the attitude sensor is arranged on the loading hull.
3. The system according to claim 1, characterized in that: Millimeter-wave radars are arranged on both sides of the ship loader's walking track, on both sides of the boom, and in front, behind, and on the left and right sides of the chute. The millimeter-wave radars are used to collect the protection data, wherein the protection data is the distance data between the radar and the object. A threshold judgment is performed on the protection data through local control, and a stop command is generated based on the judgment result to control the ship loader to stop to prevent a collision.
4. The system according to claim 2, characterized in that: The positioning device comprises an absolute value encoder, a correction switch and a GNSS positioning device, wherein the positioning device is arranged on a walking wheel, a telescopic motor, a pitching motor, a chute rotating motor and a shovel swing shaft.
5. The system according to claim 2, characterized in that: In the centralized remote control terminal, the process of modeling the morphological data includes: A laser scanner is arranged on the ship loader, and the ship loader is controlled to move through the laser scanner for laser scanning; three-dimensional modeling is performed on the point cloud data after the laser scanning to generate initial ship model data; the radar is arranged above the chute of the ship loader to collect the contour data of the hatch in real time during the loading operation, and the initial ship model data is updated according to the contour data, ship size data and posture data to generate real-time ship model data.
6. The system according to claim 1, characterized in that: Both the local controller and the centralized remote control terminal are provided with an operation console, through which manual operation is performed.
7. The system according to claim 1, characterized in that: The operating console is provided with an automatic control interface, a video monitoring interface and a ship database system interface, wherein the automatic control interface is used to display the working status of the ship loader, the video monitoring interface is used to display the loading site video, and the ship database system interface is used to manually control the remote operation of the ship loader; wherein the operating console is also provided with a ship loader control device for remote manual control of the ship loader.
8. The system according to claim 1, characterized in that: A voice broadcasting system is also provided on the ship loader, wherein the voice broadcasting system is used for voice broadcasting, wherein the voice broadcasting system is a broadcasting system based on an IP network, using the network communication TCP / IP protocol, and is constructed based on an existing LAN / WAN network.
9. The system according to claim 1, characterized in that: The centralized remote control terminal and the local controller include three operation control modes: fully automatic, remote semi-automatic, and remote manual.
