Anti-collision method and device and electronic equipment

By setting multiple cameras on the side of the stadium bridge car to collect images and extract features, and perform anti-scratch alarms, the problems of low manpower efficiency and incomplete radar data in the existing technology are solved, and a more efficient anti-scratch effect is achieved.

CN118992844APending Publication Date: 2024-11-22SANY MARINE HEAVY INDUSTRY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411375910.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-29
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

During the process of grabbing and placing containers on the field bridge spreader, relying on manpower to avoid friction efficiency, loss or incomplete existing radar data, resulting in calculation errors, low judgment accuracy, and poor anti-scratch effect.

Method used

By setting up multiple cameras on the side of the yard bridge car, we collect images with wide views to be processed, extract marker features, target container features, adjacent container features and area features to be placed, and use these features to prevent scratches and collision warnings to remind the suspension tool Or the loading container may be rubbed.

Benefits of technology

It improves the accuracy and efficiency of anti-scratch, reduces the friction between spreaders and lift containers, and ensures the safety and efficiency of operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118992844A_ABST
    Figure CN118992844A_ABST
Patent Text Reader

Abstract

The invention provides an anti-collision method and device and electronic equipment, and the method comprises the steps: collecting a to-be-processed image through a plurality of cameras which are disposed on the side surface of a yard bridge trolley and have visual angles perpendicular to the ground, and extracting anti-collision features in the to-be-processed image, namely, a marker feature, a target container feature, an adjacent container feature and a to-be-placed region feature; afterwards, based on the anti-collision characteristics, anti-collision warning is carried out so as to remind that the lifting appliance or the suspended load container may be collided. Therefore, the camera arranged on the side face of the field bridge trolley is wide in view angle, comprehensive and accurate to-be-processed images can be collected, accurate anti-collision features can be extracted based on the to-be-processed images, then anti-collision warning is timely and accurately carried out based on various features in the anti-collision features, related personnel can take measures in time, and the safety of the field bridge trolley is improved. And therefore, the collision between the lifting appliance and the lifting container is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of anti-collision technology, and in particular to an anti-collision method, device and electronic equipment. Background Art

[0002] In the process of grabbing and placing containers by the yard crane, relying on manpower to avoid collision requires a lot of manpower and material resources and has low efficiency.

[0003] In order to improve the efficiency of anti-collision, the crane crane is usually controlled to grab and place containers based on the data collected by the radar. However, the data collected by the radar is often lost or incomplete, resulting in miscalculation, low judgment accuracy and poor anti-collision effect. Summary of the invention

[0004] Based on the defects and shortcomings of the above-mentioned prior art, the present application proposes an anti-collision method, device and electronic equipment, which can collect images to be processed with a wider field of view through multiple cameras arranged on the side of the field bridge trolley and with a viewing angle perpendicular to the ground. Based on the anti-collision features in the images to be processed monitored in real time, it can more accurately determine whether a collision is likely to occur, thereby performing accurate anti-collision alarms and achieving better anti-collision effects.

[0005] According to a first aspect of an embodiment of the present application, there is provided an anti-collision method, comprising:

[0006] The image to be processed is collected by multiple cameras, the multiple cameras are arranged on the side of the yard crane trolley and the viewing angle is perpendicular to the ground, the image to be processed includes the target container, the adjacent containers of the target container and the markers on the yard crane hoist, the target container is a hoisted container or a container to be hoisted, the adjacent containers of the hoisted container are containers adjacent to the area to be placed of the hoisted container, and the adjacent containers of the container to be hoisted are containers adjacent to the container to be hoisted;

[0007] Extracting anti-collision features in the image to be processed, wherein the anti-collision features include marker features, target container features, adjacent container features, and to-be-placed area features;

[0008] Based on the anti-collision feature, an anti-collision alarm is issued, and the anti-collision alarm is used to remind the spreader or the hoisted container that a collision may occur.

[0009] According to a second aspect of an embodiment of the present application, there is provided an anti-collision device, comprising:

[0010] An image acquisition module is used to acquire images to be processed through multiple cameras, wherein the multiple cameras are arranged on the side of the yard crane trolley and the viewing angle is perpendicular to the ground, and the images to be processed include a target container, containers adjacent to the target container, and markers on the yard crane hoist. The target container is a hoisted container or a container to be hoisted. The adjacent containers of the hoisted container are containers adjacent to the area to be placed of the hoisted container, and the adjacent containers of the container to be hoisted are containers adjacent to the container to be hoisted.

[0011] A feature extraction module, used to extract anti-collision features in the image to be processed, wherein the anti-collision features include marker features, target container features, adjacent container features, and to-be-placed area features;

[0012] The anti-collision alarm module is used to issue an anti-collision alarm based on the anti-collision feature, wherein the anti-collision alarm is used to remind the spreader or the hoisted container that a collision may occur.

[0013] According to a third aspect of an embodiment of the present application, there is provided an electronic device, including a memory and a processor;

[0014] The memory is connected to the processor and is used to store programs;

[0015] The processor is used to implement the anti-collision method as described in the first aspect by running the program in the memory.

[0016] According to a fourth aspect of an embodiment of the present application, a storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the anti-collision method as described in the first aspect is implemented.

[0017] In the above-mentioned anti-collision method, device, electronic device and vehicle, multiple cameras arranged on the side of the yard bridge trolley with a viewing angle perpendicular to the ground can be used to collect images to be processed, and anti-collision features in the images to be processed, namely, features of markers, features of target containers, features of adjacent containers and features of the area to be placed, can be extracted. Then, based on the anti-collision features, anti-collision alarms can be issued to remind the spreader or the hoisted container that a collision may occur. In this way, due to the wide viewing angle of the camera arranged on the side of the yard bridge trolley, comprehensive and accurate images to be processed can be collected, and accurate anti-collision features can be extracted based on the images to be processed. Then, based on the various features in the anti-collision features, anti-collision alarms can be issued in a timely and accurate manner, so that relevant personnel can take timely measures, thereby reducing the collision between the spreader and the hoisted container. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0019] Figure 1 A schematic diagram of a process flow of an anti-collision method provided in an embodiment of the present application;

[0020] Figure 2 A schematic diagram of a camera installation position provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of a certain camera viewing angle provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of a box stacking working condition provided in an embodiment of the present application;

[0023] Figure 5 A schematic diagram of an open bottom working condition proposed in an embodiment of the present application;

[0024] Figure 6 A schematic diagram of a box grabbing working condition proposed in an embodiment of the present application;

[0025] Figure 7 A schematic diagram of an anti-collision process proposed in an embodiment of the present application;

[0026] Figure 8 A schematic diagram of the structure of an anti-collision device proposed in an embodiment of the present application;

[0027] Fig. 9 A schematic diagram of the structure of an electronic device proposed in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0029] Overview

[0030] As described in the background technology, in the process of grabbing and placing containers by crane, it is necessary to rely on manpower to avoid collision, which consumes a lot of manpower and material resources and has low efficiency. In order to improve the efficiency of anti-collision, the crane is usually controlled to grab and place containers based on the data collected by radar. However, the data collected by radar is often lost or incomplete, resulting in calculation errors, low judgment accuracy, and poor anti-collision effect.

[0031] On this basis, the inventors found through further research that by setting multiple cameras on the side of the yard crane trolley and with a viewing angle perpendicular to the ground, the image to be processed is collected, and the image to be processed includes the target container, the adjacent container of the target container, and the marker on the yard crane hoist. The target container is a hoisted container or a container to be hoisted, and the adjacent container is a container adjacent to the area to be placed of the hoisted container, or a container adjacent to the container to be hoisted. After that, the anti-collision features in the image to be processed are extracted, that is, the marker features, the target container features, the adjacent container features, and the features of the area to be placed. After that, based on the anti-collision features, an anti-collision alarm is issued to remind the hoist or the hoisted container that a collision may occur. In this way, due to the wide viewing angle of the camera set on the side of the yard crane trolley, a comprehensive and accurate image to be processed can be collected, and accurate anti-collision features can be extracted based on the image to be processed. After that, based on the various features in the anti-collision features, an anti-collision alarm is issued in a timely and accurate manner, so that relevant personnel can take measures in a timely manner, thereby reducing the collision between the hoist and the hoisted container.

[0032] Based on the above concept, an embodiment of the present specification provides an anti-collision method, which will be exemplarily described below in conjunction with the accompanying drawings.

[0033] Exemplary Methods

[0034] See also Figure 1 In an exemplary embodiment, a method for preventing collision is provided, which is applied to any electronic device, which can be arranged on a field bridge, for example, and can control a field bridge hoist.

[0035] like Figure 1 As shown, the anti-collision method includes steps S101-S103:

[0036] S101: Collecting images to be processed through multiple cameras.

[0037] Wherein, multiple cameras are arranged on the side of the field bridge trolley and the viewing angle is perpendicular to the ground. Exemplarily, the number of these multiple cameras is 4, which are arranged on the side of the field bridge trolley, respectively located on different sides of the field bridge trolley, or located at the intersection of different sides of the field bridge trolley. Alternatively, exemplarily, the number of these multiple cameras can also be 2, which are respectively arranged on two diagonal corners of the field bridge trolley, or respectively arranged on two opposite sides of the field bridge trolley.

[0038] For example, take 4 cameras as an example. Figure 2 As shown in the figure, the four cameras are a, b, c, and d. A trolley is provided on the yard bridge, i.e., the yard bridge trolley. The movement of the yard bridge trolley drives the movement of the spreader, which is used to grab and place containers. The four cameras a, b, c, and d are respectively set on different sides of the yard bridge trolley. A and c are respectively set on two sides in the direction of the trolley movement, i.e., the direction of the trolley, and b and d are respectively set on the other two sides of the yard bridge trolley.

[0039] The above-mentioned multiple cameras may also be replaced by other image acquisition devices.

[0040] The image to be processed includes the target container, the adjacent containers of the target container, and the markers on the crane crane. That is, each camera has the target container, the adjacent containers of the target container, and the markers on the crane crane under its viewing angle.

[0041] The target container is a loaded container or a container to be loaded. A loaded container is a container loaded by a crane, and a container to be loaded is a container that needs to be loaded by a crane but has not been loaded. Correspondingly, an adjacent container of a loaded container is a container adjacent to the area to be placed for the loaded container, and an adjacent container of a container to be loaded is a container adjacent to the container to be loaded.

[0042] Generally, the area to be placed for the hoisted container is the upper surface area of ​​other containers, or a preset area on the ground, wherein the preset area can be defined by drawing a white line on the ground.

[0043] It is understandable that the adjacent containers of the suspended container include containers adjacent to the area to be placed of the suspended container in the direction of the large vehicle and / or containers adjacent to the area to be placed of the suspended container in the direction of the small vehicle.

[0044] Specifically, the marker on the field crane spreader can be set above the lock head at one corner of the spreader. By setting the marker, the detection success rate of the spreader lock head can be improved, ensuring that the spreader corners can be stably detected in the collected image.

[0045] For example, taking the camera c in the above example as an example, its viewing angle can be as follows: Figure 3As shown, this perspective includes the hoisted container, the markers on the hoisting device, and the adjacent containers (of the hoisted container). Figure 3 As shown, a marker is arranged on the lock head of the crane hoist, and the hoist carries a hoisting container to place the hoisting container at a position to be placed.

[0046] S102: Extracting anti-collision features in the image to be processed.

[0047] Among them, the anti-collision features include marker features, target container features, adjacent container features and to-be-placed area features.

[0048] The target container feature may refer to the corners and / or edges of the target container, the adjacent container feature may refer to the corners and / or edges of the adjacent containers, and similarly, the to-be-placed area feature may refer to the corners and / or edges of the to-be-placed area. Generally, the size and shape of the to-be-placed area are the same as the size and shape of the lower surface of the container.

[0049] Based on different actual working conditions, if the corners of the container cannot be collected and thus the corner point of the container cannot be obtained, the lock hole of the container close to the corner point can be used as the corner point.

[0050] The features in the image to be processed, namely the anti-collision features mentioned above, are extracted through detection and segmentation algorithms.

[0051] Exemplarily, the anti-collision feature can be obtained from the image to be processed captured by the camera through the yolov8 algorithm.

[0052] On this basis, the (plane) coordinates of the required corner points and edges (lines), that is, the coordinates of the corner points and edges in the plane coordinate system of the image to be processed, can be extracted. Among them, the corner points include the corner points of the target container, the corner points of the area to be placed, and the corner points of the adjacent containers, etc., and the edges include the edges of the target container, the edges of the area to be placed, and the edges of the adjacent containers, etc.

[0053] S103: Based on the anti-collision feature, an anti-collision alarm is issued.

[0054] The anti-collision alarm is used to remind that the spreader or the suspended container may collide, that is, the spreader may collide with the container, or the suspended container may collide with the adjacent container at the location where it is to be placed.

[0055] Based on the coordinates of the anti-collision feature, the distances of different features in the direction of the large vehicle and the small vehicle are directly calculated, and the distance is used to judge whether the spreader or the hoisted container may collide. Afterwards, if it is judged that the spreader or the hoisted container may collide, an anti-collision alarm signal is generated and issued to perform an anti-collision alarm, and timely remind relevant personnel that the spreader or the hoisted container may collide, so that relevant personnel can take measures to avoid collision; if it is judged that the spreader or the hoisted container will not collide, no operation is performed and work is carried out according to the original execution logic.

[0056] While issuing an anti-collision alarm, the spreader can also be controlled to slow down or stop or perform a reverse action.

[0057] In this embodiment, multiple cameras arranged on the side of the yard bridge trolley with a viewing angle perpendicular to the ground can be used to collect images to be processed, and anti-collision features in the images to be processed, namely, features of markers, features of target containers, features of adjacent containers, and features of the area to be placed, can be extracted. Then, based on the anti-collision features, anti-collision alarms can be issued to remind the spreader or the hoisted container that a collision may occur. In this way, due to the wide viewing angle of the camera arranged on the side of the yard bridge trolley, comprehensive and accurate images to be processed can be collected, and accurate anti-collision features can be extracted based on the images to be processed. Then, based on the various features in the anti-collision features, anti-collision alarms can be issued in a timely and accurate manner, so that relevant personnel can take timely measures, thereby reducing the collision between the spreader and the hoisted container.

[0058] In some embodiments, when an anti-collision warning is issued based on the anti-collision feature, the anti-collision feature can be selected based on the current working condition to obtain a target anti-collision feature corresponding to the current working condition, and then an anti-collision warning is issued based on the target anti-collision feature. The target anti-collision feature is at least two of the anti-collision features.

[0059] In this embodiment, based on different current working conditions, features in the anti-collision features are selected as target collision features, and anti-collision warnings are performed based on the target anti-collision features to implement anti-collision warnings for different working conditions.

[0060] In some embodiments, the sling working conditions include box stacking working conditions, bottom opening working conditions, and box grabbing working conditions, etc., which can be specifically divided based on actual application conditions and are not limited to the working conditions given in this application.

[0061] Correspondingly, the current working condition is one of a box stacking working condition, a bottom opening working condition and a box grabbing working condition.

[0062] The stacking condition is the condition of placing the hoisted container on other containers, the bottom opening condition is the condition of placing the hoisted container on the ground, and the grabbing condition is the condition of grabbing the container to be hoisted. Other containers are the containers located below the hoisted container after the hoisting device places the hoisted container.

[0063] Based on the current working condition, the anti-collision feature is selected to obtain the target anti-collision feature corresponding to the current working condition. Since both the stacking condition and the bottom opening condition involve lifting the container carried by the sling to the position to be placed, the stacking condition and the bottom opening condition can be roughly classified as the same situation. At this time, if the current working condition is the stacking condition or the bottom opening condition, the target container is the lifting container, and the lifting container features, the adjacent container features and the to-be-placed area features are determined as the target anti-collision feature; if the current working condition is the grabbing condition, the target container is the to-be-lifted container, and the marker features, the to-be-lifted container features and the adjacent container features are determined as the target anti-collision feature.

[0064] Specifically, based on the difference between stacking and opening conditions, the features of the area to be placed are also obtained differently. For stacking conditions, the area to be placed is the upper surface of the container that is to be stacked and will be located below the container, that is, the area to be placed is the features of the upper surface; for opening conditions, since the preset area where the container is located is generally defined by a white line, the white line is, for example, Figure 2 The frame of the container shown in FIG. 1 is a container frame. At this time, the area to be placed is the area defined by the white line, that is, the characteristics of the area to be placed are the characteristics of the area defined by the white line.

[0065] For example, referring to the above Figure 3 The camera view, the stacking condition can be as follows Figure 4 As shown, E represents the marker on the sling, a is the edge of the container lifted by the sling, i.e., the lifted container, A is the corner point of the lifted container, b is the edge of the container below the area to be placed of the lifted container, B is the corner point of the container below the area to be placed of the lifted container, c is the edge of the container adjacent to the area to be placed in the direction of the trolley, and C is the corner point of the container adjacent to the area to be placed in the direction of the trolley.

[0066] For example, the open bottom condition can be as follows Figure 5 As shown, Figure 5 The area formed by the four dotted lines is the area where the hoisted container is to be placed. Figure 5 For the introduction of E, a, A, c, C, and D, please refer to the above Figure 4 Introduction.

[0067] For example, the box grabbing condition can be as follows Figure 6 As shown, Figure 6The introduction of E, c, C, and D can be found in the above example, where b is the edge of the container to be lifted, and B represents the corner point of the container to be lifted.

[0068] In this embodiment, the working conditions are divided into stacking, bottom opening and grabbing conditions. Based on the current working conditions, the target anti-collision feature corresponding to the current working condition is selected. When the current working condition is the stacking condition or the bottom opening condition, the target container is determined to be a hanging container, and the hanging container feature, the adjacent container feature and the to-be-placed area feature are determined as the target anti-collision feature. When the current working condition is the grabbing condition, the target container is determined to be a to-be-hanging container, and the marker feature, the hanging container feature and the adjacent container feature are determined as the target anti-collision feature. In this way, according to different current working conditions, appropriate anti-collision features can be selected as target anti-collision features for anti-collision alarm, so as to achieve the effect of accurate and timely anti-collision alarm under various working conditions.

[0069] In some embodiments, when the current working condition is a stacking condition or an open bottom condition, an anti-collision alarm is issued based on the target anti-collision feature, including:

[0070] Based on the current plane coordinates of the target anti-collision feature, combined with the polynomial curve of the plane coordinates of the target anti-collision feature changing with the height, the current height of the target anti-collision feature is determined. Then, based on the current heights of the adjacent container features and the current heights of the features of the area to be placed, it is determined whether an anti-collision alarm is needed.

[0071] The plane coordinates are coordinates in the coordinate system of the plane where the image to be processed is located. Generally, the plane coordinates can be, for example, (x, y).

[0072] In addition, the polynomial curve has a good fitting effect and can characterize the correspondence between the coordinates of the feature in the image to be processed and the actual height based on historical data calibration.

[0073] Specifically, if the current height of the adjacent container features is higher than the current height of the features of the area to be placed, the hoisted container needs to be lowered to the area to be placed whose lower surface is lower than the current height of the adjacent container. Collision may occur. At this time, an anti-collision alarm can be issued based on the hoisted container features, the adjacent container features and the features of the area to be placed, that is, the target anti-collision features corresponding to the current working conditions.

[0074] Correspondingly, if the current height of the adjacent container feature is not higher than the current height of the feature of the area to be placed, when the hoisted container is lowered to the area to be placed, the lower surface of the hoisted container is not lower than the adjacent container, and there will be no collision with the container. At this time, no operation is required.

[0075] In this embodiment, the current height of the target anti-collision feature is determined based on the current plane coordinates of the target anti-collision feature and the polynomial curve of the change of the plane coordinates of the target collision feature with the height, and when the current height of the adjacent container feature is higher than the current height of the feature of the area to be placed, an anti-collision alarm is issued based on the hoisted container feature, the adjacent container feature and the feature of the area to be placed. The polynomial curve that can accurately reflect the changes in the collision characteristics of each target item determined based on historical data can be combined. The point on the hoisted container may be at the same height as the adjacent container. When anti-collision is needed, an anti-collision alarm is issued to ensure the accuracy of the anti-collision alarm and achieve anti-collision.

[0076] In some embodiments, when an anti-collision alarm is issued based on the characteristics of the suspended container, the characteristics of adjacent containers and the characteristics of the area to be placed, the first anti-collision distance, the second anti-collision distance and / or the third anti-collision distance are calculated based on the current plane coordinates of the characteristics of the suspended container, the current plane coordinates of the characteristics of the adjacent containers and the current plane coordinates of the characteristics of the area to be placed, and an anti-collision alarm is issued based on the first anti-collision distance, the second anti-collision distance and / or the third anti-collision distance.

[0077] Among them, the first anti-collision distance is the distance between the feature of the suspended container and the feature of the area to be placed in the direction of the trolley, the second anti-collision distance is the distance between the feature of the suspended container and the feature of the adjacent container in the direction of the trolley, and the third anti-collision distance is the distance between the feature of the suspended container and the feature of the adjacent container in the direction of the large truck. The direction of the large truck is parallel to the plane where the image to be processed is located and perpendicular to the direction of the trolley.

[0078] Specifically, based on the current plane coordinates of the features of the hoisted container and the current plane coordinates of the features of the area to be placed, a first anti-collision distance is calculated. If the first anti-collision distance is less than a first critical distance, an anti-collision alarm is issued, that is, a first anti-collision alarm signal is generated and issued, which is used to prompt that the hoisted container is too close to the area to be placed. Generally, the first critical distance is, for example, 0, so that when the hoisted container passes over the area to be placed, an anti-collision alarm is issued.

[0079] Correspondingly, if the first anti-collision distance is not less than the first critical distance, no anti-collision warning is issued, or in other words, no operation is performed.

[0080] At this time, the characteristic of the hoisted container is generally the edge of the hoisted container, and the characteristic of the area to be placed is generally the edge of the area to be placed.

[0081] Alternatively, based on the current plane coordinates of the hoisted container feature and the current plane coordinates of the adjacent container feature, the distance between the two in the direction of the trolley is calculated to obtain a second anti-collision distance. If the second anti-collision distance is less than the second critical distance, an anti-collision alarm is issued, that is, a second anti-collision alarm signal is generated and issued, which is used to prompt that the hoisted container is too close to the adjacent container in the direction of the trolley. Generally, the second critical distance is, for example, 5 cm. In this way, when the hoisted container fails to rub against the adjacent container in the direction of the trolley, an anti-collision alarm is issued in time.

[0082] Correspondingly, if the second anti-collision distance is not less than the second critical distance, no anti-collision warning is issued, or in other words, no operation is performed.

[0083] Alternatively, based on the current plane coordinates of the hoisted container feature and the current plane coordinates of the adjacent container feature, the distance between the two in the direction of the large vehicle is calculated to obtain a third anti-collision distance. If the third anti-collision distance is less than the third critical distance, an anti-collision alarm is issued, that is, a third anti-collision alarm signal is generated and issued, which is used to prompt that the hoisted container is too close to the adjacent container in the direction of the large vehicle. Generally, the third critical distance is, for example, 5 cm. In this way, when the hoisted container fails to rub against the adjacent container in the direction of the large vehicle, an anti-collision alarm is issued in time.

[0084] Correspondingly, if the third anti-collision distance is not less than the third critical distance, no anti-collision warning is issued, or in other words, no operation is performed.

[0085] Alternatively, the first, second and third anti-collision distances are calculated, and if the first anti-collision distance is less than the first critical distance, a first anti-collision alarm signal is issued, if not, no operation is performed; after the first anti-collision alarm signal is issued, if the second anti-collision distance is less than the second critical distance, and / or the third anti-collision distance is less than the third critical distance, a fourth anti-collision alarm signal is issued to remind that the hoisted container is too close to the adjacent container.

[0086] Alternatively, if the first anti-collision distance is less than the first critical distance, a first anti-collision alarm signal is issued and / or the sling is controlled to move, such as decelerating; if the second anti-collision distance is less than the second critical distance, and / or the third anti-collision distance is less than the third critical distance, a fourth anti-collision alarm signal is issued, and / or the sling is controlled to stop moving or decelerate to no movement or move in the opposite direction.

[0087] In this embodiment, the first, second and / or third anti-collision distances are calculated based on the current plane coordinates of the features of the hoisted container, the current plane coordinates of the features of the adjacent containers and the current plane coordinates of the features of the area to be placed, and an anti-collision alarm is issued based on the first, second and / or third anti-collision distances, thereby issuing an alarm based on whether the hoisted container exceeds the area to be placed and whether it is about to collide with the adjacent container, thereby effectively reminding relevant personnel to control the hoist to perform corresponding actions to avoid collision.

[0088] In some embodiments, when the current working condition is a box grabbing working condition, an anti-collision alarm is issued based on the target anti-collision feature, including:

[0089] Based on the current plane coordinates of the target anti-collision feature, combined with the polynomial curve of the plane coordinates of the target anti-collision feature changing with the height, the current height of the target anti-collision feature is determined. Then, based on the current height of the adjacent container feature being higher than the current height of the container feature to be hoisted, it is determined whether an anti-collision alarm is required.

[0090] The plane coordinates are the coordinates in the coordinate system of the plane where the image to be processed is located.

[0091] Specifically, if the current height of the adjacent container feature is higher than the current height of the container to be lifted, the hoist may collide with the adjacent container on one side during the process of grabbing the container to be lifted and rising. At this time, an anti-collision alarm can be issued based on the marker features and the adjacent container features.

[0092] Accordingly, if the current height of the adjacent container feature is not higher than the container to be lifted, the spreader does not need to be lowered to the same height as any point on the adjacent container to grab the container to be lifted, and there will be no collision with the container. At this time, no operation is required.

[0093] In this embodiment, based on the current plane coordinates of the target anti-collision feature, combined with the polynomial curve of the plane coordinates of the target anti-collision feature changing with the height, the current height of the target anti-collision feature is determined, and when the current height of the adjacent container feature is higher than the current height of the container to be hoisted, an anti-collision alarm is issued based on the marker feature and the adjacent container feature. In this way, a polynomial curve that can accurately reflect the changes in the collision features of various targets determined based on historical data can be combined. When the upper point of the container to be hoisted is at the same height as the adjacent container, an anti-collision alarm is issued at this time. The anti-collision alarm can be issued when anti-collision is needed to ensure the accuracy of the anti-collision alarm and achieve anti-collision.

[0094] In some embodiments, when an anti-collision alarm is issued based on marker features and adjacent container features, a fourth anti-collision distance and / or a fifth anti-collision distance are calculated based on the current plane coordinates of the marker features and the current plane coordinates of the adjacent container features, and an anti-collision alarm is issued based on the fourth anti-collision distance and / or the fifth anti-collision distance.

[0095] Among them, the fourth anti-collision distance is the distance between the marker feature and the adjacent container feature in the direction of the small vehicle, and the fifth anti-collision distance is the distance between the marker feature and the adjacent container feature in the direction of the large vehicle.

[0096] Specifically, based on the current plane coordinates of the marker feature and the current plane coordinates of the adjacent container feature, the distance between the two in the direction of the trolley is calculated to obtain a fourth anti-collision distance. If the fourth anti-collision distance is less than the fourth critical distance, an anti-collision alarm is issued, that is, a fifth anti-collision alarm signal is generated and issued, which is used to indicate that the spreader is too close to the adjacent container in the direction of the trolley. Generally, the fourth critical distance is, for example, 5 cm. In this way, when the spreader fails to rub against the adjacent container in the direction of the trolley, an anti-collision alarm is issued in time.

[0097] Correspondingly, if the fourth anti-collision distance is not less than the fourth critical distance, no anti-collision warning is issued or no operation is performed.

[0098] Alternatively, based on the current plane coordinates of the marker feature and the current plane coordinates of the adjacent container feature, the distance between the two in the direction of the large vehicle is calculated to obtain a fifth anti-collision distance. If the fifth anti-collision distance is less than the fifth critical distance, an anti-collision alarm is issued, that is, a sixth anti-collision alarm signal is generated and issued, which is used to indicate that the spreader is too close to the adjacent container in the direction of the small vehicle. Generally, the fifth critical distance is, for example, 5 cm. In this way, when the spreader fails to rub against the adjacent container in the direction of the large vehicle, an anti-collision alarm is issued in time.

[0099] Correspondingly, if the fifth anti-collision distance is not less than the fifth critical distance, no anti-collision warning is issued or no operation is performed.

[0100] Alternatively, the fourth and fifth anti-collision distances are calculated, and if the fourth anti-collision distance is less than the fourth critical distance, a fifth anti-collision alarm signal is issued, if not, no operation is performed; after the fifth anti-collision alarm signal is issued, if the fifth anti-collision distance is less than the fifth critical distance, and / or the fourth anti-collision distance is less than the fourth critical distance, a sixth anti-collision alarm signal is issued to remind that the spreader is too close to the adjacent container.

[0101] In some embodiments, before determining the current height of the target anti-collision feature, it is determined whether there is an error in each target anti-collision feature, and based on whether there is an error, an anti-collision warning is issued, or an operation of the current height of the target anti-collision is performed.

[0102] Specifically, for any target anti-collision feature, the difference between the current plane coordinates of the target anti-collision feature and the plane coordinates in the polynomial curve corresponding to the target anti-collision feature is determined, and it is determined whether the difference exceeds a preset difference.

[0103] If so, that is, the gap exceeds the preset gap, an anti-collision alarm is issued.

[0104] Specifically, the seventh anti-collision warning signal is issued to remind the target that an error has occurred in the anti-collision feature and that the container may collapse.

[0105] If not, that is, the difference does not exceed the preset difference, an operation of determining the current height of the target anti-collision feature is performed.

[0106] In this embodiment, based on the difference of the plane coordinates in the polynomial curve corresponding to the target anti-collision feature, when the difference exceeds the preset difference, an anti-collision alarm is issued, and when the difference does not exceed the preset difference, the operation of determining the current height of the target anti-collision feature continues to be executed. Since the current plane coordinates of the target anti-collision feature and the plane in the polynomial curve corresponding to the target anti-collision feature have a large difference, the container may collapse. At this time, an anti-collision alarm is issued to promptly remind relevant personnel to take relevant measures to avoid collision.

[0107] In some embodiments, when any target anti-collision feature is a hanging container feature, when the gap exceeds a preset gap, that is, the hanging container feature error, the hanging container feature is corrected based on the relative position between the hanging container feature and the marker feature.

[0108] For example, the current plane coordinates of the marker feature are (2, 2), and the relative position relationship between the marker feature and the hanging container feature is (1, 1), then the current plane coordinates of the hanging container feature, ie, the corner point, are determined to be (1, 1).

[0109] In this way, based on the relative position relationship, even if there is an error in the hanging container feature or it is not collected, the hanging container feature can be corrected to determine the accurate hanging container feature.

[0110] Since the empty sling and the sling or the container carried by the sling may swing and scratch the container during the up and down movement, i.e., during the process of placing and grabbing the container, in some embodiments, the angle between the edge of the sling and the adjacent container may be determined as a first angle based on the current plane coordinates of the sling container characteristics and the current plane coordinates of the adjacent container characteristics, and / or the angle between the sling and the edge of the position to be placed may be determined as a second angle. The sling container characteristics and the adjacent container characteristics may refer to the edge of the sling container and the edge of the adjacent container. Afterwards, based on the first and / or second angles, when the first angle and / or the second angle are larger, an anti-collision alarm is issued to avoid collision, thereby ensuring safety.

[0111] In the above embodiments, when a collision is likely to occur, the lifting device can be controlled to stop, slow down, or move in the reverse direction while issuing an anti-collision alarm.

[0112] For example, the anti-collision process of comparing the distance between the spreader marker and the corner point of the container, the distance between the corner points of the container, and the distance to the edge of the container with the critical value for anti-collision warning can be as follows: Figure 7 As shown. Install more than two cameras on the side / below the (yard crane) trolley platform. For example, when there are two cameras, they are placed on the opposite sides of the trolley respectively; when there are four cameras, they are placed on the four sides of the trolley respectively. Afterwards, the yolov8 algorithm is used to extract features of the image to be processed collected by the camera, including the features of the markers on the spreader, the features of the hoisted containers, the features of the adjacent containers, etc., wherein the features of the adjacent containers include, for example, the features of the adjacent containers in the direction of the large truck in the yard and the features of the adjacent containers in the direction of the trolley, or the features of the adjacent container spreader of the container truck, etc. On this basis, the coordinates of the required corner points and container edges are extracted, that is, the current plane coordinates of the above-mentioned anti-collision features.

[0113] For each polynomial curve fitted with the change of height for each feature, the expression of its change with height is obtained by calibrating the correspondence between the plane coordinates of the extracted features in the image to be processed and the actual height. This expression can be used to convert the anti-collision distance in the calculated image into the actual distance, and can also be used to calculate the relative height between the neighboring box and the target box to judge the working condition. When the neighboring boxes are not higher than the area to be placed, no box collision will occur when the box is placed.

[0114] Real-time comparison of the distance between the target container corner (when stacking containers) and the spreader marker (when grabbing containers and other empty spreader operations) and the adjacent container corners and edges, as well as the angle between the target container and the adjacent container. After that, set the first critical (alarm) value 0, i.e., line b. When line a exceeds the position of line b, a warning is issued; the second critical (alarm) value is set to 5cm, i.e., when the anti-scratch box is close to 5cm from ac, an alarm is issued. When it is less than or equal to 5cm, the operation (movement) is stopped.

[0115] Exemplarily, the present invention arranges 4 cameras on the yard bridge trolley to obtain the image to be processed with the spreader marker, the target container, the target box (i.e., the area to be placed) and the adjacent containers. The features in the image to be processed are obtained through the detection and segmentation algorithm, including the marker on the spreader, the target container, the area to be placed and the adjacent containers, and then the corner points of the required features, i.e., the container lock hole (or the external container card lock) and the coordinates of the container edge (i.e., the above-mentioned current plane coordinates) are extracted. The distance between the corner of the hoisted container and the corner of the adjacent container (i.e., the corner point) and the distance to the container edge are calculated in real time.

[0116] Since there are four cameras on the field crane trolley, each camera is responsible for shooting a corner of the hoist, integrating the distance and angle information of the anti-scratch boxes at the four corners and the border, real-time monitoring, and jointly ensuring the operation of the system. When the anti-scratch distance reaches the first critical value, an anti-scratch box danger prompt (i.e. the above-mentioned anti-scratch alarm signal) is issued. When it reaches the second critical value, this information will be conveyed to the control system and the control personnel, and the operator will control the field crane to stop the operation.

[0117] According to Figure 1 As shown, cameras are installed on the four sides of the trolley. In order to better collect the spreader markers, the edge / corner points of the target container, the edge / corner points of the area to be placed, and the edge / corner points of the adjacent containers, the cameras are installed on one side of the four sides of the trolley instead of in the middle. The four cameras shoot vertically downward.

[0118] According to Figure 3 As shown in the figure, in the perspective of a single camera, there are spreader markers E, hoisted containers (when stacking containers or opening the bottom), the area to be placed, adjacent containers in the direction of the trolley, and adjacent containers in the direction of the truck. The spreader marker E is located above the lock of one corner of the spreader. By setting the marker, the detection success rate of the spreader lock can be improved, and the corners of the spreader can be stably detected in the captured image. The image captured by the camera is input into the YOLOv8 model, which can detect and segment the markers and the edges of each container. Through the results of detection and segmentation, after data processing, the spreader marker E, the edge a and the corner A of the hoisted container, the edge b and the corner (or the lock hole) B of the area to be placed, the edge c of the adjacent container in the direction of the trolley, and the corner (or the lock hole) D of the adjacent container in the direction of the truck are extracted.

[0119] like Figure 4As shown in the figure, in the stacking condition, the coordinates of points E, A, C, D and edges a, b, c are counted in real time. In the direction of the large vehicle, the distance between points AD is the anti-scratch protection distance to be calculated, and in the direction of the small vehicle, the distance between points ac is the anti-scratch protection distance to be calculated. When calculating the distance, the shortest distance between the two straight lines is taken. Since the relative positions of E and A are fixed, and the features of E are obvious, it is better to detect and locate in the image. When A is missed or the position deviates too much, the coordinates of A can be corrected by the coordinates of E, thereby ensuring the accurate calculation of the anti-scratch distance.

[0120] Because a will not exceed b in theory, the distance between ab is the first critical alarm value. If a exceeds b, a warning will be issued. At the same time, in order to avoid the box being scratched due to the swing of the spreader, the angle between ab or ac is calculated, and normal operation will be carried out within the safe angle. When setting the second critical alarm value, the anti-scratch distance is considered to be zero when the box is scratched, and the tolerance deviation is the imaginary line 5 cm in front of c. When line a reaches the imaginary line position, that is, the distance between ac is less than or equal to 5 cm, the operation is stopped.

[0121] like Figure 5 As shown in the figure, in the open bottom condition, there is no b feature corresponding to the container in the image, but the area indicated by the white indicator line on the ground is used as the area to be placed, and the distance between AD and ac is calculated as the anti-collision protection distance. Due to the lack of b line, the first critical alarm value can be set to the white indicator line on the ground parallel to c.

[0122] like Figure 6 As shown in the figure, when the container is grabbed, the E, C, and D coordinates are counted in real time during the lowering of the spreader. In the direction of the large vehicle, the distance between the two points ED is the anti-collision distance to be calculated, and in the direction of the small vehicle, the distance between EC is the anti-collision distance to be calculated. Of course, the distance between point E and the edge of the spreader must be considered when calculating the critical warning distance.

[0123] Exemplary Devices

[0124] like Figure 8 As shown, the embodiment of the present application further provides an anti-collision device, including an image acquisition module 801, a feature extraction module 802 and an anti-collision alarm module 803.

[0125] in,

[0126] The image acquisition module 801 is used to acquire images to be processed through multiple cameras, wherein the multiple cameras are arranged on the side of the yard crane trolley and the viewing angle is perpendicular to the ground, and the images to be processed include a target container, adjacent containers of the target container, and markers on the yard crane spreader. The target container is a hoisted container or a container to be hoisted. The adjacent containers of the hoisted container are containers adjacent to the area to be placed of the hoisted container, and the adjacent containers of the container to be hoisted are containers adjacent to the container to be hoisted.

[0127] A feature extraction module 802 is used to extract anti-collision features in the image to be processed, wherein the anti-collision features include marker features, target container features, adjacent container features, and to-be-placed area features;

[0128] The anti-collision alarm module 803 is used to issue an anti-collision alarm based on the anti-collision feature, and the anti-collision alarm is used to remind the spreader or the hoisted container that a collision may occur.

[0129] The anti-collision device provided in this embodiment belongs to the same application concept as the anti-collision method provided in the above embodiments of this application, and can execute the method provided in any of the above embodiments of this application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not fully described in this embodiment, please refer to the specific processing content of the anti-collision method provided in the above embodiments of this application, and will not be repeated here.

[0130] The functions implemented by the above-mentioned image acquisition module 801, feature extraction module 802 and anti-collision warning module 803 can be implemented in the form of software called by the same or different processors, and the embodiments of the present application are not limited thereto.

[0131] Exemplary Electronic Devices

[0132] Another embodiment of the present application also provides an electronic device, see Fig. 9 As shown, the electronic device includes: a memory 900 and a processor 910 .

[0133] The memory 900 is connected to the processor 910 and is used to store programs;

[0134] The processor 910 is used to implement the anti-collision method disclosed in any of the above embodiments by running the program stored in the memory 900.

[0135] Specifically, the electronic device may further include: a bus, a communication interface 920 , an input device 930 and an output device 940 .

[0136] The processor 910, the memory 900, the communication interface 920, the input device 930 and the output device 940 are connected to each other via a bus.

[0137] A bus may include a pathway that transfers information between components of a computer system.

[0138] The processor 910 may be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application. It may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0139] The processor 910 may include a main processor, and may also include a baseband chip, a modem, and the like.

[0140] The memory 900 stores a program for executing the technical solution of the present application, and may also store an operating system and other key services. Specifically, the program may include a program code, and the program code includes computer operation instructions. More specifically, the memory 900 may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk storage, a flash, and the like.

[0141] The input device 930 may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.

[0142] Output device 940 may include devices that allow information to be output to a user, such as a display screen, printer, speaker, etc.

[0143] The communication interface 920 may include any transceiver or the like to communicate with other devices or communication networks, such as Ethernet, a radio access network (RAN), a wireless local area network (WLAN), etc.

[0144] The processor 910 executes the program stored in the memory 900 and calls other devices, which can be used to implement each step of any anti-collision method provided in the above embodiments of the present application.

[0145] Those skilled in the art will understand that Fig. 9The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0146] An embodiment of the present application also proposes a chip, which includes a processor and a data interface. The processor reads and runs a program stored in a memory through the data interface to execute the anti-collision method introduced in any of the above embodiments. The specific processing process and its beneficial effects can be found in the introduction to the above-mentioned anti-collision method embodiment.

[0147] In addition to the above-mentioned methods and devices, an embodiment of the present application proposes a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the anti-collision method according to various embodiments of the present application described in the above-mentioned "Exemplary Method" section of this specification.

[0148] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0149] In addition, an embodiment of the present application further proposes a storage medium on which a computer program is stored, and the computer program is executed by a processor to execute the steps of the anti-collision method according to various embodiments of the present application described in the above "Exemplary Method" section of this specification.

[0150] The basic principle of the present invention is described above in conjunction with specific embodiments. However, it should be pointed out that the advantages, strengths, effects, etc. mentioned in the present invention are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. must be possessed by each embodiment of the present invention. In addition, the specific details disclosed above are only for the purpose of illustration and facilitation of understanding, rather than limitation, and the above details do not limit the present invention to being implemented by adopting the above specific details.

[0151] The block diagrams of the devices, apparatuses, equipment, and systems involved in the present invention are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The word "such as" used here refers to the phrase "such as but not limited to", and can be used interchangeably with it.

[0152] It should also be noted that in the device, apparatus and method of the present invention, each component or each step can be decomposed and / or reassembled, and such decomposition and / or reassembly should be regarded as an equivalent solution of the present invention.

[0153] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present invention. Therefore, the present invention is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0154] It should be understood that the qualifiers "first", "second", "third", "fourth", "fifth" and "sixth" used in the description of the embodiments of the present invention are only used to more clearly explain the technical solutions and cannot be used to limit the scope of protection of the present invention.

[0155] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present invention to the forms disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A method for preventing collision, characterized in that: The method comprises: The image to be processed is collected by multiple cameras, the multiple cameras are arranged on the side of the yard crane trolley and the viewing angle is perpendicular to the ground, the image to be processed includes the target container, the adjacent containers of the target container and the markers on the yard crane hoist, the target container is a hoisted container or a container to be hoisted, the adjacent containers of the hoisted container are containers adjacent to the area to be placed of the hoisted container, and the adjacent containers of the container to be hoisted are containers adjacent to the container to be hoisted; Extracting anti-collision features in the image to be processed, wherein the anti-collision features include marker features, target container features, adjacent container features, and to-be-placed area features; Based on the anti-collision feature, an anti-collision alarm is issued, and the anti-collision alarm is used to remind the spreader or the hoisted container that a collision may occur.

2. The anti-collision method according to claim 1, characterized in that: The anti-collision warning is performed based on the anti-collision feature, including: Based on the current working condition, the anti-collision feature is selected to obtain a target anti-collision feature corresponding to the current working condition; Based on the target anti-collision characteristics, an anti-collision warning is issued.

3. The anti-collision method according to claim 2, characterized in that: The current working condition is one of a stacking condition, a bottom opening condition, and a container grabbing condition. The stacking condition is a condition in which the hoisted container is placed on other containers. The bottom opening condition is a condition in which the hoisted container is placed on the ground. The container grabbing condition is a condition in which the container to be hoisted is grabbed. The step of selecting the anti-collision feature based on the current working condition to obtain a target anti-collision feature corresponding to the current working condition includes: If the current working condition is the stacking working condition or the bottom opening working condition, the target container is the hanging container, and the hanging container feature, the adjacent container feature and the to-be-placed area feature are determined as the target anti-collision feature; If the current working condition is the container grabbing working condition, the target container is a container to be hoisted, and the marker feature, the feature of the container to be hoisted and the feature of the adjacent container are determined as the target anti-collision feature.

4. The anti-collision method according to claim 3, characterized in that: When the current working condition is the stacked box working condition or the bottom opening working condition, the anti-collision alarm is performed based on the target anti-collision feature, including: Determine the current height of the target anti-collision feature based on the current plane coordinates of the target anti-collision feature and in combination with a polynomial curve of the plane coordinates of the target anti-collision feature varying with height, wherein the plane coordinates are coordinates in a coordinate system of the plane where the image to be processed is located; If the current height of the adjacent container feature is higher than the current height of the to-be-placed area feature, an anti-collision alarm is issued based on the hoisted container feature, the adjacent container feature and the to-be-placed area feature.

5. The anti-collision method according to claim 4, characterized in that: The anti-collision alarm is performed based on the characteristics of the hoisted container, the characteristics of the adjacent containers and the characteristics of the area to be placed, including: Calculate a first anti-collision distance, a second anti-collision distance and / or a third anti-collision distance based on the current plane coordinates of the suspended container feature, the current plane coordinates of the adjacent container feature and the current plane coordinates of the to-be-placed area feature; Based on the first anti-collision distance, the second anti-collision distance and / or the third anti-collision distance, an anti-collision warning is issued; Among them, the first anti-collision distance is the distance between the feature of the suspended container and the feature of the area to be placed in the direction of the trolley, the second anti-collision distance is the distance between the feature of the suspended container and the feature of the adjacent container in the direction of the trolley, and the third anti-collision distance is the distance between the feature of the suspended container and the feature of the adjacent container in the direction of the large truck, and the direction of the large truck is parallel to the plane where the image to be processed is located and perpendicular to the direction of the trolley.

6. The anti-collision method according to claim 3, characterized in that: When the current working condition is the box grabbing working condition, the anti-collision alarm is performed based on the target anti-collision feature, including: Determine the current height of the target anti-collision feature based on the current plane coordinates of the target anti-collision feature and in combination with a polynomial curve of the plane coordinates of the target anti-collision feature varying with height, wherein the plane coordinates are coordinates in a coordinate system of the plane where the image to be processed is located; If the current height of the adjacent container feature is higher than the current height of the to-be-loaded container feature, an anti-collision alarm is issued based on the marker feature and the adjacent container feature.

7. The anti-collision method according to claim 6, characterized in that: The anti-collision alarm is performed based on the characteristics of the marker and the characteristics of the adjacent container, including: Calculating a fourth anti-collision distance and / or a fifth anti-collision distance based on the current plane coordinates of the marker feature and the current plane coordinates of the adjacent container feature; Based on the fourth anti-collision distance and / or the fifth anti-collision distance, issuing an anti-collision warning; Among them, the fourth anti-collision distance is the distance between the marker feature and the adjacent container feature in the direction of the small vehicle, and the fifth anti-collision distance is the distance between the marker feature and the adjacent container feature in the direction of the large vehicle.

8. The anti-collision method according to claim 4 or 6, characterized in that: Prior to determining the current height of the target anti-collision feature, the method further includes: For any of the target anti-collision features, determine the difference between the current plane coordinates of the target anti-collision feature and the plane coordinates in the polynomial curve corresponding to the target anti-collision feature, and determine whether the difference exceeds a preset difference; If yes, an anti-collision warning is issued; If not, the operation of determining the current height of the target anti-collision feature is performed.

9. The anti-collision method according to claim 8, characterized in that: When any of the target anti-collision features is the hoisted container feature, the gap exceeds the preset gap, and the method further includes: The feature of the suspended container is corrected based on the relative position between the feature of the suspended container and the feature of the marker.

10. An anti-collision device, characterized in that: The device comprises: An image acquisition module is used to acquire images to be processed through multiple cameras, wherein the multiple cameras are arranged on the side of the yard crane trolley and the viewing angle is perpendicular to the ground, and the images to be processed include a target container, containers adjacent to the target container, and markers on the yard crane hoist. The target container is a hoisted container or a container to be hoisted. The adjacent containers of the hoisted container are containers adjacent to the area to be placed of the hoisted container, and the adjacent containers of the container to be hoisted are containers adjacent to the container to be hoisted. A feature extraction module, used to extract anti-collision features in the image to be processed, wherein the anti-collision features include marker features, target container features, adjacent container features, and to-be-placed area features; The anti-collision alarm module is used to issue an anti-collision alarm based on the anti-collision feature, wherein the anti-collision alarm is used to remind the spreader or the hoisted container that a collision may occur.

11. An electronic device, characterized in that: including memory and processor; The memory is connected to the processor and is used to store programs; The processor is used to implement the anti-collision method according to any one of claims 1 to 9 by running the program in the memory.