Shore crane loading, unloading, observing and aiming device based on augmented reality

Through augmented reality technology, the camera screen of the spreader is presented in front of the vision of the shore bridge driver, which solves the problems of large blind spots in the field of vision and safety hazards in the loading and unloading of the shore bridge, and achieves more efficient operation and safety guarantees.

CN221988005UActive Publication Date: 2024-11-12上海舜动科技有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202420490559.6
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-03-13
Publication Date
2024-11-12
Estimated Expiration
2034-03-13

AI Technical Summary

Technical Problem

During the loading and unloading of the shore bridge, the driver's room is located at a high altitude, with a large blind spot in the viewing angle, making it difficult to clearly observe the operation situation, resulting in box damage and safety hazards. The existing CCTV monitoring system has poor auxiliary viewing effect, making it difficult to ensure operation efficiency and safety.

Method used

Using a shore bridge loading and unloading sighting device based on augmented reality, the combination of multiple spreader cameras, video encoders, fiber optic conversion modules, video workstations and augmented reality glasses can transmit and splice video data to augmented reality glasses in real time, breaking through the field of vision limitations , provide clear working environment information.

Benefits of technology

It improves the intuitiveness and clarity of the shore and bridge drivers' working environment, grasps the position of the spreader in real time, improves the loading and unloading success rate, ensures the safety of vehicles, ships and personnel, and improves operating efficiency and availability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN221988005U_ABST
    Figure CN221988005U_ABST
Patent Text Reader

Abstract

The utility model provides a quay crane loading, unloading, observing and aiming device based on augmented reality, which comprises a plurality of sling cameras, a video encoder, an optical fiber conversion module, a video workstation and augmented reality glasses, the sling cameras are connected with the video encoder, the video encoder is connected with the optical fiber conversion module, the optical fiber conversion module is connected with the video workstation, and the video workstation is connected with the augmented reality glasses. And the video workstation is connected with the augmented reality glasses. By adopting an augmented reality observing and aiming operation mode, a hanger camera picture is presented in front of the visual field of a quay crane driver, the hanger position is mastered in real time, the loading and unloading success rate is improved, and the overall operation efficiency is improved. The auxiliary visual angle of the lifting appliance camera is presented in front of the visual field of a quay crane driver through the augmented reality technology, so that the quay crane driver can observe environment information on the current operation shore or ship more clearly, video information of the quay crane driver can be provided, the safety of vehicles, ships and personnel is guaranteed, and accidents are prevented.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model relates to the technical field of shore loading and unloading equipment, in particular to a shore crane loading and unloading observation and aiming device based on augmented reality. Background Art

[0002] Container terminals generally use shore container cranes (hereinafter referred to as "quay cranes") for loading and unloading operations. The typical operation process of a quay crane operation is as follows:

[0003] Loading stage: the operator uses the console in the quay crane driver's cab to control the quay crane's traveling mechanism to move the cargo boom to the top of the cabin; the lifting mechanism is used to lift the cargo and extend the beam outward to ensure that the cargo can completely enter the cabin; the lifting trolley is lifted to make the cargo rise vertically to the cabin height; the traveling trolley takes the cargo out of the cabin and transports it to the designated location.

[0004] Unloading stage: The operator uses the console in the quay crane driver's cab to control the quay crane's traveling mechanism to move the cargo boom to the top of the cabin; the lifting mechanism is used to lift the cargo and extend the beam outward to ensure that the cargo can completely enter the truck on the shore; the lifting trolley is lifted to raise the cargo vertically to the height of the unloading vehicle; the traveling trolley takes the cargo out of the cabin and places it on the truck.

[0005] The shore crane is an important machine for container terminal operations. Its efficiency, safety and correctness of operation have a great impact on terminal operations. The driver's cab is located at a high altitude, far from the ship and truck. The shore crane driver needs to observe the operation through the glass in a bird's-eye view. The blind spot of the view is large, and the container may be damaged due to too fast landing, or even collide with the ship and vehicle structure to cause losses. At the same time, due to limited observation of the personnel on the shore and on the ship, and the influence of tidal fluctuations, cable slack, counterweight changes, etc. during operation, it will shake, drift away from the shore (off the side), etc., which will have a safety impact on the operation. At present, the observation and aiming of shore crane loading and unloading in the market adopts the method of installing a closed-circuit television monitoring system in the driver's cab, but the method of auxiliary observation and aiming by viewing the monitoring screen of the closed-circuit television monitoring system is difficult to observe repeatedly during the operation, and the usability is poor. Therefore, how to ensure the efficiency of shore crane loading and unloading operations while ensuring the safety of personnel on board and on the shore is an urgent problem to be solved. Utility Model Content

[0006] The purpose of the utility model is to provide a quay crane loading and unloading observation device based on augmented reality, so that the quay crane driver can more clearly observe the environmental information of the current operating shore or ship, and can provide the quay crane driver with video information to ensure the safety of vehicles, ships and personnel and prevent accidents.

[0007] According to the purpose of the utility model, the utility model provides a quay crane loading and unloading observation device based on augmented reality, including multiple sling cameras, a video encoder, a fiber optic conversion module, a video workstation and augmented reality glasses, the multiple sling cameras are connected to the video encoder, the video encoder is connected to the fiber optic conversion module, the fiber optic conversion module is connected to the video workstation, and the video workstation is connected to the augmented reality glasses.

[0008] Furthermore, the video encoder is fixed on an upper frame of the quay crane hoist.

[0009] Furthermore, the optical fiber conversion module and the video workstation are fixed in the driver's cab of the quay crane.

[0010] Furthermore, the augmented reality glasses are placed in the driver's cab of the quay crane.

[0011] Furthermore, the sling camera is connected to the video encoder via a coaxial cable, and the sling camera transmits the video data analog signal to the video encoder via the coaxial cable.

[0012] Furthermore, the video encoder is connected to the optical fiber conversion module via an optical fiber, and the video encoder converts the analog signal of the video data into a digital signal and transmits the digital signal to the optical fiber conversion module via the optical fiber.

[0013] Furthermore, the optical fiber conversion module is connected to the video workstation via a network cable, and the optical fiber conversion module transmits the video digital signal to the video workstation.

[0014] Furthermore, the video workstation is connected to the augmented reality glasses via a video cable, and the video workstation parses the digital signal into video data corresponding to the plurality of hoist cameras, and then processes and splices the plurality of videos into one video and pushes the stream to the augmented reality glasses for display.

[0015] Furthermore, the augmented reality glasses are wearable glasses.

[0016] Furthermore, the sling camera includes a first sling camera, a second sling camera, a third sling camera and a fourth sling camera, and the first sling camera, the second sling camera, the third sling camera and the fourth sling camera are respectively fixed on the edge of the sling guide plate of the quay crane sling.

[0017] The technical solution of this utility model adopts an augmented reality viewing and aiming operation mode, presenting the spreader camera image in front of the quay crane driver's field of vision, breaking through the space limitation, allowing the quay crane driver to more intuitively and clearly see the relationship between the spreader or the container carried by the spreader and the target operation position, grasp the spreader position in real time, improve the success rate of loading and unloading, and improve the overall operation efficiency. The auxiliary view of the spreader camera is presented in front of the quay crane driver's field of vision through augmented reality technology, allowing the quay crane driver to more clearly observe the environmental information of the current operation shore or ship, and can provide the quay crane driver with video information to ensure the safety of vehicles, ships and personnel and prevent accidents. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the specific implementation methods of the utility model or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the utility model. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 It is a schematic diagram of the structure of an embodiment of the utility model;

[0020] Figure 2 This is a schematic diagram of the location of the quay crane hoist and the driver's cab in an embodiment of the utility model;

[0021] Figure 3 This is a front view of the crane crane camera, video encoder and crane crane according to the embodiment of the utility model;

[0022] Figure 4 A top view of a crane crane camera, a video encoder and a crane crane according to an embodiment of the utility model;

[0023] Figure 5 This is a left view of the crane crane camera, video encoder and crane crane according to the embodiment of the utility model;

[0024] In the figure: 1. First spreader camera; 2. Second spreader camera; 3. Third spreader camera; 4. Fourth spreader camera; 5. Video encoder; 6. Fiber optic conversion module; 7. Video workstation; 8. Augmented reality glasses; 9. Quay crane spreader; 10. Quay crane driver's cab. DETAILED DESCRIPTION

[0025] The technical solution of the utility model will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are part of the embodiments of the utility model, not all of the embodiments. Based on the embodiments of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the utility model.

[0026] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore should not be understood as a limitation on the present invention.

[0027] In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present utility model, "multiple" means two or more, unless otherwise clearly and specifically defined. In addition, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal connection of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present utility model can be understood according to specific circumstances.

[0028] Example 1

[0029] like Figure 1-Figure 5 As shown:

[0030] A quay crane loading and unloading observation device based on augmented reality includes multiple hoisting equipment cameras, a video encoder 5, an optical fiber conversion module 6, a video workstation 7 and augmented reality glasses 8. The video encoder 5 is installed on the upper frame of the quay crane hoist 9; the optical fiber conversion module 6 and the video workstation 7 are installed in the quay crane driver's cab 10; and the augmented reality glasses 8 are placed in the quay crane driver's cab 10.

[0031] The four sling cameras are connected to the video encoder 5 via a coaxial cable, and the four sling cameras transmit the video data analog signals to the video encoder 5 via the coaxial cable;

[0032] The video encoder 5 is connected to the optical fiber conversion module 6 via an optical fiber. The video encoder 5 converts the analog video data signal into a digital signal and transmits the digital signal to the optical fiber conversion module 6 via the optical fiber.

[0033] The optical fiber conversion module 6 is connected to the video workstation 7 via a network cable, and the optical fiber conversion module 6 transmits the video digital signal to the video workstation 7;

[0034] The video workstation 7 is connected to the augmented reality glasses 8 through a dedicated video cable. The video workstation 7 parses the digital signal into four channels of video data corresponding to the four hoist cameras, and then processes and splices the four channels of video into one channel of video and pushes the video to the augmented reality glasses 8 for display;

[0035] The augmented reality glasses 8 are wearable in design. After the quay crane driver wears the augmented reality glasses 8, he can observe the superimposed information of the current field of view and the real-time video images spliced ​​by the four crane cameras.

[0036] When the utility model is in use, it is ensured that all devices are powered on and working normally. After startup, the video workstation 7 automatically runs the video processing program to complete the analysis of four-way video digital signals, video splicing, streaming and other tasks. The driver wears augmented reality glasses 8 when entering the quay crane driver's room. The augmented reality glasses 8 provide switch button control, and the driver can choose whether to observe the camera angle of the sling as needed.

[0037] like Figure 2 As shown, it is a schematic diagram of the positions of the quay crane hoist 9 and the quay crane driver's cab 10, wherein the quay crane driver's cab 10 is fixed on the quay crane boom, the quay crane hoist 9 is raised and lowered on the quay crane boom, and the driver observes the lifting status of the quay crane hoist 9 in the quay crane driver's cab 10.

[0038] In this embodiment, there are four sling cameras, including a first sling camera 1, a second sling camera 2, a third sling camera 3 and a fourth sling camera 4. Figure 3-Figure 5 As shown, four spreader cameras are respectively installed on the edges of the spreader guide plate of the quay crane spreader 9.

[0039] In this embodiment, the augmented reality glasses 8 are glasses based on augmented reality technology. Augmented reality is a technology that combines the real world with virtual information. The core lies in the matching and visualization of virtual information and the real world in physical space. Specifically, the augmented reality glasses 8 can directly transmit external light and reflect the virtual image generated by the micro-projection device to the human eye to achieve the effect of virtual-real fusion, ensuring the correct viewpoint and clear background.

[0040] The utility model discloses an augmented reality-based quay crane loading and unloading observation and aiming system. Aiming at the problems of great difficulty in traditional quay crane loading and unloading operations, large blind spots in the operator's field of vision, great safety hazards in operations, and poor effect of monitoring auxiliary systems, the utility model adopts an augmented reality-based observation and aiming operation method to present the spreader camera image in front of the quay crane driver's field of vision, breaking through space limitations, so that the quay crane driver can more intuitively and clearly see the relationship between the spreader or the container grabbed by the spreader and the target operating position, grasp the spreader position in real time, improve the success rate of loading and unloading, and improve the overall operating efficiency.

[0041] The auxiliary viewing angle of the hoisting camera of the utility model is presented in front of the quay crane driver's field of vision through augmented reality technology, so that the quay crane driver can observe the environmental information of the current operating shore or ship more clearly, and can provide the quay crane driver with video information to ensure the safety of vehicles, ships and personnel and prevent accidents. The presentation of video information is provided by augmented reality glasses. The augmented reality glasses are wearable and can be worn directly on the driver's face. The quay crane driver can still maintain normal operation without repeatedly adjusting posture to view other screens. The usability is high in quay crane operation scenarios.

[0042] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the utility model, rather than to limit it. Although the utility model has been described in detail with reference to the aforementioned embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not make the essence of the corresponding technical solution deviate from the scope of the technical solution of the embodiments of the utility model.

Claims

1. A quay crane loading and unloading sighting device based on augmented reality, characterized in that: The system comprises a plurality of sling cameras, a video encoder, a fiber optic conversion module, a video workstation and augmented reality glasses, wherein the plurality of sling cameras are connected to the video encoder, the video encoder is connected to the fiber optic conversion module, the fiber optic conversion module is connected to the video workstation, and the video workstation is connected to the augmented reality glasses.

2. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 1 is characterized in that: The video encoder is fixed on the upper frame of the quay crane hoist.

3. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 1, characterized in that: The optical fiber conversion module and the video workstation are fixed in the operator's cab of the quay crane.

4. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 3 is characterized in that: The augmented reality glasses are placed in the operator's cab of the quay crane.

5. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 1, characterized in that: The sling camera is connected to the video encoder via a coaxial cable, and the sling camera transmits the video data analog signal to the video encoder via the coaxial cable.

6. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 1, characterized in that: The video encoder is connected to the optical fiber conversion module via an optical fiber. The video encoder converts the analog video data signal into a digital signal and transmits the digital signal to the optical fiber conversion module via the optical fiber.

7. The augmented reality based quay crane loading and unloading observation and aiming device according to claim 1, characterized in that: The optical fiber conversion module is connected to the video workstation via a network cable, and the optical fiber conversion module transmits the video digital signal to the video workstation.

8. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 1, characterized in that: The video workstation is connected to the augmented reality glasses via a video cable. The video workstation parses the digital signal into video data corresponding to the plurality of sling cameras, then processes and splices the plurality of videos into one video and pushes the stream to the augmented reality glasses for display.

9. The augmented reality-based quay crane loading and unloading observation and aiming device according to claim 1, characterized in that: The augmented reality glasses are wearable glasses.

10. The augmented reality based quay crane loading and unloading observation and aiming device according to claim 2, characterized in that: The sling camera includes a first sling camera, a second sling camera, a third sling camera and a fourth sling camera, and the first sling camera, the second sling camera, the third sling camera and the fourth sling camera are respectively fixed on the edge of the sling guide plate of the quay crane sling.