Video acquisition, transmission and display system for crane and crane

Abstract

The invention discloses a video acquisition, transmission and display system for a crane and the crane, the system adopts a face recognition and behavior monitoring camera, a camera SERDES circuit and a main control unit to form a data path for recognizing the identity of an operator and monitoring the working state of the operator; the 360-degree look-around fisheye camera, the analog decoding circuit, the main control unit, the screen SERDES circuit and the display screen form a second data path which is used for imaging around the crane and detecting obstacles; and the AHD camera, the analog decoding circuit, the main control unit, the screen SERDES circuit and the display screen form a third data path, and the third data path is used for winch disordered rope monitoring, counterweight identification and multiplying power identification during crane operation. According to the invention, an analog decoding scheme is adopted, and four paths of camera input are converted into one path of input, so that 13 paths of cameras are accessed into a single main control unit; and by introducing a serializer and a deserializer at the camera and the screen end, the transmission distance is prolonged.

Description

Technical Field

[0001] The present invention relates to a video acquisition, transmission and display system for a crane and a crane, belonging to the technical field of video acquisition, transmission and display. Background Art

[0002] In recent years, with the popularization of intelligent technologies, methods of enhancing the user operation experience through images as a medium have been extremely active in the aftermarket. However, related products support a maximum of 4 externally connected cameras. If more cameras need to be connected, more hosts need to be purchased, which will make the system extremely complex and double the cost. For scenarios such as medium and large tonnage cranes that require multiple cameras (≥ 10 channels), existing technical solutions solve the problem by stacking the number of hosts. Stacking hosts will double the cost, and the size is large, occupying a lot of space. For the scenario of separate display and control, the existing solutions are generally within 5m in length, and the number of wire harnesses is large, and the bending radius of the wire harnesses is small, which cannot meet the requirements of arbitrary layouts (distance ≥ 10m). For special scenarios such as crane operator face recognition, behavior monitoring, 360° crane surround view, obstacle monitoring, and crane working condition recognition, there are no products that match the corresponding requirements. Finally, the current face recognition and behavior monitoring cameras in the operator's cab are very large and are designed in a separated manner from the main body of the screen, occupying installation space, and the miniaturization problem needs to be solved urgently. Summary of the Invention

[0003] The purpose of the present invention is to provide a video acquisition, transmission and display system for a crane and a crane. For the problem of accessing multiple cameras, an analog decoding scheme is adopted to convert 4-channel camera inputs into 1-channel MIPI_CSI input. With a high-performance platform, a single main control unit can access 13 cameras. At the same time, the POC (Power Over Coax) technology is used for power supply, reducing the number of cables, and reducing costs and weights.

[0004] To achieve the above object, the present invention is implemented by the following technical solutions: The present invention provides a video acquisition, transmission and display system for a crane, including: a camera group, a camera SERDES circuit, an analog decoding circuit, a main control unit, a screen SERDES circuit, and a display screen; The camera group includes a face recognition and behavior monitoring camera, a fisheye camera, and an AHD camera; The face recognition and behavior monitoring camera, the camera SERDES circuit, and the main control unit form a data path for identifying the operator's identity and monitoring the operator's working status; The fisheye camera, the analog decoding circuit, the main control unit, the screen SERDES circuit, and the display screen form a second data path for imaging around the crane and detecting obstacles; The AHD camera, analog decoding circuit, main control unit, screen SERDES circuit, and display screen constitute the third data path, which is used for monitoring the winding disorder of the hoist, identifying the counterweight, and identifying the pulley ratio during crane operation; Each fisheye camera and AHD camera is respectively configured with a path of analog decoding circuit; Each data path is separately configured with a path of screen SERDES circuit and display screen.

[0005] Preferably, the face recognition and behavior monitoring camera, camera SERDES circuit, analog decoding circuit, main control unit, screen SERDES circuit, and display screen are all installed in the cab.

[0006] Preferably, the face recognition and behavior monitoring camera adopts the MIPI_CSI interface, is connected to the PCB board through the FPC, and converts the collected face information and operator behavior information into digital signals; The camera SERDES circuit includes a CSI serializer and a CSI deserializer. The CSI serializer is used to serialize the data transmitted from the MIPI_CSI interface; The CSI deserializer is used to deserialize the serialized data transmitted from the CSI serializer, restore it to MIPI_CSI data that the main control unit can recognize, and send it to the main control unit; The main control unit is used to process the data transmitted from the CSI deserializer and output the face recognition and operator behavior recognition results.

[0007] Preferably, the system includes four fisheye cameras, which are respectively installed at the front, back, left, and right positions of the crane to form a 360-degree panoramic fisheye camera for 360-degree imaging around the crane.

[0008] Preferably, the four fisheye cameras perform multi-camera synchronous acquisition and transmission in the way of equal length of coaxial cables and equal length of PCB lines.

[0009] Preferably, each path of the fisheye camera is configured with an analog decoding circuit, and the analog decoding circuit is used to decode the analog data transmitted from the fisheye camera, convert it into an eDP signal, and send it to the main control unit; The main control unit is used to process the fisheye camera acquisition data transmitted from the analog decoding circuit for 360-degree imaging around the crane and obstacle detection; The screen SERDES circuit on the second data path includes an eDP serializer and an eDP deserializer. The eDP serializer is used to serialize the 360-degree imaging around the crane and the obstacle detection results transmitted by the main control unit. The eDP deserializer is used to deserialize the serialized data transmitted by the eDP serializer, restore it to eDP data, output the obstacle detection results, and send them to the display screen to display the 360-degree imaging around the crane and the obstacle detection results.

[0010] Preferably, the system includes multiple AHD cameras that collect video data on the boom through analog encoding. The configured positions of the AHD cameras are: 2 are set near the winch, and 3 are set near the counterweight.

[0011] Preferably, the multiple AHD cameras perform synchronous acquisition and transmission through the same length of coaxial cables and the same length of PCB lines.

[0012] Preferably, each AHD camera is configured with an analog decoding circuit. The analog decoding circuit is used to decode the analog data transmitted by the AHD camera, convert it into an MIPI_CSI signal, and send it to the main control unit. The main control unit is used to process the data collected by the AHD camera transmitted by the analog decoding circuit, and perform winch rope disorder monitoring, counterweight identification, and pulley ratio identification. The screen SERDES circuit on the third data path includes a DSI serializer and a DSI deserializer. The DSI serializer is used to serialize the winch rope disorder monitoring results and the counterweight and pulley ratio identification results transmitted by the main control unit. The DSI deserializer is used to deserialize the serialized data transmitted by the DSI serializer, restore it to an MIPI_DSI signal, and send it to the display screen for display, provide an alarm to the operator, and display the corresponding video to the operator for assisting in the operation.

[0013] The present invention also provides a crane, which is characterized in that it is configured with the above-mentioned video acquisition, transmission, and display system for cranes.

[0014] The beneficial effects brought by the technical solution of the present invention are as follows: The present invention provides a video acquisition, transmission, and display system for cranes, which is specifically used for multi-channel, high-resolution, and long-distance video acquisition, transmission, and display scenarios of medium and large-tonnage cranes. It enables a single host to support the access of 13 cameras, reducing the number of hosts and at the same time reducing the number of cables, thereby reducing costs, weight, installation difficulty, and cost. By introducing serializers and deserializers at the camera and screen ends, the transmission distance between the camera and the main control, and between the display screen and the main control is extended (≥10m). The operator face recognition and behavior monitoring camera adopts the MIPI + serializer method to achieve the miniaturization of the camera. The 360-degree panoramic view and obstacle detection camera uses a fish-eye camera to achieve a wider viewing angle with fewer cameras. The auxiliary operation camera uses an AHD camera, and after image processing by the main control unit, functions such as rope entanglement detection, pulley ratio recognition, and counterweight recognition can be realized.

[0015] The present invention integrates functions such as face recognition, behavior monitoring, 360-degree panoramic view, obstacle monitoring, rope entanglement detection, counterweight recognition, and pulley ratio recognition, and adapts to the crane operation scenario. At the same time, the POC (Power Over Coax) technology is adopted for power supply, reducing the number of cables, and reducing costs and weight. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a schematic structural diagram of a video acquisition, transmission, and display system for cranes provided by an embodiment of the present invention; Figure 2 It is a schematic circuit diagram of the camera SERDES in the video acquisition, transmission, and display system provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0017] Next, the specific embodiments of the present invention will be further described in detail in conjunction with the drawings and embodiments. The embodiments described below with reference to the drawings are illustrative and are intended to explain the present invention, but should not be construed as limiting the present invention.

[0018] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by terms such as "upper", "lower", "front", "rear", "end", "bottom", "side", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or component referred to must have a specific orientation, and therefore should not be construed as limiting the present invention.

[0019] In the present invention, unless otherwise clearly specified and limited, terms such as "connection" and "installation" should be understood in a broad sense. For example, it can be a fixed connection, a direct connection, or a connection through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0020] Secondly, as used herein, "one embodiment" or "an embodiment" refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in different places in this specification does not necessarily refer to the same embodiment, nor is it an individual or alternative embodiment that is mutually exclusive with other embodiments.

[0021] The following further describes in detail the specific implementation manners of the present invention in conjunction with the accompanying drawings. The following embodiments are used to illustrate the present invention but are not intended to limit the scope of the present invention. Embodiment 1

[0022] Embodiment 1 of the present invention provides a multi-channel high-resolution long-distance video acquisition, transmission, and display system for medium and large-tonnage cranes. Refer to Figure 1 , which includes: a camera group, a camera SERDES circuit, an analog decoding circuit, a main control unit, a screen SERDES circuit, and a display screen.

[0023] Among them, the camera group includes a face recognition and behavior monitoring camera, a 360-degree panoramic fisheye camera, and an auxiliary operation AHD camera.

[0024] Specifically, the face recognition and behavior monitoring camera, the camera SERDES circuit, and the main control unit form a data path for identifying the operator's identity and monitoring the operator's working status, etc. It should be noted that the face recognition and behavior monitoring camera is installed inside the cab.

[0025] The 360-degree panoramic fisheye camera, the analog decoding circuit, the main control unit, the screen SERDES circuit, and the display screen form a second data path for realizing 360-degree imaging around the crane, obstacle detection, and avoiding safety problems caused by blind spots in the field of vision and illegal intrusion during operation. It should be noted that 4 fisheye cameras are used together to form the 360-degree panoramic fisheye camera, which are respectively installed at four positions of the front, rear, left, and right of the crane.

[0026] The auxiliary operation AHD camera, the analog decoding circuit, the main control unit, the screen SERDES circuit, and the display screen form a third data path for monitoring the winding of the hoist rope, identifying the counterweight, and identifying the block and tackle ratio, etc. during the operation of the crane. It should be noted that the installation positions of the auxiliary operation AHD cameras include: 2 are set near the hoist, and 3 are set near the counterweight blocks.

[0027] In this embodiment, except for the camera group, the remaining circuits and the main control unit are all arranged inside the cab.

[0028] In this embodiment, the face recognition and behavior monitoring camera uses the MIPI_CSI interface and is connected to the PCB board through the FPC to convert the face information and the operator's behavior information into digital signals, which not only meets miniaturization but also high bandwidth.

[0029] See Figure 2 , the camera SERDES circuit includes a CSI serializer and a CSI deserializer. The CSI serializer is used to serialize the data transmitted by MIPI_CSI to achieve long-distance transmission of high-bandwidth data; the CSI deserializer is used to deserialize the serialized data transmitted by the CSI serializer and restore it to MIPI_CSI data recognizable by the main control unit, realizing long-distance transmission of high-bandwidth data.

[0030] The main control unit is used to process the data transmitted by the CSI deserializer and output the results of face recognition and operator behavior recognition.

[0031] In this embodiment, a fisheye camera is used to achieve a wider viewing angle; four fisheye cameras are configured to achieve 360-degree imaging around the crane.

[0032] Furthermore, the four fisheye cameras achieve synchronous acquisition and transmission of multiple cameras by means of equal-length coaxial cables and equal-length PCB lines.

[0033] Each fisheye camera is configured with an analog decoding circuit, which is used to decode the analog data transmitted by the fisheye camera and convert it into an eDP signal, and send it to the main control unit.

[0034] The main control unit is used to process the data collected by the fisheye camera transmitted by the analog decoding circuit to achieve 360-degree imaging around the crane and obstacle detection. It should be noted that existing imaging methods and obstacle detection methods can be used to achieve 360-degree imaging around the crane and obstacle detection based on the data collected by the camera. Those skilled in the art should know how to perform obstacle detection based on the image data around the crane collected, so it will not be elaborated here.

[0035] The screen SERDES circuit includes an eDP serializer and an eDP deserializer. The eDP serializer is used to serialize the data transmitted by the main control unit to achieve long-distance transmission of high-bandwidth data; the eDP deserializer is used to deserialize the serialized data transmitted by the eDP serializer, restore it to eDP data, and output the obstacle detection result, and send it to the display screen to display the 360-degree imaging around the crane and the obstacle detection result.

[0036] Based on this technical means, this embodiment realizes wide viewing angle, synchronous acquisition and transmission of multiple cameras, decodes multiple analog signals into a single digital signal, and simultaneously realizes high-bandwidth long-distance transmission of image processing and display.

[0037] In this embodiment, multiple AHD cameras are configured to achieve long-distance transmission of video data on the boom through analog encoding.

[0038] Furthermore, multiple AHD cameras achieve synchronous acquisition and transmission through the means of equal-length coaxial cables and equal-length PCB lines.

[0039] Each AHD camera is configured with an analog decoding circuit, which is used to decode the analog data transmitted by the AHD camera and convert it into an MIPI_CSI signal, and then send it to the main control unit.

[0040] The main control unit is used to process the data collected by the AHD cameras transmitted by the analog decoding circuit, and realize functions such as monitoring of winch rope jamming, counterweight identification, and pulley ratio identification. It should be noted that existing technology identification methods can be used to identify the winch rope jamming, counterweight, and pulley ratio of the crane. Those skilled in the art should all know how to identify based on the collected boom video data, so it will not be elaborated here.

[0041] The screen SERDES circuit includes a DSI serializer and a DSI deserializer. The DSI serializer is used to serialize the data transmitted by the main control unit to achieve long-distance transmission of high-bandwidth data; the DSI deserializer is used to deserialize the serialized data transmitted by the DSI serializer, restore it to an MIPI_DSI signal, and send it to the display screen to display relevant results, provide an alarm to the operator, and display the corresponding video to the operator for assisting in the operation.

[0042] Based on this technical means, this embodiment realizes synchronous acquisition and transmission of multiple AHD cameras, decodes multiple analog signals into a single digital signal, and simultaneously realizes high-bandwidth long-distance transmission of image processing and display.

[0043] Furthermore, the present invention also provides a crane configured with the above-mentioned video acquisition, transmission, and display system for cranes.

[0044] The above are only the preferred embodiments of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the technical principle of the present invention, several improvements and deformations can be made, and these improvements and deformations should also be regarded as the protection scope of the present invention.

Claims

1. A video acquisition, transmission and display system for a crane, characterized in that, Including: A camera group, a camera SERDES circuit, an analog decoding circuit, a main control unit, a screen SERDES circuit, and a display screen; The camera group includes a face recognition and behavior monitoring camera, a fish-eye camera, and an AHD camera; The face recognition and behavior monitoring camera, the camera SERDES circuit, and the main control unit form a data path for identifying the operator's identity and monitoring the operator's working status; The fish-eye camera, the analog decoding circuit, the main control unit, the screen SERDES circuit, and the display screen form a second data path for imaging around the crane and detecting obstacles; The AHD camera, the analog decoding circuit, the main control unit, the screen SERDES circuit, and the display screen form a third data path for monitoring the winding disorder of the hoist, identifying the counterweight, and identifying the pulley ratio during crane operation; Wherein each fish-eye camera and AHD camera are each configured with a path of analog decoding circuit; each data path is separately configured with a path of screen SERDES circuit and a display screen.

2. The video acquisition, transmission and display system for a crane according to claim 1, wherein The face recognition and behavior monitoring camera, the camera SERDES circuit, the analog decoding circuit, the main control unit, the screen SERDES circuit, and the display screen are all installed in the cockpit.

3. The video acquisition, transmission and display system for a crane according to claim 2, wherein, The face recognition and behavior monitoring camera uses the MIPI_CSI interface, is connected to the PCB board through the FPC, and converts the collected face information and operator behavior information into digital signals; The camera SERDES circuit includes a CSI serializer and a CSI deserializer. The CSI serializer is used to serialize the data transmitted from the MIPI_CSI interface; the CSI deserializer is used to deserialize the serialized data transmitted from the CSI serializer, restore it to the MIPI_CSI data that the main control unit can recognize, and send it to the main control unit; The main control unit is used to process the data transmitted from the CSI deserializer and output the face recognition and operator behavior recognition results.

4. The video acquisition, transmission and display system for a crane according to claim 1, characterized in that, The system includes four fish-eye cameras, which are respectively installed at the front, rear, left, and right positions of the crane to form a 360-degree panoramic fish-eye camera for 360-degree imaging around the crane.

5. The video acquisition, transmission and display system for a crane according to claim 4, characterized in that, The four fish-eye cameras perform multi-camera synchronous acquisition and transmission in a way that the coaxial cables are of equal length and the PCB lines are of equal length.

6. The video acquisition, transmission and display system for a crane according to claim 4, wherein Each fish-eye camera is configured with an analog decoding circuit, and the analog decoding circuit is used to decode the analog data transmitted from the fish-eye camera and convert it into an eDP signal and send it to the main control unit; The main control unit is used to process the fish-eye camera acquisition data transmitted from the analog decoding circuit for 360-degree imaging around the crane and obstacle detection; The screen SERDES circuit on the second data path includes an eDP serializer and an eDP deserializer. The eDP serializer is used to serialize the 360-degree imaging around the crane and the obstacle detection results transmitted by the main control unit. The eDP deserializer is used to deserialize the serialized data transmitted by the eDP serializer, restore it to eDP data, output the obstacle detection results, and send them to the display screen to display the 360-degree imaging around the crane and the obstacle detection results.

7. A video acquisition, transmission and display system for a crane according to claim 1, characterized in that, The system includes multiple AHD cameras that collect video data on the boom through analog encoding. The configured positions of the AHD cameras include: 2 are set near the hoist, and 3 are set near the counterweight.

8. A video acquisition, transmission and display system for a crane according to claim 7, characterized in that, The multiple AHD cameras perform synchronous acquisition and transmission through the equal length of coaxial cables and the equal length of PCB lines.

9. The video acquisition, transmission and display system for a crane according to claim 7, characterized in that, Each AHD camera is configured with an analog decoding circuit, which is used to decode the analog data transmitted by the AHD camera and convert it into an MIPI_CSI signal and send it to the main control unit. The main control unit is used to process the AHD camera acquisition data transmitted by the analog decoding circuit, and perform hoist rope entanglement monitoring, counterweight identification, and block ratio identification. The screen SERDES circuit on the third data path includes a DSI serializer and a DSI deserializer. The DSI serializer is used to serialize the hoist rope entanglement monitoring results and the counterweight and block ratio identification results transmitted by the main control unit. The DSI deserializer is used to deserialize the serialized data transmitted by the DSI serializer, restore it to an MIPI_DSI signal, and send it to the display screen for display, provide an alarm to the operator, and present the corresponding video to the operator for assisting in the operation.

10. A crane, characterized in that, A video acquisition, transmission, and display system for a crane as claimed in any one of claims 1 to 9 is configured.

Images