Container inspection equipment scanning data processing method and system and related equipment

Abstract

The method comprises the following steps: establishing and displaying a three-dimensional model of a container inspection scene, wherein the container inspection scene comprises a container inspection device; receiving scanning data of the container inspection device, wherein the scanning data comprises scanning image column data and scanning order data of the scanning image column data; splicing the scanning image column data according to the scanning order data to obtain a scanning image; and displaying the scanning image in the three-dimensional model of the container inspection scene. The container scanning data processing method, system, electronic device and computer readable medium provided by the embodiment of the present disclosure can realize intuitive and real-time display of the container inspection device and real-time scanning image in the whole container inspection scene.

Description

Technical Field

[0001] This disclosure relates to the field of scanning and inspection technology, and in particular to a method, system, electronic device and computer-readable medium for processing scanning data of a container inspection device. Background Technology

[0002] Currently, container inspection equipment generates a scanned image after scanning a container, and displays the image as a two-dimensional picture or diagram for operators to view. However, the display of two-dimensional pictures is not intuitive enough, lacks a sense of three-dimensionality and realism, and the operating experience is not realistic enough.

[0003] Therefore, there is a need for a new method, system, electronic equipment, and computer-readable medium for processing scanning data from container inspection equipment.

[0004] The information disclosed in the background section is only intended to enhance the understanding of the background of this disclosure. Summary of the Invention

[0005] In view of this, the present disclosure provides a method, system, electronic device and computer-readable medium for processing scanning data of container inspection equipment, which can realize an intuitive display of container inspection equipment and scanned images throughout the container inspection site.

[0006] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0007] According to a first aspect of the present disclosure, a method for processing scanning data of a container inspection device is proposed, executed by a server. The method includes: establishing and displaying a three-dimensional model of a container inspection scene, the container inspection scene including a container inspection device; receiving scanning data from the container inspection device, the scanning data including scan image column data and scan order data of the scan image column data, the scanning data being obtained by the container inspection device scanning the container when it detects a container; stitching the scan image column data according to the scan order data to obtain a scanned image; and displaying the scanned image in the three-dimensional model of the container inspection scene.

[0008] In one exemplary embodiment of this disclosure, the method further includes: receiving current status information of the container inspection equipment; determining a display mode for a status indicator icon based on the current status information; and displaying the status indicator icon in a three-dimensional model of the container inspection equipment according to the display mode of the status indicator icon; wherein the current status information includes offline status, standby status, and scanning status.

[0009] In one exemplary embodiment of this disclosure, receiving the scanning data of the container inspection device includes: receiving the scanning data of the container inspection device when a scan start command is received from the container inspection device and the current status information of the container inspection device is scanned.

[0010] In one exemplary embodiment of this disclosure, receiving the scan data from the container inspection device further includes: stopping receiving the scan data from the container inspection device when a scan end command is received from the container inspection device, or when the current status information of the container inspection device is not in a scanning state.

[0011] In one exemplary embodiment of this disclosure, establishing and displaying a three-dimensional model of a container inspection scene includes: acquiring survey data of the container inspection scene; establishing a three-dimensional model based on the survey data of the container inspection scene to obtain the three-dimensional model of the container inspection scene; rendering the three-dimensional model of the container inspection scene using Web 3D rendering technology; and displaying the three-dimensional model of the container inspection scene based on the rendering result.

[0012] In one exemplary embodiment of this disclosure, the scan data further includes first verification data of the scan image column data; wherein, stitching the scan image column data according to the scanning order to obtain a scan image includes: determining second verification information based on the scan image column data; and when the scan image column data passes verification based on the first verification information and the second verification information, stitching the scan image column data according to the scanning order to obtain a scan image.

[0013] In one exemplary embodiment of this disclosure, receiving the scanning data from the container inspection device includes: establishing a connection with the container inspection device based on the TCP full-duplex communication protocol, and receiving in real time the scan image column data and the scanning order data of the scan image column data generated by the container inspection device during the scanning of the container.

[0014] In one exemplary embodiment of this disclosure, displaying the scanned image in a three-dimensional model of the container inspection scene includes: determining the receiving speed of the scanning data received by the container inspection equipment; determining the translation speed of the scanned image based on the receiving speed; and displaying the scanned image in the three-dimensional model of the container inspection scene by sliding it according to the translation speed.

[0015] According to a second aspect of the present disclosure, a method for processing scanning data of a container inspection device is proposed, executed by the container inspection device. The method includes: when a container is detected, scanning the container to obtain scan image column data; determining the order data of the scan image column data according to the generation order of the scan image column data; encapsulating the scan image column data and the scan order data of the scan image column data to obtain scan data; and sending the scan data to a server so that the server can stitch the scan image column data according to the scan order data to obtain a scan image, and display the scan image in a three-dimensional model of the container inspection scene where the container inspection device is located.

[0016] In one exemplary embodiment of this disclosure, the method further includes: determining the throughput speed of the container; and determining a scanning speed for scanning the container based on the throughput speed.

[0017] In one exemplary embodiment of this disclosure, the method further includes: when a container is detected, determining that the current status information of the container inspection device is a scanning state; and sending the current status information of the container inspection device to the server, wherein the current status information further includes an offline state, a standby state, and a scanning state.

[0018] In one exemplary embodiment of this disclosure, the method further includes: when a container is detected, determining that the current status information is a scanning state, and sending an enable scanning command to the server, so that the server receives the scanning data of the container inspection device according to the current status information and the enable scanning command.

[0019] According to a third aspect of the present disclosure, a container inspection equipment scanning data processing system is provided. The system includes: a container inspection equipment, configured to scan the container upon detection to obtain scan image column data; determine scan order data of the scan image column data based on the generation order of the scan image column data; encapsulate the scan image column data and the scan order data to obtain scan data; and send the scan data to a server; the server is configured to build and display a three-dimensional model of a container inspection scene, the container inspection scene including the container inspection equipment; receive the scan data from the container inspection equipment; stitch the scan image column data together according to the scan order data to obtain a scan image; and display the scan image in the three-dimensional model of the container inspection scene.

[0020] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs; wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the container inspection equipment scanning data processing method described in any of the preceding claims.

[0021] According to a fifth aspect of the present disclosure, a computer-readable medium is provided having a computer program stored thereon, which, when executed by a processor, implements the container inspection equipment scanning data processing method as described in any of the preceding claims.

[0022] According to certain embodiments of the present disclosure, the container inspection equipment scanning data processing method, system, electronic device, and computer-readable medium display a 3D model of the container inspection scene on the server side, enabling operators to intuitively view the container inspection scene and improving the three-dimensionality and realism of the operation process. Upon receiving scanning data from the container inspection equipment, the scanned image columns are stitched together according to the scanning order to obtain a scanned image; the scanned image is then displayed in the 3D model of the container inspection equipment. This allows for an intuitive and visual display of the scanning process by combining the 3D model of the container inspection equipment and the scanned image, facilitating operators to understand the real-time operating status of the container inspection equipment and the real-time movement trajectory of the inspected container. This makes the analysis and processing of the real-time scanned images of the container more intuitive and realistic, thereby ensuring both the container inspection pass rate and accuracy, achieving 100% coverage of the container inspection rate along the route, and laying a solid foundation for the construction of unmanned ports.

[0023] It should be understood that the above general description and the following detailed description are merely exemplary and do not limit this disclosure. Attached Figure Description

[0024] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. The drawings described below are merely some embodiments of this disclosure, and those skilled in the art will be able to derive other drawings from these drawings without any inventive effort.

[0025] Figure 1 This is a system block diagram illustrating a method and apparatus for processing scanning data of a container inspection device according to an exemplary embodiment.

[0026] Figure 2 This is a flowchart illustrating a method for processing scanning data using a container inspection device according to an exemplary embodiment.

[0027] Figure 3This is a flowchart illustrating a method for processing scanning data using a container inspection device according to another exemplary embodiment.

[0028] Figure 4 This is a flowchart illustrating a method for processing scanning data of a container inspection device according to yet another exemplary embodiment.

[0029] Figure 5 This is a flowchart illustrating the construction, loading, and display of a three-dimensional model of a container inspection device and its surrounding operating environment, according to an exemplary embodiment.

[0030] Figure 6 This is a flowchart illustrating a method for processing scanning data of a container inspection device according to yet another exemplary embodiment.

[0031] Figure 7 Image loading is used to display comparison charts for every 100 columns and every 5 columns.

[0032] Figure 8 This is a block diagram illustrating a container inspection equipment scanning data processing system according to an exemplary embodiment.

[0033] Figure 9 The diagram schematically illustrates a block diagram of an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0034] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, they are provided so that the invention will be thorough and complete, and the concept of the exemplary embodiments will be fully conveyed to those skilled in the art. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted.

[0035] The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a full understanding of embodiments of the invention. However, those skilled in the art will recognize that the technical solutions of the invention can be practiced with one or more specific details omitted, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, systems, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the invention.

[0036] The accompanying drawings are merely illustrative of the invention; the same reference numerals denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0037] The flowchart shown in the accompanying drawings is merely illustrative and does not necessarily include all content and steps, nor does it require execution in the described order. For example, some steps may be broken down, while others may be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0038] The exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0039] Figure 1 This is a system block diagram illustrating a method and apparatus for processing scanning data of a container inspection device according to an exemplary embodiment.

[0040] The system of container inspection equipment scanning data processing method and apparatus may include container inspection equipment 110 and server 120. Container inspection equipment 110 may have container scanning capabilities. Container inspection equipment 110 and server 120 may transmit data via a network. Server 120 may have data processing capabilities. Server 120 may also have a display screen panel for displaying information.

[0041] When a container is detected, the container inspection equipment 110 can scan the container to obtain scan image column data; determine the scanning order data of the scan image column data according to the generation order of the scan image column data; encapsulate the scan image column data and the scanning order data of the scan image column data to obtain scan data; and send the scan data to the server 120.

[0042] The server 120 can be a single physical server, or it can consist of multiple servers. The server 120 can build and display a 3D model of a container inspection scenario, which includes the container inspection equipment 110; receive scanning data from the container inspection equipment 110; stitch together the scanned image column data according to the scanning sequence data to obtain a scanned image; and display the scanned image in the 3D model of the container inspection scenario.

[0043] The container can refer to the container itself, or it can refer to a vehicle with a container, a movable object, etc.

[0044] In this embodiment, the container inspection equipment 110 can perform the following steps 11, 12 and 13.

[0045] Step 11: Send the current status information of the container inspection equipment to the server 120 in real time.

[0046] Step 12: When a container or vehicle (i.e., the container referred to below) passes through the container inspection equipment 110, the container inspection equipment 110 detects the container or vehicle passing by (i.e., when the container inspection detects the container), sends an initiation scan command to the server 120, and automatically triggers scanning according to the speed at which the container or vehicle passes, while acquiring scan data during the scan.

[0047] Step 13: The container inspection equipment encapsulates the scanned data column by column, storing image information, scanned image column data, and data integrity verification information (i.e., the first verification information referred to below) in the data to be sent, and encrypts it before sending it to the server 120. After this scan is completed, a scan end command is sent to the server 120. Image information includes, for example, image identification information of the scanned image column data and scan sequence data.

[0048] The server 120 can execute the following steps 21, 22, 23, 24 and 25.

[0049] Step 21: Use 3D modeling technology to model the container inspection equipment 110 and its surrounding environment (i.e., the container inspection scene) to obtain a three-dimensional model.

[0050] Step 22: Load and display the 3D model of the container inspection equipment 110 and its surrounding environment.

[0051] Step 23: Receive the current status information sent by the container inspection equipment 110, and render and display it in real time in the scene of the 3D model.

[0052] Step 24: When a container or vehicle passes through the container inspection equipment 110 for scanning, the encapsulated scanning data sent by the container inspection equipment 110 is received in real time. After decrypting and parsing the data, the complete scanned image is obtained by splicing the scanning sequence data, image identification information and scanned image column data, and then displayed to restore the real environment of container scanning.

[0053] Step 25 displays statistical data such as the workload of container inspection equipment.

[0054] Figure 2 This is a flowchart illustrating a method for processing scanning data from a container inspection device according to an exemplary embodiment. The container inspection device scanning data processing method provided in this disclosure embodiment can, for example, be derived from... Figure 1The server 120 executes the process. The container inspection equipment scanning data processing method provided in this embodiment may include steps S202 to S208.

[0055] like Figure 2 As shown, in step S202, a three-dimensional model of the container inspection scenario is established and displayed. The container inspection scenario includes container inspection equipment.

[0056] In this embodiment, the server may have a display device for displaying a 3D model of the container inspection scene. The 3D model of the container inspection scene can be obtained through pre-modeling. Further, surveying data of the container inspection scene can be acquired; a 3D model is established based on the surveying data of the container inspection scene to obtain the 3D model of the container inspection scene; the 3D model of the container inspection scene is rendered using Web 3D rendering technology, and the 3D model of the container inspection scene is displayed based on the rendering result. The surveying data of the container inspection scene is obtained by surveying the container inspection scene. The container inspection scene may include one or more of container inspection equipment, container running tracks, and containers. The surveying data may include, for example, the position and size parameters of the container inspection equipment in the container inspection scene; it may also include, for example, the size parameters, arrangement position, or orientation of the container running tracks; and it may also include, for example, the size parameters and position information of the containers. The container running tracks are used to transport containers. The container running tracks may be, for example, in the form of container aerial running tracks, or for example, in the form of container floor-mounted running tracks.

[0057] In step S204, the scanning data of the container inspection device is received. The scanning data includes scan image column data and scan order data of the scan image column data. The scanning data is obtained by the container inspection device scanning the container when it detects a container.

[0058] In this embodiment of the disclosure, the scanned image column data can be image data of a scanned image dot matrix obtained by the container inspection equipment when it detects a container passing by, and the scanned image is in columns. When a container passes through the container scanning equipment, the container inspection equipment detects the container passing by through a detection device (e.g., an infrared sensor).

[0059] The order information of the scanned image column data can be obtained, for example, by numbering the scanned image column data acquired by the container inspection equipment during the scanning process by incrementing by one.

[0060] Specifically, when the container inspection equipment receives an initiation scan command and its current status is in a scanning state, it can receive scan data from the container inspection equipment. The container inspection equipment can trigger the initiation scan command and determine its current status as scanning state upon detecting the passage of a container or vehicle (e.g., the rising edge of an infrared sensor waveform). Furthermore, when the current status information of the container inspection equipment is received as scanning state, the current status of the container inspection equipment can be displayed by rendering a status indicator icon based on the current status information. For example, a flashing status indicator icon can be used to indicate the current status as scanning state, or a text-based status indicator icon can be used.

[0061] Furthermore, the receiving of scan data from the container inspection equipment can be stopped when a scan end command is received from the container inspection equipment, or when the current status information of the container inspection equipment is not in a scanning state. Specifically, the scan end command is triggered when the container inspection equipment detects the end of a container or vehicle passage (e.g., the falling edge of the waveform from an infrared sensor).

[0062] In an exemplary embodiment, in step S204, a connection can be established with the container inspection equipment based on the TCP full-duplex communication protocol to receive in real time the scanned image column data and the scanning order data of the scanned image column data generated by the container inspection equipment during the scanning of the container. The TCP full-duplex communication protocol can improve data transmission efficiency, has no limit on the size of transmitted data, and supports more data transmissions in a short period of time. In related technologies, in scenarios where scanned images are displayed as two-dimensional planar images or schematic diagrams, the full scanned image generated by the container inspection equipment is provided to the operator for analysis and processing only after the container inspection equipment has completed a container scan. This method results in a time lag in the display of scanned images, and the data display cannot be synchronized with the scanning action of the equipment, resulting in a lack of real-time image analysis for the operator. Furthermore, two-dimensional scanned images have a smaller data volume, so the requirement for transmission efficiency is lower. In scenarios where data transmission requirements increase, due to the limitation of data transmission volume, this method cannot achieve 100% coverage of container inspection rate. In this embodiment, by employing the TCP full-duplex communication protocol to establish a connection with the container inspection equipment, full transmission of scanned data is achieved. This ensures both the container inspection pass rate and accuracy, while achieving 100% coverage of container machine inspections along this route, laying a solid foundation for the construction of unmanned ports. Simultaneously, by receiving the scanned image column data and the scanning sequence data generated during the container scanning process in real time, and subsequently stitching the scanned image column data together based on the scanning sequence data to obtain the scanned image, it is ensured that the displayed scanned image is synchronized with the actual container scanning action, improving the real-time nature of image analysis for operators.

[0063] In an exemplary embodiment, when receiving scan data from the container inspection device, the following steps can be taken: receiving encrypted data sent by the container inspection device; decrypting the encrypted data to obtain the scan data.

[0064] In step S206, the scanned image is obtained by stitching together the scanned image column data according to the scanned sequence data.

[0065] In an exemplary embodiment, the scanned data may further include first verification data of the scanned image column data. The first verification information may, for example, be a hash value of a certain length obtained by the container inspection equipment performing verification operations (such as MD5, SHA-256, etc.) on the scanned image column data. In step S206, second verification information may be determined based on the scanned image column data; when the scanned image column data passes verification based on the first and second verification information, the scanned image column data is spliced ​​together according to the scanning order to obtain a scanned image.

[0066] In this embodiment of the disclosure, a second verification information can be obtained by performing verification operations on the scanned image column data. Specifically, the first verification information is obtained by the container inspection equipment calculating a hash value based on the scanned image column data. When determining the second verification information based on the scanned image column data, the hash value of the scanned image column data can be calculated to obtain the second verification information. If the first verification information and the second verification information are consistent, the scanned data verification can be confirmed as passed. If the first verification information and the second verification information are inconsistent, the scanned image column data corresponding to the second verification information can be discarded. When stitching the scanned image column data, the scanned image column data received at the current moment can be stitched together to obtain the scanned image at the current moment.

[0067] In step S208, the scanned image is displayed in a three-dimensional model of the container inspection scene.

[0068] In an exemplary embodiment, the receiving speed of the scanning data from the container inspection equipment can be determined; the translation speed of the scanned image can be determined based on the receiving speed; and when the scanned image is displayed in the three-dimensional model of the container inspection scene, it is displayed by sliding according to the translation speed. In this embodiment, the translation speed of the scanned image in the three-dimensional model of the container inspection scene can be determined based on the receiving speed of the scanning data, ensuring that the data display is not synchronized with the scanning action of the equipment, avoiding time lag, and thus enabling the operator to analyze the image in real time.

[0069] Furthermore, it can also receive container parameters sent by container inspection equipment, determine the current container model based on the container parameters, and display the current container model in the 3D model of the container inspection scene. Container parameters include, for example, the container's model number, size, and markings. Multiple 3D models of containers can be pre-stored, each corresponding to one set of container parameters. Then, based on the container parameters sent by the container inspection equipment, the current container model is determined from among the multiple 3D models of containers. Furthermore, it can also determine the container movement speed of the current container model based on the receiving speed, and when displaying the current container model in the 3D model of the container inspection scene, it slides according to the container movement speed.

[0070] According to the container inspection equipment scanning data processing method provided in this disclosure, the server displays a 3D model of the container inspection scene, enabling operators to intuitively view the scene and improving the sense of three-dimensionality and realism during operation. Upon receiving scanning data from the container inspection equipment, the scanned image columns are stitched together according to the scanning order to obtain a scanned image; this image is then displayed in the 3D model of the container inspection equipment. This allows for an intuitive visualization of the scanning process by combining the 3D model and the scanned image, facilitating real-time understanding of the equipment's operating status and the real-time movement trajectory of the inspected container. This makes the analysis and processing of the real-time scanned images of the container more intuitive and realistic, ensuring both high container inspection pass rate and accuracy while achieving 100% coverage of container inspection along the route, laying a solid foundation for the construction of unmanned ports.

[0071] Figure 3 This is a flowchart illustrating a method for processing scanned data from a container inspection device according to another exemplary embodiment. The container inspection device scanned data processing method provided in this disclosure may include steps S302 to S306.

[0072] like Figure 3 As shown, in step S302, the current status information of the container inspection equipment is received.

[0073] The current status information can include offline status, standby status, and scanning status. The container inspection equipment is in scanning status when scanning containers or vehicles. The container inspection equipment is in offline status when it is not powered on. The container inspection equipment is in standby status when it is powered on but not performing any substantive work (i.e., not performing any operations on documents or programs).

[0074] In step S304, the display method of the status indicator icon is determined based on the current status information.

[0075] In this embodiment of the disclosure, the status indicator icon is, for example, a light icon, a circular icon, or a text icon. The display mode of the status indicator icon under different current status information can be preset. For example, when the current status information is scanning, the display mode of the status indicator icon can be set to flashing. However, this is only an example, and this disclosure does not limit the display mode of the status indicator icon under different current status information.

[0076] In step S306, the status indicator icon is displayed in the three-dimensional model of the container inspection equipment according to the display method of the status indicator icon.

[0077] In this embodiment, the current status information of the container inspection equipment is displayed in a visual manner in the three-dimensional model of the container inspection equipment, which enables operators to monitor the current operating status of the container inspection equipment and the real-time movement trajectory of the inspected container in real time, ensuring that the image information transmitted by the container inspection equipment is received, parsed, and displayed correctly in real time.

[0078] Figure 4 This is a flowchart illustrating a method for processing scanning data from a container inspection device according to yet another exemplary embodiment. The container inspection device scanning data processing method provided in this disclosure can be... Figure 1 The container inspection equipment 110 performs the operation, and the method may include steps S402 to S410.

[0079] like Figure 4 As shown, in step S402, when a container is detected, the container is scanned to obtain scan image column data.

[0080] The passage speed of the container can be determined; the scanning speed for scanning the container is determined based on the passage speed. Container detection can be confirmed by changes in the sensing signal of a detection device (e.g., an infrared sensor). For example, a container detection can be confirmed upon receiving the rising edge of the waveform from an infrared sensor. When using a communication protocol for real-time data transmission, the scanning speed can be considered to be the same as the receiving speed of the scan data from the container inspection device at the server, as mentioned above.

[0081] The transit speed of the containers can be obtained based on sensor detection.

[0082] In an exemplary embodiment, when a container is detected, the current status information of the container inspection equipment can be determined to be in a scanning state; the current status information of the container inspection equipment can be sent to the server, and the current status information also includes offline state, standby state, and scanning state. When a container is detected, the current status information is determined to be in a scanning state, and a scan start command is sent to the server, so that the server can receive the scanning data of the container inspection equipment according to the current status information and the scan start command. The server can receive the scanning data of the container inspection equipment when it receives the scan start command sent by the container inspection equipment and the current status information of the container inspection equipment is in a scanning state.

[0083] In step S404, the scanning order data of the scanned image column data is determined according to the generation order of the scanned image column data.

[0084] In step S406, the scanned image column data and the scan order data of the scanned image column data are encapsulated to obtain scanned data.

[0085] In an exemplary embodiment, first verification information of the scanned image column data can be determined based on the scanned image column data; the scanned image column data, the first verification information of the scanned image column data, and the scan order data of the scanned image column data are encapsulated to obtain scanned data.

[0086] Among them, verification operations (such as MD5, SHA-256, etc.) can be performed on the column data of the scanned image, and the hash value of a certain byte length obtained is determined as the first verification information.

[0087] In step S408, the scan data is sent to the server so that the server can obtain the scan image from the scan image column data according to the scan sequence data and display the scan image in the 3D model of the container inspection scene where the container inspection equipment is located.

[0088] When the server obtains a scanned image based on the scanned data, it can determine the second verification information based on the scanned image column data. When the scanned image column data passes the verification based on the first verification information and the second verification information, the scanned image column data is spliced ​​together according to the scanning order to obtain a scanned image.

[0089] Figure 5 This is a flowchart illustrating the construction, loading, and display of a three-dimensional model of a container inspection device and its surrounding operating environment, according to an exemplary embodiment. The method for constructing and displaying a three-dimensional model of a container inspection device and its surrounding operating environment provided in this disclosure may include steps S502 to S512.

[0090] like Figure 5 As shown, in step S502, a three-dimensional model of the container inspection equipment, its site, and its surrounding environment is constructed using three-dimensional modeling technology (i.e., a three-dimensional model of the container inspection scene).

[0091] In step S504, the materials of the 3D model are exported according to the categories of container inspection equipment and its site.

[0092] In step S506, the exported materials are saved to the server in the specified 3D model file format.

[0093] In step S508, the server initializes the canvas scene and imports 3D model materials.

[0094] In step S510, 3D model materials are loaded according to requirements, and relevant scene rendering is performed using Web 3D rendering engine technology.

[0095] In step S512, the rendering ends and the 3D model of the container inspection equipment and its surrounding environment is loaded.

[0096] Figure 6 This is a flowchart illustrating a method for processing scanning data from a container inspection device according to yet another exemplary embodiment. The method for processing scanning data from a container inspection device provided in this disclosure may include steps S602 to S606.

[0097] like Figure 6 As shown, in step S602, the server performs scene rendering of the 3D model of the container inspection equipment and its surrounding environment.

[0098] In step S604, the server establishes message communication with the container inspection equipment.

[0099] In step S606, the container inspection equipment service is activated, and message communication is established with the server.

[0100] In step S608, the container inspection equipment begins scanning.

[0101] In step S610, a scan start command is sent.

[0102] In step S612, the server loads a 3D model of the container inspection equipment and its surrounding environment, and the status indicator icon for the current status information starts flashing.

[0103] In step S614, the container inspection equipment sends scan data in real time, in units of scan image column data.

[0104] In step S616, the server receives the scanned image in real time, generates and displays the scanned image.

[0105] In step S618, the container inspection equipment sends a command to end the scan.

[0106] In step S620, the server completes the display of the scanned image, and the status indicator icon for the current status information in the 3D model turns off its flashing.

[0107] If a new image scanning task is available, execution will begin from step S608.

[0108] Because container inspection equipment generates large amounts of scan data during machine scanning, a connection-oriented transmission control protocol (TCP) can be used between the container inspection equipment and the server to ensure data transmission efficiency. Once a connection is established based on the TCP full-duplex communication protocol, it is more secure and reliable, has no size limit for transmitted data, and offers stronger real-time performance, supporting more data transmissions in a short period. Therefore, the security, integrity, and order of transmitted images are guaranteed.

[0109] When the container scanning equipment begins scanning, it uses the grayscale data of the scanned image dots, acquired in real time and organized by column, as the column data. A unique hash value (i.e., the first verification information) of a certain byte length is calculated using a checksum algorithm (such as MD5, SHA-256, etc.) for verification by the server (receiver). This column data is then encapsulated with the unique identifier of the scanned image in the system (such as an image serial number), the order of the column data within the scanned image, and the calculated hash value. This information enables the system to quickly locate the image being scanned and correctly stitch the entire image after receiving the column image. To ensure data transmission security, the container scanning equipment can encrypt the column image data using the AES encryption algorithm before transmission. AES is a symmetric encryption algorithm where the sender and receiver use the same key. It offers fast encryption and decryption speeds, low resource consumption, and is suitable for large-scale data encryption. With secure key distribution between the sender and receiver, it can quickly and securely transmit data.

[0110] After receiving the scanned data from the container inspection equipment, the server first decrypts the data using AES using a key. Then, it performs a checksum operation on the scanned image column data. If the calculated result (the second checksum) matches the parsed hash value (the first checksum), the integrity of the scanned image column data is considered verified; otherwise, the system discards this column of image data. Ensuring data integrity, the system uses the parsed grayscale data of the scanned image column data, scanned image identification information (such as image serial numbers), and the order of the column data in the original image to stitch the images together and display them in real time.

[0111] Considering the efficiency of image loading and refresh display on the web, loading and displaying each column of data after receiving it is essentially meaningless for monitor refresh or human eye recognition. Figure 7 Comparison images were displayed by loading and displaying them in 100-column and 5-column increments. After comparison and verification, it was found that processing the received data in 5-column increments, reconstructing the image in real time, and displaying it on the web interface was more reasonable in terms of data real-time performance, data processing performance, and the user's visual experience. Therefore, loading and displaying data in 5-column increments is recommended. However, the actual implementation can be adjusted through configuration options based on factors such as computer performance and user real-time experience requirements.

[0112] The container inspection equipment scanning data processing method in this embodiment constructs a 3D model of the scanning equipment, site, and surrounding environment of the container inspection system using modeling technology. It then renders the 3D model onto a web application using a Web 3D rendering engine and encrypts the scanning equipment's operational data with the web application using a full-duplex communication protocol. When the container inspection system is running, based on the real-time transmitted operational data, the 3D scene dynamically and synchronously displays the equipment's operating status, the real-time movement trajectories of multiple inspected containers, and the real-time scanned image data. Through this real-time 3D scene visualization, operators can monitor the equipment's operating status, the real-time movement trajectories of multiple inspected containers, and the actual condition of the scanned containers in real time, improving the real-time performance of the image analysis process and providing a more intuitive and realistic operator experience.

[0113] It should be clearly understood that this disclosure describes how specific examples are formed and used, but the principles of this disclosure are not limited to any details of these examples. Rather, based on the teachings of this disclosure, these principles can be applied to many other embodiments.

[0114] Those skilled in the art will understand that all or part of the steps of the above embodiments are implemented as a computer program executed by a central processing unit (CPU). When the computer program is executed by the CPU, it performs the functions defined by the methods provided in this disclosure. The program can be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk, or an optical disk.

[0115] Furthermore, it should be noted that the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of this disclosure, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0116] The following are system embodiments of this disclosure, which can be used to execute the method embodiments of this disclosure. For details not disclosed in the system embodiments of this disclosure, please refer to the method embodiments of this disclosure.

[0117] Figure 8 This is a block diagram illustrating a container inspection equipment scanning data processing system according to an exemplary embodiment. (Refer to...) Figure 8 The container inspection equipment scanning data processing system 80 provided in this embodiment may include: container inspection equipment 802 and server 804.

[0118] In the container inspection equipment scanning data processing system 80, the container inspection equipment 802 can be used to scan the container to obtain scan image column data when a container is detected; determine the scanning order data of the scan image column data according to the generation order of the scan image column data; encapsulate the scan image column data and the scanning order data of the scan image column data to obtain scan data; and send the scan data to the server.

[0119] The server-side 804 can be used to create and display a 3D model of a container inspection scenario, which includes the container inspection equipment; receive scanning data from the container inspection equipment; stitch together the scanned image column data according to the scanning sequence data to obtain a scanned image; and display the scanned image in the 3D model of the container inspection scenario.

[0120] According to the container inspection equipment scanning data processing system provided in this embodiment, the server displays a 3D model of the container inspection scene, enabling operators to intuitively view the scene and improving the sense of three-dimensionality and realism during operation. Upon receiving scanning data from the container inspection equipment, the system stitches together the scanned image columns according to the scanning order to obtain a scanned image; this image is then displayed in the 3D model of the container inspection equipment. This allows for an intuitive visualization of the scanning process by combining the 3D model and the scanned image, facilitating real-time understanding of the equipment's operating status and the real-time movement trajectory of the inspected container. This makes the analysis and processing of the real-time scanned images of the container more intuitive and realistic, ensuring both high container inspection pass rate and accuracy while achieving 100% coverage of container inspection along the route, laying a solid foundation for the construction of unmanned ports.

[0121] In an exemplary embodiment, the server 804 may also be used to: receive current status information of the container inspection equipment; determine the display mode of the status indicator icon based on the current status information; and display the status indicator icon in the three-dimensional model of the container inspection equipment according to the display mode of the status indicator icon; wherein the current status information includes offline status, standby status, and scanning status.

[0122] In an exemplary embodiment, when the server 804 receives the scanning data from the container inspection device, it can be used to: receive the scanning data from the container inspection device when it receives an enable scanning command sent by the container inspection device and the current status information of the container inspection device is scanning status.

[0123] In an exemplary embodiment, when the server 804 receives the scanning data from the container inspection device, it can also: stop receiving the scanning data from the container inspection device when it receives an end-scan instruction sent by the container inspection device, or when the current status information of the container inspection device is not in a scanning state.

[0124] In an exemplary embodiment, when the server 804 builds and displays a 3D model of the container inspection scene, it can obtain the surveying data of the container inspection scene; build a 3D model based on the surveying data of the container inspection scene to obtain the 3D model of the container inspection scene; render the 3D model of the container inspection scene using Web 3D rendering technology; and display the 3D model of the container inspection scene based on the rendering result.

[0125] In an exemplary embodiment, the scan data further includes first verification data of the scan image column data; wherein, when the server 804 splices the scan image column data according to the scan order to obtain a scan image, it can determine second verification information based on the scan image column data; when the scan image column data passes verification based on the first verification information and the second verification information, the server splices the scan image column data according to the scan order to obtain a scan image.

[0126] In an exemplary embodiment, when the server 804 receives the scanning data from the container inspection equipment, it can establish a connection with the container inspection equipment based on the TCP full-duplex communication protocol and receive in real time the scan image column data and the scanning order data of the scan image column data generated by the container inspection equipment during the scanning of the container.

[0127] In an exemplary embodiment, when the server 804 displays the scanned image in the three-dimensional model of the container inspection scene, it can determine the receiving speed of the scanning data received by the container inspection equipment; determine the translation speed of the scanned image based on the receiving speed; and slide the image according to the translation speed when displaying the scanned image in the three-dimensional model of the container inspection scene.

[0128] In an exemplary embodiment, the container inspection device 802 can also be used to: determine the throughput speed of the container; and determine the scanning speed for scanning the container based on the throughput speed.

[0129] In an exemplary embodiment, the container inspection device 802 can also be used to: determine the current status information of the container inspection device as a scanning state when a container is detected; and send the current status information of the container inspection device to the server, wherein the current status information further includes an offline state, a standby state, and a scanning state.

[0130] In an exemplary embodiment, the container inspection device 802 can also be used to: when a container is detected, determine that the current status information is a scanning state, and send an enable scanning command to the server, so that the server receives the scanning data of the container inspection device according to the current status information and the enable scanning command.

[0131] The following reference Figure 9 To describe an electronic device 900 according to this embodiment of the present invention. Figure 9 The electronic device 900 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0132] like Figure 9 As shown, the electronic device 900 is manifested in the form of a general-purpose computing device. The components of the electronic device 900 may include, but are not limited to: at least one processing unit 910, at least one storage unit 920, and a bus 930 connecting different system components (including the storage unit 920 and the processing unit 910).

[0133] The storage unit stores program code that can be executed by the processing unit 910, causing the processing unit 910 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 910 can perform actions such as... Figure 2 or Figure 3 or Figure 4 or Figure 5 or Figure 6 The steps are shown in the figure.

[0134] Storage unit 920 may include readable media in the form of volatile storage units, such as random access memory (RAM) 9201 and / or cache memory 9202, and may further include read-only memory (ROM) 9203.

[0135] Storage unit 920 may also include a program / utility 9204 having a set (at least one) program module 9205, such program module 9205 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0136] Bus 930 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0137] Electronic device 900 can also communicate with one or more external devices 1000 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 900, and / or with any device that enables electronic device 900 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 950. Furthermore, electronic device 900 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 960. As shown, network adapter 960 communicates with other modules of electronic device 900 via bus 930. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 900, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0138] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0139] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the methods described above is stored. In some possible embodiments, various aspects of the invention may also be implemented as a program product comprising program code that, when the program product is run on a terminal device, causes the terminal device to perform the steps of the various exemplary embodiments of the invention described in the "Exemplary Methods" section of this specification.

[0140] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0141] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0142] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0143] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0144] Furthermore, the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of the present invention, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0145] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and concept of this disclosure are indicated by the claims.

Claims

1. A method for processing scanning data from a container inspection device, characterized in that, Executed by the server, including: A 3D model of a container inspection scenario is created and displayed, the container inspection scenario including container inspection equipment; The container inspection equipment receives scanning data, which includes scanned image column data and scan order data of the scanned image column data. The scanning data is obtained by the container inspection equipment scanning the container when it detects a container. The scanned image is obtained by stitching together the scanned image column data according to the scan sequence data; The scanned image is displayed in a 3D model of the container inspection scene; Receive container parameters sent by the container inspection equipment, and determine the current container model based on the container parameters; Determine the receiving speed of the scanned data from the container inspection equipment; The container moving speed of the current container model and the translation speed of the scanned image are determined based on the receiving speed. When displaying the current container model and the scanned image in the 3D model of the container inspection scene, the display is slidable according to the container's moving speed and translation speed, respectively.

2. The method as described in claim 1, characterized in that, Also includes: Receive current status information from container inspection equipment; The display method of the status indicator icon is determined based on the current status information; The status indicator icon is displayed in the 3D model of the container inspection equipment according to the display method of the status indicator icon; The current status information includes offline status, standby status, and scanning status.

3. The method as described in claim 2, characterized in that, Receiving the scan data from the container inspection equipment includes: When a scan start command is received from the container inspection equipment, and the current status information of the container inspection equipment is scanned, the scan data of the container inspection equipment is received.

4. The method as described in claim 3, characterized in that, Receiving the scan data from the container inspection equipment also includes: When a scan end command is received from the container inspection equipment, or when the current status information of the container inspection equipment is not in a scanning state, the receiving of scan data from the container inspection equipment is stopped.

5. The method as described in claim 1, characterized in that, Create and display a 3D model of the container inspection scenario, including: Obtain surveying data for container inspection scenarios; A three-dimensional model is established based on the mapping data of the container inspection scenario to obtain the three-dimensional model of the container inspection scenario; The 3D model of the container inspection scene is rendered using Web 3D rendering technology, and the 3D model of the container inspection scene is displayed based on the rendering results.

6. The method as described in claim 1, characterized in that, The scan data also includes first verification information of the scanned image column data; wherein, obtaining the scanned image by stitching together the scanned image column data according to the scan order includes: The second verification information is determined based on the scanned image column data; When the scanned image column data passes the verification based on the first verification information and the second verification information, the scanned image column data is stitched together according to the scanning order to obtain a scanned image.

7. The method as described in claim 1, characterized in that, Receiving the scan data from the container inspection equipment includes: A connection is established with the container inspection equipment based on the TCP full-duplex communication protocol, and the scan image column data and the scan order data of the scan image column data generated by the container inspection equipment during the scanning of the container are received in real time.

8. A method for processing scanning data from a container inspection device, characterized in that, Performed by container inspection equipment, including: When a container is detected, the container is scanned to obtain a column of scanned image data; The scanning order data of the scanned image column data is determined according to the generation order of the scanned image column data; The scanned image column data and the scan order data of the scanned image column data are encapsulated to obtain scanned data; The scanned data and container parameters are sent to the server so that the server can stitch together the scanned image column data according to the scan sequence data to obtain a scanned image, determine the current container model according to the container parameters, determine the receiving speed of the scanned data from the container inspection equipment, determine the container movement speed of the current container model and the translation speed of the scanned image according to the receiving speed, and when displaying the current container model and the scanned image in the 3D model of the container inspection scene where the container inspection equipment is located, slide the display according to the container movement speed and the translation speed respectively.

9. The method as described in claim 8, characterized in that, Also includes: Determine the throughput speed of the container; The scanning speed for scanning the container is determined based on the passing speed.

10. The method as described in claim 8, characterized in that, Also includes: When a container is detected, the current status information of the container inspection equipment is determined to be scanning status; The current status information of the container inspection equipment is sent to the server. The current status information also includes offline status, standby status, and scanning status.

11. The method as described in claim 10, characterized in that, Also includes: When a container is detected, the current status information is determined to be in a scanning state, and a scan start command is sent to the server so that the server can receive the scanning data of the container inspection equipment according to the current status information and the scan start command.

12. A container inspection equipment scanning data processing system, characterized in that, include: Container inspection equipment is used to scan a container to obtain a column of scanned image data when the container is detected. The scanning order data of the scanned image column data is determined according to the generation order of the scanned image column data; the scanned image column data and the scanning order data of the scanned image column data are encapsulated to obtain scanned data; the scanned data and container parameters are sent to the server. The server-side component is used to build and display a 3D model of a container inspection scenario, which includes the container inspection equipment; receive scanning data and container parameters from the container inspection equipment; stitch together the scanned image column data according to the scanning sequence data to obtain a scanned image; determine the current container model based on the container parameters; and determine the receiving speed of the scanning data from the container inspection equipment. The container moving speed of the current container model and the translation speed of the scanned image are determined based on the receiving speed; when displaying the current container model and the scanned image in the 3D model of the container inspection scene, they are displayed by sliding according to the container moving speed and the translation speed, respectively.

13. An electronic device, characterized in that, include: At least one processor; Storage device for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method as described in any one of claims 1-11.

14. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-11.

Images