Visualized supervision method, device and electronic equipment for sorting line

Abstract

The application provides a kind of sorting line visual supervision method, device and electronic equipment. Among them, the method comprises: listening to the running state of sorting line;When the running state is the unstart state, static image is displayed on the visual interface;When the running state is the start state, static image is replaced by dynamic image on the visual interface;The model of package is displayed on the visual interface;The position of package on the conveying belt is determined based on the data of sensor set by sorting line, and the model of package is adjusted based on the position of package on the conveying belt.In this way, an intuitive monitoring means can be provided, which simulates the running condition of the sorting line and the real-time position of the package based on the running data of the sorting line and the data of the sensor set by the sorting line, so that the operator can quickly understand the overall operation of the sorting system.

Description

Technical Field

[0001] This invention relates to the field of inspection and sorting technology, and in particular to a visual monitoring method, apparatus and electronic device for sorting lines. Background Technology

[0002] Currently, in the inspection and sorting system, packages need to be scanned by a barcode scanner to obtain package information before entering the sorting line. After the package is weighed by a weighing module to obtain its weight information, the inspection and sorting system needs to automatically associate the weight information with the corresponding package. The package then enters an X-ray machine. After the X-ray machine scans and generates an X-ray image, the inspection and sorting system needs to automatically associate the X-ray image with the corresponding package and perform intelligent review of the X-ray image. If the intelligent review finds that the package contains prohibited items, the inspection and sorting system will automatically transfer the package to the inspection area.

[0003] However, existing inspection and sorting systems lack a visual monitoring method, making it difficult for operators to quickly understand the overall operation of the inspection and sorting system. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide a visual monitoring method, device and electronic device for sorting lines, so as to provide an intuitive monitoring means, and to simulate the operation of sorting lines and the real-time location of packages by using the operation data of sorting lines and the data of sensors set up on sorting lines, so that operators can quickly understand the overall operation of the sorting system.

[0005] In a first aspect, embodiments of the present invention provide a visual monitoring method for a sorting line, the method comprising: monitoring the operating status of the sorting line; when the operating status is in an off state, displaying a static image on a visualization interface; when the operating status is in an on state, replacing the static image with a dynamic image on the visualization interface; displaying a model of a package on the visualization interface; determining the position of the package on the conveyor belt based on data from sensors set on the sorting line; and adjusting the model of the package based on the position of the package on the conveyor belt.

[0006] In optional embodiments of this application, the above method further includes: determining a top view of the sorting line area, a dynamic image, and a static image of the conveyor belt based on the CAD image of the sorting line; and displaying the top view of the area on a visualization interface.

[0007] In an optional embodiment of this application, the step of displaying a model of a package on a visual interface includes: generating a model of the package at the top of a dynamic image when the package passes through the barcode scanning module of the sorting line.

[0008] In optional embodiments of this application, the method further includes: determining the length of the sorting line and the length of the package model; determining the ratio of the length of the sorting line to the length of the package model; obtaining the running speed of the sorting line, and using the product of the running speed and the ratio as the moving speed of the package model; and moving the package model in a dynamic image based on the moving speed.

[0009] In an optional embodiment of this application, the steps of setting multiple photoelectric sensors on the sorting line, determining the position of the package on the conveyor belt based on the data from the sensors on the sorting line, and adjusting the package model based on the position of the package on the conveyor belt include: determining the positions of multiple photoelectric sensors for a dynamic image based on the positions of the multiple photoelectric sensors set on the sorting line; when the package passes the target photoelectric sensor, setting the position of the target photoelectric sensor on the sorting line as the position of the package; determining the position of the target photoelectric sensor for the dynamic image, and adjusting the position of the package model to the position of the target photoelectric sensor for the dynamic image.

[0010] In optional embodiments of this application, the method further includes: determining the positions of multiple modules of the dynamic image based on the positions of multiple modules set in the sorting line; when a package passes through a target module, taking the position of the target module on the sorting line as the position of the package; determining the position of the target module of the dynamic image, and adjusting the position of the package model to the position of the target module of the dynamic image.

[0011] In optional embodiments of this application, the method further includes: determining the state of the package based on the target module when the package passes through the target module; adjusting the running direction of the conveyor belt based on the state of the package; and adjusting the running direction of the package model in the dynamic image based on the state of the package.

[0012] In an optional embodiment of this application, the method further includes: when the package passes the target photoelectric sensor, determining the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image; determining the deviation distance between the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image; obtaining the moving speed of the package model, and adjusting the moving speed of the package model using the following formula: vb = v1 + l / t; where vb is the adjusted moving speed of the package model; v1 is the original moving speed of the package model; l is the deviation distance; and t is the time the package spends on the conveyor belt.

[0013] Secondly, embodiments of the present invention also provide a visual monitoring device for a sorting line, the device comprising: an operation status monitoring module for monitoring the operation status of the sorting line; a static image display module for displaying a static image on a visualization interface when the operation status is not started; a dynamic image replacement module for replacing the static image with a dynamic image on the visualization interface when the operation status is started; a package model display module for displaying a package model on the visualization interface; and a package model adjustment module for determining the position of the package on the conveyor belt based on data from sensors installed on the sorting line, and adjusting the package model based on the position of the package on the conveyor belt.

[0014] Thirdly, embodiments of the present invention also provide an electronic device, which includes a processor and a memory. The memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the above-described method for visual monitoring of the sorting line.

[0015] The embodiments of the present invention bring the following beneficial effects:

[0016] This invention provides a method, device, and electronic device for visually monitoring a sorting line. The device monitors the operating status of the sorting line; when the line is in a non-started state, a static image is displayed on the visualization interface; when the line is in a started state, the static image is replaced with a dynamic image on the visualization interface; a model of the package is displayed on the visualization interface; the position of the package on the conveyor belt is determined based on data from sensors installed along the sorting line, and the package model is adjusted based on the package's position on the conveyor belt. This method provides an intuitive monitoring approach, simulating the operation of the sorting line and the real-time position of the packages through data from the sorting line's operating data and sensors installed along the line, enabling operators to quickly understand and inspect the overall operation of the sorting system.

[0017] Other features and advantages of this disclosure will be set forth in the following description, or some features and advantages may be inferred from the description or determined without doubt, or may be learned by practicing the techniques described above.

[0018] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0019] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0020] Figure 1 A flowchart illustrating a visual monitoring method for a sorting line, as provided in an embodiment of the present invention;

[0021] Figure 2 A schematic diagram of a visual interface provided in an embodiment of the present invention;

[0022] Figure 3 This is a schematic diagram of a sorting line provided in an embodiment of the present invention;

[0023] Figure 4 A flowchart illustrating another method for visual monitoring of a sorting line provided in an embodiment of the present invention;

[0024] Figure 5 This is a schematic diagram of the structure of a visual monitoring device for a sorting line provided in an embodiment of the present invention;

[0025] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0027] Currently, in the inspection and sorting system, packages need to be scanned by a barcode scanner to obtain package information before entering the sorting line. After the package is weighed by a weighing module to obtain its weight information, the inspection and sorting system needs to automatically associate the weight information with the corresponding package. The package then enters an X-ray machine. After the X-ray machine scans and generates an X-ray image, the inspection and sorting system needs to automatically associate the X-ray image with the corresponding package and perform intelligent review of the X-ray image. If the intelligent review finds that the package contains prohibited items, the inspection and sorting system will automatically transfer the package to the inspection area.

[0028] However, existing inspection and sorting systems lack a visual monitoring method, making it difficult for operators to quickly understand the overall operation of the inspection and sorting system.

[0029] Based on this, the present invention provides a method, device and electronic device for visual monitoring of sorting lines, specifically providing a visual solution for inspecting and sorting packages. It can provide an intuitive monitoring means, and simulate the operation of the sorting line and the real-time location of the packages through the operation data of the sorting line and the data of the sensors set on the sorting line, so that operators can quickly understand the overall operation of the inspection and sorting system.

[0030] To facilitate understanding of this embodiment, a visual monitoring method for sorting lines disclosed in this embodiment of the invention will first be described in detail.

[0031] Example 1:

[0032] This invention provides a method for visual monitoring of sorting lines, see [link to relevant documentation]. Figure 1 The flowchart shown illustrates a method for visually monitoring a sorting line, which includes the following steps:

[0033] Step S102: Monitor the operating status of the sorting line.

[0034] In this embodiment, the operating status of the lower-level machine sorting line can be monitored in real time. The operating status of the sorting line can be either not started or started.

[0035] In some embodiments, top views, dynamic images, and static images of the conveyor belt of the sorting line can be determined based on CAD images of the sorting line; the top views of the sorting line can be displayed on a visualization interface.

[0036] In this embodiment, top views, dynamic images, and static images of the conveyor belt of the sorting line can be created on a scale based on the CAD (Computer-Aided Design) images of the sorting line.

[0037] See Figure 2 The diagram illustrates a visualization interface. In this embodiment, the visualization interface can display a top-down view of the sorting line area, as well as multiple different packages ( Figure 2 The middle section shows the status of packages 1 through 3. The area top view allows you to set and display different modules of the sorting line. Figure 2 The middle section shows the positions of modules 1-3, and the different sensors ( Figure 2 The image shows the positions of sensor 1 and sensor 2, as well as the models and positions of different packages.

[0038] Step S104: When the running status is not started, display a static image on the visualization interface.

[0039] When the running status is not started, static images can be displayed in the visualization interface.

[0040] Step S106: When the running state is in the startup state, replace the static image with a dynamic image in the visualization interface.

[0041] When the running status is not started, static images can be replaced with dynamic images in the visual interface.

[0042] Step S108: Display the model of the package on the visualization interface.

[0043] like Figure 2 As shown, in this embodiment, the model of the package can also be displayed on the visualization interface.

[0044] In some embodiments, a model of the package can be generated at the top of a dynamic image when the package passes through the barcode scanning module of the sorting line.

[0045] In this embodiment, photoelectric sensors can be installed at key locations on each conveyor belt section. These sensors can detect the arrival and departure signals of packages.

[0046] See also Figure 3 The diagram shown is a schematic of a sorting line, such as Figure 3 As shown, the sorting line is equipped with a barcode scanning module, a weighing module, an X-ray machine module, and a transfer module in sequence; the weighing module is equipped with a photoelectric sensor 1, the X-ray machine module is equipped with a photoelectric sensor 2 behind it, and the transfer module is equipped with a photoelectric sensor 3 in front of it.

[0047] When a package is scanned by the barcode scanning module, the inspection and sorting line in this embodiment can start monitoring the time when the barcode scanning module scans the package, and at the same time generate a model of the package at the location of the package in the dynamic image.

[0048] In some embodiments, the length of the sorting line and the length of the package model can also be determined; the ratio of the length of the sorting line to the length of the package model can be determined; the operating speed of the sorting line can be obtained, and the product of the operating speed and the ratio can be used as the moving speed of the package model; the package model can be moved in a dynamic image based on the moving speed.

[0049] In this embodiment, after generating the package model, the package model can be dynamically moved in the visualization interface.

[0050] First, the length *m* of the sorting line and the length *pixel* of the package model can be determined, and the ratio *p* = (sorting line length *m*) / (package model length *pixel*). Then, the operating speed of the sorting line is converted into the moving speed of the package model. Specifically, the moving speed of the package model *ps* can be determined as: ratio *p* × sorting line operating speed *s*.

[0051] Therefore, in this embodiment, the moving speed of the package model can be determined. After the package model is generated, the package model can be dynamically moved in the visualization interface based on the above moving speed, and the operator can more intuitively determine the position of the package model.

[0052] Step S110: Determine the position of the package on the conveyor belt based on the data from the sensors set up on the sorting line, and adjust the package model based on the position of the package on the conveyor belt.

[0053] like Figure 3 As shown, in this embodiment, photoelectric sensors can be installed at key locations on each conveyor belt section. The photoelectric sensors can detect the arrival and departure signals of packages. Figure 3 Photoelectric sensor 1 to photoelectric sensor 3 are installed in it.

[0054] Therefore, in this embodiment, the signal from photoelectric sensor 1 to photoelectric sensor 3 can be used to determine whether the package has passed through photoelectric sensor 1 to photoelectric sensor 3, thereby determining the position of the package on the conveyor belt and adjusting the package model.

[0055] In some instances, multiple photoelectric sensors can be set up on the sorting line; the positions of multiple photoelectric sensors in the dynamic image are determined based on the positions of the multiple photoelectric sensors set on the sorting line; when a package passes through the target photoelectric sensor, the position of the target photoelectric sensor set on the sorting line is taken as the position of the package; the position of the target photoelectric sensor in the dynamic image is determined, and the position of the package model is adjusted to the position of the target photoelectric sensor in the dynamic image.

[0056] For example, such as Figure 3 As shown in the diagram. In this embodiment, the positions of photoelectric sensors 1-3 can be pre-displayed on the visualization interface. When the target package passes the target photoelectric sensor X (X = 1, 2, or 3), it can be determined that the position of the package model is the position of the target photoelectric sensor X displayed on the visualization interface. Therefore, the position of the package model can be adjusted to match the position of the target photoelectric sensor X in the dynamic image, thereby accurately locating the package and allowing operators to intuitively determine its position.

[0057] In some instances, the positions of multiple modules in a dynamic image can be determined based on the positions of multiple modules set in the sorting line; when a package passes through a target module, the position of the target module on the sorting line is taken as the position of the package; the position of the target module in the dynamic image is determined, and the position of the package model is adjusted to the position of the target module in the dynamic image.

[0058] like Figure 3As shown. In this embodiment, the positions of the scanning module, weighing module, X-ray machine module, and transfer module can also be pre-displayed on the visualization interface. Therefore, in this embodiment, when the package passes through the target module, it can be determined that the position of the package model is definitely the position of the target module displayed on the visualization interface. Therefore, the position of the package model can be adjusted to the position of the target module in the dynamic image, thereby accurately locating the package and making it convenient for operators to intuitively determine the position of the package.

[0059] This invention provides a visual monitoring method for sorting lines, which monitors the operating status of the sorting line. When the line is in a non-started state, a static image is displayed on the visualization interface. When the line is in a started state, the static image is replaced with a dynamic image on the visualization interface. A model of the package is displayed on the visualization interface. The position of the package on the conveyor belt is determined based on data from sensors installed on the sorting line, and the package model is adjusted based on the position of the package on the conveyor belt. This method provides an intuitive monitoring means, simulating the operation of the sorting line and the real-time position of the packages through the operating data of the sorting line and the data from the sensors installed on the sorting line, enabling operators to quickly understand and inspect the overall operation of the sorting system.

[0060] Example 2:

[0061] This embodiment provides another method for visual monitoring of sorting lines, which is implemented based on the above embodiment. See [link to relevant documentation]. Figure 4 The flowchart shown represents another method for visually monitoring a sorting line, which includes the following steps:

[0062] Step S402: When the package passes through the target module, determine the status of the package based on the target module.

[0063] like Figure 3 As shown. The inspection and sorting system in this embodiment can be equipped with a barcode scanning module, a weighing module, an X-ray machine module, and a transfer module. When a package passes through a target module, the package's status can be determined based on the target module.

[0064] For example, if the target module is a transplant module, the status of the package can be determined as either "inspected" or "released." If the target module is an X-ray machine module, the status of the package can be determined as "passed X-ray scan," etc.

[0065] Step S404: Adjust the running direction of the conveyor belt based on the status of the package.

[0066] For certain modules, the conveyor belt's direction of travel can be adjusted based on the package's status. For example... Figure 3As shown, if the target module is a transplant module, the direction of the conveyor belt can be adjusted to continue moving forward or to the right to conduct the inspection, based on the status of the package as either inspected or released.

[0067] Step S406: Adjust the running direction of the package model in the dynamic image based on the package's state.

[0068] In the visualization interface, the movement direction of the package model in the dynamic image can also be adjusted based on the package's status. If the target module is a transplant module, the movement direction in the dynamic image can be adjusted to continue moving forward or move to the right to enter the inspection area, based on whether the package's status is inspection or release.

[0069] In some embodiments, when the package passes the target photoelectric sensor, the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image can be determined; the deviation distance between the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image can be determined; the moving speed of the package model can be obtained, and the moving speed of the package model can be adjusted by the following formula: vb = v1 + l / t; where vb is the adjusted moving speed of the package model; v1 is the original moving speed of the package model; l is the deviation distance; and t is the time the package spends on the conveyor belt.

[0070] This embodiment can also correct the position of packages. In the actual use of the inspection and sorting system, the actual speed of the packages may deviate from the conveyor belt speed due to the different shapes of the packages. Therefore, it is necessary to use the photoelectric signals of photoelectric sensors to correct the package position. When the system detects the arrival of a package through the photoelectric sensor, the simulated package may be behind or ahead of schedule.

[0071] The moving speed of the package model can be adjusted using the following formula: vb = v1 + l / t; where vb is the adjusted moving speed of the package model; v1 is the original moving speed of the package model; l is the deviation distance; and t is the time the package spends on the conveyor belt.

[0072] At this point, the deviation distance l is the deviation distance between the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image. The moving speed of the package model can be adjusted from v1 to vb using the above formula, and the alignment is achieved at time t to ensure smooth alignment. Specifically, when the package is scanned by the barcode scanning module, the inspection and sorting line in this embodiment can start monitoring the time t during which the barcode scanning module scans the package.

[0073] The method described in this embodiment provides an intuitive monitoring tool. By using the operating data of the sorting line and the data from the sensors installed on the sorting line, the operation of the sorting line and the real-time location of the packages can be simulated, enabling operators to quickly understand the overall operation of the inspection and sorting system.

[0074] The method described in this embodiment can also provide a scheme for aligning the simulated package position with the actual package position. By combining the signals from photoelectric sensors and the speed information of the conveyor belt, the simulated package is adjusted in real time to align with the actual position.

[0075] Example 3:

[0076] Corresponding to the above method embodiments, this invention provides a visual monitoring device for sorting lines, see [link to relevant documentation]. Figure 5 The diagram shows a structural schematic of a visual monitoring device for a sorting line. The visual monitoring device for the sorting line includes:

[0077] The running status monitoring module 51 is used to monitor the running status of the sorting line.

[0078] The static image display module 52 is used to display static images on the visualization interface when the running state is not started.

[0079] The dynamic image replacement module 53 is used to replace static images with dynamic images in the visual interface when the running state is the startup state;

[0080] Package model display module 54 is used to display the package model in the visualization interface;

[0081] The package model adjustment module 55 is used to determine the position of the package on the conveyor belt based on the data from the sensors set up on the sorting line, and to adjust the package model based on the position of the package on the conveyor belt.

[0082] This invention provides a visual monitoring device for a sorting line, which monitors the operating status of the sorting line. When the line is in a non-started state, a static image is displayed on the visualization interface. When the line is in a started state, the static image is replaced with a dynamic image on the visualization interface. A model of the package is displayed on the visualization interface. The position of the package on the conveyor belt is determined based on data from sensors installed on the sorting line, and the package model is adjusted based on the position of the package on the conveyor belt. This method provides an intuitive monitoring approach, simulating the operation of the sorting line and the real-time position of the packages through data from the sorting line's operating data and sensors installed on the line, enabling operators to quickly understand and inspect the overall operation of the sorting system.

[0083] The aforementioned device also includes: an image creation module, used to determine the top view, dynamic image and static image of the conveyor belt of the sorting line area based on the CAD image of the sorting line; and to display the top view of the area on a visualization interface.

[0084] The aforementioned package model display module is used to generate a package model at the top of the dynamic image when the package passes through the barcode scanning module of the sorting line.

[0085] The aforementioned device further includes: a package model moving module, used to determine the length of the sorting line and the length of the package model; determine the ratio of the length of the sorting line to the length of the package model; obtain the running speed of the sorting line, and use the product of the running speed and the ratio as the moving speed of the package model; and move the package model in a dynamic image based on the moving speed.

[0086] Multiple photoelectric sensors are set on the sorting line; the package model adjustment module is used to determine the position of multiple photoelectric sensors in the dynamic image based on the position of the multiple photoelectric sensors set on the sorting line; when the package passes the target photoelectric sensor, the position of the target photoelectric sensor set on the sorting line is taken as the position of the package; the position of the target photoelectric sensor in the dynamic image is determined, and the position of the package model is adjusted to the position of the target photoelectric sensor in the dynamic image.

[0087] The aforementioned device further includes: a package model position adjustment module, used to determine the position of multiple modules in a dynamic image based on the positions of multiple modules set in the sorting line; when a package passes through a target module, the position of the target module on the sorting line is taken as the position of the package; the position of the target module in the dynamic image is determined, and the position of the package model is adjusted to the position of the target module in the dynamic image.

[0088] The aforementioned device package model position adjustment module is also used to determine the state of the package based on the target module when the package passes through the target module; adjust the running direction of the conveyor belt based on the state of the package; and adjust the running direction of the package model in the dynamic image based on the state of the package.

[0089] The aforementioned device further includes: a package model position correction module, used to determine the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image when the package passes the target photoelectric sensor; determine the deviation distance between the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image; obtain the moving speed of the package model, and adjust the moving speed of the package model using the following formula: vb=v1+l / t; where vb is the adjusted moving speed of the package model; v1 is the original moving speed of the package model; l is the deviation distance; and t is the time the package spends on the conveyor belt.

[0090] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the visual monitoring device for the sorting line described above can be referred to the corresponding process in the embodiments of the aforementioned visual monitoring method for the sorting line, and will not be repeated here.

[0091] Example 4:

[0092] This invention also provides an electronic device for running the above-described visual monitoring method for sorting lines; see also Figure 6 The diagram shows the structure of an electronic device, which includes a memory 100 and a processor 101. The memory 100 is used to store one or more computer instructions, which are executed by the processor 101 to realize the above-mentioned visual monitoring method for sorting lines.

[0093] Furthermore, Figure 6 The electronic device shown also includes a bus 102 and a communication interface 103, with the processor 101, the communication interface 103 and the memory 100 connected via the bus 102.

[0094] The memory 100 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 103 (which can be wired or wireless), such as the Internet, wide area network, local area network, or metropolitan area network. The bus 102 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 6 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0095] Processor 101 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of processor 101 or by instructions in software form. Processor 101 can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this invention. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this invention can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a readily available storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 100, and processor 101 reads information from memory 100 and, in conjunction with its hardware, completes the steps of the method described in the foregoing embodiments.

[0096] This invention also provides a computer-readable storage medium storing computer-executable instructions. When these computer-executable instructions are called and executed by a processor, they cause the processor to implement the aforementioned visual monitoring method for the sorting line. For specific implementation details, please refer to the method embodiments, which will not be repeated here.

[0097] The computer program product of the sorting line visualization monitoring method, device and electronic device provided in the embodiments of the present invention includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods in the preceding method embodiments. For specific implementation, please refer to the method embodiments, which will not be repeated here.

[0098] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the system and / or device described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0099] Furthermore, in the description of the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in the present invention based on the specific circumstances.

[0100] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0101] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0102] Finally, it should be noted that the above-described embodiments are merely specific implementations of the present invention, used to illustrate the technical solutions of the present invention, and not to limit it. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention, or make equivalent substitutions for some of the technical features; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for visual monitoring of a sorting line, characterized in that, The method includes: Monitor the operating status of the sorting line; When the running state is "not started", a static image is displayed on the visualization interface; When the running state is in the startup state, the static image is replaced with a dynamic image in the visualization interface; The visualization interface displays a model of the package; The position of the package on the conveyor belt is determined based on data from the sensors installed on the sorting line, and the model of the package is adjusted based on the position of the package on the conveyor belt. The method further includes: determining the length of the sorting line and the length of the package model; determining the ratio of the length of the sorting line to the length of the package model; obtaining the operating speed of the sorting line, and using the product of the operating speed and the ratio as the moving speed of the package model; and moving the package model in the dynamic image based on the moving speed. The steps of setting multiple photoelectric sensors on the sorting line, determining the position of the package on the conveyor belt based on data from the sensors on the sorting line, and adjusting the model of the package based on its position on the conveyor belt include: determining the positions of multiple photoelectric sensors in the dynamic image based on the positions of the multiple photoelectric sensors on the sorting line; when the package passes a target photoelectric sensor, setting the position of the target photoelectric sensor on the sorting line as the position of the package; determining the position of the target photoelectric sensor in the dynamic image, and adjusting the position of the package model to match the position of the target photoelectric sensor in the dynamic image. The method further includes: when the package passes the target photoelectric sensor, determining the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image; determining the deviation distance between the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image; obtaining the moving speed of the package model, and adjusting the moving speed of the package model using the following formula: vb=v1+l / t; where vb is the adjusted moving speed of the package model; v1 is the original moving speed of the package model; l is the deviation distance; and t is the time the package spends on the conveyor belt.

2. The method according to claim 1, characterized in that, The method further includes: Based on the CAD image of the sorting line, determine the top view of the sorting line area, the dynamic image, and the static image of the conveyor belt; The visualization interface displays a top-down view of the area.

3. The method according to claim 1, characterized in that, The steps of displaying the model of the package on the visualization interface include: When a package passes through the barcode scanning module of the sorting line, a model of the package is generated at the top of the dynamic image.

4. The method according to claim 1, characterized in that, The method further includes: The positions of the multiple modules in the dynamic image are determined based on the positions of the multiple modules set up on the sorting line; When the package passes the target module, the position of the target module on the sorting line is taken as the position of the package; Determine the position of the target module in the dynamic image, and adjust the position of the wrapped model to match the position of the target module in the dynamic image.

5. The method according to claim 4, characterized in that, The method further includes: When the package passes through the target module, the status of the package is determined based on the target module; The direction of the conveyor belt is adjusted based on the state of the package; The model of the package is adjusted in the direction of movement of the dynamic image based on the state of the package.

6. A visual monitoring device for a sorting line, characterized in that, The device includes: The running status monitoring module is used to monitor the running status of the sorting line; A static image display module is used to display static images on a visual interface when the running state is not started. The dynamic image replacement module is used to replace the static image with a dynamic image in the visualization interface when the running state is the startup state. Package model display module, used to display a model of the package on the visualization interface; The package model adjustment module is used to determine the position of the package on the conveyor belt based on the data from the sensors installed on the sorting line, and to adjust the model of the package based on the position of the package on the conveyor belt. The device further includes: a package model moving module, used to determine the length of the sorting line and the length of the package model; determine the ratio of the length of the sorting line to the length of the package model; obtain the running speed of the sorting line, and use the product of the running speed and the ratio as the moving speed of the package model; and move the package model in the dynamic image based on the moving speed. Multiple photoelectric sensors are installed on the sorting line; the package model adjustment module is used to determine the positions of multiple photoelectric sensors in the dynamic image based on the positions of the multiple photoelectric sensors installed on the sorting line; when the package passes the target photoelectric sensor, the position of the target photoelectric sensor installed on the sorting line is taken as the position of the package; the position of the target photoelectric sensor in the dynamic image is determined, and the position of the package model is adjusted to the position of the target photoelectric sensor in the dynamic image; The device further includes: a package model position correction module, used to determine the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image when the package passes the target photoelectric sensor; determine the deviation distance between the actual position of the package model in the dynamic image and the position of the target photoelectric sensor in the dynamic image; obtain the moving speed of the package model, and adjust the moving speed of the package model using the following formula: vb=v1+l / t; where vb is the adjusted moving speed of the package model; v1 is the original moving speed of the package model; l is the deviation distance; and t is the time the package spends on the conveyor belt.

7. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing computer-executable instructions that can be executed by the processor, the processor executing the computer-executable instructions to implement the visual monitoring method for a sorting line as described in any one of claims 1 to 5.

Images