Information processing systems, methods, apparatus, and electronic devices

Abstract

Embodiments of the present invention provide an information processing system, method, apparatus, and electronic equipment, relating to the field of information processing technology. The information processing system includes a first image acquisition device and a management platform. When the first image acquisition device detects the presence of a first container in the receiving area that does not contain any cargo, it acquires a first image of the first container and transmits the first image information of the first image to the management platform. The management platform receives the first image information transmitted from the first image acquisition device and, based on the first image information, acquires a first container identifier for the first container. The first image acquisition device acquires a second image of the first container in which cargo is contained and transmits the second image information of the second image to the management platform. The management platform receives the second image information transmitted from the first image acquisition device and, based on the second image information, acquires a cargo identifier for new cargo in the first container and links the first container identifier with the cargo identifier.

Description

Cross-reference to Related Applications

[0001] This application claims priority based on a Chinese patent application filed with the China National Intellectual Property Administration on June 25, 2023, with an application number of 202310755326.4 and an invention title of "Information Processing System, Method, Apparatus and Electronic Device". Here, all of its contents are incorporated into this application by reference.

Technical Field

[0002] This application relates to the field of information processing technology, and particularly to information processing systems, methods, apparatuses and electronic devices.

Background Art

[0003] In the logistics industry, storing the goods transported to the cargo distribution center is an important part of the goods flow process. In order to facilitate the management of goods, it is necessary to establish an association relationship between the goods and the container transporting the goods during the process of storing the goods.

[0004]

[0005] In related technologies, employees use handheld devices to read the two-dimensional codes of the container and each piece of goods arranged in the container respectively, obtain the container label and the goods label, and associate the obtained container label with the goods label.

Summary of the Invention

[0006] Embodiments of this application provide an information processing system, method, apparatus and electronic device, aiming to improve information processing efficiency. The specific technical solutions are as follows.

[0007] In a first embodiment, the present invention provides an information processing system. The information processing system includes a first image acquisition device and a management platform, wherein the first image acquisition device is mounted at a first preset position, and the acquisition area of ​​the first image acquisition device includes a preset storage area. The first image acquisition device is used to acquire a first image of the first container when it detects the presence of a first container in the receiving area where no cargo is placed, and to transmit the first image information of the first image to the management platform, wherein the first image information includes the first image, or includes the first container mark of the first container in the first image. The management platform is used to receive first image information transmitted from the first image acquisition device and to acquire a first container label of the first container based on the first image information. The first image acquisition device is further used to acquire a second image of the first container in which the cargo is placed, and to transmit the second image information of the second image to the management platform, wherein the second image information includes the second image, or, compared with the image of the frame immediately preceding the second image, includes the cargo markings of the new cargo in the first container in the second image. The management platform is further used to receive second image information transmitted from the first image acquisition device, to acquire a cargo label for new cargo in the first container based on the second image information, and to link the first container label with the cargo label.

[0008] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, Specifically, the first image acquisition device is used to perform label recognition on the first image to acquire the first container label of the first container, and / or to recognize the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0009] Preferably, in one specific embodiment, Specifically, the first image acquisition device is used to transmit the first image to the management platform and the second image to the management platform. Specifically, the management platform is used to perform label recognition on the first image, obtain the first container label of the first container in the first image, and recognize the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0010] Preferably, in one specific embodiment, The management platform is further used to determine the verification result for the first container mark when the first container mark for the first container is obtained, and to output a stacking command to instruct the placement of goods in the first container when the verification result indicates that the verification of the first container mark was successful.

[0011] Preferably, in one specific embodiment, the management platform is further used to output a stop command instructing a palletizing robot or person to stop placing cargo into the first container when it detects that the number of marked cargo labels obtained has reached a preset container cargo load capacity.

[0012] Preferably, in one specific embodiment, the management platform is used to: determine the cargo matching result when it detects that the number of cargo labels obtained reaches the container cargo load; output a first instruction message to instruct to record cargo labels when the cargo matching result indicates that the quantity of cargo placed in the first container is greater than the container cargo load; receive cargo labels transmitted by a target object in response to the first instruction message; compare the cargo labels transmitted from the received target object with the recorded cargo labels; obtain additional cargo labels to be linked; and link the first container label with the additional cargo labels, wherein the cargo labels transmitted from the target object are obtained by reading the cargo labels of the cargo placed in the first container using a pre-set reading device of the target object. and / or, The management platform is further used to output a second instruction message to instruct a check of the cargo labels if the cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo load capacity; to receive the cargo labels transmitted by the target object in response to the second instruction message; to compare the received cargo labels transmitted from the target object with the recorded cargo labels to obtain any extra cargo labels that should be unlinked; and to unlink the first container label from the extra cargo labels.

[0013] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, Specifically, the management platform is used to transmit a cargo matching command to the first image acquisition device when it detects that the number of cargo labels obtained has reached the container cargo load capacity. The first image acquisition device is further used to receive the cargo matching command, acquire a third image of the first container, perform object recognition on the third image, acquire the quantity of cargo placed in the first container, determine the cargo matching result based on the quantity of cargo placed in the first container and the number of cargo labels to be transmitted to the management platform, and transmit the cargo matching result to the management platform. The management platform is specifically used to receive the cargo matching results transmitted from the first image acquisition device.

[0014] Preferably, in one specific embodiment, Specifically, the management platform is used to transmit an image acquisition command to the first image acquisition device when it detects that the number of obtained cargo labels has reached the container cargo load capacity. The first image acquisition device is further used to receive the image acquisition command, acquire a third image of the first container, and transmit the third image to the management platform. Specifically, the management platform is used to receive the third image transmitted from the first image acquisition device, to perform object recognition on the third image and to obtain the quantity of goods placed in the first container, and to determine the cargo matching result based on the quantity of goods placed in the first container and the number of cargo labels obtained.

[0015] Preferably, in one specific embodiment, the information processing system further includes a transport robot. The management platform is further used to instruct the transport robot to transport the first container to a preset storage area if the cargo matching result indicates that the quantity of cargo placed in the first container is the same as the container's cargo load capacity. and / or, The management platform is further used to link the first container label and the supplementary cargo label, and then to instruct the transport robot to transport the first container to a preset storage area. and / or, The management platform is further used to instruct the transport robot to transport the first container to a preset storage area after unlinking the first container label from the extra cargo label.

[0016] Preferably, in one specific embodiment, the management platform is further used to determine the theoretical time when the last cargo was loaded, based on the container cargo load and a preset cargo loading speed, and to instruct the transport robot to move to the receiving area if it detects that the current time is earlier than the theoretical time and the time interval to the theoretical time is a preset time, the preset time being determined based on the transport robot's movement speed.

[0017] Preferably, in one specific embodiment, the information processing system further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The second image acquisition device is used to acquire a fourth image of the second container when it detects the presence of a second container in the shipping area where no cargo is placed, and to transmit the third image information of the fourth image to the management platform, wherein the third image information includes the fourth image, or includes the second container mark of the second container in the fourth image. The management platform is further used to receive the third image information transmitted from the second image acquisition device, to acquire the second container label of the second container based on the third image information, and to unlink the second container label from the cargo label associated with the second container label.

[0018] Preferably, in a specific embodiment, the second image acquisition device has an image recognition function. The second image acquisition device is further used to perform label recognition on the fourth image to obtain the second container label of the second container.

[0019] Preferably, in a specific embodiment. Specifically, the second image acquisition device is used to send the fourth image to the management platform. The management platform is further used to perform label recognition on the fourth image to obtain the second container label of the second container.

[0020] As a second aspect, the information processing method provided by the embodiments of the present application is applied to a management platform in an information processing system. The information processing system further includes a first image acquisition device. The first image acquisition device is attached to a first preset position. The acquisition area of the first image acquisition device includes a preset warehousing area. The information processing method includes: Receiving first image information of a first image sent from the first image acquisition device, and obtaining a first container label of the first container based on the first image information, where the first image is obtained by the first image acquisition device performing image acquisition on the first container when it detects that there is a first container without goods placed in the warehousing area. The first image information includes the first image or includes the first container label of the first container in the first image, and receiving second image information of a second image sent from the first image acquisition device, and obtaining a goods label of new goods in the first container based on the second image information. The second image is obtained by the first image acquisition device performing image acquisition on the first container with goods placed therein. The second image information includes the second image or includes the goods label of the new goods in the first container in the second image compared with an image of the frame one before the second image. associating the first container identifier with the cargo identifier.

[0021] Preferably, in a specific embodiment, the step of obtaining the cargo identifier of the new cargo in the first container based on the second image information includes: performing label recognition on the first image to obtain the first container identifier of the first container in the first image, and recognizing the cargo identifier of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame one before the second image.

[0022] Preferably, in a specific embodiment, the information processing method further includes: when the first container identifier of the first container is obtained, determining the verification result for the first container identifier, and when the verification result indicates that the verification of the first container identifier is successful, outputting a stacking instruction for instructing to arrange cargo in the first container.

[0023] Preferably, in a specific embodiment, the information processing system further includes a palletizing robot, and the information processing method further includes: when it is detected that the number of labels of the obtained cargo identifier reaches the preset container cargo loading capacity, outputting a stop instruction for instructing to stop arranging the cargo in the first container so that the palletizing robot or a person stops arranging the cargo in the first container.

[0024] Preferably, in a specific embodiment, the information processing method further includes: when it is detected that the number of labels of the obtained cargo identifier reaches the container cargo loading capacity, determining a cargo matching result, when the cargo matching result indicates that the number of cargo in the first container is greater than the container cargo loading capacity, outputting a first instruction message for instructing to record the cargo identifier. The process involves receiving a cargo label transmitted by the target object in response to the first instruction message, comparing the received cargo label transmitted from the target object with the recorded cargo label, obtaining a supplemental cargo label to be associated, and associating the first container label with the supplemental cargo label, wherein the cargo label transmitted from the target object is obtained by reading the cargo label of the cargo placed in the first container using a reading device preset by the target object. The cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo load capacity, and includes outputting a second instruction message to instruct checking the cargo labels; receiving the cargo labels transmitted by the target object in response to the second instruction message, comparing the received cargo labels transmitted from the target object with the recorded cargo labels, obtaining extra cargo labels that should be unlinked; and unlinking the first container label from the extra cargo labels.

[0025] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the step of determining the cargo matching result is: When it is detected that the number of obtained cargo labels reaches the container cargo load, a cargo matching command is sent to the first image acquisition device, the first image acquisition device receives the cargo matching command and acquires a third image of the first container. Receiving the cargo matching result transmitted from the first image acquisition device, wherein the cargo matching result is determined based on the first image acquisition device performing object recognition on the third image, obtaining the cargo quantity of the cargo placed in the first container, and the cargo quantity of the cargo placed in the first container and the number of cargo labels transmitted to the management platform.

[0026] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the step of determining the cargo matching result is: When it is detected that the number of cargo labels obtained reaches the container cargo load, an image acquisition command is sent to the first image acquisition device, the first image acquisition device receives the image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform. Receiving the third image transmitted from the first image acquisition device, The process includes performing object recognition on the third image to obtain the quantity of goods placed in the first container, and determining the cargo matching result based on the quantity of goods placed in the first container and the number of cargo labels obtained.

[0027] Preferably, in one specific embodiment, the information processing system further includes a transport robot, and the information processing method further includes If the cargo matching result indicates that the quantity of cargo placed in the first container is the same as the cargo load capacity of the container, the transport robot is instructed to transport the first container to a preset storage area. and / or, After linking the first container label and the supplementary cargo label, instruct the transport robot to transport the first container to a preset storage area. and / or, This includes unlinking the first container label from the extra cargo label, and then instructing the transport robot to transport the first container to a preset storage area.

[0028] Preferably, in one specific embodiment, the information processing method further includes: Based on the container cargo load capacity and the preset cargo loading speed, the theoretical time when the last cargo was loaded is determined, The system includes, if it detects that the current time is earlier than the theoretical time and the time interval between the theoretical time and the current time is a preset time, instructing the transport robot to move to the storage area, wherein the preset time is determined based on the transport robot's movement speed.

[0029] Preferably, in one specific embodiment, the information processing system further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The aforementioned information processing method is The process involves receiving the third image information transmitted from the second image acquisition device and acquiring the second container label of the second container based on the third image information, wherein the third image information is image information of a fourth image of the second container acquired when the second image acquisition device detects the presence of a second container in the shipping area where no cargo is placed, and the third image information includes the fourth image or includes the second container label of the second container in the fourth image. This includes unlinking the second container mark from the cargo mark associated with the second container mark.

[0030] Preferably, in one specific embodiment, the step of obtaining a second container label for the second container is: This includes performing label recognition on the fourth image and obtaining the second container label of the second container.

[0031] In a third aspect, the information processing method provided by the embodiment of the present application is applied to a first image acquisition device in an information processing system, the information processing system further includes a management platform, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing method is: When it is detected that there is a first container in the receiving area where no cargo is placed, a first image of the first container is acquired, and the first image information of the first image is transmitted to the management platform, so that the management platform receives the first image information and acquires a first container label of the first container based on the first image information, wherein the first image information includes the first image or includes the first container label of the first container in the first image. The method involves acquiring a second image of the first container in which the cargo is placed, transmitting the second image information of the second image to the management platform, the management platform receiving the second image information transmitted from the first image acquisition device, acquiring a cargo label for the new cargo in the first container based on the second image information, and linking the first container label with the cargo label, wherein the second image information includes the second image, or, compared with the image of the frame immediately preceding the second image, includes the cargo label for the new cargo in the first container in the second image.

[0032] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the information processing method further includes This includes performing label recognition on the first image to obtain the first container label of the first container, and / or recognizing the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0033] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the information processing method further includes When the management platform detects that the number of marked cargo labels obtained has reached the container cargo load, it receives the issued cargo matching command, acquires a third image of the first container, performs object recognition on the third image, obtains the quantity of cargo placed in the first container, determines the cargo matching result based on the quantity of cargo placed in the first container and the number of marked cargo labels to be transmitted to the management platform, and transmits the cargo matching result to the management platform, thereby allowing the management platform to receive the cargo matching result transmitted from the first image acquisition device.

[0034] Preferably, in one specific embodiment, the information processing method further includes: When the management platform detects that the number of marked cargo labels obtained reaches the container cargo load, it receives an image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform, which then receives the third image transmitted from the first image acquisition device, performs object recognition on the third image, obtains the quantity of cargo placed in the first container, and determines the cargo matching result based on the quantity of cargo placed in the first container and the number of marked cargo labels obtained.

[0035] In a fourth aspect, the information processing device provided in the embodiment of the present application is applied to a management platform in an information processing system, the information processing system further includes a first image acquisition device, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing device is A container identification receiving module that receives first image information of a first image transmitted from the first image acquisition device and acquires a first container identification mark of the first container based on the first image information, wherein the first image is obtained by acquiring an image of the first container when the first image acquisition device detects the presence of a first container in the storage area where no cargo is placed, and the first image information includes the first image or includes the first container identification mark of the first container in the first image, A cargo identification receiving module that receives second image information of a second image transmitted from the first image acquisition device and acquires cargo identification for new cargo in the first container based on the second image information, wherein the second image is obtained by the first image acquisition device performing image acquisition on the first container in which the cargo is placed, and the second image information includes the second image, or, by comparing it with the image of the frame immediately preceding the second image, includes the cargo identification for new cargo in the first container in the second image, The system includes a linking module that links the first container mark and the cargo mark.

[0036] Preferably, in one specific embodiment, the cargo identification receiving module is The system includes a first recognition means that performs mark recognition on the first image, obtains a first container mark of the first container in the first image, and recognizes a cargo mark of new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0037] Preferably, in one specific embodiment, the information processing device further comprises: The system includes verification result acquisition means, which, when a first container label for the first container is obtained, determines the verification result for the first container label, and if the verification result indicates that the verification of the first container label was successful, outputs a stacking command to instruct the placement of goods in the first container.

[0038] Preferably, in one specific embodiment, the information processing device further comprises: The system includes a first output means that, when it detects that the number of marked cargo labels obtained has reached a preset container cargo load capacity, outputs a stop command instructing the palletizing robot or a person to stop placing cargo into the first container.

[0039] Preferably, in one specific embodiment, the information processing device further includes result acquisition means, and the result acquisition means is When it is detected that the number of cargo labels obtained reaches the container cargo load, the cargo matching result is confirmed, and if the cargo matching result indicates that the quantity of cargo placed in the first container is greater than the container cargo load, a first instruction message is output to instruct the recording of cargo labels, the cargo labels transmitted by the target object in response to the first instruction message are received, the cargo labels transmitted from the received target object are compared with the recorded cargo labels, additional cargo labels to be linked are obtained, and the first container label and the additional cargo labels are linked, wherein the cargo labels transmitted from the target object are from the target object The following are used: the result is obtained by reading the cargo label of the cargo placed in the first container using a preset reading device; if the cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo loading capacity, a second instruction message is output to instruct to check the cargo label; the cargo label transmitted by the target object in response to the second instruction message is received, the cargo label transmitted from the received target object is compared with the recorded cargo label, an extra cargo label to be unlinked is obtained, and the link between the first container label and the extra cargo label is unlinked.

[0040] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the result acquisition means is specifically, When it is detected that the number of marked cargo labels obtained reaches the container cargo load, a cargo matching command is transmitted to the first image acquisition device, the first image acquisition device receives the cargo matching command and acquires a third image of the first container, and receives the cargo matching result transmitted from the first image acquisition device, the cargo matching result is determined by the first image acquisition device performing object recognition on the third image, acquiring the cargo quantity of cargo placed in the first container, and comparing the cargo quantity of cargo placed in the first container with the number of marked cargo labels transmitted to the management platform.

[0041] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the result acquisition means is specifically, When it is detected that the number of marked cargo labels obtained reaches the container cargo load, an image acquisition command is sent to the first image acquisition device, the first image acquisition device receives the image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform, receives the third image transmitted from the first image acquisition device, performs object recognition on the third image to obtain the cargo quantity of the cargo placed in the first container, and determines the cargo matching result based on the cargo quantity of the cargo placed in the first container and the number of marked cargo labels obtained.

[0042] Preferably, in one specific embodiment, the information processing system further includes a transport robot, and the information processing device further includes: The system includes an instruction means that, if the cargo matching result indicates that the quantity of cargo placed in the first container is the same as the container's cargo load, instructs the transport robot to transport the first container to a preset storage area, and / or, after linking the first container label with the additional cargo label, instructs the transport robot to transport the first container to a preset storage area, and / or, after unlinking the first container label with the extra cargo label, instructs the transport robot to transport the first container to a preset storage area.

[0043] Preferably, in one specific embodiment, the information processing device further comprises: A time determination means that determines the theoretical time when the last cargo was loaded based on the container cargo load and a preset cargo loading speed, and instructs the transport robot to move to the storage area if it detects that the current time is earlier than the theoretical time and the time interval between the theoretical time and the theoretical time is a preset time, wherein the preset time is determined based on the movement speed of the transport robot.

[0044] Preferably, in one specific embodiment, the information processing system further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The aforementioned information processing device further Information receiving means for receiving third image information transmitted from the second image acquisition device and acquiring a second container label of the second container based on the third image information, wherein the third image information is image information of a fourth image of the second container acquired when the second image acquisition device detects the existence of a second container in the shipping area where no cargo is placed, the third image information includes the fourth image, or includes the second container label of the second container in the fourth image, and the information receiving means for releasing the association between the second container label and the cargo label associated with the second container label.

[0045] Preferably, in one specific embodiment, the information receiving means is specifically, This is used to perform label recognition on the fourth image and obtain the second container label of the second container.

[0046] In a fifth aspect, the information processing device provided in the embodiment of the present application is applied to a first image acquisition device in an information processing system, the information processing system further includes a management platform, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing device is A container label recognition module that, when it detects the presence of a first container in the receiving area where no cargo is placed, acquires a first image of the first container, transmits the first image information of the first image to the management platform, the management platform receives the first image information, and acquires a first container label of the first container based on the first image information, wherein the first image information includes the first image, or includes the first container label of the first container in the first image, A cargo identification recognition module that acquires a second image of the first container in which cargo is placed, transmits the second image information of the second image to the management platform so that the management platform receives the second image information, acquires a cargo identification mark for new cargo in the first container based on the second image information, and associates the first container identification mark with the cargo identification mark, wherein the second image information includes the second image, or, by comparing it with an image of the frame immediately preceding the second image, includes the cargo identification mark for new cargo in the first container in the second image.

[0047] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the information processing device further, The system includes a second recognition means for performing label recognition on the first image to obtain a first container label of the first container, and / or recognizing a cargo label of new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0048] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the information processing device further, The management platform detects that the number of marked cargo labels obtained has reached the container cargo load capacity, and the management platform receives the issued cargo matching command, acquires a third image of the first container, performs object recognition on the third image, acquires the quantity of cargo placed in the first container, determines the cargo matching result based on the quantity of cargo placed in the first container and the number of marked cargo labels to be transmitted to the management platform, and transmits the cargo matching result to the management platform, thereby allowing the management platform to receive the cargo matching result transmitted from the first image acquisition device.

[0049] Preferably, in one specific embodiment, the information processing device further comprises: The management platform detects that the number of marked cargo labels obtained reaches the container cargo load, and the second command receiving means receives the issued image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform, so that the management platform receives the third image transmitted from the first image acquisition device, performs object recognition on the third image, obtains the cargo quantity of the cargo placed in the first container, and determines the cargo matching result based on the cargo quantity of the cargo placed in the first container and the number of marked cargo labels obtained.

[0050] In a sixth aspect, the electronic device provided by the embodiment of the present application is: Memory and, The system includes a processor that executes a program stored in memory to implement the steps of any of the above-described embodiments of the information processing method.

[0051] In a seventh aspect, the present embodiment provides a computer-readable storage medium on which a computer program is recorded, and when the computer program is executed by a processor, the steps of any of the above-described information processing method embodiments are realized.

[0052] As an eighth embodiment, the present invention further provides a computer program product including instructions, which, when run on a computer, causes the computer to execute the steps of any of the above-described information processing method embodiments.

[0053] In a ninth aspect, the present embodiment further provides a computer program including instructions, which, when the computer program is run on a computer, causes the computer to execute the steps of any of the above-described information processing method embodiments.

[0054] The embodiments of this invention provide the following beneficial effects.

[0055] As can be seen from the above, the technical solution provided in the embodiment of the present invention may include an information processing system comprising a first image acquisition device and a management platform, wherein the first image acquisition device is mounted at a first preset position, and the acquisition area of ​​the first image acquisition device includes a preset storage area.

[0056] When processing information, if the first image acquisition device detects the presence of a first container in the receiving area that does not contain any cargo, it can acquire a first image of the first container and transmit the first image information of the first image to the management platform. The first image information includes the first image or includes the first container mark of the first container in the first image. The management platform receives the first image information transmitted from the first image acquisition device and can acquire the first container mark of the first container based on the first image information. The first image acquisition device can also acquire a second image of the first container in which cargo is contained and transmit the second image information of the second image to the management platform. The second image information includes the second image or, by comparing it with the image of the frame immediately preceding the second image, includes the cargo mark of the new cargo in the first container in the second image. In this way, the management platform receives the second image information transmitted from the first image acquisition device and can acquire the cargo mark of the new cargo in the first container based on the second image information and link the first container mark with the cargo mark.

[0057] Based on this, the technology provided in the embodiment of the present invention allows both the container label and the cargo label to be obtained by recognizing images acquired by the first image acquisition device, thus providing higher recognition efficiency than a method of recognition by human reading. In the process of placing cargo, by comparing images of adjacent frames, new cargo in the container can be identified, and the cargo label of the new cargo in the container can be recognized, thereby efficiently avoiding cargo loss and improving the accuracy of label recognition. Furthermore, since linking the container label and the cargo label is achieved through cooperation between the management platform and the image acquisition device, the linking efficiency can be improved compared to a method of linking by human reading.

[0058] Of course, it is not necessary to achieve all of the above advantages when implementing any of the products or methods of this application. [Brief explanation of the drawing]

[0059] The drawings described herein are for further understanding of the present application and are intended to constitute part of the present application. The exemplary embodiments and descriptions herein are for illustrative purposes only and are not intended to limit the present application. [Figure 1] Figure 1 is a schematic diagram of the information processing system provided by the embodiment of this application. [Figure 2] Figure 2 is a Gunnaring interaction diagram of one of the information processing systems provided by the embodiment of this application. [Figure 3] Figure 3 is a schematic diagram of an application scenario for the information processing system provided by the embodiment of this invention. [Figure 4(a)] Figure 4(a) is a schematic diagram of a first image acquired by the first image acquisition device provided in this embodiment of the present invention. [Figure 4(b)] Figure 4(b) is a schematic diagram of a second image acquired by the first image acquisition device provided in this embodiment of the present invention. [Figure 4(c)] Figure 4(c) is another schematic diagram of the second image acquired by the first image acquisition device provided in this embodiment of the present invention. [Figure 5] Figure 5 is a schematic flowchart of one specific example of the information processing system provided by the embodiment of this application. [Figure 6] Figure 6 is a schematic flowchart of the information processing method applied to the management platform in the information processing system provided by the embodiment of this invention. [Figure 7] Figure 7 is a schematic flowchart of the information processing method applied to the first image acquisition device in the information processing system provided by the embodiment of the present invention. [Figure 8] Figure 8 is a schematic diagram of the configuration of an information processing device applied to the management platform in the information processing system provided by the embodiment of this invention. [Figure 9] Figure 9 is a schematic diagram of the configuration of an information processing device applied to the first image acquisition device in the information processing system provided by the embodiment of the present invention. [Figure 10] Figure 10 is a schematic diagram of the configuration of the electronic device provided in the present embodiment. [Modes for carrying out the invention]

[0060] The present application will be described in more detail below, with reference to the drawings and examples, in order to further clarify the purpose, technical proposal, and advantages of the embodiments of this application. Of course, the embodiments described are only a selection of embodiments of this application, not all embodiments. All other embodiments that a person skilled in the art could obtain based on the embodiments of this application are all within the scope of protection of this application.

[0061] In the related technology, an employee uses a handheld device to read the 2D codes of the container and the cargo placed inside it, obtaining container and cargo labels, and then linking the obtained container and cargo labels. However, in the related technology, since the above linking process is completed by a person, when there is a large quantity of cargo, there are many possibilities such as duplicate linking and cargo omissions, resulting in poor linking accuracy and low efficiency.

[0062] To solve the above technical problems, this embodiment of the present invention provides an information processing system.

[0063] The information processing system may be applied to various application scenarios where it is necessary to establish a link between a container and the object being transported by it. For example, when applied to a factory, it may record the link between cargo and a container when cargo is transported by the container; or, when applied to a baggage counter, it may establish a link between each piece of luggage and a transport vehicle when passenger luggage is transported by a transport vehicle.

[0064] The information processing system provided in this embodiment may include a first image acquisition device and a management platform.

[0065] The above-mentioned image acquisition device may be any image acquisition device capable of acquiring images, such as a smart video camera or a smart camera, and may be a 2D (two-dimensional) image acquisition device or a 3D (three-dimensional) image acquisition device. The above-mentioned management platform may be any electronic device capable of communicating with the image acquisition device, such as a mobile phone, computer, or server, and may be a single electronic device or a cluster consisting of multiple electronic devices.

[0066] Based on this, the embodiments of the present invention do not impose specific limitations on the application scenarios and implementing entities of the information processing method.

[0067] In the information processing system provided by the embodiment of the present invention, the first image acquisition device is mounted at a first preset position, and the acquisition area of ​​the first image acquisition device includes a preset storage area. The first image acquisition device is used to acquire a first image of the first container when it detects the presence of a first container in the receiving area where no cargo is placed, and to transmit the first image information of the first image to the management platform, wherein the first image information includes the first image, or includes the first container mark of the first container in the first image. The management platform is used to receive first image information transmitted from the first image acquisition device and to acquire a first container label of the first container based on the first image information. The first image acquisition device is further used to acquire a second image of the first container in which the cargo is placed, and to transmit the second image information of the second image to the management platform, wherein the second image information includes the second image, or, compared with the image of the frame immediately preceding the second image, includes the cargo markings of the new cargo in the first container in the second image. The management platform is further used to receive second image information transmitted from the first image acquisition device, to acquire a cargo label for new cargo in the first container based on the second image information, and to link the first container label with the cargo label.

[0068] As can be seen from the above, the technical solution provided in the embodiment of the present invention may include an information processing system comprising a first image acquisition device and a management platform, wherein the first image acquisition device is mounted at a first preset position, and the acquisition area of ​​the first image acquisition device includes a preset storage area.

[0069] When processing information, if the first image acquisition device detects the presence of a first container in the receiving area that does not contain any cargo, it can acquire a first image of the first container and transmit the first image information of the first image to the management platform. The first image information includes the first image, or includes the first container mark of the first container in the first image. The management platform receives the first image information transmitted from the first image acquisition device and can acquire the first container mark of the first container based on the first image information. The first image acquisition device can also acquire a second image of the first container in which cargo is contained, and transmit the second image information of the second image to the management platform. The second image information includes the second image, or, by comparing it with the image of the frame immediately preceding the second image, includes the cargo mark of the new cargo in the first container in the second image. In this way, the management platform receives the second image information transmitted from the first image acquisition device, and can acquire the cargo mark of the new cargo in the first container based on the second image information and link the first container mark with the cargo mark.

[0070] Based on this, the technology provided in the embodiment of the present invention provides that both the container label and the cargo label are obtained by recognizing images acquired by the first image acquisition device, thus offering higher recognition efficiency than a method where the labels are read and recognized by a human. In the process of placing cargo, by comparing images of adjacent frames, new cargo in the container can be identified, and the cargo label of the new cargo in the container can be recognized, thus efficiently avoiding cargo loss and improving the accuracy of label recognition. Furthermore, since linking the container label and the cargo label is achieved through cooperation between the management platform and the image acquisition device, the linking efficiency can be increased compared to a method where the labels are linked by a human.

[0071] The information processing system provided by this embodiment will be described in detail below with reference to the drawings.

[0072] Figure 1 is a schematic diagram of the configuration of an information processing system provided by an embodiment of the present invention, and as shown in Figure 1, the information processing system may include a first image acquisition device 100 and a management platform 200. The first image acquisition device 100 is mounted at a first preset position, and the acquisition area of ​​the first image acquisition device 100 includes a preset storage area. The first image acquisition device 100 is used to acquire a first image of the first container when it detects the presence of a first container in the receiving area where no cargo is placed, and to transmit the first image information of the first image to the management platform 200, wherein the first image information includes the first image, or includes the first container mark of the first container in the first image. The management platform 200 is used to receive first image information transmitted from the first image acquisition device 100 and to acquire the first container label of the first container based on the first image information. The first image acquisition device 100 is further used to acquire a second image of the first container in which the cargo is placed, and to transmit the second image information of the second image to the management platform 200, the second image information including the second image, or, compared with the image of the frame immediately preceding the second image, the cargo markings of the new cargo in the first container in the second image. The management platform 200 is further used to receive second image information transmitted from the first image acquisition device 100, to acquire cargo labels for new cargo in the first container based on the second image information, and to link the first container label with the cargo label.

[0073] The following will specifically describe the information processing system provided by the embodiment of the present invention shown in Figure 1, with reference to the Gunnar interaction process between the first image acquisition device 100 and the management platform 200 in the above-described information processing system.

[0074] Figure 2 is a schematic diagram of the gunnering interaction of an information processing system provided by the embodiment of the present invention. As shown in Figure 2, the gunnering interaction process between the first image acquisition device 100 and the management platform 200 in the information processing system includes the following steps S201 to S207.

[0075] S201, The first image acquisition device 100, if it detects the presence of a first container in the receiving area that does not contain any cargo, acquires a first image of the first container.

[0076] S202, the first image acquisition device 100 transmits the first image information of the first image to the management platform.

[0077] The first image information includes the first image, or includes the first container label of the first container in the first image.

[0078] S203, the management platform 200 receives image information transmitted from the first image acquisition device and obtains the first container label of the first container based on the first image information.

[0079] Typically, cargo transported from various locations is first placed in a designated area where pre-warehousing procedures such as inspection and disinfection are carried out. For example, each container is placed in the cargo sorting area of ​​the logistics center and inspected.

[0080] After completing pre-warehousing processing, each cargo is placed on a conveyor belt and transported to the receiving area by the conveyor belt, or each cargo is transported to the receiving area by an AGV (Automated Guided Vehicle), where it is stacked in containers. After the cargo is stacked in each container, the container and each cargo contained within it are transported to the storage area for storage. When the cargo is to be shipped out, the container and each cargo contained within it are transported to the shipping area. In this way, employees or unloading robots in the shipping area unload each cargo from the container, empty the container, and send each cargo to its respective destination.

[0081] The container may include trays, bottles, shelves, etc., but there are no specific restrictions on this. Accordingly, the goods may be arranged according to the type of container; for example, if the container is a shelf, the goods may be bottles.

[0082] The process of placing each cargo item, which is positioned on a conveyor belt or AGV, into a container may also be referred to as cargo stacking.

[0083] Furthermore, the process of placing each cargo into a container and transporting it together with the container to the storage area may also be called cargo receiving, and the process of transporting each cargo and the container in which it is placed from the storage area to the shipping area may also be called cargo shipping.

[0084] Taking the logistics industry as an example, a logistics center can receive cargo from various locations, sort and organize each received cargo, and then forward it to its respective destination. Typically, after receiving cargo from various locations, a logistics center places each received cargo in a cargo sorting area, where sorting work such as cleaning and classification can be performed on each cargo. Then, each sorted cargo is transported by conveyor to the receiving area, where it can be stacked into containers. Each container, along with the cargo contained within it, can then be transported to a storage area for storage. When it is necessary to ship cargo, the container can be transported to the shipping area. In this way, each cargo in the container is shipped out in the shipping area, transported to its respective destination, and the container can be emptied.

[0085] In the receiving area, designated locations for stacking cargo may be predetermined. In this way, each container that does not currently contain cargo is scheduled in the receiving area and then placed in an available designated location, where the cargo can be loaded.

[0086] Furthermore, in order to trace the transfer process of each cargo, a linking relationship may be established between the container and each cargo placed in that container during the cargo stacking process.

[0087] Furthermore, in order to establish a linking relationship between each cargo and container, the first image acquisition device 100 may be installed at the first preset position, and the acquisition area of ​​the first image acquisition device 100 may include at least one designated position among the above-mentioned receiving area.

[0088] The above-mentioned first preset position may be set according to actual needs, for example, the top of the storage area such as the ceiling panel, and these are reasonable and do not specifically limit the embodiments of the present invention.

[0089] Preferably, taking into consideration that the acquisition range of each first image acquisition device 100 is limited, the number and installation locations of the first image acquisition devices 100 in this information processing system are determined based on information such as the size of the receiving area and the device parameters of the first image acquisition device 100, so that the acquisition range of the installed first image acquisition devices 100 can cover at least each designated location where goods are stacked within the receiving area. In other words, multiple first image acquisition devices 100 can be installed so that the acquisition range of each first image acquisition device 100 can cover some of the designated locations within the receiving area. In this way, the acquisition range of multiple image acquisition devices 100 can cover at least all of the designated locations where goods are stacked within the receiving area. Of course, one first image acquisition device 100 may be installed, and the acquisition range of that first image acquisition device 100 can cover all designated locations within the receiving area.

[0090] Furthermore, the first image acquisition device 100 may acquire images of the receiving area according to a preset acquisition interval.

[0091] Preferably, if the first image acquisition device 100 is equipped with an image recognition function, after acquiring an image of the storage area, the first image acquisition device 100 can recognize the acquired image itself to recognize objects in the acquired image, or compare images from multiple acquired frames to determine the increase or decrease in objects included in the image of each frame.

[0092] Furthermore, the preset acquisition interval may be set according to actual needs. For example, the preset acquisition interval may be smaller than the preset stacking speed. For instance, if the preset stacking speed is 3 seconds, the preset acquisition interval may be 1 second. If the preset stacking speed is 1, the preset acquisition interval may be 0.5 seconds. These are reasonable and do not impose any specific limitations on the embodiments of this application.

[0093] Preferably, when stacking cargo, each cargo is placed on top of the container, and the first image acquisition device 100 is attached to the top of a designated position, the attached first image acquisition device 100 may be a 3D image acquisition device in order to make it easier to determine the quantity of cargo placed in each container from the plan view acquired by the first image acquisition device 100. In this way, if the first image acquisition device 100 has an image recognition function, the first image acquisition device 100 or the management platform 200 can determine the quantity of cargo placed in the first container by using the depth information of the cargo in the first container in the acquired image and the size information of the cargo to be stacked in the current cargo, which has been stored in advance.

[0094] In order to stack cargo in each container, a first container that does not currently contain cargo can be scheduled to be placed in the receiving area. In other words, if a first container is in the receiving area and does not contain cargo, it is likely that cargo will soon be stacked in that first container. In order to establish a link between the first container and the cargo it contains, the container identifier for the first container may be obtained first.

[0095] Based on this, if the first image acquisition device 100 detects the presence of a first container in the receiving area that does not contain any cargo, it may acquire a first image of the first container.

[0096] Preferably, the user schedules a first container without cargo to a designated location within the storage area, then triggers a control unit for controlling the first image acquisition device 100 to send an image acquisition signal to the first image acquisition device 100, which performs image acquisition at the designated location where the first container has arrived. When the first image acquisition device 100 detects the image acquisition signal, it can acquire a first image of the first container without cargo according to a preset acquisition interval.

[0097] Preferably, the management platform 200 schedules the first container, which does not contain any cargo, to a designated location within the receiving area, and then sends an image acquisition command to the first image acquisition device 100, which acquires images of the designated location to which the first container has arrived. When the first image acquisition device 100 detects the image acquisition command, it can acquire a first image of the first container, which does not contain any cargo, according to a preset acquisition interval.

[0098] Preferably, the first image acquisition device 100 is equipped with an image recognition function and, by comparing it with the image of the previous frame, if it detects a new first container at a specified position in the currently acquired image, it acquires a first image of the new first container.

[0099] The first image acquisition device 100 may then determine the first image information of the acquired first image and transmit the first image information of the first image to the management platform 200. The first image information may include the first image or include the first container label of the first container in the first image. In this way, the management platform 200 may receive the first image information and, based on the received first image information, acquire the first container label of the first container in the first image.

[0100] Preferably, if the first image information includes a first image, the first image acquisition device 100 may acquire a first image of the first container and then transmit the first image to the management platform 200. The management platform 200 may receive the first image, perform label recognition on the first image, and acquire the first container label of the first container in the first image.

[0101] Preferably, if the first image acquisition device has an image recognition function, the first image information may include a first container label of the first container in the first image. After acquiring a first image of the first container, the first image acquisition device 100 may perform label recognition on the first image to acquire the first container label of the first container in the first image and transmit the recognized first container label of the first container to the management platform 200. The management platform 200 may receive the first container label of the first container.

[0102] The above-mentioned first container mark is for uniquely identifying the first container and may be at least one piece of information such as a container symbol, container number, and container two-dimensional code. In other words, if at least one piece of information such as a container symbol, container number, and container two-dimensional code of the first container is recognized, the recognized information may be used as the first container mark of the first container. To more appropriately recognize the first container, container information such as the shape and color of the first container may be recognized, and the container information and first container mark of the first container may be obtained, making it easier for the management platform 200 to recognize the first container using the container information and first container mark of the first container.

[0103] The above container symbols may be set according to actual needs and may be, for example, #, @, &, etc., and these are reasonable and do not specifically limit the embodiments of this application. In addition, each container shall have a different symbol for unique identification of that container.

[0104] Accordingly, each container is equipped with a different container number and a container 2D code to uniquely identify that container.

[0105] Preferably, an initial model is pre-trained based on each sample container and its container markings, such as the container symbol, container number, and container QR code. If the initial model satisfies the preset conditions, training is stopped, a first container marking recognition model is obtained, and a recognition module including the first container marking recognition model can be installed in the first image acquisition device 100 and / or management platform 200. In this way, when the first image acquisition device 100 and / or management platform 200 acquires a first image of a first container in which no cargo is placed, the first image is input into the first container marking recognition model, and at least one type of information, such as the container symbol, container number, and container QR code of the first container recognized by the first container marking recognition model, can be obtained and used as the first container marking of the first container.

[0106] Preferably, the information processing system includes a palletizing robot, and after the management platform 200 obtains a first container label for the first container, it issues a cargo stacking command to instruct an employee or the palletizing robot to place cargo in the first container based on the cargo stacking command. The palletizing robot may be any type of robot equipped with a manipulator, and the palletizing robot is located at a stacking position corresponding to a designated position where the container is placed, and stacks the cargo at the stacking position.

[0107] For example, as shown in Figure 3, a camera 310 may be installed at a first preset position within the receiving area. In this way, when the camera 310 detects that a container 320 without cargo placed in it has entered its acquisition range, it can acquire a first image of the container 320. Furthermore, it recognizes the acquired first image, acquires a first container identifier for the container 320, and transmits the first container identifier to the management platform. To stack each cargo 330, each cargo 330 may be transported by a transport line 350 or an AGV. In this way, each cargo 330 is sequentially transported to an employee 340. The employee 340 can then take each cargo 330 from the transport line 350 and place it in a container 320.

[0108] To verify the accuracy and usability of the acquired first container labels, and to further improve the accuracy of the established cargo-container linkage, the management platform 200 may verify the acquired first container labels itself.

[0109] Based on this, preferably in one specific embodiment, The management platform 200 is further used to perform the following steps 11-12.

[0110] Step 11: If the first container label for the first container is obtained, the verification results for the first container label are finalized.

[0111] Step 12: If the verification result indicates that the verification of the first container label was successful, a stacking command is output to instruct the cargo to be placed in the first container.

[0112] In this specific embodiment, the management platform 200 can verify the first container label when it obtains the first container label of the first container. This allows it to obtain the verification result for the first container label.

[0113] Preferably, a first container identification list may be pre-built on the management platform 200 to facilitate the management of each container within the receiving area. In this way, when the management platform 200 obtains the first container identification, it searches for the first container identification in the first container identification list and uses the search result as the verification result of the first container identification. If the first container identification is found, the verification of the first container identification is successful, and if the first container identification is not found, the verification of the first container identification is unsuccessful.

[0114] Preferably, each container is scheduled by the management platform 200, and when the management platform 200 schedules each container to each receiving area, it may establish a relationship between the area marker of the receiving area, the location marker of a designated position within the scheduled receiving area, the equipment marker of the first image acquisition device 100 corresponding to the designated position, and the container marker of each container scheduled to the receiving area. As a result, when the first container marker of the first container transmitted from the first image acquisition device 100 is acquired, the relationship corresponding to the first image acquisition device 100 can be determined, and the first container marker can be compared with the container marker associated with the first image acquisition device 100 in the relationship, and the comparison result can be taken as the verification result of the first container marker. If the container marker associated with the first image acquisition device 100 includes a container marker that matches the first container marker, the verification of the first container marker is successful, and if the container marker associated with the first image acquisition device 100 does not include a container marker that matches the first container marker, the verification of the first container marker is unsuccessful.

[0115] Preferably, after acquiring the first container label, the management platform 200 may send an inspection command to the inspection target instructing it to inspect the first container label of the first container that has the equipment label of the first image acquisition device 100. The inspection target may be an employee or a robot for performing label inspection, but there are no specific restrictions here. In this way, the inspection target can acquire the first container label of the first container that does not contain cargo within the acquisition range of the first image acquisition device 100 using a PDA (Personal Digital Assistant, mobile information terminal) based on the equipment label of the first image acquisition device 100, and upload the acquired first container label to the management platform 200. As a result, the management platform 200 compares the acquired first container label with the standard first container label uploaded by the subject of inspection, and may use the comparison result as the verification result of the first container label. If the first container label acquired by the management platform 200 matches the standard first container label uploaded by the subject of inspection, the verification of the first container label is successful. If the first container label acquired by the management platform 200 does not match the standard first container label uploaded by the subject of inspection, the verification of the first container label is unsuccessful.

[0116] Preferably, the first image acquisition device 100 is equipped with an image recognition function, and if the first image information includes a first container label of the first container in the first image, the first image acquisition device 100 may transmit the first image to the management platform 200, the management platform 200 may receive the first image, recognize the first container label of the first container in the first image, verify the first container label transmitted from the received first image acquisition device 100 using the recognized first container label, and obtain the verification result of the first container label, if the first container label transmitted from the received first image acquisition device 100 matches the recognized first container label, the verification of the first container label is successful, and if the first container label transmitted from the received first image acquisition device 100 does not match the recognized first container label, the verification of the first container label is unsuccessful.

[0117] If the verification result indicates that the verification of the first container label was successful, the management platform 200 outputs a cargo stacking command to instruct an employee or palletizing robot to receive the stacking command and place the cargo in the first container.

[0118] Outputting the above stacking command may involve sending the above stacking command to a preset address, displaying the above stacking command on the display screen of the management platform 200, or emitting a preset prompt sound. These are reasonable and no specific limitations are imposed here.

[0119] Preferably, if the verification result indicates that the verification of the first container label is unsuccessful, the management platform 200 outputs an instruction message indicating that there is an error in the first container label of the first container, so that an employee can receive the instruction message and inspect the first container.

[0120] S204: The first image acquisition device 100 acquires a second image of the first container in which the cargo is placed.

[0121] S205: The first image acquisition device 100 transmits the second image information of the second image to the management platform.

[0122] The second image information includes the second image, or, compared to the image of the frame immediately preceding the second image, includes the cargo markings of the new cargo in the first container in the second image.

[0123] S206: The management platform 200 receives the second image information transmitted from the first image acquisition device and, based on the second image information, obtains the cargo label of the new cargo in the first container.

[0124] S207: Management platform 200 links the first container label and the cargo label.

[0125] After scheduling the first container to the above-mentioned receiving area, each cargo can be sequentially placed in the first container. During the process of placing the cargo, the first image acquisition device 100 may continue to acquire a second image of the first container in which the cargo is placed. Furthermore, when the first image acquisition device 100 acquires a second image of the first container in which the cargo is placed, it may confirm the second image information of the second image and transmit the second image information of the second image to the management platform 200. In this way, the management platform 200 can receive the second image information of the second image and compare it with the image of the frame immediately preceding the second image to confirm the cargo markings of the new cargo in the first container in the second image.

[0126] The second image information includes the second image, or, compared to the image of the frame immediately preceding the second image, includes the cargo markings of the new cargo in the first container in the second image.

[0127] Preferably, if the second image information includes the second image, the first image acquisition device 100 may transmit the acquired second image to the management platform 200. The management platform 200 receives the second image, compares the image content of the second image with the image content of the image in the frame immediately preceding the second image, and can identify the new cargo in the first container in the second image and recognize the cargo markings of the new cargo in the first container in the second image.

[0128] Preferably, if the first image acquisition device 100 is equipped with an image recognition function, the second image information may include cargo markings for new cargo in the first container in the second image, compared with the image of the frame immediately preceding the second image. As the amount of cargo in the first container gradually increases, the amount of cargo included in the images acquired by the first image acquisition device 100 also increases. Therefore, the first image acquisition device 100 can determine the cargo placed in the container within the time range between the acquisition times of the two images by comparing the differences in image content between an image acquired earlier and an image acquired later. That is, each time the first image acquisition device 100 acquires a second image of the first container in which cargo is placed, it can determine the new cargo in the first container within the time range between the acquisition times of the two images by comparing the image content of the second image with the image of the frame immediately preceding the second image. Each time new cargo is determined, the image containing that new cargo is the first image of that new cargo acquired by the first image acquisition device 100. Therefore, mark recognition may be performed on the second image of the first container in which the new cargo has been identified. In this way, the recognized cargo mark of the new cargo is the cargo mark of the new cargo that the first image acquisition device 100 has recognized for the first time. Since the first image acquisition device 100 has recognized the cargo mark of the new cargo for the first time, the first image acquisition device 100 has not yet transmitted the cargo mark of the new cargo to the management platform 200, and the management platform 200 has not yet established a linking relationship between the new cargo and the first container. Thus, the first image acquisition device 100 may transmit the cargo mark of the new cargo to the management platform 200 in order to establish a linking relationship between the first container and the new cargo.

[0129] The cargo can be uniquely identified by the above-mentioned cargo markings, and such cargo markings may consist of at least one piece of information from among the cargo symbol, cargo number, and cargo two-dimensional code information. In other words, if at least one piece of information from among the cargo symbol, cargo number, and cargo two-dimensional code information is recognized, the recognized information may be used as the cargo markings for that cargo. Furthermore, in order to more appropriately identify the cargo, the management platform 200 may recognize container information such as the shape and color of the cargo and obtain the cargo information and cargo markings so that the cargo can be easily identified by the cargo information and cargo markings.

[0130] Based on this, the first image acquisition device 100 can continue to acquire images of the first container, and furthermore, based on the images acquired by the first image acquisition device 100, it can determine the new cargo placed in the first container at each acquisition time. As a result, as each cargo is placed in the first container one by one, the first image acquisition device 100 can acquire multiple second images of the first container in which the cargo is placed. In this way, by comparing the image content of the second image with the image of the frame immediately preceding the second image, the new cargo in the first container in each second image can be determined, and furthermore, mark recognition can be performed on the new cargo to determine the cargo mark of the new cargo. After the management platform 200 acquires the cargo marks of the new cargo in the first container, it may link each acquired cargo mark of the new cargo to the first container mark. In this way, if no new cargo is placed in the first container, the management platform 200 links both the first container and the cargo marks of each cargo placed in the first container.

[0131] For example, as shown in Figures 4(a) to 4(c), Figure 4(a) is a first image of a container 410 without cargo, acquired by a first image acquisition device. The first image acquisition device may transmit the first image to the management platform. In this way, the management platform can receive the first image, perform label recognition on the first image, and obtain the first container label A of the container 410. Alternatively, if the first image acquisition device has an image recognition function, the first image acquisition device may perform label recognition on the first image, obtain the first container label A of the container 410, and transmit the first container label A to the management platform. In this way, the management platform can obtain the first container label A.

[0132] Figure 4(b) is a second image of a container 410 containing one cargo 420, acquired by the first image acquisition device. By comparing the second image with the second image of the container 410 without cargo in the previous frame, the first image acquisition device transmits the second image to the management platform. The management platform then compares the second image with the image from the frame prior to the second image to identify the new cargo 420 in the second image, recognize the cargo markings of the new cargo, and acquire the cargo markings B for the new cargo 420. Alternatively, if the first image acquisition device has an image recognition function, it can recognize the new cargo 420 in the container 410 in the second image. Furthermore, the first image acquisition device may perform marking recognition on the second image, recognize the cargo markings B for the cargo 420, and transmit the cargo markings B to the management platform. In this way, after acquiring the cargo markings B, the management platform can link the cargo markings B with the first container markings A.

[0133] Figure 4(c) is a second image of container 410 containing cargo 430 and cargo 420, acquired by the first image acquisition device. The first image acquisition device may transmit the second image of container 410 containing cargo 430 and cargo 420 to the management platform. By comparing the second image with the image of container 410 containing only cargo 420 from the previous frame, the management platform can determine that the first image acquisition device has identified the new cargo 430 in container 410 in the second image and recognize the cargo mark C of the new cargo 430. Alternatively, the first image acquisition device may determine the new cargo 430 in container 410 in the second image by comparing the second image with the image of container 410 containing only cargo 420 from the previous frame. Furthermore, the first image acquisition device may perform mark recognition on the second image, recognize the cargo mark C of cargo 430, and transmit the cargo mark C to the management platform. In this way, after acquiring the cargo identification mark C, the management platform can link the cargo identification mark C with the first container identification mark A. Up to this point, the management platform has linked the first container identification mark A with cargo identification mark B, and the first container identification mark A with cargo identification mark C.

[0134] As can be seen from the above, according to the technical solution provided in the embodiment of this application, both the container label and the cargo label are obtained by recognizing images acquired by the first image acquisition device, thus having higher recognition efficiency than a method in which a person reads and recognizes them. In the process of placing cargo, new cargo in the container can be identified by comparing images of adjacent frames, and the cargo label of the new cargo in the container can be recognized, thus efficiently avoiding cargo loss and improving the accuracy of label recognition. Furthermore, since linking the container label and the cargo label is achieved through cooperation between the management platform and the image acquisition device, the linking efficiency can be improved compared to a method in which a person links them.

[0135] Preferably, in one specific embodiment, the first image acquisition device 100 is equipped with an image recognition function, Specifically, the first image acquisition device 100 is used to perform label recognition on the first image to acquire the first container label of the first container, and / or to recognize the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0136] In this specific embodiment, the first image acquisition device 100 may be equipped with an image recognition function. When the first image acquisition device 100 acquires a first image of the first container, it performs mark recognition on the first image and acquires the first container mark of the first container. And / or, when the first image acquisition device 100 acquires a second image of the first container, it recognizes the cargo mark of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image, which specifically includes the following three situations.

[0137] Situation 1: When the first image acquisition device 100 acquires a first image of the first container, it can perform mark recognition on the first image and acquire the first container mark of the first container. Furthermore, when the first image acquisition device 100 acquires a second image of the first container, it can recognize the cargo mark of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image. In this way, both the first container mark of the first container and the cargo mark of the cargo placed in the first container are recognized by the first image acquisition device, and the first image acquisition device may transmit the recognized first container mark of the first container and the cargo mark of the new cargo in the first container, which was recognized during the cargo stacking process, to the management platform 200. The management platform does not need to perform the task of recognizing the marks, and can improve its operational efficiency by simply establishing a linking relationship between the first container mark of the first container and the cargo mark of the cargo placed in the first container.

[0138] In scenario 2, when the first image acquisition device 100 acquires a first image of the first container, it can perform label recognition on the first image, acquire the first container label of the first container, and transmit the recognized first container label of the first container to the management platform 200. After transmitting the first container label of the first container to the management platform, the first image acquisition device acquires a second image of the first container and transmits the second image to the management platform 200. The management platform 200, based on the image content of the second image of each received frame and the image content of the image in the frame immediately preceding the second image, can determine the new cargo in the first container in the second image for each frame, recognize the cargo label of the new cargo, and further establish a linking relationship between the first container label of the first container and the cargo label of the cargo placed in the first container. In this way, the first image acquisition device 100 does not need to recognize the cargo label of the cargo placed in the first container, saving computing resources of the first image acquisition device, improving the data transfer efficiency of the first image acquisition device, and further improving the operational efficiency of the information management system.

[0139] In scenario 3, a cargo marking recognition model can be installed on the first image acquisition device. In this way, when the first image acquisition device 100 acquires a first image of the first container, it can transmit the first image to the management platform. The management platform receives the first image, performs marking recognition on the first image, and can acquire the first container mark of the first container. During the cargo stacking process, the first image acquisition device acquires a second image of the first container, and based on the image content of the second image of each acquired frame and the image content of the frame immediately preceding the second image, it can determine the new cargo in the first container in the second image for each frame, recognize the cargo mark of the new cargo, and transmit the recognized cargo mark of the new cargo to the management platform 200. Furthermore, the management platform 200 can establish a linking relationship between the first container mark of the first container and the cargo marks of the cargo placed in the first container. In this way, the management platform 200 can recognize the container mark of the first container itself, verify the container mark, and improve the accuracy of container recognition.

[0140] Thus, if the first image acquisition device is equipped with an image recognition function, the container markings of the first container and the cargo markings of the new cargo inside the first container may be recognized by the first image acquisition device, or they may be recognized through collaboration between the first image acquisition device and the management platform, which can improve recognition efficiency compared to a human recognition method.

[0141] Preferably, in one specific embodiment, The first image acquisition device 100 is specifically used to transmit the first image to the management platform and the second image to the management platform 200. Specifically, the management platform 200 is used to perform label recognition on the first image, obtain the first container label of the first container in the first image, and recognize the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0142] To conserve the computing resources of the first image acquisition device and ensure the data transfer efficiency of the first image acquisition device, the management platform can recognize the container label of the first container and the cargo label of the new cargo inside the first container.

[0143] In other words, the first image acquisition device 100 may, after acquiring a first image of the first container, transmit the first image to the management platform 200. In this way, the management platform 200 can receive the first image transmitted from the first image acquisition device 100, perform label recognition on the first image, and acquire the first container label of the first container in the first image.

[0144] Furthermore, during the process of stacking subsequent cargo, the image acquisition device may acquire a second image of the first container and then transmit the second image to the management platform 200. The management platform 200 receives the second image transmitted from the first image acquisition device 100 and, based on the image content of the second image and the image content of the frame immediately preceding the second image, can recognize the cargo markings of the new cargo in the first container in the second image.

[0145] Thus, the first image acquisition device only needs to acquire an image of the first container and transmit the acquired image to the management platform. The management platform receives the image transmitted from the first image acquisition device and can automatically recognize the first container label of the first container and the cargo label of the new cargo inside the first container. In this way, the computing resources of the first image acquisition device can be saved, the first image acquisition device can maintain high data transfer efficiency, and furthermore, the information processing efficiency of the information processing system can be improved.

[0146] Since there is a limit to the amount of cargo that can be placed in each container, the maximum amount of cargo that can be loaded into the container may be determined based on the container size information and the estimated cargo size information of the cargo that will be placed in the container. The cargo loading capacity of the container may then be determined based on this maximum amount and the actual production needs. In this way, when the amount of cargo placed in the container reaches the above cargo loading capacity, the loading of cargo into the container can be stopped. The container is then transported to a preset shipping area, the cargo is unloaded, and the container is emptied.

[0147] Based on this, preferably in one specific embodiment, the management platform 200 is further used to output a stop command instructing a palletizing robot or person to stop placing cargo into the first container when it detects that the number of marked cargo labels obtained has reached a preset container cargo load capacity.

[0148] In this specific embodiment, the cargo capacity of the first container may be predetermined and set as the preset cargo capacity of the first container. The preset cargo capacity can be set according to the actual needs, for example, 5 or 10 units, and these are reasonable and do not specifically limit the embodiments of this application.

[0149] Preferably, the maximum container cargo capacity of the first container may be determined based on the size information of the first container and the cargo size information of the cargo placed in the first container, and then the preset container cargo capacity of the first container may be determined based on that maximum container cargo capacity. For example, based on the size information of the first container and the cargo size information of the cargo placed in the first container, the maximum container cargo capacity of the first container may be determined to be 10. In order to improve the efficiency of container utilization, it is desirable that the quantity of cargo loaded in the first container reaches the maximum container cargo capacity, and the preset container cargo capacity of the first container may be determined to be 10. Alternatively, if the load of the transport robot is small, the preset container cargo capacity of the first container may be determined to be 6, taking into account the load of the transport robot. These are reasonable and are not limited here.

[0150] Thus, the management platform 200 may obtain a preset container cargo load capacity for the first container and, when it detects that the number of cargo labels on the cargo placed in the first container reaches the above container cargo load capacity, output a stop command to instruct the system to stop placing cargo into the first container.

[0151] The information processing system includes a palletizing robot for performing the task of stacking cargo, and when the palletizing robot is stacking cargo in a first container, the management platform 200 may issue a stop command to the palletizing robot to stop placing cargo into the first container. The palletizing robot can receive the stop command and control itself to stop placing cargo into the first container. As described above, the palletizing robot is a robot equipped with a manipulator.

[0152] Alternatively, when cargo is being loaded by a person, the management platform 200 can issue a stop order to the employee loading the cargo, instructing them to stop placing cargo into the first container, thereby allowing the employee to receive the stop order and stop placing cargo into the first container.

[0153] As can be seen from the above, when the management platform detects that the number of marked cargo labels obtained has reached a preset container cargo load capacity, it can output a stop command instructing the palletizing robot or a person to stop placing cargo into the first container. In other words, by determining whether the quantity of cargo to be loaded into the first container has reached the container cargo load capacity of the first container based on the number of marked cargo labels obtained, the management platform can avoid the quantity of cargo to be loaded into the first container exceeding the container cargo load capacity of the first container.

[0154] The management platform 200 receives cargo labels for each cargo placed in the first container and, in order to ensure that cargo labels do not fall off, or to avoid the accuracy of the linked information being affected by the recognition of duplicate cargo labels, it can compare the quantity of cargo labels transmitted from the first image acquisition device 100 to determine whether the quantity of cargo labels recognized by the first image acquisition device 100 matches the actual quantity of cargo placed in the first container.

[0155] Based on this, preferably in one specific embodiment, The management platform 200 is further used to: confirm the cargo matching result when it detects that the number of cargo labels obtained reaches the container cargo load; output a first instruction message to instruct the recording of cargo labels when the cargo matching result indicates that the quantity of cargo placed in the first container is greater than the container cargo load; receive the cargo labels transmitted by the target in response to the first instruction message; compare the cargo labels transmitted from the received target with the recorded cargo labels to obtain the additional cargo labels to be linked; and link the first container labels with the additional cargo labels. The cargo labels transmitted from the target are obtained when the target reads the cargo labels using a preset reading device.

[0156] In this specific embodiment, if the management platform 200 detects that the number of obtained cargo labels reaches the cargo load capacity of the first container, the management platform may confirm the cargo matching result. The cargo labels acquired by the management platform 200 may be cargo labels recognized and uploaded by the first image acquisition device 100, which has an image recognition function, or they may be cargo labels recognized by the management platform 200 itself based on the second image uploaded by the first image acquisition device 100 that it received. Furthermore, the cargo labels acquired by the management platform 200 are cargo labels obtained after acquiring the first container, and are not all cargo labels previously received by the management platform.

[0157] Preferably, the first image acquisition device 100 may be a 3D device equipped with an image recognition function. When the management platform 200 detects that the number of marked cargo labels obtained has reached the container cargo load capacity, it may send a cargo matching command to the first image acquisition device 100. In this way, the first image acquisition device 100 receives the cargo matching command, acquires a third image of the first container, determines the quantity of cargo placed in the first container based on the depth information of the cargo placed in the first container in the third image and the size information of the cargo to be stacked in the current cargo which has been stored in advance, then determines the cargo matching result based on the quantity of cargo placed in the first container and the number of marked cargo labels it has sent to the management platform 200, and can send the cargo matching result to the management platform 200. As a result, the management platform 200 can receive the cargo matching result sent from the first image acquisition device 100.

[0158] Preferably, when the management platform 200 detects that the number of marked cargo labels obtained reaches the container cargo load capacity, it sends an image acquisition command to the first image acquisition device 100. After receiving the third image of the first container acquired by the first image acquisition device 100 based on the image acquisition command, the management platform 200 determines the depth information of the cargo placed in the first container in the third image and the size information of the cargo to be stacked, which has been stored in advance, to determine the quantity of cargo placed in the first container. Furthermore, it can determine the cargo matching result based on the quantity of cargo placed in the first container and the number of marked cargo labels obtained.

[0159] If the cargo matching result indicates that the cargo quantity is greater than the container cargo load capacity, the number of cargo labels obtained by the management platform 200 is the container cargo load capacity, and the actual cargo quantity placed in the first container is greater than the container cargo load capacity. In other words, there was an oversight when recognizing the cargo labels, and the number of recognized cargo labels is smaller than the actual cargo quantity placed in the first container. In this case, the management platform 200 outputs a first instruction message to instruct the target to record the cargo labels, the target receives the first instruction message, reads the cargo labels of the cargo placed in the first container using a preset reading device, and obtains the cargo labels of all cargo placed in the first container. The target then transmits the cargo labels of all cargo placed in the first container to the management platform 200, which may be the cargo labels transmitted by the target in response to the instruction message.

[0160] The target may be a person, or it may be a robot that performs the task of reading signs, such as a reading robot equipped with a preset reading device, or a manipulator that can utilize a preset reading device.

[0161] Outputting a first instruction message to instruct the recording of the cargo markings described above may involve sending the instruction message to a preset email address, displaying the instruction message on the display screen of the management platform 200, or emitting a preset notification sound. These are reasonable and are not limited to the embodiments of this invention.

[0162] In other words, if the cargo matching result indicates that the cargo quantity is greater than the cargo label quantity, it can be determined that there was an oversight in recognizing the cargo labels. As a result, the management platform 200 outputs a first instruction message to instruct the target that there was an oversight in recognition and that the cargo labels for all cargo placed in the first container need to be re-entered. In this way, after the target receives the instruction message, it can read the cargo labels using a preset reading device, obtain the cargo labels for all cargo, and transmit the labels for all cargo to the management platform 200.

[0163] Furthermore, the management platform 200 may receive the cargo identification mark transmitted by the target object in response to the first instruction message, and obtain additional cargo identification marks to be linked by comparing the cargo identification mark transmitted from the received target object with the cargo identification marks it has recorded. The management platform 200 may then link the first container identification mark with the additional cargo identification marks. Up to this point, the management platform 200 has linked the first container identification mark with the cargo identification marks of all cargo placed in the first container, thus avoiding the oversight of cargo identification marks.

[0164] Preferably, in one specific embodiment, The management platform 200 is further used to output a second instruction message instructing to check the cargo labels if the cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo load capacity; to receive the cargo labels transmitted by the target in response to the second instruction message; to compare the cargo labels transmitted from the received target with the recorded cargo labels to obtain any extra cargo labels that should be unlinked; and to unlink the first container labels from the extra cargo labels.

[0165] In this specific embodiment, if the cargo matching result indicates that the cargo quantity is less than the container cargo load capacity, the number of cargo labels obtained by the management platform 200 is greater than the container cargo load capacity, but the actual cargo quantity placed in the first container is less than the container cargo load capacity. In other words, the number of cargo labels obtained by the management platform 200 is greater than the actual cargo quantity placed in the first container.

[0166] In this case, the management platform 200 outputs a second instruction message to instruct the target to check the cargo labels. The target receives the second instruction message, reads the cargo labels of the cargo placed in the first container using a preset reading device, and obtains the cargo labels of all the cargo placed in the first container. The target then transmits the cargo labels of all the cargo placed in the first container to the management platform 200, which may be the cargo labels transmitted by the target in response to the second instruction message.

[0167] In other words, if the cargo matching result indicates that the cargo quantity is smaller than the cargo label quantity, it can be determined that there are extra cargo labels in the recognized cargo labels. As a result, the management platform 200 outputs a second instruction message to indicate that the target has extra label recognition and needs to re-enter the cargo labels for all cargo placed in the first container. Thus, after the target receives the second instruction message, it may read the cargo labels using a preset reading device, obtain the cargo labels for all cargo, and transmit the labels for all cargo to the management platform 200.

[0168] Furthermore, the management platform 200 may receive the cargo identification mark transmitted by the target object in response to the second instruction message, and by comparing the cargo identification mark transmitted from the received target object with the cargo identification mark it has recorded, it may obtain any extra cargo identification marks that should be unlinked. The management platform 200 may then unlink the first container identification mark from the extra cargo identification marks. Up to this point, the management platform 200 has linked the first container identification mark to the cargo identification marks of all cargo placed in the first container, thus avoiding a situation in which the first container identification mark is linked to extra cargo identification marks due to misrecognition of cargo identification marks.

[0169] Preferably, in one specific embodiment, the first image acquisition device 100 is equipped with an image recognition function, Specifically, the management platform 200 is used to send a cargo matching command to the first image acquisition device 100 when it detects that the number of cargo labels obtained has reached the container cargo load capacity. The first image acquisition device 100 is further used to receive a cargo matching command, acquire a third image of the first container, perform object recognition on the third image, acquire the quantity of cargo placed in the first container, determine the cargo matching result based on the quantity of cargo placed in the first container and the number of cargo labels to be transmitted to the management platform, and transmit the cargo matching result to the management platform. The management platform 200 is specifically used to receive cargo matching results transmitted from the first image acquisition device.

[0170] In this specific embodiment, the first image acquisition device is equipped with an image recognition function.

[0171] If the management platform 200 detects that the number of obtained cargo labels has reached the container cargo load capacity, it may send a cargo matching command to the first image acquisition device 100.

[0172] The first image acquisition device 100 may receive a cargo matching command transmitted from the management platform 200 and acquire a third image of the first container. Then, it performs object recognition on the third image and obtains the quantity of cargo placed in the first container. Recognizing objects on the third image means that recognition is performed on each cargo placed in the first container in the third image to determine the quantity of cargo placed in the first container.

[0173] Next, the first image acquisition device 100 may determine the cargo matching result based on the cargo quantity of the cargo placed in the first container and the number of cargo labels to be transmitted to the management platform, and transmit the cargo matching result to the management platform 200. The management platform 200 may receive the cargo matching result transmitted from the first image acquisition device and determine the subsequent execution policy based on the acquired cargo matching result.

[0174] Preferably, in one specific embodiment, Specifically, the management platform 200 is used to transmit an image acquisition command to the first image acquisition device when it detects that the number of acquired cargo labels has reached the container cargo load capacity. The first image acquisition device 100 is further used to receive an image acquisition command, acquire a third image of the first container, and transmit the third image to the management platform. Specifically, the management platform 200 is used to receive a third image transmitted from a first image acquisition device, to perform object recognition on the third image and to obtain the quantity of goods placed in the first container, and to determine the cargo matching result based on the quantity of goods placed in the first container and the number of cargo labels obtained.

[0175] In this specific embodiment, the management platform 200 can send an image acquisition command to the first image acquisition device 100 when it detects that the number of acquired cargo labels has reached the container cargo load. The first image acquisition device 100 can receive the image acquisition command sent from the management platform 200, acquire a third image of the first container, and transmit the third image to the management platform.

[0176] The management platform 200 may then perform object recognition on the third image and obtain the quantity of goods placed in the first container. Next, the management platform 200 determines the cargo matching result based on the quantity of goods placed in the first container and the number of cargo labels obtained. The cargo labels obtained by the management platform 200 are the cargo labels for each item placed in the first container, obtained after obtaining the first container label for the first container, and represent all past cargo labels obtained by the management platform 200.

[0177] In this way, the management platform can determine the cargo matching result itself in accordance with the third image acquired by the first image acquisition device 100, and determine the subsequent execution policy based on the cargo matching result.

[0178] Furthermore, once the management platform 200 confirms that the first container label has been linked to the cargo labels of all the cargo within the first container, it can schedule the first container to a preset storage area.

[0179] Preferably, in one specific embodiment, the information processing system provided by the embodiment of the present application may further include a transport robot. The management platform 200 is also used to instruct the transport robot to transport the first container to a preset storage area if the cargo matching result indicates that the cargo quantity and the container cargo load are the same.

[0180] In this specific embodiment, the information processing system may further include a transport robot for transporting containers in the receiving area to a preset storage area. The transport robot may be a robot with mobility capabilities, and may or may not be equipped with a manipulator. There are no specific limitations here.

[0181] If the cargo matching result indicates that the cargo quantity and the container cargo load are the same, then there are no oversights in recognizing the cargo labels, and the quantity of the recognized cargo labels is equal to the cargo quantity of the cargo actually placed in the first container. As a result, the management platform 200 obtains the cargo labels for all the cargo placed in the first container. The management platform 200 links the first container labels with the cargo labels of all the cargo in the first container, and the cargo quantity of the cargo loaded in the first container has also reached the preset container cargo load. Based on this, the management platform 200 instructs the transport robot to transport the first container to a preset storage area and store the first container with each cargo placed in it in the storage area.

[0182] Preferably, in one specific embodiment, the information processing system provided by the embodiment of the present application may further include a transport robot. The management platform 200 is further used to instruct the transport robot to transport the first container to a preset outbound area after linking the first container label with the additional cargo label, and / or to instruct the transport robot to transport the first container to a preset outbound area after unlinking the first container label with the extra cargo label.

[0183] In this specific embodiment, the management platform 200 linked the first container label with the cargo labels of all cargo within the first container after linking the first container label with the additional cargo labels and / or after unlinking the first container label with the extra cargo labels. The management platform 200 then instructs the transport robot to transport the first container to a preset storage area and to store the first container with each cargo in place within the storage area.

[0184] Preferably, the management platform 200 detects that the number of acquired labels has not reached the container cargo load capacity, and if no new cargo labels have been acquired even after the waiting time has reached a preset time interval, the management platform 200 may instruct the transport robot to transport the first container to the outbound area. The preset time interval can be set according to actual needs and may be, for example, 10 seconds, 20 seconds, etc., and these are reasonable and do not specifically limit the embodiments of this application. By setting a preset time interval in this way, it is possible to avoid the first container remaining in place for a long time waiting for cargo to be loaded when there is no cargo to be loaded into the inbound area, which would increase the cargo transfer time and reduce overall operational efficiency.

[0185] Typically, for a given type of cargo, the rate at which cargo is stacked is relatively constant for each item of that type; that is, the rate at which cargo of that type is placed in a container is relatively constant. Based on this, the cargo loading rate for each type of cargo can be estimated, and furthermore, the time required to load the container cargo capacity of that type of cargo into the first container can be determined.

[0186] Preferably, in one specific embodiment, the management platform 200 may perform the following steps 21 to 22.

[0187] Step 21: Based on the container cargo load and the preset cargo loading speed, determine the theoretical time when the last cargo was loaded. Step 22: If it is detected that the current time is earlier than the theoretical time and the time interval from the theoretical time is within a preset time, the transport robot is instructed to move to the receiving area. The preset time is determined based on the transport robot's movement speed.

[0188] In this specific embodiment, if the transport robot for transporting containers and the palletizing robot for stacking cargo are not the same robot in this information processing system, the management platform 200 can determine the theoretical time when the last cargo was loaded based on the container cargo load and a preset cargo loading speed, and determine the preset time required for the transport robot to move from its current location to the receiving area based on the transport robot's movement speed.

[0189] Preferably, when the management platform 200 receives a preset quantity of cargo labels, it may determine the theoretical time the last cargo was loaded based on the container cargo load and the preset cargo loading speed. The preset quantity may be set according to actual needs, for example, one, half the container cargo load, etc., and these are reasonable and do not specifically limit the embodiments of the present invention.

[0190] Furthermore, if the management platform 200 detects that the current time is earlier than the theoretical time and that the time interval from the theoretical time is a preset time, it can instruct the transport robot to move to the receiving area. In this way, when the transport robot moves to the receiving area, the quantity of goods placed in the first container is close to or has reached the container's cargo load capacity. In this way, by instructing the transport robot to move in advance and reducing the waiting time for the transport robot to move, overall operational efficiency can be improved.

[0191] When shipping cargo, each container to be shipped from the storage area can be transported to a preset shipping area, the cargo in each container can be unloaded in the shipping area, and each container can be emptied. After each container is emptied, the link between the container label of each container and the cargo label associated with it can be released.

[0192] Based on this, preferably in one specific embodiment, the information processing system provided by the embodiment of the present application further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The second image acquisition device is used to acquire a fourth image of the second container when it detects the presence of a second container without cargo in the shipping area, and to transmit the third image information of the fourth image to the management platform 200, wherein the third image information includes the fourth image, or includes the second container mark of the second container in the fourth image. The management platform 200 is further used to receive third image information transmitted from the second image acquisition device, to acquire the second container label of the second container based on the third image information, and to unlink the second container label from the cargo label associated with the second container label.

[0193] In this specific embodiment, by installing a second image acquisition device at a second preset position to release the association between each cargo and container, the acquisition area of ​​the second image acquisition device can include the outbound area. When each container is transported to the outbound area, the second image acquisition device installed at the second preset position for acquiring images of the outbound area can acquire an image of the container.

[0194] The above-mentioned second preset position may be set according to actual needs, for example, the top of the exit area such as a ceiling panel, and these are reasonable and do not specifically limit the embodiments of the present invention.

[0195] Preferably, taking into consideration that the acquisition range of each second image acquisition device is limited, the number and location of second image acquisition devices to be installed in this information processing system can be determined based on information such as the size of the shipping area and the device parameters of the second image acquisition devices, so that the acquisition range of the installed second image acquisition devices covers at least the shipping area. In other words, multiple second image acquisition devices may be installed, and the acquisition range of each second image acquisition device may cover the shipping area. Of course, only one second image acquisition device may be installed, and the acquisition range of that second image acquisition device may cover all designated locations within the receiving area.

[0196] If the second image acquisition device detects the presence of a second container in the shipping area that does not contain any cargo, it may acquire a fourth image of the second container, confirm the third image information of the fourth image, and transmit the third image information to the management platform 200.

[0197] Preferably, when all the cargo loaded in the second container has been removed, the unloading target triggers a control unit for controlling the second image acquisition device, which transmits an image acquisition signal to the second image acquisition device. When the second image acquisition device detects the image acquisition signal, it can acquire a fourth image of the second container, which is now empty of cargo.

[0198] In this way, the management platform can receive the third image information of the fourth image and obtain the second container label of the second container based on the third image information. The management platform 200 can then determine each cargo label associated with the second container label and unlink the second container label from the cargo labels associated with it.

[0199] Preferably, after emptying the cargo from the second container, the management platform 200 may unlink the second container label from the cargo label. Furthermore, it may instruct the transport robot to transport the second container to the receiving area, making it easier to load other cargo into the second container.

[0200] Preferably, in one specific embodiment, the second image acquisition device is equipped with an image recognition function, The second image acquisition device 100 is further used to perform label recognition on the fourth image and acquire the label of the second container.

[0201] In this specific embodiment, the second image acquisition device is equipped with an image recognition function and, when it detects the presence of a second container in the shipping area where no cargo is placed, it acquires a fourth image of the second container, performs label recognition on the fourth image, acquires the second container label of the second container, and transmits the second container label to the management platform 200.

[0202] In this way, the management platform 200 can receive the second container label of the second container and identify each cargo label associated with the second container label. The management platform 200 can then unlink the second container label from the cargo labels associated with the second container label.

[0203] In other words, if the second image acquisition device acquires a fourth image in which no cargo is placed in the second container, it may recognize the second container and transmit the second container identifier to the management platform 200. In this way, when the management platform 200 acquires the second container identifier again, it unlinks the second container identifier from each cargo identifier associated with it, releases the second container, and reschedules the second container to the receiving area to facilitate cargo loading.

[0204] Preferably, in one specific embodiment, The second image acquisition device 100 is specifically used to transmit the fourth image to the management platform. The management platform 200 is further used to perform label recognition on the fourth image and to obtain the second container label of the second container.

[0205] In this specific embodiment, the third image information includes the fourth image. After acquiring the fourth image, the second image acquisition device 100 can transmit the fourth image to the management platform. The management platform 200 can perform label recognition on the fourth image and acquire the second container label of the second container in the fourth image.

[0206] Next, the management platform 200 can identify each cargo label associated with the second container label and unlink the second container label from the cargo labels associated with it.

[0207] To facilitate understanding of the information processing method provided by the embodiment of this application, a specific practical example shown in Figure 5 may be used for explanation.

[0208] As shown in Figure 5, the management platform located in the server room in the figure is the management platform in the information processing system provided by the present application, the warehouse in the figure is the receiving area of ​​the present application, the smart camera in the figure is the first image acquisition device in the information processing system provided by the present application, the smart camera is equipped with an image recognition function, the AGV tray in the figure is the first container for stacking cargo in the present application, and the PDA in the figure is, i.e., the preset reading device in the present application.

[0209] When receiving cargo, the AGV tray may be instructed in advance to move into the acquisition range of a smart camera in the warehouse. Furthermore, the smart camera may acquire a first image of an AGV tray that does not contain cargo, recognize a first container label on the AGV tray, and transmit the first container label to a management platform in the server room.

[0210] As an employee places each item into an AGV tray, the smart camera can acquire an image of the AGV tray. When the smart camera acquires a second image of the AGV tray in which the items are placed, it can compare the second image with the image content of the frame immediately preceding it, recognize the cargo markings of the new items in the AGV tray, and transmit the cargo markings of the new items to the management platform.

[0211] In this way, the management platform can acquire the first tray label and the cargo label, and link the first tray label and the cargo label. When the number of cargo labels received by the management platform reaches the amount of cargo loaded in the tray, the management platform may send a cargo matching command to the smart camera. As a result, the smart camera can receive the cargo matching command, acquire a third image of the AGV tray, and by recognizing the third image, acquire the amount of cargo placed in the AGV tray. The smart camera can then compare the amount of cargo with the amount of cargo loaded in the AGV tray transmitted from the management platform, acquire the matching result, and transmit the matching result to the management platform.

[0212] In this manner, the management platform receives the matching result, and if the matching result indicates that the cargo quantity differs from the cargo load on the tray, it may output an instruction message. Upon receiving the instruction message, the employee takes action on the AGV tray using their PDA, that is, reads the cargo labels of all cargo on the AGV tray using the PDA, and transmits the cargo labels of all cargo to the management platform. The management platform then compares the cargo labels transmitted by the employee with the cargo labels transmitted from the smart camera. If it determines that additional cargo labels exist, it links the first tray label with the additional cargo labels. If it determines that extra cargo labels exist, it can release the link between the first container label and the extra cargo labels. In this way, by determining the quantitative relationship between the cargo quantity actually placed on the tray and the number of cargo labels actually obtained, it is possible to avoid cargo detachment or misrecognition of labels and improve the accuracy of the linking relationship of the first container label.

[0213] The management platform may instruct the robot to transport the first container to a preset storage area if the cargo matching result indicates that the cargo quantity in the first container is the same as the container cargo load, or after linking the first container label with the additional cargo label, or after unlinking the first container label with the extra cargo label.

[0214] Then, if it is necessary to unload cargo placed in an AGV tray, the robot may be instructed to transport the AGV tray to the unloading area, and the cargo unloading may be performed. If the second image acquisition device in the unloading area detects an AGV tray that does not contain cargo, it may acquire an image of the AGV tray, recognize the first container label of the AGV tray, and report the first container label to the management platform. When the management platform receives the first container label of the AGV tray again, it unlinks the first container label of the AGV tray from each cargo label associated with it, releases the AGV tray, and makes it easier to schedule the AGV tray again.

[0215] Based on the same inventive concept, the present invention further provides an information processing method corresponding to the information processing system provided by the above-described embodiment of the present invention, the information processing method being applied to a management platform in the information processing system, the information processing system further including a first image acquisition device, the first image acquisition device being mounted at a first preset position, and the acquisition area of ​​the first image acquisition device including a preset receiving area.

[0216] Figure 6 is a schematic flowchart of an information processing method applied to a management platform in an information processing system provided by the embodiment of the present invention. As shown in Figure 6, the information processing method may include the following steps S601 to S603.

[0217] S601 receives the first image information of the first image transmitted from the first image acquisition device, and acquires the first container label of the first container based on the first image information.

[0218] The first image is obtained when the first image acquisition device detects the presence of a first container in the receiving area where no cargo is placed, and acquires an image of the first container. The first image information includes the first image, or includes the first container mark of the first container in the first image.

[0219] S602, The system receives second image information of the second image transmitted from the first image acquisition device and obtains cargo identification for the new cargo in the first container based on the second image information. The second image is obtained by the first image acquisition device by performing image acquisition on the first container in which the cargo is placed, and the second image information includes the second image, or, by comparing it with the image of the frame immediately preceding the second image, includes cargo identification for the new cargo in the first container in the second image.

[0220] S603, The first container mark and the cargo mark are linked together.

[0221] As can be seen from the above, according to the technical solution provided in the embodiment of this application, both the container label and the cargo label are obtained by recognizing images acquired by the first image acquisition device, thus having higher recognition efficiency than a method in which a person reads and recognizes them. In the process of placing cargo, by comparing images of adjacent frames, new cargo in the container can be identified, and the cargo label of the new cargo in the container can be recognized, thereby efficiently avoiding cargo loss and improving the accuracy of label recognition. Furthermore, since the linking of the container label and the cargo label is achieved through cooperation between the management platform and the image acquisition device, the linking efficiency can be increased compared to a method in which a person links them.

[0222] Preferably, in one specific embodiment, the step of obtaining a cargo label for the new cargo in the first container based on the second image information is: This includes performing label recognition on the first image, obtaining the first container label of the first container in the first image, and recognizing the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0223] Preferably, in one specific embodiment, the information processing method further includes: If a first container label for the first container is obtained, the system includes determining the verification result for the first container label, and if the verification result indicates that the verification of the first container label was successful, outputting a stacking command to instruct the placement of goods in the first container.

[0224] Preferably, in one specific embodiment, the information processing system further includes a palletizing robot, and the information processing method further includes The system includes detecting that the number of marked cargo labels obtained reaches a preset container cargo load capacity, and then outputting a stop command instructing the palletizing robot or a person to stop placing cargo into the first container.

[0225] Preferably, in one specific embodiment, the information processing method further includes: When it is detected that the number of cargo labels obtained reaches the container cargo load, the cargo matching result is confirmed. If the cargo matching result indicates that the quantity of cargo placed in the first container is greater than the container's cargo load capacity, a first instruction message is output to instruct the recording of the cargo markings. The process involves receiving a cargo label transmitted by the target object in response to the first instruction message, comparing the received cargo label transmitted from the target object with the recorded cargo label, and obtaining a supplementary cargo label to be associated, wherein the cargo label transmitted from the target object is obtained by the target object reading the cargo label of the cargo placed in the first container using a preset reading device, and associating the first container label with the supplementary cargo label. The cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo load capacity, and includes outputting a second instruction message to instruct checking the cargo labels; receiving the cargo labels transmitted by the target object in response to the second instruction message, comparing the received cargo labels transmitted from the target object with the recorded cargo labels, obtaining extra cargo labels that should be unlinked; and unlinking the first container label from the extra cargo labels.

[0226] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the step of determining the cargo matching result is: When it is detected that the number of obtained cargo labels reaches the container cargo load, a cargo matching command is sent to the first image acquisition device, the first image acquisition device receives the cargo matching command and acquires a third image of the first container. Receiving the cargo matching result transmitted from the first image acquisition device, wherein the cargo matching result is determined based on the first image acquisition device performing object recognition on the third image, obtaining the cargo quantity of the cargo placed in the first container, and the cargo quantity of the cargo placed in the first container and the number of cargo labels transmitted to the management platform.

[0227] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the step of determining the cargo matching result is: When it is detected that the number of cargo labels obtained reaches the container cargo load, an image acquisition command is sent to the first image acquisition device, the first image acquisition device receives the image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform. Receiving the third image transmitted from the first image acquisition device, The process includes performing object recognition on the third image to obtain the quantity of goods placed in the first container, and determining the cargo matching result based on the quantity of goods placed in the first container and the number of cargo labels obtained.

[0228] Preferably, in one specific embodiment, the information processing system further includes a transport robot, and the information processing method further includes If the cargo matching result indicates that the quantity of cargo placed in the first container is the same as the cargo load capacity of the container, the transport robot is instructed to transport the first container to a preset storage area. and / or, After linking the first container label and the supplementary cargo label, instruct the transport robot to transport the first container to a preset storage area. and / or, This includes unlinking the first container label from the extra cargo label, and then instructing the transport robot to transport the first container to a preset storage area.

[0229] Preferably, in one specific embodiment, the information processing method further includes: Based on the container cargo load capacity and the preset cargo loading speed, the theoretical time when the last cargo was loaded is determined, The system includes, if it detects that the current time is earlier than the theoretical time and the time interval between the theoretical time and the current time is a preset time, instructing the transport robot to move to the storage area, wherein the preset time is determined based on the transport robot's movement speed.

[0230] Preferably, in one specific embodiment, the information processing system further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The aforementioned information processing method further, The process involves receiving the third image information transmitted from the second image acquisition device and acquiring the second container label of the second container based on the third image information, wherein the third image information is image information of a fourth image of the second container acquired when the second image acquisition device detects the presence of a second container in the shipping area where no cargo is placed, and the third image information includes the fourth image or includes the second container label of the second container in the fourth image. This includes unlinking the second container mark from the cargo mark associated with the second container mark.

[0231] Preferably, in one specific embodiment, the step of obtaining a second container label for the second container is: This is used to perform label recognition on the fourth image and obtain the second container label of the second container.

[0232] The specific embodiment of the information processing method applied to the management platform in the above-described information processing system is the same as the specific embodiment of the information processing system provided in the above-described embodiment of the present invention, and its description is omitted here.

[0233] Based on the same inventive concept, the present invention further provides an information processing method corresponding to the information processing system provided by the above-described embodiment of the present invention, the information processing method being applied to a first image acquisition device in the information processing system, the information processing system further including a management platform, the first image acquisition device being mounted at a first preset position, and the acquisition area of ​​the first image acquisition device including a preset storage area.

[0234] Figure 7 is a schematic flowchart of an information processing method applied to the first image acquisition device in the information processing system provided by the embodiment of the present invention. As shown in Figure 7, the information processing method may include the following steps S701 to S702.

[0235] S701, If ​​it is detected that there is a first container in the receiving area where no cargo is placed, a first image of the first container is acquired, and the first image information of the first image is transmitted to the management platform, where the management platform receives the first image information and acquires the first container label of the first container based on the first image information. The first image information includes the first image, or includes the first container label of the first container in the first image.

[0236] S702, acquires a second image of the first container in which the cargo is placed, and transmits the second image information of the second image to the management platform, so that the management platform receives the second image information transmitted from the first image acquisition device, acquires the cargo mark of the new cargo in the first container based on the second image information, and associates the first container mark with the cargo mark. The second image information includes the second image, or, compared with the image of the frame immediately preceding the second image, includes the cargo mark of the new cargo in the first container in the second image.

[0237] As can be seen from the above, according to the technical solution provided in the embodiment of this application, both the container label and the cargo label are obtained by recognizing images acquired by the first image acquisition device, thus having higher recognition efficiency than a method in which a person reads and recognizes them. In the process of placing cargo, by comparing images of adjacent frames, new cargo in the container can be identified, and the cargo label of the new cargo in the container can be recognized, thereby efficiently avoiding cargo loss and improving the accuracy of label recognition. Furthermore, since the linking of the container label and the cargo label is achieved through cooperation between the management platform and the image acquisition device, the linking efficiency can be increased compared to a method in which a person links them.

[0238] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the information processing method further includes This includes performing label recognition on the first image to obtain the first container label of the first container, and / or recognizing the cargo label of the new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0239] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the information processing method further includes When the management platform detects that the number of marked cargo labels obtained has reached the container cargo load, it receives the issued cargo matching command, acquires a third image of the first container, performs object recognition on the third image, obtains the quantity of cargo placed in the first container, determines the cargo matching result based on the quantity of cargo placed in the first container and the number of marked cargo labels to be transmitted to the management platform, and transmits the cargo matching result to the management platform, thereby allowing the management platform to receive the cargo matching result transmitted from the first image acquisition device.

[0240] Preferably, in a specific embodiment, the information processing method further When the management platform detects that the labeled quantity of the obtained cargo labels reaches the container cargo loading capacity, it receives the issued image acquisition instruction, acquires a third image of the first container, and transmits the third image to the management platform, so that the management platform receives the third image transmitted from the first image acquisition device. Then, object recognition is performed on the third image to obtain the quantity of the cargo arranged in the first container, and based on the quantity of the cargo arranged in the first container and the labeled quantity of the obtained cargo labels, a cargo verification result is determined.

[0241] The specific embodiment of the information processing method applied to the first image acquisition device in the above-described information processing system is the same as the specific embodiment of the information processing system provided by the above-described embodiment of the present application, and the description thereof is omitted here.

[0242] Based on the same inventive concept, corresponding to the information processing method applied to the management platform in the information processing system shown in FIG. 6 provided by the above-described embodiment of the present application, the embodiment of the present application further provides an information processing device applied to the management platform in the information processing system. The information processing system further includes a first image acquisition device, the first image acquisition device is attached to a first preset position, and the acquisition area of the first image acquisition device includes a preset warehousing area.

[0243] FIG. 8 is a schematic configuration diagram of an information processing device applied to the management platform in the information processing system provided by the embodiment of the present application. As shown in FIG. 8, the information processing device may include the following modules.

[0244] The container identification receiving module 810 is used to receive the first image information of the first image transmitted from the first image acquisition device, and based on the first image information, obtain the first container identification of the first container. The first image is obtained by the first image acquisition device performing image acquisition on the first container when it detects that there is a first container without goods placed in the warehousing area. The first image information includes the first image or includes the first container identification of the first container in the first image. The goods identification receiving module 820 is used to receive the second image information of the second image transmitted from the first image acquisition device, and based on the second image information, obtain the goods identification of the new goods in the first container. The second image is obtained by the first image acquisition device performing image acquisition on the first container where goods are placed. The second image information includes the second image or includes the goods identification of the new goods in the first container in the second image compared with the image of the frame one before the second image. The association module 830 is used to associate the first container identification with the goods identification.

[0245] As can be seen from the above, according to the technical solution provided by the embodiments of the present application, since both the above container identification and goods identification are obtained by recognizing the images acquired by the first image acquisition device, the recognition efficiency is higher than the method of manual reading and recognition. In the process of placing goods, by comparing the images of adjacent frames, the new goods in the container can be determined, and furthermore, the goods identification of the new goods in the container can be recognized, so that the dropping of goods can be efficiently avoided and the accuracy of recognizing the identification can be improved. In addition, since the association of the above container identification and goods identification is realized through the cooperation of the management platform and the image acquisition device, the association efficiency can be higher than the method of manual association.

[0246] Preferably, in a specific embodiment, the goods identification receiving module The system includes a first recognition means that performs mark recognition on the first image, obtains a first container mark of the first container in the first image, and recognizes a cargo mark of new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image.

[0247] Preferably, in one specific embodiment, the information processing device further comprises: The system includes verification result acquisition means, which, when a first container label for the first container is obtained, determines the verification result for the first container label, and if the verification result indicates that the verification of the first container label was successful, outputs a stacking command to instruct the placement of goods in the first container.

[0248] Preferably, in one specific embodiment, the information processing device further comprises: The system includes a first output means that, when it detects that the number of marked cargo labels obtained has reached a preset container cargo load capacity, outputs a stop command instructing the palletizing robot or a person to stop placing cargo into the first container.

[0249] Preferably, in one specific embodiment, the information processing device further includes result acquisition means, The result acquisition means determines the cargo matching result when it detects that the number of cargo labels obtained reaches the container cargo load capacity, outputs a first instruction message to instruct the recording of cargo labels when the cargo matching result indicates that the quantity of cargo placed in the first container is greater than the container cargo load capacity, and receives the cargo labels transmitted by the target object in response to the first instruction message, compares the received cargo labels transmitted from the target object with the recorded cargo labels, and acquires additional cargo labels to be associated, wherein the cargo labels transmitted from the target object are read by the target object using a preset reading device as described in the first The system is used to obtain the cargo labels of cargo placed in a container by reading them, to link the first container label with the additional cargo label, to output a second instruction message to instruct checking the cargo label if the cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo load capacity, to receive the cargo label transmitted by the target object in response to the second instruction message, to compare the cargo label transmitted from the received target object with the recorded cargo label, to obtain extra cargo labels that should be unlinked, and to unlink the first container label with the extra cargo label.

[0250] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the result acquisition means is specifically, When it is detected that the number of marked cargo labels obtained reaches the container cargo load, a cargo matching command is transmitted to the first image acquisition device, the first image acquisition device receives the cargo matching command and acquires a third image of the first container, and receives the cargo matching result transmitted from the first image acquisition device, the cargo matching result is determined by the first image acquisition device performing object recognition on the third image, acquiring the cargo quantity of cargo placed in the first container, and comparing the cargo quantity of cargo placed in the first container with the number of marked cargo labels transmitted to the management platform.

[0251] Preferably, in one specific embodiment, the first image acquisition device is equipped with an image recognition function, and the result acquisition means is specifically, When it is detected that the number of marked cargo labels obtained reaches the container cargo load, an image acquisition command is sent to the first image acquisition device, the first image acquisition device receives the image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform, receives the third image transmitted from the first image acquisition device, performs object recognition on the third image to obtain the cargo quantity of the cargo placed in the first container, and determines the cargo matching result based on the cargo quantity of the cargo placed in the first container and the number of marked cargo labels obtained.

[0252] Preferably, in one specific embodiment, the information processing system further includes a transport robot, and the information processing device further includes: The system includes an instruction means that, if the cargo matching result indicates that the quantity of cargo placed in the first container is the same as the container's cargo load, instructs the transport robot to transport the first container to a preset storage area, and / or, after linking the first container label with the additional cargo label, instructs the transport robot to transport the first container to a preset storage area, and / or, after unlinking the first container label with the extra cargo label, instructs the transport robot to transport the first container to a preset storage area.

[0253] Preferably, in one specific embodiment, the information processing device further comprises: The system includes a time determination means used to determine the theoretical time when the last cargo was loaded, based on the container cargo load and a preset cargo loading speed, and to instruct the transport robot to move to the storage area if it detects that the current time is earlier than the theoretical time and the time interval between the theoretical time and the theoretical time is a preset time, wherein the preset time is determined based on the movement speed of the transport robot.

[0254] Preferably, in one specific embodiment, the information processing system further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The aforementioned information processing device further The information receiving means is used to receive the third image information transmitted from the second image acquisition device, to acquire the second container label of the second container based on the third image information, and to release the link between the second container label and the cargo label associated with the second container label, wherein the third image information is image information of the fourth image of the second container acquired when the second image acquisition device detects the existence of a second container in the shipping area where no cargo is placed, and the third image information includes the fourth image or includes the second container label of the second container in the fourth image.

[0255] Preferably, in one specific embodiment, the information receiving means is specifically, This is used to perform label recognition on the fourth image and obtain the second container label of the second container.

[0256] Based on the same inventive concept, and corresponding to the information processing method applied to the first image acquisition device in the information processing system shown in Figure 7 provided in the above-described embodiment of the present invention, the information processing device further provided in the embodiment of the present invention is applied to the first image acquisition device in the information processing system, the information processing system further includes a management platform, the first image acquisition device is mounted in a first preset position, and the acquisition area of ​​the first image acquisition device includes a preset storage area.

[0257] Figure 9 is a schematic diagram of the configuration of an information processing device applied to the first image acquisition device in the information processing system provided by the embodiment of the present invention. As shown in Figure 9, the information processing device may include the following modules.

[0258] When the container identification module 910 detects the presence of a first container in the receiving area where no cargo is placed, it acquires a first image of the first container and transmits the first image information of the first image to the management platform. The management platform receives the first image information and uses it to acquire the first container identification of the first container based on the first image information. The first image information includes the first image or includes the first container identification of the first container in the first image.

[0259] The cargo identification module 920 acquires a second image of the first container in which the cargo is placed, and transmits the second image information of the second image to the management platform, which then receives the second image information and uses it to acquire the cargo identification of the new cargo in the first container and to associate the first container identification with the cargo identification. The second image information includes the second image, or, by comparing it with the image of the frame immediately preceding the second image, includes the cargo identification of the new cargo in the first container in the second image.

[0260] As can be seen from the above, according to the technical solution provided by the embodiment of the present application, both the container label and the cargo label are obtained by recognizing the images acquired by the first image acquisition device. Therefore, the recognition efficiency is higher than the method of manual reading and recognition. In the process of arranging the cargo, by comparing the images of adjacent frames, new cargo in the container can be determined, and further, the cargo label of the new cargo in the container can be recognized. Therefore, the drop of the cargo can be efficiently avoided, and the accuracy of recognizing the label can be improved. In addition, since the association of the container label and the cargo label is realized by the cooperation of the management platform and the image acquisition device, the association efficiency can be improved compared with the method of manual association.

[0261] Preferably, in a specific embodiment, the first image acquisition device has an image recognition function, and the information processing device further performs label recognition on the first image to obtain the first container label of the first container, and / or based on the image content of the second image and the image content of the image of the frame one before the second image, recognizes the cargo label of the new cargo in the first container in the second image, and includes a second recognition means.

[0262] Preferably, in a specific embodiment, the first image acquisition device has an image recognition function, and the information processing device further When the management platform detects that the label quantity of the obtained cargo label reaches the container cargo loading capacity, it receives the issued cargo verification command, acquires a third image of the first container, performs object recognition on the third image, and acquires the cargo quantity of the cargo arranged in the first container. Based on the cargo quantity of the cargo arranged in the first container and the label quantity of the cargo label transmitted to the management platform, a cargo verification result is determined, and the cargo verification result is transmitted to the management platform, so that the management platform receives the cargo verification result transmitted from the first image acquisition device, and includes a first command receiving means used for this.

[0263] Preferably, in one specific embodiment, the information processing device further comprises: The management platform includes a second command receiving means used for the following: when the number of marked cargo labels obtained reaches the container cargo load, the management platform receives an issued image acquisition command, acquires a third image of the first container, and transmits the third image to the management platform, thereby enabling the management platform to receive the third image transmitted from the first image acquisition device, perform object recognition on the third image to obtain the cargo quantity of the cargo placed in the first container, and determine the cargo matching result based on the cargo quantity of the cargo placed in the first container and the number of marked cargo labels obtained.

[0264] The present embodiment further provides an electronic device. As shown in Figure 10, Memory 1001 for storing computer programs, The system includes a processor 1002 that, when a program stored in memory 1001 is executed, implements steps of an information processing method applied to a first image acquisition device in the information processing system provided by the above embodiment of the present invention, or an information processing method applied to a management platform in the information processing system.

[0265] Furthermore, the electronic device may further include a communication bus and / or a communication interface, and the processor 1002, the communication interface, and the memory 1001 communicate with each other via the communication bus.

[0266] The communication bus mentioned above for the electronic equipment may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into an address bus, data bus, control bus, etc. For illustrative purposes, it is shown with only one thick line in the diagram, but this does not mean that there is only one communication bus or only one type of communication bus.

[0267] The communication interface is used for communication between the above-mentioned electronic device and other devices.

[0268] The memory may include random access memory (RAM) and non-volatile memory (NVM), and may be, for example, at least one magnetic disk memory. Preferably, the memory may further be at least one storage device located away from the aforementioned processor.

[0269] The above-mentioned processor may be a general-purpose processor including a Central Processing Unit (CPU), a Network Processor (NP), etc., or it may be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component.

[0270] Further embodiments of the present invention provide a computer-readable storage medium in which a computer program is stored, wherein, when executed by a processor, the computer program implements steps of an information processing method applied to a first image acquisition device in the information processing system described above, or an information processing method applied to a management platform in the information processing system.

[0271] Further embodiments of the present invention provide a computer program product including instructions, which, when run on a computer, causes the computer to execute an information processing method applied to a first image acquisition device in the information processing system according to the above embodiment, or an information processing method applied to a management platform in the information processing system.

[0272] Further embodiments of the present invention provide a computer program product that includes instructions, which, when the computer program is run on a computer, causes the computer to execute an information processing method applied to a first image acquisition device in the information processing system according to the above embodiment, or an information processing method applied to a management platform in the information processing system.

[0273] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded into a computer and executed, all or part of the embodiments implement the flows or functions described in the embodiments of this application. The computer may be a general-purpose computer, an application-specific computer, a computer network, or other rewritable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber, digital subscriber line (DSL)) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that a computer can read and write, or it may be a data storage device including a server, data center, etc., which integrates one or more available media. The usable media mentioned above may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), etc.

[0274] In this text, relational terms such as “First” and “Second” are used solely to distinguish one entity or operation from another, and do not require or suggest any actual relationship or order between these entities or operations. Furthermore, the terms “includes,” “contains,” or any other variation of “contains” mean non-exclusive. Therefore, a flow, method, product, or device containing a set of elements does not include only those elements, but also other elements not explicitly mentioned, or elements specific to such a flow, method, product, or device. Unless otherwise specified, an element limited by the statement “contains one…” does not exclude the presence of other identical elements in a flow, method, product, or device containing the described element.

[0275] Each example in this specification is described in relation to the others, and any identical or similar parts between examples should be cross-referenced. Each example is described in detail only where it differs from the others. In particular, the examples of methods, apparatus, electronic devices, computer-readable storage media, and computer program products are described briefly because they are basically similar to the examples of methods. For relevant details, please refer to the description of the system examples.

[0276] The above description is merely a preferred embodiment of the present application and is not intended to limit the scope of protection. Modifications, equivalent replacements, improvements, etc., made within the scope of the spirit and principles of the present application are included in the scope of protection.

Claims

1. An information processing system including a first image acquisition device and a management platform, The first image acquisition device is mounted at a first preset position, and the acquisition area of ​​the first image acquisition device includes a preset storage area. The first image acquisition device is used to acquire a first image of the first container when it detects the presence of a first container in the receiving area where no cargo is placed, and to transmit the first image information of the first image to the management platform, wherein the first image information includes the first image, or includes the first container mark of the first container in the first image. The management platform is used to receive first image information transmitted from the first image acquisition device and to acquire a first container label of the first container based on the first image information. The first image acquisition device is further used to acquire a second image of the first container in which the cargo is placed, and to transmit the second image information of the second image to the management platform, wherein the second image information includes the second image, or, compared with the image of the frame immediately preceding the second image, includes the cargo markings of the new cargo in the first container in the second image. The management platform is further characterized in that it receives second image information transmitted from the first image acquisition device, acquires a cargo label for new cargo in the first container based on the second image information, and is used to link the first container label with the cargo label. Information processing system.

2. The aforementioned first image acquisition device is equipped with an image recognition function, The first image acquisition device is used to perform label recognition on the first image and acquire the first container label of the first container, and / or to recognize the cargo label of new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image. The information processing system according to claim 1.

3. The first image acquisition device is used to transmit the first image to the management platform and to transmit the second image to the management platform. The management platform is characterized in that it is used to perform label recognition on the first image and obtain the first container label of the first container in the first image, and to recognize the cargo label of new cargo in the first container in the second image based on the image content of the second image and the image content of the frame immediately preceding the second image. The information processing system according to claim 1.

4. The management platform is further used to determine the verification result for the first container mark when the first container mark for the first container is obtained, and to output a stacking command to instruct the placement of goods in the first container when the verification result indicates that the verification of the first container mark has been successful. The information processing system according to claim 1.

5. The management platform is further characterized in that, when it detects that the number of marked cargo labels obtained has reached a preset container cargo load capacity, it outputs a stop command instructing the palletizing robot or a person to stop placing cargo into the first container. The information processing system according to claim 1.

6. The management platform is further used to: determine the cargo matching result when it detects that the number of cargo labels obtained reaches the container cargo load; output a first instruction message to instruct the recording of cargo labels when the cargo matching result indicates that the quantity of cargo placed in the first container is greater than the container cargo load; receive the cargo labels transmitted by the target object in response to the first instruction message; compare the cargo labels transmitted from the received target object with the recorded cargo labels to obtain additional cargo labels to be linked; and link the first container label with the additional cargo labels, wherein the cargo labels transmitted from the target object are obtained by reading the cargo labels of the cargo placed in the first container using a reading device preset by the target object. and / or, The management platform is further used to output a second instruction message to instruct a check of the cargo label when the cargo matching result indicates that the quantity of cargo placed in the first container is less than the container cargo load capacity; to receive the cargo label transmitted by the target object in response to the second instruction message; to compare the received cargo label transmitted from the target object with the recorded cargo label to obtain any extra cargo labels that should be unlinked; and to unlink the first container label from the extra cargo labels. The information processing system according to claim 5.

7. The aforementioned first image acquisition device is equipped with an image recognition function, The management platform is used to transmit a cargo matching command to the first image acquisition device when it detects that the number of cargo labels obtained has reached the container cargo load capacity. The first image acquisition device is further used to receive the cargo matching command and acquire a third image of the first container, to perform object recognition on the third image and acquire the quantity of cargo placed in the first container, to determine the cargo matching result based on the quantity of cargo placed in the first container and the number of cargo labels to be transmitted to the management platform, and to transmit the cargo matching result to the management platform. The management platform is used to receive the cargo matching results transmitted from the first image acquisition device, characterized in that The information processing system according to claim 6.

8. The management platform is used to transmit an image acquisition command to the first image acquisition device when it detects that the number of obtained cargo labels has reached the container cargo load capacity. The first image acquisition device is further used to receive the image acquisition command, acquire a third image of the first container, and transmit the third image to the management platform. The management platform is used to receive the third image transmitted from the first image acquisition device, to perform object recognition on the third image and to obtain the quantity of goods placed in the first container, and to determine the cargo matching result based on the quantity of goods placed in the first container and the number of cargo labels obtained. The information processing system according to claim 6.

9. The aforementioned information processing system further includes a transport robot, The management platform is further used to instruct the transport robot to transport the first container to a preset storage area if the cargo matching result indicates that the quantity of cargo placed in the first container is the same as the container's cargo load capacity. and / or, The management platform is further used to link the first container label and the supplementary cargo label, and then to instruct the transport robot to transport the first container to a preset storage area. and / or, The management platform is further used to instruct the transport robot to transport the first container to a preset storage area after unlinking the first container label from the extra cargo label. The information processing system according to claim 6.

10. The management platform is further used to determine the theoretical time when the last cargo was loaded, based on the container cargo load and a preset cargo loading speed, and to instruct the transport robot to move to the receiving area if it detects that the current time is earlier than the theoretical time and the time interval between the theoretical time and the theoretical time is a preset time, wherein the preset time is determined based on the movement speed of the transport robot. The information processing system according to claim 6 or 7.

11. The information processing system further includes a second image acquisition device, the second image acquisition device is mounted at a second preset position, and the acquisition area of ​​the second image acquisition device includes a preset outbound area. The second image acquisition device is used to acquire a fourth image of the second container when it detects the presence of a second container in the shipping area where no cargo is placed, and to transmit the third image information of the fourth image to the management platform, wherein the third image information includes the fourth image, or includes the second container mark of the second container in the fourth image. The management platform is further characterized in that it receives the third image information transmitted from the second image acquisition device, and is used to acquire the second container label of the second container based on the third image information, and to unlink the second container label from the cargo label associated with the second container label. The information processing system according to claim 7.

12. The second image acquisition device is equipped with an image recognition function, The second image acquisition device is further used to perform label recognition on the fourth image and to acquire the second container label of the second container, characterized in that The information processing system according to claim 11.

13. The second image acquisition device is used to transmit the fourth image to the management platform. The management platform is further used to perform label recognition on the fourth image and to obtain the second container label of the second container, characterized in that The information processing system according to claim 11.

14. An information processing method applicable to a management platform in an information processing system, The information processing system further includes a first image acquisition device, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing method is: The first image information of the first image transmitted from the first image acquisition device is received, and the first container label of the first container is obtained based on the first image information, wherein the first image acquisition device obtains an image of the first container when it detects the presence of a first container in the storage area where no cargo is placed, and the first image information includes the first image or includes the first container label of the first container in the first image. The process involves receiving second image information of a second image transmitted from the first image acquisition device, and obtaining a cargo mark for new cargo in the first container based on the second image information, wherein the second image is obtained by the first image acquisition device performing image acquisition on the first container in which the cargo is placed, and the second image information includes the second image, or, when compared with the image of the frame immediately preceding the second image, includes the cargo mark for new cargo in the first container in the second image. The method is characterized by including linking the first container mark and the cargo mark. Information processing methods.

15. An information processing method applied to a first image acquisition device in an information processing system, The information processing system further includes a management platform, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing method is When it is detected that there is a first container in the storage area where no cargo is placed, a first image of the first container is acquired, and the first image information of the first image is transmitted to the management platform, so that the management platform receives the first image information and acquires a first container label of the first container based on the first image information, wherein the first image information includes the first image, or includes the first container label of the first container in the first image. The method involves acquiring a second image of the first container in which the cargo is placed, transmitting the second image information of the second image to the management platform, the management platform receiving the second image information transmitted from the first image acquisition device, acquiring a cargo label for the new cargo in the first container based on the second image information, and linking the first container label with the cargo label, wherein the second image information includes the second image, or, when compared with the image of the frame immediately preceding the second image, includes the cargo label for the new cargo in the first container in the second image. Information processing methods.

16. An information processing device applicable to a management platform in an information processing system, The information processing system further includes a first image acquisition device, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing device is A container identification receiving module that receives first image information of a first image transmitted from the first image acquisition device and acquires a first container identification mark of a first container based on the first image information, wherein the first image is obtained when the first image acquisition device detects the presence of a first container in the storage area where no cargo is placed and performs image acquisition on the first container, and the first image information includes the first image or includes the first container identification mark of the first container in the first image, A cargo identification receiving module that receives second image information of a second image transmitted from the first image acquisition device and acquires cargo identification for new cargo in the first container based on the second image information, wherein the second image is obtained by the first image acquisition device performing image acquisition on the first container in which the cargo is placed, and the second image information includes the second image, or, by comparing it with the image of the frame immediately preceding the second image, includes the cargo identification for new cargo in the first container in the second image, The invention is characterized by including a linking module that links the first container label and the cargo label. Information processing device.

17. An information processing device applicable to a first image acquisition device in an information processing system, The information processing system further includes a management platform, the first image acquisition device is mounted at a first preset position, the acquisition area of ​​the first image acquisition device includes a preset storage area, and the information processing device is A container label recognition module that, when it detects the presence of a first container in the storage area where no cargo is placed, acquires a first image of the first container, transmits the first image information of the first image to the management platform, the management platform receives the first image information, and acquires a first container label of the first container based on the first image information, wherein the first image information includes the first image, or includes the first container label of the first container in the first image, A cargo identification recognition module that acquires a second image of the first container in which cargo is placed, transmits the second image information of the second image to the management platform, the management platform receives the second image information, acquires a cargo identification mark for new cargo in the first container based on the second image information, and links the first container identification mark with the cargo identification mark, wherein the second image information includes the second image, or, when compared with the image of the frame immediately preceding the second image, includes the cargo identification mark for new cargo in the first container in the second image. Information processing device.

18. Memory and, A processor that, when it executes a program stored in memory, realizes the information processing method described in claim 14 or 15. electronic equipment.

19. A computer-readable storage medium on which a computer program is recorded, The computer program, when executed by a processor, is characterized in that it realizes the information processing method described in claim 14 or 15. Computer-readable storage medium.

20. A computer program product that includes instructions, When the computer program product is run on a computer, it causes the computer to perform the steps of the information processing method described in claim 14 or 15. Computer program products.

Images