Information processing device, information processing method, recording medium, and article management system

Abstract

This information processing device can use a conversion rule for mutually converting first position information that is used in an article management device for managing the number of articles and the position of the articles and indicates the position of an article in a shelf, and coordinate information that is used when the result of processing a shelf image obtained by photographing a shelf is associated with a position in the shelf. The information processing device comprises: a first generation unit that uses coordinate information obtained by processing a shelf image to generate area information indicating an area in which an article is present in a shelf and article information indicating the type of the article; and a second generation unit for converting the area information into first position information by using the conversion rule, and generating difference information between a combination of article information and the first position information after the conversion and information stored in the article management device.

Description

Information processing device, information processing method, recording medium, and article management system

[0001] The present invention relates to an information processing device, an information processing method, a recording medium, and an article management system.

[0002] Patent Document 1 describes a technology related to inventory management of goods in an automated goods management system. The goods storage position information input device described in Patent Document 1 includes an imaging means for acquiring image information related to goods or goods storage locations, a display means for displaying information including image information and / or text information, a first storage means for storing storage information related to locations where storage objects are to be stored, a means for acquiring first ID information related to the storage objects from the image information acquired by the imaging means, a means for acquiring storage information related to the acquired first ID information from the first storage means, a means for acquiring second ID information related to the storage locations of the storage objects by the imaging means, and a means for displaying information related to the storage locations where the storage objects are to be stored on the display means based on the acquired second ID information.

[0003] Japanese Patent Application Laid-Open No. 2015-124023

[0004] In the technology described in Patent Document 1, when a worker changes the storage location of an item on-site, the location is photographed and information indicating the new storage location is updated through image recognition. Therefore, when storing, preserving, and shipping items, the worker is required to take photographs to update the information while performing these tasks.

[0005] The information processing device of the present disclosure is capable of utilizing a conversion rule for converting between first position information, which is used in an item management device that manages the number of items and the positions of the items and indicates the position of the items on a shelf, and coordinate information, which is used when processing a shelf image of the shelf and displaying the results in association with the position on the shelf; and is equipped with a first generation means that uses the coordinate information obtained by processing the shelf image to generate area information that indicates the area in the shelf where the item is located and item information that indicates the type of the item; and a second generation means that uses the conversion rule to convert the area information into the first position information and generates difference information between the combination of the item information and the converted first position information and the information stored in the item management device.

[0006] The item management system of the present disclosure comprises: an item transport device having an imaging means and a moving means; and an information processing device; and is capable of utilizing a conversion rule for converting between first position information used in the item management device for managing the number of items and the positions of the items and indicating the position of the item on a shelf, and coordinate information used when displaying the results of processing a shelf image of the shelf in association with the position on the shelf; the communication device moves to a position in front of a shelf using the moving means, images the shelf, generates the shelf image, and transmits the generated shelf image to the information processing device; and the information processing device includes: a first generation means for generating area information indicating the area in the shelf where the item is located and item information indicating the type of the item using the coordinate information obtained by processing the shelf image received from the communication device; and a second generation means for converting the area information into the first position information using the conversion rule, and generating difference information between a combination of the item information and the converted first position information and information stored in the item management device.

[0007] The information processing method of the present disclosure includes one or more computers that can utilize conversion rules for converting between first position information used in an item management device that manages the number of items and the positions of the items and indicating the positions of the items on a shelf, and coordinate information used when processing a shelf image of the shelf and displaying the results in association with the position on the shelf; using the coordinate information obtained by processing the shelf image to generate area information indicating the area in the shelf where the item is located and item information indicating the type of the item; converting the area information into the first position information using the conversion rules; and generating difference information between the combination of the item information and the converted first position information and the information stored in the item management device.

[0008] The recording medium of the present disclosure is a computer-readable recording medium having recorded thereon a program for causing a computer to use conversion rules to convert between first position information used in an item management device that manages the number of items and the positions of the items and indicating the positions of the items on a shelf, and coordinate information used when processing a shelf image of the shelf and displaying the results in association with the position on the shelf, and for causing the computer to execute a first generation process that uses the coordinate information obtained by processing the shelf image to generate area information that indicates the area on the shelf where the item is located and item information that indicates the type of the item, and a second generation process that uses the conversion rules to convert the area information into the first position information and generate difference information between the combination of the item information and the converted first position information and the information stored in the item management device.

[0009] According to the present disclosure, an information processing device, an information processing method, a program, and an item management system are provided that can improve the efficiency of item management in a warehouse.

[0010] 1 is a block diagram showing the configuration of a first information processing device according to the present disclosure. FIG. 2 is a flowchart showing the processing operation of the first information processing device according to the present disclosure. FIG. 3 is a diagram conceptually showing an example system configuration of a first item management system according to the present disclosure. FIG. 4 is a schematic diagram showing an example configuration of the robot of FIG. 3. FIG. 5 is a diagram showing an example configuration of a computer that realizes the information processing device according to the present disclosure. FIG. 6 is a diagram for explaining an item shelf. FIG. 7 is a diagram showing example data structures of warehouse management information and item information. FIG. 8 is a diagram for explaining a space management method. FIG. 9 is a diagram showing an example data structure of shelf space ID attribute information. FIG. 10 is a flowchart showing the processing operation at the time of initial setup of an information processing device according to the present disclosure. FIG. 11 is a flowchart showing the processing operation at the time of operation of an information processing device according to the present disclosure. FIG. 12 is a block diagram showing the configuration of a second information processing device according to the present disclosure. FIG. 13 is a diagram conceptually showing an example system configuration of a second item management system according to the present disclosure. FIG. 14 is a diagram for explaining another example space management method.

[0011] Hereinafter, in this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are denoted by similar reference numerals, and descriptions thereof will be omitted as appropriate. In each of the following drawings, configurations of parts that are not related to the essence of the present disclosure are omitted and are not shown.

[0012] In this disclosure, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition); and a device inputting data or information output from another device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a response, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0013] <Example of Functional Configuration> As shown in FIG. 1 , the information processing device 100 includes a first generation unit 102 and a second generation unit 104. The information processing device 100 can use conversion rules for converting between first position information, which is used in an item management device that manages the number and positions of items and indicates the positions of items on a shelf, and coordinate information, which is used to display the results of processing shelf images of a shelf in association with the positions on the shelf. The first generation unit 102 uses the coordinate information obtained by processing the shelf images to generate area information indicating the areas on the shelf where items are located and item information indicating the types of the items. The second generation unit 104 converts the area information into first position information using the conversion rules, and generates difference information between the combination of the item information and the converted first position information and the information stored in the item management device.

[0014] <Operation Example> The following will be described with reference to FIG. 2. The first generation unit 102 uses coordinate information obtained by processing the shelf image to generate area information indicating an area within the shelf where an item is located (step S101). The first generation unit 102 then processes the shelf image to generate item information indicating the type of the item (step S103). The second generation unit 104 then converts the area information into first position information using a conversion rule (step S105). The second generation unit 104 then generates difference information between the combination of the item information and the converted first position information and the information stored in the item management device (step S107).

[0015] This information processing device 100 utilizes conversion rules for converting between first position information, which is used in an item management device that manages the number and locations of items and indicates the locations of items on a shelf, and coordinate information, which is used to display the results of processing a shelf image of a shelf in association with the location on the shelf. The first generation unit 102 uses the coordinate information obtained by processing the shelf image to generate area information indicating the area in which an item is located on a shelf and item information indicating the type of the item. The second generation unit 104 then converts the area information into first position information using the conversion rules, and generates difference information between the combination of the item information and the converted first position information and the information stored in the item management device. This configuration provides an information processing device, information processing method, program, and item management system that can improve the efficiency of item management in a warehouse by using the difference information generated in this manner.

[0016] A detailed example of the information processing device 100 will be described below.

[0017] (First embodiment) <System overview> As shown in Fig. 3, the item management system 1 includes an information processing device 100, an item management device 200, and a robot 300. The information processing device 100, the item management device 200, and the robot 300 are connected to each other via a communication network 3. However, the communication network 3 connecting the devices does not have to be a single network. The communication network 3 may be a combination of multiple different networks.

[0018] The robot 300 is, for example, an automatic guided vehicle (AGV) that performs inventory and shelf organization tasks in warehouses, logistics centers, etc. The item management device 200 is, for example, a server device for a warehouse management system (WMS) that manages inventory and logistics processes in warehouses, logistics centers, etc. The item management system 1 supports item management by having the robot 300 patrol the warehouse to photograph the state of shelves and acquire images, and having the information processing device 100 process the images to monitor for any discrepancies with the information managed by the item management device 200.

[0019] The information processing device 100 and the item management device 200 are computers such as personal computers or server computers, and each include a storage device 120 and a storage device 220. The storage device 120 and the storage device 220 may be provided inside or outside the information processing device 100 and the storage device 220. In other words, the storage device 120 and the storage device 220 may be hardware that is integrated with the information processing device 100 and the item management device 200, respectively, or may be hardware that is separate from the information processing device 100 and the item management device 200.

[0020] The robot 300 moves within the warehouse and transports the item 30. As shown in FIG. 4 , the robot 300 includes a camera 302 (corresponding to an imaging means), an arm 304, a robot support 306, an item holder 310, a moving mechanism 320, and a control device (not shown). The robot 300 also includes a communication device (not shown) and communicates with the information processing device 100 and the item management device 200. The communication device can be implemented by an input / output interface 1050 or a network interface 1060 of a computer 1000 that implements the robot 300 (described later).

[0021] The camera 302 captures an image of the warehouse shelf 10 and generates an image. The camera 302 may include a mechanism for controlling the orientation of the camera body and lens, zoom control, focusing, etc., in accordance with the position and orientation of the object to be imaged.

[0022] The images generated by the camera 302 are transmitted to the control device of the robot 300 or the information processing device 100 using a communication device. The timing of transmission may be in real time from the time of capture, but is not necessarily in real time. The images transmitted to the control device or the information processing device 100 do not have to be transmitted directly from the camera 302, but may be images delayed by a predetermined time. The images captured by the camera 302 may be temporarily stored in another storage device, and the control device or the information processing device 100 may read them out from the storage device sequentially or at predetermined intervals. Furthermore, the images transmitted to the control device or the information processing device 100 may be moving images, frame images captured at predetermined intervals, or still images.

[0023] The item holding unit 310 holds the item 30 to be transported within the warehouse. The arm 304 is controlled by a control device to grasp and move the item 30. For example, the arm 304 performs an operation of removing the item 30 from the item holding unit 310 and placing it on the item shelf 10, or an operation of picking the item 30 from the item shelf 10 and storing it in the item holding unit 310.

[0024] The robot support 306 is placed on the article holder 310 and supports the camera 302 and the arm 304. The robot support 306 may be movable in at least one of the height direction and the rotation direction, or may not be movable. If movable, its movement is controlled by a control device. The movement mechanism 320 is controlled by the control device and moves the robot 300 within a predetermined area (e.g., within a warehouse). The movement mechanism 320 is not particularly limited, but moves the robot 300 by rotating a rotating member such as a caterpillar, for example.

[0025] The control device controls each component of the robot 300 (such as the camera 302, the arm 304, the robot support 306, the item holder 310, and the moving mechanism 320). The control device may autonomously control the robot 300, or, as described below, may receive instructions from the information processing device 100 and control the robot 300 in accordance with the instructions. <Hardware Configuration Example> FIG. 5 is a block diagram illustrating an example of the hardware configuration of a computer 1000 that realizes the information processing device 100 according to the present disclosure. The item management device 200 and the robot 300 in FIG. 3 are also realized by the computer 1000. Furthermore, the functions of the information processing device 100 may be shared and realized by the computers 1000 of the item management device 200 and the robot 300 and the computer 1000 of the information processing device 100. Furthermore, a communication device 400, described below, is also realized by the computer 1000.

[0026] The computer 1000 has a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .

[0027] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0028] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0029] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0030] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the information processing device 100 (e.g., the first generation unit 102, the second generation unit 104, the output unit 106 described below, etc.). The processor 1020 loads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each data, such as image data generated by the storage device 120 of the information processing device 100, the storage device 220 of the item management device 200, or the robot 300.

[0031] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded may include a non-transitory, tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0032] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0033] The network interface 1060 is an interface for connecting the computer 1000 to the communication network 3. This communication network 3 is, for example, a local area network (LAN) or a wide area network (WAN). The network interface 1060 may be connected to the communication network 3 wirelessly or by wire.

[0034] The computer 1000 is then connected to necessary equipment (e.g., the display, touch panel, operation buttons, touchpad, keyboard, mouse, speaker, microphone, camera, printer, etc. of the information processing device 100 and the item management device 200, the display, touch panel, touchpad, operation buttons, speaker, microphone, camera 302, arm 304, item holding unit 310, and moving mechanism 320, etc.) via the input / output interface 1050 or the network interface 1060.

[0035] Each component of the information processing device 100 according to the present disclosure in each figure is realized by any combination of hardware and software of the computer 1000 in Figure 5. Those skilled in the art will understand that there are various variations in the realization method and device. The functional block diagrams showing the information processing device 100 according to the present disclosure in each figure show blocks of logical functional units, rather than a configuration of hardware units.

[0036] <Example of functional configuration> The following will be described with reference to Fig. 1. As shown in Fig. 1, the information processing device 100 includes a first generating unit 102 and a second generating unit 104. The information processing device 100 can use conversion rules for converting between first position information that indicates the positions of the items 30 within the item shelf 10 and is used in an item management device 200 that manages the number of items 30 and the positions of the items 30, and coordinate information that is used when processing a shelf image obtained by photographing the item shelf 10 and displaying the results in association with the positions within the item shelf 10.

[0037] The first position information, coordinate information, and conversion rules will be described below with reference to FIGS. 6 to 9. <Regarding First Position Information> The first position information will also be referred to as a location number. As shown in FIG. 6, the item shelf 10 has multiple shelves 40, and items 30 are stacked and stored on each shelf 40 by type. The type of item 30 is information that can be identified by at least one of the name of the item 30 (e.g., product name) and the model number of the item 30 (e.g., product code). Dividers 20 are provided in the spatial area above the shelves 40 for each type of item 30, dividing the spatial area into sections for each type of item 30. The dividers 20 function as markers, as described below. However, the dividers 20 do not necessarily have to be installed. A location number is assigned to each divided spatial area above the shelves 40, and the divided spatial areas are managed by the item management device 200.

[0038] This location number corresponds to "first position information." The location number includes information that can uniquely identify the item shelf 10, the shelf 40, and the spatial area above the shelf 40. In this example, the location number is composed of a combination of a character string indicating the item shelf 10 (a combination of letters and numbers "3C"), a character string indicating the number of shelves 40 ("A7"), and a character string indicating the spatial area above the shelf 40 ("201").

[0039] As shown in FIG. 7 , the warehouse management information 230 associates a location number, which is identification information that can identify the position of a spatial area on a shelf 40 of a shelf 10 in a warehouse, item information about the items 30 to be stored in that spatial area, and information indicating the operational status of that spatial area. The item information includes at least information that can identify the items 30, such as the name (product name) and model number of the items 30. The operational status information indicates whether the spatial area is in operation. In the example shown in FIG. 7 , "1" indicates that the spatial area is in operation and "0" indicates that the spatial area is not in operation, but the content of the information is not limited to these. The warehouse management information 230 may also include information that indicates the quantity of items 30 to be stored in that spatial area (e.g., inventory quantity).

[0040] The warehouse management information 230 is stored in the storage device 220 or in the memory 1030 or storage device 1040 of the computer 1000 that implements the item management apparatus 200 .

[0041] Note that the various pieces of information described below may also be stored in the storage device 220, or in the memory 1030 or storage device 1040 of the computer 1000 that implements the item management device 200. In the following description, "stored in the storage device 220" is used to mean "stored in the storage device 220, or in the memory 1030 or storage device 1040 of the computer 1000 that implements the item management device 200."

[0042] Furthermore, as shown in FIG. 7 , the item information 232 is stored in the storage device 220 for each item 30, with information capable of identifying the item 30 associated with information indicating the size of the item 30. The information capable of identifying the item 30 in the item information 232 is linked to the item information in the warehouse management information 230. If the item 30 is a rectangular parallelepiped, the information indicating the size of the item 30 includes, for example, information indicating the width, height, and depth. However, the information indicating the size is not limited to this and may vary depending on the shape of the item 30. For example, if the item 30 is cylindrical, the information indicating the size may include information indicating the diameter (or longest diameter) of the bottom circle of the cylinder and the height of the cylinder, in addition to information indicating the shape of the item 30. Furthermore, the item information 232 may include information such as the weight of the item 30 in addition to the size of the item 30.

[0043] 6 , the divider 20 includes a label 22 on which the item information and the location number are written in text, and a label 24 on which code information (e.g., a barcode, a two-dimensional code, etc.) recording the item information and the location number is written. The item management device 200 associates and manages the location number and the item information, generates the label, and affixes it to the divider 20. By attaching these labels to the divider 20, it can function as a marker.

[0044] A worker can identify the item 30 by looking at the characters written on the label 22. Alternatively, the worker can read the code information written on the label 24 using a handheld code reader or a camera on a smartphone, tablet, or the like. The characters written on the label 22 or the code information written on the label 24 may also be read by processing an image captured by the camera 302 of the robot 300. In this way, the labels on the partitions 20 are originally intended to be used by workers and robots 300 working in the warehouse. However, as will be described later, the information processing device 100 can also recognize the partitions 20 and obtain and use the information written on the labels of the partitions 20 by processing an image of the shelf 10.

[0045] <Regarding Coordinate Information> The coordinate information will be hereinafter also referred to as a shelf space ID. By processing a shelf image of the item shelf 10, the items 30 stored on the item shelf 10 are recognized. The shelf image is generated, for example, using the camera 302 of the robot 300. However, in other examples, the shelf image may be generated using a camera installed in a warehouse.

[0046] The object 30 is recognized by an image processing device (not shown). The image processing device may be included in the information processing device 100 or may be an external device to the information processing device 100. Alternatively, the image processing device may be included in the camera 302 of the robot 300.

[0047] The image processing device extracts, from the shelf image, information that can identify the item 30 that is written on the package of the item 30 (for example, at least one of the name of the item 30, character string indicating the model number, code information, and package image). The image processing device may then identify the item 30 by performing a recognition process on the character string or code information or a comparison process with feature information of the package image of the item 30 registered in the item information 232.

[0048] When a shelf image is generated using the camera 302 of the robot 300, the location where the image is generated can be identified using information on the location where the robot 300 is moving, the position of the arm 304 of the robot 300, and the shooting direction of the camera 302 of the robot 300.

[0049] The first generation unit 102 acquires from the robot 300 the shooting position information indicating the shooting position and shooting direction of the shelf image, processes the shelf image to identify the position within the goods shelf 10, and generates area information using the coordinate information (shelf space ID).

[0050] The movement location of the robot 300 can be identified using at least one of a movement instruction to the movement mechanism 320 of the robot 300 and map information indicating the location and aisles of each shelf 10 in the warehouse. For example, if the movement instruction indicates a destination shelf 10, the information processing device 100 can identify the location of the destination shelf 10 from the map information. Alternatively, the first generation unit 102 may identify a beacon transmitter installed in the warehouse by having the robot 300 receive a beacon (including information that can identify the transmitter) transmitted from the transmitter, and identify a position corresponding to the range of the beacon transmitted from the transmitter as the current position.

[0051] The first generating unit 102 virtually divides the shelf 10 into sections to identify partitioned areas indicating locations where the items 30 are to be placed. Then, the first generating unit 102 generates coordinate information (shelf space ID) of the shelf 10 including information indicating the position and size of the partitioned areas. The shelf space ID is an example of "coordinate information."

[0052] As shown in Fig. 8, the area on each shelf 40 of the storage shelf 10 can be divided into multiple virtual box-shaped spaces 50. These multiple spaces 50 can be represented by three-dimensional coordinate values ​​(X-axis, Y-axis, Z-axis). Using this coordinate information (the shelf space ID described above), the position of each space 50 can be represented so that it can be specified.

[0053] The following are examples of methods for setting the size of the space 50 (the length of one side of the space 50 or the number of divisions into the width of the shelf 40). These methods are not limited to these. (1) The size of the space 50 or the number of divisions into the width of the shelf 40 is set by receiving an input operation from an administrator or worker in a setting menu. (2) When nothing is placed on the shelf 10 before operation begins, the size of the space 50 is set based on the width of the shelf 40 and the size of the items 30 to be stored. For example, the size of the space 50 may be determined by equally dividing the width of the shelf 40 by a predetermined number of divisions. In another example, the width of the space 50 may be set based on the smallest width of the items 30 to be stored. (3) After operation begins, the width of the space 50 may be set based on the smallest width of all the items 30 placed on the shelf 40. (4) Before or after operation begins, the space 50 may be set based on the dividers 20 installed on the shelves 40 by an administrator or worker. For example, the position of at least one divider 20 installed on the shelf 40 is identified by processing a shelf image obtained by capturing an image of the storage shelf 10. The width of the space 50 may be set based on the smallest value among the widths of the shelf 40 divided by at least one divider 20 installed on the shelf 40.

[0054] Furthermore, the first generating unit 102 can specify partitioned areas occupied by the items 30 stored on the item shelf 10 by having the image processing device process the shelf image. Fig. 8 shows how areas 60 and 62 for two types of items 30 have been specified. Furthermore, the image processing device specifies the dividers 20 by processing the shelf image. Fig. 8 shows how it has been specified that the dividers 20 are installed in three locations.

[0055] In the example of Figure 8, the coordinate information of the area 60 of a certain type of first item 30 is specified as "X0Y1Z3," and the coordinate information of the area 62 of the other type of second item 30 is specified as "X1Y1Z2." Note that while the example of Figure 8 illustrates the areas in which each item 30 exists in the X and Y axis directions, each item 30 also exists in the Z axis direction. Here, the size in the Z direction of the area 62 of the second item 30 is smaller than the area 60 of the first item 30 by one space 50.

[0056] In the example of FIG. 8 , the partition 20 is predetermined to be installed on the right side of the item 30, and the label of the partition 20 is provided below the partition 20 as shown in FIG. 6 . However, the installation position of the partition 20 and the label position are not limited to this. For example, the partition 20 may be installed so as to hang down from above the shelf 40. In this case, the label is provided above the partition 20. The partition 20 may also be installed on the left side of the item 30. This information is assumed to be set in advance in the information processing device 100. The installation method of the partition 20 may be set for each item shelf 10. The setting of the installation method of the partition 20 may be changed by accepting an operator operation using a predetermined operation menu. Alternatively, the installation method of the partition 20 may be automatically set by the image processing device processing an image to recognize the partition 20. The image processing device can identify the partition 20 from the shelf image and read and recognize the information written on each label of the partition 20.

[0057] The first generation unit 102 changes the section based on the history of the shape of the area where the item 30 stored on the item shelf 10 is located. Specifically, the first generation unit 102 stores in the storage device 120 a history of area information indicating the area where the item 30 is located, identified from the shelf image. The first generation unit 102 then uses information for each predetermined period (e.g., one week, one month, etc.) in the history information to identify the space 50 indicating the area where the item 30 is located, thereby identifying the shape of the area. The first generation unit 102 then compares the shapes identified for each predetermined period, and if a difference in capacity equal to or greater than a threshold is calculated (e.g., if the ratio of the capacity after the predetermined period to the capacity before the predetermined period is equal to or greater than a threshold), changes the section to match the area after the predetermined period. The predetermined period and threshold are preferably configurable depending on the type of item 30. This is because the delivery cycle, delivery quantity, shipping cycle, shipping quantity, etc. vary depending on the item 30.

[0058] Furthermore, the first generating unit 102 may change the section based on the position of a marker (corresponding to the partition 20) in the shelf 10. For example, in a warehouse, an operator may manually move the location of the partition 20 depending on the amount of items 30 placed on the shelf 10. In such a case, it is time-consuming for the operator to input information about the movement of the partition 20 into the item management device 200. Therefore, the first generating unit 102 identifies the moved partition 20 from the shelf image, and automatically changes the section of the space 50 indicating the area of ​​the items 30 based on the position of the partition 20.

[0059] <Regarding Conversion Rules> As an example of the conversion rules, the shelf space ID attribute information 130 shown in Fig. 9 is used. The shelf space ID attribute information 130 associates the above-mentioned coordinate information and first position information with each other and is stored in the storage device 120, or in the memory 1030 or storage device 1040 of the computer 1000 that realizes the information processing device 100.

[0060] The first generation unit 102 sets multiple spaces 50 in the area of ​​the shelf 10 and sets identification information (shelf space ID) that can identify each space 50 by having the robot 300 patrol the warehouse in advance and photograph the shelf 10, and then having the image processing device process the shelf images. Note that hereinafter, "processing an image" means "having the image processing device process an image." The functions of the first generation unit 102 described here are functions at the time of initial setting.

[0061] The first generation unit 102 processes the shelf image to recognize the type of item 30 in the item shelf 10, and generates area information indicating the area in which the item 30 is located using the coordinate information. Furthermore, the first generation unit 102 processes the shelf image to recognize the partition 20, and identifies information about the item 30 and a location number (first position information) from the partition 20. Then, the first generation unit 102 generates shelf space ID attribute information 130 that associates the coordinate information with the first position information. This shelf space ID attribute information 130 is an example of a "conversion rule."

[0062] Furthermore, the first generating unit 102 may process the shelf image to identify the quantity of each type of item 30 present on the item shelf 10 and include the quantity in the item information. The item information generated by the first generating unit 102 may include the quantity of items 30 generated by processing the shelf image.

[0063] The shelf space ID attribute information 130 is stored in the storage device 120, or in the memory 1030 or storage device 1040 of the computer 1000 that realizes the information processing device 100. Note that the various pieces of information described below may also be stored in the storage device 120, or in the memory 1030 or storage device 1040 of the computer 1000 that realizes the information processing device 100. In the following description, the phrase "stored in the storage device 120" is used, but this phrase is intended to mean "stored in the storage device 120, or in the memory 1030 or storage device 1040 of the computer 1000 that realizes the information processing device 100."

[0064] 9, the shelf space ID attribute information 130 stores first position information (location number) in association with coordinate information (shown as "space ID" in the figure). Furthermore, the shelf space ID attribute information 130 includes, in association with the coordinate information, a flag indicating whether or not a partition 20 is present (in the example shown in the figure, if a partition 20 is present, the flag is set to "1") and information indicating the type of item 30 present in the space (for example, the name and model number of the item 30).

[0065] As described above, the shelf space ID attribute information 130 is generated in advance as a conversion rule. As will be described later, this generated conversion rule is used when managing the items 30 stored on the shelf 10 in the warehouse.

[0066] <Function of the first generation unit 102 during operation> The first generation unit 102 uses coordinate information obtained by processing the shelf image to generate area information indicating the area within the shelf where the item is located and item information indicating the type of the item. As in the initial setup, the robot 300 patrols the warehouse and generates shelf images. By processing the shelf image, the first generation unit 102 recognizes the type of item 30 within the item shelf 10 and generates area information indicating the area where the item 30 is located using coordinate information (shelf space ID). Furthermore, by processing the shelf image, the first generation unit 102 recognizes the partition 20 and identifies information related to the item 30 and a location number (first position information) from the partition 20.

[0067] <Function of the second generating unit 104 during operation> The second generating unit 104 converts area information (shelf space ID) into first location information using a conversion rule. Specifically, the second generating unit 104 reads the shelf space ID attribute information 130 in Fig. 9 and acquires the first location information (location number) corresponding to the area information (shelf space ID) generated by the first generating unit 102.

[0068] Furthermore, the second generating unit 104 generates difference information between the combination of the item information (information indicating the type of item 30) and the converted first location information (location number) identified by the first generating unit 102 and the warehouse management information 230 stored in the item management device 200. Specifically, the second generating unit 104 refers to the warehouse management information 230 and identifies the location number corresponding to the information indicating the type of item 30 identified by the first generating unit 102. The second generating unit 104 then compares the identified location number (hereinafter referred to as second location information) with the first location information (location number) obtained from the shelf space ID attribute information 130, i.e., the first location information (location number) after conversion using the conversion rule.

[0069] The second generating unit 104 generates difference information relating to the difference between the first location information and the second location information. The difference information includes, for example, information indicating whether the first location information and the second location information match. Furthermore, the difference information may include the first location information and the second location information.

[0070] Furthermore, the difference information may include information indicating the difference between the quantity of items 30 present at the location indicated by the first location information and the quantity of items 30 that should be present at the location indicated by the second location information (the inventory quantity managed by the item management device 200).

[0071] Furthermore, the difference information may specify the installation state of the item 30 by processing an image of the item 30 that is present at the location indicated by the first position information. The installation state includes at least one of whether the item 30 is upside down, whether it is upside down, whether it is lying on its side, and whether it is placed at an angle to the front surface of the shelf 40.

[0072] The information processing device 100 stores in advance, as a database, an image of at least the front of the package of the item 30 or characteristic information thereof. The first generation unit 102 may identify the installation state of the item 30 by image processing. Then, when the second generation unit 104 identifies that the installation state of the item 30 is, for example, upside down, upside down, lying on its side, or placed at an angle, it generates difference information indicating the state.

[0073] Alternatively, the second generation unit 104 may process the shelf image to recognize the orientation of characters or images written on the packaging of the item 30 and determine whether the installation state of the item 30 is in the correct orientation. For example, if the orientation of the recognized characters is upside down, sideways, or diagonal, or if the characters are not recognized at all, the second generation unit 104 may determine that the installation state is incorrect. The second generation unit 104 identifies the installation state according to the orientation of the characters and generates difference information indicating the state.

[0074] The difference information may also include location information of a certain shelf 10 where a missing item 30 actually exists. The second generation unit 104 identifies the quantity of items 30 that should be present for each piece of first location information by using information indicating the type of items 30 in operation associated with the location number and information indicating the quantity of the items 30 in the warehouse management information 230 of the item management device 200. The second generation unit 104 further processes the shelf image to identify the type and quantity of items 30 that are present in the spatial region indicated by the coordinate information corresponding to the region indicated by the first location information, and compares the type and quantity of items 30 identified from the warehouse management information 230.

[0075] If the comparison shows that the quantity of a type of item 30 corresponding to the type and quantity of item 30 identified from the warehouse management information 230 is not present or is insufficient on the item shelf 10 in the shelf image, the second generation unit 104 generates difference information indicating that there is a shortage of that type of item 30. On the other hand, if the comparison shows that the quantity of a type of item 30 corresponding to the type and quantity of item 30 identified from the warehouse management information 230 is in excess of the quantity on the item shelf 10 in the shelf image, the second generation unit 104 generates difference information indicating that there is an excess of that type of item 30.

[0076] <Operation Example> An example of the processing operation of the information processing device 100 of the present disclosure will be described below. <Processing Operation Example During Initial Setup> First, the processing operation during initial setup will be described. As shown in FIG. 10 , the first generation unit 102 acquires a shelf image (step S201). The first generation unit 102 then processes the shelf image to perform a mapping process of the shelf space. As described above, the first generation unit 102 defines the area partitioned by each shelf board 40 in the shelf image of the item shelf 10 as the shelf space, and partitions the space to map multiple spaces 50.

[0077] The first generation unit 102 then processes the shelf image to identify a partitioned area indicating an area where the item 30 is present (step S205). The first generation unit 102 then identifies the space 50 corresponding to the identified partitioned area, and assigns the shelf space ID of the space 50 to the partitioned area of ​​the item 30 (step S207).

[0078] Then, the first generation unit 102 processes the shelf image to identify a location number from the partition 20 corresponding to the item 30, associates the location number with the shelf space ID, and stores it in the storage device 120 as shelf space ID attribute information 130 (step S209).

[0079] <Example of Processing Operation During Operation> Next, a processing operation during operation will be described. As shown in Fig. 11 , the first generation unit 102 acquires a shelf image (step S301). Then, the second generation unit 104 processes the shelf image to identify a location number from the partition 20, and refers to the shelf space ID attribute information 130 (using a conversion rule) to identify a space ID corresponding to the location number (step S303).

[0080] Meanwhile, the first generation unit 102 processes the shelf image to identify the inventory status of the item 30 (step S305). The inventory status of the item 30 includes at least one of the type of item 30, the quantity of the item 30, and the installation status of the item 30. The second generation unit 104 then compares the identified inventory status of the item 30 with the warehouse management information 230 (step S307). If the comparison reveals a difference (YES in step S307), the second generation unit 104 generates difference information (step S309). On the other hand, if there is no difference (NO in step S307), the second generation unit 104 bypasses step S309 and terminates the processing. However, even if there is no difference, the second generation unit 104 may generate difference information indicating that there is no difference.

[0081] As described above, according to this embodiment, the information processing device 100 includes a first generation unit 102 and a second generation unit 104. The information processing device 100 can utilize conversion rules for converting between first position information, which is used in an item management device that manages the number and positions of items and indicates the positions of items on a shelf, and coordinate information, which is used to display the results of processing a shelf image of a shelf in association with the position on the shelf. The first generation unit 102 then uses the coordinate information obtained by processing the shelf image to generate area information indicating the area in which an item is located on a shelf and item information indicating the type of the item. The second generation unit 104 then converts the area information into first position information using the conversion rules, and generates difference information between the combination of the item information and the converted first position information and the information stored in the item management device. This configuration provides an information processing device, information processing method, program, and item management system that can improve the efficiency of item management in a warehouse by using the difference information generated in this manner.

[0082] In this information processing device 100, the state of the items 30 in the item shelf 10 is grasped by image processing and the result is displayed as coordinate information. Then, according to the information processing device 100, the coordinate information can be converted into position information that can be compared with the storage location of the items 30 indicated by the management information of the item management device 200 using a conversion rule, so that the difference between the actual state of the items 30 and the management information of the item management device 200 can be generated.

[0083] In addition, the first generation unit 102 virtually divides the goods shelf 10 to identify a partitioned area indicating the location where the goods 30 are placed, and generates coordinate information (shelf space ID) of the goods shelf 10 including information indicating the position and size of the partitioned area.

[0084] According to this configuration, the area in which the items 30 are present, partitioned by the space 50, can be indicated by coordinate information. Therefore, even if the inventory quantity of the items 30 changes or the storage location of the items 30 changes due to inventory, the coordinate information can be immediately reflected. For example, in a status monitoring system for the item shelf 10 using 3D images, the images are handled as point cloud data, which results in a larger data volume, a higher computational load on the computer 1000, and longer processing time compared to the case of 2D images. Acquiring the 3D information also takes time. Furthermore, if the inventory quantity of the items 30 changes or the storage location of the items 30 changes, the 3D information must be acquired again and the above-mentioned high-load computational processing must be performed again. According to the information processing device 100 disclosed herein, by using a space ID, the computational load on the information processing device 100 is reduced and the processing time is shortened compared to the case of 3D images.

[0085] Furthermore, in a status monitoring system for the shelf 10 using two-dimensional images that do not use a spatial ID, it is difficult to grasp the status of the items 30 at the back of the shelf. However, according to the information processing device 100 of the present disclosure, by using the space 50, depth information can also be estimated, making it possible to estimate the status of the items 30 at the back of the shelf. Therefore, for example, the information processing device 100 does not need to calculate depth even when determining the maximum number of items 30 that can be stored or the optimal number of items to be stored, thereby improving calculation efficiency. Furthermore, in a status monitoring system for the shelf 10 using three-dimensional images, the images are treated as point cloud data, which increases the calculation load on the computer 1000 and requires a long processing time. According to the information processing device 100, because two-dimensional images are used, the calculation load on the computer 1000 is reduced and the processing time is shortened compared to when using three-dimensional images.

[0086] Second Embodiment A second information processing device 100 according to the present disclosure shown in Fig. 12 is the same as the information processing device 100 shown in Fig. 1 except that it further includes an output unit 106. Note that the elements shown in Fig. 12 may be combined with the elements of one or more embodiments to the extent that no contradiction occurs.

[0087] <System Overview> The second item management system 1 of FIG. 13 according to the present disclosure is the same as the item management system 1 of FIG. 4 except that it further includes a communication device 400 used by a worker U. As shown in FIG. 13 , the second item management system 1 of the present disclosure further includes the communication device 400. The communication device 400 is, for example, a computer such as a smartphone, a tablet terminal, or a personal computer. A predetermined program is installed in the communication device 400. Then, by causing the communication device 400 to execute the program, the communication device 400 cooperates with the information processing device 100 to realize some of the functions of the information processing device 100. Specifically, the communication device 400 realizes the functions of the output unit 106 of the information processing device 100, which will be described later.

[0088] Alternatively, a browser may be launched in the communication device 400, allowing the worker U to access a specific website provided by the item management system 1 and use the functions provided by the item management system 1. In either case of an application or a website, the worker U may be able to use the functions of the item management system 1 by using the communication device 400 to perform authentication processing using account information and logging in to the item management system 1.

[0089] <Functional Configuration Example> The information processing device 100 according to the present disclosure includes the same first generating unit 102 and second generating unit 104 as the information processing device 100 in FIG. 1 , and further includes an output unit 106 .

[0090] The output unit 106 outputs the difference information generated by the second generation unit 104 .

[0091] The difference information may be output in various forms, including but not limited to the following examples: <Output to Display> The output unit 106 displays the difference information on the display of the communication device 400. Alternatively, the output unit 106 may display the difference information on the display of the information processing device 100. The displayed difference information includes, for example, information indicating the difference between the actual installation state of the item 30 and the information in the warehouse management information 230.

[0092] For example, the output unit 106 may output information indicating the item 30 for which a difference has been detected, in association with difference information indicating the location where the item 30 actually existed and the location (the location where the item 30 should be placed) corresponding to the location number in the warehouse management information 230. In other words, the output unit 106 outputs difference information indicating from where to where the item 30 for which a difference has been detected should be moved.

[0093] Alternatively, the output unit 106 may output, together with information indicating the location of the item 30 for which a difference has been detected, at least one of difference information indicating that the installation state of the item 30 is disturbed and difference information including a message instructing to correct the installation state of the item 30. In other words, the output unit 106 outputs difference information indicating where the item 30 for which a difference has been detected is located and how to correct the installation state.

[0094] Furthermore, an image element that can identify the image area of ​​the item 30 in which a difference has been detected may be superimposed on the actual shelf image.

[0095] <Output to Robot 300> The output unit 106 outputs difference information to the robot 300. In this case, the difference information is information indicating the difference between the actual installation state of the item 30 and the information in the warehouse management information 230, or information instructing the robot 300 to perform work to resolve the difference.

[0096] The output unit 106, for example, associates information indicating the item 30 in which a difference has been detected with difference information indicating the location where the item 30 actually existed and the location corresponding to the location number in the warehouse management information 230 (the location where the item 30 should be placed), and outputs the information as instruction information to the robot 300. The output unit 106 may also output instruction information to the robot 300 indicating from where to where the item 30 in which a difference has been detected should be moved.

[0097] Alternatively, the output unit 106 may output, together with information indicating the location of the item 30 for which a difference has been detected, at least one of difference information indicating that the installation state of the item 30 is disturbed and instruction information instructing the robot 300 to correct the installation state of the item 30.

[0098] As described above, the information processing device 100 of this embodiment further includes the output unit 106. The output unit 106 outputs the difference information generated by the second generation unit 104. This information processing device 100 not only achieves the same effects as the above-described embodiment, but also makes it possible to display the difference information on a display or output it to the robot 300 as an instruction to organize the items 30.

[0099] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations may also be employed. (Other Embodiments) In the above embodiment, an example was described in which the virtual space 50 was partitioned into a box shape. In other embodiments, as shown in FIG. 14 , the first generation unit 102 may partition the space 50 using a plurality of patches 70. For example, the first generation unit 102 identifies at least three locations in the space 50 using the patches 70, and uses the coordinate information of the patches 70 to determine the area information of the space 50. For example, if the shape of the item 30 is a shape other than a box, the area of ​​the item 30 may be identified using a plurality of patches 70.

[0100] However, there may be at least two patches 70. In this case, for example, the XY coordinates may be specified by two patches 70, and the Z coordinate may be set to the same section across the entire depth of the shelf board 40. Alternatively, the XZ coordinates may be specified by two patches 70, and the Y coordinate may be set to the same section across the entire height between the upper and lower shelf boards 40.

[0101] Another example of the present disclosure may be a program that causes at least one computer to execute the above-disclosed method, or a computer-readable recording medium on which such a program is recorded. This recording medium includes a non-transitory tangible medium. This computer program includes computer program code that, when executed by a computer, causes the computer to perform the information processing method on an information processing device.

[0102] Any combination of the above components, and conversion of the present disclosure into a method, device, system, recording medium, computer program, etc., are also valid aspects of the present disclosure.

[0103] Furthermore, the various components of the present disclosure do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.

[0104] Furthermore, although the methods and computer programs disclosed herein describe a number of steps in a sequential order, the order in which the steps are performed does not limit the order in which the steps are performed. Therefore, when implementing the methods and computer programs disclosed herein, the order of the steps can be changed as long as it does not cause any problems in terms of the content.

[0105] Furthermore, the steps of the method and computer program disclosed herein are not limited to being executed at different times, and may be executed while one step is being executed, or may be executed partially or entirely overlapping with another step, etc.

[0106] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0107] In addition, although the flowcharts used in the above description show a sequence of steps (processes), the order of steps executed in each embodiment is not limited to the sequence shown in the flowcharts. In each embodiment, the order of steps shown in the diagrams can be changed as long as it does not cause any problems in terms of the content.

[0108] Some or all of the above embodiments can be described as in the following supplementary notes, but are not limited to them. 1. An information processing device that can utilize a conversion rule for converting between first position information used in an item management device that manages the number and positions of items and indicating the positions of the items on a shelf, and coordinate information used when processing a shelf image of the shelf and displaying the results in association with the position on the shelf, and that includes: a first generation means that uses the coordinate information obtained by processing the shelf image to generate area information that indicates the area on the shelf where the item is located and item information that indicates the type of the item; and a second generation means that uses the conversion rule to convert the area information into the first position information and generates difference information between a combination of the item information and the converted first position information and information stored in the item management device. 2. In the information processing device described in 1., the first generation means virtually partitions the shelf to identify partitioned areas that indicate where the items are to be placed, and generates the coordinate information of the shelf that includes information that indicates the position and size of the partitioned area. 3. An information processing device described in 1. or 2. 1. The information processing device described in any one of items 1. to 3., further comprising an output means for outputting the difference information. 4. The information processing device described in any one of items 1. to 3., wherein the difference information includes position information of a shelf where a missing item is actually located. 5. The information processing device described in any one of items 1. to 4., wherein the first generation means acquires shooting position information indicating the shooting position and shooting direction of the shelf image, processes the shelf image to identify a position within the shelf, and generates the area information using the coordinate information. 6. The information processing device described in any one of items 1. to 5., wherein the item information includes the quantity of the items generated by processing the shelf image. 7. The information processing device described in item 2., wherein the first generation means changes the section based on a history of the shape of the area where the items stored on the shelf are located.8. The information processing device according to 2. or 7., wherein the first generating means changes the section based on the position of a marker within the shelf.

[0109] 9. An item management system comprising: an item transport device having an imaging means and a movement means; and an information processing device, wherein a conversion rule is available for converting between first position information used in an item management device that manages the number of items and the positions of the items and indicating the positions of the items on a shelf, and coordinate information used when processing a shelf image of the shelf and correlating the processed result with the position on the shelf, wherein the communication device moves to in front of the shelf using the movement means, takes an image of the shelf, generates the shelf image, and transmits the generated shelf image to the information processing device, wherein the information processing device includes: first generation means that uses the coordinate information obtained by processing the shelf image received from the communication device to generate area information that indicates the area on the shelf where the item is located and item information that indicates the type of the item, and second generation means that uses the conversion rule to convert the area information into the first position information, and generates difference information between a combination of the item information and the converted first position information and information stored in the item management device. An information processing method in which one or more computers can use conversion rules to convert between first position information used in an item management device that manages the number of items and the positions of the items and indicating the positions of the items on a shelf, and coordinate information used when processing a shelf image of the shelf and displaying the results in association with the position on the shelf, and the conversion rules to convert the area information that indicates the area on the shelf where the item is located and item information that indicates the type of the item, using the coordinate information obtained by processing the shelf image, and converting the area information into the first position information using the conversion rules, and generating difference information between the combination of the item information and the converted first position information and the information stored in the item management device.11. A computer is capable of utilizing conversion rules for converting between first position information used in an item management device that manages the number of items and the positions of the items and indicating the positions of the items on a shelf, and coordinate information used when displaying the results of processing a shelf image of a photograph of the shelf in association with the position on the shelf, and the like, and a program for causing the computer to execute: a first generation process that uses the coordinate information obtained by processing the shelf image to generate area information that indicates the area in the shelf where the item is located and item information that indicates the type of the item; and a second generation process that uses the conversion rules to convert the area information into the first position information and generate difference information between a combination of the item information and the converted first position information and information stored in the item management device. The computer is capable of utilizing conversion rules for converting between first position information, which is used in an item management device that manages the number and positions of items and indicates the position of the item on a shelf, and coordinate information, which is used when displaying the results of processing a shelf image taken of the shelf in relation to the position on the shelf; and a computer-readable recording medium having recorded thereon a program for causing the computer to execute: a first generation process that uses the coordinate information obtained by processing the shelf image to generate area information that indicates the area on the shelf where the item is located, and item information that indicates the type of the item; and a second generation process that uses the conversion rules to convert the area information into the first position information, and generate difference information between the combination of the item information and the converted first position information and the information stored in the item management device.

[0110] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8 that are subordinate to the above-mentioned Supplementary Note 1 (information processing device) may also be subordinate to the item management system of Supplementary Note 9, the information processing method of Supplementary Note 10, the program of Supplementary Note 11, and the recording medium of Supplementary Note 12 in the same subordinate relationship as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1 and 10 to 12, some or all of the configurations described as Supplements may also be subordinate to various hardware, software, various recording means for recording software, or systems within the scope of each of the above-mentioned embodiments.

[0111] REFERENCE SIGNS LIST 1 Item management system 3 Communication network 10 Item shelf 20 Partition 22 Label 24 Label 30 Item 40 Shelf 50 Space 60 Area 62 Area 70 Patch 100 Information processing device 102 First generation unit 104 Second generation unit 106 Output unit 120 Storage device 130 Shelf space ID attribute information 200 Item management device 220 Storage device 230 Warehouse management information 232 Item information 300 Robot 302 Camera 304 Arm 306 Robot support 310 Item holder 320 Moving mechanism 400 Communication device 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / output interface 1060 Network interface

Claims

1. An information processing apparatus that is used in an article management apparatus for managing the number of articles and the positions of the articles, and is capable of using a conversion rule for converting between first position information indicating the positions of the articles in a shelf and coordinate information used for associating and indicating the result of processing a shelf image obtained by photographing the shelf with positions in the shelf, and a first generation means for generating region information indicating a region where the articles exist in the shelf and article information indicating the types of the articles by using the coordinate information obtained by processing the shelf image, and a second generation means for converting the region information into the first position information by using the conversion rule and generating difference information between a combination of the article information and the converted first position information and information stored in the article management apparatus.

2. The information processing apparatus according to claim 1, wherein the first generation means generates the coordinate information of the shelf including information indicating the position and size of a partition region indicating a place where the article is placed by virtually partitioning the shelf.

3. The information processing apparatus according to claim 1 or 2, further comprising output means for outputting the difference information.

4. The information processing apparatus according to any one of claims 1 to 3, wherein the difference information includes position information of the shelf where articles that are lacking in a certain shelf actually exist.

5. The information processing apparatus according to any one of claims 1 to 4, wherein the first generation means acquires photographing position information indicating the photographing position and direction of the shelf image, processes the shelf image to identify positions in the shelf, and generates the region information by using the coordinate information.

6. The information processing apparatus according to any one of claims 1 to 5, wherein the article information includes the quantity of the articles generated by processing the shelf image.

7. The information processing apparatus according to claim 2, wherein the first generation means changes the partition based on a history of the shape of a region where the articles stored in the shelf exist.

8. The information processing apparatus according to claim 2 or 7, wherein the first generation means changes the partition based on the positions of markers in the shelf.

9. An article conveying apparatus having an imaging means and a moving means, and an information processing apparatus, and is used in an article management apparatus for managing the number of articles and the positions of the articles. A first position information indicating the position of the article in the shelf, and a conversion rule for converting between the first position information and coordinate information used to indicate, in association with the position in the shelf, the result of processing a shelf image obtained by photographing the shelf are available. The communication device moves in front of the shelf by the moving means, captures an image of the shelf to generate the shelf image, and transmits the generated shelf image to the information processing apparatus. The information processing apparatus includes: a first generation means for generating region information indicating a region where the article exists in the shelf and article information indicating the type of the article, using the coordinate information obtained by processing the shelf image received from the communication device; and a second generation means for converting the region information into the first position information using the conversion rule, and generating difference information between the combination of the article information and the converted first position information and the information stored in the article management apparatus. An article management system.

10. An information processing method, wherein one or more computers can use a conversion rule for converting between first position information indicating the position of an article in a shelf, which is used in an article management apparatus for managing the number of articles and the positions of the articles, and coordinate information used to indicate, in association with the position in the shelf, the result of processing a shelf image obtained by photographing the shelf. Using the coordinate information obtained by processing the shelf image, region information indicating a region where the article exists in the shelf and article information indicating the type of the article are generated. The region information is converted into the first position information using the conversion rule, and difference information between the combination of the article information and the converted first position information and the information stored in the article management apparatus is generated.

11. The computer can use a conversion rule for converting between first position information indicating the positions of articles in a shelf, which is used in an article management device that manages the number and positions of articles, and coordinate information used when associating and indicating the result of processing a shelf image of the shelf with positions in the shelf. The computer is caused to execute a first generation process for generating region information indicating a region where the articles are present in the shelf and article information indicating the types of the articles, using the coordinate information obtained by processing the shelf image, and a second generation process for converting the region information into the first position information using the conversion rule and generating difference information between a combination of the article information and the converted first position information and information stored in the article management device. A computer-readable recording medium having recorded thereon a program for causing the computer to execute the processes.

Images