Management device, management method, and recording medium

Abstract

The management device comprises an antenna control unit, a reading unit, a status identification unit, and an output unit. The antenna control unit controls movement of antennas that can individually move on a rail attached to a shelf. The reading unit uses the antennas to read an RFID tag attached to an article and including information that can identify the article. The status identification unit identifies information indicating the display status of the article on the shelf on the basis of position information of the antenna and the information read from the RFID tag. The output unit outputs information indicating the display status.

Description

Management device, management method, and recording medium

[0001] The present disclosure relates to a management device and the like.

[0002] In recent years, items with attached RFID (Radio Frequency Identification) tags are often stored or displayed on shelves. An RFID reader manages the storage status, such as the number of items stored on the shelves, via an antenna.

[0003] Patent document 1 describes a method in which a scanner including multiple antennas and readers for each shelf level is installed on a shelf, and the scanner moves laterally across the shelf to read RFID tags attached to items on each shelf level.

[0004] Special Publication No. 2015-510479

[0005] Incidentally, when placing items with RFID tags attached on a shelf in order to manage the status of the items on the shelf, many antennas may be required.

[0006] An example of an object of the present disclosure is to provide a management device or the like that aims to reduce the number of antennas.

[0007] In one aspect of the present disclosure, the management device comprises: an antenna control means for controlling the movement of antennas that are individually movable on rails attached to shelves; a reading means for using the antennas to read RFID tags attached to items that contain information that can identify the items; a situation determination means for determining information representing the display status of the items on the shelves based on position information of the antennas and the information read from the RFID tags; and an output means for outputting the information representing the display status.

[0008] A management method in one aspect of the present disclosure includes controlling the movement of antennas that are individually movable on rails attached to shelves, using the antennas to read RFID tags attached to items that contain information that can identify the items, identifying information that represents the display status of the items on the shelves based on the position information of the antennas and the information read from the RFID tags, and outputting the information that represents the display status.

[0009] A program in one aspect of the present disclosure causes a computer to perform the following processes: control the movement of antennas that can be moved individually on rails attached to a shelf; use the antennas to read RFID tags attached to items that contain information that can identify the items; identify information that represents the display status of the items on the shelf based on position information of the antennas and the information read from the RFID tags; and output the information that represents the display status.

[0010] Each program may be stored in a non-transitory computer-readable recording medium.

[0011] According to the present disclosure, it is possible to reduce the number of antennas.

[0012] 1 is a first block diagram showing a configuration example of a management device according to the present disclosure; FIG. 1 is an example of a shelf; FIG. 2 is an explanatory diagram showing an example in which an antenna is included in a moving unit having wheels; FIG. 3 is an explanatory diagram showing an example of a moving unit including a rail and an antenna attached to a shelf; FIG. 4 is a flowchart showing an operation example of a management device according to the present disclosure; FIG. 5 is an explanatory diagram showing an example of a connection between a management device and another device; FIG. 6 is an explanatory diagram showing an example of attaching a position tag; FIG. 7 is an explanatory diagram showing an example of attaching a position tag when an antenna is moved in the depth direction of a shelf; FIG. 8 is an explanatory diagram showing an example of installing an imaging device; FIG. 9 is an explanatory diagram showing an example in which an imaging device is included in a moving unit having wheels; FIG. 10 is an explanatory diagram showing an example in which an antenna and an imaging device are included in a moving unit having wheels; FIG. 11 is a second block diagram showing a configuration example of a management device according to the present disclosure; FIG. 12 is an explanatory diagram showing an example of a shelf allocation DB; FIG. 13 is an explanatory diagram showing an example of an antenna DB; FIG. 14 is an explanatory diagram showing an example of a position tag DB; FIG. 15 is an explanatory diagram showing an example of a product DB; FIG. 16 is an explanatory diagram showing an example in which an image of a shelf is displayed together with a notification of foreign object detection; FIG. 17 is an explanatory diagram showing an example of attaching a sensor; FIG. 18 is a flowchart showing an operation example of a management device that controls the movement of an antenna according to the detection result by a sensor. 10 is a flowchart illustrating an example of the operation of a management device that controls an imaging device according to a reading state.

[0013] Hereinafter, with reference to the drawings, embodiments of a management device, a management method, a program, and a non-transitory recording medium for recording a program according to the present disclosure will be described in detail. The disclosed technology is not limited to these embodiments.

[0014] In each embodiment, shelves are used as an example of a device for placing items, but the present invention is not limited to shelves. Furthermore, since products are used as examples of items, the status of items on shelves is referred to as the display status of items, but this may also be referred to as the storage status, placement status, etc. For example, the number of items on display may also be referred to as the number of items stored, the number of items placed, etc. Furthermore, the types of items are not particularly limited and may include food, daily necessities, clothing, various materials, etc. Furthermore, although the shelves are described using store shelves as an example, they may also be shelves in a logistics warehouse, etc.

[0015] 1 is a first block diagram illustrating a configuration example of a management device according to the present disclosure. The management device 10 includes an antenna control unit 101, a reading unit 102, a situation identification unit 103, and an output unit 104.

[0016] The antenna control unit 101 is an example of an antenna control means that controls the movement of an antenna that is independently movable on a rail attached to a shelf.

[0017] 2 shows an example of a shelf. The type of shelf is not particularly limited. For example, the shelf may have multiple levels.

[0018] For example, a rail may be attached to the shelf, allowing the antenna 11 to move laterally on the shelf. For example, if the antenna 11 is movable laterally, the rail may be attached to the shelf step. The number of shelves may be one or more. Therefore, rails may be attached across multiple shelves, allowing the antenna 11 to move.

[0019] For example, the shelf may be provided with a rail that allows the antenna 11 to move in the depth direction of the shelf.For example, the shelf may be provided with a rail that allows the antenna 11 to move in the height direction of the shelf.

[0020] For example, items with RFID tags attached are placed on shelves. Take products as an example of items. There are various methods for attaching RFID tags to products, such as attaching the RFID tag to a product accessory such as a price tag, or attaching the RFID tag to the product itself. Here, an RFID tag attached to a product may be called a product tag.

[0021] The antenna 11 is also connected to an RFID reader 12 via a cable or the like. The management device 10 is connected to the reader 12 via a communication network or the like. When the management device 10 sends a read instruction to the reader 12, the reader 12 can read the product tag via the antenna 11. The reader 12 acquires information stored in the RFID tag using radio waves transmitted from and to the antenna 11, and transmits the information to the management device 10. More specifically, the RFID tag may communicate by reflecting a carrier wave from the antenna 11 controlled by the reader 12. The information stored in the RFID tag is carried on this reflected wave. The management device 10 can then read the information stored in the RFID tag by receiving the information stored in the RFID tag.

[0022] Here, the type of antenna 11 is not particularly limited, but as long as the antenna 11 is movable, an antenna 11 with a narrow reading range can be used. For example, the antenna 11 may be capable of reading product tags of the same type of product. For example, if there are multiple rows on each shelf level, the antenna 11 may be capable of reading product tags of multiple rows in which the same products are displayed. For example, in FIG. 2, multiple rows on each shelf level means that there are multiple rows in the horizontal direction.

[0023] For example, the antenna 11 may be attached to a moving part that can move on a rail, or the antenna 11 may be integrated into a moving part that can move on a rail as the same device.

[0024] Fig. 3 is an explanatory diagram showing an example in which the antenna 11 is included in a moving unit having wheels. The moving unit 13 may have wheels, for example. The number of wheels is not particularly limited, but in Fig. 3, the moving unit 13 has two wheels. The moving unit 13 can move by rotating the wheels. For example, the moving unit 13 may rotate the wheels by controlling a motor.

[0025] In this way, the antenna control unit 101 may control the movement of the antenna 11 by controlling the movement of the moving unit 13 equipped with the antenna 11, which is placed on a rail attached to a shelf.

[0026] 4 is an explanatory diagram showing an example of a moving unit 13 equipped with a rail attached to a shelf and an antenna 11. A rail is attached to the shelf. The moving unit 13 is attached to the rail. The moving unit 13 moves on the rail. The moving unit 13 is equipped with an antenna 11, and the antenna 11 is connected to a reader 12 by a cable.

[0027] For example, if rails are attached to the shelves, the price tags may be attached to the rails so as to hide the moving part 13. Products are displayed on the shelves. Product tags are attached to the products.

[0028] The reading unit 102 is an example of a reading means that uses the antenna 11 to read an RFID tag attached to a product that contains information that can identify the product. The product tag may store a product ID (Identifier). The product tag ID is an example of product tag identification information that identifies the product tag attached to the product. The product tag may also store product information such as the product name and price.

[0029] As a specific reading method, the reading unit 102 reads the information stored in the product tag and transmits a read instruction to the reader 12. Then, the reader 12 reads the information stored in the product tag via the antenna 11.

[0030] The situation identification unit 103 is an example of an identification means that identifies information representing the display situation of products on a shelf based on the position information of the antenna 11 and information read from the product tag. The position information of the antenna 11 may be estimated based on the amount of movement of the antenna 11, or may be identified by reading an RFID tag for identifying the position.

[0031] As an example of identifying information representing a display situation, the situation identification unit 103 may identify the number of products displayed on a shelf. Furthermore, for example, the situation identification unit 103 may detect a shortage in which the number of products displayed falls below a predetermined number. For example, the situation identification unit 103 may detect a situation in which the number of products displayed at the front of a shelf falls below a predetermined number.

[0032] As another example of identifying information representing the display situation, the situation identification unit 103 may identify that products different from the shelf allocation are displayed on the shelf. That is, the situation identification unit 103 may determine whether the products assigned to be displayed at the position indicated by the position information of the moved antenna 11 and its surrounding positions are the same as the products identified by the information read from the product tag. For example, if they are different, the situation identification unit 103 can identify that products different from the shelf allocation are displayed. Furthermore, for example, the situation identification unit 103 may identify product information on the shelf. The product information may be the product name, the product expiration date, etc. Examples of product expiration dates include a use-by date, a best-before date, and a consume-by date.

[0033] As another example of identifying information representing the display situation, the situation identification unit 103 may identify whether the product being searched for is located at the location indicated by the location information of antenna 11 and its surrounding locations based on the location information of antenna 11 and information read from the product tag.

[0034] The output unit 104 is an example of an output means that outputs information representing the display situation. For example, the output unit 104 may output the information representing the display situation when there is a change in the display situation. For example, the output unit 104 may output the information representing the display situation when there is an abnormality in the display situation. Examples of abnormalities in the display situation include when products different from the shelf layout are displayed, when the number of displayed products is below a predetermined number, etc.

[0035] Furthermore, for example, the output unit 104 may output time information indicating the reading time in association with information indicating the display status. The output destination of the output unit 104 is not particularly limited to a storage device such as a database, a terminal device, a display device, an audio output device, a lighting device, etc. The terminal device may have a display device, an audio output device, a lighting device, etc. For example, the output unit 104 may display information indicating the display status on a user's terminal device. The user is not particularly limited to a store clerk, a customer, etc. For example, if the output is a stocking instruction or the like, the user may be a store clerk. For example, if the output is the number of items on display, etc., the user may be a store clerk or a customer.

[0036] 5 is a flowchart showing an example of operation of the management device 10 according to the present disclosure. The antenna control unit 101 controls the movement of the antenna 11 on the rail (step S101). The reading unit 102 reads the product tag (step S102). For example, the situation identification unit 103 identifies information representing the display situation of the products on the shelf (step S103). The output unit 104 outputs the information representing the display situation (step S104).

[0037] As described above, rails along which the antennas 11 can move are attached to the shelves, and the management device 10 moves the antennas 11 to read RFID tags attached to items placed on the shelves. The management device 10 then manages the display status of the shelves. This allows the number of antennas 11 to be reduced.

[0038] Furthermore, for example, when multiple antennas are moved simultaneously and reading is performed from each of the multiple antennas, the reader switches between reading from the multiple antennas, which may result in a decrease in reading accuracy. For this reason, if the antenna 11 can be moved independently, the decrease in reading accuracy can be suppressed. However, a configuration in which multiple antennas 11 can be moved simultaneously may also be used.

[0039] (Second embodiment) Next, a second embodiment will be described in detail with reference to the drawings. In the second embodiment, an example of identifying the position of an antenna, an example of the timing of moving the antenna, and an example of combining the antenna with other devices will be described. Below, to the extent that the description of the second embodiment is not unclear, descriptions of content that overlaps with the above description will be omitted.

[0040] 6 is an explanatory diagram showing an example of a connection between a management device and other devices. Here, the management device 20 may be an edge terminal device installed in a store, or may be a server.

[0041] For example, the management device 20 is connected to an RFID reader 22 via a communication network. The reader 22 is connected to one or more antennas 21. The reader 22 may be installed as appropriate depending on the size of the store and the performance of the reader 22. The reader 22 may be a dedicated reader or a reader / writer. The antenna 21 and the reader 22 are connected using a cable. FIG. 6 shows multiple antennas 21-1 to 21-n. For example, n is an integer of 2 or greater. As in the example described in the first embodiment, the antenna 21 may be provided in, for example, the mobile unit 23. Therefore, FIG. 6 shows multiple mobile units 23-1 to 23-n.

[0042] For example, the management device 20 is connected to the imaging device 24 via a communication network. For example, the management device 20 may be able to control the imaging device 24.

[0043] Furthermore, the imaging device 24 may be installed on, for example, the ceiling of a store. For example, the imaging device 24 may be installed in a position where it can image the shelf. For example, the imaging device 24 may be installed in a position where it can image the shelf from the front. The position, orientation, angle of view, etc. of the imaging device 24 may be controlled by the management device 20, so that it can image the shelf. Furthermore, for example, the imaging device 24 may be movable by control of the management device 20. For example, the imaging device 24 may be movable on rails attached to the opposite shelf. This allows the imaging device 24 to image the front of the shelf that is visible from the opposite shelf. For example, the imaging device 24 may be movable on rails attached to the ceiling.

[0044] Furthermore, the imaging device 24 may be installed in a position where it can capture an image of a person standing in front of the shelf. The position, orientation, angle of view, etc. of the imaging device 24 may be controlled by the management device 20, so that it can capture an image of a person standing in front of the shelf. Furthermore, for example, the imaging device 24 may be movable by the control of the management device 20.

[0045] Here, the imaging device 24 capable of capturing an image of the shelf and the imaging device 24 capable of capturing an image of a person standing in front of the shelf may be the same imaging device or different imaging devices. Therefore, a plurality of imaging devices 24 may be installed in a store.

[0046] Furthermore, for example, the management device 20 is connected to a terminal device 25 via a communication network. The terminal device 25 is an example of a destination of a notification from the management device 20, and the device that is the destination of the notification is not particularly limited. For example, the terminal device 25 may be a user's terminal device 25 or a terminal device 25 fixedly installed in a store, and is not particularly limited.

[0047] FIG. 7 is an explanatory diagram showing an example of attaching a position tag. In FIG. 7, each of the antennas 21 is movable laterally across three shelves. Here, RFID tags may be attached to the shelves to identify the position information of the antennas 21. RFID tags attached to shelves are also called position tags. For example, the position tags may be attached in a position where they can be easily read by the antennas 21. For example, the position tags may be attached near the rails. For example, proximity tags may be used as the position tags. In FIG. 7, multiple position tags may be attached. The number of position tags is not particularly limited, and may be provided for each row of shelf levels, or may be such that the display position of the products can be identified.

[0048] 8 is an explanatory diagram showing an example of attaching a position tag when the shelf is moved in the depth direction. For example, the position tag may be attached above the product. Then, rails may be attached above the product on the shelf, and the antenna 21 may be movable on the rails and be able to read the tag in the depth direction. This makes it possible to reduce the number of antennas 21.

[0049] Here, for example, the position tag may store a position tag ID for identifying the position tag, or may store position information representing a shelf and a position on the shelf.

[0050] 9 is an explanatory diagram showing an example of installation of the imaging device 24. For example, the imaging device 24 may be movable on a rail attached near the ceiling. For example, the imaging device 24 may be able to capture images of at least a portion of a plurality of shelves by moving on the rail. In FIG. 9, the imaging device 24 captures an image of, for example, the second shelf from the top of the leftmost shelf, as indicated by the dotted line.

[0051] 10 is an explanatory diagram showing an example in which the imaging device 24 is included in a moving unit having wheels. The function of the moving unit 26 may be the same as that of the moving unit 13 shown in FIG. 3, and the moving unit 26 has the imaging device 24. For example, to capture an image of a first shelf of two facing shelves, a rail may be attached to a second shelf of the two shelves, and the moving unit 26 may move on the rail attached to the second shelf, allowing the imaging device 24 to capture an image of a predetermined range of the first shelf. The first shelf is one of the two facing shelves, and the second shelf is the shelf of the two shelves that faces the first shelf.

[0052] Fig. 11 is an explanatory diagram showing an example in which the antenna 21 and the imaging device 24 are included in a moving unit 23 having wheels. In Fig. 11, if rails are attached to each of a plurality of shelves, the moving unit 23 may include the antenna 21 and the imaging device 24. The moving unit 23 moves on the rails attached to the shelves, the antenna 21 can read product tags on the shelves, and the imaging device 24 can capture images of the shelves it faces.

[0053] 12 is a second block diagram showing a configuration example of the management device 20 according to the present disclosure. In FIG. 12, the management device 20 includes an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, a reception unit 205, a position identification unit 206, an imaging device control unit 207, a person detection unit 208, an item detection unit 209, and a determination unit 210.

[0054] The antenna control unit 201 may have, as a basic function, the function of the antenna control unit 101 shown in Fig. 1. The reading unit 202 may have, as a basic function, the function of the reading unit 102 shown in Fig. 1. The situation identification unit 203 may have, as a basic function, the function of the situation identification unit 103 shown in Fig. 1. The output unit 204 may have, as a basic function, the function of the output unit 104 shown in Fig. 1.

[0055] The management device 20 may also include a shelf allocation DB (DataBase) 2001 , an antenna DB 2002 , a position tag DB 2003 , and a product DB 2004 .

[0056] FIG. 13 is an explanatory diagram showing an example of the shelf allocation DB 2001. The shelf allocation DB 2001 stores shelf allocation information related to the display of products on shelves. Specifically, for example, the shelf allocation DB 2001 stores display position information indicating the position of a shelf and a product ID that identifies the product, in association with each other. The product ID is an example of product identification information that identifies the product. According to FIG. 13, a product with a product ID of product P01 is displayed on the first level of shelf s1.

[0057] Here, for ease of explanation, an example has been given in which the same products are displayed on different levels, but the same products may also be displayed on different shelves, or on different rows of shelves, and there are no particular limitations on the specific examples of shelf layout.

[0058] FIG. 14 is an explanatory diagram showing an example of the antenna DB 2002. The antenna DB 2002 stores information indicating the position of each antenna 21. Specifically, for example, the antenna DB 2002 stores an antenna ID in association with movement range information indicating the range within which the antenna 21 identified by the antenna ID can move. For example, the antenna ID is an example of antenna identification information for identifying the antenna 21, and may be an antenna number, etc. The movement range information may be information indicating a shelf and a shelf level, etc. In FIG. 14 , the movement range is a range within which products on the first levels of shelves s1 and s2 can be read.

[0059] Furthermore, the antenna DB 2002 may further include initial position information that indicates the initial position of the antenna 21. For example, the position of the antenna 21 may be identified based on the amount of movement of the antenna 21 with respect to the initial position.

[0060] 15 is an explanatory diagram showing an example of the position tag DB 2003. The position tag DB 2003 contains information relating to the attachment position of each position tag. Specifically, for example, the position tag DB 2003 stores a position tag ID in association with information on the position where the position tag is attached. The position tag ID is an example of position tag identification information that identifies a position tag. The position tag ID may be, for example, the serial number of the RFID tag, and is not particularly limited.

[0061] For example, the position tag stores a position tag ID that identifies the position tag. The management device 20 can read the position tag ID from the position tag via the antenna 21, and thereby identify the position of the antenna 21 based on the position information associated with the position tag ID.

[0062] According to FIG. 15, the position tag identified by the position tag T01 is attached to the first stage of the shelf s1, near the first and second rows.

[0063] FIG. 16 is an explanatory diagram showing an example of the product DB 2004. The product DB 2004 stores information about products. Product tags are attached to individual products. Therefore, the product DB 2004 stores product information such as product IDs and product names for each product tag. Specifically, for example, the product DB 2004 stores product tag IDs in association with product information such as product IDs and product names. The product tag ID is an example of product tag identification information that identifies the product tag attached to the product. The product ID is an example of product identification information that identifies the product. The product name is the name of the product.

[0064] 16, a tag with a product tag ID of tag PT01 is attached to a product with a product ID of product P01. The product name of the product with the product ID of product P01 is xx Cookie.

[0065] In addition, the product DB 2004 may include other product information such as tag information identified by a product tag ID, the price of a product identified by a product ID, the type of product, the expiration date of the product, and the manufacturer of the product.

[0066] Here, the product tag may be a tag appropriate for the material of the product. For example, an RFID tag may communicate by reflecting a carrier wave from an antenna 21 controlled by an RFID reader 22. Information stored in the RFID tag is carried on this reflected wave. Metal and liquid obstruct the carrier wave, causing the radio waves to be reflected by such obstructions. As a result, the reflected wave from the RFID tag interferes with the reflected wave from the obstruction, making it difficult or easy for the antenna 21 to read the reflected wave from the RFID tag. In this way, obstructions may result in abnormal reading. Therefore, for example, tags with a general frequency adjustment may be used for products that do not pose obstructions. Metal tags may be used for products that contain metal as part of their material, such as canned beverages and canned goods. For example, metal tags are tags that are adjusted to have a general frequency when attached to metal. Water tags may be used for products that contain liquid as part of their material, such as plastic bottles and paper cartons. For example, a water tag is a tag whose frequency characteristics are adjusted so that RFID tags can transmit and receive signals when they come into close proximity with a liquid such as water. In order to attach product tags to products, shelf allocation may be performed taking into account the material of the products, etc.

[0067] Next, each functional unit will be described in detail.

[0068] The antenna control unit 201 controls the movement of the antenna 21, which is movable on rails attached to a shelf. The movement method is as described in embodiment 1. The timing at which the antenna control unit 201 moves the position of the antenna 21 is not particularly limited.

[0069] Furthermore, the reading unit 202 reads the product tag using the antenna 21. For example, the reading unit 202 may read the RFID tag while the antenna control unit 201 moves the position of the antenna 21. The reading unit 202 may read continuously or singly. Therefore, the order of the processing by the antenna control unit 201 and the processing by the reading unit 202 is not particularly limited.

[0070] As described above, if a position tag is located near or attached to the rail, the reading unit 202 also reads the position tag. Specifically, the reading unit 202 transmits an RFID tag read instruction to the reader 22, which then reads RFID tags, such as product tags and / or position tags, within the reading range of the antenna 21 via the antenna 21. The situation identification unit 203 then identifies the display situation of products on the shelf based on the information read from the position tag and the information read from the product tag. Here, an example in which the position of the antenna 21 is identified by the position tag will be described. First, a case will be described in which, for example, a position tag ID is stored as information capable of identifying the position on the shelf stored in the position tag. When the position tag stores a position tag ID, the position identification unit 206 is an example of a position identification means that identifies the position information of the antenna based on the information read from the position tag. For example, if the position tag stores a position tag ID, the position identification unit 206 acquires position information associated with the read position tag ID from the position tag DB 2003. For example, the position identification unit 206 may identify the acquired position information as position information indicating the position of the antenna 21. Here, if multiple position tag IDs are read, the position tag ID read from the position tag with the strongest signal strength may be used.

[0071] When the position tag stores the position information itself indicating the position where the position tag is attached as information that can identify the position on the shelf, the position information of the antenna can be the position information of the position tag, and therefore there is no need for the position identification unit 206 to perform processing to acquire the position information from the position tag DB 2003. Note that when multiple pieces of position information are read, the position information read from the position tag with the strongest signal strength can be used as the position information of the antenna.

[0072] Next, an example will be described in which the position of the antenna 21 is identified based on the amount of movement of the antenna 21. The position identification unit 206 is an example of a position identification means that identifies antenna position information from control information for the movement of the antenna 21 by the antenna control unit 201. More specifically, the position identification unit 206 identifies the amount of movement of the antenna 21 in each direction from the control information for the movement of the antenna 21 by the antenna control unit 201. For example, the position identification unit 206 may identify position information that represents the current position of the antenna 21 based on position information that represents the initial position stored in the antenna DB 2002 and the identified amount of movement. The antenna DB 2002 may further store position information before movement, and the position identification unit 206 may identify position information after movement based on the position information before movement and the new amount of movement.

[0073] For example, when the user moves the antenna 21 to a desired position, and the position of the antenna 21 is specified by a position tag, the reading unit 202 reads the tag while moving the antenna using the antenna control unit 201. On the other hand, when the position of the antenna 21 is specified by the amount of movement of the antenna 21, the reading unit 202 may read the tag after moving the antenna to the desired position, or may read the tag while moving the antenna.

[0074] Next, the situation identification unit 203 will be described. As described in the first embodiment, the situation identification unit 203 identifies information representing the display status of products on a shelf based on the position information of the antenna 21 and information read from the product tag. Specifically, for example, the situation identification unit 203 identifies information representing the display status of products at the position on the shelf indicated by the position information of the antenna 21 based on the position information of the antenna 21 and information read from the product tag. Note that the position of the antenna 21 also includes positions near the antenna 21. If the product tag stores a product tag ID, the situation identification unit 203 acquires at least one of the product ID and product information associated with the product tag ID from the product DB 2004. This allows the situation identification unit 203 to identify products displayed at the position of the antenna 21.

[0075] The output unit 204 then outputs information representing the display status. The output destination and output method of the output unit 204 are as described in the first embodiment.

[0076] Next, the processing of the situation identification unit 203 and the output unit 204 will be described in more detail using the display situation as an example. As described in the first embodiment, the display situation may be the number of products on display, whether there are any out-of-stock items, whether there are products displayed in a way that differs from the shelf layout, or the display position of the product to be searched. In more detail, the display situation may be whether products are displayed at the back of the shelf and not at the front. In more detail, the display situation may be the expiration date of the products on display.

[0077] First, an example in which the number of displayed items is determined will be described. For example, the situation determination unit 203 may determine the number of displayed items based on the number of product tags that store product tag IDs associated with the same product ID in the product DB 2004. The output unit 204 may then output position information indicating the position of the antenna 21 in association with the number of displayed items. For example, the output unit 204 may superimpose the number of displayed items around the position of the antenna 21 on the shelf image. The shelf image may be an image prepared in advance, or may be a newly captured image as described below. Furthermore, the output unit 204 may output a product stocking instruction when the number of displayed items is equal to or less than a predetermined number. The output unit 204 may output the stocking instruction together with product information such as the product name.

[0078] Next, an example in which it is determined that a product different from the shelf allocation is displayed will be described. For example, the situation identification unit 203 may acquire, from the shelf allocation DB 2001, a product ID associated with location information indicating a location that is the same as or close to the location of the antenna 21. A location close to the location of the antenna 21 may be a location within a predetermined range from the location indicated by the location information of the antenna 21. The situation identification unit 203 may compare a product ID identified from the read product tag with a product ID in the shelf allocation. As a result, if the product ID identified from the read product tag does not match the product ID in the shelf allocation, the situation identification unit 203 can determine that a product different from the shelf allocation is displayed. If the product ID identified from the read product tag does not match the product ID in the shelf allocation, the output unit 204 may notify that a product different from the shelf allocation is displayed. That is, the output unit 204 may output a notification of foreign object detection.

[0079] Next, an example in which a product display is identified in a product search instruction will be described. In the case of a product search, the antenna control unit 201 moves the antenna 21, while the reading unit 202 performs reading via the antenna 21. Then, the situation identification unit 203 may identify whether the search target product is located at the position indicated by the position information of the antenna 11 and a surrounding position, based on the position information of the antenna 11 and information read from the product tag. Note that a method for receiving a product search instruction by the receiving unit 205 will be described later. A product tag ID or a product ID may be specified as the search target. More specifically, as a series of processes for product search, the product tag stores the product tag ID, and when the product tag ID is specified by the user as the product to be searched for, the situation identification unit 203 determines whether the read product tag ID matches the product tag ID of the product to be searched for. Then, when the product for which the search command was issued is found, i.e., when the read product tag ID matches the product tag ID of the product being searched for, the output unit 204 outputs the location information at the time the product tag ID was read.

[0080] The imaging device control unit 207 is an example of an imaging device control means that controls the imaging device 24, which can capture images of the movement range of the antenna 21 on the shelf. For example, the imaging device control unit 207 may control at least one of the orientation, position, and angle of view of the imaging device 24 in accordance with the reading of product information by the antenna 21, to cause the imaging device 24 to capture an image of the shelf. For example, when the situation identification unit 203 identifies the display situation, the imaging device control unit 207 may use the imaging device 24 to capture an image of the shelf. Alternatively, for example, if there is an abnormality in the reading of product tags by the antenna 21, the imaging device control unit 207 may use the imaging device 24 to capture an image of the shelf. An abnormality in the reading of product tags by the antenna 21 may be, for example, an abnormality in the display situation, as described above.

[0081] Furthermore, the imaging device control unit 207 may move the imaging device 24 to a position where it can capture an image of a product, based on the expiration date of the product identified by the information capable of identifying the product read from the product tag by the antenna 21, and use the imaging device 24 to capture an image of the shelf that includes the product. As an example of capturing an image based on a product's expiration date, the imaging device control unit 207 may capture an image of the shelf when there is a product whose expiration date is approaching. An approaching expiration date for a product refers to when the difference between the current date and time and the product's expiration date is within a predetermined number of days or a predetermined time. For example, if the expiration date is within a few days or the day of the product's expiration date, the imaging device control unit 207 may use the imaging device 24 to capture an image of the shelf that includes the product. This allows the output unit 204 to notify the store clerk of shelf images along with instructions for stocking, moving forward, discounts, price reductions, and expiration date confirmation. This makes it easier for store staff to check the display status.

[0082] In addition, the following description will be given taking as an example a case where the imaging device 24 is movable on a rail attached to a shelf. Even in the case where the imaging device 24 is movable on a rail, the imaging device control unit 207 may control at least one of the orientation, position, and angle of view of the imaging device 24.

[0083] For example, in response to reading information from a product tag by the antenna 21, the imaging device control unit 207 moves the imaging device 24 to a position where it can capture an image of a product identified by the read information. Then, the imaging device control unit 207 may use the imaging device 24 to capture an image that includes the product.

[0084] Furthermore, for example, if there is an abnormality in reading information from a product tag by antenna 21, imaging device control unit 207 moves imaging device 24 to a position where it can capture an image of the display situation at the display position where the abnormality was detected. Then, imaging device control unit 207 captures an image of the display situation at the display position on the shelf where the abnormality was detected using imaging device 24. Capturing an image of the display situation at the display position on the shelf where the abnormality was detected means capturing an image of the shelf so as to include the display position where the abnormality was detected.

[0085] The imaging device control unit 207 moves the imaging device 24 to a position where it can capture an image of the product, in accordance with the expiration date of the product specified by the information capable of identifying the product read by the antenna 21. Then, the imaging device control unit 207 uses the imaging device 24 to capture an image that includes the product.

[0086] The output unit 204 may output the captured image in association with information indicating the display status. For example, the output unit 204 may output a notification according to the display status together with the captured image.

[0087] 17 is an explanatory diagram showing an example in which an image of a shelf is displayed together with a notification of foreign object detection. For example, the output unit 204 displays the notification of foreign object detection on the terminal device 25. The screen includes the notification of foreign object detection and an image of the shelf. This allows the user to visually check the display status of the shelf.

[0088] <Timing of Movement of Antenna 21 and Reading> The antenna control unit 201 and the reading unit 202 may perform each process in response to a user instruction. For example, the antenna control unit 201 may move the antenna 21 in response to a user instruction. Specifically, for example, the receiving unit 205 is an example of a receiving unit that receives a user instruction. For example, the receiving unit 205 receives a reading instruction via the terminal device 25 operated by the user. Then, upon receiving the user instruction, the antenna control unit 201 moves the antenna 21. Also, for example, the reading unit 202 may output an RFID tag reading instruction to the reader 22 in response to the user instruction. If the user instruction is an instruction to search for a product, the user instruction may include a product ID that identifies the product to be searched for. Furthermore, if the user instruction is an instruction to search for an individual product, the user instruction may include a product tag ID that identifies the product tag attached to the product to be searched for or a product ID that identifies the product. In the case of an instruction to search for a product, the antenna control unit 201 may stop the movement of the antenna or may return it to its initial position when the product is found.

[0089] Furthermore, the antenna control unit 201 may, depending on the results of sales analysis, control the movement of the antenna 21. For example, when a predetermined number or more of the same product are purchased, the antenna control unit 201 may move the antenna 21 to a position that includes the position where the product is displayed within its reading range.

[0090] The antenna control unit 201 may also move the antenna 21 in accordance with the detection result of the sensor. For example, the determination unit 210 is an example of a determination means that determines whether the detection result of the sensor attached to the shelf satisfies a predetermined condition. The sensor may be at least one of a weight sensor, a vibration sensor, a sound detection sensor, a human presence sensor, and an imaging device 24. The type of human presence sensor is not particularly limited, and may include infrared, ultrasonic, visible light, etc. Note that sensors may be used in combination. For example, the determination unit 210 acquires the detection result from the sensor. Then, the determination unit 210 determines whether the detection result satisfies a predetermined condition. Then, the antenna control unit 201 may control the movement of the antenna 21 when the detection result of the sensor attached to the shelf satisfies the predetermined condition.

[0091] FIG. 18 is an explanatory diagram showing an example of sensor installation. In FIG. 18, multiple sensors 30-11 to 30-13, 30-21 to 30-23, and 30-31 to 30-33 are shown. Here, they are simply referred to as sensors 30. For example, the sensors 30 are not particularly limited as long as they are installed so as to be able to detect changes in the display status of products. For example, as shown in FIG. 18, the sensors 30 may be installed on each row of shelves on which products are displayed, or on each shelf level, and are not particularly limited. Furthermore, depending on the type of sensor 30, the sensor 30 may be installed above the products. For example, if the sensor 30 is a human presence sensor, the human presence sensor may be installed above the products and detect when a hand enters the product display area.

[0092] Taking FIG. 18 as an example, the antenna control unit 201 may move the antenna 21 to a position whose reading range includes at least a portion of the row of shelves to which the sensor 30 whose detection result satisfies a predetermined condition is attached. This position is, for example, a position where a position tag located at or near the position of the antenna 21 can be read. For example, the antenna control unit 201 may move the antenna 21 while the reading unit 202 reads the position tag. Then, the antenna control unit 201 may stop moving the antenna 21 if the position identified by the position tag is at or near the position of the antenna 21. Alternatively, for example, the antenna control unit 201 may calculate the distance required to move the antenna 21 from its current position to the position where the sensor 30 is attached. Then, the antenna control unit 201 may move the antenna 21 based on this distance.

[0093] For example, if the sensor 30 is a weight sensor, the detection result is the result of a change in weight detected by the weight sensor. For example, the predetermined condition may be that a change in weight has been detected. A change in weight can be an increase in weight or a decrease in weight. For example, the predetermined condition may be that an increase in weight has been detected. Examples of cases in which weight increases include when a store clerk puts a new product on the shelves, when a customer returns a product that they had previously acquired, or when a customer places a product that differs from the shelf allocation. For example, the predetermined condition may be that a decrease in weight has been detected. Examples of cases in which weight decreases include when a customer acquires a product.

[0094] Furthermore, for example, the predetermined condition may be a weight change in a unit of weight different from the weight of the product assigned to the position where the weight sensor is attached. If the weight change satisfies this condition, it is highly likely that a product different from the shelf allocation has been placed. For example, if the weight of the product assigned to the position where the weight sensor is attached is 300 grams, but the weight change is an increase of 500 grams, it is highly likely that a product other than the product assigned to the position where the weight sensor is attached has been placed. More specifically, for example, the predetermined condition may be a detection of a weight increase in a unit of weight different from the weight of the product assigned to the position where the weight sensor is attached. Both detection by the weight sensor and reading by the antenna 21 make it possible to determine whether a product different from the shelf allocation has been placed. Therefore, the management device 20 can detect foreign objects with greater accuracy. Furthermore, the predetermined condition may be a detection of a predetermined weight change by the weight sensor a predetermined number of times or more. The predetermined number of times may be determined based on the number of products that can be displayed.

[0095] If the sensor 30 is a vibration sensor, the detection result is the result of vibration detection by the vibration sensor. For example, the predetermined condition may be that vibration occurs at the position where the vibration sensor is attached. For example, the predetermined condition may be that the vibration occurring at the position where the vibration sensor is attached is within a predetermined range. The predetermined range may be a range of vibration that may occur when placing a product to be displayed in the planogram or a range of vibration that may occur when a product to be displayed in the planogram is acquired. Furthermore, the predetermined condition may be that a specific vibration is detected by the vibration sensor a predetermined number of times or more. The predetermined number may be determined based on the number of products that can be displayed.

[0096] For example, the vibrations generated when a product is placed on a shelf vary depending on the product's weight and shape. If the vibrations differ from those generated when arranging or acquiring products displayed in the planogram, it is possible that a product other than the products displayed in the planogram has been displayed. For example, the predetermined condition may be that the vibrations exceed a predetermined range. By using both detection by the weight sensor and reading by the antenna 21, it becomes possible to determine whether a product different from the planogram has been placed. Therefore, the management device 20 can detect foreign objects with greater accuracy.

[0097] If the sensor 30 is a sound detection sensor, the detection result is the result of sound detection by the sound detection sensor. For example, the predetermined condition may be that a specific sound is detected at the location where the sound detection sensor is attached. More specifically, for example, the predetermined condition may be that the sound generated at the location where the sound detection sensor is attached is within a predetermined range. The predetermined range may be a range of sounds that may be generated when placing products to be displayed in the planogram or a range of sounds that may be generated when products to be displayed in the planogram are acquired. The predetermined range may be the sound of a door closing or opening on a shelf with a door. In other words, the predetermined condition may be that a sound that is inferred to indicate a change in the display situation is generated. Alternatively, the predetermined condition may be that a specific sound is detected by the sound detection sensor a predetermined number of times or more. The predetermined number may be determined based on the number of products that can be displayed.

[0098] If the sensor 30 is a human presence sensor, the detection result is the result of the human presence sensor detecting a person. For example, the predetermined condition may be that a person is detected in an area detectable by the human presence sensor. For example, when a person takes a product from a shelf or places a product on a shelf, the person puts their hand into the product display area. Therefore, if the area detectable by the human presence sensor is the product display area, the human presence sensor detects the person's hand when the person puts their hand into the display area. This allows the antenna to be moved when there is a high possibility that the display status of the shelf has changed. Alternatively, the predetermined condition may be that a hand is detected in the area detectable by the human presence sensor a predetermined number of times or more. The predetermined number may be determined based on the number of products that can be displayed.

[0099] Furthermore, the output unit 204 may output the detection result by the sensor 30 in association with information indicating the display status.

[0100] The antenna control unit 201 may also control the movement of the antenna 21 in accordance with an image captured by the imaging device 24 .

[0101] The person detection unit 208 is an example of a person detection means that detects the behavior of a person from an image captured by the imaging device 24 that can capture an image of a person in front of a shelf. The behavior of a person may be, for example, a person picking up a product from a shelf, a person reaching out to a shelf, or a person placing a product on a shelf, and is not particularly limited. Examples of people include customers and store clerks.

[0102] Then, in accordance with the person's behavior, the antenna control unit 201 moves the antenna 21 to a position whose reading range includes the vicinity of the position where the person was detected. For example, the vicinity of the position where the person was detected may be the shelf level in front of the person where the person was detected. Also, for example, the position where the person was detected may be the shelf level where the person reached out, and the vicinity of the position where the person was detected may be the shelf level where the person reached out. Specifically, for example, the antenna control unit 201 moves the antenna 21 to a position where it can read the product tag of a product displayed at the position on the shelf where the person reached out.

[0103] For example, the person detection unit 208 may detect that a person has picked up a product from a shelf from an image captured by the imaging device 24. When the antenna control unit 201 detects that a person has picked up a product from a shelf, it moves the antenna 21 to a position where it can read an RFID tag located at the position where the product is displayed on the shelf. For example, the antenna control unit 201 moves the antenna 21 to a position where it can read a position tag located at the position where the product is displayed or in the vicinity of that position. Also, for example, the antenna control unit 201 may move the antenna 21 while the reading unit 202 reads the position tag. Then, when the position specified by the position tag is the position where the product is displayed or in the vicinity of that position, the antenna control unit 201 may stop moving the antenna 21.

[0104] Furthermore, for example, the person detection unit 208 may detect that a person has placed a product on a shelf based on an image captured by the imaging device 24. Then, when the antenna control unit 201 detects that a person has placed a product from the shelf, it moves the antenna 21 to a position where it can read an RFID tag located at the position on the shelf where the product is displayed.

[0105] The item detection unit 209 is an example of a detection means for detecting an item included in an image captured by the imaging device 24 capable of capturing an image of the shelf within the movement range of the antenna 21. The antenna control unit 201 moves the antenna 21 to a position whose reading range includes the position where the item included in the image is placed. If the antenna control unit 201 does not detect an item from the image, it moves the antenna 21 to a position whose reading range includes the position where the item included in the image is placed.

[0106] 19 is a flowchart showing an example of the operation of the management device 20 controlling the movement of the antenna 21 in accordance with the detection results of the sensor 30. The antenna control unit 201 controls the movement of the antenna 21 on a rail attached to a shelf (step S201). The reading unit 202 reads the product tag and the position tag (step S202). Note that steps S201 and S202 may be performed simultaneously. That is, the management device 20 may read the product tag and the position tag while moving the antenna 21.

[0107] The situation identification unit 203 identifies the display situation of the products on the shelf (step S203). Then, the situation identification unit 203 may determine whether there is an abnormality in the display situation (step S204). If there is no abnormality in the display situation (step S204: No), the management device 20 may end the processing. If there is an abnormality in the display situation (step S204: Yes), the imaging device control unit 207 controls the imaging device 24 to capture an image that includes the abnormal shelf portion (step S205). In step S205, the imaging device control unit 207 may control at least one of the orientation, position, and angle of view of the imaging device 24 to capture an image that includes the abnormal shelf portion. Furthermore, in step S205, the imaging device control unit 207 may move the imaging device 24 to capture an image that includes the abnormal shelf portion.

[0108] The output unit 204 outputs the information indicating the display status in association with the image (step S206).Then, the management device 20 ends the series of processes.

[0109] 20 is a flowchart showing an example of the operation of the management device 20 that controls the imaging device 24 according to the reading state. The determination unit 210 may determine whether the detection result of the sensor 30 attached to the shelf satisfies a predetermined condition (step S211). If the detection result of the sensor 30 attached to the shelf does not satisfy the predetermined condition (step S211: No), the determination unit 210 returns to step S211.

[0110] On the other hand, if the detection result of the sensor 30 attached to the shelf satisfies the predetermined condition (step S211: Yes), the antenna control unit 201 moves the antenna 21 to a position whose reading range includes the display position corresponding to the sensor 30 whose detection result satisfies the predetermined condition (step S212). The reading unit 202 reads the product tag and the position tag (step S213). Note that steps S212 and S213 may be performed simultaneously. That is, the management device 20 may read the product tag and the position tag while moving the antenna 21. As a result, when the position of the antenna 21 is identified using the position tag, the antenna 21 can be moved to a position whose reading range includes the display position corresponding to the sensor 30 whose detection result satisfies the predetermined condition.

[0111] The status identification unit 203 then identifies the display status (step S214). The output unit 204 associates information indicating the display status with the detection result of the sensor 30 and outputs the information (step S215). The management device 20 then ends the series of processes.

[0112] As described above, in the second embodiment, position tags containing information that can identify a position on the shelf are attached to each position on the shelf near the rail. The management device 20 further reads the position tags and identifies the display status of products on the shelf based on the information that can identify the read position and the information that can identify the read item. This makes it possible to accurately identify the position of the antenna 21 using the position tags. Furthermore, the antenna 21 may be movable in at least one of the horizontal, vertical, and depth directions on the shelf. Therefore, it is sufficient that rails along which the antenna 21 can move are attached to the shelf, etc. This makes it possible to reduce the number of antennas 21.

[0113] Furthermore, management device 20 identifies the position information of antenna 21 from the control information for the movement of antenna 21. Then, management device 20 identifies the display status of products on the shelf based on the identified position information of antenna 21 and the product information read from the product tag. This allows the position of antenna 21 to be identified with high accuracy using the control information of antenna 21.

[0114] Furthermore, in response to reading of information capable of identifying an item by the antenna 21, the management device 20 controls at least one of the orientation, position, and angle of view of the imaging device 24, which is capable of capturing images of the movement range of the antenna 21 on the shelf, to cause the imaging device 24 to capture an image of the shelf. In this way, the status of items on the shelf can be managed by combining the RFID tag and the imaging device 24.

[0115] Furthermore, the imaging device 24 may be movable on rails attached to the shelves, and the management device 20 may control the movement of the imaging device 24 to a position where it can capture an image of the item in accordance with the reading of information that can identify the item by the antenna 21. This makes it possible to reduce the number of imaging devices 24, and ultimately to reduce the cost of installing the imaging devices 24.

[0116] The imaging device 24 may be placed on the rail on which the antenna 21 is placed. In this way, by sharing the rail for the imaging device 24 and the antenna 21, the cost of installing the rail can be reduced.

[0117] Furthermore, if there is an abnormality in the reading of the information that can identify an item by the antenna 21, the management device 20 moves the imaging device 24 to a position where it can capture an image of the display status at the position where the abnormality was detected. Furthermore, the management device 20 moves the imaging device 24 to a position where it can capture an image of the item according to the expiration date of the item specified by the information that can identify the item by the antenna 21, and captures an image of the shelf so that the item is included. The management device 20 then notifies the user of the captured image along with information indicating the display status, making it easier for the user to check the display status. In this way, the management device can capture images only when it is necessary to notify the user.

[0118] Furthermore, the management device 20 controls the movement of the antenna 21 when the detection result of the sensor 30 attached to the shelf satisfies a predetermined condition. For example, the sensor 30 is at least one of a weight sensor, a vibration sensor, and a sound detection sensor. This allows the antenna 21 to be moved when a change in the display situation is detected. Therefore, it is possible to avoid moving the antenna 21. For example, if the sensor 30 is a weight sensor, the predetermined condition may be a weight change in a unit of weight different from the weight of the product assigned to the position where the weight sensor is attached. This allows the antenna 21 to be moved when it is predicted that a foreign object has been placed on the shelf. Therefore, it is possible to more accurately identify abnormalities in the display situation.

[0119] Furthermore, the management device 20 detects the behavior of a person from images captured by an imaging device 24 capable of capturing images of the movement range of the antenna 21 on the shelf. Then, the management device 20 moves the antenna 21 to the vicinity of the position where the person was detected in accordance with the person's behavior. This allows the antenna to be moved when a change in the display situation is likely to have occurred due to a person such as a customer or a store clerk.

[0120] Specifically, for example, the management device 20 detects that a person has taken a product from a shelf from an image captured by the imaging device 24. When the management device 20 detects that a person has taken a product from a shelf, it moves the antenna 21 to a position whose reading range includes the position on the shelf where the product is displayed. This allows the antenna to be moved when there is a high possibility that the number of products on display has been reduced by a person such as a customer or a store clerk.

[0121] Furthermore, for example, the management device 20 detects that a person has placed a product on a shelf based on an image captured by the imaging device 24. When the management device 20 detects that a person has placed a product from the shelf, it moves the antenna 21 to a position whose reading range includes the position on the shelf where the product is displayed. This allows the antenna to be moved when there is a high possibility that the number of products on display has increased due to a person such as a customer or a store clerk.

[0122] Furthermore, the management device 20 detects a product included in an image captured by the imaging device 24 that is capable of capturing an image of the movement range of the antenna 21 on the shelf. Then, the antenna control unit 201 of the management device 20 moves the antenna 21 to a position that includes within its reading range the position where the product included in the image is placed.

[0123] The above is the description of each embodiment. Each embodiment may be modified. Modifications will be described below.

[0124] <Modifications> In the above example, the moving unit 23 and the moving unit 26 have wheels and move by rotating the wheels. For example, the moving unit 23 and the moving unit 26 may have a structure similar to that of a general camera slider. More specifically, for example, the moving unit 23 and the moving unit 26 may have a structure similar to that of a slider with bearings or a plastic camera slider.

[0125] This concludes the description of the modified examples. Furthermore, the embodiments and modified examples may be combined. Furthermore, the management devices 10 and 20 may each include some of the functional units and information. For example, the management device 20 may include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and a reception unit 205. For example, the management device 20 may include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and a person detection unit 208. For example, the management device 20 may include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and an object detection unit 209. For example, the management device 20 may include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and an image capture device control unit 207. In this way, there is no particular limitation on the functional units included in the management device 20. Furthermore, the management device 20 may also include other functional units not shown.

[0126] Furthermore, each embodiment is not limited to the above-described examples and can be modified in various ways. Furthermore, the configuration of the management devices 10 and 20 is not particularly limited. For example, the functional units of the management devices 10 and 20 may be implemented by a single device. Alternatively, for example, each functional unit or DB of the management devices 10 and 20 may be implemented by a different device and configured as a system. For example, each functional unit of the management device 20 may be configured by multiple servers and configured as a system. For example, it may be implemented by a database server including each DB and a server having each functional unit.

[0127] In the embodiment, each DB may include a portion of the above-mentioned information. Each piece of information may also include information other than the above-mentioned information. For example, for ease of explanation, a distinction is made between a position tag ID and a product tag ID, but a tag ID that can simply identify an RFID tag may also be used. For example, the tag manufacturing number may be used as the tag ID.

[0128] The process of generating information to be displayed on the terminal device 25 may be performed by the output unit 204. This process may also be performed by the terminal device 25. That is, the terminal device 25 generates information for a screen to be displayed on the terminal device 25 based on data received from the management devices 10 and 20, and displays the screen.

[0129] (Example of Computer Hardware Configuration) Next, an example of a hardware configuration in which each device, such as the management devices 10 and 20 and the terminal device 25, is realized by a computer will be described.

[0130] 21 is an explanatory diagram showing an example of the hardware configuration of a computer. For example, some or all of the devices can be realized using any combination of a computer 80 and a program as shown in FIG.

[0131] The computer 80 includes, for example, a processor 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, and a storage device 804. The computer 80 also includes a communication interface 805 and an input / output interface 806. The components are connected to each other, for example, via a bus 807. The number of each component is not particularly limited, and there may be one or more of each component.

[0132] The processor 801 controls the entire computer 80. The processor 801 may be, for example, a central processing unit (CPU), a digital signal processor (DSP), a graphics processing unit (GPU), a physics processing unit (PPU), a tensor processing unit (TPU), a quantum processor, or a combination thereof, and is not particularly limited.

[0133] The computer 80 also includes a ROM 802, a RAM 803, and a storage device 804. Examples of the storage device 804 include a semiconductor memory such as a flash memory, a hard disk drive (HDD), and a solid state drive (SSD). For example, the storage device 804 stores an operating system (OS) program, application programs, and programs related to the embodiments. Alternatively, the ROM 802 stores application programs and programs related to the embodiments. The RAM 803 is used as a work area for the processor 801.

[0134] The processor 801 also loads programs stored in the storage device 804, ROM 802, etc. The processor 801 then executes each process coded in the program. The processor 801 may also download various programs via the communication network NT. The processor 801 also functions as a part or all of the computer 80. The processor 801 may then execute the processes or instructions in the illustrated flowchart based on the program.

[0135] The communication interface 805 is connected to a communication network NT such as a LAN (Local Area Network) or a WAN (Wide Area Network) via a wireless or wired communication line. The communication network NT may be composed of multiple communication networks NT. As a result, the computer 80 is connected to external devices and external computers 80 via the communication networks NT. The communication interface 805 serves as an interface between the communication network NT and the inside of the computer 80. The communication interface 805 also controls the input and output of data from external devices and external computers 80.

[0136] Furthermore, the input / output interface 806 is connected to at least one of an input device, an output device, and an input / output device. The connection method may be wireless or wired. Examples of the input device include a keyboard, a mouse, and a microphone. Examples of the output device include a display device, a lighting device, and an audio output device that outputs audio. Examples of the input / output device include a touch panel display. Note that the input device, output device, and input / output device may be built into the computer 80 or may be external.

[0137] The hardware configuration of the computer 80 is an example. The computer 80 may have some of the components shown in FIG. 21 . The computer 80 may have components other than those shown in FIG. 21 . For example, the computer 80 may have a drive device or the like. The processor 801 may then read programs and data stored on a recording medium attached to the drive device or the like into the RAM 803. Examples of non-transitory tangible recording media include optical disks, flexible disks, magneto-optical disks, and USB (Universal Serial Bus) memories. As described above, the computer 80 may have input devices such as a keyboard and a mouse. The computer 80 may have an output device such as a display. The computer 80 may also have an input device, an output device, and an input / output device.

[0138] The computer 80 may also include various sensors (not shown). The types of sensors are not particularly limited. The computer 80 may also include an imaging device capable of capturing images or videos.

[0139] This concludes the description of the hardware configuration of each device. There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.

[0140] Furthermore, some or all of the components of each device may be realized by circuits for specific applications. Furthermore, some or all of the components of each device may be realized by general-purpose circuits such as FPGAs (Field Programmable Gate Arrays). Furthermore, some or all of the components of each device may be realized by a combination of circuits for specific applications and general-purpose circuits. These circuits may be a single integrated circuit. Alternatively, these circuits may be divided into multiple integrated circuits. The multiple integrated circuits may be connected via a bus or the like.

[0141] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be centrally located or distributed.

[0142] The management method described in the embodiment may be realized by being executed by a computer such as the management device 10 or 20 .

[0143] Each program, such as the formulation program and optimization program described in the embodiments, is recorded on a computer-readable recording medium such as an HDD, SSD, flexible disk, optical disk, magneto-optical disk, or USB memory. Each program is executed by being read from the recording medium by a computer. Each program may also be distributed via a communication network NT.

[0144] The functions of each of the components of management device 10 and management device 20 described above may be realized by dedicated hardware, such as a computer. Alternatively, each component may be realized by software. Alternatively, each component may be realized by a combination of hardware and software.

[0145] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. The configuration and details of each of the present disclosures may include embodiments to which various modifications that would be apparent to those skilled in the art are applied within the scope of the present disclosure. The present disclosure may include embodiments in which the details described herein are appropriately combined or substituted as necessary. For example, details described using a particular embodiment may also be applied to other embodiments to the extent that no contradiction occurs. For example, although multiple operations are described in sequence in the form of a flowchart, the order of description does not limit the order in which the multiple operations are performed. Therefore, when implementing the embodiments, the order of the multiple operations may be changed as long as it does not interfere with the content.

[0146] Some or all of the above-described embodiments can be described as follows: However, some or all of the above-described embodiments are not limited to the following.

[0147] (Supplementary Note 1) A management device comprising: antenna control means for controlling the movement of antennas that are individually movable on rails attached to shelves; reading means for using the antennas to read RFID tags that are attached to items and contain information that can identify the items; situation determination means for determining information that represents the display situation of the items on the shelves based on position information of the antennas and the information read from the RFID tags; and output means for outputting the information that represents the display situation.

[0148] (Appendix 2) A management device as described in Appendix 1, wherein RFID tags containing information that can identify a position on the shelf are attached to each position near the rail, the reading means further reads the RFID tags containing the information that can identify the position, and the situation identification means identifies the display situation based on the read information that can identify the position and the read information that can identify the item.

[0149] (Appendix 3) The management device of claim 1, further comprising a position determination means for determining the position information of the antenna from control information of the movement of the antenna by the antenna control means, and the situation determination means determines the display situation based on the position information of the antenna and the information capable of identifying the read item.

[0150] (Supplementary Note 4) A management device as described in any of Supplementary Note 1 to Supplementary Note 3, comprising an imaging device control means for controlling an imaging device capable of capturing an image of the movement range of the antenna on the shelf, wherein the imaging device control means controls at least one of the orientation, position, and angle of view of the imaging device in accordance with the reading of the information capable of identifying the item by the antenna, to cause the imaging device to capture an image of the shelf.

[0151] (Supplementary Note 5) The management device described in Supplementary Note 4, wherein the imaging device is movable on a rail attached to the shelf, and the imaging device control means controls movement of the imaging device to a position where it can image the item in accordance with reading of the information capable of identifying the item by the antenna.

[0152] (Supplementary Note 6) The management device according to Supplementary Note 5, wherein the imaging device is placed on the rail on which the antenna is placed.

[0153] (Supplementary Note 7) The management device described in Supplementary Note 5 or Supplementary Note 6, wherein the imaging device control means, when there is an abnormality in the reading of the information capable of identifying the item by the antenna, moves the imaging device to a position where it can capture an image of the display situation at the position where the abnormality was detected.

[0154] (Supplementary Note 8) The management device according to any one of Supplementary Note 5 to Supplementary Note 7, wherein the imaging device control means moves the imaging device to a position where it can capture an image of the item, depending on the expiration date of the item specified by the information that can identify the item by the antenna.

[0155] (Supplementary Note 9) The management device according to any one of Supplementary Note 5 to Supplementary Note 8, wherein the antenna control means controls movement of the antenna when a detection result by a sensor attached to the shelf satisfies a predetermined condition.

[0156] (Supplementary Note 10) The management device according to Supplementary Note 9, wherein the sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.

[0157] (Supplementary Note 11) The management device according to Supplementary Note 9, wherein the sensor is a weight sensor, the detection result is a detection result of a change in weight by the weight sensor, and the predetermined condition is a change in weight in a unit different from the weight of an item assigned to the position where the weight sensor is attached.

[0158] (Supplementary Note 12) A management device according to any one of Supplementary Notes 1 to 11, further comprising: a person detection means for detecting the behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person; and the antenna control means for moving the antenna to a position near the position where the person is detected in accordance with the behavior of the person.

[0159] (Supplementary Note 13) The management device according to Supplementary Note 12, wherein the person detection means detects, from an image captured by the imaging device, that the person has retrieved an item from the shelf, and the antenna control means, when it detects that the person has retrieved an item from the shelf, moves the antenna to a position on the shelf whose reading range includes the position where the item is placed.

[0160] (Supplementary Note 14) The management device described in Supplementary Note 12 or Supplementary Note 13, wherein the person detection means detects that the person has placed the item on the shelf based on an image captured by the imaging device, and the antenna control means, when it detects that the person has placed the item from the shelf, moves the antenna to a position on the shelf that includes the position where the item is placed within its reading range.

[0161] (Supplementary Note 15) A management device as described in any of Supplementary Note 1 to Supplementary Note 14, further comprising an item detection means for detecting an item included in an image captured by an imaging device capable of capturing an image of the movement range of the antenna on the shelf, and the antenna control means moves the antenna to a position on the shelf that includes within its reading range the position where the item included in the image is placed.

[0162] (Supplementary Note 16) A management method comprising: controlling the movement of antennas that are individually movable on rails attached to a shelf; reading an RFID tag attached to an item using the antenna, the RFID tag containing information that can identify the item; identifying information that represents the display status of the item on the shelf based on position information of the antenna and the information read from the RFID tag; and outputting the information that represents the display status.

[0163] (Appendix 17) A management method as described in Appendix 16, wherein RFID tags containing information that can identify a position on the shelf are attached to each position near the rail, the reading further includes reading the RFID tags containing the information that can identify the position, and the identification of the information representing the display status includes identifying the display status based on the information that can identify the read position and the information that can identify the read item.

[0164] (Appendix 18) A management method as described in Appendix 16, wherein position information of the antenna is identified from control information for the movement of the antenna, and in identifying the information representing the display status, the display status is identified using the position information of the antenna and the information capable of identifying the read item.

[0165] (Supplementary Note 19) A management method according to any one of Supplementary Note 16 to Supplementary Note 18, comprising controlling an imaging device capable of capturing an image of the movement range of the antenna on the shelf, and in the control of the imaging device, controlling at least one of the orientation, position, and angle of view of the imaging device in accordance with the reading of the information capable of identifying the item by the antenna, thereby causing the imaging device to capture an image of the shelf.

[0166] (Supplementary Note 20) The management method according to Supplementary Note 19, wherein the imaging device is movable on a rail attached to the shelf, and the control of the imaging device controls movement of the imaging device to a position where it can capture an image of the item in response to reading of the information capable of identifying the item by the antenna.

[0167] (Supplementary Note 21) The management method according to Supplementary Note 20, wherein the imaging device is placed on the rail on which the antenna is placed.

[0168] (Appendix 22) The management method described in Appendix 20 or Appendix 21, wherein, in the control of the imaging device, if there is an abnormality in the reading of the information that can identify the item by the antenna, the imaging device is moved to a position where it can capture an image of the display situation at the position where the abnormality was detected.

[0169] (Supplementary Note 23) The management method according to any one of Supplementary Note 20 to Supplementary Note 22, wherein in the control of the imaging device, the imaging device is moved to a position where it can image the item, depending on the expiration date of the item specified by the information that can identify the item by the antenna.

[0170] (Supplementary Note 24) The management method according to any one of Supplementary Note 20 to Supplementary Note 23, wherein, in controlling the antenna, movement of the antenna is controlled when a detection result by a sensor attached to the shelf satisfies a predetermined condition.

[0171] (Supplementary Note 25) The management method according to Supplementary Note 24, wherein the sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.

[0172] (Appendix 26) The management method described in Appendix 24, wherein the sensor is a weight sensor, the detection result is a detection result of a change in weight by the weight sensor, and the predetermined condition is a change in weight in a unit different from the weight of an item assigned to the position where the weight sensor is attached.

[0173] (Supplementary Note 27) The management method described in any one of Supplementary Note 16 to Supplementary Note 26, further comprising: detecting the behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person; and, in the control of the antenna, moving the antenna to a position near the detected position of the person in accordance with the behavior of the person.

[0174] (Supplementary Note 28) The management method according to Supplementary Note 27, further comprising: detecting, from an image captured by the imaging device, that the person has retrieved an item from the shelf; and, when it is detected in the control of the antenna that the person has retrieved the item from the shelf, moving the antenna to a position on the shelf whose reading range includes the position where the item is placed.

[0175] (Supplementary Note 29) The management method described in Supplementary Note 27 or Supplementary Note 28, wherein in the detection of the person's behavior, it is detected that the person has placed the item on the shelf based on an image captured by the imaging device, and in the control of the antenna, when it is detected that the person has placed the item from the shelf, the antenna is moved to a position on the shelf whose reading range includes the position where the item is placed.

[0176] (Supplementary Note 30) A management method according to any one of Supplementary Notes 16 to 29, comprising detecting an item included in an image captured by an imaging device capable of capturing an image of the movement range of the antenna on the shelf, and in controlling the antenna, moving the antenna to a position on the shelf whose reading range includes the position where the item included in the image is placed.

[0177] (Supplementary Note 31) A non-transitory computer-readable recording medium having recorded thereon a program for causing a computer to execute the following processes: controlling the movement of antennas that are individually movable on rails attached to shelves; reading RFID tags attached to items using the antennas and that contain information that can identify the items; identifying information that represents the display status of the items on the shelves based on position information of the antennas and the information read from the RFID tags; and outputting the information that represents the display status.

[0178] (Appendix 32) A recording medium as described in Appendix 31, wherein RFID tags containing information that can identify a position on the shelf are attached to each position near the rail, the reading process further includes reading the RFID tags containing the information that can identify the position, and the process of identifying the information representing the display status identifies the display status using the information that can identify the read position and the information that can identify the read item.

[0179] (Appendix 33) The recording medium described in Appendix 31, in which the computer is caused to identify position information of the antenna from control information for the movement of the antenna and execute processing, and in the processing for identifying information representing the display status, the display status is identified using the position information of the antenna and the information capable of identifying the read item.

[0180] (Appendix 34) A recording medium described in any one of Appendices 31 to 33, which causes the computer to execute a process of controlling an imaging device capable of capturing an image of the movement range of the antenna on the shelf, and in the process of controlling the imaging device, at least one of the orientation, position, and angle of view of the imaging device is controlled in accordance with the reading of the information capable of identifying the item by the antenna, thereby causing the imaging device to capture an image of the shelf.

[0181] (Appendix 35) The recording medium described in Appendix 34, wherein the imaging device is movable on a rail attached to the shelf, and the process of controlling the imaging device controls movement of the imaging device to a position where it can image the item in accordance with reading of the information capable of identifying the item by the antenna.

[0182] (Supplementary Note 36) The recording medium according to Supplementary Note 35, wherein the imaging device is placed on the rail on which the antenna is placed.

[0183] (Appendix 37) The recording medium described in Appendix 35 or Appendix 36, wherein in the process of controlling the imaging device, if there is an abnormality in the reading of the information capable of identifying the item by the antenna, the imaging device is moved to a position where it can capture an image of the display situation at the position where the abnormality was detected.

[0184] (Appendix 38) The recording medium described in any one of Appendices 35 to 37, wherein the process of controlling the imaging device moves the imaging device to a position where it can image the item, depending on the expiration date of the item specified by the information that can identify the item by the antenna.

[0185] (Supplementary Note 39) The recording medium according to any one of Supplementary Note 35 to Supplementary Note 38, wherein the process of controlling the antenna controls movement of the antenna when a detection result by a sensor attached to the shelf satisfies a predetermined condition.

[0186] (Supplementary Note 40) The recording medium according to Supplementary Note 39, wherein the sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.

[0187] (Appendix 41) The recording medium described in Appendix 39, wherein the sensor is a weight sensor, the detection result is a detection result of a change in weight by the weight sensor, and the predetermined condition is a change in weight in a unit different from the weight of an item assigned to the position where the weight sensor is attached.

[0188] (Appendix 42) A recording medium described in any one of Appendices 31 to 41, wherein the computer is caused to execute a process of detecting the behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person, and in the process of controlling the antenna, the antenna is moved to a position near the position where the person is detected in accordance with the person's behavior.

[0189] (Appendix 43) The recording medium described in Appendix 42, wherein the computer is caused to execute a process of detecting, from an image captured by the imaging device, that the person has retrieved an item from the shelf, and in the process of controlling the antenna, when it is detected that the person has retrieved an item from the shelf, the antenna is moved to a position on the shelf whose reading range includes the position where the item is placed.

[0190] (Appendix 44) The recording medium described in Appendix 42 or Appendix 43, wherein the process of detecting the person's behavior detects that the person has placed the item on the shelf based on an image captured by the imaging device, and the process of controlling the antenna, when it is detected that the person has placed the item from the shelf, moves the antenna to a position on the shelf whose reading range includes the position where the item is placed.

[0191] (Appendix 45) A recording medium described in any one of Appendices 31 to 44, which causes the computer to execute a process of detecting an item included in an image captured by an imaging device capable of capturing an image of the movement range of the antenna on the shelf, and in the process of controlling the antenna, moves the antenna to a position whose reading range includes the position where the item included in the image is placed.

[0192] (Supplementary Note 31) A program that causes a computer to execute the following processes: controlling the movement of antennas that are individually movable on rails attached to shelves; using the antennas to read RFID tags that are attached to items and contain information that can identify the items; identifying information that represents the display status of the items on the shelves based on position information of the antennas and the information read from the RFID tags; and outputting the information that represents the display status.

[0193] 10, 20 Management device 11, 21, 21-1 to 21-n Antenna 13, 23, 23-1 to 23-n Moving unit 22 Reader 24 Imaging device 25 Terminal device 26 Moving unit 30 Sensor 80 Computer 101, 201 Antenna control unit 102, 202 Reading unit 103, 203 Situation identification unit 104, 204 Output unit 205 Reception unit 206 Position identification unit 207 Imaging device control unit 208 Person detection unit 209 Item detection unit 210 Determination unit 801 Processor 802 ROM 803 RAM 804 Storage device 805 Communication interface 806 Input / output interface 807 Bus 2001 Shelf allocation DB 2002 Antenna DB 2003 Location tag DB 2004 Product DB NT Communication network

Claims

1. A management device comprising: antenna control means for controlling movement of antennas which are individually movable on rails attached to a shelf; reading means for using said antennas to read an RFID (Radio Frequency Identification) tag attached to an item which contains information enabling the item to be identified; situation determination means for determining information indicative of the display situation of said item on said shelf based on position information of said antenna and the information read from the RFID tag; and output means for outputting the information indicative of the display situation.

2. The management device described in claim 1, wherein RFID tags containing information capable of identifying a position on the shelf are attached to each position near the rail, the reading means further reads the RFID tags containing the information capable of identifying the position, and the situation determination means determines the display situation based on the read information capable of identifying the position and the read information capable of identifying the item.

3. A management device as described in claim 1, further comprising a position identification means for identifying position information of the antenna from control information of the movement of the antenna by the antenna control means, and the situation identification means identifies the display situation based on the antenna position information and the information capable of identifying the read item.

4. A management device as described in any one of claims 1 to 3, further comprising an imaging device control means for controlling an imaging device capable of imaging the range of movement of the antenna on the shelf, wherein the imaging device control means controls at least one of the orientation, position, and angle of view of the imaging device in response to reading of the information capable of identifying the item, thereby causing the imaging device to image the shelf.

5. The management device according to claim 4, wherein the imaging device is movable on a rail attached to the shelf, and the imaging device control means controls the movement of the imaging device to a position where it can image the item in response to the reading by the antenna of the information capable of identifying the item.

6. The management device according to claim 5, wherein the imaging device is placed on the rail on which the antenna is placed.

7. A management device as described in any one of claims 5 to 6, wherein, when an abnormality is detected in the reading of the information capable of identifying the item by the antenna, the imaging device control means moves the imaging device to a position where it can capture an image of the display situation at the position where the abnormality is detected.

8. A management device as described in any one of claims 5 to 7, wherein the imaging device control means moves the imaging device to a position where it can image the item according to the expiration date of the item specified by the information that enables the item to be identified by the antenna.

9. A management device according to any one of claims 5 to 8, wherein said antenna control means controls movement of said antenna when a detection result by a sensor attached to said shelf satisfies a predetermined condition.

10. The management device according to claim 9, wherein the sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.

11. The management device of claim 9, wherein the sensor is a weight sensor, the detection result is a detection result of a change in weight by the weight sensor, and the specified condition is a change in weight in a unit different from the weight of an item assigned to the position where the weight sensor is attached.

12. A management device as described in any one of claims 1 to 11, further comprising: a person detection means for detecting the behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person; and wherein the antenna control means moves the antenna to the vicinity of the position where the person is detected in accordance with the behavior of the person.

13. The management device described in claim 12, wherein the person detection means detects that the person has retrieved an item from the shelf from an image captured by the imaging device, and the antenna control means, when it detects that the person has retrieved an item from the shelf, moves the antenna to a position on the shelf whose reading range includes the position where the item is placed.

14. A management method comprising: controlling the movement of antennas which are individually movable on rails attached to a shelf; using the antennas to read an RFID tag attached to an item which contains information enabling the item to be identified; identifying information representing the display status of the item on the shelf based on position information of the antennas and the information read from the RFID tag; and outputting the information representing the display status.

15. A non-transitory recording medium readable by a computer having recorded thereon a program for causing a computer to execute the following processes: controlling the movement of antennas that are individually movable on rails attached to a shelf; reading an RFID tag attached to an item using the antennas, the RFID tag containing information capable of identifying the item; identifying information representing the display status of the item on the shelf based on position information of the antennas and the information read from the RFID tags; and outputting the information representing the display status.

Images