Management device, management method, and recording medium
The management device automates the registration of article locations by tracking individuals and articles within warehouses, reducing manual labor and enhancing efficiency in tracking and searching for articles.
Patent Information
- Application Number
- PCT/JP2023/045588
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-20
- Publication Date
- 2025-06-26
AI Technical Summary
In warehouses and similar spaces, manually registering the location of articles is time-consuming and labor-intensive, especially when articles are carried by individuals rather than machinery.
A management device equipped with detection means to track the positions of individuals and articles as they pass through predetermined spaces, and management means to automatically register the position of the article when it stops and the individual leaves, based on historical position data.
This solution significantly reduces the labor required to register article locations, enhances efficiency in tracking and searching for articles within large spaces, and minimizes errors associated with manual registration.
Smart Images

Figure JP2023045588_26062025_PF_FP_ABST
Abstract
Description
Management device, management method, and recording medium
[0001] The present disclosure relates to a management device and the like.
[0002] For example, in a warehouse, it is necessary to manage where each item is placed. For example, Patent Document 1 describes that when an item is transported by a forklift, the location where the item is unloaded can be known by operating the forklift.
[0003] JP 2010-018408 A
[0004] However, there are cases where a person carries an item, and in such cases, it is time-consuming for the person to manually register where the item is located.
[0005] An example of an object of the present disclosure is to provide a management device or the like that eliminates the need to register location information indicating the location where an item is placed.
[0006] In one aspect of the present disclosure, the management device includes a detection means for detecting the positions of a person and an item carried by the person who simultaneously pass a predetermined position within a predetermined space, and a management means for registering position information indicating the position of the item when the item stops and the person moves away from the item, based on historical information of the respective positions of the person and the item.
[0007] In one aspect of the present disclosure, a management method includes a computer detecting the locations of a person and an item carried by the person who simultaneously pass through a specified location within a specified space, and registering location information indicating the location of the item when the item stopped and the person moved away from the item based on historical information of the respective locations of the person and the item.
[0008] A program in one aspect of the present disclosure causes a computer to perform the following process: detect the positions of a person and an item carried by the person who simultaneously pass a specified position in a specified space; and, based on historical information of the positions of the person and the item, register position information indicating the position of the item when the item stopped and the person moved away from the item.
[0009] Each program may be stored in a non-transitory computer-readable recording medium.
[0010] According to the present disclosure, it is possible to eliminate the need to register location information indicating the location where an item is placed.
[0011] 14 is a first block diagram showing an example of the configuration of a management device. FIG. 15 is a flowchart showing an example of the operation of the management device. FIG. 16 is an explanatory diagram showing example 1 of connection between the management device and other devices. FIG. 17 is an example of a predetermined space. FIG. 18 is an explanatory diagram showing example 1 of attachment of item tags and person tags. FIG. 19 is an explanatory diagram showing example 1 of attachment of item tags and person tags. FIG. 20 is an explanatory diagram showing an example of installation of position tags. FIG. 21 is a second block diagram showing an example of the configuration of a management device. FIG. 22 is an explanatory diagram showing an example of an item DB when RFID tags are used. FIG. 23 is an explanatory diagram showing an example of a position tag DB. FIG. 24 is an explanatory diagram showing an example of a person and an item passing through a gate. FIG. 25 is an explanatory diagram showing a state where a person is carrying an item and a drone is tracking the item tag. FIG. 26 is an explanatory diagram showing an example of history information of the position of an item tag. FIG. 27 is an explanatory diagram showing an example of history information of the position of a person tag. FIG. 28 is an explanatory diagram showing an example where the item tag has stopped and the position of the person tag and the position of the item tag are separated. FIG. 29 is an explanatory diagram showing an example of registration of position information in the item DB shown in FIG. 8. FIG. 29 is an explanatory diagram showing an example of output of item position information. FIG. 29 is an explanatory diagram showing an example where position information registered in the item DB shown in FIG. 14 is deleted. FIG. 1 is a flowchart showing an operation example of a management device. FIG. 2 is an explanatory diagram showing a second connection example between the management device and other devices. FIG. 3 is an explanatory diagram showing an example of an installation of a plurality of RFID readers. FIG. 4 is an explanatory diagram showing a third connection example between the management device and other devices. FIG. 5 is an explanatory diagram showing an example of an item DB when an AR marker is used. FIG. 6 is an explanatory diagram showing a fourth connection example between the management device and other devices. FIG. 7 is an explanatory diagram showing an example of an installation of a plurality of imaging devices. FIG. 8 is an explanatory diagram showing an example of the hardware configuration of a computer.
[0012] Hereinafter, with reference to the drawings, embodiments of a management device, a management method, a program, and a non-transitory recording medium for recording a program according to the present disclosure will be described in detail. Each embodiment does not limit the disclosed technology.
[0013] Here, in each embodiment, an item will be described using luggage as an example. For example, an item that can carry one or more items, such as a cart with a basket (also called a basket cart), may be considered as one item. For example, identifying an area where an item is located may be interpreted as identifying an area where a basket cart is located. In each embodiment, the size of the item, the unit of the item, etc. are not particularly limited.
[0014] In each embodiment, the predetermined space is, for example, a space in which an item is placed, and is not particularly limited. For example, the predetermined space may be a warehouse.
[0015] For example, when an item is brought into an indoor space such as a warehouse, it is expected that a worker will manually register the location of the item in a database or the like, since GPS (Global Positioning System) or the like cannot be used indoors.
[0016] 1 is a first block diagram showing an example of the configuration of a management device 10. The management device 10 includes a detection unit 101 and a management unit 102.
[0017] The detection unit 101 detects the positions of a person and an item carried by the person who simultaneously pass through a predetermined position within a predetermined space. The predetermined position is, for example, a position where the person and the item are likely to pass through simultaneously. For example, when a person carries an item into a predetermined space, the predetermined position may be, for example, an entrance to the predetermined space.
[0018] The management unit 102 registers location information indicating the location of an item when the item stops and the person moves away from the item, based on historical information on the respective locations of the person and the item. For example, an item stops when the item remains in the same location for a predetermined period of time or more. The management unit 102, for example, registers the location information indicating the location of the item in a database that manages the locations of the items. The management unit 102 may register the location information in the database in association with the date and time of registration.
[0019] Here, examples of the method by which the detection unit 101 detects the positions of people and objects include using an RFID (Radio Frequency Identification) tag and using an AR marker or code, such as a one-dimensional code or a two-dimensional code.
[0020] <Example Using RFID Tags> First, a brief description will be given of an example in which the detection unit 101 detects the positions of people and articles using RFID tags.
[0021] A person is attached with a person tag, which is an RFID tag that stores information that can identify the person. For example, the person tag may be attached to an item that the person wears. For example, the person tag may be attached to an item such as a helmet worn by the person. The person's location history information is location history information of the person tag.
[0022] An item tag, which is an RFID tag that stores information that can identify the item, is attached to the item. The item tag's location history information is information about the item tag's location.
[0023] Here, "attaching a tag such as a person tag or an item tag" means that the tag may be directly attached, or that the RFID tag may be sandwiched between pieces of paper and attached with a string, like a price tag. The method of attaching the tag is not particularly limited.
[0024] The detection unit 101 detects the positions of the person tag and the item tag by reading the person tag and the item tag via an RFID reader. For example, the detection unit 101 registers position information indicating the position of the person tag in the position history information of the person tag. The position history information of the person tag registers position information indicating the detected position so that the transition of the position of the person tag can be identified. For example, the position information may be registered in association with time information in the position history information of the person tag. For example, the detection unit 101 registers position information indicating the position of the item tag in the position history information of the item tag. The position history information of the item tag registers position information indicating the detected position so that the transition of the position of the item tag can be identified. For example, the position information may be registered in association with time information in the position history information of the item tag.
[0025] The management unit 102 registers the position information of the item tag when the item tag stops and the position of the person tag and the position of the item tag are separated as the position information of the item based on the position history information of the item tag and the position history information of the person tag. For example, the management unit 102 can determine that the item has stopped based on whether the item tag remains stationary for a predetermined period of time or more. For example, the position of the person tag and the position of the item tag being separated may be, for example, a predetermined distance or more, and is not particularly limited. Note that the management unit 102 may register position information indicating the position of the item based on whether the item has stopped and the person has stopped carrying the item.
[0026] <Example of Using AR (Argumented Reality) Marker> Next, an example of using an AR marker and a code will be described using an AR marker as an example. Note that the example of the AR marker may be applied to an example of using a code.
[0027] A person is assigned a person AR marker that allows the person to be identified. The person's position history information is history information on the position of the person AR marker. The person AR marker is assigned so that it can be captured by an imaging device.
[0028] An article AR marker that can identify the article is attached to the article. The history information of the article position is history information of the position of the article AR marker. The article AR marker is attached so that it can be imaged by an imaging device.
[0029] The detection unit 101 detects the positions of the person AR marker and the article AR marker by reading the person AR marker and the article AR marker using an imaging device. For example, the detection unit 101 registers position information indicating the position of the person AR marker in position history information of the person AR marker. The position history information of the person AR marker registers position information indicating the detected position so that the transition of the position of the person AR marker can be identified. For example, the position information may be registered in association with time information in the position history information of the person AR marker. For example, the detection unit 101 registers position information indicating the position of the article AR marker in position history information of the item tag. The position history information of the article AR marker registers position information indicating the detected position so that the transition of the position of the article AR marker can be identified. For example, the position information may be registered in association with time information in the position history information of the item AR marker so that the transition of the position of the article AR marker can be identified.
[0030] The management unit 102 registers the position information of the article AR marker when the article AR marker stops and the position of the person AR marker is separated from the position of the article AR marker as the position information of the article, based on the position history information of the article AR marker and the position history information of the person AR marker. For example, the management unit 102 can determine that the article has stopped based on whether the article AR marker remains stationary for a predetermined period of time or more. For example, the position of the person AR marker being separated from the position of the article AR marker may be, for example, a predetermined distance or more, and is not particularly limited.
[0031] 2 is a flowchart showing an example of the operation of the management device 10. First, the detection unit 101 detects the positions of people and items carried by the people who simultaneously pass a predetermined position in a predetermined space (step S101).
[0032] Next, the registration unit registers, in the database, location information indicating the location of the item when the item stopped and the person moved away from the item, based on the historical information of the locations of the person and the item (step S102). The management device 10 ends the series of processes shown in FIG.
[0033] In large spaces such as warehouses, registering where luggage or carts have been placed is time-consuming. Furthermore, if location information is not registered, searching for luggage or carts in a large warehouse is time-consuming. As described above, the management device 10 detects the locations of people and items carried by people who simultaneously pass through a specific location within a specific space. Based on historical location information for the people and items, the management device 10 registers location information in a database indicating the location of the item when the item stops and the person leaves the item. When an item stops, it may be because the person has finished carrying the item, such as by placing it on a shelf, or it may simply be that the item has temporarily stopped with the person. Therefore, by detecting the location of both the person and the item, the management device 10 can more accurately determine whether the item has stopped and whether the person has left the item by detecting whether the item has been placed. This eliminates the need to register location information indicating where the item was placed. Furthermore, it simplifies the process of searching for items.
[0034] Second Embodiment Next, a second embodiment will be described in detail with reference to the drawings. In the second embodiment, an example of registering the location information of an item using an RFID tag will be described in detail. Below, explanations of content that overlaps with the above explanation will be omitted to the extent that the explanation of the second embodiment is not unclear.
[0035] 3 is an explanatory diagram showing Example 1 of a connection between a management device and another device. In FIG. 3 , an example of registering location information of an item by reading an RFID tag using an RFID tag mounted on a drone 24 will be described in detail. The drone 24 is an example of a mobile device. The mobile device may be, for example, an automatic guided vehicle (AGV) or a robot, and is not limited to the drone 24.
[0036] The management device 20 may be connected to a drone 24 equipped with an RFID reader via a communication network. For example, the management device 20 may be capable of controlling the drone 24. When the management device 20 sends a read instruction to an RFID reader equipped on the drone 24, the RFID reader equipped on the drone 24 can output reading radio waves to an antenna equipped on the RFID reader. For example, the RFID reader equipped on the drone 24 may constantly read data while the drone 24 is flying.
[0037] The management device 20 may also be connected to a gate 21 equipped with an RFID reader via a communication network. For example, the RFID reader provided in the gate 21 may be constantly reading data. Specifically, the RFID reader can output reading radio waves to an antenna mounted on the RFID reader. The gate 21 equipped with an RFID reader is installed, for example, at a predetermined location.
[0038] The management device 20 may be connected to a user's terminal device 23 via a communication network. The user may be, for example, a person searching for an item. Examples of the user include a warehouse worker or warehouse manager. The type of terminal device 23 is not particularly limited, and may be a personal computer (PC), a smartphone, a tablet device, or the like. The terminal device 23 may be pre-installed with an application program that can transmit information to the management device 20 and output information from the management device 20. Alternatively, the terminal device 23 may access a website connected to the management device 20 and transmit and receive information to and from the management device 20 via the website.
[0039] FIG. 4 shows an example of a predetermined space. A warehouse is used as an example of the predetermined space. A plurality of shelves are installed in the warehouse. The gate 21 with an RFID reader is installed, for example, at the entrance of the warehouse, which is an example of a predetermined location. For example, the drone 24 may be waiting near the predetermined location. Note that, although an example in which the gate 21 with an RFID reader is fixedly installed at the predetermined location will be described, the RFID reader may simply be fixedly installed at the predetermined location.
[0040] 5A is an explanatory diagram showing Example 1 of attachment of an item tag and a person tag. The item tag is attached to, for example, the item itself. The person tag is attached to, for example, an item of the person. For example, in FIG. 5A, the item tag is attached to the person's helmet.
[0041] 5B is an explanatory diagram showing Example 1 of attaching an article tag and a person tag. In FIG. 5B, when the article is a cart, the article tag is attached to the cart. For example, in FIG. 5B, the person tag is attached to the person's helmet.
[0042] As shown in Figures 5A and 5B, a person carries an item, and the person and the item pass through a predetermined location, such as a warehouse entrance, at the same time.
[0043] FIG. 6 is an explanatory diagram showing an example of the installation of a position tag. A position tag, which is an RFID tag that stores position information that can identify a location in the specified space, is installed in a specified space. In FIG. 6 , the position tag is installed on a shelf. For example, an RFID reader mounted on a drone 24 can identify the location of the drone 24 by reading the position tag. For example, if the strength of a signal received from the position tag by the RFID reader mounted on the drone 24 is equal to or greater than a specified strength, the management device 20 may determine that the drone 24 is in the vicinity of the position tag. Therefore, if the position tag stores position information, the position information read by the RFID reader at a strength equal to or greater than the specified strength can be identified as the position information of the drone 24.
[0044] The example of position tag placement shown in FIG. 6 is merely an example, and position tags may be attached to each shelf level in more detail. Here, the performance and characteristics of an RFID tag are determined by the type of tag, the usage environment, and the like. If the performance and characteristics of an item tag and a position tag are the same or similar, and the item tag and the position tag are close to each other, the strength of the signal received from each will be similar. For example, when an item is placed on one shelf of a shelf, the management device 20 may identify, as the item's location information, the location information stored in the position tag with the signal strength closest to the strength of the signal received from the item tag. Position tags may also be installed in more detail by shelf or column. In this case, the management device 20 may also identify, as the location information of the item to which the item tag is attached, the location information read from the position tag with the signal strength closest to the strength of the signal received from the item tag.
[0045] 7 is a second block diagram showing an example of the configuration of the management device 20. The management device 20 includes a detection unit 201, a management unit 202, a control unit 203, a reception unit 204, and an output unit 205.
[0046] For example, the detection unit 201 may have, as a basic function, the function of the detection unit 101 shown in Fig. 1. For example, the management unit 202 may have, as a basic function, the function of the management unit 102 shown in Fig. 1.
[0047] The management device 20 may also include an item DB (Database) 2000 and a position tag DB 2001. The item DB 2000 is a database for managing position information of items in a predetermined space. The position tag DB 2001 is a database for managing position tags.
[0048] FIG. 8 is an explanatory diagram showing an example of an item DB 2000 when an RFID tag is used. The item DB 2000 stores an item ID (IDentifier), an item tag ID, location information, and the last update date and time in association with each other. For example, the item ID is an example of item identification information for identifying an item. The item identification information may be the item name. The item tag ID is an example of item tag identification information for identifying an item tag attached to an item. Note that the last update date and time is an example, and a new update date and time may be added and registered in the item DB 2000 each time it is updated.
[0049] For example, if an item tag ID is stored in an item tag, when the item tag ID stored in the item tag is read, the item ID associated with the item tag ID in item DB2000 is identified, making it possible to identify the item to which the item tag is attached.
[0050] In FIG. 8, for example, according to the item DB 2000, an item tag identified by an item tag ID "PDTag1" is attached to an item identified by an item ID "PD1", and the location information of the item has not yet been registered.
[0051] Furthermore, the item DB 2000 may further manage item information. If the item is a commodity, the item information may include the item name, the item price, etc. For example, if the item is a parcel to be delivered, the parcel information may include the parcel name, the parcel destination, information identifying the shipper, etc.
[0052] FIG. 9 is an explanatory diagram showing an example of a position tag DB 2001. The position tag DB 2001 is a database that manages position information indicating the position where a position tag is attached. In FIG. 9, the position tag DB 2001 is a database that manages position information indicating the position where a position tag is attached. The position information may be any information that can identify a position in a predetermined space, and the method of expressing the position information is not particularly limited. For example, the position information may be coordinate information in a predetermined space. In FIG. 9, for example, a shelf number is registered as the position information. For example, according to FIG. 9, it is possible to identify that the position tag identified by the position tag ID "POTag1" is attached to shelf S5.
[0053] The detection unit 201 detects the positions of a person and an item carried by the person who simultaneously pass through a predetermined position in a predetermined space. For example, the detection unit 201 detects the passage of the person tag and the item tag through the predetermined position by reading the person tag and the item tag via an RFID reader provided in the gate 21 installed at the predetermined position.
[0054] FIG. 10 is an explanatory diagram showing an example of a person and an item passing through the gate 21. In FIG. 10, a person passes through the entrance while carrying an item. The detection unit 201 detects the passing of the person tag and the item tag at a predetermined position by reading the person tag and the item tag via an RFID reader provided at the gate 21 installed at a predetermined position. The detection unit 201 registers the fact that the person tag has passed through the gate 21 in the position history information of the person tag. The detection unit 201 registers the fact that the item tag has passed through the gate 21 in the position history information of the item tag.
[0055] When the control unit 203 detects that a person or an item has passed through a predetermined position, the control unit 203 controls a mobile device equipped with an RFID reader to track either the person tag or the item tag. An example of the mobile device is a drone 24. For example, a mobile device such as the drone 24 may be placed on standby near a predetermined position in advance.
[0056] Here, there is no particular limitation as to whether a person tag or an item tag is tracked. For example, the control unit 203 controls the drone 24 so that the reception strength of a signal from an RFID tag to be tracked by an RFID reader provided in the drone 24 falls within a predetermined strength range. This allows the control unit 203 to track either a person tag or an item tag.
[0057] Then, the detection unit 201 detects the positions of the person tag and the item tag by reading the position tag via an RFID reader provided in the drone 24. The RFID reader provided in the drone 24 reads the position tag. When the drone 24 tracks the item tag, the detection unit 201 sets the position information read from the position tag with the strongest reception strength as the position information of the item tag.
[0058] Furthermore, the detection unit 201 may detect whether the person tag and the position tag are in the same position based on the reception strength from the person tag and the reception strength from the position tag. If the performance of the person tag and the position tag are the same, and the person tag and the position tag are in approximately the same position, the reception strength from the person tag and the reception strength from the position tag will be approximately the same. Therefore, when the drone 24 tracks the item tag, if the detection unit 201 detects that the person tag and the position tag are in the same position based on the reception strength from the person tag and the reception strength from the position tag, it registers the position information of the person tag in the position history information of the person tag.
[0059] 11 is an explanatory diagram showing a state in which a person is carrying an item and the drone 24 is tracking an item tag. For example, the detection unit 201 can detect the position of the drone 24, the position of the item tag, and the position of the person tag by reading the position tags attached to each shelf using an RFID reader provided on the drone 24. The detection unit 201 may detect the position information read from the position tag with the strongest reception strength as the position information of the drone 24, the position information of the item tag, and the position information of the person tag.
[0060] Fig. 12A is an explanatory diagram showing an example of location history information of an item tag. Fig. 12B is an explanatory diagram showing an example of location history information of a person tag. For example, as shown in Fig. 12A, location history information 2100 of an item tag is registered by associating location information with date and time. For example, as shown in Fig. 12B, location history information 2101 of a person tag is registered by associating location information with date and time.
[0061] The management unit 202 registers the position information of the item tag when the item tag stops and the position of the person tag and the position of the item tag are separated as the position information of the item based on the position history information 2100 of the item tag and the position history information 2101 of the person tag.
[0062] Here, for example, when the drone 24 is tracking an item tag, if the reception strength of the signal from the person tag falls below a certain strength, the detection unit 201 cannot detect the position of the person tag. Therefore, for example, the detection unit 201 may not register the position information of the person tag in the person tag position history information 2101, or may register that the position information was not detected. Alternatively, when the drone 24 is tracking an item tag, if the person tag is not within the reading area of the RFID reader equipped on the drone 24, the RFID reader cannot read the person tag. Therefore, the detection unit 201 cannot detect the position of the person tag. Therefore, for example, the detection unit 201 may not register the position information of the person tag in the person tag position history information 2101, or may register that the position information was not detected. As described above, when the drone 24 is tracking an item tag, if the reception strength of the signal from the person tag falls below a certain strength or if the position of the person tag cannot be detected, the management unit 202 can determine that the position of the person tag and the position of the item tag are far apart. In this way, for example, the management unit 202 can determine that the position of the person tag and the position of the item tag are far apart based on the history information 2101 of the position of the person tag.
[0063] For example, the management unit 202 can determine whether the item tag is stationary based on the item tag's location history information 2100. Specifically, for example, when the drone 24 is tracking the item tag, the detection unit 201 does not update the date and time if there is no change from the location information most recently registered in the item tag's location history information 2100. The management unit 202 may determine that the item tag is stationary if the time from the current time to the most recently registered date and time is equal to or longer than a predetermined time. Alternatively, for example, when the drone 24 is tracking the item tag, the detection unit 201 registers the item tag's location history information 2100 at specific time intervals. When the location information associated with the most recently registered date and time is consecutive in chronological order, the management unit 202 may determine that the item tag is stationary if the time from the most recently registered date and time to the oldest date and time in the same consecutive chronological order location information is equal to or longer than a predetermined time.
[0064] 13 is an explanatory diagram showing an example in which the item tag has stopped and the position of the person tag and the position of the item tag are separated. The management unit 202 registers the position information of the item tag in the case in which the item tag has stopped and the position of the person tag and the position of the item tag are separated as the position information of the item.
[0065] 14 is an explanatory diagram showing an example of registration of location information in the item DB 2000 shown in FIG. 8. For example, the management unit 202 registers the location information of an item tag as the location information of the item in the item DB 2000. At this time, the management unit 202 may register a date and time in association with the location information of the item. The date and time here may be the date and time at the time of registration, or may be the date and time when the item tag was first detected at the position indicated by the location information of the item tag.
[0066] The item DB 2000 may also manage information for identifying a person who has carried an item. Therefore, the management unit 202 may register, in the item DB 2000, the location information of an item in association with information capable of identifying a person read from a person tag.
[0067] Furthermore, the detection unit 201 may terminate the process of detecting the positions of the item tag and the position tag when the management unit 202 completes the registration of the position information. Therefore, the control unit 203 terminates the tracking of the item tag by the mobile device. For example, if the drone 24 is kept waiting near a predetermined position in advance, the control unit 203 may control the drone 24 to return to the predetermined position.
[0068] In the above example, the drone 24 tracks an item tag. However, the drone 24 may also track a person tag. For example, in the process of determining whether an item tag is stationary, when the drone 24 is tracking a person tag, the detection unit 201 determines that the item tag is stationary if there is no change from the most recently registered location information in the item tag's location history information 2100. The management unit 202 may determine that the item tag is stationary if a predetermined time or more has elapsed since the current time until the most recently registered date and time. Alternatively, for example, when the drone 24 is tracking a person tag, the detection unit 201 may determine that the item tag is stationary if a predetermined time or more has elapsed since the item tag became unreadable. Alternatively, for example, when the drone 24 is tracking a person tag, the management unit 202 may determine that the item tag is stationary if a predetermined time or more has elapsed since the reception strength from the item tag became weaker than a predetermined strength. Also, when the drone 24 is tracking a person tag, if the management unit 202 can read the person tag but cannot read the item tag, it can determine that the person tag and the item tag are separated.
[0069] In this way, the drone 24 may track the person tag or the item tag. For example, if a person carries multiple items at the same time and places the multiple items in different positions, the control unit 203 may cause the drone 24 to track the person tag.
[0070] Furthermore, the output unit 205 may output the location information of the item registered in the item DB 2000. The output format is not particularly limited to audio output, screen display, lighting output, print output, etc. For example, the output unit 205 may display the location information of the registered item on the user's terminal device 23. In this case, the output unit 205 may output, on a map showing a predetermined space, that the item is located at the position indicated by the location information of the registered item. The map here is an image of the map.
[0071] The receiving unit 204 may also receive a designation of an item. The method of reception is not particularly limited to voice input, screen operation input, or the like. For example, the receiving unit 204 may receive the designation of an item through a user's operation on the terminal device 23. The output unit 205 outputs location information registered in the item DB 2000 in association with an item ID that identifies the designated item.
[0072] 15 is an explanatory diagram showing an example of output of item location information. The output unit 205 highlights the shelf where the item is located on a map in a predetermined space on the user's terminal device 23. Furthermore, the output unit 205 may display the shelf number, which is location information indicating the location where the item is located, and the item name.
[0073] When an item is carried out of a specified space, such as when the item is shipped or delivered to another location, it is expected that the item will pass through gate 21 again. Therefore, when detection unit 201 detects that an item whose location information is registered in item DB 2000 has passed through gate 21, management unit 202 deletes the location information associated with the item ID in item DB 2000. For example, detection unit 201 can detect that an item tag has passed through gate 21 by reading the item tag via an RFID reader provided in gate 21. When an item tag ID is stored in the item tag, management unit 202 deletes the location information associated with the read item tag ID in item DB 2000.
[0074] The item DB 2000 has a flag indicating whether the item has been shipped, and the management unit 202 may change the shipped flag from a state indicating that the item has not been shipped to a state indicating that the item has been shipped when it detects that the item tag has passed through the gate 21. Note that, for example, the management unit 202 may change the shipped flag in the item DB 2000 from a state indicating that the item has not been shipped to a state indicating that the item has been shipped, without deleting the location information registered in the item DB 2000.
[0075] 16 is an explanatory diagram showing an example in which location information registered in the item DB 2000 shown in FIG. 14 is deleted. The management unit 202 deletes the location information associated with the item ID "PD1." As shown in FIG. 16, the management unit 202 may also update the date and time when the item ID "PD1" was associated with the item ID to the date and time of deletion.
[0076] 17 is a flowchart showing an example of the operation of the management device 20. Here, an example will be described in which the position of an RFID tag is detected by an RFID reader mounted on a drone 24. The management device 20 detects the passage of a person tag and an article tag through the gate 21 by the RFID reader provided in the gate 21 (step S201).
[0077] Next, the control unit 203 controls the drone 24 to track the person and the item (step S202). The detection unit 201 detects the positions of the person tag and the item tag by reading the person tag and the item tag with an RFID reader mounted on the drone 24 (step S203). In step S203, the detection unit 201 can detect the positions of the person tag and the item tag using the position tag read by the RFID reader mounted on the drone 24. Note that the tracking of the person tag and the item tag by the drone 24 in step S202 is carried out continuously at the same time as step S203.
[0078] The management unit 202 determines whether the item tag is staying based on the item tag location history information 2100 (step S204). If the item tag is not staying (step S204: No), the detection unit 201 returns to step S203.
[0079] If the item tag is present (step S204: Yes), the management unit 202 determines whether the person tag and the item tag are separated (step S205). If the person tag and the item tag are not separated (step S205: No), the detection unit 201 returns to step S203.
[0080] If the person tag and the item tag are separated from each other (step S205: Yes), the management unit 202 registers the location information of the item tag as the location information of the item in the item DB 2000 (step S206), and the management device 20 ends the series of processes shown in Fig. 17. Note that the order of steps S204 and S205 is not particularly limited.
[0081] In the above examples, an example of reading an item tag and a person tag using an RFID reader mounted on the drone 24 has been described. An example of reading an item tag and a person tag using a plurality of RFID readers fixedly arranged in a predetermined space, and an example of using an AR marker will be described.
[0082] <Example of Reading by Multiple Fixedly Arranged RFID Readers> For example, an example in which multiple RFID readers are fixedly arranged in a predetermined space will be described.
[0083] FIG. 18 is an explanatory diagram showing a second example of a connection between the management device 20 and another device. In FIG. 18, an example of registering location information of an item by reading RFID tags with a plurality of RFID readers 25 will be described in detail. A plurality of RFID readers 25-1 to 25-n are installed at different positions in a predetermined space. For example, the plurality of RFID readers 25-1 to 25-n may be fixedly arranged, and their respective positions may be determined in advance. m is an integer of 2 or greater.
[0084] The management device 20 may be connected to a plurality of RFID readers 25-1 to 25-n via a communication network. When the management device 20 sends a read instruction to each RFID reader 25, the RFID reader 25 can output a read radio wave to an antenna mounted on the RFID reader 25. For example, the plurality of RFID readers 25 may perform reading at all times. The number of RFID readers 25 is not particularly limited, and may be n, where n is an integer of 2 or greater.
[0085] The gate 21 with an RFID reader and the user terminal device 23 are the same as those in the example shown in FIG.
[0086] In an example in which person tags and item tags are read by a plurality of RFID readers 25 , the management device 20 may be configured to include a detection unit 201 , a management unit 202 , a reception unit 204 , and an output unit 205 .
[0087] The detection unit 201 detects the positions of the item tags and the person tags by reading the item tags and the person tags using a plurality of RFID readers 25 .
[0088] FIG. 19 is an explanatory diagram showing an example of installation of multiple RFID readers 25. In FIG. 19, multiple RFID readers 25 may be installed, for example, on each shelf. When an RFID reader 25 is installed on each shelf, the detection unit 201 reads item tags and person tags using the multiple RFID readers 25. The detection unit 201 may detect, as the location of the item, the position of the RFID reader 25 that has the strongest reception strength from the item tag among the multiple RFID readers 25. The detection unit 201 may register position information indicating the position of the detected item in the item tag position history information 2100. The detection unit 201 may detect, as the location of the person, the position of the RFID reader 25 that has the strongest reception strength from the person tag among the multiple RFID readers 25. The detection unit 201 may register position information indicating the position of the detected person in the person tag position history information 2101. Alternatively, multiple antennas may be connected to one RFID reader 25, and the antennas may be installed on each shelf. That is, one RFID reader 25 may be installed for a plurality of shelves, and an antenna may be installed for each shelf.
[0089] The management unit 202 registers the position information of the item tag when the item tag stops and the position of the person tag and the position of the item tag are separated as the position information of the item based on the position history information 2100 of the item tag and the position history information 2101 of the person tag.
[0090] The management unit 202 determines whether the item tag has stopped based on the item tag position history information 2100. The management unit 202 determines whether the position of the person tag and the position of the item tag are separated based on the item tag position history information 2100 and the person tag position history information 2101. For example, if the item tag has stopped and the position of the person tag and the position of the item tag are separated, the management unit 202 registers the position information of the item tag in the item DB 2000 as item position information. Note that the item DB 2000 may be similar to the example shown in FIG. 8 .
[0091] <Examples Using AR Markers> Next, examples using AR markers will be described. An example in which a person AR marker and an object AR marker are read by an imaging device mounted on a drone, and an example in which a person AR marker and an object AR marker are read by multiple imaging devices will be described.
[0092] <Example of Reading by an Imaging Device Mounted on a Drone> First, an example of reading a person AR marker and an article AR marker by an imaging device mounted on a drone will be described.
[0093] FIG. 20 is an explanatory diagram showing a third example of a connection between the management device 20 and another device. In FIG. 20 , for example, an example of registering the position information of an item by reading an AR marker with an imaging device will be described in detail. In FIG. 20 , for example, an example of registering the position information of an item by reading an AR marker with an imaging device mounted on a drone 27 will be described in detail. The drone 27 is an example of a mobile device. The mobile device may be, for example, an AGV, a robot, or the like, and is not limited to the drone 27. The drone 27 may be waiting near a predetermined position.
[0094] The management device 20 may be connected to a drone 27 equipped with an imaging device via a communication network. When the management device 20 sends a reading instruction to the drone 27, the imaging device equipped on the drone 27 captures an image of the person AR markers and the article AR markers and reads the person AR markers and the article AR markers from the captured image. The imaging device equipped on the drone 27 may also perform reading at all times.
[0095] The management device 20 may also be connected to the imaging device 26 via a communication network. For example, the imaging device 26 may be installed at a predetermined position, such as an entrance. The imaging device 26 may constantly read the AR markers. The imaging device 26 may be installed at a predetermined position, for example.
[0096] The user terminal device 23 is the same as the example shown in FIG.
[0097] A person is assigned a person AR marker that can identify the person. The person's position history information is position history information of the person AR marker. The person AR marker's position history information may include position information and date and time so that the transition in the position of the person AR marker can be identified, similar to the person tag's position history information 2101. An item AR marker that can identify the item is assigned to an item. The item's position history information is position history information of the item AR marker. The item AR marker's position history information may include position information and date and time so that the transition in the position of the item AR marker can be identified, similar to the item tag's position history information 2100.
[0098] In an example in which a person AR marker and an object AR marker are read using an imaging device mounted on a drone 27, the management device 20 may be configured to include a detection unit 201, a management unit 202, a control unit 203, a reception unit 204, and an output unit 205.
[0099] 21 is an explanatory diagram showing an example of an item DB 2000 when an AR marker is used. The item DB 2000 stores an item ID, an item AR marker ID, location information, and the last update date and time in association with each other. For example, the item ID is an example of identification information for identifying an item. The item marker AR ID is an example of identification information for identifying an item AR marker attached to an item.
[0100] For example, if an item AR marker ID is stored in an item AR marker, when the item AR marker ID stored in the item AR marker is read, the item ID associated with the item AR marker ID in item DB2000 is identified, making it possible to identify the item to which the item AR marker is attached.
[0101] In FIG. 21, for example, according to the item DB 2000, an item AR marker identified by an item AR marker ID "PDMark01" is attached to an item identified by an item ID "PD1", and the location information of the item has not yet been registered.
[0102] The detection unit 201 detects the passage of the person AR marker and the article AR marker through a predetermined position by reading the person AR marker and the article AR marker via the imaging device 26 installed at a predetermined position such as an entrance.
[0103] When the control unit 203 detects that the article AR marker and the person AR marker have passed through a predetermined position, it controls the drone 27 equipped with an imaging device to track either the person AR marker or the article AR marker.
[0104] Here, there is no particular limitation as to whether the object AR marker or the person AR marker is tracked. For example, the control unit 203 controls the drone 24 to be positioned so that the AR marker of the tracking target can be read by an imaging device provided in the drone 27. This allows the control unit 203 to track either the object AR marker or the person AR marker.
[0105] The detection unit 201 then detects the positions of the person AR marker and the item AR marker by reading the person AR marker and the item AR marker using an imaging device mounted on the drone 27. Position AR markers that can identify each position in the specified space are attached to the specified space. For example, the position AR markers may be attached to shelves or to the floor. A plurality of position AR markers may be attached. Note that, similar to position tags, the position AR markers may be attached to individual shelves, and are not particularly limited. The detection unit 201 detects the positions of the person AR marker and the item AR marker by reading the position AR marker. For example, similar to the position tag DB 2001, a position AR marker DB may manage position information that indicates the positions where the position AR markers are attached.
[0106] The management unit 202 registers, as the position information of the article AR marker, the position information of the article AR marker when the article AR marker has stopped and the position of the person AR marker is separated from the position of the article AR marker, based on the position history information of the article AR marker and the position history information of the person AR marker. As a method of determining whether the article AR marker has stopped, the management unit 202 determines whether the article AR marker has stopped based on the position history information of the article AR marker, depending on whether the article AR marker has been staying for a predetermined period of time or more. When the drone 27 is tracking the article AR marker, if the article AR marker and the person AR marker become separated, it is expected that the imaging device mounted on the drone 27 will not be able to capture an image of the person AR marker. For this reason, the detection unit 201 will not be able to detect the position of the person AR marker. In such a case, the management unit 202 can detect the position of the article AR marker based on the position history information of the article AR marker and the position history information of the person AR marker, but if the position of the person AR marker cannot be detected, it can determine that the position of the person AR marker and the position of the article AR marker are far apart. Note that, as in the example of the RFID tag, the drone 27 may track the person AR marker.
[0107] Furthermore, when the management unit 202 completes the registration of the position information, the detection unit 201 may terminate the process of detecting the positions of the article AR markers and the person AR markers. Therefore, the control unit 203 terminates tracking of the item tags by the mobile device. For example, if the drone 27 is kept waiting near a predetermined position in advance, the control unit 203 may control the drone 27 to return to the predetermined position.
[0108] Similarly to the example of the RFID tag, after the location information of the item is registered, the detection unit 201 detects that the item AR marker has passed through a predetermined position via the imaging device 26 installed at the predetermined position. That is, it is expected that the item will be detected as having been taken out after being placed somewhere within a predetermined space. Therefore, when the management unit 202 detects that the item AR marker has passed through a predetermined position, the management unit 202 may delete the registered location information of the item.
[0109] Also, similar to the example of the RFID tag, the item DB 2000 may have a flag indicating whether the item has been shipped. When the management unit 202 detects that the item AR marker has passed a predetermined position, the management unit 202 may change the shipped flag from a state indicating that the item has not been shipped to a state indicating that the item has been shipped. Note that, for example, the management unit 202 may change the shipped flag in the item DB 2000 from a state indicating that the item has not been shipped to a state indicating that the item has been shipped without deleting the location information registered in the item DB 2000.
[0110] <Example of Reading Using Multiple Fixedly Arranged Imaging Devices> Next, an example of reading person AR markers and article AR markers using multiple imaging devices will be described.
[0111] FIG. 22 is an explanatory diagram showing a fourth example of a connection between the management device 20 and other devices. In FIG. 22, an example of registering the location information of an item using AR markers read by a plurality of imaging devices will be described in detail. A plurality of imaging devices 28-1 to 28-m are installed at different positions in a predetermined space. For example, the plurality of imaging devices 28-1 to 28-m may be fixedly arranged, with their respective positions determined in advance. m is an integer of 2 or greater.
[0112] The management device 20 is connected to a plurality of image capturing devices 28-1 to 28-m via a communication network. The plurality of image capturing devices 28-1 to 28-m capture images of person AR markers and object AR markers. The plurality of image capturing devices 28-1 to 28-m8 may be capable of capturing images at all times.
[0113] The user's terminal device 23 is the same as the example shown in Fig. 3. The imaging device 26 installed at the entrance is the same as the example shown in Fig. 20.
[0114] Fig. 23 is an explanatory diagram showing an example of the installation of a plurality of image capture devices. In Fig. 23, image capture device 28 may be installed so as to be able to read the article AR markers of articles placed on each shelf. Image capture device 28 may also be installed so as to be able to read the person AR markers of people passing in front of the shelves and the article AR markers carried by the people.
[0115] In an example in which person AR markers and object AR markers are read using multiple imaging devices 28-1 to 28-m, the management device 20 may be configured to include a detection unit 201, a management unit 202, a reception unit 204, and an output unit 205.
[0116] The detection unit 201 detects the positions of the person AR markers and the article AR markers by reading the person AR markers and the article AR markers using the multiple image capture devices 28-1 to 28-m. For example, the image capture devices 28 may be installed on separate shelves. If the shelves that can be read by each image capture device 28 are determined, the detection unit 201 may detect, as the position of the person and the position of the item, the position of the shelf that corresponds to the image capture device 28 that reads the article AR marker and the person AR marker, among the multiple image capture devices 28-1 to 28-m.
[0117] As another method for detecting positions, position AR markers may be used. Position AR markers that can identify positions in a predetermined space are attached to the predetermined space. For example, the position AR markers may be attached to a shelf or a floor. A plurality of position AR markers may be attached. The detection unit 201 detects the positions of the person AR marker and the object AR marker by reading the position AR markers.
[0118] The management unit 202 registers, as the position information of the article, the position information of the article AR marker when the article AR marker has stopped and the position of the person AR marker is separated from the position of the article AR marker, based on the position history information of the article AR marker and the position history information of the person AR marker. For example, when the article AR marker includes an article AR marker ID, the management unit 202 registers the position information of the article in association with the article AR marker ID in the article DB 2000.
[0119] As a method for determining whether an article AR marker is stationary, the management unit 202 determines whether an article AR marker is stationary based on whether the article AR marker stays for a predetermined time or more.
[0120] The detection unit 201 detects the passage of the person AR marker and the article AR marker through a predetermined position by reading the person AR marker and the article AR marker via the imaging device 26 installed at a predetermined position.
[0121] After the position information of the article is registered, the detection unit 201 detects that the article AR marker has passed a predetermined position via the imaging device 26 installed at the predetermined position. Then, when the management unit 202 detects that the article AR marker has passed the predetermined position, it deletes the registered position information of the article.
[0122] As described above, in the second embodiment, the management device 20 detects, via an RFID reader, the positions of person tags attached to people who simultaneously pass a predetermined position in a predetermined space and the positions of item tags attached to items carried by the people. Then, based on the historical position information of the person tags and the item tags, the management device 20 registers, as item position information, position information indicating the position of the item tag when the item tag stops and the person tag separates from the item tag. For example, the management device 20 determines whether the item tag is stopped based on whether the item tag remains stationary for a predetermined period of time or more. The positions of items and people can be detected using RFID tags even in environments such as indoors where GPS cannot be used. This allows the location of an item to be easily registered using RFID tags. This also eliminates the need for users to register location information indicating the location of an item.
[0123] When the management device 20 detects the passage of a person or an item through a predetermined location, it controls a mobile device equipped with an RFID reader to track either the person tag or the item tag. This makes it possible to detect the location of the person and the item. For example, when using fixed RFID readers, a large number of RFID readers must be installed in a large space. By using a drone, the effort required for installing RFID readers can be reduced.
[0124] For example, a location tag, which is an RFID tag that stores location information that can identify a location in the space, is installed in a predetermined space, and the management device 20 detects the locations of the person tag and the item tag by reading the location tag. This makes it possible to detect the location of a person and the location of an item with a simple configuration.
[0125] The management device 20 detects the passage of the person tag and the item tag through a predetermined location by reading the person tag and the item tag via an RFID reader provided at a gate installed at a predetermined location, thereby making it possible to identify with a simple configuration whether a person is carrying an item.
[0126] After the location information of the item is registered, the management device 20 detects that the item tag has passed a predetermined position via an RFID reader provided at the gate. When the management device 20 detects that the item tag has passed a predetermined position, it deletes the registered location information of the item. The management device 20 may also register that the item has been shipped. This makes it possible to register with a simple configuration that the item is no longer in the predetermined space.
[0127] A plurality of RFID readers are installed at different positions in a predetermined space, and the management device 20 detects the positions of the person tags and the item tags by reading the person tags and the item tags with the plurality of RFID readers, thereby making it possible to detect the positions of the person and the item.
[0128] Furthermore, the management device 20 detects the positions of the person AR marker and the article AR marker by reading the person AR marker and the article AR marker using an imaging device. Based on the historical information of the position of the article AR marker and the historical information of the position of the person AR marker, the management device 20 registers the position information of the article AR marker when the article AR marker stops and the position of the person AR marker is separated from the position of the article AR marker as the position information of the item. For example, the management device 20 determines whether the item tag is stopped based on whether the item AR marker remains stationary for a predetermined period of time or more. The positions of items and people can be detected using RFID tags even in environments where GPS cannot be used, such as indoors. This allows the position of an item to be easily registered using an RFID tag. This also eliminates the need for a user to register position information indicating the position of an item.
[0129] When the management device 20 detects the passage of a person or an object through a predetermined location, the management device 20 controls a mobile device equipped with an imaging device to track either the person AR marker or the object AR marker. For example, when using fixedly installed imaging devices, a large number of imaging devices must be installed in a large space. By using a drone, the effort required for installing imaging devices can be reduced compared to such cases.
[0130] The management device 20 detects the positions of the person AR markers and the object AR markers by reading the position AR markers, thereby enabling the position of the person and the object to be detected with a simple configuration.
[0131] The management device 20 detects the passage of the person AR marker and the item AR marker through a predetermined position by reading the person AR marker and the item AR marker via an imaging device provided at a gate installed at a predetermined position, thereby making it possible to identify with a simple configuration that a person is carrying an item.
[0132] After the location information of the item is registered, the management device 20 detects that the item AR marker has passed a predetermined position via an imaging device provided at the gate. When the management device 20 detects that the item AR marker has passed a predetermined position, it deletes the registered location information of the item. The management device 20 may also register that the item has been shipped. This makes it possible to register with a simple configuration that the item is no longer in the predetermined space.
[0133] A plurality of imaging devices are installed at different positions in a predetermined space, and the management device 20 detects the positions of the person AR markers and the article AR markers by reading the person AR markers and the article AR markers using the plurality of imaging devices, thereby making it possible to detect the positions of the person and the article.
[0134] The management device 20 outputs the location information of the registered item to the user's terminal device 23. For example, the management device 20 outputs, on a map showing a predetermined space, that the item is located at the location indicated by the location information of the registered item. This makes it easy to search for luggage or carts even in a large warehouse, thereby reducing the effort required for searching.
[0135] For example, the example using an RFID tag and the example using an AR marker may be combined. Both an AR marker and an RFID tag may be attached to an item, and both an AR marker and an RFID tag may be attached to a person. For example, in an example in which an AR marker is tracked by a drone 27, the passage of a person and an item through a predetermined position may be detected using an RFID tag. Furthermore, the example using the drone 24 and the example in which multiple RFID readers 25 are fixedly arranged may be combined. Furthermore, the example using the drone 27 and the example in which multiple image capturing devices 28 are fixedly arranged may be combined. Furthermore, the processing described in the example using an RFID tag may be applied to the example using an AR marker, as appropriate, and the processing described in the example using an AR marker may be applied to the example using an RFID tag.
[0136] Furthermore, although an example of an item DB that manages location information for each item has been described, for example, a database that manages the locations of items may also be one that registers item identification information for each item by location information.
[0137] The above is the description of each embodiment. The embodiments may be combined or modified.
[0138] Furthermore, the management devices 10 and 20 may be configured to include some of the functional units and information. For example, since the control unit 203 is a functional unit for controlling a drone, if a drone is not used, the management device 20 may be configured to include a detection unit 201, a management unit 202, a reception unit 204, and an output unit 205. The management device 20 may be configured to include the detection unit 201, the management unit 202, and the control unit 203. The functional units included in the management device 20 are not particularly limited. Furthermore, the management devices 10 and 20 may have other functional units not shown.
[0139] Furthermore, the embodiments are not limited to the examples described above and can be modified in various ways. Furthermore, the configuration of the management devices 10 and 20 is not particularly limited. For example, the functional units of the management devices 10 and 20 may be implemented by a single device. Alternatively, for example, each functional unit or database of the management devices 10 and 20 may be implemented by a different device, and configured as a system. For example, each functional unit of the management device 20 may be implemented by multiple servers, and configured as a system. For example, it may be implemented by a database server including each database and a server having each functional unit.
[0140] In addition, in the embodiment, each database may include part of the information described above. Also, each piece of information may include information other than the information described above.
[0141] Furthermore, the process of generating information to be displayed on the terminal device 23 may be performed by a functional unit included in the management device 20, such as the output unit 205. This process may also be performed by the terminal device 23. That is, the terminal device 23 may generate information for a screen to be displayed on the terminal device 23 based on data received from the management devices 10 and 20, and display the screen.
[0142] (Example of Computer Hardware Configuration) Next, an example of a hardware configuration in which each device, such as the management devices 10 and 20 and the terminal device 23, is realized by a computer will be described.
[0143] 24 is an explanatory diagram showing an example of the hardware configuration of a computer. For example, some or all of the devices can be realized using any combination of a computer 80 and a program as shown in FIG.
[0144] The computer 80 includes, for example, a processor 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, and a storage device 804. The computer 80 also includes a communication interface 805 and an input / output interface 806. The components are connected to each other, for example, via a bus 807. The number of each component is not particularly limited, and there may be one or more of each component.
[0145] The processor 801 controls the entire computer 80. The processor 801 may be, for example, a central processing unit (CPU), a digital signal processor (DSP), a graphics processing unit (GPU), a physics processing unit (PPU), a tensor processing unit (TPU), a quantum processor, or a combination thereof, and is not particularly limited.
[0146] The computer 80 also includes a ROM 802, a RAM 803, and a storage device 804. Examples of the storage device 804 include semiconductor memory such as flash memory, a hard disk drive (HDD), and a solid state drive (SSD). For example, the storage device 804 stores an operating system (OS) program, application programs, and programs according to the embodiments. Alternatively, the ROM 802 stores application programs and programs according to the embodiments. The RAM 803 is used as a work area for the processor 801.
[0147] The processor 801 also loads programs stored in the storage device 804, ROM 802, etc. The processor 801 then executes each process coded in the program. The processor 801 may also download various programs via the communication network NT. The processor 801 also functions as a part or all of the computer 80. The processor 801 may then execute the processes or instructions in the illustrated flowchart based on the program.
[0148] The communication interface 805 is connected to a communication network NT such as a LAN (Local Area Network) or a WAN (Wide Area Network) via a wireless or wired communication line. The communication network NT may be composed of multiple communication networks NT. As a result, the computer 80 is connected to external devices and external computers 80 via the communication networks NT. The communication interface 805 serves as an interface between the communication network NT and the inside of the computer 80. The communication interface 805 also controls the input and output of data from external devices and external computers 80.
[0149] Furthermore, the input / output interface 806 is connected to at least one of an input device, an output device, and an input / output device. The connection method may be wireless or wired. Examples of the input device include a keyboard, a mouse, and a microphone. Examples of the output device include a display device, a lighting device, and an audio output device that outputs audio. Examples of the input / output device include a touch panel display. Note that the input device, output device, and input / output device may be built into the computer 80 or may be external.
[0150] The hardware configuration of the computer 80 is an example. The computer 80 may have some of the components shown in FIG. 24 . The computer 80 may have components other than those shown in FIG. 24 . For example, the computer 80 may have a drive device or the like. The processor 801 may then read programs and data stored on a recording medium attached to the drive device or the like into the RAM 803. Examples of non-transitory tangible recording media include optical disks, flexible disks, magneto-optical disks, and USB (Universal Serial Bus) memories. As described above, the computer 80 may have input devices such as a keyboard and a mouse. The computer 80 may have an output device such as a display. The computer 80 may also have an input device, an output device, and an input / output device.
[0151] The computer 80 may also include various sensors (not shown). The types of sensors are not particularly limited. The computer 80 may also include an imaging device capable of capturing images or videos.
[0152] This concludes the description of the hardware configuration of each device. There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.
[0153] Furthermore, some or all of the components of each device may be realized by circuits for specific applications. Furthermore, some or all of the components of each device may be realized by general-purpose circuits such as FPGAs (Field Programmable Gate Arrays). Furthermore, some or all of the components of each device may be realized by a combination of circuits for specific applications and general-purpose circuits. These circuits may be a single integrated circuit. Alternatively, these circuits may be divided into multiple integrated circuits. The multiple integrated circuits may be connected via a bus or the like.
[0154] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be centrally located or distributed.
[0155] The management methods described in the respective embodiments may be implemented by a computer such as the management devices 10 and 20 .
[0156] Each program described in each embodiment is recorded on a computer-readable recording medium such as a HDD, SSD, flexible disk, optical disk, magneto-optical disk, or USB memory. Each program is executed by being read from the recording medium by a computer. Each program may also be distributed via a communication network NT.
[0157] The functions of each of the components of management device 10 and management device 20 described above may be realized by dedicated hardware, such as a computer. Alternatively, each component may be realized by software. Alternatively, each component may be realized by a combination of hardware and software.
[0158] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. The configuration and details of each of the present disclosures may include embodiments to which various modifications that would be apparent to those skilled in the art are applied within the scope of the present disclosure. The present disclosure may include embodiments in which the features described herein are appropriately combined or substituted as necessary. For example, features described using a particular embodiment may also be applied to other embodiments to the extent that no contradiction occurs. For example, although multiple operations are described in sequence in the form of a flowchart, the order of description does not limit the order in which the multiple operations are performed. Therefore, when implementing the embodiments, the order of the multiple operations may be changed as long as the content is not affected.
[0159] Some or all of the above-described embodiments can be described as follows: However, some or all of the above-described embodiments are not limited to the following.
[0160] (Supplementary Note 1) A management device comprising: a detection means for detecting the positions of a person and an item carried by said person who simultaneously pass a predetermined position in a predetermined space; and a management means for registering position information indicating the position of said item when said item stops and said person moves away from said item, based on historical information of the respective positions of said person and said item.
[0161] (Supplementary Note 2) The person is attached with a person tag which is an RFID tag that stores information that can identify the person; the item is attached with an item tag which is an RFID tag that stores information that can identify the item; the person's location history information is location history information of the person tag; the item tag's location history information is location history information of the item tag; the detection means detects the location of the person tag and the item tag by reading the person tag and the item tag via an RFID reader; and the management means registers the location information of the item tag when the item tag has stopped and the location of the person tag and the location of the item tag are separated as location information of the item, based on the location history information of the item tag and the location history information of the person tag.
[0162] (Supplementary Note 3) The management device according to Supplementary Note 2, wherein the management means determines whether the item tag is stopped based on whether the item tag remains there for a predetermined time or more.
[0163] (Supplementary Note 4) The management device according to Supplementary Note 2 or 3, further comprising: a control means for controlling a mobile device equipped with the RFID reader to track either the person tag or the item tag when the passage of the person and the item through the predetermined position is detected.
[0164] (Appendix 5) The management device described in Appendix 4, wherein a position tag, which is an RFID tag that stores position information that can identify a position in the specified space, is installed in the specified space, and the detection means detects the positions of the person tag and the item tag by reading the position tag.
[0165] (Supplementary Note 6) The management device according to any one of Supplementary Notes 2 to 5, wherein the detection means detects the passage of the person tag and the item tag through the predetermined position by reading the person tag and the item tag via an RFID reader provided at a gate installed at the predetermined position.
[0166] (Supplementary Note 7) The management device described in Supplementary Note 6, wherein the detection means detects that the item tag has passed the predetermined position via an RFID reader provided at the gate after the location information of the item has been registered, and the management means deletes the registered location information of the item when it detects that the item tag has passed the predetermined position.
[0167] (Appendix 8) A management device as described in Appendix 2 or Appendix 3, wherein a plurality of the RFID readers are installed at different positions in the specified space, and the detection means detects the positions of the person tags and the item tags by reading the person tags and the item tags using the plurality of RFID readers.
[0168] (Supplementary Note 9) The management device according to Supplementary Note 1, wherein the person is affixed with a person AR marker that allows the person to be identified, the item is affixed with an item AR marker that allows the item to be identified, the position history information of the person is position history information of the person AR marker, and the position history information of the item is position history information of the item AR marker, the detection means detects the positions of the person AR marker and the item AR marker by reading the person AR marker and the item AR marker with an imaging device, and the management means registers, based on the position history information of the position of the item AR marker and the position history information of the person AR marker, the position information of the item AR marker when the item AR marker has stopped and the position of the person AR marker and the position of the item AR marker are separated, as position information of the item.
[0169] (Supplementary Note 10) The management device according to Supplementary Note 9, wherein the management means determines whether the article AR marker is stationary based on whether the article AR marker remains stationary for a predetermined period of time or more.
[0170] (Supplementary Note 11) The management device according to Supplementary Note 9 or Supplementary Note 10, comprising: a control means for controlling a mobile device equipped with the imaging device to track either the person AR marker or the item AR marker when the passage of the person and the item through the predetermined position is detected.
[0171] (Supplementary Note 12) The management device according to Supplementary Note 11, wherein position AR markers capable of identifying positions in the predetermined space are attached to the predetermined space, and the detection means detects positions of the person AR marker and the object AR marker by reading the position AR markers.
[0172] (Supplementary Note 13) The management device according to any one of Supplementary Note 9 to Supplementary Note 12, wherein the detection means detects the passage of the person AR marker and the article AR marker through the predetermined position by reading the person AR marker and the article AR marker via an imaging device provided at a gate installed at the predetermined position.
[0173] (Supplementary Note 14) The management device described in Supplementary Note 13, wherein the detection means detects that the article AR marker has passed the specified position via an imaging device provided at the gate after the position information of the article has been registered, and the management means deletes the registered position information of the article when it detects that the article AR marker has passed the specified position.
[0174] (Supplementary Note 15) The management device according to Supplementary Note 9 or Supplementary Note 10, wherein a plurality of the imaging devices are installed at different positions in the predetermined space, and the detection means detects the positions of the person AR marker and the article AR marker by reading the person AR marker and the article AR marker using the plurality of imaging devices.
[0175] (Supplementary Note 16) The management device according to any one of Supplementary Note 1 to Supplementary Note 15, further comprising: an output unit that outputs position information of the registered item to a terminal device of a user.
[0176] (Supplementary Note 17) The management device according to Supplementary Note 16, wherein the output means outputs, on a map showing the predetermined space, information indicating that the item is located at a position indicated by registered position information of the item.
[0177] (Supplementary Note 18) The management device according to Supplementary Note 7 or Supplementary Note 13, wherein the management means registers that the item has been shipped.
[0178] (Supplementary Note 19) A management method in which a computer detects the positions of a person and an item carried by said person who simultaneously pass through a predetermined position in a predetermined space, and registers position information indicating the position of said item when said item stops and said person moves away from said item, based on historical information of the respective positions of said person and said item.
[0179] (Supplementary Note 20) A non-transitory computer-readable recording medium that records a program for causing a computer to execute the following process: detect the positions of a person and an item carried by said person who simultaneously pass a predetermined position in a predetermined space; and register position information indicating the position of said item when said item stops and said person moves away from said item, based on historical information of the respective positions of said person and said item.
[0180] (Supplementary Note 21) A program that causes a computer to execute a process of detecting the positions of a person and an item carried by said person who simultaneously pass through a predetermined position in a predetermined space, and registering position information indicating the position of said item when said item stops and said person moves away from said item based on historical information of the respective positions of said person and said item.
[0181] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 18, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 19, 20, and 21 in the same dependent relationship as Supplementary Notes 2 to 18. Furthermore, not limited to Supplementary Notes 1, 19, 20, and 21, but also various hardware, software, various recording means for recording software, or systems may be made to be dependent on some or all of the configurations described as Supplements, within the scope of each of the above-mentioned embodiments.
[0182] 10, 20 Management device 21 Gate 23 Terminal device 24, 27 Drone 25, 25-1 to 25-m RFID reader 26, 28, 28-1 to 28-m Imaging device 80 Computer 101, 201 Detection unit 102, 202 Management unit 203 Control unit 204 Reception unit 205 Output unit 801 Processor 802 ROM 803 RAM 804 Storage device 805 Communication interface 806 Input / output interface 807 Bus 2100 Location history information of item tag 2101 Location history information of person tag 2000 Item DB 2001 Location tag DB NT Communication network
Claims
1. A management device comprising: detection means for detecting the positions of a person who has simultaneously passed through a predetermined position within a predetermined space and an article carried by the person; and management means for registering position information indicating the position of the article when the article stops and the person leaves the article, based on the history information of the respective positions of the person and the article.
2. The management device according to claim 1, wherein the person is attached with a person tag which is an RFID (Radio Frequency Identification) tag storing information capable of identifying the person, the article is attached with an article tag which is an RFID tag storing information capable of identifying the article, the history information of the position of the person is the history information of the position of the person tag, the history information of the position of the article tag is the history information of the position of the article tag, the detection means detects the positions of the person tag and the article tag by reading the person tag and the article tag via an RFID reader, and the management means registers, as the position information of the article, the position information of the article tag when the article tag stops and the positions of the person tag and the article tag are separated, based on the history information of the position of the article tag and the history information of the position of the person tag.
3. The management device according to claim 2, wherein the management means determines whether the article tag has stopped depending on whether the article tag has stayed for a predetermined time or more.
4. The management device according to claim 2 or 3, further comprising control means for controlling a mobile device provided with the RFID reader to track either the person tag or the article tag when the passage of the person and the article through the predetermined position is detected.
5. The management device according to claim 4, wherein a position tag which is an RFID tag storing position information capable of specifying a position within the predetermined space is installed in the predetermined space, and the detection means detects the positions of the person tag and the article tag by reading the position tag.
6. The management device according to any one of claims 2 to 5, wherein the detection means detects the passage of the person tag and the article tag through the predetermined position by reading the person tag and the article tag via an RFID reader provided in a gate installed at the predetermined position.
7. After the position information of the article is registered, the detection means detects that the article tag has passed through the predetermined position via the RFID reader provided in the gate. When the management means detects that the article tag has passed through the predetermined position, it deletes the registered position information of the article. The management device according to claim 6.
8. A plurality of the RFID readers are installed at different positions in the predetermined space. The detection means detects the positions of the person tag and the article tag by reading the person tag and the article tag with the plurality of RFID readers. The management device according to claim 2 or claim 3.
9. The person is attached with a person AR (Argumented Reality) marker that can identify the person. The article is attached with an article AR marker that can identify the article. The history information of the position of the person is the history information of the position of the person AR marker. The history information of the position of the article is the history information of the position of the article AR marker. The detection means detects the positions of the person AR marker and the article AR marker by reading the person AR marker and the article AR marker with an imaging device. The management means registers the position information of the article AR marker when the article AR marker stops and the positions of the person AR marker and the article AR marker are separated based on the history information of the position of the article AR marker and the history information of the position of the person AR marker as the position information of the article. The management device according to claim 1.
10. The management means determines whether the article AR marker has stopped depending on whether the article AR marker has stayed for a predetermined time or more. The management device according to claim 9.
11. Control means for controlling a mobile device provided with the imaging device so as to track either the person AR marker or the article AR marker when the passage of the person and the article through the predetermined position is detected. The management device according to claim 9 or claim 10, comprising the control means.
12. In the predetermined space, a position AR marker capable of specifying a position in the predetermined space is attached, and the detection means detects the positions of the person AR marker and the article AR marker by reading the position AR marker. The management device according to claim 11.
13. The detection means detects passage through the predetermined position with the person AR marker and the article AR marker by reading the person AR marker and the article AR marker via an imaging device provided in a gate installed at the predetermined position. The management device according to any one of claims 9 to 12.
14. After the position information of the article is registered, the detection means detects that the article AR marker has passed through the predetermined position via the imaging device provided in the gate. When the management means detects that the article AR marker has passed through the predetermined position, the management means deletes the registered position information of the article. The management device according to claim 13.
15. A plurality of the imaging devices are installed at different positions in the predetermined space, and the detection means detects the positions of the person AR marker and the article AR marker by reading the person AR marker and the article AR marker with the plurality of imaging devices. The management device according to claim 9 or claim 10.
16. The mobile device is a drone. The management device according to any one of claims 4, 5, 11, and 12.
17. An output means for outputting the registered position information of the article. The management device according to any one of claims 1 to 16.
18. The output means outputs that there is an article at the position indicated by the registered position information of the article on a map showing the predetermined space. The management device according to claim 17.
19. A computer detects the positions of a person who has simultaneously passed through a predetermined position in a predetermined space and an article carried by the person, and based on the history information of the respective positions of the person and the article, registers position information indicating the position of the article when the article stops and the person leaves the article. A management method.
20. A non-transitory computer-readable recording medium that records a program for causing a computer to execute a process of detecting positions of a person and an article carried by the person that have simultaneously passed through a predetermined position within a predetermined space, and registering position information indicating the position of the article when the article stops and the person leaves the article based on history information of the respective positions of the person and the article.
Citation Information
Patent Citations
Article managing system and method
JP2004326437A
Image capture control device, image capture control method, control program, recording medium storing the control program, image capture control system, and information processing system
JP4736529B2
Automatic dishwashing system, automatic dishwashing method, automatic dishwashing program, and storage medium
JP7018637B2