Information processing device, management system, information processing method, and program

Abstract

Provided are an information processing device, a management system, an information processing method, and a program that can more reliably manage articles. This information processing device is provided with: a movement line identification unit that identifies the movement line of the movement of an object within a prescribed region near a gate; an RSSI acquisition unit that acquires an RSSI of a signal from an RFID tag near the gate; a passage determination unit that, on the basis of the identified movement line and the acquired RSSI, determines whether or not an article identified from discrimination information read from the RFID tag has passed through the gate; an image information acquisition unit that acquires image information which includes characteristic information regarding an object identified by image recognition performed on an image capturing the interior of the region; and a management unit that links and manages the image information and the identified article.

Description

Information processing device, management system, information processing method and program

[0001] The present disclosure relates to an information processing device, a management system, an information processing method, and a program.

[0002] In recent years, various technologies using RFID (Radio Frequency Identifier) ​​have been proposed. For example, Patent Document 1 discloses a system that uses RFID tags to manage whether or not an article has passed through a gate. The technology described in this document uses the received signal strength indicator (RSSI) of a signal from the RFID tag to determine whether or not an article to which the RFID tag is attached has passed through the gate.

[0003] Japanese Patent Application Laid-Open No. 2022-135731 Japanese Patent Application Laid-Open No. 2023-526362 Japanese Patent Application Laid-Open No. 2023-023177 Japanese Patent Application Laid-Open No. 2021-127186

[0004] However, while the magnitude of the RSSI generally can be used to determine whether an RFID tag is approaching or moving away from a gate, it cannot determine whether the RFID tag has actually passed through the gate. In other words, there is a risk that an RFID tag (item) that has not actually passed through the gate may be mistakenly determined to have passed through the gate.

[0005] For this reason, when managing whether an item has been carried in or out by reading an RFID tag attached to the item at a gate (carry-in or carry-out), there is a need for technology that can more reliably determine whether the RFID tag has passed through the gate. Furthermore, when items carried in through a carry-in gate are stored in a storage space, there is a need to easily obtain information not only about items being carried out of the storage space through an carry-out gate, but also about items moving within the storage space and items stored in the storage space.

[0006] Therefore, one of the objectives that the embodiments disclosed in this specification aim to achieve is to provide an information processing device, management system, information processing method, and program that can more reliably manage items.

[0007] The information processing device according to the first aspect comprises: a flow path identification unit that identifies the flow path of an object within a specified area near the gate; an RSSI acquisition unit that acquires the RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified flow path and the acquired RSSI; an image information acquisition unit that acquires image information of an imaged subject identified by image recognition of an image captured within the area; and a management unit that links and manages the image information and the identified item.

[0008] The management system according to the second aspect comprises: a sensor that detects objects within a predetermined area near the gate; a reading device that communicates with an RFID tag to read information stored in the RFID tag and measure the RSSI of the signal from the RFID tag; an imaging device that captures images within the area; an image recognition device that performs image recognition on the image captured by the imaging device; and an information processing device, wherein the information processing device has: a flow line identification unit that identifies the flow line of an object within the predetermined area near the gate; an RSSI acquisition unit that acquires the RSSI of the signal from the RFID tag near the gate; a passage determination unit that determines whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of the image target of the identified image by image recognition of the image captured within the area; and a management unit that links and manages the image information and the identified item.

[0009] In the information processing method according to the third aspect, the movement path of an object within a specified area near a gate is identified, the RSSI of the signal from the RFID tag near the gate is acquired, and based on the identified movement path and the acquired RSSI, it is determined whether an item identified by the identification information read from the RFID tag has passed through the gate, image information of the imaged subject of the identified image is acquired by image recognition of an image captured within the area, and the image information is linked to the identified item and managed.

[0010] The program according to the fourth aspect causes a computer to perform the following operations: identify the movement path of an object within a specified area near a gate; acquire RSSI of a signal from an RFID tag near the gate; determine whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified movement path and the acquired RSSI; acquire image information of the imaged subject of the identified image by performing image recognition on an image captured within the area; and manage the image information in association with the identified item.

[0011] According to the above aspects, it is possible to provide an information processing device, a management system, an information processing method, and a program that can more reliably manage items.

[0012] 1 is a block diagram illustrating a configuration of an information processing device according to the present disclosure. FIG. 1 is a block diagram illustrating a configuration of a management system according to the present disclosure. FIG. 2 is a schematic diagram illustrating a storage space to which items managed by the management system according to the present disclosure are moved and stored. FIG. 3 is a schematic diagram illustrating the periphery of a gate according to the present disclosure, showing a view of the gate from the side. FIG. 4 is a schematic diagram illustrating a detection area detected by a sensor according to the present disclosure, showing a view from above. FIG. 5 is a schematic diagram illustrating an imaging area imaged by an imaging device according to the present disclosure, showing a view from above. FIG. 6 is a block diagram illustrating a functional configuration of an information processing device according to the present disclosure. FIG. 7 is a schematic diagram illustrating an example of a flow line that satisfies a start condition for an RFID tag reading process according to the present disclosure. FIG. 8 is a schematic diagram illustrating an example of a flow line that satisfies a start condition for an RFID tag reading process according to the present disclosure. FIG. 9 is a schematic diagram illustrating a flow line that does not satisfy a start condition for an RFID tag reading process according to the present disclosure. FIG. 10 is a schematic diagram illustrating a flow line that does not satisfy a start condition for an RFID tag reading process according to the present disclosure. 1 is a schematic diagram illustrating a flow line that satisfies an end condition of an RFID tag reading process according to the present disclosure. FIG. 1 is a schematic diagram illustrating a flow line that satisfies an end condition of an RFID tag reading process according to the present disclosure. FIG. 2 is a schematic diagram illustrating a flow line that satisfies an end condition of an RFID tag reading process according to the present disclosure and is determined to have not passed through a gate. FIG. 3 is a schematic diagram illustrating a flow line that satisfies an end condition of a reading process according to the present disclosure and is determined to have not passed through a gate. FIG. 4 is a diagram illustrating an image capture area captured by an imaging device according to the present disclosure. FIG. 5 is a diagram illustrating an image capture area captured by an imaging device according to the present disclosure. FIG. 6 is a schematic diagram illustrating a map of a storage space according to the present disclosure. FIG. 7 is a schematic diagram illustrating a hardware configuration of an information processing device according to the present disclosure. FIG. 8 is a flowchart illustrating an operation flow of a management system according to the present disclosure. FIG. 9 is a flowchart illustrating an operation flow of carrying in an item in a management system according to the present disclosure. FIG. 10 is a flowchart illustrating an operation flow of a display unit in a management system according to the present disclosure. FIG. 11 is a flowchart illustrating an operation flow of carrying out an item in a management system according to the present disclosure.1 is a schematic diagram illustrating an imaging space including height information imaged by an imaging device according to the present disclosure, as viewed from the side; 2 is a schematic diagram illustrating an imaging space imaged by an imaging device according to the present disclosure, as viewed from the side; 3 is a schematic diagram illustrating an imaging space imaged by an imaging device according to the present disclosure, as viewed from the side; 4 is a schematic diagram illustrating a storage space map according to the present disclosure;

[0013] <Overview of the embodiment> Prior to a detailed description of the embodiment, an overview of the embodiment will be described. Fig. 1 is a block diagram illustrating a configuration of an information processing device 10 according to the present disclosure. As shown in Fig. 1, the information processing device 10 includes a traffic line identification unit 11, an RSSI acquisition unit 12, a passage determination unit 13, an image information acquisition unit 14, and a management unit 15.

[0014] The flow line identification unit 11 identifies the flow line of an object within a predetermined area near the gate. The RSSI acquisition unit 12 acquires the RSSI of a signal from an RFID tag near the gate. The passage determination unit 13 determines whether an item identified by identification information read from the RFID tag has passed through the gate, based on the flow line identified by the flow line identification unit 11 and the RSSI acquired by the RSSI acquisition unit 12. The image information acquisition unit 14 acquires image information of the image target of the identified image by performing image recognition on an image captured within a predetermined area near the gate. The management unit 15 manages the image information acquired by the image information acquisition unit 14 by linking it to the item identified by the identification information.

[0015] When determining whether a gate has been passed using only the traffic flow, not only RFID tags that have actually passed through the gate but also RFID tags present near the gate are read. Therefore, there is a risk that tags that have not actually passed through the gate may be erroneously determined to have passed through the gate. Furthermore, when determining whether a gate has been passed through using only the RSSI, it is impossible to distinguish between an RFID tag that approaches the gate, passes through it, and then moves away from it, and an RFID tag that approaches the gate, then moves away from it without passing through it. Therefore, even in this case, there is a risk that an RFID tag that has not actually passed through the gate may be erroneously determined to have passed through the gate. In contrast, the information processing device 10 can determine whether a gate has been passed through using two types of information: the RSSI of the signal from the RFID tag and the traffic flow occurring in the area near the gate. This reduces the above-mentioned erroneous determination. Therefore, the entry and exit of items can be more reliably managed.

[0016] Furthermore, the information processing device 10 can determine whether an item has passed through a gate using three types of information: the RSSI signal from the RFID tag, the movement of people in the area near the gate, and image information. This allows for even more reliable management of the carrying in and out of items.

[0017] Furthermore, the information processing device 10 acquires image information and position information of items that have passed through the gate and been carried into the storage space. This allows the information processing device 10 to acquire not only the positions of the items in the storage space but also changes in the positions of the items. This allows for more reliable management of the movement of items. Furthermore, information on items stored in the storage space can be easily obtained.

[0018] In the present disclosure, a gate refers to a partition of space set up to manage the inflow or outflow of goods and does not necessarily have to be a physical structure. A gate can also be referred to as a transport entrance, a loading entrance, or an unloading entrance. For example, when managing the inflow of goods to a certain location, the inflow of the goods is considered to have occurred when the goods are moved from the entrance side of the gate (loading entrance) to the exit side. Similarly, when managing the outflow of goods from a certain location, the outflow of the goods is considered to have occurred when the goods are moved from the entrance side of the gate (unloading entrance). Specifically, the inflow or outflow of goods may refer to, for example, the inflow or outflow of goods (entry or outflow) in a warehouse or store. Furthermore, when a gate is installed in a store that sells goods, managing the passage of goods through the gate (i.e., managing the outflow of goods) may refer to the identification of the goods to be purchased. In this way, the information processing device 10 can be used to manage the inflow or outflow of goods in various environments.

[0019] In addition, in this disclosure, a space separated by a gate is referred to as a storage space. In this case, the gate separates the inside of the storage space where items are stored from the outside of the storage space. Carrying in or out of an item means carrying in or out of the storage space. The storage space includes a space where the carried-in items are stored. The storage space also includes a flat storage area or a shelf storage area where items are laid flat. When a gate is installed at the entrance of a storage space, the side of the gate facing the inside of the storage space is called the inside, and the side of the gate facing the outside of the storage space is called the outside. Therefore, carrying in an item can be said to be the movement of an item from the entrance side to the exit side of the gate (carry-in entrance), as well as the movement of an item from the outside of the gate (carry-in entrance) to the inside. In contrast, carrying out an item can be said to be the movement of an item from the entrance side to the exit side of the gate (carry-out exit), as well as the movement of an item from the inside to the outside of the gate (carry-out exit).

[0020] First Embodiment FIG. 2 is a block diagram illustrating a configuration of a management system 1 according to the present disclosure. FIG. 3 is a schematic diagram illustrating a storage space 600 in which items 90 managed by the management system 1 according to the present disclosure are moved and stored. FIG. 4 is a schematic diagram illustrating the periphery of a gate 50 according to the present disclosure, showing a view of the gate 50 from the side. FIG. 5 is a schematic diagram illustrating detection areas 51A and 51B detected by sensors 200A and 200B according to the present disclosure, showing a view from above. FIG. 6 is a schematic diagram illustrating an imaging area 60 imaged by an imaging device 310 according to the present disclosure, showing a view from above. Note that the position of the imaging device 310 has been shifted in FIG. 6 to avoid cluttering the diagram.

[0021] As shown in FIGS. 2 to 6 , the management system 1 includes an information processing device 20, a reading device 100, a sensor 200A, a sensor 200B, an image recognition device 300, an imaging device 310, and a DB server 400. The management system 1 is a system that manages the transport (specifically, the carrying in or carrying out) of the item 90 and the storage of the item 90 by managing the passage of the item 90 through a gate 50. The management system 1 identifies the item 90 that has passed through the gate 50 by reading (reading the identification information) an RFID tag 91 attached to the item 90 to be managed. In this way, the management system 1 manages whether or not a transport has been carried out for each item 90. The management system 1 also manages the item 90 in the storage space 600 based on image information of an image captured of the storage space 600 where the item 90 is stored.

[0022] In the description of this embodiment, for the sake of convenience, an entrance and an exit are defined for the gate 50, but the management system 1 may manage transport including passage through the gate 50 in both directions, rather than managing transport including passage through the gate 50 in one direction. Furthermore, for the delivery of the item 90, the entrance side of the gate 50 may be outside the storage space 600, and the exit side of the gate 50 may be inside the storage space 600. Conversely, for the delivery of the item 90, the entrance side of the gate 50 may be inside the storage space 600, and the exit side of the gate 50 may be outside the storage space 600.

[0023] The reading device 100 is a device for communicating with an RFID tag 91 attached to an item 90 to be managed for transportation and storage, and reading information stored in the RFID tag 91. The reading device 100 also measures the RSSI of a signal from the RFID tag 91. The reading device 100 is connected to the information processing device 20 in a state in which communication is possible via wire or wirelessly. Note that, for example, identification information for uniquely identifying the item 90 is pre-stored in the RFID tag 91, and the reading device 100 reads the information stored in the RFID tag 91. The reading device 100 has an RFID reader 101 and an antenna 102.

[0024] The RFID reader 101 is a control circuit that communicates with the RFID tag 91 via the antenna 102 in accordance with a predetermined communication protocol and reads information stored in the RFID tag 91. The RFID reader 101 also measures the RSSI of the signal from the RFID tag 91 that is received by the antenna 102. The RFID reader 101 outputs the information read from the RFID tag 91 to the information processing device 20. The RFID reader 101 also outputs time-series data of the RSSI of the signal from the RFID tag 91 to the information processing device 20. More specifically, the RSSI time-series data is data that associates the identification information of the RFID tag 91 that transmitted the signal with the RSSI value and time information.

[0025] The antennas 102 are installed in positions where they can transmit and receive radio waves to and from the RFID tags 91 passing through the gate 50, and transmit radio waves to the RFID tags 91 and receive radio waves transmitted from the RFID tags 91. In this embodiment, two antennas 102 are installed on each side of the gate 50, for a total of four antennas 102, but the number of antennas 102 is not limited as long as it is one or more. Furthermore, the antennas 102 may be provided as separate antennas for transmission and reception.

[0026] The sensors 200A and 200B are sensors that detect objects within a predetermined area near the gate 50. The sensors 200A and 200B are connected to the information processing device 20 in a state in which they can communicate with each other via wire or wirelessly. The sensors 200A and 200B detect various objects, such as a person, an AGV (Automated Guided Vehicle), or an article 90 that has entered the predetermined area.

[0027] For example, sensor 200A is a sensor that detects an object within a predetermined detection area 51A (also referred to as a first area) on the entrance side of gate 50 (see FIGS. 4 and 5). As an example, detection area 51A is an area outside storage space 600. Sensor 200B is a sensor that detects an object within a predetermined detection area 51B (also referred to as a second area) on the exit side of gate 50 (see FIGS. 4 and 5). As an example, detection area 51B is an area inside storage space 600. In this embodiment, sensor 200A is provided near the top of gate 50 on the entrance side, and sensor 200B is provided near the top of gate 50 on the exit side.

[0028] In this embodiment, the sensors 200A and 200B detect objects by emitting light beams 201 to each of the partial regions 510A and 510B obtained by dividing the predetermined detection region 51A and the detection region 51B into a grid pattern and receiving reflected light of the light beams 201. The light beams 201 are, for example, infrared, but are not limited to infrared. The sensors 200A and 200B detect objects by detecting whether the light beams 201 emitted to each of the partial regions 510A and 510B are blocked by an object. The sensor 200A emits light beams 201 to each of the partial regions 510A (see FIGS. 4 and 5 ) obtained by dividing the detection region 51A on the entrance side of the gate 50 into a grid pattern and receives reflected light of the emitted light beams 201. Similarly, the sensor 200B emits a light beam 201 to each of the partial areas 510B (see Figures 4 and 5) obtained by dividing the detection area 51B on the exit side of the gate 50 into a grid pattern, and receives the reflected light of each emitted light beam 201.

[0029] The sensors 200A and 200B detect the presence of an object based on the difference in the light reception state of reflected light between when an object is present and when it is not present. This difference in the light reception state may be a difference in the reflection time or a difference in the amount of received light.

[0030] As described above, sensor 200A and sensor 200B emit light beams 201 to their respective partial regions 510A and 510B. Therefore, if the total number of partial regions 510A within detection region 51A or the total number of partial regions 510B within detection region 51B is n, sensor 200A and sensor 200B each obtain n detection results as object detection results. When an object moves within detection region 51A or detection region 51B, the range of partial region 510A or partial region 510B in which a detection result indicating the presence of an object is obtained changes over time. The change in the range of partial region 510A or partial region 510B in which a detection result indicating the presence of an object is obtained corresponds to the direction of movement.

[0031] Therefore, by analyzing the time-series data of the n detection results of the sensors 200A and 200B, it is possible to identify the movement direction of an object within the detection area 51A or 51B. That is, it is possible to identify the movement line. Furthermore, because the detection results of the sensors 200A and 200B include time information, it is also possible to identify the period during which the movement line occurred (the period during which movement occurred). In this embodiment, the movement line is identified by the information processing device 20. Therefore, the sensors 200A and 200B each sequentially transmit the above-mentioned n detection results to the information processing device 20. As a result, the information processing device 20 acquires time-series data of the detection results of the sensors 200A and 200B for each of the partial areas 510A and 510B.

[0032] In this embodiment, a sensor 200A for the entrance and a sensor 200B for the exit are used to detect objects, but a single sensor that detects both detection areas 51A and 51B may also be used.

[0033] As described above, in this embodiment, a sensor that emits light rays 201 to each of partial areas 510A and 510B is used to detect an object, but any other sensor that can detect an object to identify its movement line may be used. For example, a camera that captures images of the movement of an object in detection areas 51A and 51B may be used.

[0034] The imaging device 310 captures an image of the imaging area 60 by capturing an image of the imaging area 60. The imaging area 60 may include the storage space 600 or a predetermined area near the gate 50. The image includes a video. The imaging device 310 may be disposed above the storage space 600, for example, and capture an image of the imaging area 60 in the storage space 600 from above. Note that the placement position of the imaging device 310 is not limited to above the storage space 600. The imaging device 310 captures images of various objects, such as people, AGVs, and articles 90, that have entered the imaging area 60 (see FIGS. 3 and 6 ). The imaging device 310 may capture images of each partial area 610 obtained by dividing the imaging area 60 in the storage space 600 into a grid pattern, for example.

[0035] The imaging device 310 may include, for example, a camera. The imaging device 310 is connected to the information processing device 20 in a state where they can communicate with each other via a wired or wireless connection. The imaging device 310 outputs image data including a captured image and the capture time at which the image was captured to the information processing device 20. Therefore, the image data includes time-series data in which the images are arranged according to the capture time. Therefore, the image data includes time information. Note that the imaging device 310 may be connected to the image recognition device 300 in a state where they can communicate with each other via a wired or wireless connection, and output image data to the image recognition device 300.

[0036] The image recognition device 300 performs image recognition on an image captured by the imaging device 310. As a result, the image recognition device 300 identifies an imaging target captured in the image. The image recognition device 300 is connected to the information processing device 20 in a state in which they can communicate with each other via wired or wireless communication. The image recognition device 300 includes an image DB 301 and an image recognition unit 302.

[0037] The image DB 301 is a database that stores image information and characteristic information of the object captured in the image, linked to each other. The characteristic information of the object includes characteristic points extracted from the image of the object. The image information includes information that identifies the object. For example, the characteristic information of the object includes information such as a predetermined size, a rectangular cardboard box, and a predetermined mark. The image information includes information such as ABC Company's DEF parts. The image DB 301 stores the image information and characteristic information of the object in advance, linked to each other.

[0038] The image recognition unit 302 receives image data from the information processing device 20 or the imaging device 310. The image recognition unit 302 extracts feature points of the imaging target captured in the image in the image data. The image recognition unit 302 then compares the feature information of the imaging target in the image with the feature information stored in the image DB 301. For example, if the imaging target in the image captured by the imaging device 310 includes feature information such as a predetermined size, a rectangular cardboard box, a predetermined mark, etc., the image recognition unit 302 compares the feature information of the imaging target in the image DB 301.

[0039] When feature information of the imaging target of the image captured by the imaging device 310 matches feature information stored in the image DB 301, the image recognition unit 302 outputs the image information to the information processing device 20. For example, the image recognition unit 302 transmits information such as ABC Company's DEF parts as image information. Note that "matching" of feature information refers to a case where the degree of match between feature points is equal to or greater than a predetermined value. The image recognition unit 302 also identifies the position of the imaging target in the imaging area 60. For example, the image recognition unit 302 identifies a partial area 610 in the imaging area 60 as the position of the imaging target. The image recognition unit 302 transmits, as position information, the position of the imaging target in the storage space 600 corresponding to the imaging area 60. Note that image data including the image recognized by the image recognition unit 302 includes time information. Therefore, the image recognition unit 302 may transmit image information including time information to the information processing device 20.

[0040] The image recognition unit 302 may perform image recognition using AI (Artificial Intelligence). For example, the image recognition unit 302 may perform image recognition using an image dictionary that has been previously trained on feature information and image information by machine learning.

[0041] The DB server 400 is a server that serves as a database that stores information about each item 90. The DB server 400 may store the information about the item 90 as management information.

[0042] The management information may include, for example, transport information, image information, and location information. The DB server 400 manages various information related to the item 90, for example, in association with identification information that identifies the item 90. For example, the transport information includes information on whether the item 90 has been transported. The image information includes information on the image capture target linked to the item 90. The location information includes information indicating the location of the item 90 in the storage space 600. In this embodiment, the transport information stored in the DB server 400 is updated by the information processing device 20 based on read information from the RFID tag 91 that has passed through the gate 50. Furthermore, the location information stored in the DB server 400 is updated by the information processing device 20 based on image information identified by image recognition of the image captured by the imaging device 310.

[0043] The information processing device 20 controls the reading device 100 based on the detection results of the sensors 200A and 200B, and manages whether or not the article 90 has been transported for each article 90 based on the detection results of the sensors 200A and 200B and the RSSI measured by the reading device 100. The information processing device 20 also manages image information identified by image recognition of an image captured by the imaging device 310 in association with the article 90 identified based on the sensors 200A, etc. and the RSSI.

[0044] The information processing device 20 is connected to the reading device 100, the sensors 200A and 200B, the image recognition device 300, the imaging device 310, and the DB server 400 in a wired or wireless communication state. In the configuration shown in FIG. 2 , the information processing device 20 communicates with the DB server 400 to update management information including transportation information, image information, and location information of the item 90 managed in a database, but the information processing device 20 may have such a database. That is, the DB server 400 may be omitted from the management system 1. In the configuration shown in FIG. 2 , the information processing device 20 communicates with the image recognition device 300 to perform image recognition on an image captured by the imaging device 310, but the information processing device 20 may have such an image recognition device 300. That is, the image recognition device 300 may be omitted from the management system 1.

[0045] 7 is a block diagram illustrating a functional configuration of an information processing device 20 according to the present disclosure. As shown in FIG. 7, the information processing device 20 includes a flow line identification unit 21, a communication control unit 22, a data update unit 23, a reading control unit 24, an image information control unit 25, a management unit 26, and a display unit 27.

[0046] The trajectory identification unit 21 corresponds to the trajectory identification unit 11 in FIG. 1 . Based on the detection results of the sensor 200A, the trajectory identification unit 21 identifies the trajectory of an object's movement within a predetermined detection area 51A on the entrance side of the gate 50 and identifies the period during which the trajectory occurs. The trajectory identification unit 21 also identifies the trajectory of an object's movement within a predetermined detection area 51B on the exit side of the gate 50 and identifies the period during which the trajectory occurs. In this embodiment, the trajectory identification unit 21 uses time-series data of the detection results acquired from the sensors 200A and 200B to analyze the temporal progression of the ranges of the partial areas 510A and 510B in which detection results indicating the presence of an object are obtained. As a result, the trajectory identification unit 21 identifies the trajectory of the object and the period during which the trajectory occurs. Specifically, the trajectory identification unit 21 identifies the object's movement direction (movement path) as the trajectory. When a camera is used as a sensor for detecting an object, the flow line identifying unit 21 analyzes the image captured by the camera to identify the flow line of the object and the period during which it occurred.

[0047] The communication control unit 22 communicates with other devices and transmits and receives information to and from the other devices. Specifically, the communication control unit 22 acquires information stored in the RFID tag 91 from the RFID reader 101 of the reading device 100. The communication control unit 22 also acquires RSSI time-series data from the RFID reader 101 of the reading device 100. Therefore, the communication control unit 22 corresponds to the RSSI acquisition unit 12 in FIG. 1. That is, the communication control unit 22 acquires the RSSI of the signal from the RFID tag 91 near the gate 50. The communication control unit 22 may also be referred to as an RSSI acquisition unit. The communication control unit 22 also acquires detection results from the sensors 200A and 200B. The communication control unit 22 also transmits and receives management information about the item 90 to and from the DB server 400. The communication control unit 22 also acquires image data from the imaging device 310. The communication control unit 22 transmits and receives image data and image information to and from the image recognition device 300.

[0048] The data update unit 23 updates the transportation information for the item 90 that has passed through the gate 50. Therefore, the data update unit 23 determines whether the item 90 identified by the identification information read from the RFID tag 91 has passed through the gate 50. The data update unit 23 determines whether the item 90 identified by the identification information read from the RFID tag 91 has passed through the gate 50 using the identified traffic path and the acquired RSSI. The data update unit 23 corresponds to the passage determination unit 13 in FIG. 1 . Therefore, the data update unit 23 may also be referred to as a passage determination unit. Furthermore, the data update unit 23 updates image information of the image capture target identified by image recognition of the image captured by the imaging device 310, and location information of the item 90 in the storage space 600. In this way, the data update unit 23 updates management information including transportation information, image information, and location information. Details of the processing by the data update unit 23 will be described later.

[0049] The reading control unit 24 determines whether the flow line identified by the flow line identification unit 21 corresponds to a predetermined pattern as a start condition for the reading process of the RFID tag 91. More specifically, when the identified flow line of the object's movement within the detection area 51A corresponds to this predetermined pattern, the reading control unit 24 controls the reading device 100 to start the reading process of the RFID tag 91 near the gate 50. Specifically, the reading control unit 24 instructs the reading device 100 to start the reading process of the RFID tag 91. As a result, the reading process is started by the reading device 100, and if an RFID tag 91 that can communicate with the reading device 100 is present, the information of the RFID tag 91 is read by the reading device 100.

[0050] In this embodiment, specifically, the predetermined pattern as a condition for starting the reading process of the RFID tag 91 is a movement pattern of approaching a predetermined position near the entrance of the gate 50. That is, the reading control unit 24 performs control to start the reading process of the RFID tag 91 when the identified flow line indicates movement approaching a predetermined position near the entrance of the gate 50. Note that the predetermined position near the entrance is specifically, for example, the edge of the detection area 51A on the gate 50 side.

[0051] The image information control unit 25 acquires image information of the imaging target of the identified image by performing image recognition on the image captured in the imaging area 60. Therefore, the image information control unit 25 corresponds to the image information acquisition unit 14 in FIG. 1 . Therefore, the image information control unit 25 may also be referred to as an image information acquisition unit. The image information control unit 25 receives image data from the imaging device 310, in which images captured by the imaging device 310 are arranged in chronological order. The image information control unit 25 also transmits the image data received from the imaging device 310 to the image recognition device 300. As a result, the image information control unit 25 causes the image recognition device 300 to perform image recognition. Furthermore, the image information control unit 25 receives from the image recognition device 300 image information of the imaging target of the identified image by image recognition and position information in the storage space 600 corresponding to each partial area 610 of the imaging area 60.

[0052] If a change occurs in the position information of the object being imaged as a result of the image recognition device 300 recognizing the image captured by the imaging device 310, the image information control unit 25 obtains the position information of the item 90 in the storage space 600 after the change from the image recognition device 300.

[0053] The management unit 26 manages the image information received from the image recognition device 300 by linking it to the item 90 identified by the identification information. Therefore, the management unit 26 corresponds to the management unit 15 in FIG. 1 . The management unit 26 may manage the image information and the item 90 by linking them to each other based on the imaging time when the imaging target was imaged and the passing time when it was determined that the item 90 passed through the gate 50. That is, when the passing time of the imaging target through the gate 50 calculated from the imaging time matches the passing time of the item 90 through the gate 50 calculated from the movement of the traffic line and changes in RSSI strength, the management unit 26 manages the image information and the item 90 by linking them to each other. This allows the item 90 to be identified from three types of information, thereby making it possible to more reliably manage the item 90.

[0054] In this way, the management unit 26 links the image information with the item 90, thereby managing the image-recognized imaged object as the item 90 together with its identification information. The management unit 26 causes the data update unit 23 to update management information including transportation information, image information, and position information of the item 90 identified by the identification information. In this way, the management unit 26 manages the position information of the item 90 in the storage space 600. Specifically, for example, the management unit 26 causes the data update unit 23 to update the position information of the imaged object linked to the item 90. When the image information control unit 25 acquires position information indicating that the position of the item 90 in the storage space 600 has moved, the management unit 26 links the updated position information with the item 90 and manages it.

[0055] The display unit 27 displays a map of the storage space 600. For example, the display unit 27 displays an image of the storage space 600 together with the map of the storage space 600 on a screen such as a user's display. The display unit 27 displays the position of the item 90 on the map.

[0056] Next, the operation of the information processing device 20 of this embodiment will be described, including the passage of an item through a gate and the movement of an item within the storage space. In this embodiment, the entrance side of the gate 50 indicates the outside of the storage space 600, and the exit side of the gate indicates the inside of the storage space 600. Therefore, in this case, the detection area 51A is the area outside the storage space 600, and the detection area 51B is the area inside the storage space 600.

[0057] 8 and 9 are schematic diagrams illustrating a flow line that satisfies the conditions for starting the reading process of the RFID tag 91 according to the present disclosure. In FIGS. 8 and 9, the hatched partial area 510A indicates the partial area 510A where the presence of an object is detected, and the arrows indicate the flow line. As shown in FIGS. 8 and 9, when the flow line of the identified object indicates movement approaching a predetermined position near the entrance of the gate 50 (specifically, the edge of the detection area 51A on the gate 50 side), the reading control unit 24 controls to start the reading process.

[0058] 10 and 11 are schematic diagrams illustrating examples of traffic lines that do not satisfy the conditions for starting the reading process of the RFID tag 91 according to the present disclosure. In FIGS. 10 and 11, the hatched partial area 510A indicates the partial area 510A where the presence of an object was detected, and the arrows indicate the traffic lines. FIG. 10 shows an example of a traffic line that corresponds to movement across the periphery of the gate 50. FIG. 11 shows an example of a traffic line that corresponds to movement that approaches the gate 50 and then turns back.

[0059] The reading control unit 24 also determines whether the flow line identified by the flow line identification unit 21 matches a predetermined pattern as a termination condition for the reading process of the RFID tag 91. More specifically, the reading control unit 24 controls the reading process to terminate when the identified flow line of the object's movement within the detection area 51B matches this predetermined pattern. Specifically, the reading control unit 24 instructs the reading device 100 to terminate the reading process of the RFID tag 91. This terminates the reading process by the reading device 100.

[0060] Specifically, in this embodiment, one of the patterns predetermined as the termination condition for the reading process of the RFID tag 91 is a movement pattern moving away from the vicinity of the exit of the gate 50. That is, the reading control unit 24 performs control to terminate the reading process of the RFID tag 91 when the identified flow line indicates movement moving away from the vicinity of the exit of the gate 50.

[0061] 12 to 14 are schematic diagrams illustrating examples of movement paths that satisfy the conditions for ending the reading process of an RFID tag 91 according to the present disclosure. In FIGS. 12 and 13, the hatched partial area 510B indicates the partial area 510B where the presence of an object was detected, and the arrows indicate the movement path. As shown in FIGS. 12 and 13, if the movement path of the identified object indicates movement away from the exit of the gate 50, the reading control unit 24 performs control to end the reading process.

[0062] The pattern predetermined as the end condition of the reading process may be a movement pattern from near the exit of gate 50 to outside of detection area 51B as shown in Figures 12 and 13, or a movement pattern that does not leave detection area 51B as shown in Figure 14. In other words, the pattern predetermined as the end condition of the reading process may be a movement pattern that moves away from near the exit of gate 50 to a predetermined position within detection area 51B. In this case, the reading process can be ended even if the object has not moved outside of detection area 51B, and it is possible to prevent the reading process from being continued unnecessarily.

[0063] However, even if a flow line that satisfies the start condition of the reading process is obtained, it is possible that the transporter does not pass through the gate 50, or passes through it once and then turns back. In this case, the above-mentioned flow line that satisfies the end condition of the reading process cannot be obtained. Therefore, a predetermined pattern other than the above-mentioned pattern can also be used as the end condition of the reading process of the RFID tag 91. Such a pattern is a movement pattern that moves away from the vicinity of the entrance of the gate 50 on the entrance side of the gate 50.

[0064] Therefore, the reading control unit 24 controls the reading process to end if the flow line identified after the start of the reading process indicates movement away from the vicinity of the entrance of gate 50 on the entrance side of gate 50. That is, the reading control unit 24 controls the reading process to end if the flow line identified for the movement of an object within detection area 51A after the start of the reading process indicates movement away from the vicinity of the entrance of gate 50. In such a case, it is assumed that item 90 identified by the identification information read from RFID tag 91 has passed through gate 50, and the transport information should not be updated. Therefore, the data update unit 23 determines that item 90 has not passed through gate 50 if the flow line identified after the start of the reading process indicates movement away from the vicinity of the entrance of gate 50 on the entrance side of gate 50.

[0065] In other words, the data update unit 23 determines that the item 90 has not passed through the gate 50 if, after the reading process has begun, movement away from the vicinity of the entrance of the gate 50 is detected on the entrance side of the gate 50, rather than movement away from the vicinity of the exit of the gate 50.

[0066] 15 and 16 are schematic diagrams illustrating a flow line that satisfies the termination condition of the reading process according to the present disclosure and determines that the item 90 has not passed through the gate 50. In FIGS. 15 and 16, the hatched partial areas 510A and 510B indicate the partial areas 510A and 510B where the presence of an object was detected, and the arrows indicate the flow line. FIG. 15 illustrates an example of a flow line that corresponds to a movement that returns without passing through the gate 50. FIG. 16 illustrates an example of a flow line that corresponds to a movement that passes through the gate 50 but then returns. As shown in FIGS. 15 and 16, if, after the start of the reading process, the entrance side of the gate 50 indicates movement away from the vicinity of the entrance of the gate 50, the reading control unit 24 controls the reading process to end. The data update unit 23 then determines that the item 90 identified by the read identification information has not passed through the gate 50. This prevents the transportation information from being updated to incorrect information.

[0067] Here, consider a case where an item 90 is left unattended near the entrance of gate 50. In this case, too, it is assumed that the item 90 identified by the identification information read from RFID tag 91 has passed through gate 50, and the transport information should not be updated. Therefore, if the flow path identified after the start of the reading process indicates that the object is staying near the entrance of gate 50, the data update unit 23 determines that the item 90 has not passed through gate 50. In other words, if the flow path identified for the movement of an object within detection area 51A after the start of the reading process indicates that the object is staying near the entrance of gate 50, the data update unit 23 determines that the item 90 has not passed through gate 50. In other words, if the data update unit 23 detects that the object is staying near the entrance of gate 50, rather than moving away from the exit of gate 50, after the start of the reading process, the data update unit 23 determines that the item 90 has not passed through gate 50. This prevents the transport information from being updated to incorrect information. In this case, the reading control unit 24 controls the reading process to end. That is, the reading control unit 24 controls the reading process to end when the flow line identified after the start of the reading process indicates that the object will remain near the entrance to the gate 50.

[0068] As described above, the reading control unit 24 controls the reading process to end when the movement line identified after the start of the reading process matches one of the patterns predetermined as the end conditions for the reading process. As described above, the predetermined patterns are, for example, movement away from the exit of the gate 50, movement away from the entrance of the gate 50 on the entrance side of the gate 50, and the object remaining near the entrance of the gate 50.

[0069] The data update unit 23 determines whether the item 90 identified by the identification information read from the RFID tag 91 has passed through the gate 50. As described above, the data update unit 23 determines that the item 90 has not passed through the gate 50 when the reading process is completed due to the identification of a flow line other than the flow line corresponding to a movement pattern moving away from the exit vicinity of the gate 50. In other words, the data update unit 23 determines that the item 90 identified by the identification information read by this reading process has not passed through the gate 50. Therefore, in this case, the data update unit 23 does not update the transport information of this item 90 to transport information indicating that it has passed through the gate 50.

[0070] In contrast, when the reading process is completed by identifying a flow path corresponding to a movement pattern moving away from the exit of gate 50, data update unit 23 determines that item 90 has passed through gate 50. The item 90 identified by the identification information obtained in this reading process is treated as a candidate for item 90 that has passed through gate 50. Here, the candidate for item 90 that has passed gate 50 may include an item 90 that has not actually passed through gate 50. For example, if another item 90 is present near gate 50 (reader 100) when item 90 passes through gate 50, the identification information of the RFID tag 91 of this other item 90 may also be read. Note that such unintended reading may occur due to unexpected signal reflection, even when a directional antenna is used as antenna 102.

[0071] When the reading process is completed by identifying a flow line corresponding to a movement pattern moving away from the exit of the gate 50, that is, when it is determined that the article 90 has passed through the gate 50, the data updating unit 23 identifies which article 90 has passed through the gate 50. To do this, the data updating unit 23 refers to the RSSI of the signal from the RFID tag 91 read by this reading process.

[0072] It is assumed that the time-series data of the RSSI of the signal from the RFID tag 91 of the item 90 that actually passed through the gate 50 will be the following time-series data. The RFID tag 91 of the item 90 that actually passed through the gate 50 will gradually approach the antenna 102 provided on the gate 50, and then gradually move away from the antenna 102. Therefore, it is assumed that the time-series data of the RSSI of the signal from the RFID tag 91 of the item 90 that actually passed through the gate 50 will gradually increase and then gradually decrease. For this reason, the data update unit 23 determines whether the item 90 actually passed through the gate 50 based on whether the change in the RSSI of the item 90 of interest during the period in which the specified flow line occurred corresponds to a predetermined fluctuation pattern corresponding to the flow line.

[0073] In this embodiment, when any article 90 passes through gate 50, two flow lines are identified. The first flow line is the flow line of the object within a predetermined detection area 51A on the entrance side of gate 50. More specifically, this is the flow line of movement approaching a predetermined position near the entrance of gate 50, i.e., the flow line corresponding to the start condition of the reading process. The second flow line is the flow line of the object within a predetermined detection area 51B on the exit side of gate 50. More specifically, this is the flow line of movement away from the vicinity of the exit of gate 50, i.e., the flow line corresponding to the end condition of the reading process. Hereinafter, the first flow line described above will be referred to as the IN flow line, and the second flow line will be referred to as the OUT flow line.

[0074] As described above, the data update unit 23 determines whether the article 90 has passed through the gate 50 based on whether the change in the RSSI during the period in which the identified flow line occurs corresponds to a predetermined fluctuation pattern corresponding to the flow line. Here, the period in which the IN flow line occurs corresponds to the period in which the movement represented by the IN flow line occurs, and the period in which the OUT flow line occurs corresponds to the period in which the movement represented by the OUT flow line occurs.

[0075] The period during which an IN traffic line occurs is the period during which the RFID tag 91 gradually approaches the antenna 102 provided at the gate 50. Therefore, the RSSI value increases during this period. Therefore, when the identified traffic line is an IN operation, the predetermined fluctuation pattern corresponding to the traffic line is specifically a fluctuation pattern that represents an increase in RSSI.

[0076] In contrast, the period during which an OUT flow line occurs is the period during which the RFID tag 91 gradually moves away from the antenna 102 provided at the gate 50. Therefore, the RSSI value decreases during this period. Therefore, when the identified flow line is an OUT operation, the predetermined fluctuation pattern corresponding to the flow line is specifically a fluctuation pattern that represents a decrease in RSSI.

[0077] Therefore, the data updating unit 23 determines whether the item 90 of interest (RFID tag 91) has passed through the gate 50 based on whether the change in the RSSI of the item 90 of interest (RFID tag 91) during the period in which the IN flow line occurs indicates an increase in the RSSI. The data updating unit 23 also determines whether the item 90 of interest (RFID tag 91) has passed through the gate 50 based on whether the change in the RSSI of the item 90 of interest (RFID tag 91) during the period in which the OUT flow line occurs indicates a decrease in the RSSI.

[0078] In this embodiment, when the transition of the RSSI for the item 90 (RFID tag 91) of interest satisfies the above-mentioned conditions in both the period when the IN flow line occurs and the period when the OUT flow line occurs, the data update unit 23 determines that the item 90 has passed through the gate 50. Note that when the transition of the RSSI for the item 90 (RFID tag 91) of interest satisfies the above-mentioned conditions in either the period when the IN flow line occurs or the period when the OUT flow line occurs, the data update unit 23 determines that the item 90 has passed through the gate 50.

[0079] In this way, the data update unit 23 determines not only whether the RSSI transition shows a predetermined pattern, but also whether the RSSI transition during the same period as the occurrence period of the traffic line shows the predetermined pattern. Therefore, it is possible to more accurately identify the article 90 that actually passed through the gate 50 compared to when it is determined only whether the RSSI transition shows a predetermined pattern.

[0080] When the data update unit 23 identifies the item 90 that has passed through the gate 50 , it updates the transport information of this item 90 to transport information indicating that the item 90 has passed through the gate 50 .

[0081] <Movement of item position within storage space> If the entrance side of the gate 50 separating the storage space 600 is outside the storage space 600 and the exit side of the gate 50 is inside the storage space 600, the item 90 that has passed through the gate 50 as described above is transported into the storage space 600.

[0082] 17 and 18 are diagrams illustrating an imaging area 60 captured by an imaging device 310 according to the present disclosure. As shown in FIG. 17 , the imaging device 310 captures an image of the imaging area 60. The imaging area 60 includes a predetermined area near the gate 50 in the storage space 600. The image recognition device 300 receives image data captured by the imaging device 310 via the information processing device 20 or directly from the imaging device 310. The image recognition device 300 performs image recognition on the image in the received image data, and when a moving imaging target is detected, identifies the moving imaging target. For example, the image recognition unit 302 extracts feature points of the imaging target and identifies the imaging target by comparing them with the image DB 301. The image recognition device 300 outputs image information identifying the moving imaging target to the information processing device 20.

[0083] When the image information control unit 25 receives image information of a moving imaging target, it determines whether the moving imaging target has passed through a gate 50 and been carried in. For example, the image information control unit 25 causes the image recognition device 300 to perform image recognition of the gate 50 and determine whether the imaging target has passed through the gate 50. Note that the positions of the gates 50 may be set in advance in the image, and the determination may be made based on whether the imaging target has passed between the set gates 50. When the moving imaging target has passed through a gate 50 and been carried in, the image information control unit 25 may control the image recognition device 300 to continue tracking and image-recognizing the moving imaging target. In this way, the image information control unit 25 receives image information of the tracked imaging target.

[0084] The management unit 26 determines whether or not there is identification information in the RFID tag 91 of the item 90 that passed through the gate 50 from the DB server 400. If the DB server 400 has the identification information of the item 90, the management unit 26 acquires the identification information of the item 90 from the DB server 400. The management unit 26 then determines whether the imaged object matches the item 90. For example, the management unit 26 may compare the time when the imaged object passed through the gate with the time when the item 90 passed through the gate 50, or may compare the identification information of the item 90 with predetermined information in the image information. If the imaged object matches the item 90, the management unit 26 associates the image information acquired by the image information control unit 25 with the identification information of the item 90 acquired from the DB server 400 and manages them in association with each other. In other words, the management unit 26 associates the moving imaged object as the item 90.

[0085] When the moving item 90 stops inside the storage space 600, the image information control unit 25 receives the position information of the item 90 in the storage space 600 from the image recognition device 300. Then, the management unit 26 causes the data update unit 23 to update the management information in the DB server 400. Specifically, when the image information control unit 25 acquires the position information of the item 90 in the storage space 600, the management unit 26 updates the position information of the item 90 in the management information.

[0086] As shown in FIG. 18, the management unit 26 manages management information including transport information, image information, and position information for a plurality of items 90 stored in the storage space 600.

[0087] 19 is a schematic diagram illustrating a map of the storage space 600 according to the present disclosure. As shown in FIG. 19 , the display unit 27 displays the map of the storage space 600 on the screen. The map displays, for example, the locations of the items 90 managed in the storage space 600 and also displays vacant areas. Therefore, by sharing the map with field workers working in the storage space 600, the user can specify the storage locations of the items 90 and the locations to which the items 90 are to be moved.

[0088] Furthermore, by clicking on an item 90 on the map displayed on the web screen, the user can check the image information and location information in addition to the history of recognition of the item 90 and transport information including the loading and unloading of the item 90. Furthermore, by clicking on the item 90, the user can check the identification information of the RFID tag 91 of the item 90. For example, if the identification information includes information about the individual packaging inside the package of the item 90, the user can check this information.

[0089] Next, a description will be given of the hardware configuration of the information processing device 20. Fig. 20 is a schematic diagram illustrating an example of the hardware configuration of the information processing device 20 according to the present disclosure. As shown in Fig. 20, the information processing device 20 includes a communication interface IF, a memory MMR, and a processor PRC.

[0090] The communication interface IF is used to communicate with other devices. In this embodiment, the communication interface IF includes interfaces for communicating with the RFID reader 101, the sensor 200A, the sensor 200B, the imaging device 310, the image recognition device 300, and the DB server 400.

[0091] The memory MMR is configured, for example, by a combination of volatile memory and non-volatile memory, and is used to store software (computer programs) including one or more instructions executed by the processor PRC, and data used for various processes of the information processing device 20.

[0092] The processor PRC reads and executes software (computer programs) from the memory MMR to perform processing of the flow line identification unit 21, communication control unit 22, data update unit 23, reading control unit 24, image information control unit 25, management unit 26, and display unit 27. The processor PRC may be a microprocessor, an MPU (Micro Processor Unit), a CPU (Central Processing Unit), or the like. The processor PRC may include multiple processors.

[0093] In this way, the information processing device 20 has the functionality of a computer. Similarly, the DB server 400 also has a processor PRC and a memory MMR and has the functionality of a computer. Note that the RFID reader 101, the imaging device 310, and the image recognition device 300 may also have a processor PRC and a memory MMR and have the functionality of a computer. Therefore, the functions of the RFID reader 101, the imaging device 310, and the image recognition device 300 may be realized by the execution of a program by the processor PRC. As such, it will be understood by those skilled in the art that the functions of the management system 1 can be realized in various ways using only hardware, only software, or a combination thereof, and are not limited to any one of these.

[0094] Furthermore, the above-described program can be stored in and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may be provided to the computer by various types of transient computer-readable media. Examples of transient computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transient computer-readable media can provide the program to the computer via a wired communication path such as an electrical wire or optical fiber, or via a wireless communication path.

[0095] Next, a description will be given of the operation of the management system 1. Fig. 21 is a flowchart illustrating an example of the flow of operation of the management system 1 according to the present disclosure. Below, the flow of operation of reading the RFID tag 91 in the management system 1 will be described with reference to Fig. 21.

[0096] In step S100, the flow line identification unit 21 identifies the flow line of the object movement and the time of occurrence (period of occurrence) based on the detection results of the sensors 200 A and 200 B. Note that this process by the flow line identification unit 21 is continuously performed even while the processes from step S101 onwards are being performed.

[0097] Next, in step S101, the reading control unit 24 determines whether the flow line identified by the flow line identification unit 21 corresponds to a pattern predetermined as a start condition for the reading process of the RFID tag 91. That is, the reading control unit 24 determines whether the identified flow line indicates movement approaching the entrance of the gate 50. If the identified flow line does not indicate movement approaching the entrance of the gate 50 (No), the reading process is not started, and the process returns to step S100. On the other hand, if the identified flow line indicates movement approaching the entrance of the gate 50 (Yes), the process proceeds to step S102.

[0098] In step S102, the reading control unit 24 determines that the conditions for starting the reading process are satisfied, and performs control to start the reading process of the RFID tag 91.

[0099] Next, in step S103, the data update unit 23 determines whether the flow line after the start of the reading process indicates that the object is staying near the entrance of the gate 50. If the object has been staying at the entrance of the gate 50 for a predetermined time or longer (if Yes), the process proceeds to step S104. On the other hand, if the object has not been staying at the entrance of the gate 50 for a predetermined time or longer (if No) in step S103, the process proceeds to step S106.

[0100] In step S104, the reading control unit 24 performs control to end the reading process.

[0101] Then, in step S105, the data update unit 23 determines that the item 90 identified by the identification information read from the RFID tag 91 by the reading process started in step S102 has not passed through the gate 50. After step S105, the process returns to step S100.

[0102] Meanwhile, in step S106, the data update unit 23 determines whether the flow line after the start of the reading process indicates movement that turns back from near the entrance of gate 50. If the flow line indicates movement that turns back from near the entrance of gate 50 (if Yes), the process proceeds to step S107. On the other hand, if the flow line does not indicate movement that turns back from near the entrance of gate 50 (if No) in step S106, the process proceeds to step S109.

[0103] In step S107, the reading control unit 24 performs control to end the reading process.

[0104] Then, in step S108, the data update unit 23 determines that the item 90 identified by the identification information read from the RFID tag 91 by the reading process started in step S102 has not passed through the gate 50. After step S108, the process returns to step S100.

[0105] Meanwhile, in step S109, the data update unit 23 determines whether the flow line after the start of the reading process indicates movement away from the vicinity of the exit of gate 50. If the flow line indicates movement away from the vicinity of the exit of gate 50 (Yes), the process proceeds to step S110. On the other hand, if the flow line does not indicate movement away from the vicinity of the exit of gate 50 (No) in step S109, the process returns to step S103.

[0106] In step S110, the reading control unit 24 performs control to end the reading process.

[0107] Then, in step S111, the data update unit 23 performs processing to update the transport information of the item 90 that has passed through the gate 50 to transport information indicating that the item has passed through the gate 50. The processing flow of this step will be specifically described with reference to FIG. 22.

[0108] 22 is a flowchart illustrating the flow of a data update process according to the present disclosure. In this process, the data update unit 23 determines whether the RSSI of each RFID tag 91 read by the reading process started in step S102 exhibits a specific pattern during a specific period of time. This allows the data update unit 23 to identify the RFID tag 91 (item 90) that has passed through the gate 50. The process flow will be described below with reference to FIG. 22.

[0109] First, in step S150, the data update unit 23 extracts the identification information of the RFID tags 91 that have, among the read RFID tags 91, the RSSI transition during the period when the flow line occurs at the entrance side that matches a predetermined first pattern. That is, the data update unit 23 extracts the RFID tags 91 that have the RSSI transition during the period when the flow line identified in step S101 occurs that matches a fluctuation pattern that indicates an increase in RSSI.

[0110] Next, in step S151, the data update unit 23 extracts the identification information of the RFID tags 91 extracted in step S150, of which the change in RSSI during the period when the flow line occurs on the exit side is in a predetermined second pattern. That is, the data update unit 23 extracts the RFID tags 91, of which the change in RSSI during the period when the flow line occurs identified in step S109 is in a fluctuation pattern that indicates a decrease in RSSI.

[0111] Then, in step S152, the data update unit 23 determines that the item 90 identified by the identification information extracted in step S151 has passed through the gate 50. Then, the data update unit 23 updates the transport information of this item 90 to a value indicating that the transport has been completed.

[0112] According to the management system 1 of the first embodiment, gate passage determination is performed using two types of information: the RSSI of the signal from the RFID tag and the movement path occurring in the area near the gate 50. This makes it possible to more reliably manage the carrying in and carrying out of items. In particular, in this embodiment, it is determined not only whether the change in RSSI shows a predetermined pattern, but also whether the change in RSSI over the same period as the occurrence period of the movement path shows the predetermined pattern. This makes it possible to more accurately identify the items 90 that actually passed through the gate 50.

[0113] Next, whether the item 90 has passed through the gate 50 is determined based on the RSSI signal from the RFID tag 91 and the traffic flow occurring in the area near the gate 50, and image information is linked. Fig. 23 is a flowchart illustrating an example of the flow of operations for carrying in the item 90 in the management system 1 according to the present disclosure. Below, the flow of operations for linking image information and compositing it onto a map when the item 90 is carried in will be described with reference to Fig. 23 .

[0114] In step S200, the image information control unit 25 acquires image information of an imaging target that is moving in the imaging area 60 from the image recognition device 300. Specifically, when an imaging target that is moving in the image is detected by performing image recognition on an image captured by the imaging device 310, the image recognition device 300 identifies the moving imaging target. The image recognition device 300 then outputs image information of the identified moving imaging target to the information processing device 20. This allows the image information control unit 25 to acquire image information of the moving imaging target. Note that this processing by the image information control unit 25 may be performed continuously while the processing from step S201 onwards is being performed.

[0115] Next, in step S201, the image information control unit 25 determines whether the moving imaging object has been carried in through the gate 50. If the moving imaging object has not passed through the gate 50 (No), the process returns to step S200. On the other hand, if the moving imaging object has passed through the gate 50 (Yes), the process proceeds to step S202.

[0116] In step S202, the image information control unit 25 acquires image information obtained by tracking the moving imaging target, and causes the imaging target to be image-recognized by the image recognition device 300. In this way, the image information control unit 25 acquires image information of the continuously moving imaging target from the image recognition device 300.

[0117] Next, in step S203, the management unit 26 determines whether the data update unit 23 has acquired, in the DB server 400, the identification information of the items 90 that passed through the gate 50 at the same time. If the data update unit 23 has not acquired the identification information of the items 90 that passed through the gate 50 at the same time (No), the processing proceeds to step S204. On the other hand, if the data update unit 23 has acquired the identification information of the items 90 that passed through the gate 50 at the same time (Yes), the processing proceeds to step S205.

[0118] In step S204, the image capture target is an object that is not subject to management, such as an AGV, that does not include identification information. Therefore, the management unit 26 determines that the image capture target is not subject to management. Then, the process returns to step S200.

[0119] In step S205, the management unit 26 links the image information with the identification information of the item 90. Then, the management unit 26 causes the data update unit 23 to update the management information including the identification information and image information in the DB server 400. The process proceeds to step S206.

[0120] In step S206, the image information control unit 25 determines whether or not the movement of the article 90 has stopped. If the movement of the article 90 has not stopped (No), the process proceeds to step S207. If the movement of the article 90 has stopped (Yes), the process proceeds to step S209.

[0121] In step S207, it is determined whether the article 90 has passed through the gate 50. The determination of whether the article 90 has passed through the gate 50 is as described above. If the article 90 has not passed through the gate (No), the process proceeds to step S206. If the article 90 has passed through the gate (Yes), the process proceeds to step S208.

[0122] In step S208, the management unit 26 causes the data update unit 23 to update the management information to include carry-out information indicating that the item 90 has passed through the gate 50 and been carried out. Then, the process proceeds to step S200.

[0123] In step S209, the image information control unit 25 acquires the position information of the image capture target whose movement has stopped from the image recognition device 300 as the position information of the item 90. The management unit 26 causes the data update unit 23 to update the management information to include the position information of the item 90.

[0124] In step S210, the display unit 27 combines the acquired position information of the item 90 with the map. The operation of the display unit 27 will be described below.

[0125] 24 is a flowchart illustrating an example of the flow of operations of the display unit 27 in the management system 1 according to the present disclosure. The flow of operations for displaying a map on the display unit 27 in the management system 1 will be described below with reference to FIG.

[0126] In step S250, the communications control unit 22 receives a request to display a map. For example, the user opens a map by specifying the map's address from the web. That is, the user requests the management unit 26 to display the map via the communications control unit 22. In response to this, the management unit 26 causes the display unit 27 to display the map.

[0127] In step S251, the display unit 27 displays a map on which the position of the article 90 is superimposed.

[0128] In step S252, the display unit 27 accepts the selection of the item 90 displayed on the map. For example, the user clicks on the item 90 on the map displayed on the web screen.

[0129] In step S253, the display unit 27 displays predetermined management information linked to the selected item 90. The predetermined management information may be preset information from among identification information, transport information, image information, and position information that identify the item 90.

[0130] 25 is a flowchart illustrating the flow of operations for carrying out the item 90 in the management system 1 according to the present disclosure. The flow of operations for carrying out the item 90 will be described below with reference to FIG.

[0131] In step S300, the image information control unit 25 acquires image information of an imaging target moving in the imaging area 60 from the image recognition device 300. Note that this processing by the image information control unit 25 may be performed continuously while the processing from step S301 onwards is being performed.

[0132] Next, in step S301, the image information control unit 25 determines whether the movement of the image capture target is the movement of the item 90 stored in the storage space 600. For example, this determination may be made based on whether the origin of the image capture target matches the position information of the item 90. If the movement of the image capture target is not the movement of the item 90 stored in the storage space 600 (if No), the process returns to step S300. For example, if the movement is the movement of the item 90 being carried in, the process is performed according to the above-mentioned carry-in flow. In addition, if the movement is the movement of an AGV or the like, the process also returns to step S300. On the other hand, if the movement of the image capture target is the movement of the item 90 stored in the storage space 600 (if Yes), the process proceeds to step S302.

[0133] In step S302, the image information control unit 25 acquires image information obtained by tracking the imaging target, and causes the imaging target to be image-recognized by the image recognition device 300. As a result, the image information control unit 25 acquires position information and image information of the continuously moving imaging target from the image recognition device 300.

[0134] In step S303, the management unit 26 associates the continuously acquired image information with the item 90.

[0135] In step S304, the image information control unit 25 determines whether the movement of the article 90 has stopped. If the movement of the article 90 has stopped (Yes), the process proceeds to step S305. If the movement of the article 90 has not stopped (No), the process proceeds to step S307.

[0136] In step S305, the image information control unit 25 acquires the position information of the image capture target whose movement has stopped from the image recognition device 300 as the position information of the item 90. The management unit 26 causes the data update unit 23 to update the management information so that the new position information of the item 90 is included.

[0137] In step S306, the display unit 27 combines the updated position information of the item 90 with the map.

[0138] In step S307, it is determined whether the article 90 has passed through the gate. The determination of whether the article 90 has passed through the gate 50 is as described above. If the article 90 has not passed through the gate (No), the process proceeds to step S304. If the article 90 has passed through the gate (Yes), the process proceeds to step S308.

[0139] In step S308, the management unit 26 causes the data update unit 23 to update the management information of the item 90. The management unit 26 may also cause the data update unit 23 to remove the management information of the item 90 from the management list. In this manner, the management unit 26 manages management information including the delivery of the item 90 to the storage space 600 and the delivery of the item 90 from the storage space 600.

[0140] According to this embodiment, the management system 1 not only has functions such as a gate equipped with a vector sensor that detects the carrying in and out of the gate 50 with high accuracy, but also recognizes images of the items 90 using an imaging device 310 such as a camera, so it is possible to track where the items 90 are placed in the storage space 600. Furthermore, the management system 1 can identify which of the items 90 stored in the storage space 600 are to be picked up.

[0141] Furthermore, according to this embodiment, in managing the loading and unloading of the items 90, in addition to identifying them based on their flow lines and using RSSI signals from the RFID tags 91, image information is acquired through image recognition. This allows multiple items 90 that have passed through the gate 50 in a mixed state to be distinguished by image recognition. For example, the stacking order in the vertical direction can be distinguished. Furthermore, since three types of information are acquired, including the two types of information including the identification based on their flow lines and the RSSI signals from the RFID tags 91 described above, as well as image information through image recognition, it is possible to reduce reading errors or omissions of the items 90. Furthermore, in this embodiment, moving items 90 are detected from around the gate 50, so the items 90 can be loaded and unloaded without having to stop in front of the gate 50.

[0142] Furthermore, according to this embodiment, it is possible to manage the location information of the items 90 stored in the storage space 600. Furthermore, it is possible to obtain information about the items 90 in the storage space 600 from a map. Therefore, it is possible to reduce the time required to search for the items 90. Furthermore, it is possible to easily set a route for a transport vehicle such as an AGV that transports the items 90, using the item location information and distribution information of multiple items 90 in the storage space 600. Furthermore, by using the map, it is possible to manage the items 90 in the storage space 600 from a remote location. This eliminates the need to directly check the items 90 in the storage space 600, thereby reducing the number of times that the user has to bend over.

[0143] Furthermore, according to this embodiment, when managing the items 90 stored in the storage space 600, the map can be used to update the information in real time. Also, it is possible to grasp with high accuracy whether or not the desired item 90 is present in the storage space 600. Note that, since the reading device 100 including the antenna 102, the imaging device 310, and the image recognition device 300 can be outsourced, the information processing device 20 can be made compact.

[0144] <Embodiment 2> Next, a management system according to embodiment 2 will be described. The above-described embodiment 1 illustrates an example in which the imaging device 310 captures an image of the storage space 600 from above. Therefore, embodiment 1 illustrates an example in which, for example, an item 90 placed flat in the storage space 600 is managed. However, the management system 1 may also manage an item 90 placed on a shelf in the storage space 600. For example, the imaging device 310 may be disposed to the side of the storage space 600 and capture an image of the storage space 600 from the side, thereby acquiring the position of the item 90 in the imaging space, including height information. Note that the imaging device 310 may be disposed above and capture an image from above to acquire the position of the item 90 in the imaging space, or may be disposed to the side and capture an image from the side to acquire the position of the item 90 in the imaging area 60.

[0145] FIG. 26 is a schematic diagram illustrating an imaging space 70 including height information captured by an imaging device 310 according to the present disclosure, viewed from the side. As shown in FIG. 26 , the imaging device 310 may be disposed, for example, on the side of a storage space 600 to capture an image of the imaging space 70 in the storage space 600 from the side. A shelf 71 may be disposed in the storage space 600. The imaging device 310 captures an image of the imaging space 70 by capturing an image of the imaging space 70. The imaging space 70 may include the storage space 600 or a predetermined area near the gate 50. Note that the location at which the imaging device 310 is disposed is not limited to the side of the storage space 600. The imaging device 310 may also be disposed in multiple locations, such as above and to the side. The imaging device 310 captures images of various objects, such as a person, an AGV, and an item 90, that have entered the imaging space 70. The imaging device 310 may, for example, capture images of each partial space 710 obtained by dividing the imaging space 70 in the storage space 600 into a grid pattern.

[0146] 27 and 28 are schematic diagrams illustrating an imaging space 70 imaged by an imaging device 310 according to the present disclosure, viewed from the side. As shown in FIG. 27 , the imaging device 310 images the imaging target from the side. Therefore, if a predetermined mark or the like that serves as characteristic information of the item 90 is placed on the side of the item 90, the imaging device 310 can reliably acquire the characteristic information of the item 90. This improves the accuracy of linking the imaging target to the item 90. Furthermore, because the imaging device 310 images the imaging target from the side, it can detect the vertical movement of the imaging target. Therefore, the management unit 26 can also acquire the vertical movement of the item 90 placed on a shelf 71 or the like in the storage space 600. As a result, as shown in FIG. 28 , the management unit 26 can manage position information, including height information of the item 90 in the storage space 600, as management information.

[0147] FIG. 29 is a schematic diagram illustrating a map of the storage space 600 according to the present disclosure. As shown in FIG. 29 , the display unit 27 may display a three-dimensional map of the storage space 600 on the screen. The three-dimensional map, for example, displays the three-dimensional positions of the items 90 managed in the storage space 600 and also displays vacant areas. The display unit 27 may also display a three-dimensional image of the storage space 600 on the screen. This allows the user to more clearly understand the status of the items 90 stored in the storage space 600.

[0148] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0149] Each drawing is merely an example for describing one or more embodiments. Each drawing may not relate to only one particular embodiment, but may also relate to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0150] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An information processing device comprising: a flow line identification unit that identifies a flow line of an object's movement within a predetermined area near a gate; an RSSI acquisition unit that acquires RSSI of signals from RFID tags near the gate; a passage determination unit that determines whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaged target identified in an image captured within the area by image recognition; and a management unit that associates the image information with the identified item and manages them. (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the management unit associates the image information with the item and manages them based on the image capturing time when the image of the imaged target was captured and the time when it was determined that the item had passed through the gate. (Supplementary Note 3) The information processing device according to Supplementary Note 1, wherein the management unit manages the image-recognized image target as the item together with the identification information by linking the image information with the item. (Supplementary Note 4) The information processing device according to Supplementary Note 3, wherein the gate separates the inside of a storage space where the item is stored from the outside of the storage space, and the management unit manages position information of the item in the storage space. (Supplementary Note 5) The information processing device according to Supplementary Note 4, wherein the image information acquisition unit acquires the position information of a change in the position of the item in the storage space, and the management unit manages the updated position information by linking it with the item. (Supplementary Note 6) The information processing device according to Supplementary Note 4, wherein the management unit manages management information including the delivery of the item to the storage space and the removal of the item from the storage space. (Supplementary Note 7) The information processing device according to Supplementary Note 1, further comprising a display unit that displays a map of a storage space in which items are stored, wherein the display unit displays position information of the items on the map.(Supplementary Note 8) A management system comprising: a sensor that detects an object within a predetermined area near a gate; a reading device that communicates with an RFID tag to read information stored in the RFID tag and measure the RSSI of the signal from the RFID tag; an imaging device that images the area; an image recognition device that performs image recognition on the image captured by the imaging device; and an information processing device, wherein the information processing device has: a flow line identification unit that identifies a flow line of an object within the predetermined area near the gate; an RSSI acquisition unit that acquires the RSSI of the signal from the RFID tag near the gate; a passage determination unit that determines whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of the image target of the identified image by image recognition of the image captured within the area; and a management unit that links and manages the image information and the identified item. (Supplementary Note 9) An information processing method comprising: identifying a path of movement of an object within a predetermined area near a gate; acquiring RSSI of signals from RFID tags near the gate; determining whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified path of movement and the acquired RSSI; acquiring image information of the imaged object identified in the image by image recognition of an image captured within the area; and linking the image information to the identified item for management. (Supplementary Note 10) The information processing method according to Supplementary Note 9, wherein, during management, the image information is linked to the item for management based on the image capturing time when the imaged object was captured and the time when it was determined that the item had passed through the gate. (Supplementary Note 11) The information processing method according to Supplementary Note 9, wherein, during management, the image information is linked to the item, thereby managing the image-recognized imaged object as the item together with the identification information. (Supplementary Note 12) The information processing method according to Supplementary Note 11, wherein the gate separates the inside of the storage space where the item is stored from the outside of the storage space, and manages position information of the item in the storage space when managing the gate.(Supplementary Note 13) The information processing method according to Supplementary Note 12, wherein, when acquiring the image information, position information indicating a change in the position of the item in the storage space is acquired, and when managing, the updated position information is linked to the item for management. (Supplementary Note 14) The information processing method according to Supplementary Note 12, wherein, when managing, management information including the delivery of the item to the storage space and the delivery of the item from the storage space is managed. (Supplementary Note 15) The information processing method according to Supplementary Note 9, wherein, when displaying, a map of the storage space in which the item is stored is displayed on a display unit, and when displaying, position information of the item is displayed on the map. (Supplementary Note 16) A program that causes a computer to execute the following steps: identify a flow line of an object within a predetermined area near a gate, acquire RSSI of a signal from an RFID tag near the gate, determine whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI, acquire image information of the image target of the identified image by image recognition of an image captured within the area, and manage the image information in association with the identified item. (Supplementary Note 17) The information processing device according to Supplementary Note 1, wherein the passage determination unit determines whether the item has passed through the gate based on whether a change in the RSSI during a period in which the identified flow line occurs corresponds to a predetermined fluctuation pattern corresponding to the flow line. (Supplementary Note 18) The information processing device according to Supplementary Note 2, wherein the flow line identification unit identifies a flow line of movement of an object within a predetermined first area on the entrance side of the gate, and the passage determination unit determines whether the item has passed through the gate based on whether a change in the RSSI during a period in which a flow line occurs within the first area indicates an increase in RSSI. (Supplementary Note 19) The information processing device according to Supplementary Note 17 or 18, wherein the flow line identification unit identifies a flow line of movement of an object within a predetermined second area on the exit side of the gate, and the passage determination unit determines whether the item has passed through the gate based on whether a change in the RSSI during a period in which a flow line occurs within the second area indicates a decrease in RSSI.(Supplementary Note 20) The information processing device according to Supplementary Note 17 or 18, wherein the RSSI acquisition unit acquires the RSSI of each of the signals received at each of the plurality of gates, and the passage determination unit identifies which of the gates the item has passed through based on the magnitude of the RSSI of the signal from the same RFID tag for each of the gates.

[0151] The elements described in other Supplements 2 to 7 and 17 to 20 that depend on Supplement 1, and other Supplements 10 to 15 that depend on Supplement 9, such as some or all of the configurations, units (means), and functions, may also depend on the systems, methods, and programs of the other Supplements in the same dependency relationship as in Supplement 1 and Supplement 9. Some or all of the elements described in any Supplement may be applied to various hardware, software, recording means for recording software, systems, and methods.

[0152] This application claims priority based on Japanese Patent Application No. 2024-034812, filed March 7, 2024, the disclosure of which is incorporated herein in its entirety by reference.

[0153] REFERENCE SIGNS LIST 1 Management system 10, 20 Information processing device 11 Flow line identification unit 12 RSSI acquisition unit 13 Passage determination unit 14 Image information acquisition unit 15 Management unit 21 Flow line identification unit 22 Communication control unit 23 Data update unit 24 Reading control unit 25 Image information control unit 26 Management unit 27 Display unit 50 Gate 51A, 51B Detection area 60 Imaging area 70 Imaging space 71 Shelf 90 Item 91 RFID tag 100 Reading device 101 RFID reader 102 Antenna 200A, 200B Sensor 201 Light beam 300 Image recognition device 301 Image DB 302 Image recognition unit 310 Imaging device 400 DB server 510A, 510B Partial area 600 Storage space 610 Partial domain 710 Partial space IF Communication interface MMR Memory PRC Processor

Claims

1. An information processing device comprising: a flow line identification means for identifying the flow line of an object within a specified area near a gate; an RSSI acquisition means for acquiring the RSSI of a signal from an RFID tag near the gate; a passage determination means for determining whether an item identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition means for acquiring image information of an imaged subject identified by image recognition of an image captured within the area; and a management means for linking and managing the image information and the identified item.

2. The information processing device according to claim 1, wherein the management means links and manages the image information and the item based on the imaging time when the object was imaged and the time when the item was determined to have passed through the gate.

3. The information processing device according to claim 1, wherein the management means links the image information with the item, thereby managing the image-recognized image target as the item together with the identification information.

4. The information processing device according to claim 3, wherein the gate separates the inside of the storage space where the item is stored from the outside of the storage space, and the management means manages location information of the item in the storage space.

5. The information processing device according to claim 4, wherein the image information acquisition means acquires the location information of the item in the storage space after it has been moved, and the management means links the updated location information with the item and manages it.

6. The information processing device according to claim 4, wherein the management means manages management information including the carrying-in of the item into the storage space and the carrying-out of the item from the storage space.

7. The information processing device according to claim 1, further comprising a display means for displaying a map of a storage space in which items are stored, said display means displaying location information of said items on said map.

8. The information processing device according to claim 1, wherein the passage determination means determines whether the item has passed through the gate based on whether the trend in the RSSI during the period in which the identified traffic line occurs corresponds to a predetermined fluctuation pattern corresponding to the traffic line.

9. The information processing device of claim 2, wherein the flow path identification means identifies the flow path of the object's movement within a predetermined first area on the entrance side of the gate, and the passage determination means determines whether the item has passed through the gate based on whether the trend in the RSSI during the period in which the flow path occurs within the first area represents an increase in RSSI.

10. An information processing device as described in claim 8 or 9, wherein the flow path identification means identifies the flow path of the object's movement within a specified second area on the exit side of the gate, and the passage determination means determines whether the item has passed through the gate based on whether the trend in the RSSI during the period in which the flow path occurs within the second area represents a decrease in RSSI.

11. An information processing device as described in claim 8 or 9, wherein the RSSI acquisition means acquires the RSSI of each of the signals received at each of the plurality of gates, and the passage determination means identifies which of the gates the item has passed through based on the magnitude of the RSSI of the signal from the same RFID tag for each gate.

12. A management system comprising: a sensor that detects objects within a specified area near a gate; a reading device that communicates with an RFID tag to read information stored in the RFID tag and measure the RSSI of the signal from the RFID tag; an imaging device that captures images within the area; an image recognition device that performs image recognition on the image captured by the imaging device; and an information processing device, wherein the information processing device has: a flow line identification means that identifies the flow line of an object within the specified area near the gate; an RSSI acquisition means that acquires the RSSI of the signal from the RFID tag near the gate; a passage determination means that determines whether an item identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition means that acquires image information of the image target of the identified image by image recognition of the image captured within the area; and a management means that links and manages the image information and the identified item.

13. An information processing method comprising: identifying the movement path of an object within a specified area near a gate; acquiring the RSSI of the signal from an RFID tag near the gate; determining whether an item identified by the identification information read from the RFID tag has passed through the gate based on the identified movement path and the acquired RSSI; acquiring image information of the imaged subject of the identified image by image recognition of an image captured within the area; and linking and managing the image information with the identified item.

14. An information processing method as described in claim 13, wherein, when managing, the image information and the item are linked and managed based on the imaging time when the object was imaged and the time when the item was determined to have passed through the gate.

15. An information processing method according to claim 13, wherein, when managing, the image information is linked to the item, and the imaged object that has been image-recognized is managed as the item together with the identification information.

16. The information processing method according to claim 15, wherein the gate separates the inside of the storage space where the item is stored from the outside of the storage space, and when managing the storage space, manages the location information of the item in the storage space.

17. The information processing method according to claim 16, wherein when acquiring the image information, location information indicating a change in the position of the item in the storage space is acquired, and when managing the information, the updated location information is linked to the item and managed.

18. The information processing method according to claim 16, wherein management information including the carrying-in of the item into the storage space and the carrying-out of the item from the storage space is managed during management.

19. The information processing method according to claim 13, further comprising displaying a map of a storage space in which items are stored on a display means, and displaying location information of the items on the map when displaying the map.

20. A program that causes a computer to perform the following actions: identify the movement path of an object within a specified area near a gate; acquire the RSSI of the signal from the RFID tag near the gate; determine whether an item identified by the identification information read from the RFID tag has passed through the gate based on the identified movement path and the acquired RSSI; acquire image information of the object captured in the identified image by image recognition of an image captured within the area; and manage the image information by linking it with the identified item.

Images