Information processing device, management system, information processing method, and program

Abstract

To provide an information processing device, a management system, an information processing method, and a program capable of more surely managing articles.SOLUTION: An information processing device 10 comprises: a traffic line identification unit 11 that identifies a traffic line of article movements in a prescribed region near a gate 50; an RSSI acquisition unit 12 that acquires an RSSI of a signal from an RFID tag near the gate 50; a passage determination unit 13 that determines whether or not an article 90 identified by identification information read from the RFID tag has passed through the gate 50 on the basis of the identified traffic line and the RSSI; an image information acquisition unit 14 that acquires image information containing characteristic information of the article identified by recognizing an image imaging the inside of the region; and a management unit 15 that manages the image information and the identified article 90 in association.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a management system, an information processing method, and a program. [Background technology]

[0002] In recent years, various technologies using RFID (Radio Frequency Identifier) ​​have been proposed. For example, Patent Document 1 discloses a system that uses RFID tags to manage whether or not an article has passed through a gate. The technology described in this document uses the RSSI (Received Signal Strength Indicator) of the signal from the RFID tag to determine whether or not the article to which the RFID tag is attached has passed through the gate. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-135731 [Patent Document 2] Special Publication No. 2023-526362 [Patent Document 3] Japanese Patent Publication No. 2023-023177 [Patent Document 4] Japanese Patent Publication No. 2021-127186 Summary of the Invention [Problem to be solved by the invention]

[0004] However, while the magnitude of the RSSI can generally be used to determine whether an RFID tag is approaching or moving away from a gate, it cannot determine whether the RFID tag has actually passed through the gate. In other words, there is a risk that an RFID tag (item) that has not actually passed through the gate may be mistakenly determined to have passed through the gate.

[0005] For this reason, when managing whether an item has been brought in or taken out by reading the RFID tag attached to the item at a gate (carry-in or carry-out), there is a need for technology that can more reliably determine whether the RFID tag has passed through the gate.Furthermore, when items brought in through a carry-in gate are stored in a storage space, there is a need to easily obtain information not only on items being taken out of the storage space through the carry-out gate, but also on items moving within the storage space and items stored in the storage space.

[0006] Therefore, one of the objectives that the embodiments disclosed in this specification aim to achieve is to provide an information processing device, management system, information processing method, and program that can more reliably manage items. [Means for solving the problem]

[0007] The information processing device according to the first aspect includes: a flow line identification unit that identifies a flow line of an object within a predetermined area near the gate; an RSSI acquisition unit that acquires RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an article identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaging target of the image identified by image recognition of an image captured within the area; a management unit that manages the image information and the identified item in association with each other; Equipped with.

[0008] The management system according to the second aspect includes: a sensor that detects an object within a predetermined area near the gate; a reader that communicates with the RFID tag to read information stored in the RFID tag and measure the RSSI of the signal from the RFID tag; an imaging device that captures an image of the area; an image recognition device that recognizes the image captured by the imaging device; Information processing device Equipped with The information processing device includes: a flow line identification unit that identifies a flow line of an object within a predetermined area near the gate; an RSSI acquisition unit that acquires RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an article identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaging target of the image identified by image recognition of an image captured within the area; a management unit that manages the image information and the identified item in association with each other; It has.

[0009] In the information processing method according to the third aspect, Identifying the movement of objects within a specified area near the gate, Acquire RSSI of a signal from an RFID tag near the gate; determining whether an article identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; acquiring image information of an imaging target of the image identified by performing image recognition on an image captured within the area; The image information and the identified item are linked and managed.

[0010] A program according to a fourth aspect includes: Identifying the movement of objects within a specified area near the gate, Acquire RSSI of a signal from an RFID tag near the gate; determining whether an article identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; acquiring image information of an imaging target of the image identified by performing image recognition on an image captured within the area; managing the image information and the identified item in association with each other; Make the computer do that. [Effects of the Invention]

[0011] According to the above aspects, it is possible to provide an information processing device, a management system, an information processing method, and a program that can more reliably manage items. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a block diagram illustrating a configuration of an information processing device according to the present disclosure. [Figure 2] FIG. 1 is a block diagram illustrating a configuration of a management system according to the present disclosure. [Figure 3] FIG. 1 is a schematic diagram illustrating a storage space where items managed by a management system according to the present disclosure are moved and stored. [Figure 4] FIG. 1 is a schematic diagram illustrating the periphery of a gate according to the present disclosure, showing the gate as viewed from the side. [Figure 5] FIG. 1 is a schematic diagram illustrating a detection area detected by a sensor according to the present disclosure, as viewed from above. [Figure 6] 1 is a schematic diagram illustrating an imaging area captured by an imaging device according to the present disclosure, viewed from above; [Figure 7] 1 is a block diagram illustrating a functional configuration of an information processing device according to the present disclosure. [Figure 8] 10 is a schematic diagram illustrating an example of a flow line that satisfies a start condition for a reading process of an RFID tag according to the present disclosure. [Figure 9] 10 is a schematic diagram illustrating an example of a flow line that satisfies a start condition for a reading process of an RFID tag according to the present disclosure. [Figure 10] 10A and 10B are schematic diagrams illustrating a flow line that does not satisfy the conditions for starting the reading process of an RFID tag according to the present disclosure. [Figure 11]10A and 10B are schematic diagrams illustrating a flow line that does not satisfy the conditions for starting the reading process of an RFID tag according to the present disclosure. [Figure 12] 10 is a schematic diagram illustrating a flow line that satisfies a termination condition for the RFID tag reading process according to the present disclosure. [Figure 13] 10 is a schematic diagram illustrating a flow line that satisfies a termination condition for the RFID tag reading process according to the present disclosure. [Figure 14] 10 is a schematic diagram illustrating a flow line that satisfies a termination condition for the RFID tag reading process according to the present disclosure. [Figure 15] 10A and 10B are schematic diagrams illustrating a flow line that satisfies the end condition of the reading process according to the present disclosure and that determines that the article has not passed through the gate. [Figure 16] 10A and 10B are schematic diagrams illustrating a flow line that satisfies the end condition of the reading process according to the present disclosure and that determines that the article has not passed through the gate. [Figure 17] 1 is a diagram illustrating an example of an imaging area captured by an imaging device according to the present disclosure. [Figure 18] 1 is a diagram illustrating an example of an imaging area captured by an imaging device according to the present disclosure. [Figure 19] FIG. 1 is a schematic diagram illustrating a map of storage space according to the present disclosure. [Figure 20] FIG. 1 is a schematic diagram illustrating a hardware configuration of an information processing device according to the present disclosure. [Figure 21] 1 is a flowchart illustrating an example of the flow of operations of a management system according to the present disclosure. [Figure 22] 10 is a flowchart illustrating a data update process according to the present disclosure. [Figure 23] 10 is a flowchart illustrating an example of the flow of an operation for carrying in an item in the management system according to the present disclosure. [Figure 24] 10 is a flowchart illustrating an example of the flow of operations of a display unit in a management system according to the present disclosure. [Figure 25] 10 is a flowchart illustrating an example of the flow of an operation for carrying out an item in the management system according to the present disclosure. [Figure 26]1 is a schematic diagram illustrating an imaging space including height information captured by an imaging device according to the present disclosure, as viewed from the side; [Figure 27] 1 is a schematic diagram illustrating an imaging space captured by an imaging device according to the present disclosure, viewed from the side; [Figure 28] 1 is a schematic diagram illustrating an imaging space captured by an imaging device according to the present disclosure, viewed from the side; [Figure 29] FIG. 1 is a schematic diagram illustrating a map of storage space according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] <Outline of the embodiment> Before describing the embodiments in detail, an overview of the embodiments will be described. Fig. 1 is a block diagram illustrating a configuration of an information processing device 10 according to the present disclosure. As shown in Fig. 1, the information processing device 10 includes a traffic line identification unit 11, an RSSI acquisition unit 12, a passage determination unit 13, an image information acquisition unit 14, and a management unit 15.

[0014] The flow line identification unit 11 identifies the flow line of an object within a predetermined area near the gate. The RSSI acquisition unit 12 acquires the RSSI of a signal from an RFID tag near the gate. The passage determination unit 13 determines whether an item identified by identification information read from an RFID tag has passed through the gate, based on the flow line identified by the flow line identification unit 11 and the RSSI acquired by the RSSI acquisition unit 12. The image information acquisition unit 14 acquires image information of the image target of the identified image by performing image recognition on an image captured within a predetermined area near the gate. The management unit 15 manages the image information acquired by the image information acquisition unit 14 by linking it with the item identified by the identification information.

[0015] When determining whether a user has passed through a gate using only the traffic flow, not only RFID tags that have actually passed through the gate but also RFID tags present near the gate are read. Therefore, there is a risk that tags that have not actually passed through the gate may be erroneously determined to have passed through the gate. Furthermore, when determining whether a user has passed through a gate using only RSSI, it is impossible to distinguish between an RFID tag that approaches a gate, passes through the gate, and then moves away from the gate, and an RFID tag that approaches the gate, moves away from the gate without passing through. Therefore, even in this case, there is a risk that an RFID tag that has not actually passed through the gate may be erroneously determined to have passed through the gate. In contrast, the information processing device 10 can determine whether a user has passed through a gate using two types of information: the RSSI of the signal from the RFID tag and the traffic flow occurring in the area near the gate. This reduces the above-mentioned erroneous determination. Therefore, the carrying in and carrying out of items can be more reliably managed.

[0016] Furthermore, the information processing device 10 can determine whether or not a person has passed through a gate using three types of information: the RSSI signal from the RFID tag, the flow of movement occurring in the area near the gate, and image information. This allows for even more reliable management of the carrying in and out of goods.

[0017] Furthermore, the information processing device 10 acquires image information and position information of the items that have passed through the gate and been carried into the storage space. This allows the information processing device 10 to acquire not only the positions of the items in the storage space but also changes in the positions of the items. This allows for more reliable management of the movement of items. Furthermore, information on the items stored in the storage space can be easily obtained.

[0018] In the present disclosure, a gate is a partition of space set up to manage the inflow or outflow of goods and does not necessarily have to be a physical structure. A gate can also be referred to as a transport entrance, a loading entrance, or an unloading entrance. For example, when managing the inflow of goods to a certain location, the inflow of the goods is deemed to have occurred when the goods are moved from the entrance side of the gate (loading entrance) to the exit side. Similarly, when managing the outflow of goods from a certain location, the outflow of the goods is deemed to have occurred when the goods are moved from the entrance side of the gate (unloading entrance). Specifically, the inflow or outflow of goods may refer to, for example, the inflow or outflow of goods in a warehouse or store. Furthermore, when a gate is installed in a store selling goods, the management of goods passing through the gate (i.e., the management of goods outflow) may refer to the identification of the goods to be purchased. In this way, the information processing device 10 can be used to manage the inflow or outflow of goods in various environments.

[0019] In addition, in this disclosure, a space separated by a gate is referred to as a storage space. In this case, the gate separates the inside of the storage space where items are stored from the outside of the storage space. Carrying in or out of an item means carrying in or out of the item to or from the storage space. The storage space includes a space where the carried-in items are stored. The storage space also includes a flat storage area or a shelf storage area where items are laid flat. When a gate is installed at the entrance of a storage space, the side of the gate facing the inside of the storage space is called the inside, and the side of the gate facing the outside of the storage space is called the outside. Therefore, carrying in an item can be said to be the movement of an item from the entrance side to the exit side of the gate (carry-in entrance), as well as the movement of an item from the outside of the gate (carry-in entrance) to the inside. In contrast, carrying out an item can be said to be the movement of an item from the entrance side to the exit side of the gate (carry-out exit), as well as the movement of an item from the inside to the outside of the gate (carry-out exit).

[0020] <Embodiment 1> FIG. 2 is a block diagram illustrating the configuration of a management system 1 according to the present disclosure. FIG. 3 is a schematic diagram illustrating a storage space 600 in which items 90 managed by the management system 1 according to the present disclosure are moved and stored. FIG. 4 is a schematic diagram illustrating the periphery of a gate 50 according to the present disclosure, showing a view of the gate 50 from the side. FIG. 5 is a schematic diagram illustrating detection areas 51A and 51B detected by sensors 200A and 200B according to the present disclosure, showing a view from above. FIG. 6 is a schematic diagram illustrating an imaging area 60 imaged by an imaging device 310 according to the present disclosure, showing a view from above. Note that the position of the imaging device 310 has been shifted in FIG. 6 to avoid cluttering the diagram.

[0021] As shown in FIGS. 2 to 6, the management system 1 includes an information processing device 20, a reading device 100, a sensor 200A, a sensor 200B, an image recognition device 300, an imaging device 310, and a DB server 400. The management system 1 is a system that manages the transport (specifically, carrying in or out) of an item 90 and the storage of the item 90 by managing the passage of the item 90 through a gate 50. The management system 1 identifies the item 90 that has passed through the gate 50 by reading (reading the identification information) an RFID tag 91 attached to the item 90 to be managed. In this way, the management system 1 manages whether or not transportation has been carried out for each item 90. The management system 1 also manages the items 90 in a storage space 600 based on image information of an image captured of the storage space 600 where the items 90 are stored.

[0022] In the description of this embodiment, for the sake of convenience, an entrance and an exit are defined for the gate 50, but the management system 1 may manage transport including passage through the gate 50 in both directions, rather than managing transport including passage through the gate 50 in one direction. Furthermore, for the delivery of the item 90, the entrance side of the gate 50 may be outside the storage space 600, and the exit side of the gate 50 may be inside the storage space 600. Conversely, for the delivery of the item 90, the entrance side of the gate 50 may be inside the storage space 600, and the exit side of the gate 50 may be outside the storage space 600.

[0023] The reading device 100 is a device for communicating with an RFID tag 91 attached to an item 90 that is the object of transportation and storage management, and reading information stored in the RFID tag 91. The reading device 100 also measures the RSSI of a signal from the RFID tag 91. The reading device 100 is connected to the information processing device 20 in a state in which communication is possible via wire or wirelessly. Note that the RFID tag 91 has, for example, identification information for uniquely identifying the item 90 stored in advance, and the reading device 100 reads the information stored in the RFID tag 91. The reading device 100 has an RFID reader 101 and an antenna 102.

[0024] The RFID reader 101 is a control circuit that communicates with the RFID tag 91 via the antenna 102 in accordance with a predetermined communication protocol and reads information stored in the RFID tag 91. The RFID reader 101 also measures the RSSI of the signal from the RFID tag 91 that is received by the antenna 102. The RFID reader 101 outputs the information read from the RFID tag 91 to the information processing device 20. The RFID reader 101 also outputs time-series data of the RSSI of the signal from the RFID tag 91 to the information processing device 20. More specifically, the RSSI time-series data is data that associates the identification information of the RFID tag 91 that transmitted the signal with the RSSI value and time information.

[0025] The antenna 102 is installed in a position where it can transmit and receive radio waves to and from the RFID tag 91 passing through the gate 50, and transmits radio waves to the RFID tag 91 and receives radio waves transmitted from the RFID tag 91. In this embodiment, a total of four antennas 102 are installed, two on each side of the gate 50, but the number of antennas 102 is not limited as long as it is one or more. Furthermore, the antenna 102 may be installed as a transmitting antenna and a receiving antenna separately.

[0026] The sensors 200A and 200B are sensors that detect objects within a predetermined area near the gate 50. The sensors 200A and 200B are connected to the information processing device 20 in a state in which they can communicate with each other via wire or wirelessly. The sensors 200A and 200B detect various objects, such as a person, an AGV (Automated Guided Vehicle), or an article 90 that has entered the predetermined area.

[0027] For example, the sensor 200A is a sensor that detects an object within a predetermined detection area 51A (also referred to as a first area) on the entrance side of the gate 50 (see FIGS. 4 and 5). As an example, the detection area 51A is an area outside the storage space 600. Furthermore, the sensor 200B is a sensor that detects an object within a predetermined detection area 51B (also referred to as a second area) on the exit side of the gate 50 (see FIGS. 4 and 5). As an example, the detection area 51B is an area inside the storage space 600. In this embodiment, the sensor 200A is provided near the top of the entrance side of the gate 50, and the sensor 200B is provided near the top of the exit side of the gate 50.

[0028] In this embodiment, the sensors 200A and 200B are sensors that detect objects by emitting light beams 201 to partial regions 510A and 510B obtained by dividing the predetermined detection regions 51A and 51B into a grid pattern and receiving reflected light of the light beams 201. The light beams 201 are, for example, infrared rays, but are not limited to infrared rays. The sensors 200A and 200B detect objects by detecting whether the light beams 201 emitted to the partial regions 510A and 510B are blocked by an object. The sensor 200A emits light beams 201 to each of the partial regions 510A (see FIGS. 4 and 5 ) obtained by dividing the detection region 51A on the entrance side of the gate 50 into a grid pattern and receives reflected light of the emitted light beams 201. Similarly, the sensor 200B emits a light beam 201 to each of the partial areas 510B (see Figures 4 and 5) obtained by dividing the detection area 51B on the exit side of the gate 50 into a grid pattern, and receives the reflected light of each emitted light beam 201.

[0029] The sensors 200A and 200B detect the presence of an object based on the difference in the light reception state of reflected light between when an object is present and when it is not present. This difference in the light reception state may be a difference in the reflection time or a difference in the amount of received light.

[0030] As described above, sensor 200A and sensor 200B emit light beams 201 to their respective partial regions 510A and 510B. Therefore, if the total number of partial regions 510A within detection region 51A or the total number of partial regions 510B within detection region 51B is n, sensor 200A and sensor 200B each obtain n detection results as object detection results. When an object moves within detection region 51A or detection region 51B, the range of partial region 510A or partial region 510B in which a detection result indicating the presence of an object is obtained changes over time. The change in the range of partial region 510A or partial region 510B in which a detection result indicating the presence of an object is obtained corresponds to the direction of movement.

[0031] Therefore, by analyzing the time-series data of the n detection results of the sensor 200A and the sensor 200B, it is possible to identify the movement direction of an object within the detection area 51A or the detection area 51B. In other words, it is possible to identify the movement line. Furthermore, since the detection results of the sensor 200A and the sensor 200B include time information, it is also possible to identify the period during which the movement line occurred (the period during which movement occurred). In this embodiment, the movement line is identified by the information processing device 20. For this reason, the sensor 200A and the sensor 200B each sequentially transmit the above-mentioned n detection results to the information processing device 20. As a result, the information processing device 20 acquires the time-series data of the detection results of the sensor 200A and the sensor 200B for each of the partial areas 510A and 510B.

[0032] In this embodiment, the entrance sensor 200A and the exit sensor 200B are used to detect an object, but one sensor that targets both the detection areas 51A and 51B may be used.

[0033] As described above, in this embodiment, a sensor that emits light beams 201 to each of partial areas 510A and 510B is used to detect an object, but any other sensor that can detect an object to identify its movement line may be used. For example, a camera that captures images of the movement of an object in detection areas 51A and 51B may be used.

[0034] The imaging device 310 captures an image of the imaging area 60 by capturing an image of the imaging area 60. The imaging area 60 may include the storage space 600 or a predetermined area near the gate 50. The image includes a video. The imaging device 310 may be disposed above the storage space 600, for example, and capture an image of the imaging area 60 in the storage space 600 from above. Note that the placement position of the imaging device 310 is not limited to above the storage space 600. The imaging device 310 captures images of various objects such as a person, an AGV, and an article 90 that enter the imaging area 60 (see FIGS. 3 and 6). The imaging device 310 may capture images of each partial area 610 obtained by dividing the imaging area 60 in the storage space 600 into a grid pattern, for example.

[0035] The imaging device 310 may include, for example, a camera. The imaging device 310 is connected to the information processing device 20 in a state where they can communicate with each other via wire or wirelessly. The imaging device 310 outputs image data including a captured image and the capture time at which the image was captured to the information processing device 20. Therefore, the image data includes time-series data in which the images are arranged according to the capture time. Therefore, the image data includes time information. Note that the imaging device 310 may be connected to the image recognition device 300 in a state where they can communicate with each other via wire or wirelessly, and output image data to the image recognition device 300.

[0036] The image recognition device 300 performs image recognition on an image captured by the imaging device 310. As a result, the image recognition device 300 identifies an imaging target captured in the image. The image recognition device 300 is connected to the information processing device 20 in a state in which they can communicate with each other via wired or wireless communication. The image recognition device 300 includes an image DB 301 and an image recognition unit 302.

[0037] The image DB 301 is a database that stores image information and characteristic information of the object captured in the image in association with each other. The characteristic information of the object includes characteristic points extracted from the image of the object. The image information includes information that identifies the object. For example, the characteristic information of the object includes information such as a predetermined size, a rectangular cardboard box, and a predetermined mark. The image information includes information such as ABC Company's DEF parts. The image DB 301 stores the image information and characteristic information of the object in association with each other in advance.

[0038] The image recognition unit 302 receives image data from the information processing device 20 or the imaging device 310. The image recognition unit 302 extracts feature points of the imaging target captured in the image in the image data. The image recognition unit 302 then compares the feature information of the imaging target in the image with the feature information stored in the image DB 301. For example, if the imaging target in the image captured by the imaging device 310 includes feature information such as a predetermined size, a rectangular cardboard box, a predetermined mark, etc., the image recognition unit 302 compares the feature information of the imaging target in the image DB 301.

[0039] When feature information of the imaging target of the image captured by the imaging device 310 matches feature information stored in the image DB 301, the image recognition unit 302 outputs the image information to the information processing device 20. For example, the image recognition unit 302 transmits information such as ABC company's DEF parts as image information. Note that "matching" of feature information refers to a case where the degree of match between feature points is equal to or greater than a predetermined value. The image recognition unit 302 also identifies the position of the imaging target in the imaging area 60. For example, the image recognition unit 302 identifies a partial area 610 in the imaging area 60 as the position of the imaging target. The image recognition unit 302 transmits, as position information, the position of the imaging target in the storage space 600 corresponding to the imaging area 60. Note that image data including an image recognized by the image recognition unit 302 includes time information. Therefore, the image recognition unit 302 may transmit image information including time information to the information processing device 20.

[0040] The image recognition unit 302 may perform image recognition using AI (Artificial Intelligence). For example, the image recognition unit 302 may perform image recognition using an image dictionary that has been previously trained on feature information and image information by machine learning.

[0041] The DB server 400 is a server that serves as a database that stores information about each item 90. The DB server 400 may store the information about the item 90 as management information.

[0042] The management information may include, for example, transport information, image information, and location information. The DB server 400 manages various information related to the item 90, for example, in association with identification information that identifies the item 90. For example, the transport information includes information on whether the item 90 has been transported. The image information includes information on an image capture target linked to the item 90. The location information includes information indicating the location of the item 90 in the storage space 600. In this embodiment, the transport information stored in the DB server 400 is updated by the information processing device 20 based on read information from the RFID tag 91 that has passed through the gate 50. Furthermore, the location information stored in the DB server 400 is updated by the information processing device 20 based on image information identified by image recognition of an image captured by the imaging device 310.

[0043] The information processing device 20 controls the reading device 100 based on the detection results of the sensors 200A and 200B, and manages whether or not the article 90 has been transported for each article 90 based on the detection results of the sensors 200A and 200B and the RSSI measured by the reading device 100. The information processing device 20 also manages image information identified by image recognition of an image captured by the imaging device 310 in association with the article 90 identified based on the sensors 200A, etc. and the RSSI.

[0044] The information processing device 20 is connected to the reading device 100, the sensors 200A and 200B, the image recognition device 300, the imaging device 310, and the DB server 400 in a wired or wireless manner so as to be able to communicate with each other. In the configuration shown in FIG. 2, the information processing device 20 communicates with the DB server 400 to update management information including transportation information, image information, and location information of the item 90 managed in a database; however, the information processing device 20 may have such a database. That is, the DB server 400 may be omitted from the management system 1. In the configuration shown in FIG. 2, the information processing device 20 communicates with the image recognition device 300 to perform image recognition on an image captured by the imaging device 310; however, the information processing device 20 may have such an image recognition device 300. That is, the image recognition device 300 may be omitted from the management system 1.

[0045] 7 is a block diagram illustrating a functional configuration of an information processing device 20 according to the present disclosure. As shown in FIG. 7, the information processing device 20 includes a flow line identification unit 21, a communication control unit 22, a data update unit 23, a reading control unit 24, an image information control unit 25, a management unit 26, and a display unit 27.

[0046] The trajectory identification unit 21 corresponds to the trajectory identification unit 11 in FIG. 1. Based on the detection result of the sensor 200A, the trajectory identification unit 21 identifies the trajectory of an object's movement within a predetermined detection area 51A on the entrance side of the gate 50 and identifies the period during which the trajectory occurs. The trajectory identification unit 21 also identifies the trajectory of an object's movement within a predetermined detection area 51B on the exit side of the gate 50 and identifies the period during which the trajectory occurs. In this embodiment, the trajectory identification unit 21 uses time-series data of the detection results acquired from the sensors 200A and 200B to analyze the temporal transition of the ranges of the partial areas 510A and 510B in which detection results indicating the presence of an object are obtained. As a result, the trajectory identification unit 21 identifies the trajectory of the object and the period during which the trajectory occurs. Specifically, the trajectory identification unit 21 identifies the object's movement direction (movement path) as the trajectory. When a camera is used as a sensor for detecting an object, the flow line identifying unit 21 analyzes the image captured by the camera to identify the flow line of the object and the period in which it occurred.

[0047] The communication control unit 22 communicates with other devices and transmits and receives information to and from the other devices. Specifically, the communication control unit 22 acquires information stored in the RFID tag 91 from the RFID reader 101 of the reading device 100. The communication control unit 22 also acquires RSSI time-series data from the RFID reader 101 of the reading device 100. Therefore, the communication control unit 22 corresponds to the RSSI acquisition unit 12 in FIG. 1. That is, the communication control unit 22 acquires the RSSI of the signal from the RFID tag 91 near the gate 50. The communication control unit 22 may also be referred to as an RSSI acquisition unit. The communication control unit 22 also acquires detection results from the sensors 200A and 200B. The communication control unit 22 also transmits and receives management information about the item 90 to and from the DB server 400. The communication control unit 22 also acquires image data from the imaging device 310. The communication control unit 22 also transmits and receives image data and image information to and from the image recognition device 300.

[0048] The data update unit 23 updates the transportation information for the item 90 that has passed through the gate 50. To this end, the data update unit 23 determines whether the item 90 identified by the identification information read from the RFID tag 91 has passed through the gate 50. The data update unit 23 determines whether the item 90 identified by the identification information read from the RFID tag 91 has passed through the gate 50 using the identified flow path and the acquired RSSI. The data update unit 23 corresponds to the passage determination unit 13 in FIG. 1. For this reason, the data update unit 23 may also be referred to as a passage determination unit. The data update unit 23 also updates image information of the image capture target identified by image recognition of the image captured by the imaging device 310, and position information of the item 90 in the storage space 600. In this way, the data update unit 23 updates management information including the transportation information, image information, and position information. Details of the processing by the data update unit 23 will be described later.

[0049] The reading control unit 24 determines whether the flow line identified by the flow line identification unit 21 matches a predetermined pattern as a start condition for reading the RFID tag 91. More specifically, when the identified flow line of the object's movement within the detection area 51A matches this predetermined pattern, the reading control unit 24 controls the reading device 100 to start the reading process of the RFID tag 91 near the gate 50. Specifically, the reading control unit 24 instructs the reading device 100 to start the reading process of the RFID tag 91. As a result, the reading process is started by the reading device 100, and if an RFID tag 91 that can communicate with the reading device 100 is present, the information of the RFID tag 91 is read by the reading device 100.

[0050] In this embodiment, specifically, the predetermined pattern as a start condition for the reading process of the RFID tag 91 is a movement pattern of approaching a predetermined position near the entrance of the gate 50. That is, the reading control unit 24 performs control to start the reading process of the RFID tag 91 when the identified flow line indicates movement approaching a predetermined position near the entrance of the gate 50. Note that the predetermined position near the entrance is specifically, for example, the edge of the detection area 51A on the gate 50 side.

[0051] The image information control unit 25 acquires image information of the imaging target of the image identified by image recognition of the image captured in the imaging area 60. Therefore, the image information control unit 25 corresponds to the image information acquisition unit 14 in FIG. 1 . Therefore, the image information control unit 25 may also be referred to as an image information acquisition unit. The image information control unit 25 receives image data from the imaging device 310, in which images captured by the imaging device 310 are arranged in chronological order. Furthermore, the image information control unit 25 transmits the image data received from the imaging device 310 to the image recognition device 300. As a result, the image information control unit 25 causes the image recognition device 300 to perform image recognition. Furthermore, the image information control unit 25 receives, from the image recognition device 300, image information of the imaging target of the image identified by image recognition and position information in the storage space 600 corresponding to each partial area 610 of the imaging area 60.

[0052] If a change occurs in the position information of the object being imaged in the image as a result of the image recognition device 300 recognizing the image captured by the imaging device 310, the image information control unit 25 obtains the position information of the item 90 in the storage space 600 after the change from the image recognition device 300.

[0053] The management unit 26 manages the image information received from the image recognition device 300 in association with the article 90 identified by the identification information. Therefore, the management unit 26 corresponds to the management unit 15 in FIG. 1. The management unit 26 may manage the image information in association with the article 90 based on the imaging time when the image of the imaged object was captured and the passing time when it was determined that the article 90 passed through the gate 50. That is, when the passing time of the imaged object through the gate 50 calculated from the imaging time matches the passing time of the article 90 through the gate 50 calculated from the movement of the flow line and the change in RSSI intensity, the management unit 26 manages the image information in association with the article 90. This allows the article 90 to be identified from three types of information, thereby enabling more reliable management of the article 90.

[0054] In this way, the management unit 26 links the image information with the item 90, thereby managing the image-recognized image target as the item 90 together with its identification information. The management unit 26 causes the data update unit 23 to update management information including transportation information, image information, and position information of the item 90 identified by the identification information. In this way, the management unit 26 manages the position information of the item 90 in the storage space 600. Specifically, for example, the management unit 26 causes the data update unit 23 to update the position information of the image target linked to the item 90. When the image information control unit 25 acquires position information indicating that the position of the item 90 in the storage space 600 has moved, the management unit 26 links the updated position information with the item 90 and manages it.

[0055] The display unit 27 displays a map of the storage space 600. For example, the display unit 27 displays an image of the storage space 600 together with the map of the storage space 600 on a screen such as a user's display. The display unit 27 displays the position of the item 90 on the map.

[0056] Next, the operation of the information processing device 20 of this embodiment will be described, including "passing of an article through a gate" and "movement of an article's position in a storage space." In this embodiment, the entrance side of the gate 50 indicates the outside of the storage space 600, and the exit side of the gate indicates the inside of the storage space 600. Therefore, in this case, the detection area 51A is the area outside the storage space 600, and the detection area 51B is the area inside the storage space 600.

[0057] <Items passing through the gate> 8 and 9 are schematic diagrams illustrating a flow line that satisfies the start condition for the reading process of the RFID tag 91 according to the present disclosure. In Fig. 8 and Fig. 9, the hatched partial area 510A indicates the partial area 510A where the presence of an object was detected, and the arrows indicate the flow line. As shown in Fig. 8 and Fig. 9, when the flow line of the identified object indicates movement approaching a predetermined position near the entrance of the gate 50 (specifically, the edge of the detection area 51A on the gate 50 side), the reading control unit 24 performs control to start the reading process.

[0058] 10 and 11 are schematic diagrams illustrating examples of traffic lines that do not satisfy the conditions for starting the reading process of the RFID tag 91 according to the present disclosure. In FIGS. 10 and 11, the hatched partial area 510A indicates the partial area 510A where the presence of an object was detected, and the arrows indicate the traffic lines. FIG. 10 shows an example of a traffic line that corresponds to movement across the periphery of the gate 50. FIG. 11 shows an example of a traffic line that corresponds to movement that approaches the gate 50 and then turns back.

[0059] The reading control unit 24 also determines whether the flow line identified by the flow line identification unit 21 matches a predetermined pattern as a termination condition for the reading process of the RFID tag 91. More specifically, the reading control unit 24 controls the reading process to terminate when the identified flow line of the object's movement within the detection area 51B matches this predetermined pattern. Specifically, the reading control unit 24 instructs the reading device 100 to terminate the reading process of the RFID tag 91. This terminates the reading process by the reading device 100.

[0060] Specifically, in this embodiment, one of the patterns predetermined as the termination condition for the reading process of the RFID tag 91 is a movement pattern moving away from the vicinity of the exit of the gate 50. That is, the reading control unit 24 performs control to terminate the reading process of the RFID tag 91 when the identified flow line indicates movement moving away from the vicinity of the exit of the gate 50.

[0061] 12 to 14 are schematic diagrams illustrating examples of flow lines that satisfy the conditions for ending the reading process of an RFID tag 91 according to the present disclosure. In Fig. 12 and Fig. 13, the hatched partial area 510B indicates the partial area 510B where the presence of an object was detected, and the arrows indicate the flow lines. As shown in Fig. 12 and Fig. 13, when the flow line of the identified object indicates movement away from the exit of the gate 50, the reading control unit 24 performs control to end the reading process.

[0062] The pattern predetermined as the end condition of the reading process may be a movement pattern from near the exit of gate 50 to outside of detection area 51B as shown in Figures 12 and 13, or a movement pattern that does not leave detection area 51B as shown in Figure 14. In other words, the pattern predetermined as the end condition of the reading process may be a movement pattern that moves away from near the exit of gate 50 to a predetermined position within detection area 51B. In this case, the reading process can be ended even if the object has not moved outside of detection area 51B, and it is possible to prevent the reading process from being continued unnecessarily.

[0063] However, even if a flow line that satisfies the start condition of the reading process is obtained, it is possible that the carrier does not pass through gate 50, or passes through it once and then turns back. In this case, the above-mentioned flow line that satisfies the end condition of the reading process cannot be obtained. Therefore, a predetermined pattern other than the above-mentioned pattern can also be used as the end condition of the reading process of the RFID tag 91. Such a pattern is a movement pattern that moves away from the vicinity of the entrance of gate 50 on the entrance side of gate 50.

[0064] Therefore, the reading control unit 24 controls the reading process to end if the flow line identified after the start of the reading process indicates movement away from the vicinity of the entrance of gate 50 on the entrance side of gate 50. That is, the reading control unit 24 controls the reading process to end if the flow line identified about the movement of an object within the detection area 51A after the start of the reading process indicates movement away from the vicinity of the entrance of gate 50. In such a case, the transport information should not be updated as it is assumed that the item 90 identified by the identification information read from the RFID tag 91 has passed through gate 50. Therefore, the data update unit 23 determines that the item 90 has not passed through gate 50 if the flow line identified after the start of the reading process indicates movement away from the vicinity of the entrance of gate 50 on the entrance side of gate 50.

[0065] In other words, the data update unit 23 determines that the item 90 has not passed through the gate 50 if, after the reading process has begun, movement away from the vicinity of the entrance of the gate 50 is detected on the entrance side of the gate 50, rather than movement away from the vicinity of the exit of the gate 50.

[0066] 15 and 16 are schematic diagrams illustrating an example of a flow line that satisfies the termination condition of the reading process according to the present disclosure and determines that the article 90 has not passed through the gate 50. In FIGS. 15 and 16, the hatched partial areas 510A and 510B indicate the partial areas 510A and 510B where the presence of an object was detected, and the arrows indicate the flow line. FIG. 15 illustrates an example of a flow line that corresponds to a movement that returns without passing through the gate 50. FIG. 16 illustrates an example of a flow line that corresponds to a movement that passes through the gate 50 but then returns. As shown in FIGS. 15 and 16, if, after the start of the reading process, the entrance side of the gate 50 indicates movement away from the vicinity of the entrance of the gate 50, the reading control unit 24 controls the reading process to end. Then, the data update unit 23 determines that the article 90 identified by the read identification information has not passed through the gate 50. This prevents the transportation information from being updated to incorrect information.

[0067] Here, consider a case where an article 90 is left unattended near the entrance of gate 50. In this case, too, the article 90 identified by the identification information read from the RFID tag 91 is considered to have passed through gate 50, and the transport information should not be updated. Therefore, if the flow line identified after the start of the reading process indicates that the object is staying near the entrance of gate 50, the data update unit 23 determines that the article 90 has not passed through gate 50. In other words, if the flow line identified regarding the movement of an object within the detection area 51A after the start of the reading process indicates that the object is staying near the entrance of gate 50, the data update unit 23 determines that the article 90 has not passed through gate 50. In other words, if the data update unit 23 detects that the object is staying near the entrance of gate 50, rather than moving away from the exit of gate 50, after the start of the reading process, the data update unit 23 determines that the article 90 has not passed through gate 50. This prevents the transport information from being updated to incorrect information. In this case, the reading control unit 24 controls the reading process to end. That is, the reading control unit 24 controls the reading process to end when the flow line identified after the start of the reading process indicates that the object will remain near the entrance to the gate 50.

[0068] As described above, the reading control unit 24 controls the reading process to end when the movement line identified after the start of the reading process matches one of the patterns predetermined as the end conditions for the reading process. As described above, the predetermined patterns are, for example, movement away from the vicinity of the exit of the gate 50, movement away from the vicinity of the entrance of the gate 50 on the entrance side of the gate 50, and the object remaining near the entrance of the gate 50.

[0069] The data update unit 23 determines whether the item 90 identified by the identification information read from the RFID tag 91 has passed through the gate 50. As described above, the data update unit 23 determines that the item 90 has not passed through the gate 50 when the reading process is completed due to the identification of a flow line other than the flow line corresponding to the movement pattern moving away from the exit vicinity of the gate 50. In other words, the data update unit 23 determines that the item 90 identified by the identification information read by this reading process has not passed through the gate 50. Therefore, in this case, the data update unit 23 does not update the transport information of this item 90 to transport information indicating that it has passed through the gate 50.

[0070] On the other hand, when the reading process is completed by identifying a flow line corresponding to a movement pattern moving away from the exit of gate 50, data update unit 23 determines that article 90 has passed through gate 50. The article 90 identified by the identification information obtained in this reading process is treated as a candidate for article 90 that has passed through gate 50. Here, the candidate for article 90 that has passed gate 50 may include an article 90 that has not actually passed through gate 50. For example, when article 90 passes through gate 50, if another article 90 is present near gate 50 (reader 100), the identification information of the RFID tag 91 of this other article 90 may also be read. Note that such unintended reading may occur due to unexpected signal reflection, etc., even if a directional antenna is used as antenna 102.

[0071] When the reading process is completed by identifying a flow line corresponding to a movement pattern moving away from the exit of gate 50, that is, when it is determined that an article 90 has passed through gate 50, data update unit 23 identifies which article 90 has passed through gate 50. To do this, data update unit 23 refers to the RSSI of the signal from RFID tag 91 read by this reading process.

[0072] It is assumed that the time series data of the RSSI of the signal from the RFID tag 91 of the article 90 that actually passed through the gate 50 will be the following time series data. The RFID tag 91 of the article 90 that actually passed through the gate 50 will gradually approach the antenna 102 provided on the gate 50, and then gradually move away from the antenna 102. Therefore, it is assumed that the time series data of the RSSI of the signal from the RFID tag 91 of the article 90 that actually passed through the gate 50 will gradually increase, and then gradually decrease. For this reason, the data update unit 23 determines whether the article 90 of interest actually passed through the gate 50 based on whether the transition of the RSSI for the article 90 of interest during the period in which the identified flow line occurs corresponds to a predetermined fluctuation pattern corresponding to the flow line.

[0073] In this embodiment, when any article 90 passes through gate 50, two flow lines are identified. The first flow line is the flow line of the object within a predetermined detection area 51A on the entrance side of gate 50. More specifically, this is the flow line of movement approaching a predetermined position near the entrance of gate 50, i.e., the flow line corresponding to the start condition of the reading process. The second flow line is the flow line of the object within a predetermined detection area 51B on the exit side of gate 50. More specifically, this is the flow line of movement away from the vicinity of the exit of gate 50, i.e., the flow line corresponding to the end condition of the reading process. Hereinafter, the first flow line described above will be referred to as the IN flow line, and the second flow line will be referred to as the OUT flow line.

[0074] As described above, the data update unit 23 determines whether the article 90 has passed through the gate 50 based on whether the transition of the RSSI during the period in which the identified flow line occurs corresponds to a predetermined fluctuation pattern corresponding to the flow line. Here, the period in which the IN flow line occurs corresponds to the period in which the movement represented by the IN flow line occurs, and the period in which the OUT flow line occurs corresponds to the period in which the movement represented by the OUT flow line occurs.

[0075] The period during which an IN traffic line occurs is the period during which the RFID tag 91 gradually approaches the antenna 102 provided at the gate 50. Therefore, the RSSI value increases during this period. Therefore, when the identified traffic line is an IN operation, the predetermined fluctuation pattern corresponding to the traffic line is specifically a fluctuation pattern that indicates an increase in RSSI.

[0076] In contrast, the period during which an OUT traffic line occurs is the period during which the RFID tag 91 gradually moves away from the antenna 102 provided at the gate 50. Therefore, the RSSI value decreases during this period. Therefore, when the identified traffic line is an OUT movement, the predetermined fluctuation pattern corresponding to the traffic line is specifically a fluctuation pattern that indicates a decrease in RSSI.

[0077] Therefore, the data update unit 23 determines whether the item 90 of interest (RFID tag 91) has passed through the gate 50 based on whether the change in the RSSI of the item 90 of interest (RFID tag 91) during the period in which the IN flow line occurs indicates an increase in the RSSI. The data update unit 23 also determines whether the item 90 of interest (RFID tag 91) has passed through the gate 50 based on whether the change in the RSSI of the item 90 of interest (RFID tag 91) during the period in which the OUT flow line occurs indicates a decrease in the RSSI.

[0078] In this embodiment, when the transition of the RSSI for the item 90 (RFID tag 91) of interest satisfies the above-mentioned conditions in both the period when the IN flow line occurs and the period when the OUT flow line occurs, the data update unit 23 determines that the item 90 has passed through the gate 50. Note that when the transition of the RSSI for the item 90 (RFID tag 91) of interest satisfies the above-mentioned conditions in either the period when the IN flow line occurs or the period when the OUT flow line occurs, the data update unit 23 determines that the item 90 has passed through the gate 50.

[0079] In this way, the data update unit 23 determines not only whether the RSSI transition shows a predetermined pattern, but also whether the RSSI transition during the same period as the occurrence period of the traffic line shows a predetermined pattern. Therefore, it is possible to more accurately identify the article 90 that actually passed through the gate 50 compared to when it is determined only whether the RSSI transition shows a predetermined pattern.

[0080] When the data update unit 23 identifies the article 90 that has passed through the gate 50, it updates the transport information of this article 90 to transport information indicating that the article 90 has passed through the gate 50.

[0081] <Moving items in storage space> If the entrance side of the gate 50 separating the storage space 600 is outside the storage space 600 and the exit side of the gate 50 is inside the storage space 600, the items 90 that pass through the gate 50 as described above are transported into the storage space 600.

[0082] 17 and 18 are diagrams illustrating an imaging area 60 captured by an imaging device 310 according to the present disclosure. As shown in FIG. 17, the imaging device 310 captures an image of the imaging area 60. The imaging area 60 includes a predetermined area near the gate 50 in the storage space 600. The image recognition device 300 receives image data captured by the imaging device 310 via the information processing device 20 or directly from the imaging device 310. The image recognition device 300 performs image recognition on the image in the received image data, and when a moving imaging target is detected, identifies the moving imaging target. For example, the image recognition unit 302 extracts feature points of the imaging target and identifies the imaging target by comparing them with the image DB 301. The image recognition device 300 outputs image information identifying the moving imaging target to the information processing device 20.

[0083] When the image information control unit 25 receives image information of a moving imaging target, it determines whether the moving imaging target has passed through the gate 50 and been carried in. For example, the image information control unit 25 causes the image recognition device 300 to perform image recognition of the gate 50 and determines whether the imaging target has passed through the gate 50. Note that the positions of the gates 50 may be set in advance in the image, and the determination may be made based on whether the imaging target has passed between the set gates 50. When the moving imaging target has passed through the gate 50 and been carried in, the image information control unit 25 may control the image recognition device 300 to continue tracking and image-recognizing the moving imaging target. In this way, the image information control unit 25 receives image information of the tracked imaging target.

[0084] The management unit 26 determines whether or not the DB server 400 has identification information for the RFID tag 91 of the article 90 that has passed through the gate 50. If the DB server 400 has identification information for the article 90, the management unit 26 acquires the identification information for the article 90 from the DB server 400. The management unit 26 then determines whether the image capture target matches the article 90. For example, the management unit 26 may compare the time when the image capture target passed through the gate with the time when the article 90 passed through the gate 50, or may compare the identification information of the article 90 with predetermined information in the image information. If the image capture target matches the article 90, the management unit 26 associates the image information acquired by the image information control unit 25 with the identification information of the article 90 acquired from the DB server 400 and manages them in association with each other. In other words, the management unit 26 associates the moving image capture target as the article 90.

[0085] When the moving item 90 stops inside the storage space 600, the image information control unit 25 receives the position information of the item 90 in the storage space 600 from the image recognition device 300. Then, the management unit 26 causes the data update unit 23 to update the management information in the DB server 400. Specifically, when the image information control unit 25 acquires the position information of the item 90 in the storage space 600, the management unit 26 updates the position information of the item 90 in the management information.

[0086] As shown in FIG. 18, the management unit 26 manages management information including transport information, image information, and position information for a plurality of items 90 stored in the storage space 600.

[0087] FIG. 19 is a schematic diagram illustrating a map of the storage space 600 according to the present disclosure. As shown in FIG. 19, the display unit 27 displays the map of the storage space 600 on the screen. The map displays, for example, the locations of the items 90 managed in the storage space 600, as well as vacant areas. Therefore, by sharing the map with field workers working in the storage space 600, the user can specify the storage location of the items 90 and the location to which the items 90 should be moved.

[0088] Furthermore, by clicking on an item 90 on the map displayed on the web screen, the user can check the image information and location information in addition to the history of recognition of the item 90 and transport information including the loading and unloading of the item 90. Furthermore, by clicking on the item 90, the user can check the identification information of the RFID tag 91 of the item 90. For example, if the identification information includes information about the individual packaging inside the package of the item 90, this information can be checked.

[0089] Next, a description will be given of the hardware configuration of the information processing device 20. Fig. 20 is a schematic diagram illustrating the hardware configuration of the information processing device 20 according to the present disclosure. As shown in Fig. 20, the information processing device 20 includes a communication interface IF, a memory MMR, and a processor PRC.

[0090] The communication interface IF is used to communicate with other devices. In this embodiment, the communication interface IF includes interfaces for communicating with the RFID reader 101, the sensor 200A, the sensor 200B, the imaging device 310, the image recognition device 300, and the DB server 400.

[0091] The memory MMR is configured, for example, by a combination of volatile memory and non-volatile memory, and is used to store software (computer programs) including one or more instructions executed by the processor PRC, as well as data used for various processes of the information processing device 20.

[0092] The processor PRC reads and executes software (computer programs) from the memory MMR to perform processing of the flow line identification unit 21, communication control unit 22, data update unit 23, reading control unit 24, image information control unit 25, management unit 26, and display unit 27. The processor PRC may be a microprocessor, an MPU (Micro Processor Unit), a CPU (Central Processing Unit), or the like. The processor PRC may include multiple processors.

[0093] In this way, the information processing device 20 has the functionality of a computer. Similarly, the DB server 400 has a processor PRC and a memory MMR, and has the functionality of a computer. Note that the RFID reader 101, the imaging device 310, and the image recognition device 300 may also have a processor PRC and a memory MMR, and have the functionality of a computer. Therefore, the functions of the RFID reader 101, the imaging device 310, and the image recognition device 300 may be realized by the execution of a program by the processor PRC. As such, it will be understood by those skilled in the art that the functions of the management system 1 can be realized in various ways, using only hardware, only software, or a combination thereof, and are not limited to any one of them.

[0094] The above-described program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program can also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to a computer via a wired communication path such as an electric wire or optical fiber, or via a wireless communication path.

[0095] Next, a description will be given of the operation of the management system 1. Fig. 21 is a flowchart illustrating the flow of the operation of the management system 1 according to the present disclosure. Below, the flow of the operation of reading the RFID tag 91 in the management system 1 will be described with reference to Fig. 21.

[0096] In step S100, the flow line identification unit 21 identifies the flow line of the movement of the object and the time of occurrence (period of occurrence) based on the detection results of the sensors 200A and 200B. Note that this process by the flow line identification unit 21 is continuously performed even while the processes from step S101 onwards are being performed.

[0097] Next, in step S101, the reading control unit 24 determines whether the flow line identified by the flow line identification unit 21 corresponds to a pattern predetermined as a start condition for the reading process of the RFID tag 91. That is, the reading control unit 24 determines whether the identified flow line indicates movement approaching the entrance of the gate 50. If the identified flow line does not indicate movement approaching the entrance of the gate 50 (No), the reading process is not started, and the process returns to step S100. On the other hand, if the identified flow line indicates movement approaching the entrance of the gate 50 (Yes), the process proceeds to step S102.

[0098] In step S102, the reading control unit 24 determines that the conditions for starting the reading process are satisfied, and performs control to start the reading process of the RFID tag 91.

[0099] Next, in step S103, data update unit 23 determines whether the flow line after the start of the reading process indicates that the object is staying near the entrance of gate 50. If the object is staying at the entrance of gate 50 for a predetermined time or more (if Yes), the process proceeds to step S104. On the other hand, if the object is not staying at the entrance of gate 50 for a predetermined time or more (if No) in step S103, the process proceeds to step S106.

[0100] In step S104, the reading control unit 24 performs control to end the reading process.

[0101] Then, in step S105, the data update unit 23 determines that the article 90 identified by the identification information read from the RFID tag 91 by the reading process started in step S102 has not passed through the gate 50. After step S105, the process returns to step S100.

[0102] Meanwhile, in step S106, the data update unit 23 determines whether the flow line after the start of the reading process indicates movement that turns back from near the entrance of gate 50. If the flow line indicates movement that turns back from near the entrance of gate 50 (if Yes), the process proceeds to step S107. On the other hand, if in step S106 the flow line does not indicate movement that turns back from near the entrance of gate 50 (if No), the process proceeds to step S109.

[0103] In step S107, the reading control unit 24 performs control to end the reading process.

[0104] Then, in step S108, the data update unit 23 determines that the article 90 identified by the identification information read from the RFID tag 91 by the reading process started in step S102 has not passed through the gate 50. After step S108, the process returns to step S100.

[0105] Meanwhile, in step S109, the data update unit 23 determines whether the flow line after the start of the reading process indicates movement away from the vicinity of the exit of gate 50. If the flow line indicates movement away from the vicinity of the exit of gate 50 (if Yes), the process proceeds to step S110. On the other hand, if in step S109 the flow line does not indicate movement away from the vicinity of the exit of gate 50 (if No), the process returns to step S103.

[0106] In step S110, the reading control unit 24 performs control to end the reading process.

[0107] Then, in step S111, the data update unit 23 performs processing to update the transport information of the item 90 that has passed through the gate 50 to transport information indicating that the item has passed through the gate 50. The processing flow of this step will be specifically described with reference to FIG. 22.

[0108] 22 is a flowchart illustrating the flow of data update processing according to the present disclosure. In this processing, the data update unit 23 determines whether the RSSI of each RFID tag 91 read by the reading processing started in step S102 shows a specific pattern during a specific period. As a result, the data update unit 23 identifies the RFID tag 91 (item 90) that has passed through the gate 50. The processing flow will be described below with reference to FIG. 22.

[0109] First, in step S150, the data update unit 23 extracts the identification information of the RFID tags 91 that have, from among the read RFID tags 91, the RSSI transition during the occurrence period of the flow line at the entrance side that matches a predetermined first pattern. That is, the data update unit 23 extracts the RFID tags 91 that have the RSSI transition during the occurrence period of the flow line identified in step S101 that matches a fluctuation pattern that indicates an increase in RSSI.

[0110] Next, in step S151, the data update unit 23 extracts the identification information of the RFID tags 91 extracted in step S150, of which the change in RSSI during the period when the flow line occurs on the exit side is in a predetermined second pattern. That is, the data update unit 23 extracts the RFID tags 91, of which the change in RSSI during the period when the flow line identified in step S109 occurs is in a fluctuation pattern that indicates a decrease in RSSI.

[0111] Then, in step S152, the data update unit 23 determines that the item 90 identified by the identification information extracted in step S151 has passed through the gate 50. Then, the data update unit 23 updates the transport information of this item 90 to a value indicating that the transport has been completed.

[0112] According to the management system 1 of the first embodiment, gate passage determination is performed using two types of information: the RSSI of the signal from the RFID tag and the movement path occurring in the area near the gate 50. This makes it possible to more reliably manage the carrying in and carrying out of items. In particular, in this embodiment, it is determined not only whether the RSSI transition shows a predetermined pattern, but also whether the RSSI transition during the same period as the occurrence period of the movement path shows the predetermined pattern. This makes it possible to more accurately identify the items 90 that actually passed through the gate 50.

[0113] Next, whether the item 90 has passed through the gate 50 is determined based on the RSSI signal from the RFID tag 91 and the traffic flow occurring in the area near the gate 50, and image information is linked. Fig. 23 is a flowchart illustrating an example of the flow of operations for carrying in the item 90 in the management system 1 according to the present disclosure. Below, the flow of operations for linking image information and compositing it onto a map when the item 90 is carried in will be described with reference to Fig. 23.

[0114] In step S200, the image information control unit 25 acquires image information of an imaging target moving in the imaging area 60 from the image recognition device 300. Specifically, when an imaging target moving in an image is detected by performing image recognition on an image captured by the imaging device 310, the image recognition device 300 identifies the moving imaging target. Then, the image recognition device 300 outputs image information of the identified moving imaging target to the information processing device 20. In this way, the image information control unit 25 acquires image information of the moving imaging target. Note that this processing by the image information control unit 25 may be performed continuously while the processing from step S201 onwards is being performed.

[0115] Next, in step S201, the image information control unit 25 determines whether or not the moving imaging object has been carried in through the gate 50. If the moving imaging object has not passed through the gate 50 (No), the process returns to step S200. On the other hand, if the moving imaging object has passed through the gate 50 (Yes), the process proceeds to step S202.

[0116] In step S202, the image information control unit 25 acquires image information obtained by tracking the moving imaging target, and causes the imaging target to be image-recognized by the image recognition device 300. In this way, the image information control unit 25 acquires image information of the continuously moving imaging target from the image recognition device 300.

[0117] Next, in step S203, the management unit 26 determines whether the data update unit 23 has acquired, in the DB server 400, the identification information of the items 90 that passed through the gate 50 at the same time. If the data update unit 23 has not acquired the identification information of the items 90 that passed through the gate 50 at the same time (No), the processing proceeds to step S204. On the other hand, if the data update unit 23 has acquired the identification information of the items 90 that passed through the gate 50 at the same time (Yes), the processing proceeds to step S205.

[0118] In step S204, the image capture target is an object that is not subject to management, such as an AGV, that does not include identification information. Therefore, the management unit 26 determines that the image capture target is not subject to management. Then, the process returns to step S200.

[0119] In step S205, the management unit 26 associates the image information with the identification information of the item 90. Then, the management unit 26 causes the data update unit 23 to update the management information including the identification information and image information in the DB server 400. The process proceeds to step S206.

[0120] In step S206, the image information control unit 25 determines whether the movement of the article 90 has stopped. If the movement of the article 90 has not stopped (No), the process proceeds to step S207. If the movement of the article 90 has stopped (Yes), the process proceeds to step S209.

[0121] In step S207, it is determined whether or not the article 90 has passed through the gate 50. The determination of whether the article 90 has passed through the gate 50 is as described above. If the article 90 has not passed through the gate (if No), the process proceeds to step S206. If the article 90 has passed through the gate (if Yes), the process proceeds to step S208.

[0122] In step S208, management unit 26 causes data update unit 23 to update the management information to include carry-out information that article 90 has passed through gate 50 and been carried out. Then, the process proceeds to step S200.

[0123] In step S209, the image information control unit 25 acquires the position information of the image capture target whose movement has stopped from the image recognition device 300 as the position information of the article 90. The management unit 26 causes the data update unit 23 to update the management information so that the position information of the article 90 is included.

[0124] In step S210, the display unit 27 combines the acquired position information of the item 90 with the map. The operation of the display unit 27 will be described below.

[0125] 24 is a flowchart illustrating the flow of operations of the display unit 27 in the management system 1 according to the present disclosure. The flow of operations for displaying a map on the display unit 27 in the management system 1 will be described below with reference to FIG.

[0126] In step S250, the communication control unit 22 receives a request to display a map. For example, the user opens a map by specifying the map's address from the web. That is, the user requests the management unit 26 to display the map via the communication control unit 22. In response to this, the management unit 26 causes the display unit 27 to display the map.

[0127] In step S251, the display unit 27 displays a map onto which the position of the article 90 is superimposed.

[0128] In step S252, the display unit 27 accepts the selection of the item 90 displayed on the map. For example, the user clicks on the item 90 on the map displayed on the web screen.

[0129] In step S253, the display unit 27 displays predetermined management information linked to the selected item 90. The predetermined management information may be preset information from among identification information, transport information, image information, and position information that identify the item 90.

[0130] 25 is a flowchart illustrating the flow of operations for carrying out the item 90 in the management system 1 according to the present disclosure. The flow of operations for carrying out the item 90 will be described below with reference to FIG.

[0131] In step S300, the image information control unit 25 acquires image information of an imaging target moving in the imaging area 60 from the image recognition device 300. Note that this processing by the image information control unit 25 may be performed continuously while the processing from step S301 onwards is being performed.

[0132] Next, in step S301, the image information control unit 25 determines whether the movement of the image capture target is the movement of an item 90 stored in the storage space 600. For example, this determination may be made based on whether the origin of the image capture target matches the position information of the item 90. If the movement of the image capture target is not the movement of an item 90 stored in the storage space 600 (if No), the process returns to step S300. For example, if the movement is the movement of an item 90 being brought in, the process is performed using the above-mentioned bring-in flow. Also, if an AGV or the like is moving, the process returns to step S300. On the other hand, if the movement of the image capture target is the movement of an item 90 stored in the storage space 600 (if Yes), the process proceeds to step S302.

[0133] In step S302, the image information control unit 25 acquires image information obtained by tracking the imaging target, and causes the imaging target to be image-recognized by the image recognition device 300. As a result, the image information control unit 25 acquires, from the image recognition device 300, position information and image information of the imaging target that is continuously moving.

[0134] In step S303, the management unit 26 associates the continuously acquired image information with the article 90.

[0135] In step S304, the image information control unit 25 determines whether the movement of the article 90 has stopped. If the movement of the article 90 has stopped (Yes), the process proceeds to step S305. If the movement of the article 90 has not stopped (No), the process proceeds to step S307.

[0136] In step S305, the image information control unit 25 acquires the position information of the image capture target whose movement has stopped from the image recognition device 300 as the position information of the article 90. The management unit 26 causes the data update unit 23 to update the management information so that the new position information of the article 90 is included.

[0137] In step S306, the display unit 27 combines the updated position information of the item 90 with the map.

[0138] In step S307, it is determined whether the article 90 has passed through the gate. The determination of whether the article 90 has passed through the gate 50 is as described above. If the article 90 has not passed through the gate (No), the process proceeds to step S304. If the article 90 has passed through the gate (Yes), the process proceeds to step S308.

[0139] In step S308, the management unit 26 causes the data update unit 23 to update the management information of the item 90. The management unit 26 may also cause the data update unit 23 to remove the management information of the item 90 from the management list. In this manner, the management unit 26 manages management information including the delivery of the item 90 to the storage space 600 and the delivery of the item 90 from the storage space 600.

[0140] According to this embodiment, the management system 1 not only has functions such as a gate equipped with a vector sensor that detects the entry and exit of items through the gate 50 with high accuracy, but also recognizes images of the items 90 using an imaging device 310 such as a camera, making it possible to track where the items 90 have been placed in the storage space 600. Furthermore, the management system 1 can identify which of the items 90 stored in the storage space 600 are to be picked up.

[0141] Furthermore, according to this embodiment, in managing the loading and unloading of the items 90, in addition to identifying them based on their flow lines and using RSSI signals from the RFID tags 91, image information is obtained through image recognition. This makes it possible to distinguish multiple items 90 that have passed through the gate 50 in a mixed state using image recognition. For example, it is possible to distinguish the order in which the items are stacked vertically. Furthermore, since three types of information are obtained, including the above-mentioned two types of information including identifying them based on their flow lines and using RSSI signals from the RFID tags 91, and also image information from image recognition, it is possible to reduce reading errors or omissions of the items 90. Furthermore, in this embodiment, moving items 90 are detected from around the gate 50, so the items 90 can be loaded and unloaded without having to stop in front of the gate 50.

[0142] Furthermore, according to this embodiment, it is possible to manage the location information of the items 90 stored in the storage space 600. Furthermore, it is possible to obtain information about the items 90 in the storage space 600 from a map. Therefore, it is possible to reduce the time required to search for the items 90. Furthermore, it is possible to easily set a route for a transport vehicle such as an AGV that transports the items 90, using the item location information and distribution information of multiple items 90 in the storage space 600. Furthermore, by using the map, it is possible to manage the items 90 in the storage space 600 from a remote location. This eliminates the need to directly check the items 90 in the storage space 600, thereby reducing the number of times one has to bend over.

[0143] Furthermore, according to this embodiment, when managing the items 90 stored in the storage space 600, the map can be used to update the management in real time. Also, it is possible to grasp with high accuracy whether or not the desired item 90 is present in the storage space 600. Note that, since the reading device 100 including the antenna 102, the imaging device 310, and the image recognition device 300 can be outsourced, the information processing device 20 can be made compact.

[0144] <Embodiment 2> Next, a management system according to a second embodiment will be described. The first embodiment described above illustrates an example in which the imaging device 310 images the storage space 600 from above. Therefore, the first embodiment illustrates an example in which, for example, an item 90 placed flat in the storage space 600 is managed. However, the management system 1 may also manage an item 90 placed on a shelf in the storage space 600. For example, the imaging device 310 may be disposed to the side of the storage space 600 and acquire the position of the item 90 in the imaging space, including height information, by capturing an image of the storage space 600 from the side. Note that the imaging device 310 may acquire the position of the item 90 in the imaging space when it is disposed above and captures an image from above, or may acquire the position of the item 90 in the imaging area 60 when it is disposed to the side and captures an image from the side.

[0145] FIG. 26 is a schematic diagram illustrating an imaging space 70 including height information captured by an imaging device 310 according to the present disclosure, viewed from the side. As shown in FIG. 26 , the imaging device 310 may be disposed, for example, on the side of a storage space 600 to capture an image of the imaging space 70 in the storage space 600 from the side. A shelf 71 may be disposed in the storage space 600. The imaging device 310 captures an image of the imaging space 70 by capturing an image of the imaging space 70. The imaging space 70 may include the storage space 600 or a predetermined area near the gate 50. Note that the location at which the imaging device 310 is disposed is not limited to the side of the storage space 600. The imaging device 310 may also be disposed in multiple locations, such as above and to the side. The imaging device 310 captures images of various objects, such as a person, an AGV, and an item 90, that enter the imaging space 70. The imaging device 310 may capture images of each partial space 710 obtained by dividing the imaging space 70 in the storage space 600 into a grid pattern, for example.

[0146] 27 and 28 are schematic diagrams illustrating an example of an imaging space 70 imaged by an imaging device 310 according to the present disclosure, viewed from the side. As shown in FIG. 27, the imaging device 310 images the imaging target from the side. Therefore, if a predetermined mark or the like that serves as characteristic information of the item 90 is placed on the side of the item 90, the imaging device 310 can reliably acquire the characteristic information of the item 90. This improves the accuracy of linking the imaging target to the item 90. Furthermore, since the imaging device 310 images the imaging target from the side, it can detect the vertical movement of the imaging target. Therefore, the management unit 26 can also acquire the vertical movement of the item 90 placed on a shelf 71 or the like in the storage space 600. As a result, as shown in FIG. 28, the management unit 26 can manage position information, including height information of the item 90 in the storage space 600, as management information.

[0147] FIG. 29 is a schematic diagram illustrating a map of the storage space 600 according to the present disclosure. As shown in FIG. 29, the display unit 27 may display a three-dimensional map of the storage space 600 on the screen. The three-dimensional map, for example, displays the three-dimensional positions of the items 90 managed in the storage space 600 and also displays vacant areas. The display unit 27 may also display a three-dimensional image of the storage space 600 on the screen. This allows the user to more clearly understand the status of the items 90 stored in the storage space 600.

[0148] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0149] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0150] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. (Appendix 1) a flow line identification unit that identifies a flow line of an object within a predetermined area near the gate; an RSSI acquisition unit that acquires RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an article identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaging target of the image identified by image recognition of an image captured within the area; a management unit that manages the image information and the identified item in association with each other; An information processing device comprising: (Appendix 2) the management unit manages the image information and the article in association with each other based on an imaging time when the imaging target is imaged and a time when it is determined that the article has passed through the gate. 2. The information processing device according to claim 1. (Appendix 3) the management unit associates the image information with the item, and manages the image-captured target that has been image-recognized as the item together with the identification information. 2. The information processing device according to claim 1. (Appendix 4) the gate separates the inside of the storage space in which the item is stored from the outside of the storage space; The management unit manages position information of the items in the storage space. 4. The information processing device according to claim 3. (Appendix 5) the image information acquisition unit acquires the position information of the item in the storage space; The management unit manages the updated location information in association with the item. 5. The information processing device according to claim 4. (Appendix 6) The management unit manages management information including the delivery of the item to the storage space and the delivery of the item from the storage space. 5. The information processing device according to claim 4. (Appendix 7) Further, a display unit is provided for displaying a map of a storage space for storing items, The display unit displays the location information of the item on the map. 2. The information processing device according to claim 1. (Appendix 8) a sensor that detects an object within a predetermined area near the gate; a reader that communicates with the RFID tag to read information stored in the RFID tag and measure the RSSI of the signal from the RFID tag; an imaging device that captures an image of the area; an image recognition device that recognizes the image captured by the imaging device; Information processing device Equipped with The information processing device includes: a flow line identification unit that identifies a flow line of an object within a predetermined area near the gate; an RSSI acquisition unit that acquires RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an article identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaging target of the image identified by image recognition of an image captured within the area; a management unit that manages the image information and the identified item in association with each other; A management system having: (Appendix 9) Identifying the movement of objects within a specified area near the gate, Acquire RSSI of a signal from an RFID tag near the gate; determining whether an article identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; acquiring image information of an imaging target of the image identified by performing image recognition on an image captured within the area; managing the image information and the identified item in association with each other; Information processing methods. (Appendix 10) Identifying the movement of objects within a specified area near the gate, Acquire RSSI of a signal from an RFID tag near the gate; determining whether an article identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; acquiring image information of an imaging target of the image identified by performing image recognition on an image captured within the area; managing the image information and the identified item in association with each other; A program that makes a computer do something. (Appendix 11) The passage determination unit determines whether the article has passed through the gate based on whether a transition of the RSSI during an occurrence period of the identified flow line corresponds to a predetermined fluctuation pattern corresponding to the flow line. 2. The information processing device according to claim 1. (Appendix 12) the flow line identification unit identifies a flow line of movement of an object within a predetermined first area on the entrance side of the gate; The passage determination unit determines whether the article has passed through the gate based on whether a transition of the RSSI during a period in which a flow line occurs in the first area indicates an increase in RSSI. 3. The information processing device according to claim 2. (Appendix 13) the flow line identification unit identifies a flow line of movement of an object within a predetermined second area on the exit side of the gate; The passage determination unit determines whether the article has passed through the gate based on whether the transition of the RSSI during a period in which a flow line occurs in the second area indicates a decrease in RSSI. 13. The information processing device according to claim 11 or 12. (Appendix 14) the RSSI acquisition unit acquires an RSSI of each of the signals received at each of the plurality of gates; The passage determination unit identifies which gate the article has passed through based on the magnitude of the RSSI of the signal from the same RFID tag for each gate. 13. The information processing device according to claim 11 or 12.

[0151] Some or all of the elements (e.g., configurations and functions) described in other Supplements 2 to 7 and 11 to 14 that are dependent on Supplement 1 may also be dependent on the systems, methods, and programs of Supplements 8 to 10 in the same dependency relationship as Supplement 1. Some or all of the elements described in any Supplement may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]

[0152] 1 Management System 10, 20 Information processing device 11 Flow line identification part 12 RSSI acquisition department 13 Passage determination section 14 Image information acquisition unit 15 Management Department 21 Flow line identification part 22 Communication control section 23 Data Update Section 24 Reading control unit 25 Image Information Control Section 26 Management Department 27 Display section 50 Gates 51A, 51B detection area 60 imaging area 70 Imaging Space 71 Shelf 90 Goods 91 RFID tags 100 Reading device 101 RFID Reader 102 Antenna 200A, 200B Sensor 201 Ray of light 300 Image Recognition Device 301 Image DB 302 Image Recognition Unit 310 Imaging device 400 DB servers 510A, 510B partial area 600 storage spaces 610 Partial area 710 Subspace IF Communication Interface MMR Memory PRC Processor

Claims

1. a flow line identification unit that identifies a flow line of an object within a predetermined area near the gate; an RSSI acquisition unit that acquires an RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an article identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaging target of the image identified by image recognition of an image captured within the area; a management unit that manages the image information and the identified item in association with each other; An information processing device comprising:

2. the management unit manages the image information and the article in association with each other based on an imaging time when the imaging target is imaged and a time when it is determined that the article has passed through the gate. The information processing device according to claim 1 .

3. the management unit associates the image information with the item, and manages the image-captured target that has been image-recognized as the item together with the identification information. The information processing device according to claim 1 .

4. the gate separates the inside of the storage space where the item is stored from the outside of the storage space; The management unit manages position information of the items in the storage space. The information processing device according to claim 3 .

5. the image information acquisition unit acquires the position information of the item in the storage space; The management unit manages the updated location information in association with the item. The information processing device according to claim 4 .

6. The management unit manages management information including the delivery of the item to the storage space and the delivery of the item from the storage space. The information processing device according to claim 4 .

7. Further, a display unit is provided for displaying a map of a storage space for storing items, The display unit displays the location information of the item on the map. The information processing device according to claim 1 .

8. a sensor that detects an object within a predetermined area near the gate; a reader that communicates with the RFID tag to read information stored on the RFID tag and measure the RSSI of the signal from the RFID tag; an imaging device that captures an image of the area; an image recognition device that recognizes the image captured by the imaging device; Information processing device Equipped with The information processing device includes: a flow line identification unit that identifies a flow line of an object within a predetermined area near the gate; an RSSI acquisition unit that acquires an RSSI of a signal from an RFID tag near the gate; a passage determination unit that determines whether an article identified by identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; an image information acquisition unit that acquires image information of an imaging target of the image identified by image recognition of an image captured within the area; a management unit that manages the image information and the identified item in association with each other; A management system having:

9. Identifying the movement of objects within a specified area near the gate, Acquire an RSSI of a signal from an RFID tag near the gate; determining whether an article identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; acquiring image information of an imaging target of the image identified by performing image recognition on an image captured within the area; managing the image information and the identified item in association with each other; Information processing methods.

10. Identifying the movement of objects within a specified area near the gate, Acquire an RSSI of a signal from an RFID tag near the gate; determining whether an article identified by the identification information read from the RFID tag has passed through the gate based on the identified flow line and the acquired RSSI; acquiring image information of an imaging target of the image identified by performing image recognition on an image captured within the area; managing the image information and the identified item in association with each other; A program that makes a computer do something.

Images