Information processing systems, information processing methods, and non-volatile computer-readable media

Abstract

This disclosure relates to an information processing system, an information processing method, and a non-volatile computer-readable medium. The information processing system (1) includes a determining device (20) for identifying a person existing at a predetermined location as a specific person, at least one identifying device (30) for identifying persons existing in a geographical area corresponding to the local machine as unspecified persons, and an information processing device (10). The information processing device (10) analyzes the identification results of the at least one identifying device (30) to obtain a movement history representing the time change of the location of the first unspecified person. Based on the determining device (20), it determines the time and predetermined location (25) of the specific person and the movement history of the first unspecified person, determines whether the specific person and the first unspecified person are the same, and when it is determined that the specific person and the first unspecified person are the same, it stores the movement history of the first unspecified person and the specific person in a corresponding manner in a storage device.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Japanese Patent Application No. 2021-208768, filed on December 22, 2021, the entire disclosure of which is incorporated herein by reference. Technical Field

[0003] This disclosure relates to information processing systems, information processing methods, and non-volatile computer-readable media. Background Technology

[0004] Previously, technologies related to the detection of objects using detection devices such as radar were known. For example, Patent Document 1 discloses a technology that uses radar sensors to detect objects and assists driving based on the detected information.

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: International Publication No. 2019 / 239471 Summary of the Invention

[0008] The problem the invention aims to solve

[0009] However, there is room for improvement in the technology related to the detection of individuals using detection devices.

[0010] The purpose of this disclosure is to improve the technology related to the detection of persons using detection devices.

[0011] Solution for solving the problem

[0012] An information processing system according to one embodiment of the present disclosure includes:

[0013] The identification device identifies a person located at a predetermined location as a specific person;

[0014] At least one identification device identifies persons existing within a geographical area corresponding to the local machine as unspecified persons; and

[0015] The information processing device communicates with the determining device and the at least one identifying device, wherein...

[0016] The information processing device

[0017] By analyzing the identification results of the at least one identification device, a movement history representing the temporal changes in the location of the first unspecified person is obtained.

[0018] Based on the determination device, the time and predetermined location of the specific person and the movement history of the first unspecified person are determined, and it is determined whether the specific person and the first unspecified person are the same.

[0019] If it is determined that the specific person is the same as the first unspecified person, the movement history of the first unspecified person is correspondingly stored in the storage device with that of the specific person.

[0020] One embodiment of the information processing method disclosed herein is an information processing system comprising:

[0021] The identification device identifies a person located at a predetermined location as a specific person;

[0022] At least one identification device identifies persons existing within a geographical area corresponding to the local machine as unspecified persons; and

[0023] The information processing device communicates with the determining device and the at least one identifying device, wherein...

[0024] The information processing method includes the following steps:

[0025] The information processing device

[0026] By analyzing the identification results of the at least one identification device, a movement history representing the temporal changes in the location of the first unspecified person is obtained;

[0027] Based on the determination device, the time and predetermined location of the specific person and the movement history of the first unspecified person are determined, and it is determined whether the specific person and the first unspecified person are the same; and

[0028] If it is determined that the specific person is the same as the first unspecified person, the movement history of the first unspecified person is correspondingly stored in the storage device with that of the specific person.

[0029] One embodiment of this disclosure uses a non-volatile, computer-readable medium storing a program that enables a computer to operate as an information processing device.

[0030] The information processing device communicates with a determining device and at least one identifying device, wherein the determining device identifies persons existing at predetermined locations as specific persons, and the at least one identifying device identifies persons existing within a geographical area corresponding to the device as unspecified persons.

[0031] The information processing device analyzes the identification results of the at least one identification device to obtain a movement history representing the temporal changes in the location of the first unspecified person.

[0032] Based on the determination device, the time and predetermined location of the specific person and the movement history of the first unspecified person are determined, and it is determined whether the specific person and the first unspecified person are the same.

[0033] If it is determined that the specific person is the same as the first unspecified person, the movement history of the first unspecified person is correspondingly stored in the storage device with that of the specific person.

[0034] The effects of the invention

[0035] According to one embodiment of this disclosure, the technology related to the detection of persons using detection devices has been improved. Attached Figure Description

[0036] Figure 1 This is a block diagram illustrating the general structure of an information processing system according to one embodiment of the present disclosure.

[0037] Figure 2 It is a block diagram representing the general structure of an information processing device.

[0038] Figure 3 It is a block diagram representing the general structure of the device.

[0039] Figure 4 It is a block diagram showing the general structure of the identification device.

[0040] Figure 5 It is a block diagram showing the general structure of the shooting device.

[0041] Figure 6 This is a map showing an example of an urban area that has applied an information processing system.

[0042] Figure 7 It is a flowchart illustrating the operation of an information processing device.

[0043] Figure 8 This is a flowchart illustrating the steps involved in acquiring and processing mobile history.

[0044] Figure 9 This is a flowchart representing the steps involved in the identity determination process.

[0045] Figure 10 This is a diagram representing an example of a sample of the first data stored in the first storage device.

[0046] Figure 11 This is a diagram representing an example of a sample of the second data stored in the second storage device.

[0047] Figure 12 This is a diagram illustrating an example of a velocity vector determined based on the second data point.

[0048] Figure 13 This is a diagram illustrating an example of how movement history can be extracted from the results of identification by an identification device.

[0049] Explanation of reference numerals in the attached figures

[0050] 1. Information processing system; 10. Information processing device; 11. Control unit; 12. Storage unit; 13. Communication unit; 20. Determination device; 21. Control unit; 22. Identification information acquisition unit; 23. Storage unit; 24. Communication unit; 30. Identification device; 31. Control unit; 32. Radar unit; 33. Storage unit; 34. Communication unit; 35. Geographic range; 40. Imaging device; 41. Control unit; 42. Imaging unit; 43. Storage unit; 44. Communication unit; 50. First storage device; 60. Second storage device; 70. Network. Detailed Implementation

[0051] The embodiments of this disclosure will now be described.

[0052] (Summary of the implementation method)

[0053] Reference Figure 1 An overview of the information processing system 1 according to embodiments of the present disclosure will be described. The information processing system 1 includes an information processing device 10, a determining device 20, at least one identification device 30, an imaging device 40, a first storage device 50, and a second storage device 60. The information processing device 10, determining device 20, at least one identification device 30, imaging device 40, first storage device 50, and second storage device 60 are communicatively connected, for example, to a network 70 including the Internet and mobile communication networks. Hereinafter, an example will be described where the number of the information processing device 10, determining device 20, imaging device 40, first storage device 50, and second storage device 60 in the information processing system 1 is one; however, the number of at least one of these devices may be two or more. The determining device 20 and at least one imaging device 40 are, for example, located within a certain geographical area such as a street, a specific site, or inside a building. Hereinafter, an example will be described where the determining device 20 and at least one imaging device 40 are located on a street; however, these devices may also be located within a desired geographical area.

[0054] The information processing device 10 is, for example, a computer such as a server device. The information processing device 10 can communicate with the imaging device 40, the first storage device 50, and the second storage device 60 via the network 70.

[0055] The determining device 20 is a device that identifies a person existing at a predetermined location as a specific person and obtains identification information to identify that person. For example, the determining device 20 may also identify the person by receiving data such as a user ID from the terminal held by the person, or by reading the person's biometric information.

[0056] The identification device 30 is a device that identifies individuals existing within a geographical area corresponding to the device as unspecified individuals. The identification device 30 is capable of identifying the location of individuals existing within a geographical area corresponding to the device. The identification device 30 may also identify individuals using, for example, millimeter-wave radar or infrared sensors. As described later, the identification results of the identification device 30 for unspecified individuals can also be used to extract the movement history of those unspecified individuals.

[0057] The shooting device 40 is a device for shooting people and acquiring captured images. The captured images acquired by the shooting device 40 can also be stored in correspondence with the movement history of unspecified persons who, although identified as persons by the recognition device 30, were not identified by the determining device 20.

[0058] Alternatively, the determining device 20 may be located only in a specific location, whereas at least one identification device 30 may be located in at least one location throughout the street. Alternatively, the determining device 20 may be located only in public places, whereas the identification device 30 may be located not only in public places but also in private spaces. For example, the determining device 20 may be located at the entrance of a residential building to identify residents or visitors entering the building. The identification device 30 may also track the movements of the person after they enter the building.

[0059] The first storage device 50 is a device that stores information including the identification information of the person determined by the determining device 20, the time of the person determination, and the location as first data. The second storage device 60 is a device that stores information including the location of the person identified by the recognition device 30, the time of the person recognition, and the velocity vector as second data. The velocity vector can also be determined, for example, by the information processing device 10 analyzing the recognition result of the recognition device 30. The first storage device 50 and the second storage device 60 can also be implemented as network storage, for example. Alternatively, the first storage device 50 or the second storage device 60 can also be implemented as storage built into or external to the information processing device 10. Alternatively, the first storage device 50 can also be implemented as storage built into or external to the determining device 20 that can be accessed from the information processing device 10. The second storage device 60 can also be implemented as distributed storage built into or external to each of the at least one recognition device 30 that can be accessed from the information processing device 10.

[0060] First, an overview of this embodiment will be given; detailed information will be described later. In the structure described above, the information processing device 10 analyzes the identification result of at least one identification device 30 to obtain a movement history representing the temporal changes in the location of a first unspecified person who is a certain unspecified person. Based on the time and predetermined location when the determining device 20 identifies the person as the specific person, and the movement history of the first unspecified person, the information processing device 10 determines whether the specific person and the first unspecified person are the same. If the information processing device 10 determines that the specific person and the first unspecified person are the same, it stores the movement history of the first unspecified person and the specific person in a corresponding manner in a storage device.

[0061] Thus, in this embodiment, a specific person is associated with a movement history based on the determination result of the determining device 20 and the movement history of an unspecified person based on the identification result of at least one identification device 30. Therefore, the information processing system 1 is able to determine the unspecified person identified by the identification device 30. Since the movement history is obtained without determining the person, the privacy of that person can be protected. On the other hand, regarding the person that the determining device 20 can determine (e.g., a resident of the street), the movement history can be stored in a correspondence with that person (i.e., the movement history can be stored in a form that can identify the individual), which is useful from the point of view, for example, from the perspective of prevention or security. In addition, the information processing system 1 can obtain the movement history of a wider geographical area by using at least one identification device 30. According to this embodiment, the number of expensive determining devices 20 can also be reduced, thus achieving cost reduction. Furthermore, according to this embodiment, since the individual cannot be identified solely by the identification result obtained by using the identification device 30, it is assumed that even if the identification result is leaked, privacy can be protected. Therefore, according to this embodiment, the technology related to person detection is improved in terms of achieving low cost of system construction and privacy protection.

[0062] Next, the structure of information processing system 1 will be described in detail.

[0063] (Structure of an information processing device)

[0064] like Figure 2 As shown, the information processing device 10 includes a control unit 11, a storage unit 12, and a communication unit 13.

[0065] The control unit 11 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The processor may be a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor for specific processing, but is not limited thereto. The programmable circuit may be, for example, a FPGA (Field-Programmable Gate Array), but is not limited thereto. The dedicated circuit may be, for example, an ASIC (Application Specific Integrated Circuit), but is not limited thereto. The control unit 11 controls the overall operation of the information processing device 10.

[0066] Storage unit 12 includes one or more memories. These memories may be, for example, semiconductor memories, magnetic memories, or optical memories, but are not limited to these. Each memory included in storage unit 12 may function as a main storage device, an auxiliary storage device, or a cache memory. Storage unit 12 stores any information used for the operation of information processing device 10. For example, storage unit 12 may also store system programs, application programs, databases, and map information. Furthermore, the information stored in storage unit 12 may be updated using information obtained from network 70 via communication unit 13.

[0067] The communication unit 13 includes one or more communication interfaces connected to the network 70. These communication interfaces may correspond to mobile communication standards such as 4G (4th Generation) or 5G (5th Generation), wired LAN (Local Area Network) standards, or wireless LAN standards, but are not limited to these; they may correspond to any communication standard. In this embodiment, the information processing device 10 can communicate with the determining device 20, at least one identification device 30, the imaging device 40, the first storage device 50, and the second storage device 60 via the communication unit 13 and the network 70. It should be noted that the information processing device 10 can also communicate via the communication unit 13 and the network 70 with devices other than the determining device 20, at least one identification device 30, the imaging device 40, the first storage device 50, and the second storage device 60, such as a smartphone held by a person.

[0068] (Determine the structure of the device)

[0069] like Figure 3 As shown, the determining device 20 includes a control unit 21, a discrimination information acquisition unit 22, a storage unit 23, and a communication unit 24.

[0070] The control unit 21 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The control unit 21 controls the overall operation of the determining device 20.

[0071] The identification information acquisition unit 22 is a device that identifies a person located at a predetermined location and acquires identification information for that person. For example, the identification information acquisition unit 22 can identify the individual holding the terminal by receiving data such as a user ID from the terminal held by the person. Such a terminal could be a smartphone, but could also be an employee ID card or admission card. When identifying a person through the held terminal, the identification information acquisition unit 22 can communicate with the terminal using wireless communication methods such as Bluetooth (registered trademark) or NFC (Near Field Communication). When communicating via Bluetooth (registered trademark), the identification information acquisition unit 22 can identify terminals in 10cm increments, thus enabling the simultaneous identification of multiple people. It should be noted that the identification information acquisition unit 22 can also directly acquire biometric information related to a person, such as fingerprints, iris scans, or facial features, and use the biometric information itself or information identifying the person corresponding to that biometric information as identification information to determine the person. That is, the identification information acquisition unit 22 can also include a camera or a biometric sensor.

[0072] Storage unit 23 includes one or more memory units. Each memory unit included in storage unit 23 may function as a main storage device, an auxiliary storage device, or a cache memory. Storage unit 23 stores any information used to determine the operation of device 20. For example, storage unit 23 may also store system programs, application programs, databases, and map information. Alternatively, the information stored in storage unit 23 may be updated using information obtained from network 70 via communication unit 24.

[0073] The communication unit 24 includes one or more communication interfaces connected to the network 70. These communication interfaces may correspond to, for example, mobile communication standards, wired LAN standards, or wireless LAN standards, but are not limited to these; they may correspond to any communication standard. In this embodiment, the determining device 20 can communicate with the information processing device 10 and the first storage device 50 via the communication unit 24 and the network 70.

[0074] When the identification information acquisition unit 22 acquires identification information of a person located at a predetermined location, the control unit 21 of the determining device 20 stores information including the identification information, the location and time of acquisition of the identification information as first data in the first storage device 50. That is, the control unit 21 sends the first data from the communication unit 24 to the first storage device 50 via the network 70, causing the first storage device 50 to store the first data. The control unit 21 can also communicate with the first storage device 50 via a secure communication path, such as an encrypted communication path. This prevents the leakage of information related to the actions of the person determined by the determining device 20, protecting the person's privacy.

[0075] (Structure of the identification device)

[0076] like Figure 4 As shown, the identification device 30 includes a control unit 31, a radar unit 32, a storage unit 33, and a communication unit 34.

[0077] The control unit 31 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The control unit 31 controls the overall operation of the identification device 30.

[0078] The radar unit 32 is a device that transmits millimeter waves and receives reflected waves within a geographical area corresponding to the identification device 30. When objects such as people are present within the corresponding geographical area, the objects reflect millimeter waves. The identification device 30 identifies the object based on the reflected waves received by the radar unit 32. In this embodiment, when the identification device 30 identifies a moving object, it identifies that object as an unspecified person. The radar unit 32 can, for example, identify objects within a geographical area of ​​several meters × several meters to tens of meters × tens of meters using a grid of 50cm × 50cm to several meters × several meters. Furthermore, the radar unit 32 can also identify the three-dimensional position of the object. For example, if the identification device 30 is positioned at 2.4 meters above the ground, it can also identify the height of the object within the corresponding geographical area, ranging from the ground to 2.4 meters above the ground.

[0079] It should be noted that in this embodiment, an example of an identification device 30 implemented using millimeter-wave radar is described. However, the identification device 30 is not limited to a structure based on millimeter-wave radar, as long as it is capable of identifying unspecified persons within a geographical area corresponding to the device. For example, the identification device 30 may also be constructed using an infrared sensor or the like. The identification device 30, constructed using millimeter-wave radar or an infrared sensor, can be provided at a lower cost compared to the determination device 20.

[0080] Storage unit 33 includes one or more memory units. Each memory unit included in storage unit 33 may function as a main storage device, an auxiliary storage device, or a cache memory. Storage unit 33 stores any information used to identify the operation of device 30. For example, storage unit 33 may also store system programs, application programs, databases, and map information. Alternatively, the information stored in storage unit 33 may be updated using information obtained from network 70 via communication unit 34.

[0081] The communication unit 34 includes one or more communication interfaces connected to the network 70. These communication interfaces may correspond to, for example, mobile communication standards, wired LAN standards, or wireless LAN standards, but are not limited to these; they may correspond to any communication standard. In this embodiment, the identification device 30 can communicate with the information processing device 10 and the second storage device 60 via the communication unit 34 and the network 70.

[0082] When the radar unit 32 identifies an unspecified person within the geographical area corresponding to the identification device 30, the control unit 31 of the identification device 30 stores information including the time and location of the unspecified person as a second data in the second storage device 60. That is, the control unit 31 sends the second data from the communication unit 34 to the second storage device 60 via the network 70, causing the second storage device 60 to store the second data. The control unit 31 can also communicate with the second storage device 60 via a secure communication path, such as an encrypted communication path. This prevents the leakage of information related to the actions of the unspecified person identified by the identification device 30, protecting the person's privacy.

[0083] The control unit 31 of the identification device 30, when capable of acquiring not only the location and time of an unspecified person identified, but also other information, can store this information as a second data in the second storage device 60. For example, the control unit 31 can calculate the velocity vector of an unspecified person based on the temporal changes in the location of that person within the geographical area corresponding to the identification device 30. When the velocity vector is calculated, the control unit 31 can store the information including the velocity vector as a second data in the second storage device 60, in addition to identifying the time and location of the unspecified person. Furthermore, the control unit 31 can identify an unspecified person as the same person if it identifies them at a close location at a close time. For example, when identifying objects at a certain frame interval (e.g., 0.1 seconds), the control unit 31 can identify an unspecified person as the same person if the distance between the location of an unspecified person identified in a certain frame and the location of an unspecified person identified in an adjacent frame is less than a predetermined threshold (e.g., 1 m). The control unit 31 can also assign an object ID to an unspecified person if it identifies them as the same person at different times and locations, so as to distinguish them from other unspecified persons. The control unit 31 can also store such an object ID as a second data in the second storage device 60. In addition, the control unit 31 can also store the identification information used by the identification device 30 as a second data in the second storage device 60.

[0084] (Structure of the filming device)

[0085] like Figure 5 As shown, the shooting device 40 includes a control unit 41, a shooting unit 42, a storage unit 43, and a communication unit 44.

[0086] The control unit 41 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The control unit 41 controls the overall operation of the imaging device 40.

[0087] The imaging unit 42 is a device that captures images of objects existing within the imaging range of the imaging device 40 to generate captured images. The imaging unit 42 is, for example, an RGB (Red, Green, Blue) camera that generates color images, but it can also be a camera that generates grayscale or black and white images instead.

[0088] Storage unit 43 includes one or more memory units. Each memory unit included in storage unit 43 may function as a main storage device, an auxiliary storage device, or a cache memory. Storage unit 43 stores any information used for the operation of the imaging device 40. For example, storage unit 43 may also store system programs, application programs, databases, and map information. Alternatively, the information stored in storage unit 43 may be updated using information obtained from network 70 via communication unit 44.

[0089] The communication unit 44 includes one or more communication interfaces connected to the network 70. These communication interfaces may correspond to, for example, mobile communication standards, wired LAN standards, or wireless LAN standards, but are not limited to these; they may correspond to any communication standard. In this embodiment, the imaging device 40 can communicate with the information processing device 10 via the communication unit 44 and the network 70.

[0090] When the shooting unit 42 takes a picture of the subject, the control unit 41 of the shooting device 40 stores information including the captured image, time, and location as third data in the storage unit 43. The control unit 41 stores the third data in the storage unit 43 for a certain period of time (e.g., one week) and then deletes it. The control unit 41 can also send the captured image from the communication unit 44 to the information processing device 10 via the network 70 according to a request from the information processing device 10. When sending the captured image, the control unit 41 can also communicate with the information processing device 10 via a secure communication path such as an encrypted communication path. As a result, it is possible to prevent the leakage of information related to the actions of the person captured by the shooting device 40 and protect the privacy of the person. It should be noted that in this embodiment, the shooting device 40 stores the third data including the captured image in the storage unit 43, but it can also store it in a storage device or the like that includes network storage connected to the network 70.

[0091] (Application example of information processing system)

[0092] Here, information processing system 1 is applied to Figure 6 Examples of such urban situations will be used to illustrate this. Figure 6 This is a map showing an example of an urban area where information processing system 1 has been applied. Figure 6 In the example, a determining device 20, three identifying devices 30 (30a, 30b, 30c) and a shooting device 40 are located near a road in the city.

[0093] The determining device 20 identifies a person existing at a predetermined location 25 as a specific person. Upon identifying a person, the determining device 20 stores first data, including the time of identification, the predetermined location 25, and the person's identification information, in the first storage device 50.

[0094] The identification devices 30 (30a, 30b, 30c) respectively identify persons existing within the geographical range 35 (35a, 35b, 35c) corresponding to the local device as unspecified persons. Figure 6 In this example, the identification device 30c can identify a person 80 located within a geographical area 35c. The identification device 30c acquires the location and time of the identified person 80 and stores the second data containing this information in the second storage device 60.

[0095] The imaging device 40 captures images of the object within its imaging range, generating a captured image. Figure 6 In the example, the shooting device 40 takes the area that is approximately the same as the geographical range 35c of the identification device 30c as its shooting range and keeps shooting.

[0096] The following is about Figure 6 Any location on the map shown can be accessed via... Figure 6 This example illustrates how the X and Y coordinates (X, Y) of an XY coordinate system, with the top left corner as the origin (reference point), are used to determine the coordinates. Here, the value of the X coordinate varies with the x-axis. Figure 6 The value of the Y-coordinate increases as it moves to the right. Figure 6 It increases as it moves downwards. For example, in Figure 6 In the diagram, the predetermined position 25 is located at (60, 60). The position of character 80 is located at (120, 120). The following examples illustrate the case where the X and Y coordinate values ​​are expressed in meters (m) as distances from the origin.

[0097] (Operational flow of the information processing device)

[0098] Reference Figures 7-12 The operation of the information processing device 10 will be explained. Figures 7-9 This is a flowchart illustrating the operation of the information processing device 10. (See attached diagram.) Figures 7-9 The operation of the information processing device 10 described herein is equivalent to one of the information processing methods of this embodiment. Figures 7-9 The actions of each step are executed based on the control of the control unit 11. The program for causing the computer to execute the information processing method of this embodiment can include... Figures 7-9 The steps shown are as follows. The following is an example of the process for determining an unspecified person 80 identified by a certain identification device (e.g., identification device 30c) at a certain moment.

[0099] Step S1: The control unit 11 acquires the result of the determination of the person by the determination device 20.

[0100] Specifically, the control unit 11 can also access the first storage device 50 and refer to the first data stored in the first storage device 50. Figure 10 This is a diagram representing an example of a sample of the first data stored in the first storage device 50. Figure 10 In the example, the determining device 20 determines the coordinates of the predetermined position 25 of the person as (60, 60). Figure 10 In the example, at the predetermined location 25, "User A" was determined at 14:50:00, and "User B" was determined at 15:35:00. The following describes the case where the control unit 11 obtains information including the time 14:50:00, the predetermined location (60, 60), and the identification information "User A" as the determination result. It should be noted that when the first data is stored in the storage unit 23 of the determining device 20, the control unit 11 can also access the determining device 20 to obtain the result determined by the determining device 20.

[0101] Step S2: The control unit 11 acquires the results of the identification of unspecified persons by each of the identification devices 30 (30a, 30b, 30c) at least one identification device 30.

[0102] Specifically, the control unit 11 can also access the second storage device 60 and refer to the second data stored in the second storage device 60 as the result of the identification of unspecified persons performed by the identification device 30 (30a, 30b, 30c). Figure 11 This is a diagram representing an example of a sample of the second data stored in the second storage device 60. Figure 11 In the example, the recognition results of all recognition devices 30 (30a, 30b, 30c) are stored together with the discrimination information of recognition devices 30a, 30b, and 30c in a time sequence. For example, in Figure 11 In the process, as the recognition result of the recognition device 30c, at time 14:51:59 at location (120, 119) and at time 14:52:00 at location (120, 120), an unspecified person identified by the object ID "c0001" is recognized. It should be noted that when the second data is stored in the storage unit 33 of each recognition device 30 (30a, 30b, 30c), the control unit 11 can also access each recognition device 30 (30a, 30b, 30c) to obtain the recognition results of the recognition devices 30 (30a, 30b, 30c).

[0103] It should be noted that the identification devices 30 (30a, 30b, 30c) identify objects (including people) within the geographical range 35 (35a, 35b, 35c) corresponding to the local device by transmitting and receiving millimeter-wave radar at a certain sampling rate. Therefore, the second data not only includes information determining the location of the identified objects in seconds, but may also include information determining the location of the identified objects in finer time units (e.g., less than 1 second).

[0104] Step S3: The control unit 11 analyzes the recognition results of the recognition devices 30 (30a, 30b, 30c) to obtain the movement history representing the time change of the position of an unspecified person 80.

[0105] Specifically, the control unit 11 executes a sample of the second data, which is the time after the determining device 20 determined the time of the person, included in the determination result obtained in step S1. Figure 8 The mobile history acquisition process shown (steps S11 to S16).

[0106] Step S11: The control unit 11 refers to the second data and analyzes the recognition result of a certain recognition device (first recognition device, for example, recognition device 30c), thereby determining the position (first position) and velocity vector (first velocity vector) of the first unspecified person (first unspecified person) 80 at a certain moment (first moment) recognized by the first recognition device 30c.

[0107] Specifically, the control unit 11 can also extract multiple samples of second data that are considered to be the same person, and determine the first velocity vector based on the position change of the extracted second data per unit time. The velocity vector is a vector representing the amount of movement and orientation of the person being identified in the XY direction per unit time. For example, the control unit 11 can also extract second data of unspecified persons assigned the same object ID by the same identification device 30 as the second data of the same person. If the second data does not contain an object ID, the control unit 11 can also extract multiple samples of second data of unspecified persons identified by the same identification device 30 whose time and position difference is below a predetermined threshold as the second data of the same person. Such a threshold for the time and position difference can be determined, for example, based on the normal walking speed of pedestrians. Specifically, the control unit 11 can also extract multiple samples of second data with a movement distance of a few meters within a time of less than 1 second as the second data of the same person. The control unit 11 can also determine the first velocity vector of the first unspecified person 80 based on the position and time of the first unspecified person 80 represented by the multiple samples of the extracted second data.

[0108] If the second data stored in the second storage device 60 contains information other than the location and time identified for an unspecified person, the control unit 31 can also utilize this information when determining the first velocity vector. For example, as described above, if the identification information and object ID of the identification device 30 are included in the second data, the control unit 11 can also use this information to determine the identity of the unspecified person and determine the first velocity vector. Alternatively, if the second data contains velocity vectors calculated by the identification devices 30 (30a, 30b, 30c), the control unit 11 can also determine that velocity vector as the first velocity vector. In this way, when the second data contains information other than the location and time identified for an unspecified person, using this information to determine the first velocity vector allows for a more accurate determination of the velocity vector for that unspecified person.

[0109] It should be noted that the control unit 11 may not determine the first velocity vector for each sample of the second data acquired at a certain sampling rate, but rather for samples representing the second data acquired continuously for the same person identified by the same recognition device 30. For example, the control unit 11 may determine the first velocity vector for each sample of the second data acquired continuously for the same person at a constant time interval (e.g., 10 seconds).

[0110] Figure 12 This is a diagram illustrating an example of a velocity vector determined based on the second data point. Figure 12 In the example, for Figure 11 Each sample of the second data example determines a velocity vector. A velocity vector can also be represented by the amount and direction of movement along the X and Y directions during a unit of time. The direction of movement can also be represented by positive or negative signs. Below, an example is given of representing a velocity vector using a two-dimensional vector with a unit of time of 1 minute. For example, the velocity vector of an unspecified person identified at position (60, 60) at time 14:50:00 is (60, 0). This velocity vector represents the movement along the positive X direction during a 1-minute period, i.e. Figure 6 Move 60m to the right. For example, the velocity vector of an unspecified person identified at position (120, 140) at time 14:50:40 is (0, -70). This velocity vector represents the velocity in the negative Y direction during the 1-minute period. Figure 6 It moved 70m above.

[0111] Step S12: Based on the first moment, first position and first velocity vector determined in step S11, the control unit 11 determines the estimated position of the first unspecified person 80, which is a past moment compared to the first moment.

[0112] Specifically, the control unit 11 can also determine the estimated position for each time point included in the sample of the first vector that determines the second data, including times before the first time point and times within a certain time period (e.g., 1 minute) from the first time point. For example, in step S11, the time point 14:52:00, the position (120, 120), and the velocity vector (0, 60) are determined as the first time point, the first position, and the first velocity vector (see reference). Figure 12 In this case, it is presumed that the first unspecified person 80 moved in the positive Y direction during a 1-minute period ( Figure 6 The position is moved 60m below the first time point. Therefore, the control unit 11 determines the estimated position of time 14:51:30 as (120, 90) and the estimated position of time 14:51:00 as (120, 60). In this way, the control unit 11 determines the estimated position for each time point in the past within a certain period of time from the first time point.

[0113] Step S13: The control unit 11 refers to the second data and analyzes the recognition result of a certain recognition device (second recognition device, for example, recognition device 30b), thereby determining the time (second moment) when the second recognition device 30b recognizes an unspecified person (second unspecified person) and the position (second position) of the second unspecified person at the second moment.

[0114] Specifically, the control unit 11 may also use the times included in the sample of the second data that are the same as the times determined to be past times in step S12 as the second times, and determine the position of the unspecified person at that time as the second position. For example, if the control unit 11 sets the time 14:51:30, which was determined to be a past time in step S12, as the second time, it may determine the position (50, 60) of that time as the second position (refer to...). Figure 12 Additionally, if time 14:51:00 is set as the second time, then the position (120, 60) of that time is determined as the second position.

[0115] Step S14: Based on the comparison between the past time and estimated position of the first unspecified person 80 determined in step S12 and the second time and second position of the second unspecified person determined in step S13, the control unit 11 determines whether the first unspecified person 80 and the second unspecified person are the same.

[0116] Specifically, the control unit 11 may determine that the first unspecified person 80 and the second unspecified person are the same if the distance between the second position corresponding to the second time (which is the same as the past time determined in step S12) and the estimated position is within a predetermined threshold. For example, let the threshold for determining the identity of unspecified persons be 3m. In step S12, the control unit 11 determines the estimated position (120, 90) of the past time 14:51:30 for the first unspecified person 80 based on the first position (120, 120) and the first velocity vector (0, 60) at the first time 14:52:00. For example, let's say that in step S13, the control unit 11 determines the second position (50, 60) (velocity vector (-90, 0)) at the second time 14:51:30 for the second unspecified person. In this case, the distance between the second position (50, 60) corresponding to the second time point that is the same as the past time point and the estimated position (120, 90) is ((120-50)). 2 +(90-60) 2 ) 1 / 2 =76.16m exceeds the threshold of 3m. Therefore, the control unit 11 determines that the first unspecified person 80 is not the same as the second unspecified person. On the other hand, suppose that in step S12, the control unit 11 determines the estimated position (120, 60) of the past time 14:51:00 for the first unspecified person 80. For example, suppose that in step S13, the control unit 11 determines the second position (120, 60) (velocity vector (60, 0)) of the second time 14:51:00 as the second unspecified person. In this case, the distance between the second position (120, 60) corresponding to the second time that is the same as the past time and the estimated position (120, 60) is 0 (< the threshold of 3m). Therefore, the control unit 11 determines that the first unspecified person 80 is the same as the second unspecified person. In this way, the control unit 11 can also compare the estimated position with the second position at the second time that is the same as the past time for each time determined in step S12, and determine whether the first unspecified person 80 and the second unspecified person are the same.

[0117] Step S15: If the control unit 11 determines in step S14 that the first unspecified person 80 is the same as the second unspecified person (YES in step S15), it proceeds to step S16; otherwise, it ends the movement history acquisition process (NO in step S15).

[0118] Specifically, the control unit 11 may also proceed to step S16 in step S14 if, at least at any one of the multiple past moments, it is determined that the first unspecified person 80 is the same as the second unspecified person.

[0119] Step S16: The control unit 11 adds the second moment and second position of the second unspecified person who is determined to be the same as the first unspecified person 80 to the movement history of the first unspecified person 80.

[0120] Specifically, for example, it is determined that the first unspecified person 80, who was at position (120, 120) at time 14:52:00, is the same as the second unspecified person, who was at position (120, 60) at time 14:51:00. Therefore, the control unit 11 adds the second time 14:51:00 and the second position (120, 60) to the movement history of the first unspecified person 80.

[0121] The control unit 11 can also take each sample of the second data obtained in step S1 after the determining device 20 has determined the time of the person, and use the time of that sample as the first time of step S11. It can then repeatedly execute steps S11 to S16, backtracking from the reference time, thereby obtaining the movement history of the unspecified person 80. The reference time could be, for example, the time when the user receives the request to start the process, or the time when the unspecified person 80, for whom the person determination is desired, is identified by a recognition device (e.g., recognition device 30c). Through the above-described movement history acquisition process, the samples contained in the second data can be associated with the same unspecified person 80 to create the movement history of the unspecified person 80.

[0122] It should be noted that when the control unit 11 includes identification information and object ID from the identification device 30 in the second data, it can also use this information to create the movement history of an unspecified person 80. For example, the control unit 11 can also extract a series of samples of the second data continuously acquired for the same person identified by the same identification device 30 as the movement history of that person.

[0123] Figure 13 This diagram illustrates an example of how movement history can be extracted from the identification results of the identification device 30 through the steps described above. Figure 13 In the example, unspecified character 80 is at position (60, 60) at time 14:50:00, passes through position (120, 60) at time 14:51:00, and arrives at position (120, 120) at time 14:52:00. After creating the movement history, control unit 11 ends the movement history acquisition process and enters... Figure 7 Step S4.

[0124] Step S4: The control unit 11 determines whether the specific person and the first unspecified person 80 are the same based on the time and predetermined location 25 determined by the determining device 20 as the specific person and the movement history of the first unspecified person 80 obtained in step S3.

[0125] Specifically, the control unit 11 executes Figure 9 The identity determination process shown (steps S21 to S23).

[0126] Step S21: The control unit 11 acquires the first moment and the first position contained in the movement history of the first unspecified person 80 who is being identified.

[0127] Specifically, the control unit 11 acquires at least one set of times and locations included in the movement history of the unspecified person 80 acquired in step S3. For example, the control unit 11 acquires... Figure 13 The example movement history includes one or more groups of times and locations.

[0128] Step S22: Based on the determination result of the determination device 20, the control unit 11 obtains the time (determination time) when the specific person is determined and the predetermined position 25.

[0129] Specifically, for example, control unit 11 acquires Figure 10 At least one group of the exemplified figures with a defined time and location.

[0130] Step S23: The control unit 11 compares the first moment and first position obtained in step S21 with the determined moment and predetermined position 25 obtained in step S22, and determines the identity of the first unspecified person 80 with the specified person.

[0131] Specifically, the control unit 11 determines whether any one of the at least one set of time and location included in the movement history acquired in step S21 matches any one of the at least one set of the determined time and predetermined location 25 acquired in step S22. Here, even if the time and location included in the movement history are not exactly the same as the determined time and predetermined location 25, as long as the difference is within a predetermined threshold (e.g., 5 seconds for time, 5 meters for location), the control unit 11 can determine that they match. If a match exists, the control unit 11 determines that the first unspecified person 80 is the same as the specific person involved in the determined time and predetermined location 25 that matches their movement history. If no match exists, the control unit 11 determines that the first unspecified person 80 is different from the specific person.

[0132] exist Figure 10 and Figure 13 In the example, Figure 13 The movement history includes the time 14:50:00 and the location (60, 60) and Figure 10 The determined time 14:50:00 and the predetermined position 25 (60, 60) are the same, therefore they match. Therefore, the control unit 11 determines that it has... Figure 13Unspecified figures in the history of movement 80 and Figure 10 The specific person is the same as "User A". When the processing of step S23 ends, the control unit 11 ends the identity determination process and enters the next step. Figure 7 Step S5.

[0133] Step S5: If the result of the same determination process in step S4 is that the first unspecified person 80 is the same as the specified person (YES in step S5), the control unit 11 proceeds to step S6; otherwise, it proceeds to step S7 (NO in step S5).

[0134] Step S6: The control unit 11 establishes a correspondence between the movement history of the first unspecified person 80 obtained in step S3 and the specific person determined to be the same in step S4, and stores it in the storage device.

[0135] For example, in the aforementioned example, control unit 11 will Figure 13 The movement history is mapped to "User A" and stored in storage devices such as storage unit 12. Then, control unit 11 finishes processing the flowchart.

[0136] Step S7: The control unit 11 establishes a correspondence between the movement history of the first unspecified person 80 and the captured image of the first unspecified person 80 and stores it in the storage device.

[0137] Specifically, the control unit 11 acquires a captured image showing the first unspecified person 80. For example, the control unit 11 may also acquire images captured by the capturing device 40 at times and locations included in the movement history of the first unspecified person 80. Alternatively, the control unit 11 may acquire a specific captured image specified by the user as the captured image showing the first unspecified person 80. The control unit 11 then establishes a correspondence between the acquired captured image and the movement history of the first unspecified person 80 and stores it in a storage device such as the storage unit 12. Then, the control unit 11 terminates the flowchart processing.

[0138] As described above, the information processing system 1 of this embodiment includes a determining device 20 for identifying a person existing at a predetermined location 25 as a specific person, at least one identifying device 30 for identifying people existing in a geographical area 35 corresponding to the local machine as unspecified persons, and an information processing device 10. The information processing device 10 analyzes the identification results of the at least one identifying device 30 to obtain a movement history indicating the temporal changes in the location of the first unspecified person 80. Based on the determination of the specific person's time and predetermined location 25 by the determining device 20 and the movement history of the first unspecified person 80, the information processing device 10 determines whether the specific person and the first unspecified person 80 are the same. If the information processing device 10 determines that the specific person and the first unspecified person 80 are the same, it establishes a correspondence between the movement history of the first unspecified person 80 and the specific person and stores it in a storage device such as a storage unit 12.

[0139] Based on this structure, a specific person is associated with their movement history based on the determination result of the determining device 20 and the movement history of an unspecified person 80 based on the identification result of at least one identification device 30. Therefore, the unspecified person 80 identified by the identification device 30 can be identified. Furthermore, by using at least one identification device 30, movement history over a wider geographical area can be obtained. The number of expensive determining devices 20 can also be reduced, thus achieving cost reduction. Moreover, since the identification result obtained solely by the identification device 30 cannot identify an individual, the privacy of the unspecified person 80 identified by the identification device 30 can be protected even if the identification result is leaked. Additionally, the identification device 30 can be implemented with any structure as long as it can at least obtain information on the location and time of the unspecified person 80, thus it can be implemented using inexpensive devices such as radar.

[0140] In the information processing system 1, one or more identification devices 30 may include a first identification device (e.g., identification device 30c). Furthermore, the information processing device 10 can analyze the identification result of the first identification device 30c to determine the first position and first velocity vector of the first unspecified person 80 at the first moment when the first unspecified person 80 was identified by the first identification device 30c. The information processing device 10 can also determine the estimated position of the first unspecified person 80, which is a past moment compared to the first moment, based on the first moment, the first position, and the first velocity vector.

[0141] Based on this structure, by obtaining the estimated position of the unspecified person 80 in the past moments based on the time, position and velocity vector of the unspecified person 80, the movement history of the unspecified person 80 can be obtained with high accuracy.

[0142] In the information processing system 1, the identification device 30 may also include a second identification device (e.g., identification device 30b). Furthermore, the information processing device 10 can analyze the identification result of the second identification device 30b to determine the second time and the second location of the second unspecified person identified by the second identification device 30b. The information processing device 10 can also determine whether the first unspecified person 80 is the same as the second unspecified person based on a comparison between past times and estimated locations and the second time and second location.

[0143] Based on this structure, the past time and estimated position of the first unspecified person 80 identified by the first identification device 30c are compared with the second time and second position of the second unspecified person identified by the second identification device 30b, and the identity of the first unspecified person 80 and the second unspecified person is determined, thereby enabling the acquisition of movement history with high accuracy.

[0144] In the information processing system 1, the information processing device 10 can also determine whether the specific person is the same as the first unspecified person 80 based on the comparison between the time and predetermined location 25 of the specific person determined by the determining device 20 and the past time and estimated location.

[0145] Based on this structure, the identity of the specific person and the first unspecified person 80 is determined by comparing the time and predetermined position 25 of the determining device 20 with the past time and presumed position of the first unspecified person 80, thereby enabling the determination of the first unspecified person 80 with high precision.

[0146] In the information processing system 1, if the information processing device 10 determines that the specific person is different from the first unspecified person 80, it can also acquire the image of the first unspecified person 80 captured by the shooting device 40, establish a correspondence between the movement history of the first unspecified person 80 and the captured image, and store it in the storage device.

[0147] Based on this structure, for unspecified persons 80 who are not associated with a specific person, by establishing a correspondence between the movement history and the captured images, when a suspicious person appears as an unspecified person 80, it is possible to track their actions by establishing a correspondence between the suspicious person's appearance and their actions.

[0148] In the information processing system 1, at least one identification device 30 may also include a millimeter-wave radar or an infrared sensor.

[0149] Typically, millimeter-wave radar or infrared sensors can be constructed more cost-effectively than the identification device 20 for identifying persons. Therefore, by utilizing millimeter-wave radar or infrared sensors to implement at least one identification device 30, the information processing system 1 can be constructed cost-effectively.

[0150] In the information processing system 1, at least one identification device 30 may also include two or more identification devices 30 configured in such a way that at least a portion of the corresponding geographical range 35 overlaps with each other.

[0151] For example, in Figure 6 In this configuration, the geographical range 35a of identification device 30a partially overlaps with the geographical range 35b of identification device 30b. Thus, if at least a portion of the corresponding geographical ranges 35 of the identification devices 30 overlap, then when an unspecified person 80 moves through the overlapping range within multiple geographical ranges 35, two or more identification devices 30 can seamlessly track and identify the movement of the unspecified person 80. Therefore, with this structure, it is possible to track the movement history of an unspecified person 80 moving across geographical ranges 35 corresponding to multiple identification devices 30 with high precision.

[0152] This disclosure has been described based on the accompanying drawings and embodiments; however, it should be noted that various modifications and alterations can be made based on this disclosure by those skilled in the art. Therefore, it should be understood that such modifications and alterations are included within the scope of this disclosure. For example, the functions contained in each component or step can be reconfigured in a logically consistent manner, and multiple components or steps can be combined into one or divided.

[0153] For example, in the above embodiments, it is also possible to distribute the structure and operation of the information processing device 10 among multiple computers capable of communicating with each other. Alternatively, it is possible to include some or all of the components of the determining device 20 or the identification device 30 in the information processing device 10. For example, the information processing device 10 may also include components for acquiring identification information of the person possessed by the determining device 20.

[0154] Furthermore, the information processing device 10 can also, based on the user's selection of an unspecified person 80, obtain the movement history of that unspecified person 80 according to the request, determine the corresponding specific person, and store the movement history and the specific person in a storage device. With this structure, the movement history of the unspecified person 80 selected by the user can be automatically obtained and a correspondence established with the specific person.

[0155] Furthermore, the information processing device 10 can also display the correspondence between the movement history of unspecified persons 80 and specific persons to the user. For example, the information processing device 10 can also display an image on a map showing the correspondence between the movement history of unspecified persons 80 and the identification information of specific persons on a screen. With this structure, the user can easily grasp the correspondence between the movement history of unspecified persons 80 and specific persons.

[0156] Furthermore, the information processing device 10 can also store temporarily created mobile history within a certain time range in the storage unit 12, etc., and reuse the stored mobile history when creating mobile history for a time range adjacent to that time range. With this structure, it is not necessary to repeat the process of creating the same mobile history for temporarily created mobile history, and processing can be performed efficiently.

[0157] In addition, after referring to Figure 6 In the example shown, the person determination performed by the determining device 20 precedes the identification of the unspecified person 80 based on the identification devices 30b and 30c. However, the person determination performed by the determining device 20 does not necessarily precede the identification of the unspecified person 80 performed by the identification device 30. For example, the person determination based on the determining device 20 may be performed after the identification of the unspecified person 80 performed by the identification device 30.

[0158] Alternatively, for example, an embodiment could be implemented in which a general-purpose computer functions as the information processing apparatus 10 of the above-described embodiments. Specifically, a program describing the processing contents for implementing the functions of the information processing apparatus 10 of the above-described embodiments is stored in the memory of a general-purpose computer, and the program is read and executed by a processor. Therefore, this disclosure can also be implemented as a program executable by a processor or a non-volatile computer-readable medium storing the program.

Claims

1. An information processing system comprising: determination means for determining a person present at a predetermined location as a specific person; at least one recognition means for recognizing a person present in a geographical range corresponding to the home as an unspecified person, respectively; and information processing means, wherein the information processing means acquires a movement history indicating a temporal change in the position of a first unspecified person by analyzing the results of recognition by the at least one recognition means, determines whether the specific person and the first unspecified person are the same based on the time at which the specific person is determined by the determination means and the predetermined location and the movement history of the first unspecified person, stores the movement history of the first unspecified person in the storage means in association with the specific person in the case where it is determined that the specific person and the first unspecified person are the same, the at least one recognition means includes a first recognition means and a second recognition means, the information processing means determines a first position and a first velocity vector of the first unspecified person at a first time at which the first unspecified person is recognized by the first recognition means by analyzing the results of recognition by the first recognition means, determines an estimated position of the first unspecified person at a time that is past compared to the first time based on the first time, the first position, and the first velocity vector, determines a second position of a second unspecified person at a second time at which the second unspecified person is recognized by the second recognition means by analyzing the results of recognition by the second recognition means, by taking a time included in the results of recognition by the second recognition means that is the same as the time determined to be the past time as the second time at which the second unspecified person is recognized, determines whether the first unspecified person and the second unspecified person are the same based on a comparison of the past time and the estimated position with the second time and the second position.

2. The information processing system according to claim 1, wherein the information processing means determines whether the specific person and the first unspecified person are the same based on a comparison of the time at which the specific person is determined by the determination means and the predetermined location and the past time and the estimated position.

3. The information processing system according to claim 1 or 2, wherein the information processing means acquires a captured image of the first unspecified person captured by a capturing device in the case where it is determined that the specific person and the first unspecified person are not the same, and stores the movement history of the first unspecified person in association with the captured image in the storage means.

4. The information processing system according to claim 1 or 2, wherein the at least one recognition means includes a millimeter wave radar or an infrared sensor.

5. The information processing system according to claim 1 or 2, wherein the at least one recognition means includes two or more recognition means arranged in a manner in which at least a part of the corresponding geographical ranges overlap each other.

6. An information processing method of an information processing system comprising: determining means for determining a person present at a predetermined location as a specific person; at least one recognition means for recognizing a person present in a geographical range corresponding to the host as an unspecified person, respectively; and an information processing apparatus that communicates with the determining means and the at least one recognition means, the at least one recognition means includes a first recognition means and a second recognition means, wherein the information processing method includes the following steps: the information processing apparatus acquires a movement history indicating a temporal change in the position of the first unspecified person by analyzing the result of recognition by the at least one recognition means; determines whether the specific person and the first unspecified person are the same based on the time at which the specific person is determined by the determining means and the predetermined location and the movement history of the first unspecified person, in a case where it is determined that the specific person and the first unspecified person are the same, stores the movement history of the first unspecified person in the storage means in association with the specific person, in the step of acquiring the movement history, the information processing apparatus determines a first position and a first velocity vector of the first unspecified person at a first time at which the first unspecified person is recognized by the first recognition means by analyzing the result of recognition by the first recognition means, determines a presumed position of the first unspecified person at a time that is past compared to the first time based on the first time, the first position, and the first velocity vector, determines a second position of a second unspecified person at a second time at which the second unspecified person is recognized by the second recognition means by analyzing the result of recognition by the second recognition means, the second time being the same as the time determined to be the past time, determines whether the first unspecified person and the second unspecified person are the same based on a comparison between the past time and the presumed position and between the second time and the second position.

7. A non-transitory computer readable medium, wherein, The non-transitory computer-readable medium stores a program that causes a computer to function as an information processing apparatus, The information processing apparatus communicates between determining means for determining a person present at a predetermined location as a specific person and at least one recognition means for recognizing a person present in a geographical range corresponding to the host as an unspecified person, respectively, wherein The information processing apparatus acquires a movement history indicating a temporal change in the position of the first unspecified person by analyzing the result of recognition by the at least one recognition means, determines whether the specific person and the first unspecified person are the same based on the time at which the specific person is determined by the determining means and the predetermined location and the movement history of the first unspecified person, in a case where it is determined that the specific person and the first unspecified person are the same, stores the movement history of the first unspecified person in the storage means in association with the specific person, The at least one recognition device includes a first recognition device and a second recognition device, when the movement history is acquired, The information processing apparatus decides a first position and a first velocity vector of the first unspecified person at a first time when the first unspecified person is recognized by the first recognition device, by analyzing a result of recognition by the first recognition device, decides a presumed position of the first unspecified person at a time that is past compared to the first time, based on the first time, the first position, and the first velocity vector, decides a second position of a second unspecified person at a second time when the second unspecified person is recognized, by analyzing a result of recognition by the second recognition device, by taking a time included in the result of recognition by the second recognition device that is the same as the time decided to be the past time as the second time when the second unspecified person is recognized, determines whether the first unspecified person and the second unspecified person are the same, based on a comparison of the past time and the presumed position with the second time and the second position.

Images