Information processing device, information processing system, and information processing method

Abstract

To specify a loss location where a lost item was misplaced in a facility equipped with multiple cameras.SOLUTION: An information processing device according to the present invention includes a storage unit, a reception unit, a setting unit, a search unit, and a specifying unit. The storage unit stores imaging data obtained by imaging different imaging areas within a facility with each of a plurality of cameras. The reception unit receives a search request for a lost item misplaced by a person who lost an item in the facility. The setting unit sets the person who lost the item and the lost item as search conditions for a similar image search on the basis of the search request received by the reception unit. The search unit searches for a switching point at which the imaging data in which the person who lost the item and the lost item are imaged transitions to imaging data in which only the person who lost the item is imaged through a similar image search on the imaging data stored in the storage unit on the basis of the search conditions set by the setting unit. The specifying unit specifies the loss location of the lost item on the basis of the imaging area of the camera that imaged the switching point searched by the search unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, and an information processing method. [Background technology]

[0002] Conventionally, there are techniques for detecting lost items from image data. For example, Patent Document 1 discloses a technique for detecting an object that has not moved for a certain period of time as a lost item, and for identifying a person who appears in image data immediately before the lost item is detected as the cause of the loss. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-88072 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the prior art has not considered identifying the location where an item was lost in a facility equipped with multiple cameras.

[0005] The present invention has been made in consideration of the above, and aims to provide an information processing device, an information processing system, and an information processing method that can identify the location where an item was lost in a facility equipped with multiple cameras. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, an information processing device according to the present invention includes a storage unit, a reception unit, a setting unit, a search unit, and an identification unit. The storage unit stores image data captured by multiple cameras each capturing a different image area of ​​a facility. The reception unit accepts a search request for a lost item lost by an owner of the item at the facility. The setting unit sets the owner of the item and the lost item as search conditions for a similar image search based on the search request accepted by the reception unit. The search unit searches the image data stored in the storage unit for a similar image search based on the search conditions set by the setting unit, and searches for a switching point at which the image data capturing the owner of the item and the lost item switches to image data capturing the owner of the item alone. The identification unit identifies the location where the lost item was lost based on the image area of ​​the camera capturing the switching point found by the search unit. [Effects of the Invention]

[0007] According to the present invention, it is possible to identify the location where an item was lost in a facility equipped with multiple cameras. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a schematic diagram of an imaging region according to the embodiment. [Figure 3] FIG. 3 is a block diagram of an information processing apparatus according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of information stored in the imaging data storage unit according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of information stored in a camera information storage unit according to the embodiment. [Figure 6] FIG. 6 is an explanatory diagram of processing by the search unit according to the embodiment. [Figure 7] FIG. 7 is an explanatory diagram of processing by the search unit according to the embodiment. [Figure 8] FIG. 8 is an explanatory diagram of a process performed by the search unit according to the embodiment. [Figure 9] FIG. 9 is an explanatory diagram of a process performed by a search unit according to the embodiment. [Figure 10] FIG. 10 is an explanatory diagram of a search process for a lost item owner according to the embodiment. [Figure 11] FIG. 11 is an explanatory diagram of a search process for a lost item owner according to the embodiment. [Figure 12] FIG. 12 is a flowchart showing a processing procedure executed by the information processing apparatus according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] The information processing device 1 according to the embodiment described below includes a memory unit 34 that stores image data captured by multiple cameras each capturing an image of a different imaging area of ​​a facility; a reception unit 352 that receives a search request for a lost item lost by an owner of the item at the facility; a setting unit 353 that sets the owner of the item and the lost item as search conditions for a similar image search based on the search request received by the reception unit 352; a search unit 354 that searches for a switching point at which the image data capturing the owner of the item and the lost item switches to image data capturing the owner of the item alone by performing a similar image search on the image data stored in the memory unit 34 based on the search conditions set by the setting unit 353; and an identification unit 355 that identifies the location where the lost item was lost based on the image area of ​​the camera that captured the image of the switching point searched for by the search unit 354.

[0010] In the information processing device 1 according to the embodiment described below, the search unit 354 obtains the movement trajectory of the person who lost the item from the imaging data, and searches for the switching point using the imaging data of the movement trajectory as a target.

[0011] In addition, in the information processing device 1 according to the embodiment described below, when the search unit 354 detects image data of the lost item captured alone after the lost item has deviated from multiple image capture areas while in possession of the lost item, the search unit 354 sets the deviation area in which the lost item has deviated from the image capture area as the switching point.

[0012] In addition, in the information processing device 1 according to the embodiment described below, the receiving unit 352 receives a search request including a specification that image data of both the owner of the loss and the lost item are to be searched for.

[0013] In addition, in the information processing device 1 according to the embodiment described below, when a lost item is found, the reception unit 352 can receive a search request for the owner of the lost item, and the search unit 354 searches for the owner of the lost item using image data captured at the time the lost item was found, which was before the time the lost item was found.

[0014] Furthermore, an information processing system S according to an embodiment described below includes a plurality of cameras installed in a facility, each capable of capturing an image of a different imaging area, and an information processing device 1 that analyzes imaging data captured by the plurality of cameras. The information processing device 1 includes a memory unit 34 that stores imaging data captured by each of the plurality of cameras in a different imaging area of ​​the facility, a reception unit 352 that receives a search request for a lost item lost by an owner of the item at the facility, a setting unit 353 that sets the owner of the item and the lost item as search conditions for a similar image search based on the search request received by the reception unit 352, a search unit 354 that searches for a switching point at which imaging data capturing the owner of the item and the lost item switches to imaging data capturing the owner of the item alone by a similar image search based on the search conditions set by the setting unit 353, and an identification unit 355 that identifies the location where the lost item was lost, based on the imaging area of ​​the camera that captured the switching point searched for by the search unit 354.

[0015] Furthermore, the information processing method according to the embodiment described below has a computer execute the following steps: a storage step for storing image data captured by a plurality of cameras each capturing an image of a different imaging area of ​​a facility; a reception step for receiving a search request for a lost item lost by an owner of the item at the facility; a setting step for setting the owner of the item and the lost item as search conditions for a similar image search based on the search request received by the reception step; a search step for searching for a switching point at which the image data captured by the owner of the item and the lost item switches to image data captured by the owner of the item alone by performing a similar image search on the image data stored in the storage step based on the search conditions set by the setting step; and an identification step for identifying the location where the lost item was lost based on the image area of ​​the camera that captured the switching point found by the search step.

[0016] (Embodiment) Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the technology disclosed by the present invention. Furthermore, the same components in each embodiment are designated by the same reference numerals, and redundant explanations will be omitted.

[0017] First, a configuration example of an information processing system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing a configuration example of an information processing system according to an embodiment. As shown in Fig. 1, an information processing system S includes an information processing device 1 and a plurality of camera-equipped lighting devices 50a to 50n (n is a natural number), and the information processing device 1 and the plurality of camera-equipped lighting devices 50 are connected to each other via a predetermined network N.

[0018] The information processing device 1 is a control device that controls the entire information processing system S. In the present disclosure, the information processing device 1 performs processing such as people flow analysis by image analysis of image data captured by each of the multiple camera-equipped lighting devices 50a to 50n. Also, in the present disclosure, the information processing device 1 provides additional services using the captured images.

[0019] The multiple camera-equipped lighting devices 50a-50n are lighting devices equipped with cameras and are installed on the ceiling or the like of a facility. Therefore, each camera installed in the camera-equipped lighting devices 50a-50n can capture image data overlooking the facility. Note that, hereinafter, when there is no need to distinguish between the camera-equipped lighting devices 50a-50n, they may be simply referred to as "camera-equipped lighting devices 50." In the present disclosure, the camera-equipped lighting devices 50 provide the image data captured by each camera to the information processing device 1 via the network N. The camera-equipped lighting devices 50 can also control lighting in response to control signals transmitted from the information processing device 1 via the network N.

[0020] Furthermore, each of the camera-equipped lighting devices 50 is disposed so as to capture an image of a different imaging area. An example of the imaging area will now be described with reference to Fig. 2. Fig. 2 is a schematic diagram of the imaging area according to the embodiment.

[0021] In Fig. 2, the facility in which the camera-equipped lighting devices 50 are installed is divided into nine areas. As shown in Fig. 2, when the facility is represented as areas A1 to A3, areas B1 to B3, and areas C1 to C3, one camera-equipped lighting device 50 is installed in each area.

[0022] That is, the cameras of the camera-equipped lighting devices 50 each capture an image of a different imaging area within the facility, thereby making it possible to capture an image of the entire facility. Note that the imaging areas of the cameras of the camera-equipped lighting devices 50 may be installed so that they partially overlap.

[0023] The information processing system S according to the embodiment makes use of these features to provide a search service for lost items in a facility. Details of the search service will be described below with reference to FIG. 3 and subsequent drawings. First, an example of the configuration of the information processing device 1 will be described with reference to FIG. 3. FIG. 3 is a block diagram of the information processing device 1 according to the embodiment.

[0024] As shown in FIG. 3, the information processing device 1 includes a communication unit 31, a display unit 32, an operation unit 33, a storage unit , and a control unit .

[0025] The communication unit 31 is implemented by a predetermined communication circuit such as a NIC (Network Interface Card), and performs data communication with the camera-equipped lighting device 50 and the like via a communication network such as Ethernet (registered trademark) or LAN.

[0026] The display unit 32 is implemented by, for example, a liquid crystal monitor, a touch panel, etc. The operation unit 33 is implemented by, for example, a mouse, a keyboard, etc., and accepts various operations from the owner of the lost item, the facility manager, etc.

[0027] The storage unit 34 is implemented by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. In the example shown in FIG. 3, the storage unit 34 has an imaging data storage unit 341 and a camera information storage unit 342.

[0028] The imaging data storage unit 341 stores imaging data. The imaging data is data captured by the camera of the camera-equipped lighting device 50. Here, an example of information stored in the imaging data storage unit 341 according to the embodiment will be described with reference to FIG.

[0029] 4 is a diagram showing an example of information stored in the imaging data storage unit 341 according to the embodiment. In the example shown in Fig. 4, the imaging data storage unit 341 stores information items such as "camera ID," "image ID," "imaging time," and "imaging data" in association with one another.

[0030] The "camera ID" field stores an identifier for identifying each camera that captured the image data. In the present disclosure, since the camera is mounted on a lighting device, the camera ID can also be said to be an identifier for identifying the camera-equipped lighting device 50.

[0031] The "Image ID" field stores an identifier for identifying each piece of imaging data. The "Imaging Time" field stores the imaging time of the imaging data identified by the corresponding image ID. The "Imaging Data" field stores the imaging data identified by the corresponding image ID.

[0032] In the present disclosure, imaging data captured by each camera is stored in imaging data storage unit 341. Therefore, the imaging data stored sequentially are each still images, but by playing these in chronological order, they become a moving image.

[0033] 3, the camera information storage unit 342 will be described. The camera information storage unit 342 stores camera information. The camera information is information relating to the camera of the lighting device 50 with camera.

[0034] An example of information stored in the camera information storage unit 342 according to the embodiment will now be described with reference to Fig. 5. Fig. 5 is a diagram illustrating an example of information stored in the camera information storage unit 342 according to the embodiment.

[0035] 5, the camera information storage unit 342 stores information such as "camera ID" and "map ID" in association with each other. The "camera ID" field stores an identifier for identifying each camera. As described above, the "camera ID" can also be considered an identifier for identifying the camera-equipped lighting device 50.

[0036] The "Map ID" field stores a map ID. The map ID is an identifier that indicates the imaging area of ​​the camera identified by the corresponding camera ID. In the example shown in FIG. 2 above, the "Map ID" field stores identifiers that indicate areas A1 to A3, areas B1 to B3, and areas C1 to C3.

[0037] Returning to the explanation of Fig. 3, the control unit 35 will be described. The control unit 35 is a controller that controls the entire information processing device 1. For example, the control unit 35 can be implemented by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). Alternatively, the control unit 35 may be implemented by an integrated circuit such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

[0038] In the example of FIG. 3, the control unit 35 includes an acquisition unit 351, a reception unit 352, a setting unit 353, a search unit 354, and a specification unit 355.

[0039] The acquisition unit 351 acquires imaging data from each camera-equipped lighting device 50 (see FIG. 1) via the communication unit 31. For example, the acquisition unit 351 acquires imaging data to which a camera ID, an image ID, and an imaging time are assigned, and stores the imaging data in the imaging data storage unit 341.

[0040] The reception unit 352 receives a search request for a lost item that was lost by the owner of the item at the facility. For example, the reception unit 352 receives a search request for the lost item from the owner of the item via the operation unit 33. Note that the reception unit 352 may receive the search request remotely, for example, via a dedicated terminal or the like installed at a service counter or the like installed at the facility.

[0041] In the present disclosure, the receiving unit 352 receives a search request including image data of the owner of the lost item and the lost item. Specifically, when making a search request, the owner of the lost item prepares in advance image data of the lost item to be searched for and image data of the owner of the lost item himself / herself, and the receiving unit 352 receives the search request to search for the owner of the lost item and the lost item that appear in these image data.

[0042] In this case, for example, the reception unit 352 may present the image data captured when the owner of the lost item entered the facility to the owner of the lost item, and receive from the owner of the lost item designation of the owner of the lost item and the lost item on the image data.

[0043] Alternatively, the receiving unit 352 may receive a text input representing the lost item instead of image data. For example, in this case, the receiving unit 352 uses the input text to identify an image of the lost item corresponding to the text from the Internet or the like, and converts the text into an image. In this case, the processing of the setting unit 353 and subsequent processes is performed based on the image.

[0044] As will be described later, the receiving unit 352 can also receive a search request from the owner of the lost item. For example, some owners may remember the time up to which they had the lost item. In this case, the receiving unit 352 may receive a designation of the image capture time from the owner of the lost item. Specifically, in such a case, the search process may be performed on image data captured after the time designated by the owner of the lost item.

[0045] The setting unit 353 sets the lost item owner and the lost item as search conditions for the similar image search based on the search request accepted by the accepting unit 352. Specifically, the setting unit 353 sets the image data of the lost item owner and the lost item that the lost item owner lost, which are search targets specified by the search request accepted by the accepting unit 352, as search conditions for the similar image search.

[0046] In this case, the setting unit 353 may predefine "lost" as a state in which the owner of the item is in possession of the lost item if the lost item is present within 1 meter of the owner of the item, and as a state in which the owner of the item is not in possession of the lost item if the lost item is not present within 1 meter of the owner of the item.

[0047] The search unit 354 searches for a switching point at which the image data in which the lost item and the lost item are captured switches to the image data in which the lost item is captured alone, by performing a similar image search on the image data stored in the memory unit 34 based on the search conditions set by the setting unit 353.

[0048] Here, a specific example of the processing by the search unit 354 will be described with reference to Fig. 6 to Fig. 9. Fig. 6 to Fig. 9 are explanatory diagrams of the processing by the search unit 354 according to the embodiment. For example, as shown in Fig. 6, assume that the owner of the lost item moves in the following order in the facility: Area A2 → Area B2 → Area C2 → Area C1 → Area C2 → Area C3.

[0049] For example, the search unit 354 tracks the owner of the lost item by performing a similar image search on each piece of imaging data stored in the imaging data storage unit 341 based on the search conditions set by the setting unit 353, and generates log information on the owner of the lost item in the facility. The log information is, for example, a movement trajectory of the owner of the lost item in the facility.

[0050] The search unit 354 then searches for a switching point in the image data of the movement trajectory. Specifically, the search unit 354 searches for a similar image of the lost item in the image data constituting the movement trajectory of the person who lost the item, i.e., the image data in which the person who lost the item is photographed, to find out how far the person who lost the item has carried the lost item.

[0051] Specifically, the search unit 354 separates the image data into those showing the lost item and the lost item, and those showing the lost item alone, and searches for the switching point P at which the boundary between the two changes to the image data showing the lost item alone.

[0052] In the example of FIG. 6, of the movement trajectories of the lost owner, the movement trajectory up to the switching point P is shown by a dashed line as a first trajectory R1, and the movement trajectory after the switching point P is shown by a solid line as a second trajectory R2.

[0053] In the example of Figure 6, when the owner of the lost item passes through the first trajectory R1, it indicates that the owner is in possession of the lost item, and when the owner of the lost item passes through the second trajectory R2, it indicates that the owner is not in possession of the lost item, i.e., the lost item is in a lost state.

[0054] In other words, the image data of the first trajectory R1 shows the owner and the lost item, and the image data of the second trajectory R2 shows the owner alone. In this way, by searching for the switching point P, the search unit 354 can identify the image data taken at the time the owner lost the item.

[0055] Fig. 7 shows the log information of the person who lost the item in the example of Fig. 6. Fig. 7 also shows the time and the area where the person who lost the item stayed. The log information can be generated by analyzing the image data captured by the camera of each camera-equipped lighting device 50.

[0056] The log information of the owner of the lost item when the owner of the lost item follows the movement trajectory of Figure 6 can be shown as in Figure 7. If the owner of the lost item loses the lost item in area C2, as shown in Figure 7, the owner of the lost item will switch from a state in which the owner of the lost item is in possession of the lost item (lost item) until the owner is in area C2 to a state in which the owner of the lost item is not in possession of the lost item in area C2 (no lost item).

[0057] Based on the log information, the search unit 354 performs a similar image search for the switching point P among the image data of the area where the person who lost the item stayed, and targets the image data that was taken at the time the person who lost the item stayed.

[0058] That is, based on the log information, the search unit 354 performs processing by limiting the imaging data to be searched for at the switching point P to imaging data that shows the owner of the lost item. This reduces the processing load of the similar image search compared to when similar image search is performed on all imaging data.

[0059] Next, consider a case where the owner of the lost item goes to the restroom, as shown in Fig. 8. It is assumed that the camera-equipped lighting device 50 is not installed in the restroom, for reasons of privacy, etc.

[0060] For example, as shown in Figure 9, suppose that the owner of the lost item had the lost item in their possession before going to the toilet (lost item), but did not have the item in their possession after coming out of the toilet (not lost item). In this case, as shown in Figure 8, the route from Area A2 → Area B2 → Area C2 → Area C1 → Toilet is a first trajectory R1 in which the owner of the lost item is in possession of the lost item, and the route from Area C1 → Area C2 → Area C3 after the toilet is a second trajectory R2 in which the owner of the lost item is not in possession of the lost item.

[0061] Therefore, the search unit 354 determines that the person who lost the item lost it in the toilet, and sets the toilet as the switching point P. In this way, when the person who lost the item departs from multiple imaging areas while carrying the lost item and then detects imaging data in which the person who lost the item is imaged alone, the search unit 354 sets the deviation area (corresponding to the toilet) where the person who lost the item departs from the imaging area as the switching point P.

[0062] This allows the search unit 354 to appropriately identify the switching point P at which the owner of the lost item lost the item. The search unit 354 can also search for the owner of the lost item using the lost item as a search key, for example.

[0063] Here, the process of searching for the owner of the lost item will be described with reference to Fig. 10 and Fig. 11. Fig. 10 and Fig. 11 are explanatory diagrams of the process of searching for the owner of the lost item according to the embodiment. Fig. 10 shows the movement trajectory of the finder who found the lost item.

[0064] Also, assume here that the finder who found the lost item found the lost item at switching point P in area C2. In such a case, the search unit 354 generates a movement trajectory by searching for similar images of the finder in the imaging data.

[0065] 10, the finder's movement trajectory is assumed to be Area C3 → Area C2 → Area B2 → Area A2. Next, the search unit 354 searches for a switching point P where the finder found the lost item by searching for images similar to the lost item.

[0066] In the example of Figure 10, the finder's movement trajectory before switching point P becomes a second trajectory R2 in which the finder is not carrying the lost item, and after switching point P becomes a first trajectory R1 in which the finder is carrying the lost item.

[0067] Next, the search unit 354 determines the image data to be searched for by the loser based on the occurrence time of the switching point P, i.e., the time when the finder found the lost item. Specifically, as shown in Fig. 11, the search targets image data captured up until the finder found the lost item in area C2, and excludes image data captured after the finder found the lost item in area C2.

[0068] More specifically, the search unit 354 searches for the owner of the lost item among the image data captured in area C2 up until the finder found the lost item in area C2. For example, in this case, the search unit 354 searches for images similar to the lost item among the image data to be searched, and identifies the image data captured when the lost item began to appear in the image data.

[0069] That is, the search unit 354 identifies image data of the lost item when the lost item was lost by the owner through a similar image search for the lost item, and identifies the owner from the image data. Next, the search unit 354 subjects the identified owner to a similar image search to identify the movement trajectory of the owner. This makes it possible to identify the current location of the owner.

[0070] In this way, the search unit 354 can quickly return the lost item to the owner by identifying the owner of the lost item using the lost item as a search key.

[0071] 3, the identification unit 355 will be described. The identification unit 355 identifies the point at which the lost item was lost based on the image capture area of ​​the camera that captured the image of the switching point P found by the search unit 354.

[0072] Specifically, the identification unit 355 refers to the camera information storage unit 342, and based on the camera ID of the camera that captured the image of the switching point P, identifies the map ID (see FIG. 5) that corresponds to the camera ID.

[0073] That is, the identification unit 355 converts the switching point P shown in the image data into an actual coordinate system in the facility based on the camera ID, etc. Through this process, the identification unit 355 identifies the point where the lost item was lost, and provides information about the point of loss to the person who lost the item via the display unit 32, etc.

[0074] At this time, the identification unit 355 may also provide the lost person with imaging data of the current state of the lost location, which allows the lost person to easily check whether the lost person is still at the lost location using the imaging data.

[0075] Furthermore, for example, the identification unit 355 may transmit information about the location of the loss to the mobile device (e.g., a smartphone) of the person who lost the item. In this case, the identification unit 355 may transmit map information showing the route from the current location to the location of the loss to the mobile device of the person who lost the item.

[0076] In this case, the information processing system S may notify the owner of the loss of the item of the location where it was lost by controlling the lighting of the camera-equipped lighting device 50. For example, in this case, the information processing system S may notify the owner of the loss of the location of the loss of the item by controlling the lighting, such as by blinking the lighting of the camera-equipped lighting device 50 at the location where it was lost.

[0077] Also, for example, if the facility is a commercial facility such as a department store, the identification unit 355 may, upon identifying the location of the loss, request employees of tenants near the location of the loss to secure the lost item.

[0078] Next, a processing procedure executed by the information processing device 1 according to the embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the processing procedure executed by the information processing device 1 according to the embodiment. Note that the processing procedure shown below is repeatedly executed by the control unit 35 of the information processing device 1.

[0079] 12, first, the information processing device 1 sequentially stores image data captured by each of the plurality of camera-equipped lighting devices 50 (step S101). Next, the information processing device 1 determines whether or not a search request for a lost item has been received (step S102).

[0080] If the information processing device 1 determines in step S102 that a search request has not been received (step S102: No), the information processing device 1 ends the process. If the information processing device 1 determines in step S102 that a search request has been received (step S102: Yes), the information processing device 1 sets search conditions for a similar image search (step S103).

[0081] Next, the information processing device 1 performs a similar image search for the imaging data stored in the imaging data storage unit 341 (step S104) and identifies the switching point P (step S105).

[0082] Then, the information processing device 1 provides information about the location where the lost item was lost based on the switching point P (step S106), and ends the process.

[0083] As described above, the information processing device 1 according to the embodiment includes a memory unit 34 that stores image data captured by multiple cameras each capturing an image of a different imaging area of ​​a facility; a reception unit 352 that receives a search request for a lost item lost by an owner of the item at the facility; a setting unit 353 that sets the owner of the item and the lost item as search conditions for a similar image search based on the search request received by the reception unit 352; a search unit 354 that searches for a switching point at which the image data capturing the owner of the item and the lost item switches to image data capturing the owner of the item alone by performing a similar image search on the image data stored in the memory unit 34 based on the search conditions set by the setting unit 353; and an identification unit 355 that identifies the location where the lost item was lost based on the image area of ​​the camera that captured the image of the switching point searched for by the search unit 354.

[0084] Therefore, the information processing device 1 according to the embodiment can identify the location where the lost item was lost in a facility equipped with multiple cameras.

[0085] The above-described information processing device 1 may be configured using a cloud. For example, when the information processing device 1 is configured using a cloud, the display unit 32, the operation unit 33, and the reception unit 352 of the control unit 35 may be implemented in a search terminal installed in the facility, and the other components (such as the setting unit 353) may be implemented on the information processing device 1 side.

[0086] When the information processing device 1 here is configured as a cloud, it can usually be used by the facility for purposes such as constant monitoring of the facility from a monitoring terminal of the facility within the normal fee range. Then, based on a request from a search terminal, the information processing device 1 provides a search service.

[0087] In other words, by separating the access source in this way, it becomes possible to bill the usage fee for the search service separately from the regular fee that the facility pays to the information processing device 1. Therefore, the user who lost the item can be made to pay the communication fee for downloading the image data to be input to the reception unit 352 from the storage unit 34, which can be expensive especially when using the cloud.

[0088] As a specific example of such a search service, for example, when the information processing device 1 is installed in an airport or the like, the information processing device 1 operates constantly as a monitoring system and provides a search service to the owner of the lost item when the owner is charged by the owner of the lost item.

[0089] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as the inventions described in the claims and their equivalents. [Explanation of symbols]

[0090] 1. Information processing equipment 31 Communications Department 32 Display section 33 Operation section 34 Storage section 35 Control Unit 50 Camera-equipped lighting device 341 Imaging data storage unit 342 Camera information storage unit 351 Acquisition Department 352 Reception Department 353 Settings 354 Search Department 355 Specific part P Switching point S Information Processing System

Claims

1. a storage unit that stores image data obtained by capturing images of different imaging areas of the facility using each of the multiple cameras; a reception unit that receives a search request for a lost item that has been lost by the owner of the lost item at the facility; a setting unit that sets the owner of the lost item and the lost item as search conditions for a similar image search based on the search request received by the receiving unit; a search unit that searches for a switching point at which the image data in which the lost person and the lost item are captured switches to the image data in which the lost person is captured alone, by performing a similar image search on the image data stored in the storage unit based on the search conditions set by the setting unit; an identification unit that identifies a point where the lost item was lost based on the image capturing area of ​​the camera that captured the image of the switching point searched for by the search unit; An information processing device comprising:

2. The search unit A movement trajectory of the owner of the lost item is obtained from the image data, and the switching point is searched for using the image data of the movement trajectory as a target. The information processing device according to claim 1 .

3. The search unit When the owner of the lost item departs from the plurality of image capturing areas while carrying the lost item and the image capturing data in which the owner of the lost item is captured alone is detected, the deviated area where the owner of the lost item departs from the image capturing area is set as the switching point. The information processing device according to claim 2 .

4. The reception unit The search request is received, the search target being image data of the owner of the loss and the lost item. The information processing device according to claim 1 .

5. The reception unit When the lost item is found, a search request for the owner who lost the lost item can be accepted; The search unit The owner of the lost item is searched for using the image data in which the lost item was found before the lost item was found. The information processing device according to claim 1 .

6. A plurality of cameras installed in the facility, each capable of capturing an image of a different imaging area; an information processing device that analyzes image data captured by the plurality of cameras; Equipped with The information processing device includes: a storage unit that stores image data obtained by capturing images of different imaging areas of the facility using each of the multiple cameras; a reception unit that receives a search request for a lost item that has been lost by the owner of the lost item at the facility; a setting unit that sets the owner of the lost item and the lost item as search conditions for a similar image search based on the search request received by the receiving unit; a search unit that searches for a switching point at which the image data in which the lost person and the lost item are captured switches to the image data in which the lost person is captured alone, by performing a similar image search on the image data stored in the storage unit based on the search conditions set by the setting unit; an identification unit that identifies a point where the lost item was lost based on the image capturing area of ​​the camera that captured the image of the switching point searched for by the search unit; An information processing system comprising:

7. a storage step of storing image data obtained by capturing images of different imaging areas of the facility using each of the plurality of cameras; a receiving step of receiving a request to search for a lost item that has been lost by the owner of the item at the facility; a setting step of setting the owner of the lost item and the lost item as search conditions for a similar image search based on the search request received in the receiving step; a search step of searching for a switching point at which the image data in which the lost person and the lost item are captured switches to the image data in which the lost person is captured alone, by performing a similar image search on the image data stored in the storage step based on the search conditions set in the setting step; an identifying step of identifying a point where the lost item was lost based on the image capturing area of ​​the camera that captured the image of the switching point searched for in the searching step; An information processing method that causes a computer to execute the above.

Images