Search assistance system, mobile body device, search assistance method, and recording medium

Abstract

Provided are a search assistance system, a mobile body device, a search assistance method, and a recording medium which are capable of contributing to improvement of efficiency of search for a search target.　The search assistance system comprises: an acquisition means which acquires, as information on a search target, a feature amount extracted from an image of the search target; a distribution means which includes an object matching function using a camera and the feature amount and distributes the feature amount extracted from the image of the search target to a mobile body cooperating in the search for the search target; a reception means which receives, from the mobile body, a report including information for identifying the position of the mobile body and including whether or not an object corresponding to the feature amount extracted from the image of the search target has been found; and a recording means for recording, on the basis of the report, a section which is searched for the search target by the mobile body.

Description

Search Support System, Mobile Device, Search Support Method, and Recording Medium

[0006] ,

[0005] ,

[0001] The present invention relates to a search support system, a mobile device, a search support method, and a recording medium.

[0002] Patent Document 1 discloses a relief system that can reliably and easily rescue search targets such as elderly wanderers suffering from dementia and lost children. In the relief system described in this document, an in-vehicle device mounted on a taxi uses an in-vehicle video or an out-of-vehicle video captured by a camera to perform authentication using biometric authentication information of a pre-registered target person. When the target person is found, the server notifies the family terminal of the current position of the target person. Further, the server transmits a protection instruction for the target person and information on the destination address to the in-vehicle device of the taxi according to the instruction of the family terminal. The taxi uses this information to deliver the target person to the destination address.

[0003] Japanese Unexamined Patent Application Publication No. 2020-4335

[0004] In the relief system of Patent Document 1, the search for the target person is requested to a taxi or the like. However, even if the target person is found, since the target person is also moving, there is no guarantee that the target person can be protected unless an appropriate instruction from the family terminal is obtained. Also, when the target person is not found, a search request is made to the police or the like, but there is a problem that the search range cannot be narrowed down because the search range during the period until the search request is made cannot be grasped.

[0005] An object of the present disclosure is to provide a search support system, a mobile device, a search support method, and a recording medium that can contribute to improving the efficiency of searching for a search target.

[0006] From the first perspective, a search support system is provided that includes: an acquisition means for acquiring feature quantities extracted from an image of the target of search as information on the target of search; a distribution means for distributing the feature quantities extracted from the image of the target of search to a mobile body that is equipped with a camera and an object matching function using the feature quantities and is cooperating in the search for the target of search; a reception means for receiving a report from the mobile body that includes information for identifying the location of the mobile body and whether or not an object matching the feature quantities extracted from the image of the target of search has been found; and a recording means for recording the section in which the mobile body has searched for the target of search based on the report.

[0007] From a second perspective, a mobile device is provided that includes: a receiving means for receiving a first feature quantity extracted from an image of a search target from a computer constituting a search support system; an extraction means for extracting a second feature quantity from an object photographed by a camera; a determination means for determining whether or not the object photographed by the camera is the search target based on the first and second feature quantities; and a transmission means for transmitting the determination result, along with information for identifying the position of the mobile device, to the computer.

[0008] From a third perspective, a search support method is provided which includes acquiring feature quantities extracted from images of the target to be searched as information about the target to be searched, distributing the feature quantities extracted from the images of the target to a mobile body that is equipped with a camera and an object matching function using the feature quantities, receiving a report from the mobile body that includes information for identifying the mobile body's position and whether or not an object matching the feature quantities extracted from the images of the target to be searched has been found, and recording the section in which the mobile body searched for the target based on the report.

[0009] From a fourth perspective, a search support method is provided, which involves receiving a first feature quantity extracted from an image of the object to be searched from a computer constituting the search support system, extracting a second feature quantity from an object photographed by a camera, determining whether or not the object photographed by the camera is the object to be searched based on the first and second feature quantities, and transmitting the determination result, along with information for identifying the location of the moving object, to the computer.

[0010] From a fifth perspective, a recording medium is provided that contains a program that causes a computer to execute the following: a process for acquiring feature quantities extracted from an image of the target to be searched; a process for distributing the feature quantities extracted from the image of the target to a mobile device that is equipped with a camera and an object matching function using the feature quantities and cooperates in the search for the target; a process for receiving a report from the mobile device that includes information for identifying the mobile device's location and whether or not an object matching the feature quantities extracted from the image of the target to have been found; and a process for recording the section in which the mobile device searched for the target based on the report.

[0011] From a sixth perspective, a recording medium is provided that contains a program that causes a computer constituting a search support system to execute the following: a process of receiving a first feature quantity extracted from an image of the target of search; a process of extracting a second feature quantity from an object photographed by a camera; a process of determining whether or not the object photographed by the camera is the target of search based on the first and second feature quantities; and a process of transmitting the determination result, along with information for identifying the location of a moving object, to the computer.

[0012] This disclosure makes it possible to provide a search support system, a mobile device, a search support method, and a recording medium that can contribute to improving the efficiency of searching for a target.

[0013] This is a diagram showing one configuration of this disclosure. This is a diagram for explaining the operation of this disclosure. This is a diagram showing one configuration of the mobile body of this disclosure. This is a flowchart showing the operation of this disclosure. This is a diagram for explaining the operation of this disclosure. This is a diagram for explaining the overview of this disclosure. This is a diagram for explaining the overview of this disclosure. This is a diagram showing the configuration of the search support server of this disclosure. This is a diagram showing an example of information held in the search target management unit of the search support server of this disclosure. This is a diagram showing an example of information held in the search range recording unit of the search support server of this disclosure. This is a sequence diagram for explaining the operation (search request) of this disclosure. This is a sequence diagram for explaining the operation (report collection) of this disclosure. This is a diagram for explaining the operation of this disclosure. This is another diagram for explaining the operation of this disclosure. This is another diagram for explaining the operation of this disclosure. This is a diagram showing another configuration of the search support server of this disclosure. This is a sequence diagram for explaining another operation (search request) of this disclosure. This is a diagram showing the configuration of the computers constituting the search support system or search support server of this disclosure.

[0014] First, an overview of one embodiment of this disclosure will be described with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. The reference numerals in the drawings appended to this overview are provided for convenience as examples to aid understanding and are not intended to limit this disclosure to the illustrated embodiments. In addition, the connecting lines between blocks in the drawings and other references referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. The program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as needed. This computer device is also configured to communicate with devices (including computers) inside or outside the device via the communication interface, whether wired or wireless. In addition, there are ports or interfaces at the input / output connection points of each block in the figures, but these are omitted from the illustration.

[0015] In one embodiment, this disclosure can be realized by a search support system 10 comprising an acquisition means 11, a distribution means 12, a reception means 13, and a recording means 14, as shown in Figure 1. More specifically, as shown in Figure 2, the acquisition means 11 acquires feature quantities extracted from an image of the object to be searched as information about the object to be searched. The distribution means 12 distributes the feature quantities extracted from the image of the object to be searched to the mobile body. As a result, the search support system 10 requests the mobile body, which is equipped with a camera and an object matching function using feature quantities, to cooperate in the search for the object to be searched.

[0016] The receiving means 13 receives a report from the mobile body that includes information for identifying the mobile body's location and whether or not an object matching the feature quantities extracted from the image of the target being searched has been found. The information for identifying the mobile body's location can include the mobile body's location information or the positional relationship between the mobile body and the target being searched. The recording means 14 records the section in which the mobile body searched for the target being searched based on the report.

[0017] There are no particular restrictions on the objects that the above-mentioned search support system 10 can search. For example, as shown in Figure 2, the search targets ST can include people, pets (animals), vehicles, bicycles, etc. The mobile objects (MO) that the above-mentioned search support system 10 requests to search only need to be equipped with a camera and an object matching function using feature quantities. As shown in Figure 2, these could include unmanned aerial vehicles, ordinary cars, buses, unmanned transport vehicles, etc.

[0018] Figure 3 shows one configuration of the mobile body of the present disclosure. Such a mobile body MO includes a receiving means 21 that receives a first feature quantity extracted from an image of the target of search from a computer constituting the search support system 10, and an extraction means 22 that extracts a second feature quantity from an object photographed by a camera. The mobile body MO also includes a determination means 23 that determines whether or not the object photographed by the camera is the target of search based on the first and second feature quantities. As this determination means 23, for example, a large-scale language model (LLM) or a VLM (Vision-Language Model) capable of performing image analysis can be used. Furthermore, the mobile body MO includes a transmitting means 24 that transmits the determination result along with information for identifying the location of the mobile body to the computer.

[0019] The search support system 10 configured as described above operates as follows. First, the search support system 10 acquires feature quantities extracted from the image of the target ST (step S01 in Figure 4). Note that the extraction of feature quantities from the image of the target may be performed by the search support system 10.

[0020] Next, the search support system 10 distributes feature quantities extracted from the image of the target ST to the mobile body MO (step S02 in Figure 4).

[0021] Next, the search support system 10 receives a report from the mobile object MO that includes information for identifying the location of the mobile object and whether or not an object matching the feature quantities extracted from the image of the target to be searched has been found (step S03 in Figure 4).

[0022] Finally, the search support system 10 records the section in which the mobile body searched for the target based on the report (step S04 in Figure 4). This section may be received as the travel route from the mobile body MO, but if the travel route of the mobile body MO is known, the section identified from the travel route of the mobile body MO may be used.

[0023] For example, if vehicles MO1 to MO2, which are mobile entities, travel along the routes shown in Figure 5, these vehicles will report to the search support system 10, including information to identify the location of the mobile entities. If vehicles MO1 to MO2 find the target ST, a report to that effect can be obtained. Even if vehicles MO1 to MO2 do not find the target ST, the search support system 10 can identify the sections on the map in Figure 5 that have not been searched. By searching these sections SEG1 to SEG5, the possibility of finding the target ST can be increased. Of course, if there is a possibility that the target ST may move, the search area may be expanded to take its mobility into consideration.

[0024] As explained above, this disclosure makes it possible to streamline the search for the target ST.

[0025] [First Embodiment] Next, we will describe a first embodiment in which this disclosure is applied to the search for a missing person (hereinafter referred to as "missing person") who has left their home or facility and gone missing. Figures 6 and 7 are diagrams illustrating the overview of the search support system to which this disclosure is applied. First, we will explain the flow from the occurrence of a missing person to the finding of the missing person by referring to Figures 6 and 7.

[0026] (1) Missing after going out ~ (2) When a family member realizes that the person to be searched TP has gone out and is missing, they provide an image of the person to be searched TP to the terminal 400 of the search center which is part of the search support system and request a search. The image of the person to be searched TP may be provided by transmitting it via the internet, etc., or by presenting the image to the operator of the terminal 400. In the following explanation, the search center will be described as being located in a local government or community center, but the search center may also be a website set up on the internet. In this case, the family of the person to be searched TP will directly access the search support server 100 and register the necessary information.

[0027] (3) Registration of information on the person to be searched ~ (4) The operator of the search data distribution terminal 400 registers information such as the image and contact information of the person to be searched TP with the search support server 100. The search support server 100 issues a search ID to the registered person to be searched TP. The search support server 100 then uses this search ID to create search data for the person to be searched TP and distributes it to the search cooperation vehicles 201 and 202 that are cooperating in the search for the person to be searched TP. This search data for the person to be searched TP preferably consists of, for example, a search ID and the feature quantities of the person to be searched TP, and does not include information that can directly identify the person to be searched TP. The search cooperation vehicles 201 and 202 may be general vehicles or taxis, but may also be general business vehicles or public transportation vehicles. Business vehicles and public transportation vehicles have the characteristic of traveling on a fixed route at a fixed time. By adding these vehicles to the search and rescue fleet, it becomes possible to reliably secure a search area of ​​a certain size or larger.

[0028] (5) Finding / Not Finding ~ (6) Finding Report or Periodic Report Search cooperation vehicles 201 and 202, having received search data for the person to be searched TP, conduct a search for the person to be searched TP using camera images taken during their journey. For example, if search cooperation vehicle 202 finds a person that matches the characteristics of the person to be searched TP, it sends a finding report to the search support server 100. This finding report includes the time and location information. In addition, search cooperation vehicle 202 sends a periodic report to the search support server 100 that includes information about the section (route) that search cooperation vehicle 202 traveled. Search cooperation vehicle 202 also sends this periodic report even if it is unable to find a person that matches the characteristics of the person to be searched TP.

[0029] (7) Recording of discovery reports or periodic reports The search support server 100 records the discovery reports or periodic reports received from the search cooperation vehicles 201 and 202 in this manner. The search support server 100 can use the date and time and location information included in the discovery reports to create information on the movements of the person being searched for TP. The search support server 100 can also use the information on the sections traveled by the vehicles included in the periodic reports to create maps showing the sections where the person being searched for TP has been searched and the sections where it has not been searched.

[0030] (8) Notification ~ (11) Search If there is one or more reports of the discovery of the person being searched TP, or if a certain number of the aforementioned periodic reports have been collected, the search support server 100 will notify terminal 400 that a clue has been obtained. Upon receiving the notification, the operator of terminal 400 will contact the family of the person being searched TP. Upon receiving the contact, the family will use their own terminal or other device to access the search support server 100 and view the location information of the person being searched TP and the areas where the person being searched TP has already been searched (previously searched areas). The family will use the location information of the person being searched TP and the areas where the person being searched TP has already been searched (previously searched areas) as clues to search for the person being searched TP. Specifically, the family can determine where the person being searched TP went from the location information. Furthermore, the family can use the areas where the person being searched TP has already been searched (previously searched areas) to narrow down the area that should be searched. In the example shown in Figure 7, the search support server 100 notifies the search center terminal 400 that the person being searched for TP has been found. However, the search support server 100 may also directly notify the family of the person being searched for TP's discovery. In the following explanation using Figure 8, we will assume that the search support server 100 directly contacts the family of the person being searched for TP's discovery.

[0031] Next, an example of the configuration of the search support server 100 described above will be explained in detail with reference to the drawings. Figure 8 is a diagram showing the configuration of the search support server 100 of this disclosure. Referring to Figure 8, the search support server 100 includes a search request reception unit 105, a search data generation unit 101, a distribution unit 102, a reception unit 103, a recording unit 104, a search range recording unit 106, a search target management unit 107, and a communication unit 108. In the following description, the vehicles cooperating in the search of the person to be searched TP will be described as vehicles 201 and 202 (hereinafter referred to as search cooperation vehicles). Furthermore, in the following description, the search cooperation vehicles 201 and 202 will be described as being equipped with cameras, capable of conducting searches for the person to be searched TP using search data, and capable of transmitting discovery reports and periodic reports.

[0032] The search request reception unit 105 publishes a form for inputting search requests and receives information such as images of the person being searched for (TP) and contact information of family members from the search support system terminal 400. The search request reception unit 105 sends the received information to the search data generation unit 101. The search request reception unit 105 corresponds to the acquisition means 11 described above.

[0033] The search data generation unit 101 issues a search ID for the person to be searched TP. The search data generation unit 101 also extracts feature quantities from the image of the person to be searched TP. The search data generation unit 101 generates search data that links the search ID and the feature quantities. The search data generation unit 101 sends the search data to the distribution unit 102 and requests its distribution to the search cooperation vehicles 201 and 202. The search data generation unit 101 corresponds to the search data generation means.

[0034] The distribution unit 102 distributes the search data to the search cooperation vehicles 201 and 202. The distribution unit 102 corresponds to the distribution means 12 described above.

[0035] The reception unit 103 receives discovery reports and periodic reports using search data from the search cooperation vehicles 201 and 202, and sends them to the recording unit 104.

[0036] When the recording unit 104 receives a discovery report from the search cooperation vehicles 201 and 202, it records it in the search target management unit 107. Furthermore, when the recording unit 104 receives a periodic report from the search cooperation vehicles 201 and 202, it records it in the search range recording unit 106. It is preferable that the reception unit 103 limits the period for receiving discovery reports and periodic reports using search data to within a predetermined time after the transmission of the search data. This ensures that the recording unit 104 records the sections in which the search was conducted based on reports received within the predetermined time.

[0037] Figure 9 is a list of discovery reports recorded in the search target management unit 107. The search target management unit 107 manages the location information of the person being searched for TP in chronological order. In addition, in the example in Figure 9, images of the person who was determined to match the person being searched for TP by the vehicle that sent the discovery report are also registered. By using this information, it is possible to create information on the movements (estimated travel route) of the person being searched for TP.

[0038] Figure 10 shows a list of periodic reports recorded in the search area recording unit 106. The search area recording unit 106 records the date and time of travel, route information (travel section), and search results for each vehicle identified by its vehicle ID. By using this information, it is possible to identify the area where the person being searched TP has been searched.

[0039] When certain conditions are met, such as the passage of a certain amount of time or the receipt of a predetermined number of discovery reports, the liaison unit 108 notifies the terminal 500 of the family of the person being searched TP that clues such as movement information have been obtained. Upon receiving a request from the terminal 500 of the family of the person being searched TP, the liaison unit 108 provides movement information and information on the searched area. Of course, even before the aforementioned notification is made, the liaison unit 108 may also provide movement information and information on the searched area in response to requests from the terminal 500 of the family of the person being searched TP.

[0040] Next, the operation of this embodiment will be described in detail with reference to the drawings. FIG. 11 is a diagram for explaining the operation (search request) of the present disclosure. First, the person in charge at the search center receives from the family of the search target person TP the provision of an image, family contact information, etc., inputs these into the terminal 400, and accepts a search request (step S001).

[0041] The person in charge at the search center uses the terminal 400 to register information such as the image and family contact information in the search support server 100 (step S002).

[0042] When the search support server 100 receives the registration of the image and family contact information of the search target person TP, it creates search data for distribution to the search cooperation vehicles 201 and 202 (step S003). Specifically, the search support server 100 issues a search ID for the search target person TP. Further, the search support server 100 extracts feature amounts from the image of the search target person TP and creates search data in association with the search ID.

[0043] Next, the search support server 100 distributes the created search data to the search cooperation vehicles 201 and 202 (step S004). The search cooperation vehicles 201 and 202 that have received the search data start searching for the search target person TP based on the search data (step S005).

[0044] FIG. 12 is a diagram for explaining the operation (report collection) of the present disclosure. The search cooperation vehicles 201 and 202 transmit a discovery report or a regular report to the search support server 100 (step S006).

[0045] The search support server 100 that has received the discovery report or the regular report records the content received as the discovery report or the regular report in the search target management unit 107 and the search range recording unit 106 (step S007).

[0046] When conditions such as the results over a certain period of time or the reception of a predetermined number of discovery reports are met, the search support server 100 notifies the terminal 500 of the family members of the search target person TP that a clue has been obtained (step S008). The family members of the search target person TP who have received the notification access the search support server 100 using the terminal 500 or the like, and view the trace information and the information on the searched range (step S009).

[0047] After that, the family members of the search target person TP who have received the notification search for the search target person TP using the information provided by the search support server 100 as a clue (step S010).

[0048] FIG. 13 is a diagram showing an example of the presentation form of the trace information (estimated movement route) provided by the search support server 100. Hereinafter, in FIGS. 13 to 15, the upper side of the map indicates north. In the example of FIG. 13, it can be seen that the search target person TP was discovered at a position northwest of his / her home Hm at 13:00, then headed further north at 13:05, and then moved eastward at 13:20.

[0049] FIG. 14 is a diagram in which the travel route of the search cooperation vehicle V1 that traveled in the vicinity at the same time is superimposed on the trace information (estimated movement route) of FIG. 13 as the information on the searched range. In this case, if there is no discovery report from the search cooperation vehicle V1, it is highly likely that the search target person TP is not on the travel route of the search cooperation vehicle V1. The family members of the search target person TP can narrow down the search range by obtaining such information. For example, the family members of the search target person TP can discover the search target person TP earlier by searching the section SEG1.

[0050] On the other hand, as shown in Figures 13 and 14, there are cases where no discovery report is obtained. Figure 15 shows the travel routes of search assistance vehicles V1 and V2. In this case, since there is no discovery report, no information on where the person was found is obtained. However, if the travel routes of search assistance vehicles V1 and V2 are considered already searched sections, then the remaining sections SEG1 to SEG6 become unsearched sections. Of these, sections SEG5 and SEG6 were traveled by search assistance vehicles V1 and V2 successively in adjacent sections, but no discovery was made, so it is considered unlikely that the person being searched for TP is in those sections. The family of the person being searched for TP can obtain this information and narrow down the search area to sections SEG1 to SEG4. For example, by searching sections SEG1 to SEG4, the family of the person being searched for TP can find TP in SEG4 early. As described above, the recording unit 104 records the sections in which the search for the target has been conducted based on periodic reports received within a predetermined time. Therefore, sections that have already been searched and sections that have not been searched can be easily distinguished by whether or not the search assistance vehicles V1 and V2 traveled within the predetermined time.

[0051] As explained above, this disclosure makes it possible to streamline searches by family members or others of missing persons. In the embodiments described above, an example was given in which the family of the person to be searched TP conducts the search, but the same can be applied when facility staff or others search for the missing person.

[0052] Furthermore, in comparison with Patent Document 1, the configuration of this disclosure allows for the use of general commercial vehicles and public transportation vehicles as the primary subjects of the search. Compared to the configuration in Patent Document 1, which primarily uses taxis and also provides protection, this disclosure has advantages such as eliminating the need for training taxi drivers and avoiding additional work. Moreover, while the configuration in Patent Document 1 may not be able to obtain cooperation from taxis in operation, this disclosure, since it basically only requires driving, has the potential to obtain cooperation from a variety of vehicles.

[0053] In the embodiments described above, the search data was explained as consisting of a search ID and feature quantities. However, since the feature quantities may potentially identify an individual, it is preferable that they be anonymized so that the search target cannot be identified. Such anonymization can be performed using methods such as homomorphic encryption.

[0054] [Second Embodiment] Next, a second embodiment will be described in which past images stored in the search cooperation vehicles are also included in the search. Figure 16 is a functional block diagram showing the configuration of the search support server 100a and the search cooperation vehicles 201a and 202a of this disclosure. The first difference from the first embodiment shown in Figure 8 is that the search cooperation vehicles 201a and 202a are provided with storage 211 and 212 for saving images taken by cameras, and the search cooperation vehicles 201a and 202a search for the person to be searched TP by also including past images. The second difference from the first embodiment shown in Figure 8 is that the search support server 100a receives discovery reports that also include past images and updates the search target management unit 107. The other configurations are almost the same as in the first embodiment, so the following will mainly describe the differences in operation.

[0055] The search assistance vehicles 201a and 202a are equipped with storage devices 211 and 212 that store images captured by cameras for a certain period of time. When the search assistance vehicles 201a and 202a receive search data from the search support server 100a, they search for the person to be searched for TP using the storage devices 211 and 212. The search assistance vehicles 201a and 202a do not need to search all the images in the storage devices 211 and 212; they only need to search for images from the date and time after which the missing person is estimated to have disappeared. For this reason, in this embodiment, it is preferable to ask for the date and time when the missing person is estimated to have disappeared when the search request is received, and to include this estimated date and time in the search data. As for the combination of storage devices 211 and 212 and cameras, a drive recorder and its camera can be used.

[0056] When the reception unit 103a of the search support server 100a receives a report from the search cooperation vehicles 201a and 202a that the person being searched for TP has been found, based on images recorded in storage devices 211 and 212, it requests the recording unit 104 to record the information.

[0057] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 17 is a diagram illustrating the operation of this disclosure. The operations from steps S001 to S004 in Figure 17 are the same as in the first embodiment, so their explanation will be omitted. The search cooperation vehicles 201a and 202a, having received the search data, check whether the person to be searched TP is captured in past images in the storage based on the search data (step S101). Although omitted in Figure 17, if the person to be searched TP is found at this point, the search cooperation vehicles 201a and 202a may report the discovery to the search support server 100a. After that, the search cooperation vehicles 201a and 202a start searching for the person to be searched TP based on the search data (step S005).

[0058] As explained above, this disclosure makes it possible to extend the scope of the search conducted by the search cooperation vehicles 201a and 202a in the past direction from the time of receipt of the search data.

[0059] The search assistance vehicles 201a and 202a described above are equipped with a receiving means for receiving a first feature quantity extracted from an image of the target of search from a computer constituting the search support system, and a function (storage) for storing images taken by the camera for a predetermined period of time. The search support server 100a described above will search the stored data of these search assistance vehicles 201a and 202a to see whether the target of search is captured in the stored images taken after the estimated time when the target of search went missing.

[0060] While the embodiments of this disclosure have been described above, this disclosure is not limited to the embodiments described above, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of this disclosure. For example, the network configurations, element configurations, and data representations shown in the drawings are examples to aid in understanding this disclosure and are not limited to the configurations shown in these drawings.

[0061] For example, the explanation assumed there were two vehicles assisting the investigation, but it is better to have many such vehicles. For instance, by adding various buses and administrative service vehicles as vehicles assisting the investigation, the search area can be expanded depending on the number of services and routes they take.

[0062] Furthermore, although not specifically described in the first and second embodiments described above, if the person being searched for TP is found safely based on information provided by the search support server, the operators of the search cooperation vehicles 201 to 202a may be given a predetermined incentive.

[0063] Furthermore, in the example shown in Figure 14, a map is presented showing the sections in which the search for the target was conducted by a search support vehicle (mobile unit) and the sections in which the search for the target was not conducted by a search support vehicle (mobile unit) (SEG1 to SEG6). However, these could also be presented as separate maps.

[0064] (Hardware Configuration) In each embodiment of this disclosure, each component of each device represents a functional unit block. Some or all of each component of each device is realized by any combination of an information processing device 900 and a program, for example, as shown in Figure 13. Figure 13 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration: ・CPU (Central Processing Unit) 901 ・ROM (Read Only Memory) 902 ・RAM (Random Access Memory) 903 ・Program 904 loaded into RAM 903 ・Storage device 905 that stores the program 904 ・Drive device 907 that reads and writes to the recording medium 906 ・Communication interface 908 that connects to a communication network 909 ・Input / output interface 910 that performs data input and output ・Bus 911 that connects each component

[0065] Each component of each device in each embodiment is realized when the CPU 901 acquires and executes a program 904 that realizes these functions. That is, the CPU 901 in Figure 18 executes a search data distribution program and a discovery report processing program, and performs update processing of each calculation parameter held in RAM 903, storage device 905, etc. The program 904 that realizes the functions of each component of each device is, for example, stored in advance in storage device 905 or ROM 902, and read by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via a communication network 909, or it may be stored in advance in a recording medium 906, and the drive device 907 may read the program and supply it to the CPU 901.

[0066] There are various variations in how each device is implemented. For example, each device may be implemented by any combination of a separate information processing device 900 and a program for each component. Alternatively, multiple components of each device may be implemented by any combination of a single information processing device 900 and a program. In other words, each part (processing means, function) of the search support server described above can be implemented by a computer program that causes a processor mounted on the device to execute the described processes using its hardware.

[0067] Furthermore, some or all of the components of each device are realized by other general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be made up of a single chip or multiple chips connected via a bus.

[0068] Some or all of the components of each device may be realized by a combination of the circuits and programs described above.

[0069] When some or all of the components of each device are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form in which each is connected via a communication network, such as a client-and-server system or a cloud computing system.

[0070] The embodiments described above are preferred embodiments of this disclosure and do not limit the scope of this disclosure to these embodiments alone. That is, a person skilled in the art can modify or substitute the embodiments described above to construct various modified forms without departing from the gist of this disclosure.

[0071] Some or all of the above embodiments may also be described as follows, but are not limited to these.

[0072] [Note 1] A search support system comprising: an acquisition means for acquiring feature quantities extracted from an image of the target to be searched as information on the target to be searched; a distribution means for distributing the feature quantities extracted from the image of the target to a mobile body that is equipped with a camera and an object matching function using the feature quantities and is cooperating in the search for the target to the mobile body; a reception means for receiving a report from the mobile body that includes information for identifying the location of the mobile body and whether or not an object matching the feature quantities extracted from the image of the target to be searched has been found; and a recording means for recording the section in which the mobile body has searched the target to be searched based on the report. [Note 2] The recording means of the search support system described above may be configured to create a map showing the section in which the mobile body has searched the target to be searched or the section in which the mobile body has not searched the target to be searched. [Note 3] The recording means of the search support system described above may be configured to record the section in which the target to be searched has been searched based on a report received within a predetermined time. [Note 4] In the search support system described above, the mobile body may further transmit a discovery report including location information and time information of the discovery of the object, and the search system may be configured to create a movement route of the target of search using the location information and time information included in a plurality of the discovery reports. [Note 5] The search support system described above may further include a search data creation means that issues a search ID to conceal the target of search, extracts feature quantities from an image of the target of search received from the user, and creates search data including the search ID and the feature quantities, and the distribution means may be configured to distribute the search data to mobile bodies cooperating in the search of the target of search, and receive discovery reports from the mobile bodies that identify the target of search using the search ID. [Note 6] Preferably, the search data created by the search support system described above is anonymized so that the target of search cannot be identified.[Note 7] In the search support system described above, the mobile body has a function to store images taken by the camera for a predetermined period of time, and the search support system can be configured to request the mobile body to search and report whether or not the subject of the search is captured in the stored images from the stored data taken after the estimated time when the subject of the search disappeared. [Note 8] A mobile body device comprising: receiving means for receiving a first feature quantity extracted from an image of the subject of the search from a computer constituting the search support system; storage means for storing images taken by a camera for a predetermined period of time; extraction means for extracting feature quantities of objects captured in the images stored in the storage means; determination means for determining whether or not the object of the search is captured in the storage means based on the first and second feature quantities; and transmitting means for transmitting the determination result to the computer along with information for identifying the position of the mobile body. [Note 9] The above-described mobile device is further equipped with a function (storage) for storing images taken by the camera for a predetermined period of time, and can be configured to search whether the subject of search is captured in the stored images taken after the time when the subject of search is estimated to have disappeared. [Note 10] A search support method comprising: obtaining feature quantities extracted from images of the subject of search as information about the subject of search; providing an object matching function using a camera and the feature quantities, distributing the feature quantities extracted from images of the subject of search to a mobile device cooperating in the search for the subject of search; receiving a report from the mobile device including information for identifying the mobile device's location and whether or not an object matching the feature quantities extracted from images of the subject of search has been found; and recording the section in which the mobile device searched for the subject of search based on the report. [Note 11] A search support method comprising: receiving a first feature quantity extracted from an image of the object to be searched from a computer constituting the search support system; extracting a second feature quantity of an object photographed by a camera; determining whether or not the object photographed by the camera is the object to be searched based on the first and second feature quantities; and transmitting the determination result, along with information for identifying the position of the moving object, to the computer.[Note 12] A recording medium that records a program that causes a computer to execute the following: a process of acquiring feature quantities extracted from an image of the target to be searched as information about the target to be searched; a process of distributing the feature quantities extracted from the image of the target to a mobile body that is equipped with a camera and an object matching function using the feature quantities and cooperates in the search for the target to be searched; a process of receiving a report from the mobile body that includes information for identifying the location of the mobile body and whether or not an object matching the feature quantities extracted from the image of the target to be searched has been found; and a process of recording the section in which the mobile body searched for the target to be searched based on the report. [Note 13] A recording medium that records a program that causes a computer to execute the following: a process of receiving a first feature quantity extracted from an image of the target to be searched from a computer constituting a search support system; a process of extracting a second feature quantity from an object photographed by a camera; a process of determining whether or not the object photographed by the camera is the target to be searched based on the first and second feature quantities; and a process of transmitting the determination result along with information for identifying the location of the mobile body to the computer. Furthermore, the forms described in each of the above appendices can be combined with each other after making the necessary modifications. For example, a configuration that combines the contents described in appendice 2 and the contents described in appendice 3 is also included within the scope of disclosure of this specification. In this case, the search support system will create a map showing the section in which the mobile body has searched for the target or the section in which the mobile body has not searched for the target, based on reports received within a predetermined time. Furthermore, the forms described in appendices 9 and 11 can be expanded into the forms described in appendices 2 to 8, similar to appendice 1.

[0073] Furthermore, each disclosure in the above-mentioned patent documents is incorporated into this document by reference and may be used as the basis or part of this disclosure as necessary. Within the framework of this disclosure (including the claims), further modifications and adjustments to the embodiments or examples are possible based on their fundamental technical concept. Also, within the framework of this disclosure, various combinations or selections (including partial deletions) of various disclosure elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, this disclosure naturally includes the entire disclosure, including the claims, and various modifications and alterations that a person skilled in the art could make in accordance with the technical concept. In particular, with respect to the numerical ranges described in this document, any numerical value or sub-range included within that range should be interpreted as being specifically described, even if not otherwise stated. Furthermore, each disclosure item of the above-mentioned cited documents may, as necessary, be used in part or in whole as part of this disclosure, in accordance with the spirit of this disclosure, and this is also considered to be included in the disclosure items of this application.

[0074] 10 Search support system 11 Acquisition means 12 Distribution means 13 Reception means 14 Recording means 21 Receiving means 22 Extraction means 23 Judgment means 24 Transmission means 100 Search support server 201, 202 Search cooperation vehicle 101 Search data generation unit 102 Distribution unit 103, 103a Reception unit 104 Recording unit 105 Search request reception unit 106 Search range recording unit 107 Search target management unit 108 Notification unit 211, 212 Storage 201, 202, 201a, 202a Search cooperation vehicle 400, 500 Terminal 900 Information processing device 901 CPU (Central Processing Unit) 902 ROM (Read Only) Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording medium 907 Drive device 908 Communication interface 909 Communication network 910 Input / output interface 911 Bus MO, MO1, MO2 Mobile device SEG Section ST Search target TP Person being searched for

Claims

1. A search support system comprising: an acquisition means for acquiring feature quantities extracted from an image of the target to be searched as information on the target to be searched; a distribution means for distributing the feature quantities extracted from the image of the target to a mobile body that is equipped with a camera and an object matching function using the feature quantities and is cooperating in the search for the target to be searched; a reception means for receiving a report from the mobile body that includes information for identifying the location of the mobile body and whether or not an object matching the feature quantities extracted from the image of the target to be searched has been found; and a recording means for recording the section in which the mobile body searched for the target to be searched based on the report.

2. The search support system according to claim 1, wherein the recording means creates a map showing the section in which the mobile body has searched for the target of search or the section in which the mobile body has not searched for the target of search.

3. The search support system according to claim 1 or 2, wherein the recording means records the section in which the search for the target of the search was conducted based on a report received within a predetermined time.

4. The search support system according to any one of claims 1 to 3, wherein the mobile body further transmits a discovery report including location information and time information of the discovery of the object, and the search system uses the location information and time information included in a plurality of the discovery reports to create a movement path for the object to be searched.

5. A search support system according to any one of claims 1 to 4, further comprising: a search ID for concealing the target of search; a search data creation means for extracting feature quantities from an image of the target of search received from the user and creating search data including the search ID and the feature quantities; a distribution means for distributing the search data to a mobile body cooperating in the search for the target of search; and receiving a discovery report from the mobile body that identifies the target of search using the search ID.

6. The search support system according to claim 5, wherein the search data is anonymized so that the search target cannot be identified.

7. A search support system according to any one of claims 1 to 6, wherein the mobile body has a function to store images taken by the camera for a predetermined period of time, and requests the mobile body to search and report whether or not the subject of the search is captured in the stored images from the time after which the subject of the search is estimated to have disappeared.

8. A mobile device comprising: receiving means for receiving a first feature quantity extracted from an image of a target for search from a computer constituting a search support system; extraction means for extracting a second feature quantity from an object photographed by a camera; determination means for determining whether or not the object photographed by the camera is the target for search based on the first and second feature quantities; and transmitting means for transmitting the determination result, along with information for identifying the position of the mobile device, to the computer.

9. The mobile device according to claim 8, further comprising a function to store images taken by the camera for a predetermined period of time, and searching the stored data to determine whether or not the subject of the search is captured in the stored images taken after the estimated time when the subject of the search disappeared.

10. A search support method comprising: obtaining feature quantities extracted from an image of the target to be searched as information on the target to be searched; distributing the feature quantities extracted from the image of the target to a mobile body that is equipped with a camera and an object matching function using the feature quantities and is cooperating in the search for the target; receiving a report from the mobile body that includes information for identifying the mobile body's position and whether or not an object matching the feature quantities extracted from the image of the target to be searched has been found; and recording the section in which the mobile body searched for the target based on the report.

11. A search support method comprising: receiving a first feature quantity extracted from an image of the object to be searched from a computer constituting a search support system; extracting a second feature quantity from an object photographed by a camera; determining whether or not the object photographed by the camera is the object to be searched based on the first and second feature quantities; and transmitting the determination result, along with information for identifying the location of the moving object, to the computer.

12. A recording medium that records a program causing a computer to execute the following: a process for acquiring feature quantities extracted from an image of the target to be searched as information about the target to be searched; a process for distributing the feature quantities extracted from the image of the target to a mobile device that is equipped with a camera and an object matching function using the feature quantities and is cooperating in the search for the target; a process for receiving a report from the mobile device that includes information for identifying the location of the mobile device and whether or not an object matching the feature quantities extracted from the image of the target to be searched has been found; and a process for recording the section in which the mobile device searched for the target based on the report.

13. A recording medium that records a program causing a computer to execute the following: a process of receiving a first feature quantity extracted from an image of the object to be searched from a computer constituting a search support system; a process of extracting a second feature quantity from an object photographed by a camera; a process of determining whether or not the object photographed by the camera is the object to be searched based on the first and second feature quantities; and a process of transmitting the determination result, along with information for identifying the location of a moving object, to the computer.

Images