Unmanned aerial vehicle, guidance support device, guidance support system, guidance support method, and program

Abstract

The present invention provides a mechanism for guiding a person to a correct destination with an unmanned aerial vehicle. An acquisition unit (11) acquires an image taken at a place of departure, an identification unit (12) identifies a person appearing in the image, a specification unit (13) specifies a destination of the identified person, and a guidance unit (14) causes an unmanned aerial vehicle to guide the person toward the destination.

Description

[Technical Field]

[0001] The present invention relates to an unmanned aerial vehicle, a guidance support device, a guidance support system, a guidance support method, and a recording medium, and more particularly to an unmanned aerial vehicle, a guidance support device, a guidance support system, a guidance support method, and a recording medium that safely guide people. [Background technology]

[0002] When a natural or man-made disaster occurs, or when there is a risk of a disaster occurring, local governments and other organizations utilize their disaster prevention organizations to carry out disaster prevention activities to reduce damage caused by the disaster. Disaster prevention activities include checking the safety of residents and guiding them. In the event of a natural disaster such as an earthquake or river flooding, it is necessary to quickly guide people to safe evacuation shelters such as high ground.

[0003] In recent years, autonomous mobile devices (hereinafter referred to as unmanned aerial vehicles), such as drones and walking robots, have been used to guide people to evacuate. For example, unmanned aerial vehicles are flown to disaster sites to restrict public access and to warn people who enter the site.

[0004] In a related technology described in Patent Document 1, multiple unmanned aerial vehicles form a predetermined formation and guide people seeking evacuation to an evacuation shelter.

[0005] In the related technology described in Patent Document 2, a management device determines whether a person can pass through a dangerous area based on the situation of the dangerous area. If it determines that passing through the dangerous area is difficult, it sends guidance instructions to multiple unmanned aerial vehicles. The multiple unmanned aerial vehicles follow the guidance instructions and warn people heading toward the dangerous area. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent No. 6670065 [Patent Document 2] Patent Publication No. 2021-135875 Summary of the Invention [Problem to be solved by the invention]

[0007] In the related technology described in Patent Document 1, the person requesting the drone cannot know whether the drone was able to correctly guide the person to the evacuation shelter.

[0008] The present invention solves the above-mentioned problems, and its purpose is to provide a mechanism for guiding a person to the correct destination using an unmanned aerial vehicle. [Means for solving the problem]

[0009] A guidance support device according to one embodiment of the present invention includes an acquisition means for acquiring an image taken at a starting point, an identification means for identifying a person appearing in the image, an identification means for identifying the destination of the identified person, and a guidance means for directing the person to the destination and having a drone guide the person.

[0010] In one aspect of the present invention, a guidance support method involves a computer acquiring an image taken at a starting point, identifying a person appearing in the image, determining the destination of the identified person, heading to the destination, and having a drone guide the person.

[0011] A recording medium according to one aspect of the present invention stores a program for causing a computer to acquire an image taken at a departure point, identify a person appearing in the image, determine the destination of the identified person, and direct the person to the destination using an unmanned aircraft.

[0012] A guidance support system according to one embodiment of the present invention includes a guidance support device having an acquisition means for acquiring an image taken at a departure point, an identification means for identifying a person appearing in the image, an identification means for specifying the destination of the identified person, and a guidance means for directing the person to the destination and having a drone guide the person, a communication device used to control the operation of the drone, and a request information database in which request information indicating the content of requests regarding the guidance of the person is stored. [Effects of the Invention]

[0013] According to one aspect of the present invention, a mechanism can be provided for guiding a person to the correct destination using an unmanned aerial vehicle. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a diagram schematically illustrating an example of the configuration of a guidance support system including a guidance support device according to any one of first to third embodiments. [Figure 2] 1 is a block diagram showing a configuration of a guidance support device according to a first embodiment. [Figure 3] 4 is a flowchart showing the operation of the guidance support device according to the first embodiment. [Figure 4] FIG. 10 is a block diagram showing the configuration of a guidance support device according to a second embodiment. [Figure 5] FIG. 10 is a block diagram showing the configuration of a guidance support device according to a third embodiment. [Figure 6] FIG. 10 is a first flowchart showing the operation of the guidance support device according to the third embodiment. [Figure 7] FIG. 2 is a second diagram of the flowchart showing the operation of the guidance support device according to the third embodiment. [Figure 8] 1 is a diagram illustrating an example of a hardware configuration of a guidance support device according to any one of the first to third embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0015] Some embodiments of the present invention are described below with reference to the drawings.

[0016] (Guidance Support System 1) An example of the configuration of a guidance support system 1 including any one of guidance support devices 10, 20, and 30 according to embodiments 1 to 3 will be described first with reference to Fig. 1. In Fig. 1, "guidance support device 10 (20, 30)" refers to any one of the guidance support devices 10, 20, and 30 according to embodiments 1 to 3.

[0017] 1, the guidance support system 1 includes a communication device 100, a requester terminal 200, a request information database 300, and a drone (unmanned aerial vehicle) 400. Except for the request information database 300, each component of the guidance support system 1 may be provided in plural.

[0018] Communication device 100 is placed at a predetermined location. The predetermined location is determined by an administrator of unmanned aerial vehicle 400. The administrator may be, for example, a local government, a fire department, a police department, a school, or another organization. The administrator may also be a corporation such as a travel agency, a cram school, or a security company.

[0019] The communication device 100 is, for example, a wireless device, an IoT device, a Wi-Fi (registered trademark) device, or a smartphone. The communication device 100 may also be any other communication device. The communication device 100 is used to control the operation of the unmanned aerial vehicle 400. The communication device 100 is controlled by the guidance support device 10 (20, 30) via the Internet.

[0020] The requester terminal 200 is used by the requester. The requester uses the requester terminal 200 to register a request to guide a person using the unmanned aerial vehicle 400 in the request information database 300 along with basic information about the requester, such as the requester's contact information. The requester may register the request information in the request information database 300 via a web request or an application. If the person to be guided is a person in need of support, the requester may be a designated supporter. Supporters include local government officials, fire brigade members, citizen volunteers, and other related parties.

[0021] The requests registered in the request information database 300 are executed by the guidance support device 10 (20, 30). Note that the target of guidance may be a person different from the requester, or may be the requester himself / herself.

[0022] For example, a local government (an example of a requester) can request the guidance support device 10 (20, 30) to guide residents from their homes to evacuation shelters. Alternatively, a travel agency (another example of a requester) can request the guidance support device 10 (20, 30) to guide tourists from a meeting place to a tourist spot.

[0023] The request information database 300 stores request information assigned a request ID. The request information indicates the content of a request regarding the guidance of a person. The request information includes location information indicating the destination of the guidance. The request information may also include information indicating at least one of the meeting place, meeting time, stopovers, and arrival destination. In addition, the request information may include the attributes and preferences of the person to be guided. Attributes refer to the age, sex, nationality, physical disability, chronic illness, or whether or not the person has family or cohabitants, etc.

[0024] The request information database 300 also stores basic information such as the name, address (current location), and contact information of the person to be guided, as well as facial feature data of the person to be guided. The facial feature data of the person to be guided is used by the guidance support devices 10, 20, and 30 to identify the person.

[0025] If the person to be guided is a person requiring support, an evacuation plan for the person requiring support may be stored as request information in the request information database 300. The evacuation plan indicates information for carrying out evacuation. The evacuation plan includes determining an evacuation shelter and evacuation route for the person requiring support in the event of a disaster, and identifying dangerous areas on the way to the evacuation shelter.

[0026] Unmanned aerial vehicle 400 receives a wireless signal from communication device 100 and moves according to instructions contained in the wireless signal. Unmanned aerial vehicle 400 is not limited to a drone, but may be a small unmanned aerial vehicle or a walking robot. Alternatively, unmanned aerial vehicle 400 may be another machine such as an unmanned driver.

[0027] In addition to a mobile device, the unmanned aerial vehicle 400 is equipped with at least a camera and a speaker. Video data captured by the camera is transmitted to the guidance support device 10 (20, 30) via wireless and the Internet. The speaker also receives audio data from the guidance support device 10 (20, 30) via wireless and the Internet. The unmanned aerial vehicle 400 may also be equipped with the guidance support devices 10, 20, and 30. In this case, a processor and control circuit included in the unmanned aerial vehicle 400 realize functions corresponding to the respective components of the guidance support devices 10, 20, and 30 described below. The unmanned aerial vehicle 400 may also be equipped with an image acquisition means for acquiring an image of a person at a departure point, a destination information acquisition means for acquiring destination information indicating a destination identified by identifying a person appearing in the image, and a person guidance means for guiding the person to the destination based on the destination information.

[0028] The guidance support devices 10, 20, and 30 will be described in the first to third embodiments below.

[0029] [Embodiment 1] The first embodiment will be described with reference to FIGS.

[0030] (Guidance support device 10) The configuration of the guidance support device 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the guidance support device 10. As shown in Fig. 2, the guidance support device 10 includes an acquisition unit 11, an identification unit 12, an identification unit 13, and a guidance unit 14.

[0031] The acquisition unit 11 acquires images taken at the departure point. The acquisition unit 11 is an example of an acquisition means.

[0032] In one example, the acquisition unit 11 acquires, via wireless communication and the Internet, video data captured by a camera of the unmanned aerial vehicle 400. The acquisition unit 11 acquires location information of the unmanned aerial vehicle 400 from a positioning system such as a GPS (Global Positioning System).

[0033] When the drone 400 is at the departure point, the acquisition unit 11 may use the communication device 100 to remotely control the drone 400 to cause the camera of the drone 400 to take photographs.

[0034] The starting point is the point from which guidance of a person begins by unmanned aerial vehicle 400. For example, the starting point is the home of the person to be guided, a tourist gathering place, an evacuation shelter in the event of a disaster, or the current location of the person to be guided.

[0035] The acquisition unit 11 outputs the image data captured at the departure point to the recognition unit 12.

[0036] The identification unit 12 identifies a person appearing in an image. The identification unit 12 is an example of an identification means.

[0037] In one example, the identification unit 12 receives image data captured at the departure point from the acquisition unit 11. The identification unit 12 analyzes the received image data to detect a person appearing in the image. The identification unit 12 also extracts the facial area of ​​the detected person from the image.

[0038] Next, the classification unit 12 extracts features of the person's face from the area of ​​the person's face in the image. At this time, the classification unit 12 may use a general face classification technique in the field of machine learning technology.

[0039] The identification unit 12 refers to the facial feature data of a person stored in the desired information database 300 (FIG. 1). Then, the identification unit 12 compares the facial feature data of the person stored in the desired information database 300 (FIG. 1) with the feature data extracted from the facial area of ​​the person in the image. If the compared feature data are similar, the identification unit 12 identifies the person in the image as a person to be guided who is registered in the desired information database 300 (FIG. 1).

[0040] After identifying the person appearing in the image, the identification unit 12 outputs information indicating the identified person to the specification unit 13. For example, the information indicating the identified person is a request ID registered in the request information database 300.

[0041] The identification unit 13 identifies the destination of the identified person. The identification unit 13 is an example of an identification means.

[0042] In one example, the identification unit 13 receives information indicating the person identified by the identification unit 12. The identification unit 13 acquires request information stored in the request information database 300 using the information indicating the identified person (e.g., a request ID). The request information includes location information indicating the destination of guidance. The identification unit 13 identifies the person's destination from the request information.

[0043] The identification unit 13 outputs information indicating the destination of the person to the guiding unit 14.

[0044] The guidance unit 14 guides the person to the destination and causes the unmanned aerial vehicle 400 to guide the person. The guidance unit 14 is an example of a guidance means.

[0045] In one example, the guiding unit 14 receives information indicating the person's destination from the identification unit 13. The guiding unit 14 acquires map data including the area from the departure point to the destination from a map database (not shown). The guiding unit 14 determines a travel route from the departure point to the destination using the map data and the information indicating the person's destination. The guiding unit 14 controls the communication device 100 (FIG. 1) to move the unmanned aerial vehicle 400 toward the destination along the determined travel route. Alternatively, the guiding unit 14 transmits destination information indicating the person's destination to the unmanned aerial vehicle 400. The destination information acquisition means of the unmanned aerial vehicle 400 receives the destination information indicating the person's destination. Then, the person guiding means of the unmanned aerial vehicle 400 guides the person toward the destination based on the destination information. Alternatively, the guiding unit 14 transmits information regarding the determined travel route (travel route information) to the unmanned aerial vehicle 400, and the destination information acquisition means of the unmanned aerial vehicle 400 receives the travel route information. The person guidance means of the unmanned aerial vehicle 400 may guide the person based on the received travel path information.

[0046] While the unmanned aerial vehicle 400 is guiding a person, the guidance unit 14 may cause the unmanned aerial vehicle 400 to perform various operations to ensure that the person is guided by the unmanned aerial vehicle 400 (embodiment 2).

[0047] While the person is being guided by the unmanned aerial vehicle 400, the guidance unit 14 continuously acquires location information of the unmanned aerial vehicle 400 from a GPS receiver mounted on the unmanned aerial vehicle 400. When the unmanned aerial vehicle 400 arrives at the destination, the guidance unit 14 completes the guidance of the person by the unmanned aerial vehicle 400. If the request information includes information indicating the attributes of the person to be guided, the guidance unit 14 can determine a travel route taking into account the attributes of the person to be guided. For example, if the person to be guided is elderly, the guidance unit 14 selects a travel route with fewer slopes from among several candidate travel routes.

[0048] (Operation of the guidance support device 10) The operation of the guidance support device 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of processing executed by each unit of the guidance support device 10.

[0049] 3, the acquisition unit 11 acquires an image taken at the departure point (S1). The acquisition unit 11 outputs the image data taken at the departure point to the recognition unit 12.

[0050] Next, the identification unit 12 identifies the person appearing in the image (S2). After identifying the person appearing in the image, the identification unit 12 outputs information indicating the identified person to the identification unit 13.

[0051] The identification unit 13 identifies the destination of the identified person (S3), and outputs information indicating the destination of the person to the guiding unit 14.

[0052] Based on the information indicating the person's destination, the guiding unit 14 determines a route for the unmanned aerial vehicle 400 from the departure point to the destination. The guiding unit 14 then controls the communication device 100 (FIG. 1) to cause the unmanned aerial vehicle 400 to guide the person toward the destination (S4).

[0053] This completes the operation of the guidance support device 10 according to the first embodiment. Note that the target of guidance by the guidance support device 10 is not limited to one person. The guidance support device 10 may also guide a group of people who want to go to the same destination. In this case, the guidance unit 14 matches the destinations of multiple people and groups people who are going to the same destination into one group. Thereafter, the guidance unit 14 guides each group toward the destination of the people included in the group.

[0054] (Effects of this embodiment) According to the configuration of this embodiment, the acquisition unit 11 acquires an image taken at a departure point. The identification unit 12 identifies a person appearing in the image. The specification unit 13 specifies the destination of the identified person. The guidance unit 14 causes the drone 400 to guide the person toward the destination.

[0055] The person acts according to the guidance of the unmanned aerial vehicle 400. Even if the person does not know the route from the departure point to the destination, or if the person is in an unfamiliar location, the person can arrive at their destination without getting lost. Furthermore, because the person is identified before guidance, there is a low possibility that another person's destination will be mistakenly identified. This allows the person to be reliably guided by the unmanned aerial vehicle 400. In this way, the guidance support device 10 can support people in moving safely to their destination.

[0056] [Embodiment 2] A second embodiment will be described with reference to Fig. 4. In the second embodiment, the same reference numerals as those in the first embodiment are used for components that execute the same processes as those in the first embodiment, and descriptions of those components will be omitted.

[0057] In the second embodiment, a configuration will be described in which unmanned aerial vehicle 400 (FIG. 1) is made to perform various operations in order to reliably guide a person.

[0058] (Guidance support device 20) The configuration of the guidance support device 20 according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the guidance support device 20. As shown in Fig. 4, the guidance support device 20 includes an acquisition unit 11, an identification unit 12, an identification unit 13, and a guidance unit 14'. The guidance unit 14' of the guidance support device 20 partially differs in processing from the guidance unit 14 of the guidance support device 10 (Fig. 2) according to the first embodiment.

[0059] Like the guidance unit 14, the guidance unit 14' heads toward the destination and has the drone 400 guide the person. While the drone 400 is guiding the person, the guidance unit 14' continuously acquires location information of the drone 400 from a GPS receiver attached to the drone 400.

[0060] Furthermore, the guidance unit 14' causes the drone 400 (FIG. 1) to perform various operations in order to reliably guide the person using the drone 400. Specifically, while the guidance unit 14' is guiding the person using the drone 400, the guidance unit 14' analyzes images captured by the camera of the drone 400 to detect dangerous points.

[0061] The guidance unit 14' then determines a route for guiding the unmanned aerial vehicle 400 so as to avoid the detected dangerous points. To detect dangerous points, the guidance unit 14' can use related technologies such as crack detection in concrete roads, obstacle detection, or flood detection. Furthermore, the guidance unit 14' may detect dangerous points using road surface condition determination technology in the technical field of autonomous driving.

[0062] When the guiding unit 14' detects a dangerous point, it modifies the route (hereinafter referred to as the evacuation route) to be guided by the unmanned aerial vehicle 400. That is, the guiding unit 14' determines whether the determined evacuation route passes through the dangerous point. When the determined evacuation route passes through the dangerous point, the guiding unit 14' modifies the evacuation route so as to avoid the dangerous point.

[0063] Also, while the person is being guided by the unmanned aerial vehicle 400, the guiding unit 14' calls out to the person to move to the destination from a speaker of the unmanned aerial vehicle 400. For example, the guiding unit 14' controls the communication device 100 (FIG. 1) to output voice data for guidance to the speaker of the unmanned aerial vehicle 400. Note that the guiding unit 14' may generate voice data and transmit the generated voice data to the communication device 100, or the voice data may be stored in advance in a memory unit (not shown) of the unmanned aerial vehicle 400. Also, the guidance unit 14' provides the requester with video of the surroundings and person captured by the unmanned aerial vehicle 400 while the unmanned aerial vehicle 400 is guiding the person. For example, the guidance unit 14' directly or indirectly acquires video data captured by the camera of the unmanned aerial vehicle 400 from the unmanned aerial vehicle 400. The guidance unit 14' then transfers the video data acquired from the unmanned aerial vehicle 400 to the requester terminal 200 (Figure 1). In addition, the guidance unit 14' accepts requests such as speaking to the person from the requester. The guidance unit 14' then speaks to the person using a speaker while the unmanned aerial vehicle 400 is guiding the person.

[0064] When the unmanned aerial vehicle 400 arrives at the destination, the guidance unit 14' completes the guidance of the person by the unmanned aerial vehicle 400. The guidance unit 14' may then determine whether the guidance of the person by the unmanned aerial vehicle 400 was successful (embodiment 3).

[0065] (Operation of the guidance support device 20) The basic operation of the guidance support device 20 according to the present embodiment 2 is the same as the operation of the guidance support device 10 according to the above-described embodiment 1 (FIG. 3). A description of the operation of the guidance support device 20 according to the present embodiment will be omitted here.

[0066] (Effects of this embodiment) According to the configuration of this embodiment, the acquisition unit 11 acquires an image taken at a departure point. The identification unit 12 identifies a person appearing in the image. The specification unit 13 specifies the destination of the identified person. The guidance unit 14' causes the drone 400 to guide the person toward the destination.

[0067] The person acts according to the guidance of the unmanned aerial vehicle 400. Even if the person does not know the route from the departure point to the destination, or if the person is in an unfamiliar location, the person can arrive at their destination without getting lost. Furthermore, because the person is identified before guidance, there is a low possibility that the destination of another person will be mistakenly identified. This allows the unmanned aerial vehicle 400 to reliably guide the person.

[0068] Furthermore, according to the configuration of this embodiment, while the person is being guided by the unmanned aerial vehicle 400, the guiding unit 14' calls out to the person from the speaker of the unmanned aerial vehicle 400 to move to the destination.

[0069] Also, while the person is being guided by the unmanned aerial vehicle 400, the guidance unit 14' analyzes images captured by the camera of the unmanned aerial vehicle 400 to detect dangerous points and determines a route for guidance by the unmanned aerial vehicle 400 so as to avoid the detected dangerous points. This allows the person to be reliably guided by the unmanned aerial vehicle 400 while avoiding the person passing through the dangerous points.

[0070] [Embodiment 3] A third embodiment will be described with reference to Figures 5 to 7. In the third embodiment, the same reference numerals as those in the first or second embodiment are used for components that execute the same processes as those in the first or second embodiment, and the description of these components will be omitted.

[0071] In this third embodiment, a configuration will be described in which, when the unmanned aerial vehicle 400 arrives at the destination, it is determined whether or not the unmanned aerial vehicle 400 has successfully guided a person.

[0072] (Guidance support device 30) The configuration of a guidance support device 30 according to the third embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the guidance support device 30. As shown in Fig. 5, the guidance support device 30 includes an acquisition unit 11, an identification unit 12, an identification unit 13, and a guidance unit 14. The guidance support device 30 further includes a reporting unit 35. The guidance support device 30 may include the guidance unit 14' (Fig. 4) described in the second embodiment, instead of the guidance unit 14.

[0073] If the guidance unit 14 succeeds in guiding the person using the unmanned aerial vehicle 400 (Figure 1), the reporting unit 35 reports to the requester that the guidance of the person has been completed. On the other hand, if the guidance unit 14 fails to guide the person using the unmanned aerial vehicle 400, the reporting unit 35 notifies the requester. The reporting unit 35 is an example of a reporting means. Here, successful guidance of the person means that the person has arrived at the destination. On the other hand, failure to guide the person means that the person has not arrived at the destination when the unmanned aerial vehicle 400 arrives at the destination.

[0074] In one example, after the drone 400 arrives at the destination, the acquisition unit 11 acquires a second image taken at the destination. In the third embodiment, the image taken at the departure point is called a first image to distinguish it from the second image taken at the destination.

[0075] The acquisition unit 11 outputs the second image data taken at the destination to the recognition unit 12.

[0076] The recognition unit 12 receives second image data captured at the destination from the acquisition unit 11. The recognition unit 12 recognizes people appearing in the second image. At this time, the recognition unit 12 uses the related recognition technology exemplified in the first embodiment.

[0077] The identification unit 12 outputs information indicating the person identified in the second image to the guiding unit 14. For example, the information indicating the identified person is a request ID registered in the request information database 300. If there is no person in the second image, or if the person in the second image is not a target person for guidance, the identification unit 12 outputs null data to the guiding unit 14.

[0078] The guiding unit 14 receives information indicating the person identified in the second image taken at the destination from the identification unit 12. Based on the identification result of the person appearing in the second image, the guiding unit 14 determines whether or not the unmanned aerial vehicle 400 has successfully guided the person.

[0079] Specifically, after the identification unit 12 identifies the person in the second image, the guiding unit 14 determines whether the person in the first image and the person in the second image are the same. For example, the guiding unit 14 determines whether the information indicating the person in the first image and the information indicating the person in the second image are the same.

[0080] In addition, if there is no person in the second image, or if the person in the second image is not the person to be guided, the guidance unit 14 determines that the person in the first image and the person in the second image are not the same person.

[0081] If the person shown in the first image and the person shown in the second image are the same, the guiding unit 14 determines that the drone 400 has successfully guided the person. On the other hand, if the person shown in the first image and the person shown in the second image are not the same, the guiding unit 14 determines that the drone 400 has failed to guide the person.

[0082] The guiding unit 14 outputs to the reporting unit 35 a determination result indicating whether or not the unmanned aerial vehicle 400 has been successful in guiding the person.

[0083] If the guidance unit 14 is successful in guiding the person using the unmanned aerial vehicle 400 (FIG. 1), the reporting unit 35 reports to the requester that the guidance of the person has been completed. On the other hand, if the guidance unit 14 is unsuccessful in guiding the person using the unmanned aerial vehicle 400, the reporting unit 35 notifies the requester. For example, the reporting unit 35 refers to the basic information of the requester stored in the request information database 300. The reporting unit 35 reports or notifies the requester using the contact information of the requester included in the basic information of the requester.

[0084] (Operation of the guidance support device 30) The operation of the guidance support device 30 according to the third embodiment will be described with reference to Fig. 6 and Fig. 7. Fig. 6 and Fig. 7 are flowcharts showing the flow of processing executed by each unit of the guidance support device 30.

[0085] 6, the acquisition unit 11 acquires a first image taken at the departure point (S301). The acquisition unit 11 outputs the first image data taken at the departure point to the recognition unit 12.

[0086] Next, the identification unit 12 identifies the person appearing in the first image (S302). After identifying the person appearing in the first image, the identification unit 12 outputs information indicating the identified person to the identification unit 13.

[0087] The identification unit 13 identifies the destination of the identified person (S303). The identification unit 13 outputs information indicating the destination of the person to the guiding unit .

[0088] Based on the information indicating the person's destination, the guiding unit 14 determines a route for the unmanned aerial vehicle 400 from the departure point to the destination. The guiding unit 14 then controls the communication device 100 (FIG. 1) to cause the unmanned aerial vehicle 400 to guide the person toward the destination (S304).

[0089] After unmanned aerial vehicle 400 arrives at the destination (Yes in S305), the flow proceeds to step S306 in FIG.

[0090] 7, after the unmanned aerial vehicle 400 arrives at the destination, the acquisition unit 11 acquires a second image taken at the destination (S306). The acquisition unit 11 outputs the second image data taken at the destination to the classification unit 12.

[0091] The recognition unit 12 recognizes the person appearing in the second image (S307). The recognition unit 12 outputs information indicating the person appearing in the second image (for example, a desired ID) to the guiding unit .

[0092] The guiding unit 14 receives information indicating the person identified in the second image taken at the destination from the identification unit 12. Based on the identification result of the person appearing in the second image, the guiding unit 14 determines whether or not the person has been successfully guided by the unmanned aerial vehicle 400 (S308).

[0093] The guiding unit 14 outputs to the reporting unit 35 a determination result indicating whether or not the unmanned aerial vehicle 400 has been successful in guiding the person.

[0094] If the unmanned aerial vehicle 400 is successful in guiding the person (Yes in S308), the reporting unit 35 reports to the requester that the person has been guided (S309A). On the other hand, if the unmanned aerial vehicle 400 fails to guide the person (No in S308), the reporting unit 35 notifies the requester (S309B).

[0095] This completes the operation of the guidance support device 30 according to the third embodiment.

[0096] (Effects of this embodiment) According to the configuration of this embodiment, the acquisition unit 11 acquires a first image taken at a departure point. The identification unit 12 identifies a person appearing in the first image. The specification unit 13 specifies the destination of the identified person. The guidance unit 14 causes the drone 400 to guide the person toward the destination.

[0097] The person acts according to the guidance of the unmanned aerial vehicle 400. Even if the person does not know the route from the departure point to the destination, or if the person is in an unfamiliar location, the person can arrive at their destination without getting lost. Furthermore, because the person is identified before guidance, there is a low possibility that the destination of another person will be mistakenly identified. This allows the unmanned aerial vehicle 400 to reliably guide the person.

[0098] Furthermore, according to the configuration of this embodiment, after the unmanned aerial vehicle 400 arrives at the destination, the acquisition unit 11 acquires a second image taken at the destination. The identification unit 12 identifies the person appearing in the second image. The guidance unit 14 determines whether the unmanned aerial vehicle 400 has successfully guided the person based on the identification result of the person appearing in the second image. If the unmanned aerial vehicle 400 has successfully guided the person, the reporting unit 35 reports to the requester that guidance of the person has been completed, and if the unmanned aerial vehicle 400 has failed to guide the person, the reporting unit 35 notifies the requester. This enables the requester to more reliably understand the situation of the person being guided and to more quickly assist or rescue the person being guided.

[0099] (About hardware configuration) Each of the components of the guidance support devices 10, 20, and 30 described in the first to third embodiments is represented by a functional block. Some or all of these components are realized by an information processing device 900 as shown in Fig. 8. Fig. 8 is a block diagram showing an example of the hardware configuration of the information processing device 900.

[0100] As shown in FIG. 8, the information processing device 900 includes, for example, the following configuration.

[0101] ·CPU(Central Processing Unit)901 ROM (Read Only Memory) 902 ·RAM(Random Access Memory)903 Program 904 loaded into RAM 903 A storage device 905 for storing a program 904 A drive device 907 for reading and writing data from and to the recording medium 906 A communication interface 908 for connecting to a communication network 909 Input / output interface 910 for inputting and outputting data Bus 911 connecting each component Each of the components of the guidance support devices 10, 20, and 30 described in the first to third embodiments is realized by the CPU 901 reading and executing a program 904 that realizes the functions of the components. The program 904 that realizes the functions of the components is stored, for example, in advance in the storage device 905 or the ROM 902, and is loaded into the RAM 903 and executed by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via the communication network 909, or may be stored in advance in the recording medium 906, and the drive device 907 may read out the program and supply it to the CPU 901.

[0102] According to the above configuration, the guidance support devices 10, 20, and 30 described in the first to third embodiments are realized as hardware, and therefore, the same effects as those described in any of the first to third embodiments can be achieved.

[0103] [Note] One aspect of the present invention can be described as, but is not limited to, the following supplementary notes.

[0104] (Appendix 1) an acquisition means for acquiring an image taken at a departure point; an identification means for identifying a person appearing in the image; Identification means for identifying a destination of the identified person; Guidance means for guiding the person to the destination by the drone; A guidance support device equipped with

[0105] (Appendix 2) The identification means acquiring request information indicating a request for guidance of the identified person; Identifying the destination of the person based on the request information 2. A guidance support device according to claim 1.

[0106] (Appendix 3) The request information includes information indicating at least one of a meeting place, a meeting time, a stopover point, and a destination point of the person. 3. The guidance support device according to claim 2,

[0107] (Appendix 4) The identification means identifies the face of a person appearing in the image. 2. A guidance support device according to claim 1.

[0108] (Appendix 5) The guiding means calls for movement to the destination from a speaker of the unmanned aerial vehicle while the unmanned aerial vehicle is guiding the person. 5. A guidance support device according to any one of claims 1 to 4.

[0109] (Appendix 6) The guiding means, while guiding the person by the unmanned aerial vehicle, Analyzing images taken by the camera of the drone to detect dangerous locations; A route for guidance by the unmanned aerial vehicle is determined so as to avoid the detected dangerous point. 5. A guidance support device according to any one of claims 1 to 4.

[0110] (Appendix 7) After the drone arrives at the destination, the acquisition means acquires a second image taken at the destination; the identification means identifies a person appearing in the second image; The guiding means determines whether the unmanned aerial vehicle has successfully guided the person based on the identification result of the person shown in the second image. 5. A guidance support device according to any one of claims 1 to 4.

[0111] (Appendix 8) If the unmanned aerial vehicle is successful in guiding the person, the unmanned aerial vehicle reports to the requester that the person has been guided; If the drone fails to guide the person, it notifies the requester. Further reporting measures 8. The guidance support device according to claim 7,

[0112] (Appendix 9) image acquisition means for acquiring an image of a person at a departure point; a destination information acquisition means for acquiring destination information indicating a destination identified by identifying the person appearing in the image; person guiding means for guiding the person to the destination based on the destination information; A drone equipped with (Appendix 10) The computer Acquire an image taken at the departure point; Identifying people in the image; Identifying a destination of the identified person; Head to the destination and have the drone guide the person Guidance support method.

[0113] (Appendix 11) Obtaining an image taken at a starting point; Identifying people in the images; determining a destination of the identified person; and directing the person to the destination and having the drone guide the person. A non-transitory recording medium that stores a program for causing a computer to execute the above.

[0114] (Appendix 12) an acquisition means for acquiring an image taken at a departure point; an identification means for identifying a person appearing in the image; Identification means for identifying a destination of the identified person; Guidance means for guiding the person to the destination by the drone; A guidance support device comprising: a communication device used to control the operation of the unmanned aerial vehicle; a request information database storing request information indicating the content of requests regarding the guidance of the person; Guidance support system including.

[0115] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configurations and details of the above-described embodiments (and examples) within the scope of the present invention. [Industrial Applicability]

[0116] The present invention can be used, for example, in a guidance support system for supporting disaster prevention activities by local governments and the like in the event of a disaster. [Explanation of symbols]

[0117] 1 Guidance support system 10 Guidance support device 11 Acquisition Department 12 Identification unit 13 Specific section 14 Guidance part 14´ Guide part 20 Guidance support device 30 Guidance support device 35 Reporting Department 400 drones

Claims

1. an acquisition means for acquiring an image taken at a departure point; an identification means for identifying a person appearing in the image; Identification means for identifying a destination of the identified person; Guidance means for causing the drone to guide the person toward the destination; Equipped with the identification means identifies the person appearing in the image by comparing a feature amount of a person to be guided registered in advance with a feature amount of the person appearing in the image; the guiding means determines a route of travel based on information on attributes of the identified person; The attribute information indicates at least one of the following items registered in advance for the target person: age, sex, nationality, physical disability, chronic illness, whether or not the target person has family, and whether or not the target person has cohabitants. Guidance support device.

2. The identification means identifies the face of a person appearing in the image.

2. The guidance support device according to claim 1.

3. The guiding means calls for movement to the destination from a speaker of the unmanned aerial vehicle while the unmanned aerial vehicle is guiding the person.

3. The guidance support device according to claim 1 or 2.

4. The guiding means, while guiding the person by the unmanned aerial vehicle, Analyzing images taken by the camera of the drone to detect dangerous locations; A route for guidance by the unmanned aerial vehicle is determined so as to avoid the detected dangerous point.

3. The guidance support device according to claim 1 or 2.

5. After the unmanned aerial vehicle arrives at the destination, the acquisition means acquires a second image taken at the destination; the identification means identifies a person appearing in the second image; The guiding means determines whether or not the unmanned aerial vehicle has successfully guided the person based on the identification result of the person shown in the second image.

3. The guidance support device according to claim 1 or 2.

6. image acquisition means for acquiring an image of a person at a departure point; a destination information acquisition means for acquiring destination information indicating a destination specified by identifying the person by comparing a feature amount of the person shown in the image with a feature amount of a person to be guided that has been registered in advance; person guiding means for guiding the person toward the destination based on the destination information; Equipped with the person guiding means determines a route of travel based on information on attributes of the identified person; The attribute information indicates at least one of the following items registered in advance for the target person: age, sex, nationality, physical disability, chronic illness, whether or not the target person has family, and whether or not the target person has cohabitants. Drone.

7. The computer Acquire an image taken at the departure point; identifying the person by comparing a feature amount of the person appearing in the image with a feature amount of a pre-registered person to be guided; Identifying a destination of the identified person; causing the drone to guide the person toward the destination; In guiding the person, determining a route of travel based on information on attributes of the identified person; The attribute information indicates at least one of the following items registered in advance for the target person: age, sex, nationality, physical disability, chronic illness, whether or not the target person has family, and whether or not the target person has cohabitants. Guidance support method.

8. Obtaining an image taken at a starting point; Identifying the person appearing in the image by comparing a feature amount of the person appearing in the image with a feature amount of a person to be guided that has been registered in advance; determining a destination of the identified person; causing the drone to guide the person toward the destination; on the computer, In guiding the person by the unmanned aerial vehicle, determining a movement route based on information on the attributes of the identified person; The attribute information indicates at least one of the following items registered in advance for the target person: age, sex, nationality, physical disability, chronic illness, whether or not the target person has family, and whether or not the target person has cohabitants. program.

9. an acquisition means for acquiring an image taken at a departure point; an identification means for identifying a person by comparing a feature amount of the person appearing in the image with a feature amount of a person to be guided that has been registered in advance; Identification means for identifying a destination of the identified person; Guidance means for causing the drone to guide the person toward the destination; Equipped with the guiding means determines a route of travel based on information on attributes of the identified person; The attribute information indicates at least one of the following items registered in advance for the target person: age, sex, nationality, physical disability, chronic illness, whether or not the target person has family, and whether or not the target person has cohabitants. A guidance support device; a communication device used to control the operation of the unmanned aerial vehicle; a request information database storing request information indicating the content of requests regarding the guidance of the person; Guidance support system including.

Images