Guidance device, program, guidance system, and guidance method

Abstract

To provide a guide device, a program, a guide system, and a guide method that can perform route guidance for a person who does not have an apparatus for route guidance.SOLUTION: A guide device of an embodiment comprises a specification unit, a decision unit, a determination unit, and a notification unit. The specification unit specifies a first destination from the details input by a first person to an input device installed at a first place. The decision unit decides a first route from the first place to the first destination. The determination unit determines that the first person captured in a first image photographed by a first photographing device and a second person captured in a second image photographed by a second photographing device installed at a second place are the same person. When the determination unit determines that the first person and the second person are the same person, the notification unit performs guidance based on the first route by using a notification device installed at the second place.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a guidance device, a program, a guidance system, and a guidance method. [Background technology]

[0002] Conventionally, when people are unfamiliar with the internal structure of a facility, they need to ask someone or look at a map to find their way to their destination. Alternatively, they can use a route guidance device such as a smartphone to receive route guidance to their destination. However, such route guidance devices are difficult to use in facilities where radio waves cannot be used or where bringing in information devices is restricted. Another problem with using such route guidance devices is that it can leave the user's hands tied. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-226634 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the embodiments of the present invention is to provide a guidance device, a program, a guidance system, and a guidance method that can provide route guidance to people who do not have a device for route guidance. [Means for solving the problem]

[0005] A guidance device according to an embodiment includes an identification unit, a determination unit, a judgment unit, and a notification unit. The identification unit identifies a first destination from content input by a first person to an input device installed at a first location. The determination unit determines a first route from the first location to the first destination. The judgment unit determines that the first person appearing in a first image captured by a first image capture device is the same person as a second person appearing in a second image captured by a second image capture device installed at a second location different from the first image capture device. If the judgment unit determines that the first person and the second person are the same person, the notification unit provides route guidance based on the first route using a notification device installed at the second location. [Effects of the Invention]

[0006] The present invention can provide route guidance to people who do not have a device for route guidance. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a block diagram showing an example of a configuration of a voice guidance system according to an embodiment and essential components included in the voice guidance system; [Figure 2] 2 is a flowchart showing an example of processing by a processor in FIG. 1; [Figure 3] 2 is a flowchart showing an example of processing by a processor in FIG. 1; [Figure 4] 2 is a flowchart showing an example of processing by a processor in FIG. 1; [Figure 5] FIG. 1 is a diagram for explaining route guidance. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, a voice guidance system according to an embodiment will be described with reference to the drawings. Note that the scale of each part in each drawing used in the following description of the embodiment may be changed as appropriate. Also, for the sake of explanation, each drawing used in the following description of the embodiment may omit the configuration. Also, in each drawing and in this specification, the same reference numerals indicate similar elements.

[0009] FIG. 1 is a block diagram showing an example of a voice guidance system 1 according to an embodiment and a configuration of the main components included in the voice guidance system 1. The voice guidance system 1 is installed within a predetermined range, such as within a facility. The voice guidance system 1 is a system that uses voice to provide route guidance to people who enter the predetermined range. Facilities in which the voice guidance system 1 is installed include, for example, power plants such as nuclear power plants, hospitals, research facilities, and construction sites. However, the facilities in which the voice guidance system 1 is installed are not limited to these. The range covered by the voice guidance system 1 may be a single building, part of a single building, or a facility including multiple buildings. The range covered by the voice guidance system 1 may also include an outdoor area, such as an outdoor facility. The range covered by the voice guidance system 1 will hereinafter be referred to as the "facility range."

[0010] The voice guidance system 1 includes, as an example, a control device 100, a camera 200, a speaker 300, a display device 400, and a microphone 500. Note that while FIG. 1 shows one each of the control device 100, the camera 200, the speaker 300, and the display device 400, the number of each is not limited. Typically, the voice guidance system 1 includes multiple cameras 200, multiple speakers 300, multiple display devices 400, and multiple microphones 500. In the following description, the voice guidance system 1 will be described as including one control device 100, multiple cameras 200, multiple speakers 300, multiple display devices 400, and multiple microphones 500. Note that the voice guidance system 1 is an example of a guidance system.

[0011] The control device 100 is a device that performs overall control of the voice guidance system 1. The control device 100 is, for example, a personal computer (PC) or a server. The control device 100 includes, for example, a processor 101, a read-only memory (ROM) 102, a random-access memory (RAM) 103, an auxiliary storage device 104, and a control interface 105. A bus 106 and the like connect these components. The control device 100 is an example of a guidance device.

[0012] The processor 101 is the central part of a computer that performs various calculations and processes, such as calculations and controls, necessary for the operation of the control device 100. The processor 101 is, for example, a central processing unit (CPU), a microprocessing unit (MPU), a system on a chip (SoC), a digital signal processor (DSP), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA). Alternatively, the processor 101 may be a combination of several of these. The processor 101 may also be a combination of these with a hardware accelerator or the like. The processor 101 controls each component to realize various functions of the control device 100 based on programs such as firmware, system software, and application software stored in the ROM 102 or the auxiliary storage device 104. The processor 101 also executes the processes described below based on the programs. Note that some or all of the programs may be incorporated into the circuitry of the processor 101.

[0013] The ROM 102 and RAM 103 are main storage devices of the computer with the processor 101 at its core. The ROM 102 is a non-volatile memory used exclusively for reading data. The ROM 102 stores, for example, firmware among the above programs. The ROM 102 also stores data used by the processor 101 when it performs various processes. The RAM 103 is a memory used for reading and writing data. The RAM 103 is used as a work area for storing data that is temporarily used when the processor 101 performs various processes. The RAM 103 is typically a volatile memory.

[0014] The auxiliary storage device 104 is an auxiliary storage device of a computer centered around the processor 101. The auxiliary storage device 104 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 104 stores, for example, system software and application software among the above programs. The auxiliary storage device 104 also stores data used by the processor 101 when performing various processes, data generated by the processes in the processor 101, various setting values, and the like.

[0015] The auxiliary storage device 104 also stores a visitor database (DB), which is a database that stores and manages information about visitors within the facility area.

[0016] The control interface 105 is an interface through which the control device 100 communicates with and controls the camera 200, the speaker 300, the display device 400, the microphone 500, etc. The control device 100 controls the camera 200, the speaker 300, the display device 400, the microphone 500, etc. via the control interface 105.

[0017] The bus 106 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the various parts of the control device 100 .

[0018] Camera 200 captures images for image recognition. Camera 200 also outputs the captured image data. Note that a moving image is a type of image. Camera 200 is also an example of an imaging device.

[0019] The speaker 300 outputs the input audio signal as a sound wave. The speaker 300 outputs audio to notify various information to a person receiving guidance from the audio guidance system 1. The speaker 300 is an example of an alerting device that alerts by audio.

[0020] The display device 400 displays a screen for notifying various pieces of information to a person receiving guidance from the voice guidance system 1. The display device 400 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display. The display device 400 is an example of a notification device.

[0021] The microphone 500 is a microphone that converts input sound into a signal and outputs the signal. The microphone 500 is an example of an input device that inputs sound.

[0022] The operation of the voice guidance system 1 according to the embodiment will be described below with reference to Figs. 2 to 4. Note that the processing content in the following operation description is an example, and various processing that can obtain similar results can be used as appropriate. Figs. 2 to 4 are flowcharts showing an example of processing by the processor 101 of the control device 100. The processor 101 executes the processing of Figs. 2 to 4 based on a program stored in, for example, the ROM 102 or the auxiliary storage device 104.

[0023] Fig. 5 is a diagram for explaining route guidance. Fig. 5 shows a map M1 illustrating an example of a portion of the facility area. Fig. 5 also shows an entrance E1, a lobby L1, a location P1, a unit U, and a route R1 on the map M1.

[0024] A person entering the facility area (hereinafter referred to as "visitor") performs initial registration, for example, in the lobby L1 immediately after entering the facility area through the entrance E1. During the initial registration, the visitor registers face data for face recognition, which identifies individuals based on their facial features. However, visitors whose face data has already been registered do not need to register their face data again at the entrance. Furthermore, during initial registration, visitors input whether they require route guidance and their destination. Note that the lobby L1 may be a lobby or an entrance.

[0025] A unit Ua is installed in the lobby L1 or the like for initial registration. The unit Ua is the unit U for initial registration. The unit U includes, for example, a camera 200, a speaker 300, a display device 400, and a microphone 500. Alternatively, the unit U may include only some of the camera 200, the speaker 300, the display device 400, and the microphone 500.

[0026] When only the camera 200, speaker 300, display device 400, and microphone 500 in the unit Ua are described, the reference numerals are suffixed with "a." In other words, the unit Ua includes the camera 200a, speaker 300a, display device 400a, and microphone 500a.

[0027] Unit Ub is a unit U other than unit Ua. Six units Ub, unit Ub1 to unit Ub6, are shown in Fig. 5. Unit Ub is installed, for example, at a fork in the road, a corner, or other places where it is easy to get lost.

[0028] To register face data, the visitor stands in a predetermined position so that his or her face is captured within the shooting range of the camera 200a. The camera 200a captures the visitor's image.

[0029] For example, when a visitor enters the facility area, the processor 101 of the control device 100 performs the processing of Fig. 2. The flowchart of Fig. 2 shows the processing for initial registration. In step ST11 of FIG. 2, the processor 101 of the control device 100 acquires an image of a visitor's face from the camera 200a. The camera 200a is an example of a first image capturing device. The image is an example of a first image captured by the first image capturing device. The person captured in the first image is an example of a first person.

[0030] In step ST12, the processor 101 extracts facial features of the visitor using the image acquired in step ST11.

[0031] In step ST13, the processor 101 associates the feature amount extracted in step ST12 with the visitor ID and stores it in the visitor DB or the like. The visitor ID is identification information unique to each visitor. The processor 101 assigns a visitor ID to each visitor.

[0032] Face data is registered in the voice guidance system 1 through the processing of steps ST11 to ST13.

[0033] In step ST14, processor 101 outputs a voice message from speaker 300a asking the visitor whether route guidance within the facility area is necessary. One example of the voice message is, "Do you need route guidance to your destination?" Furthermore, in addition to outputting audio, the processor 101 may also display on the display device 400 an image asking the visitor whether or not route guidance within the facility area is necessary.

[0034] In step ST15, processor 101 determines whether or not to provide route guidance. The visitor responds to the question in step ST15. If the visitor needs route guidance, they vocalize an affirmative response such as "Yes," "I need it," or "Please." Alternatively, if the visitor does not need route guidance, they vocalize a negative response such as "No" or "I don't need it." Alternatively, if the visitor does not need route guidance, they may remain silent. Microphone 500a receives input of an affirmative or negative statement from the visitor. Processor 101 analyzes the voice input to microphone 500a to recognize whether the visitor has made an affirmative or negative statement. If the visitor has made an affirmative statement, processor 101 determines to provide route guidance. On the other hand, if the visitor has made a negative statement, processor 101 determines not to provide route guidance. In addition, the processor 101 also determines not to provide route guidance if the visitor does not make any affirmative or negative statement for a predetermined period of time or longer.

[0035] If processor 101 determines not to provide route guidance, it determines No in step ST15 and ends the processing in Fig. 2. On the other hand, if processor 101 determines to provide route guidance, it determines Yes in step ST15 and proceeds to step ST16.

[0036] In step ST16, processor 101 executes the guidance start processing shown in Fig. 3 for the visitor whose face data was registered in the immediately preceding steps ST11 to ST13, and processor 101 executes the processing for camera 200a, speaker 300a, display device 400a, and microphone 500a. The guidance start processing is processing for determining a destination, route, etc. for route guidance. A visitor targeted by the guidance start processing will be referred to as a "target person" below. Camera 200, speaker 300, display device 400, and microphone 500 targeted by the guidance start processing will be referred to as a target camera, target speaker, target display device, and target microphone, respectively.

[0037] The flowchart in FIG. 3 shows the guidance start process. In step ST21 of FIG. 3, the processor 101 outputs a voice message from the target speaker asking the target person about the destination.

[0038] The subject responds to the question in step ST21 by stating the destination aloud. The subject microphone receives this utterance. In step ST22, the processor 101 recognizes the destination by analyzing the voice input to the target microphone. The voice input to the target microphone indicates the destination by a name indicating a location within the facility, such as a room name, facility name, equipment name, or device name. If the destination is indicated by the name of equipment or device, the location where the equipment or device is installed is the destination. The voice input to the target microphone may also indicate the destination by a sentence or phrase. An example of the sentence is "A place to do XX." For example, if XX is a break, the destination is a rest area. In FIG. 5, the destination is location P1. The processor 101 also associates the recognized destination with the visitor ID of the target person and stores it in the visitor DB.

[0039] The location where unit U including the target camera, target speaker, target display device, and target microphone is installed is an example of a first location. The target microphone is an example of an input device installed in the first location. The destination recognized in step ST22 is an example of a first destination. Therefore, by performing the processing of step ST22, processor 101 functions as an example of an identification unit that identifies the first destination from the content input by the first person to the input device installed in the first location.

[0040] In step ST23, the processor 101 associates the destination recognized in step ST22 with the visitor ID of the target person and stores it in the visitor DB, etc. The destination associated with the visitor ID indicates the destination that the visitor identified by the visitor ID wants to go to.

[0041] In step ST24, processor 101 acquires map data indicating the facility area. If there are impassable areas such as roads or passages that are impassable due to various factors such as construction or accidents, the map data preferably reflects such impassable roads or passages. The locations of such impassable areas are input in advance by, for example, a person in charge into the voice guidance system 1. Alternatively, the processor 101 may identify the impassable areas by image recognition using images captured by cameras 200 installed at various locations. Once the processor 101 identifies the impassable areas, it updates the map data so that the locations of the impassable areas can be determined.

[0042] In step ST25, the processor 101 determines a route from the subject's current location to the destination using the map data acquired in step ST24. At this time, the processor 101 determines a route that does not pass through roads or passages that are impassable due to various factors such as construction or accidents. Various known methods can be used to determine the route. In FIG. 5, the route to the destination location P1 is shown as route R1. The processor 101 also stores route data indicating the route in association with the visitor ID of the target person in the visitor DB.

[0043] The current location of the subject is an example of a first location. The route determined in step ST25 is also an example of a first route. Therefore, by performing the processing of step ST25, processor 101 functions as an example of a determination unit that determines a first route from the first location to the first destination.

[0044] In step ST26, the processor 101 starts route guidance for the target person. That is, the processor 101 associates flag data indicating that route guidance is being provided with the target person's visitor ID and stores the data in the visitor DB or the like. Then, the processor 101 notifies the target person of which direction to go first. To this end, the processor 101 outputs, for example, a sound indicating which direction to go first from the target speaker. The processor 101 also displays a screen indicating which direction to go first on the target display device. The processor 101 may also display a map showing the route to the destination on the target display device. The target person can start going along the route leading to the destination by listening to the sound content or viewing the content displayed on the display device. After processing step ST26, the processor 101 proceeds to step ST31.

[0045] In the example of Fig. 5, speaker 300a, which is the target speaker, outputs a voice such as "Please proceed to the passage ahead (north side)." Furthermore, display device 400a, which is the target display device, displays a screen including a character string such as "Please proceed to the passage ahead (north side)." Note that characters are a type of image.

[0046] When the guidance start process in step ST16 in FIG. 2 is completed, processor 101 ends the process shown in FIG.

[0047] The flowchart in Fig. 4 shows the process for providing route guidance within the facility area, etc. The processor 101 performs the process shown in Fig. 4 for each of the cameras 200 installed within the facility area, for example.

[0048] In step ST31 of FIG. 3, the processor 101 of the control device 100 acquires an image captured by the target camera 200. The image acquired here will be referred to as the "acquired image" hereinafter. The camera 200 is an example of a second image capturing device. The acquired image is also an example of a second image captured by the second image capturing device. The person appearing in the acquired image is an example of a second person.

[0049] In step ST32, if a human face is present in the acquired image, processor 101 performs face recognition using face data stored in an attendee DB or the like. For example, processor 101 identifies the face data stored in the attendee DB that has the highest match rate with the face of the person appearing in the acquired image. Then, processor 101 determines that the face indicated by the face data with the highest match rate matches the face of the person appearing in the acquired image if the match rate is equal to or greater than a predetermined threshold. In this way, the processor 101 can identify which entrant is shown in the acquired image by determining which registered face data the face shown in the acquired image matches.

[0050] In step ST33, processor 101 determines whether or not there is face data matching a human face in the acquired image in the face recognition processing of step ST32. If there is no matching face data, processor 101 determines No in step ST33 and returns to step ST31. Also, if there is no human face in the acquired image, processor 101 determines No in step ST33 and returns to step ST31. On the other hand, if there is matching face data, processor 101 determines Yes in step ST33 and proceeds to step ST35.

[0051] As described above, by performing the processing of steps ST31 to ST33, processor 101 functions as an example of a determination unit that determines that a first person appearing in a first image captured by a first photographing device and a second person appearing in a second image captured by a second photographing device different from the first photographing device and installed at a second location different from the first location are the same person.

[0052] In step ST34, processor 101 acquires a visitor ID associated with face data that matches the face of a person appearing in the acquired image. The visitor ID is the visitor ID of the person appearing in the acquired image. The visitor identified by the processing of step ST32 will be referred to as a "specific visitor" hereinafter. In other words, a specific visitor is a visitor who has the visitor ID acquired in step ST34. The visitor ID will be referred to as a "specific ID" hereinafter.

[0053] In step ST35, processor 101 determines whether route guidance is currently being provided to a specific visitor. For example, processor 101 refers to the visitor DB and determines that route guidance is currently being provided to a specific visitor if flag data indicating that route guidance is currently being provided is associated with the specific ID. If route guidance is currently being provided to a specific visitor, processor 101 determines Yes in step ST35 and proceeds to step ST36.

[0054] In step ST36, the processor 101 refers to the visitor DB and acquires route data associated with the specific ID. The processor 101 then provides route guidance to the specific visitor so that the specific visitor follows the route indicated by the route data. To this end, the processor 101 uses the same unit U as the camera 200 that captured the acquired image to notify the specific visitor how to proceed. The processor 101 notifies the specific visitor, for example, by outputting sound from the speaker 300 of the unit U. The processor 101 notifies the specific visitor, for example, by displaying a screen on the display device 400 of the unit U.

[0055] The content of the notification may be, for example, "Go straight," "Turn right," or "Turn left." The content of the notification may be more detailed, such as "Go straight, then turn left at the end of the road." However, what is shown here is an example, and any content may be used as long as route guidance is possible.

[0056] In the example shown in Figure 5, a visitor starts from unit Ua, passes through the location where unit Ub1 is installed, the location where unit Ub2 is installed, and the location where unit Ub3 is installed, in that order, and arrives at destination location P1. The processor 101 provides the visitor with the following guidance, for example, at each of the locations where the unit Ub1 is installed, the location where the unit Ub2 is installed, and the location where the unit Ub3 is installed.

[0057] The processor 101 notifies the entrant in the location where the unit Ub1 is installed, for example, "Please go straight" or "Go straight, then turn left at the end." The processor 101 issues a notice to the entrant at the location where the unit Ub2 is installed, such as "Please turn left." The processor 101 notifies the entrant at the location where the unit Ub1 is installed, for example, "Please turn right" or "Please turn right. The destination location P1 is at the end."

[0058] As described above, by performing the processing of step ST36, processor 101 functions as an example of an alarm unit that provides route guidance based on the first route using an alarm device installed in the second location when the judgment unit determines that the first person and the second person are the same person.

[0059] In step ST37, processor 101 determines whether to end route guidance for the specified visitor. For example, if the unit U that photographed and notified the specified visitor is the last unit U among the units U installed up to the destination on the route indicated by the route data acquired in step ST36, processor 101 considers that the specified visitor has arrived at the destination and determines to end route guidance for the specified visitor. In the example shown in Figure 5, the last unit U on route R1 is unit Ub3.

[0060] If the processor 101 determines that the route guidance for the specific visitor is to be terminated, it makes a "Yes" determination in step ST37 and proceeds to step ST38. In step ST38, processor 101 ends route guidance for the specific visitor. To do this, processor 101, for example, deletes flag data associated with the specific ID from the visitor DB, indicating that route guidance is currently being provided. Processor 101 may also delete route data associated with the specific ID from the visitor DB.

[0061] After processing step ST38, processor 101 proceeds to step ST39. If route guidance for the specific visitor is not to be terminated, processor 101 determines No in step ST37 and proceeds to step ST39.

[0062] In step ST39, processor 101 determines whether to change the destination in the route guidance for the specific visitor. If the visitor wishes to change the destination along the way, he or she will make a statement to that effect. For example, the visitor may say out loud, "I want to go to YY," or "I want to change the destination to YY." The microphone 500 of the same unit U as the camera 200 that captured the captured image receives input of such a statement. When the specific visitor makes a statement such as this indicating that he or she wishes to change the destination and that destination, processor 101 determines that the destination in the route guidance for the specific visitor will be changed. If processor 101 does not wish to change the destination in the route guidance for the specific visitor, it makes a No determination in step ST39 and returns to step ST31.

[0063] On the other hand, if the processor 101 determines that the destination in the route guidance for the specific visitor should be changed, it makes a "Yes" determination in step ST39 and proceeds to step ST40.

[0064] In step ST40, processor 101 determines a new destination based on the utterance of the specific visitor. Processor 101 recognizes the destination by, for example, analyzing the voice in the same manner as in step ST22 of FIG. 3. Processor 101 also associates the recognized destination with a specific ID and stores it in the visitor DB in the same manner as in step ST23. At this time, processor 101 overwrites the old destination with the new destination and stores it in the visitor DB, for example.

[0065] The processor 101 also determines a route from the current location to the destination, similar to steps ST24 and ST25. The processor 101 creates new route data, for example, by rewriting part of the route data acquired in step ST36. That is, the processor 101 leaves the route indicated by the route data from the starting point to the current location, and rewrites the route from the current location onward to a new destination. In this way, it becomes possible to determine from which direction a specific visitor has traveled to the current location. The processor 101 associates the rewritten route data with the specific ID and stores it in the visitor DB. At this time, the processor 101, for example, overwrites the old route data with the new route data and stores it in the visitor DB. After the process of step ST40 in FIG. 4, processor 101 returns to step ST36.

[0066] The destination recognized in step ST40 is an example of a second destination. Therefore, by recognizing the destination in the processing of step ST40, processor 101 functions as an example of an identification unit that identifies the second destination from the content input by the first person to an input device installed in the second location. The route determined in step ST40 is an example of a second route. Therefore, by determining the route in the processing of step ST40, processor 101 functions as an example of a determination unit that determines a second route from the second location to the second destination.

[0067] The acquired image acquired in step ST31 after the destination change is an example of a third image. Furthermore, camera 200 that captured the acquired image is an example of a third image capturing device installed in a third location. Furthermore, the person captured in the acquired image is an example of a third person. Therefore, by performing the processes of steps ST31 to ST33 after the destination change, processor 101 functions as an example of a determination unit that determines that the first person and the third person captured in the third image captured by a third image capturing device installed in a third location different from the second location are the same person. In addition, by performing the processing of step ST36 after changing the destination, processor 101 functions as an example of an alarm unit that provides route guidance based on the second route using an alarm device installed in the third location if the judgment unit determines that the first person and the third person are the same person.

[0068] On the other hand, if the processor 101 is not currently providing route guidance to a specific visitor, it determines No in step ST35 and proceeds to step ST41.

[0069] In step ST41, the processor 101 determines whether the specified visitor is lost. The processor 101 analyzes the image of the specified visitor and determines whether the specified visitor is lost based on the movements of the specified visitor. For example, the processor 101 determines that the specified visitor is lost when the specified visitor stops and looks around, or when the specified visitor is wandering around the same place. The processor 101 may determine whether the specified visitor is lost using not only the acquired image but also multiple images taken by multiple cameras 200. If the processor 101 does not determine that the specified visitor is lost, it determines No in step ST41 and returns to step ST31. On the other hand, if the processor 101 determines that the specified visitor is lost, it determines Yes in step ST41 and proceeds to step ST41.

[0070] As described above, by performing the process of step ST41, processor 101 functions as an example of a determination unit that determines whether a first person is lost using an image captured by a camera installed at a first location. Note that the acquired image used for this determination is an example of an image captured by a camera installed at the first location.

[0071] In step ST42, processor 101 outputs audio from speaker 300 of unit U that is the same as camera 200 that captured the acquired image, asking the visitor whether or not route guidance within the facility range is necessary, similar to step ST14 in Fig. 2. In addition to outputting audio, processor 101 may also display an image on display device 400 of unit U that is the same as camera 200 that captured the acquired image, asking the visitor whether or not route guidance within the facility range is necessary.

[0072] As described above, by performing the processing of step ST42, processor 101 functions as an example of an alarm unit that, when the judgment unit determines that the first person is lost, asks whether route guidance is required using an alarm device installed at the first location.

[0073] In step ST43 of FIG. 4, the processor 101 determines whether to provide route guidance to the designated visitor. The designated visitor responds to the question in step ST42. If the designated visitor needs route guidance, he or she vocalizes an affirmative response such as "Yes," "I need it," or "Please." Alternatively, if the designated visitor does not need route guidance, he or she vocalizes a negative response such as "No" or "I don't need it." Alternatively, if the designated visitor does not need route guidance, he or she may remain silent. The microphone 500 of the same unit U as the camera 200 that captured the captured image receives input of an affirmative or negative statement from the designated visitor. The processor 101 analyzes the voice input to the microphone 500 to determine whether the designated visitor has made an affirmative or negative statement. If the designated visitor has made an affirmative statement, the processor 101 determines to provide route guidance. On the other hand, if the designated visitor has made a negative statement, the processor 101 determines not to provide route guidance. Processor 101 also determines that route guidance will not be provided if the specific visitor does not make any affirmative or negative statement for a predetermined period of time or longer, or if the specific visitor leaves. If processor 101 determines that route guidance will not be provided to the specific visitor, it determines No in step ST43 and returns to step ST31. On the other hand, if route guidance will be provided to the specific visitor, processor 101 determines Yes in step ST43 and proceeds to step ST44.

[0074] 3 for the specific visitor, as well as the camera 200, speaker 300, display device 400, and microphone 500 of the same unit U as the camera 200 that captured the acquired image. When the guidance start processing in step ST44 is completed, processor 101 returns to step ST31.

[0075] The voice guidance system 1 of the embodiment performs face recognition using multiple image capture devices, and can identify the location of the image capture device where the visitor is located. This allows the voice guidance system 1 of the embodiment to provide the same visitor with guidance based on the same route at each of multiple locations.

[0076] Furthermore, the voice guidance system 1 of the embodiment uses an installed device to make notifications, so visitors do not need to carry any device for guidance.

[0077] Furthermore, the voice guidance system 1 of the embodiment uses voice input, so visitors can input even if their hands are full.

[0078] Furthermore, the voice guidance system 1 of the embodiment provides route guidance by voice, so that visitors can receive route guidance as long as they can hear the voice.

[0079] Furthermore, the voice guidance system 1 of the embodiment allows the destination to be changed during route guidance, so that even if a visitor has made a mistake in choosing the destination, they can continue on their way to the correct destination.

[0080] The voice guidance system 1 of the embodiment also recognizes visitors who are lost and can help them by providing route guidance.

[0081] The above embodiment can be modified as follows. In the above embodiment, the processor 101 of the control device 100 identifies the visitor who appears in the acquired image by facial recognition. However, the processor 101 may identify the visitor who appears in the acquired image by a method other than facial recognition. For example, the processor 101 identifies the visitor using characteristics of a person's behavior, such as gait. For example, the processor 101 identifies the visitor using characteristics of the clothing worn by the person. Note that when using a recognition method other than facial recognition, the voice guidance system 1 uses characteristics of behavior or characteristics of clothing, etc., instead of facial characteristics.

[0082] When registering face data, if the face data has already been registered, the processor 101 does not need to newly register the face data. The processor 101 performs face recognition using the image acquired in step ST11 in the same manner as in step ST32, and if there is matching face data, it considers the face data to have already been registered.

[0083] In the above embodiment, the visitor inputs their destination by voice input. However, they may also be able to input it by a method other than voice input. For example, the unit U is equipped with an input device such as a keyboard, a touch panel, or a touch pad. The display device 400 may also be the touch panel. The visitor inputs their destination using the input device. Furthermore, they may also be able to input other destinations by a method other than voice input.

[0084] The processor 101 may identify who is speaking by voice recognition. In this case, the attendee registers voice data for voice recognition along with face data during initial registration. The attendee inputs voice into the microphone 500. The processor 101 extracts features from the voice and stores them in the attendee DB along with the face features. By performing voice recognition, the processor 101 can determine whether the input voice is a statement made by a specific attendee or a non-specific attendee. The processor 101 may ignore statements made by non-specific attendees.

[0085] If the facility area is multi-story, the processor 101 may provide guidance by issuing a notification to use the stairs, escalator, or elevator, for example.

[0086] In the above embodiment, the processor 101 determines whether a visitor whose face data is registered is lost. However, the processor 101 may also determine whether a visitor whose face data is not registered is lost. If guidance is required, the processor 101 registers the face data by photographing the visitor with the camera 200 installed at the site, and performs guidance start processing for the visitor.

[0087] In the above embodiment, the processor 101 asks the visitor whether he or she needs route guidance. However, the visitor may state aloud that he or she needs route guidance and the destination before such a question is asked. The processor 101 may also provide route guidance in this case. In other words, the processor 101 performs a guidance start process for the visitor.

[0088] The processor 101 may recognize an injured person by image analysis using the acquired image. For example, if the processor 101 recognizes that a visitor has collapsed or is crouching, the processor 101 considers the visitor to be an injured person. Once the processor 101 recognizes an injured person, the processor 101 may call out to the injured person by outputting audio using the speaker 300 of the same unit U as the camera 200 that captured the acquired image. If the injured person does not respond, or if the injured person responds by notifying an emergency, the processor 101 makes an emergency call to an ambulance or other emergency service. The processor 101 recognizes that a response by notifying an emergency has been received by using audio input from the microphone 500.

[0089] Furthermore, after making an emergency call, the processor 101 provides route guidance to the injured or sick person using the speakers 300 and display devices 400 at each location. The processor 101 determines, for example, a route from the entrance to the injured or sick person. Then, route guidance is provided by making an announcement using the speakers 300 and display devices 400 provided in units U on the route from the entrance to the injured or sick person. Furthermore, for each unit U not on the route, a route from each unit U to the injured or sick person may be determined, and route guidance based on the determined route may be provided by making an announcement using the speakers 300 and display devices 400 provided in each unit U. Through the above processing, emergency personnel can reach the injured or sick person from the entrance without getting lost. Furthermore, people in other locations can also reach the injured or sick person without getting lost. The content of the notification may be, for example, "Go straight here to reach the injured person" or "Turn right here to reach the injured person." While providing route guidance to the injured person, processor 101 may suspend other route guidance, such as the process shown in FIG.

[0090] The processor 101 may also use the speaker 300 and the microphone 500 to ask the injured person about the condition of their injury or illness. The processor 101 then transmits the condition that it has heard and information indicating that an injured person has been injured to a predetermined device. The device may be installed in, for example, a security room or a management room of the facility. In response to receiving the information, the device notifies the user that an injured person has been injured and the condition of the injured person based on the information by, for example, displaying the information on a screen.

[0091] As described above, the processor 101 functions as an example of a determination unit that determines whether a person shown in an image captured by the imaging device is an injured person, an example of a decision unit that determines a route to the injured person if the determination unit determines that the person is an injured person, and an example of a notification unit that provides route guidance based on the route to the injured person using an alarm device if the determination unit determines that the person is an injured person.

[0092] Furthermore, the processor 101 may perform processing for evacuation guidance in the event of a disaster such as a fire or an earthquake. The processor 101 outputs a sound indicating that evacuation should be performed from the speaker 300 of the unit U installed at each location. The processor 101 also causes the display device 400 of the unit U to display a screen indicating that evacuation should be performed. The processor 101 also determines a route from each unit U to the nearest exit. The exit is an exit of the building or an exit of the facility area. The map used in this case preferably reflects impassable areas that have become impassable due to a disaster, such as a fire or a collapse. The processor 101 identifies such impassable areas, for example, by image recognition using images captured by cameras 200 installed at various locations. The processor 101 provides guidance on the route from the unit U to the exit determined as described above by making a notification using the speaker 300 and display device 400 of each unit U. The route to the exit may be a predetermined evacuation route or the like. The content of the notification may be, for example, "Go straight here to get to the exit" or "Turn right here to get to the exit." While the processor 101 is providing route guidance in the event of a disaster, the processor 101 may stop other route guidance, such as the processing shown in FIG.

[0093] By providing route guidance when a disaster occurs as described above, the processor 101 functions as an example of a notification unit that provides route guidance to an exit by a notification device when a disaster occurs.

[0094] The voice guidance system of the embodiment may use a device other than the speaker 300 and the display device 400 to make a notification.

[0095] The processor 101 may implement part or all of the processing implemented by a program in the above-described embodiment by a hardware circuit configuration.

[0096] The program for implementing the processes of the embodiments may be transferred, for example, in a state stored in the device. However, the device may also be transferred without the program stored therein. The program may then be transferred separately and written to the device. In this case, the program may be transferred by, for example, recording it on a removable storage medium or by downloading it via a network such as the Internet or a local area network (LAN).

[0097] Although the embodiments of the present invention have been described above, they are merely examples and are not intended to limit the scope of the present invention. The embodiments of the present invention can be implemented in various forms without departing from the spirit of the present invention. [Explanation of symbols]

[0098] 1. Voice guidance system 100 control device 101 processors 102 ROM 103 RAM 104 Auxiliary storage 105 Control Interface Bus 106 200 cameras 300 speakers 400 display device 500 microphones

Claims

1. An identification unit that identifies the location of an injured person as a first destination; a determination unit that determines a first route from a first location where a first person is present to the first destination; a determination unit that determines whether a first person appearing in a first image captured by a first image capturing device and a second person appearing in a second image captured by a second image capturing device different from the first image capturing device, the second image being installed at a second location different from the first location, are the same person; A guidance device comprising: an alarm unit that, when the determination unit determines that the first person and the second person are the same person, provides route guidance based on the first route using an alarm device installed at the second location.

2. The guidance device described in Claim 1, wherein the alarm device is a device that alerts by voice.

3. the identification unit identifies a second destination from content input by the first person to an input device installed at the second location; the determination unit determines a second route from the second location to the second destination; the determination unit determines that the first person and a third person appearing in a third image captured by a third image capturing device installed at a third location different from the second location are the same person; 3. The guidance device according to claim 1, wherein when the determination unit determines that the first person and the third person are the same person, the notification unit provides route guidance based on the second route using an alarm device installed at the third location.

4. the determination unit determines that the first person is lost using an image captured by an image capture device installed at a first location; 4. The guidance device according to claim 1, wherein when the determination unit determines that the first person is lost, the notification unit asks the first person whether route guidance is required by a notification device installed at the first location.

5. The guidance device according to claim 1 , wherein the notification unit provides route guidance to an exit by the notification device when a disaster occurs.

6. The guidance device according to claim 1 , wherein the determination unit analyzes an image captured by an imaging device and determines whether a person appearing in the image is the sick or injured person.

7. A processor included in the guide device, an identification unit that identifies a location where the injured person is present as a first destination; a determination unit that determines a first route from a first location where a first person is present to the first destination; a determination unit that determines whether a first person appearing in a first image captured by a first image capturing device and a second person appearing in a second image captured by a second image capturing device different from the first image capturing device, the second image being installed at a second location different from the first location, are the same person; A program that functions as an alarm unit that provides route guidance based on the first route using an alarm device installed at the second location when the determination unit determines that the first person and the second person are the same person.

8. The system includes a guide device, an input device, a plurality of image capturing devices including a first image capturing device and a second image capturing device, and a notification device, The guide device is an identification unit that identifies a location where the injured person is present as a first destination; a determination unit that determines a first route from a first location where a first person is present to the first destination; a determination unit that determines whether the first person appearing in a first image captured by the first image capturing device and a second person appearing in a second image captured by the second image capturing device installed at a second location different from the first location are the same person; A guidance system comprising: an alarm unit that, when the determination unit determines that the first person and the second person are the same person, provides route guidance based on the first route using the alarm device installed at the second location.

9. Identifying the location of the injured person as a first destination; determining a first route from a first location where a first person is located to the first destination; A guidance method in which, if a first person appearing in a first image captured by a first photographing device and a second person appearing in a second image captured by a second photographing device different from the first photographing device and installed at a second location different from the first location are the same person, a notification device installed at the second location provides route guidance based on the first route.

Images