Authentication device, authentication system, terminal device, authentication method, and program

Abstract

To enable authenticating a person at a distance without face authentication in an authentication system for authenticating the person using a camera.SOLUTION: An authentication device comprises: an image acquisition section that acquires an image of a photographed person; a first sound wave output section that outputs a first sound wave representing first identification information for causing a terminal device used by the person to execute predetermined display processing; a determination section that determines, on the basis of the image acquired by the acquisition section, whether the terminal device has executed the predetermined display processing; a second sound wave output section that outputs a second sound wave representing second identification information for allowing the terminal device to identify its own device when the terminal device has executed the predetermined display processing; and an authentication section that collates authentication information transmitted by the terminal device and including the second identification information and terminal identification information for identifying the terminal device with preliminarily registered registration information to authenticate the person or the terminal device.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an authentication device, an authentication system, an authentication method, and a program. [Background technology]

[0002] 2. Description of the Related Art There is known an authentication system that authenticates people within a facility by using fixed cameras such as surveillance cameras, or mobile cameras provided on mobile robots.

[0003] For example, there is known a matching system that, when it is not possible to match the face of a person contained in a first image captured by a fixed camera, obtains a second image using a mobile camera located in a position where it can capture the person, and performs facial authentication of the person (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] A camera-based authentication system as described above can authenticate a person from a relatively distant location, for example, by using a drone, a mobile robot, or a surveillance camera.

[0005] However, the technology disclosed in Patent Document 1 requires higher resolution images and higher authentication accuracy to perform face authentication of a person.Facial authentication also has the problem that it is difficult to authenticate a person who is wearing a mask or the like.

[0006] One embodiment of the present invention has been made in consideration of the above problems, and enables a person to be authenticated from a remote location without relying on facial recognition in an authentication system that uses a camera to authenticate a person. [Means for solving the problem]

[0007] In order to solve the above problems, an authentication device according to one embodiment of the present invention has an image acquisition unit that acquires an image of a person, a first sound wave output unit that outputs first sound waves representing first identification information that causes a terminal device used by the person to execute a predetermined display process, a judgment unit that judges whether the terminal device has executed the predetermined display process based on the image, a second sound wave output unit that outputs second sound waves representing second identification information that identifies the terminal device to the terminal device if the terminal device has executed the predetermined display process, and an authentication unit that authenticates the person or the terminal device by comparing authentication information transmitted by the terminal device, the second identification information including terminal identification information that identifies the terminal device, with pre-registered registration information. Effect of the Invention

[0008] According to one embodiment of the present invention, in an authentication system that uses a camera to authenticate a person, it becomes possible to authenticate a person from a remote location without relying on face authentication. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 1 is a diagram illustrating an overview of authentication processing of an information processing system according to an embodiment. [Diagram 3] 11A to 11C are diagrams illustrating an example of a transition of a display screen of a terminal device according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to an embodiment. [Diagram 5] FIG. 1 is a diagram illustrating an example of a hardware configuration of a drone according to an embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a hardware configuration of a terminal device according to an embodiment. [Figure 7] FIG. 1 is a diagram illustrating an example of a functional configuration of an information processing system according to an embodiment. [Figure 8] FIG. 11 is a diagram illustrating another example of a functional configuration of an information processing system according to an embodiment. [Figure 9] FIG. 2 is a diagram showing an example of information managed by an information management unit according to an embodiment; [Figure 10] 4 is a flowchart showing an example of processing of the authentication system according to the first embodiment. [Figure 11] 10 is a flowchart showing an example of processing when authentication is OK according to the first embodiment. [Figure 12] 10 is a flowchart showing an example of a process in the case of authentication NG according to the first embodiment. [Figure 13] 5 is a flowchart showing an example of processing of a terminal device according to the first embodiment. [Figure 14] FIG. 2 is a sequence diagram showing an example of processing of the information processing system according to the first embodiment. [Figure 15] FIG. 11 is a sequence diagram showing an example of processing of an information processing system according to the second embodiment. [Figure 16] FIG. 11 is a sequence diagram illustrating an example of a registration process according to an embodiment. [Figure 17] FIG. 11 is a sequence diagram illustrating another example of a registration process according to an embodiment. [Figure 18] FIG. 13 is a sequence diagram showing an example of processing of an information processing system according to a third embodiment. [Figure 19] FIG. 1 shows an application example according to an embodiment. [Figure 20] FIG. 2 illustrates an application example according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0011] <System configuration> 1 is a diagram showing an example of a system configuration of an information processing system according to an embodiment. The information processing system 100 is a system that uses a drone 120 to authenticate a person 131 who uses a terminal device 130.

[0012] The drone 120 is an unmanned aircraft that does not carry a person on board, and is equipped with, for example, a camera 121 that captures images of a terminal device 130 and a person 131 using the terminal device 130, and a speaker 122 that outputs sound waves 123.

[0013] There are cases where such drones 120 are used to give voice instructions, provide guidance, and provide security to people 131. For example, an operator 111 who operates the drone 120 can operate the drone 120 using an information processing device 110 that can communicate with the drone 120 via wireless communication 101, and can take pictures of the person 131, output voice messages to the person 131, and so on.

[0014] However, with conventional technology, when using such a drone 120, for example, when a suspicious person is discovered within a facility, it is difficult to authenticate whether the person 131 is a person authorized to use the facility.

[0015] For example, as in the technology disclosed in Patent Document 1, a camera that captures images with higher resolution and higher authentication accuracy are required to perform face authentication of the person 131. In addition, face authentication has a problem in that authentication is difficult when the person 131 to be authenticated is wearing a mask or the like.

[0016] Therefore, in the information processing system 100 according to this embodiment, authentication of a person 131 to be authenticated is performed using a terminal device 130 such as a smartphone, a tablet terminal, or a wearable terminal used by the person 131 to be authenticated.

[0017] The drone 120 includes a camera 121 and a speaker 122, and is an example of a device used to authenticate the person 131. The device used to authenticate the person 131 may be, for example, a traveling device (such as a security robot) that travels on a road surface, a floor surface, or the like, or a mobile device that travels on water. The device used to authenticate the person 131 may also be a device that does not have a mobile function, such as a surveillance camera, digital signage, or a reception terminal. Here, as an example, the following description will be given assuming that the device used to authenticate the person 131 is the drone 120 and that the terminal device 130 used by the person 131 to be authenticated is a smartphone.

[0018] <Processing Overview> Fig. 2 is a diagram showing an overview of authentication processing of an information processing system according to an embodiment. In the example of Fig. 2, an authentication system 200 that authenticates a person 131 who uses a terminal device 130 includes, for example, a drone 120, an information processing device 110, and an access authentication DB (Database) 201.

[0019] The authentication system 200 authenticates a person 131 who is in a facility that is a management target, among various facilities such as private land, managed land, parks, companies, rivers, etc. The authentication system 200 also stores in advance in an access authentication DB 201 information on users who are permitted to use the facility, and terminal identification information (hereinafter referred to as terminal ID) that identifies the terminal device used by the user.

[0020] When the authentication system 200 detects (discovers) a person 131 in a facility from an image captured by the camera 121 of the drone 120, it executes, for example, the following authentication process. Note that here, the person 131 is a user who is permitted to use the facility, and an application (hereinafter, referred to as an app) compatible with the authentication system 200 is installed in the terminal device 130 used by the person 131.

[0021] In step S1, the authentication system 200 uses the speaker 122 of the drone 120 to output an audio announcement to the person 131, for example, to urge the person 131 to start an app and point the display screen of the terminal device 130 toward the drone 120.

[0022] In step S2, when the person 131 starts the application, the terminal device 130 displays a first display screen (for example, a red screen or the like).

[0023] In step S3, the authentication system 200 checks the display of the first display screen of the terminal device 130 from the image captured by the camera 121, and in step S4 outputs a first sound wave representing first identification information (hereinafter, referred to as ID1) from the speaker 122. Note that ID1 is an example of the first identification information that causes the terminal device 130 to execute a predetermined display process.

[0024] In step S5, the terminal device 130 acquires surrounding sounds using a microphone provided in the terminal device 130, and when it receives a first sound wave representing ID1, it transitions from the first display screen to a second display screen (e.g., a yellow screen).

[0025] In step S6, when the authentication system 200 confirms the transition from the image captured by the camera 121 to the second display screen of the terminal device 130, in step S7, it outputs a second sound wave representing second identification information (hereinafter, referred to as ID2) from the speaker 122. Note that ID2 is an example of second identification information for identifying the drone 120 (or the authentication system 200, the information processing device 110, etc.).

[0026] In step S8, when the terminal device 130 receives the sound wave representing the ID2, the terminal device 130 transmits authentication information including the ID2 and a terminal ID for identifying the terminal device 130 to the authentication system 200, for example, by wireless communication. Preferably, the authentication information includes location information indicating the location of the terminal device 130, which the terminal device 130 has acquired by using a global positioning system (GPS) or the like.

[0027] In addition, the destination of the authentication information may be, for example, an application that has a destination address corresponding to ID2 in advance, or the terminal device 130 may obtain the destination address corresponding to ID2 from a preset external server or the like.

[0028] In step S9, the authentication system 200 permits (or rejects) authentication of the person 131 based on the result of comparing the authentication information transmitted from the terminal device 130 with the access authentication DB 201. For example, when the terminal ID of the terminal device 130 is registered in the access authentication DB 201, the authentication system 200 permits authentication of the person 131 who uses the terminal device 130. Alternatively, the authentication system 200 may authenticate the person 131 who uses the terminal device 130 by further using the ID2, location information, etc., included in the authentication information.

[0029] In step S10, the authentication system 200 notifies the terminal device 130 of the authentication result, for example, by wireless communication. In this case, since the person 131 is a user permitted to use the facility, the authentication result indicating that authentication of the person 131 has been permitted is notified to the terminal device 130.

[0030] In step S11, when terminal device 130 receives an authentication result indicating that authentication has been permitted from authentication system 200, it transitions the display screen from the second display screen to a third display screen (for example, a green screen, etc.).

[0031] In step S12, when the authentication system 200 confirms the transition from the image captured by the camera 121 to the third display screen of the terminal device 130, it permits the person 131 to use the facility. In addition, in step S13, the authentication system 200 uses the speaker 122 of the drone 120 to output an audio announcement indicating that use of the facility is permitted.

[0032] As described above, according to this embodiment, in the authentication system 200 that uses the camera 121 to authenticate the person 131, it becomes possible to authenticate the person 131 from a remote location without relying on face authentication.

[0033] FIG. 3 is a diagram showing an example of transition of a display screen of a terminal device according to an embodiment. FIG. 3(A) shows an example of a first display screen, a second display screen, and a third display screen displayed by the terminal device 130. In step S2 of FIG. 2, the terminal device 130 displays a first display screen 310a in which the entire display screen is colored red, as an example. In this case, in step S5 of FIG. 2, the terminal device 130 displays a second display screen 310b in which the entire display screen is colored yellow, for example. In addition, in step S11 of FIG. 2, the terminal device 130 displays a third display screen 310c in which the entire display screen is colored green, for example. Note that the colors of the first display screen 310a, the second display screen 310b, and the third display screen 310c shown in FIG. 3(A) are examples, and may be other colors.

[0034] FIG. 3B shows another example of the first display screen, the second display screen, and the third display screen displayed by the terminal device 130. In step S2 of FIG. 2, the terminal device 130 may display the first display screen 320a that displays the character "A" on the entire display screen, as an example. In this case, in step S5 of FIG. 2, the terminal device 130 displays the second display screen 320b that displays the character "B" on the entire display screen, for example. In addition, in step S11 of FIG. 2, the terminal device 130 displays the third display screen 320c that displays the character "C" on the entire display screen, for example. Note that the characters displayed on the first display screen 320a, the second display screen 320b, and the third display screen 320c shown in FIG. 3B are only examples, and other characters may be used.

[0035] FIG. 3C shows another example of the first display screen, the second display screen, and the third display screen displayed by the terminal device 130. In step S2 of FIG. 2, the terminal device 130 may display, as an example, a first display screen 330a in which a plurality of rectangles 331 are arranged at a predetermined position on the display screen. In this case, in step S5 of FIG. 2, the terminal device 130 displays, for example, a second display screen 330b in which a plurality of rectangles 331 are arranged at a position different from that of the first display screen 330a. In addition, in step S11 of FIG. 2, the terminal device 130 displays, for example, a third display screen 330c in which a plurality of rectangles 331 are arranged at a position different from that of the first display screen 330a and the second display screen 330b. Note that the arrangement of the plurality of rectangles 331 displayed on the first display screen 330a, the second display screen 330b, and the third display screen 330c shown in FIG. 3C is an example, and other arrangements may be used.

[0036] In this way, the terminal device 130 displays the first to third display screens in a manner that makes it easy to distinguish the transition of the display screen from the image captured by the camera 121 of the drone 120. Therefore, in this embodiment, a high-resolution camera is not required as the camera 121 of the drone 120, and it becomes possible to authenticate the person 131 using a general camera. Furthermore, the authentication system 200 according to this embodiment does not need to have a face authentication function (it may have one).

[0037] 3(A) to 3(C) are examples of the first to third display screens displayed by the terminal device 130. The terminal device 130 may display other display elements, such as, for example, mutually different QR codes (registered trademark) or barcodes, on the display screen as the first to third display screens.

[0038] Moreover, the processes of displaying the first to third display screens are examples of the first to third display processes executed by the terminal device 130. The first to third display processes executed by the terminal device 130 may be, for example, processes of blinking an LED (Light Emitting Diode) in different blinking patterns.

[0039] Furthermore, as an application example of this embodiment, the terminal device 130 may execute first to third sound wave output processes instead of the first to third display processes. For example, the terminal device 130 may output sounds of different musical scales from a speaker included in the terminal device 130 instead of the first to third display screens. Alternatively, the terminal device 130 may output sound waves representing different information from a speaker included in the terminal device 130 instead of the first to third display processes.

[0040] <Hardware configuration> Next, the hardware configurations of the information processing device 110, the drone 120, and the terminal device 130 will be described.

[0041] (Hardware configuration of information processing device) The information processing device 110 has, for example, the hardware configuration of a computer 400 as shown in FIG.

[0042] 4 is a diagram showing an example of a hardware configuration of a computer according to an embodiment. The computer 400 includes, for example, a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, a HD (Hard Disk) 404, a HDD (Hard Disk Drive) controller 405, a display 406, an external device connection I / F (Interface) 407, a communication I / F 408, a keyboard 409, a pointing device 410, a DVD-RW (Digital Versatile Disk Rewritable) drive 412, a media I / F 414, and a bus line 415.

[0043] Of these, the CPU 401 is a processor that controls the overall operation of the computer 400. The ROM 402 is a non-volatile memory that stores programs used to start up the computer 400, such as an IPL (Initial Program Loader). The RAM 403 is a volatile memory that is used as a work area for the CPU 401. The HD 404 is a storage device that stores programs, various data, etc. The HDD controller 405 controls reading and writing of various data from and to the HD 404 under the control of the CPU 401.

[0044] The display 406 is a display device that displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 407 is an interface for connecting various external devices to the computer 400. Examples of external devices include a headset 416, a microphone, headphones, and speakers.

[0045] The communication I / F 408 is an interface for communicating with an external device. The communication I / F 408 includes a network interface card (NIC) for connecting the computer 400 to a communication network such as the Internet or a local area network (LAN), a wireless communication interface for wirelessly communicating with the drone 120, and the like.

[0046] The keyboard 409 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 410 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 412 controls reading and writing of various data from a DVD-RW 411 as an example of a removable recording medium. Note that the DVD-RW 411 is not limited to a DVD-RW, and may be another recording medium. The media I / F 414 controls reading and writing (storing) of data from a medium 413 such as a flash memory. The bus line 415 is commonly connected to each of the above components, and includes, for example, an address bus, a data bus, various control signals, etc.

[0047] (Drone hardware configuration) 5 is a diagram showing an example of a hardware configuration of a drone according to an embodiment. The drone 120 includes, for example, a CPU 501, a memory 502, a storage device 503, a communication device 504, a flight device 505, a camera 121, a sound wave output circuit 506, a speaker 122, a spotlight 507, and a bus 508.

[0048] The CPU 501 is a computing device that realizes various functions of the drone 120 by executing programs stored in, for example, the storage device 503, the memory 502, etc. The memory 502 includes, for example, a RAM, which is a volatile memory used as a work area for the CPU 501, and a ROM that stores in advance programs for starting the CPU 501, etc. The storage device 503 is, for example, a large-capacity nonvolatile storage device such as a flash ROM or an SSD (Solid State Drive).

[0049] The communication device 504 includes, for example, a communication interface that performs wireless communication in the same wireless communication system as the communication I / F 408 of the information processing device 110. The communication device 504 also includes, for example, a communication interface that connects to a communication network such as the Internet or a LAN via wireless WAN (Wide Area Network) communication.

[0050] The flight device 505 includes multiple propellers for flying the drone 120, actuators such as motors or engines that drive the propellers, and control circuits that control the actuators.

[0051] The camera 121 is an imaging device that captures images of the periphery of the drone 120. The sonic output circuit 506 includes, for example, an amplifier that amplifies a sonic signal, a DA (Digital to Analog) converter that converts sonic data into a sonic signal, and the like, and generates a sonic signal to be output to the speaker 122. The speaker 122 is a speaker that converts the sonic signal output by the sonic output circuit 506 into a sound wave and outputs it.

[0052] The spotlight 507 is a lighting device that illuminates the person 131 to be authenticated, for example, when the surroundings are dark. The bus 508 is commonly connected to each of the above components, and transmits, for example, address signals, data signals, and various control signals.

[0053] (Terminal device hardware configuration) Fig. 6 is a diagram showing an example of a hardware configuration of a terminal device according to an embodiment. As shown in Fig. 6, the terminal device 130 includes a CPU 601, a ROM 602, a RAM 603, a storage device 604, a CMOS (Complementary Metal Oxide Semiconductor) sensor 605, an image sensor I / F 606, an acceleration / direction sensor 607, a media I / F 609, and a GPS receiver 610.

[0054] Of these, the CPU 601 executes a predetermined program to control the overall operation of the terminal device 130. The ROM 602 stores a program used to start up the CPU 601, such as an IPL. The RAM 603 is used as a work area for the CPU 601. The storage device 604 is a large-capacity storage device that stores programs such as an OS and applications, and various data, and is realized by, for example, an SSD, a flash ROM, or the like.

[0055] The CMOS sensor 605 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) under the control of the CPU 601 to obtain image data. The terminal device 130 may have an imaging means such as a CCD (Charge Coupled Device) sensor instead of the CMOS sensor 605. The imaging element I / F 606 is a circuit that controls the driving of the CMOS sensor 605. The acceleration / direction sensor 607 is an electronic magnetic compass that detects geomagnetism, a gyrocompass, an acceleration sensor, or other such sensor. The media I / F 609 controls the reading or writing (storage) of data from / to a media (storage media) 608 such as a flash memory. The GPS receiver 610 receives GPS signals from GPS satellites.

[0056] The terminal device 130 also includes a long-distance communication circuit 611, an antenna 611a of the long-distance communication circuit 611, a CMOS sensor 612, an image sensor I / F 613, a microphone 614, a speaker 615, an audio input / output I / F 616, a display 617, an external device connection I / F 618, a short-distance communication circuit 619, an antenna 619a of the short-distance communication circuit 619, and a touch panel 620.

[0057] Of these, the long-distance communication circuit 611 is a circuit that communicates with other devices, for example, via a communication network. The CMOS sensor 612 is a type of built-in imaging means that captures an image of a subject and obtains image data under the control of the CPU 601. The image sensor I / F 613 is a circuit that controls the drive of the CMOS sensor 612. The microphone 614 is a built-in circuit that converts sound into an electrical signal. The speaker 615 is a built-in circuit that converts an electrical signal into physical vibrations to generate sound such as music or voice. The sound input / output I / F 616 is a circuit that processes the input / output of sound wave signals between the microphone 614 and the speaker 615 under the control of the CPU 601.

[0058] The display 617 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. The external device connection I / F 618 is an interface for connecting various external devices. The short-distance communication circuit 619 includes a circuit for performing short-distance wireless communication. The touch panel 620 is a type of input means that allows a user to operate the terminal device 130 by pressing the display 617.

[0059] 6. Moreover, the terminal device 130 includes a bus line 621. The bus line 621 includes an address bus, a data bus, and the like for electrically connecting the components such as the CPU 601 shown in FIG.

[0060] <Functional configuration> 7 is a diagram illustrating an example of a functional configuration of an information processing system according to an embodiment. In the example of FIG. 7, an authentication system 200 includes an information processing device 110, a drone 120, and an access authentication server 700.

[0061] (Functional configuration of information processing device) The information processing device 110 realizes a communication unit 731, a drone operation unit 732, and the like, for example, by executing a predetermined program in the CPU 401 in Fig. 4. Note that at least a part of the above-mentioned functional configurations may be realized by hardware.

[0062] The communication unit 731 performs wireless communication with the drone 120 using, for example, the communication I / F 408 in FIG. 4 in a predetermined wireless communication method.

[0063] The drone operation unit 732, for example, displays an operation screen of the drone 120 on the display 406 in Fig. 4 or the like, and transmits a control signal according to the operation of the operator 111 to the drone 120 via the communication unit 711, thereby operating the drone 120. In addition, the drone operation unit 732 displays an image captured by the drone 120 on the display 406 in Fig. 4 or the like.

[0064] (Drone functional configuration) The drone (authentication device) 120, for example, by executing a predetermined program on the CPU 501 in Figure 5, realizes a communication unit 721, an image acquisition unit 722, a first sound wave output unit 723, a judgment unit 724, a second sound wave output unit 725, an authentication unit 726, a flight control unit 727, and a memory unit 728, etc.

[0065] The communication unit 721 communicates with the information processing device 110 by predetermined wireless communication, for example, using the communication device 504 in Fig. 5. In addition, the communication unit 721 connects the drone 120 to a communication network N such as the Internet or a LAN, for example, using the communication device 504, and communicates with the access authentication server 700, the terminal device 130, and the like.

[0066] The image acquisition unit 722 acquires an image of a person 131 in the vicinity of the drone 120 using, for example, the camera 121 in FIG.

[0067] 5, the first sound wave output unit 723 outputs a first sound wave representing ID1 (first identification information) that causes the terminal device 130 to execute a predetermined display process, for example, using the sound wave output circuit 506, the speaker 122, etc. For example, as described in FIG. 2, the first sound wave output unit 723 outputs a first sound wave representing ID1 that causes the terminal device 130 to transition from a state in which a first display screen is displayed (first display state) to a state in which a second display screen is displayed (second display state).

[0068] In this embodiment, there is no particular limitation on the method of representing the ID with sound waves. As an example, a multi-bit ID may be represented by expressing digital values ​​of 1 / 0 by turning sound waves of multiple frequencies on and off.

[0069] As a suitable example, the first sound wave output unit 723 and the second sound wave output unit 725 may output the first sound wave and the second sound wave at a frequency of 16 kHz or more within a frequency range (for example, 20 Hz to 20 kHz) that can be acquired by a microphone provided in the terminal device 130. Sound waves with a frequency of 16 kHz or more are difficult to hear by the average human ear and have a high degree of linearity, so they are suitable for use in transmitting sound waves representing an ID to the terminal device 130.

[0070] The determination unit 724 determines whether or not the terminal device 130 has executed a predetermined display process, from the image acquired by the image acquisition unit 722. For example, when the terminal device 130 transitions to a state in which the second display screen is displayed (second display state) after the first sound wave output unit 723 outputs the first sound wave, the determination unit 724 determines that the terminal device 130 has executed the predetermined display process.

[0071] When the terminal device 130 executes a predetermined display process, the second sound wave output unit 725 outputs to the terminal device 130 a second sound wave representing ID2 (second identification information) that identifies the drone (own device) 120.

[0072] The first sound wave output unit 723 and the second sound wave output unit 725 may be realized by one sound wave output unit 720. The sound wave output unit 720 can output various sound waves (for example, voice announcements, etc.) other than the first sound wave and the second sound wave.

[0073] The authentication unit 726 compares the authentication information sent by the terminal device 130, which includes ID2 and a terminal ID that identifies the terminal device 130, with pre-registered registration information, and authenticates the person 131 using the terminal device 130 or the terminal device 130.

[0074] For example, when the terminal device 130 receives a second sound wave representing ID2 output by the drone 120, it transmits authentication information including ID2 contained in the second sound wave, the terminal ID of the terminal device 130, and location information of the terminal device 130 to the access authentication server 700.

[0075] Furthermore, when the access authentication server 700 receives authentication information transmitted from the terminal device 130, it adds a date and time (time stamp) to the received authentication information, for example, as shown in FIG. 9(A), and stores the information in the access authentication DB 201.

[0076] Furthermore, the access authentication server 700 pre-stores, in the access authentication DB 201, registration information including the terminal ID, user ID, user name, etc. of users who are permitted to use the facility, as shown in FIG. 9(B), for example.

[0077] The authentication unit 726, for example, refers to the access authentication DB 201 and identifies the authentication information transmitted by the terminal device 130 from among a plurality of pieces of authentication information as shown in Fig. 9(A) based on the date and time, ID2, location information, etc. Furthermore, when the terminal ID included in the authentication information transmitted by the terminal device 130 is registered in the registration information as shown in Fig. 9(B), the authentication unit 726 permits authentication of the person 131 (or the terminal device 130) who uses the terminal device 130.

[0078] Preferably, as described in steps S10 to S13 of FIG. 2, the authentication unit 726 may transmit an authentication result indicating that authentication has been permitted to the terminal device 130 for which authentication has been permitted, and permit authentication of the person 131, etc., when the terminal device 130 transitions to the third display screen.

[0079] The flight control unit 727 controls the flight device 505 in Figure 5 according to control information transmitted from the drone operation unit 732 of the information processing device 110, for example, to move the drone 120 to a processing position or in a specified direction.

[0080] The memory unit 728 is realized, for example, by a program executed by the CPU 501 in FIG. 5, the storage device 503, the memory 502, etc., and stores various information such as the terminal ID of the drone 120.

[0081] (Functional configuration of the access authentication server) 4, the access authentication server 700 realizes a communication unit 701, an information management unit 702, an access authentication DB 201, etc. by executing a predetermined program in a CPU 401. At least a part of the above-mentioned functional configurations may be realized by hardware.

[0082] The communication unit 701, for example, uses the communication I / F 408 in FIG. 4 to connect the access authentication server 700 to the communication network N and communicates with the drone 120, the terminal device 130, and the like.

[0083] The information management unit 702 adds date and time as shown in FIG. 9A to the authentication information including the terminal ID, ID2, location information, etc. transmitted by the terminal device 130, and stores and manages it in the access authentication DB 201.

[0084] Furthermore, the information management unit 702 stores and manages in the access authentication DB 201, for example, registration information including the terminal ID, user ID, user name, etc. of users who are permitted to use the facility, as shown in FIG. 9(B).

[0085] The access authentication DB 201 is realized by, for example, a program executed by the CPU 401, the HD 404, the HDD controller 405, etc., and stores authentication information, registration information, etc. managed by the information management unit 702.

[0086] (Functional configuration of terminal device) The terminal device 130 realizes a communication unit 711, an acoustic wave acquisition unit 712, a display control unit 713, an authentication information transmission unit 714, an operation reception unit 715, and a memory unit 716, for example, by executing a predetermined program (application) on the CPU 601 in FIG. 6.

[0087] The communication unit 711 connects the terminal device 130 to the communication network N using, for example, the long-distance communication circuit 611 in FIG. 6, and communicates with the access authentication server 700, the drone 120, and the like.

[0088] The sound wave acquisition unit 712 acquires sound waves around the terminal device 130, including the first sound wave output by the first sound wave output unit 723, the second sound wave output by the second sound wave output unit 725, etc., using, for example, the microphone 614 and sound input / output I / F 616 in Figure 6.

[0089] When the sound wave acquired by the sound wave acquisition unit 712 is a first sound wave representing ID1 requesting execution of a predetermined display process, the display control unit 713 executes the predetermined display process. For example, the display control unit 713 transitions the first display screen displayed on the display 617 to a second display screen.

[0090] When the sound wave acquired by the sound wave acquisition unit 712 is, for example, a second sound wave representing ID2 for identifying the drone 120, the authentication information transmission unit 714 transmits authentication information including ID2 and the terminal ID of the terminal device 130 to the access authentication server 700. Note that the access authentication server 700 is an example of a predetermined transmission destination.

[0091] Preferably, when the sound wave acquired by the sound wave acquisition unit 712 is a second sound wave, the authentication information transmission unit 714 transmits authentication information including ID2 contained in the second sound wave, the terminal ID of the terminal device 130, and location information of the terminal device 130 to the access authentication server 700.

[0092] The operation reception unit 715 receives an input operation by the person 131 using the terminal device 130, for example, by using a touch panel or the like in Fig. 6. The storage unit 716 is realized by, for example, a program executed by the CPU 601 in Fig. 6, the storage device 604, the RAM 603, etc., and stores various information including the terminal ID of the terminal device 130, etc.

[0093] 7 is an example, and the authentication system 200 may have various functional configurations. For example, the function of the access authentication server 700 may be included in the information processing device 110 or the drone 120. In addition, the function of the drone 120 may be included in the information processing device 110, as shown in FIG. 8.

[0094] Fig. 8 is a diagram showing another example of the functional configuration of the information processing system according to an embodiment. In the example of Fig. 8, the information processing device 110 has an image acquisition unit 722, a first sound wave output unit 723, a determination unit 724, a second sound wave output unit 725, and an authentication unit 726, which are included in the drone 120 of Fig. 7. In addition, the information processing device 110 has an information management unit 702 and an access authentication DB 201, which are included in the access authentication server 700 of Fig. 7.

[0095] (Drone functional configuration) In the example of Fig. 8, the drone 120 realizes a communication unit 721, a flight control unit 727, a sound wave reproduction unit 801, an image capture unit 802, and the like, for example, by executing a predetermined program in the CPU 501 of Fig. 5. Of these, the communication unit 721 and the flight control unit 727 are similar to the communication unit 721 and the flight control unit 727 of the drone 120 of Fig. 7.

[0096] The sound wave reproducing unit 801 reproduces sound wave data transmitted by wireless communication from the information processing device 110 using, for example, the sound wave output circuit 506 and the speaker 122 in FIG. 5, and outputs the reproduced data as sound waves.

[0097] The photographing unit 802 transmits image data photographed by the camera 121 to the information processing device 110 via wireless communication.

[0098] (Functional configuration of information processing device) In the example of Figure 8, the information processing device (authentication device) 110 has, for example, a communication unit 731, an image acquisition unit 722, a first sound wave output unit 723, a judgment unit 724, a second sound wave output unit 725, an authentication unit 726, an information management unit 702, an access authentication DB 201, and a drone operation unit 732, by executing a predetermined program on the CPU 401 of Figure 4.

[0099] The processing contents of each functional configuration are basically the same as the processing contents explained in FIG. 7, so the following explanation will focus on the differences from the processing contents explained in FIG.

[0100] The communication unit 731 communicates with the drone 120 via a predetermined wireless communication, and also connects the information processing device 110 to the communication network N to communicate with the terminal device 130.

[0101] The image acquisition unit 722 receives image data captured by the imaging unit 802 of the drone 120 via the communication unit 711, thereby acquiring an image of a person 131 using the terminal device 130.

[0102] The first sound wave output unit 723 outputs the first sound wave using the drone 120 by transmitting sound wave data of the first sound wave representing ID1, which causes the terminal device 130 to execute a predetermined display process, to the drone 120 via the communication unit 711.

[0103] When the terminal device 130 executes a specified display process, the second sound wave output unit 725 outputs a second sound wave using the drone 120 by transmitting second sound wave data representing an ID that identifies the information processing device 110 or the drone 120 to the drone 120.

[0104] The processing of the functional components other than those described above may be similar to the processing of each functional component described with reference to Fig. 7. In this manner, it is sufficient that each functional component included in authentication system 200 is included in authentication system 200.

[0105] <Processing flow> Next, the process flow of the authentication method according to this embodiment will be described.

[0106] [First embodiment] (Authentication system processing) 10 is a flowchart showing an example of processing of the authentication system according to the first embodiment. This processing shows an example of processing executed by, for example, the authentication system 200 shown in FIG.

[0107] In step S1001, the image acquisition unit 722 of the authentication system 200 determines whether or not a person is included in the acquired image, and if a person is included in the acquired image, executes the processes from step S1002 onward. On the other hand, if a person is not included in the acquired image, the image acquisition unit 722 repeatedly executes the process of step S1001.

[0108] The process of step S1001 is an example of a trigger for starting the process of the authentication system shown in Fig. 10. For example, the authentication system 200 may start the process of Fig. 10 in response to a start operation by the operator 111. Also, the authentication system 200 may start the process of Fig. 10 when, for example, face authentication of a person included in an image is performed and the face authentication fails.

[0109] In step S1002, the sound wave output unit 720 of the authentication system 200 outputs a voice announcement to the person 131 included in the image to instruct the person 131 to start an application and display a screen. Note that this process may be performed by the operator 111 using a microphone of the headset 416, for example.

[0110] In step S1003, the determination unit 724 of the authentication system 200 determines whether or not the first display screen 310a as shown in FIG. 3(A) has been displayed by the terminal device 130 from the image acquired by the image acquisition unit 722. If the first display screen has been displayed, the authentication system 200 shifts the process to step S1004. On the other hand, if the first display screen has not been displayed, the authentication system 200 shifts the process to step S1010.

[0111] In step S1004, the first sound wave output unit 723 of the authentication system 200 outputs a first sound wave representing ID1 to the terminal device 130 used by the person 131, for example.

[0112] In step S1005, the determination unit 724 determines whether or not the second display screen 310b as shown in Fig. 3(A) has been displayed by the terminal device 130 from the image acquired by the image acquisition unit 722. If the second display screen has been displayed, the authentication system 200 shifts the process to step S1006. On the other hand, if the second display screen has not been displayed, the authentication system 200 shifts the process to step S1010.

[0113] When proceeding to step S1006, the second sound wave output unit 725 of the authentication system 200 outputs a second sound wave representing the ID2 that identifies the drone 120 to the terminal device 130 used by the person 131.

[0114] In step S1007, the authentication unit 726 of the authentication system 200 judges whether or not the authentication information transmitted by the terminal device 130 has been registered in the access authentication DB 201 within a predetermined time. For example, the authentication unit 726 judges whether or not the authentication information transmitted by the terminal device 130 has been registered based on the date and time, ID2, location information, and the like of multiple pieces of authentication information as shown in Fig. 9(A) stored in the access authentication DB 201.

[0115] If the authentication information of the terminal device 130 is registered in the access authentication DB 201, the authentication unit 726 shifts the process to step S1008. On the other hand, if the authentication information of the terminal device 130 is not registered in the access authentication DB 201, the authentication unit 726 shifts the process to step S1010.

[0116] In step S1008, the authentication unit 726 compares the authentication information transmitted by the terminal device 130 with, for example, registration information as shown in Fig. 9(B) to determine whether to permit authentication (authentication OK) or reject authentication (authentication NG). For example, when the terminal ID included in the authentication information transmitted by the terminal device 130 is registered in the registration information as shown in Fig. 9(B), the authentication unit 726 permits authentication of the terminal device 130 and the person 131 who uses the terminal device 130. On the other hand, when the terminal ID included in the authentication information transmitted by the terminal device 130 is not registered in the registration information, the authentication unit 726 rejects authentication of the terminal device 130 and the person 131 who uses the terminal device 130.

[0117] If authentication is permitted (authentication is OK), authentication system 200 shifts the process to step S1009. On the other hand, if authentication is rejected (authentication is NG), authentication system 200 shifts the process to step S1010.

[0118] In step S1009, authentication system 200 executes a process for the case where authentication is OK, such as that shown in FIG.

[0119] In step S1010, authentication system 200 executes a process for the case of authentication NG, such as that shown in FIG.

[0120] (Processing if authentication is OK) Fig. 11 is a flowchart showing an example of a process when authentication is OK according to the first embodiment. This process shows an example of a process when authentication is OK, executed by authentication system 200 in step S1009 in Fig. 10, for example.

[0121] In step S1101, the authentication unit 726 registers that authentication of the terminal device 130 has been permitted in the access authentication DB 201. For example, the authentication unit 726 sets the "authentication result" of the authentication information as shown in Fig. 9(A) to "OK."

[0122] In step S1102, the authentication system 200 notifies the terminal device 130 of an authentication result indicating that authentication has been permitted. For example, the access authentication server 700 may transmit this authentication result to the terminal device 130 via the communication network N. In this case, the access authentication server 700 stores, for example, the source address of the terminal device 130 in the authentication information as shown in Fig. 9(A). As another example, the authentication result may be output by the authentication unit 726 using the sound wave output unit 720 as a sound wave including an ID indicating the authentication result.

[0123] In step S1103, the determination unit 724 determines whether or not the terminal device 130 has displayed, for example, a third display screen 310c as shown in FIG. 3(A) from the image acquired by the image acquisition unit 722. If the third display screen is displayed, the authentication system 200 shifts the process to step S1104. On the other hand, if the third display screen is not displayed, the authentication system 200 shifts the process to step S1105. Note that the state in which the third display screen is displayed is an example of the third display state.

[0124] When the process proceeds to step S1104, the sound wave output unit 720 of the authentication system 200 outputs a voice announcement indicating that the authentication has been completed (for example, that the use of the facility has been permitted, etc.). Note that this process may be performed by the operator 111 using a microphone such as the headset 416 to make the announcement.

[0125] On the other hand, in step S 1105 , the authentication unit 726 of the authentication system 200 cancels the authentication permission of the terminal device 130 registered in the access authentication DB 201 .

[0126] In step S1006, authentication system 200 executes a process for the case of authentication NG, such as that shown in FIG.

[0127] (Processing in case of authentication failure) Fig. 12 is a flowchart showing an example of a process in the case of authentication NG according to the first embodiment. This process shows an example of a process in the case of authentication NG executed by the authentication system 200 in, for example, step S1010 in Fig. 10 and step S1106 in Fig. 11.

[0128] In step S1201, the sound wave output unit 720 of the authentication system 200 outputs a voice announcement notifying the failure of the authentication and a signal to retry the authentication (e.g., waving a hand). Note that this process may be performed by the operator 111 using a microphone of the headset 416 or the like.

[0129] In steps S1202 and S1203, authentication system 200 judges, from the image acquired by image acquisition unit 722, whether or not person 131 using terminal device 130 is making the signal notified by the voice announcement. If a signal is being made, authentication system 200 shifts the process to step 1202. On the other hand, if a signal is not being made, authentication system 200 shifts the process to step S1206. Note that this process is executed by, for example, judgment unit 724. As another example, at least a part of this process may be executed by operator 111 or the like.

[0130] In steps S1204 and S1205, authentication system 200 determines whether the number of retries is equal to or less than a predetermined number, and if the number of retries is equal to or less than the predetermined number, for example, executes (retries) the processes from step S1002 onward in Fig. 10 again. On the other hand, if the number of retries is not equal to or less than the predetermined number, the process proceeds to step S1206.

[0131] In steps S1206 and S1207, the authentication system 200 notifies a security guard or the like that a person 131 who is not permitted to use the facility is present, and outputs a voice announcement indicating that the authentication has failed. Note that this process may be executed by the operator 111, for example.

[0132] (Terminal device processing) 13 is a flowchart showing an example of processing of the terminal device according to the first embodiment. This processing shows an example of processing on the terminal device 130 side corresponding to the processing of the authentication system 200 described with reference to FIGS.

[0133] In step S1301, when an application corresponding to the authentication system 200 is started on the terminal device 130, the terminal device 130 executes the processes from step S1302 onward. Alternatively, the terminal device 130 may execute the processes from step S1302 onward when a predetermined operation is performed on the operation screen of the application.

[0134] In step S1302, the display control unit 713 of the terminal device 130 changes the color of the display screen displayed by the terminal device 130 to red, and displays, for example, a first display screen 310a as shown in Fig. 3(A). Preferably, the display control unit 713 sets the brightness of the screen to maximum at this time.

[0135] In step S1303, the terminal device 130 waits until the sound wave acquirer 712 receives a first sound wave representing ID1, and when the first sound wave is received, the terminal device 130 transitions to step S1304.

[0136] In step S1304, the display control unit 713 of the terminal device 130 changes the color of the display screen displayed by the terminal device 130 to yellow, and displays, for example, a second display screen 310b as shown in FIG. 3(A).

[0137] In step S1305, when the sound wave acquisition unit 712 receives the second sound wave representing ID2, in step S1306, the authentication information transmission unit 714 transmits authentication information to the authentication system 200 using the communication unit 711. This authentication information includes, for example, a terminal ID for identifying the terminal device 130, ID2 represented by the second sound wave, location information indicating the location of the terminal device 130, and the like.

[0138] In step S1307, if the communication unit 711 (or the sound wave acquisition unit 712) of the terminal device 130 receives an authentication result indicating that the authentication is OK, the terminal device 130 shifts the process to step S1308. On the other hand, if the authentication result indicating that the authentication is OK is not received within a predetermined time (including the case where the authentication result indicating that the authentication is NG is received), the terminal device 130 shifts the process to step S1310.

[0139] In step S1308, the display control unit 713 of the terminal device 130 changes the color of the display screen displayed by the terminal device 130 to green, and displays, for example, a third display screen 310c as shown in FIG. 3(A).

[0140] In step S1308, if the communication unit 711 (or the sound wave acquisition unit 712) of the terminal device 130 does not receive an authentication result indicating that the authentication is NG within a predetermined time, the terminal device 130 ends the process in Fig. 13. On the other hand, if an authentication result indicating that the authentication is NG is received within the predetermined time, the terminal device 130 shifts the process to step S1310.

[0141] In step S1310, the display control unit 713 of the terminal device 130 changes the color of the display screen displayed by the terminal device 130 to red, and displays, for example, the first display screen 310a as shown in FIG. 3(A) again.

[0142] (Information Processing System) Fig. 14 is a sequence diagram showing an example of processing of the information processing system according to the first embodiment. This processing shows an example of processing of the entire information processing system 100 corresponding to the processing of Figs. 10 to 13. Note that the following description will be given on the assumption that a person 131 using the terminal device 130 is a user who is permitted to use the facility.

[0143] In step S1401, when the image acquisition unit 722 of the authentication system 200 detects the person 131 to be authenticated, in step S1402, the sound wave output unit 720 outputs a voice announcement instructing the start of an application and the display of a screen. Note that this process corresponds to, for example, the processes in steps S1001 and S1002 in FIG. 10.

[0144] In step S1403, the terminal device 130 starts an application in response to, for example, an operation by the person 131, and displays a first display screen. This process corresponds to, for example, the processes in steps S1301 and S1302 in FIG.

[0145] In step S1404, when the determination unit 724 of the authentication system 200 confirms that the first display screen has been displayed by the terminal device 130, in step S1405, the first sound wave output unit 723 outputs a first sound wave representing ID1. Note that this process corresponds to, for example, the processes in steps S1003 and S1004 in FIG.

[0146] When the sound wave acquisition unit 712 of the terminal device 130 receives the first sound wave in step S1406, the display control unit 713 displays the second display screen in step S1407. Note that this process corresponds to, for example, the processes in steps S1303 and S1304 in FIG.

[0147] In step S1407, when the determination unit 724 of the authentication system 200 confirms that the second display screen has been displayed by the terminal device 130, in step S1408, the second sound wave output unit 725 outputs a second sound wave representing ID2. Note that this process corresponds to, for example, the processes in steps S1005 and S1006 in FIG. 10.

[0148] In step S1409, the display control unit 713 of the terminal device 130 may display, for example, a screen for confirming the transmission of authentication information. Here, when the operation accepting unit 715 accepts an approval operation by the person 131, the process of step S1410 is executed. Note that this process is optional, and the process of step 1410 may be automatically executed by omitting this process.

[0149] In step S1410, the authentication information transmission unit 714 of the terminal device 130 transmits authentication information including, for example, the terminal ID, ID2, location information, and the like, to the authentication system 200 using the communication unit 711. Note that this process corresponds to, for example, the process of step 1306 in FIG.

[0150] In step S1411, when the information management unit 702 of the authentication system 200 receives the authentication information transmitted by the terminal device 130, it adds a date and time (time stamp) to the authentication information and registers it in the access authentication DB 201, for example, as shown in FIG.

[0151] In step S1412, when authentication information of terminal device 130 is registered in access authentication DB 201, authentication unit 726 of authentication system 200 compares the authentication information of terminal device 130 with pre-registered registration information to authenticate terminal device 130. As described above, in this case, person 131 is a user permitted to use the facility, so the authentication result is OK. This process corresponds to, for example, the processes of steps S1007 and S1008 in FIG. 10.

[0152] In step S1413, authentication system 200 notifies terminal device 130 of the authentication result indicating that authentication has been permitted. Note that this process corresponds to, for example, the process of step S1102 in FIG.

[0153] In step S1414, when the communication unit 711 of the terminal device 130 receives an authentication result indicating that the authentication is OK, the display control unit 713 displays a third display screen. Note that this process corresponds to, for example, the processes of steps S1307 and S1308 in FIG. 13.

[0154] In step S1415, when the determination unit 724 of the authentication system 200 determines that the third display screen has been displayed by the terminal device 130, in step S1416, the sound wave output unit 720 outputs a voice announcement indicating that the authentication has been completed. Note that this process corresponds to, for example, the processes in steps S1103 and S1104 in FIG. 11.

[0155] Through the above process, the authentication system 200 authorizes the authentication of the person 131 who uses the terminal device 130. This allows the person 131 who uses the terminal device 130 to use the facility.

[0156] [Second embodiment] In the second embodiment, an example will be described in which the first sound wave output by the authentication system 200 includes, for example, ID2 (second identification information) for identifying the drone 120.

[0157] Fig. 15 is a sequence diagram showing an example of processing of the information processing system according to the second embodiment. Note that detailed description of processing contents similar to the processing of the information processing system according to the first embodiment described in Fig. 14 will be omitted here.

[0158] In step S1501, when the image acquisition unit 722 of the authentication system 200 detects the person 131 to be authenticated, in step S1502, the sound wave output unit 720 outputs a voice announcement instructing the start of an application and the display of a screen.

[0159] In step S1503, the terminal device 130 starts an application in response to an operation by the person 131, for example, and displays a first display screen.

[0160] In step S1504, when the judgment unit 724 of the authentication system 200 confirms that the first display screen has been displayed by the terminal device 130, in step S1505, the first sound wave output unit 723 outputs a first sound wave representing ID1 and ID2.

[0161] In step S1506, the display control unit 713 of the terminal device 130 determines whether or not the drone 120 has been authenticated based on the ID2 represented by the first sound wave. If the drone 120 has not been authenticated, for example, the process from step S1406 onward in FIG. 14 is executed.

[0162] On the other hand, if authentication has been completed for the drone 120, in step S1507, the display control unit 713 of the terminal device 130 stops displaying the second display screen and displays the third display screen.

[0163] In step S1508, the authentication information transmitting unit 714 of the terminal device 130 uses the communication unit 711 to transmit to the authentication system 200 authentication information including, for example, the terminal ID, ID2, and location information.

[0164] In step S1509, the authentication unit 726 of the authentication system 200 compares the authentication information received from the terminal device 130 with the information of authenticated terminal devices registered in the access authentication DB 201, and determines whether the terminal device 130 has been authenticated.

[0165] If it is confirmed that the terminal device 130 has been authenticated, then in step S1510, the sound wave output unit 720 outputs a voice announcement indicating that the authentication has been completed.

[0166] By the above-described process, in the information processing system 100 according to the second embodiment, if the terminal device 130 has already been successfully authenticated, for example, part of the authentication process as shown in FIG. 4 can be omitted.

[0167] <Registration process> Here, an example of a process for registering a person 131 or the like who uses the terminal device 130 in the authentication server as a user who can use the facility will be described.

[0168] (Registration process 1) 16 is a sequence diagram showing an example of a registration process according to an embodiment. This process will be described as an example of a process for registering information on employees who can use facilities of a company or the like in the access authentication DB 201.

[0169] In step 1601, for example, a person 131 (such as an employee) using a terminal device 130 installs an application compatible with the authentication system 200 in the terminal device 130 and starts it.

[0170] In step S1602, the display control unit 713 of the terminal device 130 displays a registration screen for the user, and the operation receiving unit 715 receives an operation by the person 131 to register registration information such as an employee ID, name, and face photo.

[0171] In step S 1603 , the communication unit 711 of the terminal device 130 transmits the accepted registration information to the access authentication server 700 .

[0172] In step S1604, when the information management unit 702 of the access authentication server 700 receives the registration information from the terminal device 130, it determines whether or not the registration information can be registered. For example, if the terminal ID is not registered and the employee ID and name are registered in the employee list, the information management unit 702 determines that registration is possible. On the other hand, if the terminal ID has already been registered or if the employee ID, name, etc. are not registered in the employee list, the information management unit 702 determines that registration is not possible.

[0173] If it is determined that registration is possible, the processes of steps S1605 to S1607 are executed. On the other hand, if it is determined that registration is not possible, for example, the processes of steps S1611 and S1612 are executed.

[0174] In step S1605, the information management unit 702 of the access authentication server 700 registers the registration information determined to be registerable in the access authentication DB 201. In addition, in step S1606, the communication unit 701 of the access authentication server 700 transmits a registration result indicating that the registration has been completed to the terminal device 130.

[0175] In step S1607, the display control unit 713 of the terminal device 130 displays a registration completion screen indicating that registration has been completed.

[0176] By the above process, information on employees who have used the facilities of a company or the like can be registered in the access authentication DB 201.

[0177] On the other hand, in step S1611, the communication unit 701 of the access authentication server 700 transmits a registration result indicating that the registration has failed to the terminal device 130. This registration result (failure) includes, for example, a reason for the failure indicating why the registration has failed.

[0178] In step S16121, the display control unit 713 of the terminal device 130 displays the reason for the failure on a registration failure screen indicating that the registration has failed.

[0179] (Registration process 2) 17 is a sequence diagram showing another example of the registration process according to an embodiment. This process will be described as an example of the process in which the authentication system 200 registers, for example, information on a person 131 who has purchased a facility admission ticket or a right of use such as fishing rights in the access authentication DB 201.

[0180] In step 1701, for example, a person 131 using a terminal device 130 installs an application compatible with the authentication system 200 in the terminal device 130 and starts it up.

[0181] In step S1702, the display control unit 713 of the terminal device 130 displays a screen for purchasing a usage right, and the operation receiving unit 715 receives an operation by the person 131 to register purchase information such as payment information, personal registration information, and a facial photograph.

[0182] In step S 1703 , the communication unit 711 of the terminal device 130 transmits the accepted purchase information to the access authentication server 700 .

[0183] In step S1704, when the information management unit 702 of the access authentication server 700 receives the purchase information from the terminal device 130, it determines whether or not the usage right can be purchased based on the purchase information. For example, the information management unit 702 determines that the purchase is possible if the payment is successful using the payment information included in the purchase information and there is no required information that has not been input. On the other hand, the information management unit 702 determines that the purchase is not possible if the payment is unsuccessful using the payment information included in the registration information or if there is required information that has not been input.

[0184] If it is determined that the purchase is possible, the process proceeds to steps S1705 to S1707. On the other hand, if it is determined that the purchase is not possible, the process proceeds to steps S1711 and S1712, for example.

[0185] In step S1705, the information management unit 702 of the access authentication server 700 registers the purchase information determined to be purchase-approved in the access authentication DB 201. In addition, in step S1706, the communication unit 701 of the access authentication server 700 transmits a purchase result indicating that the purchase has been completed to the terminal device 130.

[0186] In step S1707, the display control unit 713 of the terminal device 130 displays a purchase completion screen indicating that the purchase has been completed.

[0187] Through the above process, the authentication system 200 can register, in the access authentication DB 201, information on a person 131 who has purchased a facility admission ticket or a right of use such as fishing rights for fishing, and information on the terminal device 130 used by the person 131, for example.

[0188] On the other hand, when the process proceeds to step S1711, the communication unit 701 of the access authentication server 700 transmits a purchase result indicating that the purchase of the usage right has failed to the terminal device 130. This purchase result (failure) includes, for example, a failure reason indicating the reason why the purchase has failed.

[0189] In step S16121, the display control unit 713 of the terminal device 130 displays the reason for failure on a purchase failure screen indicating that the purchase has failed.

[0190] [Third embodiment] Fig. 18 is a sequence diagram showing an example of processing of the information processing system according to the third embodiment. This processing shows an example of authentication processing for authenticating a person 131 who has purchased a usage right by, for example, the registration processing explained in Fig. 17. Among the processing shown in Fig. 18, the processing of steps S1401 to S1411 is similar to the processing explained in Fig. 14, so here, differences from the first embodiment will be mainly explained.

[0191] In step S1801, when authentication information of the terminal device 130 is registered in the access authentication DB 201, the authentication unit 726 of the authentication system 200 authenticates the terminal device 130 by comparing the authentication information of the terminal device 130 with pre-registered purchase information.

[0192] Here, if the person 131 who uses the terminal device 130 has already purchased a usage right in the registration process of Fig. 17, the authentication result is OK. In this case, for example, the process after step S1412 in Fig. 14 is executed.

[0193] On the other hand, if the person 131 using the terminal device 130 has not yet purchased a usage right, the authentication result is NG. In this case, the processes in and after step S1802 in FIG. 18 are executed.

[0194] In step S1802, the sound wave output unit 720 of the authentication system 200 outputs a voice announcement encouraging the purchase of a usage right.

[0195] In step S1803, person 131 using terminal device 130 purchases a usage right by, for example, executing the processes in and after step S1702 in Fig. 17. Here, when the purchase of the usage right is completed, terminal device 130 displays a fourth display screen different from the first to third display screens in step S1804. Note that the state in which the fourth display screen is displayed is an example of a fourth display state.

[0196] In step S1805, when the determination unit 724 of the authentication system 200 confirms that the fourth display screen has been displayed by the terminal device 130, the authentication process is retried in step S1806. For example, the information processing system 100 executes again the process after step S1405 in FIG. 14 or FIG.

[0197] In this way, each process described in the first embodiment can be modified or applied in various ways depending on the application or purpose.

[0198] <Application Examples> In each of the above embodiments, the drone 120 or the information processing device 110 has been described as being an authentication device. For example, the drone 120 having a hardware configuration as shown in FIG. 5 is an example of an authentication device.

[0199] For example, the authentication device may be a drone 120 having a parametric speaker 1610 as shown in FIG. 19(A) in addition to the hardware configuration of the drone 120 shown in FIG.

[0200] The parametric speaker 1610 is an acoustic system that utilizes ultrasound to provide sharp, precise sound.

[0201] The parametric speaker 1610 generates ultrasonic waves modulated with a strong sound pressure exceeding about 110 dB by, for example, applying amplitude modulation, DSB (Double Sideband) modulation, SSB (Single Sideband) modulation, etc. to the ultrasonic waves. This generates an audible sound due to the "nonlinear characteristics" of the ultrasonic waves as they propagate through the air.

[0202] A typical ultrasonic speaker can only achieve a directivity of about 60 to 70 degrees by itself, but when multiple ultrasonic speakers are arranged on a flat surface to form a parametric array, the directivity becomes extremely sharp. A unit in which multiple ultrasonic speakers are arranged in this way is called a parametric speaker.

[0203] An output range 1611 of sound waves output by a parametric speaker 1610 can be made narrower than an output range 1612 of a general speaker 122. Therefore, for example, as shown in Fig. 19(B), it becomes possible to selectively output a first sound wave and a second sound wave toward a person 131 using the terminal device 130 and the terminal device 130.

[0204] In addition, it is desirable for the drone 120 to have a lighting device such as a spotlight 507 so that the drone 120 can find the person 131 even when the surroundings are dark.

[0205] In addition, in each of the above embodiments, the drone 120 is controlled using the information processing device 110 having a hardware configuration as shown in Fig. 4, but the information processing device that controls the drone 120 may be, for example, a small operation device 2010 as shown in Fig. 20(A). In this case, it is preferable that the operation device 2010 has, for example, a touch panel display 2011 that displays a plurality of selectable operation contents as shown in Fig. 20(B).

[0206] In addition, instead of the drone 120, the authentication system 200 may use a mobile device capable of moving on a road or floor, such as a security robot 2020 shown in Figure 10 (C), to photograph a person 131 using a terminal device 130 and output sound waves.

[0207] Furthermore, the authentication system 200 may use, instead of the drone 120, a device that does not have a mobile function, such as a digital signage 2030 shown in FIG. 10(d) or a surveillance camera with a speaker, to capture an image of a person 131 using a terminal device 130 and output sound waves.

[0208] 20(D), for example, the digital signage 2030 has a camera 2031, a speaker 2032, and a display 2033. In this case, the digital signage 2030 uses the camera 2031 to capture an image of the person 131 using the terminal device 130, and outputs a first sound wave and a second sound wave using the speaker 2032. The digital signage 2030 may also display a text message on the display 2033 instead of (or in addition to) the audio announcement output in step S1402 of FIG. 14, for example.

[0209] As described above, according to each embodiment of the present invention, in authentication system 200 that authenticates a person using a camera, it becomes possible to authenticate a person from a remote location without relying on face authentication.

[0210] <Supplementary Information> Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0211] Additionally, the devices described in the examples are merely one of a number of computing environments for implementing the embodiments disclosed herein. In one embodiment, the authentication system 200 includes a number of computing devices, such as a server cluster. The computing devices are configured to communicate with each other via any type of communication link, including a network, shared memory, etc., and perform the processes disclosed herein. Similarly, the terminal device 130 may include a number of computing devices configured to communicate with each other.

[0212] Furthermore, authentication system 200 and terminal device 130 can be configured to share the disclosed processing steps, for example, the processes shown in Figures 10 to 19, in various combinations. Also, the functional components of authentication system 200 may be integrated into one server device, or may be separated into multiple devices. [Explanation of symbols]

[0213] 100 Information Processing Systems 110 Information processing device (an example of an authentication device) 120 Drone (an example of an authentication device) 130 Terminal Equipment 131 People 200 Authentication System 722 Image Acquisition Unit 723 First sonic output unit 724 Judgment Department 725 Second Sonic Output Unit 726 Authentication Department [Prior art documents] [Patent documents]

[0214] [Patent Document 1] JP 2018-173788 A

Claims

1. an image acquisition unit that acquires an image of a person; a first sound wave output unit that outputs a first sound wave representing first identification information that causes a terminal device used by the person to execute a predetermined display process; a determination unit that determines whether or not the terminal device has executed the predetermined display process based on the image; a second sound wave output unit that outputs, when the terminal device executes the predetermined display process, a second sound wave representing second identification information that identifies the terminal device; an authentication unit that authenticates the person or the terminal device by comparing authentication information, which is transmitted by the terminal device and includes the second identification information and terminal identification information that identifies the terminal device, with pre-registered registration information; An authentication device comprising:

2. the first sound wave output unit outputs the first sound wave representing the first identification information that causes the terminal device to transition from a first display state to a second display state; The authentication device according to claim 1 , wherein the determination unit determines that the terminal device has executed the predetermined display process when the terminal device has transitioned to the second display state.

3. The authentication device according to claim 2, wherein the authentication unit notifies the terminal device of an authentication result when permitting authentication of the person, and revokes permission for authentication of the person if the terminal device does not transition to a third display state in response to the authentication result.

4. the first sound wave output unit outputs the first sound wave representing the first identification information and the second identification information; The authentication device according to claim 2, wherein the authentication unit omits at least a part of the authentication process for authenticating the person or the terminal device when the terminal device transitions to a fourth display state indicating that it has been authenticated in response to the first sound wave.

5. the first sound wave output unit outputs the first sound wave representing the first identification information to cause the terminal device to display a predetermined screen; The authentication device according to claim 1 , wherein the determination unit determines that the terminal device has executed the predetermined display process when the terminal device displays the predetermined screen.

6. the first sound wave output unit outputs to the terminal device the first sound wave representing the first identification information for causing a display screen to be displayed that prompts the person to perform a predetermined action; The authentication device according to claim 1 , wherein the determination unit determines that the terminal device has executed the predetermined display process when the person performs the predetermined motion.

7. A terminal device capable of acquiring a sound wave output by the authentication device according to any one of claims 1 to 6, a display control unit that executes a predetermined display process when the sound wave acquired from the authentication device is a first sound wave representing first identification information that requests execution of the predetermined display process; an authentication information transmitting unit that transmits authentication information including the second identification information and terminal identification information that identifies the terminal device to a predetermined destination when the sound wave acquired from the authentication device is the second sound wave including second identification information that identifies the authentication device; A terminal device having the above configuration.

8. an image acquisition unit that acquires an image of a person; a first sound wave output unit that outputs a first sound wave representing first identification information that causes a terminal device used by the person to execute a predetermined display process; a determination unit that determines whether or not the terminal device has executed the predetermined display process based on the image; a second sound wave output unit that outputs a second sound wave including second identification information different from the first identification information to the terminal device when the terminal device executes the predetermined display process; an authentication unit that authenticates the person or the terminal device by comparing authentication information, which is transmitted by the terminal device and includes the second identification information and terminal identification information that identifies the terminal device, with pre-registered registration information; An authentication system comprising:

9. A terminal device capable of acquiring the sound wave output by the authentication system according to claim 8, a display control process for executing a predetermined display process when the sound wave acquired from the authentication system is a first sound wave representing first identification information requesting execution of the predetermined display process; an authentication information transmission process for transmitting, to the authentication system, authentication information including the second identification information and terminal identification information for identifying the terminal device, when the sound wave acquired from the authentication system is a second sound wave representing second identification information different from the first identification information; A program to execute.

10. An authentication method for authenticating a person who uses a terminal device or the terminal device, comprising: The computer An image acquisition process for acquiring an image of the person; a first sound wave output process for outputting a first sound wave representing first identification information that causes a terminal device used by the person to execute a predetermined display process; a determination process for determining whether or not the terminal device has executed the predetermined display process based on the image; a second sound wave output process for outputting, to the terminal device, a second sound wave including second identification information different from the first identification information, when the terminal device executes the predetermined display process; an authentication process for authenticating the person by comparing authentication information transmitted by the terminal device, the authentication information including the second identification information and terminal identification information for identifying the terminal device, with pre-registered registration information; The authentication method to be performed.

11. A program for causing a computer to execute the authentication method according to claim 10.

Images