Information processing device, information processing method, and recording medium

Abstract

This information processing device (10) comprises: an object detection means (110) for detecting an object; a face detection means (120) for detecting the face of a subject; a face recognition means (130) for executing face recognition using a face image of the subject; an acquisition means (135) for acquiring status information indicating a status; and a control means (140) for controlling the degree of priority of the object detection means, the face detection means, and the face recognition means on the basis of the status information. Such an information processing device makes it possible to suitably control the degree of priority of object detection, face detection, and face recognition and to suitably execute respective processes.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] There are known devices that execute various controls in a vehicle based on the results of biometric authentication. For example, Patent Document 1 discloses a technology that sets the vehicle doors to an unlock standby state (a state in which the doors can be unlocked simply by touching a touch sensor on the door handle) when facial authentication is successful. Patent Document 2 discloses a technology that unlocks the doors and starts the engine when facial authentication is successful.

[0003] As another related technique, Patent Document 3 discloses a technique for unlocking corresponding vehicle doors depending on the configuration of the driver and accompanying persons.

[0004] Japanese Patent Application Laid-Open No. 2006-161545 Japanese Patent Application Laid-Open No. 2021-046741 Japanese Patent Application Laid-Open No. 2021-075265

[0005] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0006] One aspect of the information processing device disclosed herein comprises an object detection means for detecting an object, a face detection means for detecting the face of a target, a face authentication means for performing face authentication using a face image of the target, an acquisition means for acquiring situation information indicating a situation, and a control means for controlling the priority of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0007] One aspect of the information processing method disclosed herein is an information processing device that includes an object detection means for detecting an object, a face detection means for detecting the face of a target, and a face authentication means for performing face authentication using a face image of the target, and acquires situation information indicating a situation, and controls the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0008] One aspect of the recording medium of this disclosure is an information processing device that includes an object detection means for detecting an object, a face detection means for detecting a face of a target, and a face authentication means for performing face authentication using a face image of the target. The recording medium has recorded thereon a computer program that causes the computer to execute an information processing method that acquires situation information indicating a situation and controls the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0009] 1. A block diagram showing the hardware configuration of an information processing device according to a first embodiment. 2. A block diagram showing the functional configuration of an information processing device according to a first embodiment. 3. A flowchart showing the flow of a face authentication operation in an information processing device according to a first embodiment. 4. A flowchart showing the flow of a priority control operation in an information processing device according to a first embodiment. 5. A flowchart showing the flow of a face authentication operation in an information processing device according to a second embodiment. 6. A side view showing the configuration of a vehicle in which an information processing device according to a third embodiment is installed. 7. A flowchart showing the flow of a priority control operation in an information processing device according to a third embodiment. 8. A block diagram showing the functional configuration of an information processing device according to a fourth embodiment. 9. A block diagram showing the functional configuration of an information processing device according to a fifth embodiment. 10. A block diagram showing the functional configuration of an information processing device according to a sixth embodiment. 11. A flowchart showing the flow of a door lock control operation in an information processing device according to a sixth embodiment. 12. A block diagram showing the functional configuration of an information processing device according to a seventh embodiment. 13. A flowchart showing the flow of an alert output operation in an information processing device according to a seventh embodiment. 14. A block diagram showing the functional configuration of an information processing device according to an eighth embodiment. 15. A flowchart showing the flow of a door lock control operation in an information processing device according to the eighth embodiment. 16. A flowchart showing the flow of a face authentication operation in an information processing device according to a ninth embodiment. 17. A block diagram showing the functional configuration of an information processing device according to a tenth embodiment.

[0010] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0011] First Embodiment An information processing apparatus according to a first embodiment will be described with reference to FIGS. 1 to 4. FIG.

[0012] (Hardware Configuration) First, the hardware configuration of the information processing apparatus according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing apparatus according to the first embodiment.

[0013] 1 , an information processing device 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, and a ROM (Read Only Memory) 13. The information processing device 10 may further include a storage device 14, an input device 15, and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0014] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks that perform object detection, face detection, and face authentication, as well as functional blocks that control the priorities of object detection, face detection, and face authentication, are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing device 10.

[0015] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0016] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0017] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0018] The storage device 14 stores data that is to be saved long-term by the information processing device 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0019] The input device 15 is a device that receives input instructions from a user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0020] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing device 10. The output device 16 may also be a speaker or the like that can output information related to the information processing device 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing device 10 as audio.

[0021] 1 may be provided in a device external to the information processing device 10. For example, the information processing device 10 may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, input device 15, and output device 16) may be provided in an external device connected to the information processing device 10. Furthermore, some of the computing functions of the information processing device 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0022] (Functional Configuration) Next, the functional configuration of the information processing device 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing device according to the first embodiment.

[0023] 2, the information processing device 10 according to the first embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, an acquisition unit 135, and a control unit 140. Each of the object detection unit 110, the face detection unit 120, the face authentication unit 130, the acquisition unit 135, and the control unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0024] The object detection unit 110 is configured to be able to detect objects. For example, the object detection unit 110 may be configured to acquire an image captured by a camera and detect an object captured in the acquired image. Alternatively, the object detection unit 110 may be configured to be able to detect objects using radar, a sensor, or the like. The object detection unit 110 may be configured to detect only moving objects (e.g., humans, animals, etc.) and not to detect stationary objects. The object detection unit 110 may be configured to detect objects using AI (artificial intelligence). More specifically, the object detection unit 110 may be configured to detect objects using an object detection model including a trained neural network.

[0025] The face detection unit 120 is configured to be able to detect the face of a target (i.e., a target of face authentication, which will be described later). For example, the face detection unit 120 may be configured to be able to detect the face of a human or animal detected by the object detection unit 110. In this case, the face detection unit 120 may perform face detection only when an object is detected by the object detection unit 110. The face detection unit 120 may be configured to acquire an image captured by a camera and detect a face captured in the acquired image. The face detection unit 120 may be configured to detect a face using AI. More specifically, the face detection unit 120 may be configured to detect the face of a target using a face detection model including a trained neural network.

[0026] The face authentication unit 130 is configured to perform face authentication using a target face image. The face authentication unit 130 may perform face authentication by comparing a pre-registered face image with the acquired face image. The face authentication unit 130 may perform face authentication on a face detected by the face detection unit 120. For example, after the face detection unit 120 detects a face from an image, the face authentication unit 130 may perform face authentication using information about the area in the image where the face is detected (face area). The face authentication unit 130 may perform face authentication based on, for example, facial features extracted from the face image. The face authentication unit 130 may be configured to perform face authentication using AI. More specifically, the face authentication unit 130 may be configured to perform face authentication using a face authentication model including a trained neural network.

[0027] The acquisition unit 135 is configured to acquire situation information indicating a situation. The acquisition unit 135 may acquire the situation information using, for example, a camera or various sensors. Alternatively, the acquisition unit 135 may acquire the situation information using communication with an external device (e.g., internet communication, etc.). The situation information may be, for example, information indicating the state of an object. For example, the situation information may include information regarding the position or posture of the object. Alternatively, the situation information may be information regarding the surrounding environment of the object. For example, the situation information may include information regarding the brightness around the object or information regarding objects present around the object (e.g., a vehicle used by the object, etc.). Alternatively, the situation information may include information regarding the status of each of the object detection unit 110, the face detection unit 120, and the face authentication unit 130. For example, the situation information may include information regarding whether the processing performed by each of the object detection unit 110, the face detection unit 120, and the face authentication unit 130 has been completed.

[0028] The control unit 140 is configured to control the priorities of the object detection unit 110, the face detection unit 120, and the face authentication unit 130. That is, the control unit 140 is configured to determine the priority and execution level of each of the object detection process performed by the object detection unit 110, the face detection process performed by the face detection unit 120, and the face authentication process performed by the face authentication unit 130. The control unit 140 may control the priorities by, for example, changing the allocation of the processor 11 and memory (i.e., RAM 12) used by the object detection unit 110, the face detection unit 120, and the face authentication unit 130. Alternatively, the control unit 140 may control the priorities by turning on and off the cameras used by the object detection unit 110, the face detection unit 120, and the face authentication unit 130, or by adjusting camera parameters (exposure, gain, etc.). More specific priority control by the control unit 140 will be described in detail in other embodiments described below.

[0029] The control unit 140 is configured to control the priority based on the situation information acquired by the acquisition unit 135. For example, the control unit 140 grasps the situation by analyzing the situation information. The control unit 140 then controls the priorities of the object detection unit 110, the face detection unit 120, and the face authentication unit 130 according to the situation. The control unit 140 may control each process executed by the object detection unit 110, the face detection unit 120, and the face authentication unit 130 so that it is executed in an optimal state according to the situation. Specific examples of situation-based control by the control unit 140 will be described in detail later.

[0030] (Facial Recognition Operation) Next, the flow of the facial recognition operation (i.e., the operations by the object detection unit 110, the face detection unit 120, and the facial recognition unit 130) by the information processing device 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the facial recognition operation in the information processing device according to the first embodiment.

[0031] 3, in the face authentication operation by the information processing device 10 according to the first embodiment, the object detection unit 110 first detects an object (step S101). If no object is detected, the subsequent processing may be omitted. If multiple objects are detected, the subsequent processing may be performed for each of the multiple objects.

[0032] Next, the face detection unit 120 detects the face of the target (step S102). Then, the face authentication unit 130 performs face authentication using the target face image (step S103). After performing face authentication, the face authentication unit 130 outputs the authentication result (step S104). For example, the face authentication unit 130 outputs information indicating that face authentication was successful, information indicating that face authentication was unsuccessful, or information indicating that face authentication could not be performed normally.

[0033] The information processing device 10 may be configured to be able to execute various processes based on the authentication result of the face authentication unit 130. For example, if face authentication is successful, the information processing device 10 may execute a process of permitting passage through a gate, a process of unlocking a door, etc. If face authentication is unsuccessful, the information processing device may execute a process of prohibiting passage through a gate, a process of locking a door, etc. The processes listed here are merely examples, and various other processes may be executed based on the authentication result of the face authentication unit 130.

[0034] (Priority Control Operation) Next, the flow of priority control operation by the information processing device 10 according to the first embodiment (i.e., operation of controlling priority by the control unit 140) will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of priority control operation in the information processing device according to the first embodiment.

[0035] 4 , in the priority control operation by the information processing device 10 according to the first embodiment, the acquisition unit 135 first acquires situation information (step S151). The situation information acquired by the acquisition unit 135 is output to the control unit 140. The control unit 140 then analyzes the situation based on the situation information acquired by the acquisition unit 135 (step S152). Specifically, the control unit 140 analyzes, based on the situation information, how much priority should be given to each of the object detection unit 110, the face detection unit 120, and the face authentication unit 130.

[0036] Next, the control unit 140 controls the priorities of the object detection unit 110, the face detection unit 120, and the face authentication unit 130 based on the current analysis results. For example, when object detection by the object detection unit 110 has been completed but face detection by the face detection unit 120 and face authentication by the face authentication unit 130 have not been completed, the control unit 140 may execute control such that the priority of the object detection unit 110 is lowered and the priority of the face detection unit 120 and the face authentication unit 130 is increased. More specifically, the control unit 140 may reduce the proportion of the processor 11 and RAM 12 allocated to the object detection unit 110 and increase the proportion of the processor 11 and RAM 12 allocated to the face detection unit 120 and the face authentication unit 130. Alternatively, the control unit 140 may change the parameters of a camera that captures an image of a target from parameters suitable for object detection to parameters suitable for face detection and face authentication.

[0037] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the first embodiment will be described.

[0038] 1 to 4 , in the information processing device 10 according to the first embodiment, the priorities of the object detection unit 110, the face detection unit 120, and the face authentication unit 130 are controlled based on situation information. This makes it possible to appropriately execute the processes executed by the object detection unit 110, the face detection unit 120, and the face authentication unit 130 according to the situation. This technical effect is particularly evident in cases where it is difficult to simultaneously execute the processes of the object detection unit 110, the face detection unit 120, and the face authentication unit 130 in an appropriate manner due to limitations resulting from, for example, the device configuration or processing load.

[0039] Second Embodiment An information processing device 10 according to a second embodiment will be described with reference to Fig. 5. Note that the second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit a description of other overlapping parts as appropriate.

[0040] (Mounted in a Vehicle) The information processing device 10 according to the second embodiment is mounted in a vehicle. All of the components of the information processing device 10 may be mounted in the vehicle. Alternatively, the information processing device 10 may have some components mounted in the vehicle and other components located outside the vehicle. In this case, the information processing device 10 may be configured to execute various processes while communicating with the outside of the vehicle. Note that the vehicle according to this embodiment may include various vehicles such as automobiles, bicycles, motorcycles, buses, and trains. Furthermore, the vehicle according to this embodiment may include moving bodies that are not classified as general vehicles (for example, ships, airplanes, etc.).

[0041] (Face Recognition Operation) Next, the flow of face recognition operation by the information processing device 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of face recognition operation in the information processing device according to the first embodiment.

[0042] 5 , in the face authentication operation by the information processing device 10 according to the second embodiment, the object detection unit 110 first detects an object around the vehicle (step S201). The object detection unit 110 may detect the object using, for example, a wide-area camera, radar, a sensor, or LiDER (Light Detection and Ranging) mounted on the vehicle. The object detection unit 110 may detect, for example, an object present within a predetermined distance from the vehicle or an object approaching the vehicle.

[0043] Next, the face detection unit 120 detects the face of a target present around the vehicle (step S202). Note that "around the vehicle" here includes not only the outside of the vehicle but also the inside of the vehicle. That is, the face detection unit 120 may be configured to detect at least one of the face of a target present outside the vehicle and the face of a target present inside the vehicle. The face detection unit 120 may detect the face of the target from an image captured by a camera mounted on the vehicle, for example. Then, the face authentication unit 130 performs face authentication using the face image of the target present around the vehicle (step S203). Note that if there are multiple targets around the vehicle, the face authentication unit 130 may perform face authentication for each of the multiple targets.

[0044] Next, the face authentication unit 130 outputs the authentication result of the face authentication (step S204). The authentication result of the face authentication may be used, for example, as a trigger for various processes that can be executed in the vehicle. For example, if the face authentication is successful, a process of unlocking the vehicle doors may be executed. Alternatively, if the face authentication is successful, a process of starting the vehicle engine may be executed.

[0045] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the second embodiment will be described.

[0046] 5, the information processing device 10 according to the second embodiment is mounted on a vehicle, and the object detection unit 110, the face detection unit 120, and the face authentication unit 130 each perform a process for an object present around the vehicle. In particular, the priority of each process performed by the object detection unit 110, the face detection unit 120, and the face authentication unit 130 is controlled by the control unit 140. In this way, it is possible to appropriately perform processes related to the vehicle depending on the situation.

[0047] In the following embodiments, as described in the second embodiment, an example in which the information processing device 10 is mounted on a vehicle will be described.

[0048] Third Embodiment An information processing device 10 according to a third embodiment will be described with reference to Figures 6 and 7. Note that the third embodiment differs only in part of the configuration and operation from the second embodiment described above, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0049] (Camera Arrangement) First, the arrangement of cameras in a vehicle equipped with an information processing device 10 according to the third embodiment will be described with reference to Fig. 6. Fig. 6 is a side view showing the configuration of a vehicle equipped with an information processing device according to the third embodiment.

[0050] As shown in FIG. 6 , a vehicle 50 equipped with an information processing device 10 according to the third embodiment is provided with a first camera 210 and a second camera 220. The first camera 210 is installed on the top of the vehicle 50 and captures images of the periphery of the vehicle 50. The first camera 210 is used for object detection by the object detection unit 110. That is, the object detection unit 110 according to the third embodiment detects objects present around the vehicle 50 using images of the periphery of the vehicle 50 captured by the first camera 210. Meanwhile, the second camera 220 is installed on each door of the vehicle 50 and captures images of the faces of targets approaching each door. The second camera 220 is used for face detection by the face detection unit 120 and face authentication by the face authentication unit 130. That is, the face detection unit 120 according to the third embodiment detects the faces of targets from images captured by the second camera 220. Furthermore, the face authentication unit 130 according to the third embodiment performs face authentication using images captured by the second camera 220.

[0051] (Priority Control Operation) Next, the flow of priority control operation by the information processing device 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of priority control operation in the information processing device according to the third embodiment.

[0052] As shown in FIG. 7 , in the priority control operation by the information processing device 10 according to the third embodiment, the control unit 140 first determines whether or not to perform object detection using the object detection unit 110 (step S301). For example, the control unit 140 determines whether or not the vehicle is set to an "object detection mode" that detects objects. Because object detection is performed to detect targets present in the vicinity of the vehicle 50, it may be performed, for example, on the assumption that the occupants of the vehicle 50 have left the vehicle. Therefore, the control unit 140 may determine to perform object detection when, for example, the vehicle 50 is stopped and the occupants have left the vehicle. Note that if object detection is not to be performed by the object detection unit 110 (step S301: NO), the subsequent processing is omitted.

[0053] When an object is detected by object detection unit 110 (step S301: YES), control unit 140 turns on first camera 210 and turns off second camera 220 (step S302). In this state, image capture is performed by first camera 210, and object detection is performed using the image captured by first camera 210. On the other hand, image capture is not performed by second camera 220, and therefore face detection and face authentication using the image captured by second camera 220 are not performed. As a result, a state is realized in which object detection has a high priority and face detection and face authentication have a low priority.

[0054] Next, the control unit 140 determines whether or not there is an object approaching the vehicle 50 using the object detection unit 110 (step S304). The control unit 140 may determine that there is an object approaching the vehicle 50 when the object detection unit 110 detects an object present at a position within a predetermined range from the vehicle 50. Note that when it is determined that there is no object approaching the vehicle 50 (step S304: NO), the control unit 140 maintains the above-described state in which the first camera 210 is on and the second camera 220 is off (step S302).

[0055] On the other hand, if it is determined that an object is approaching vehicle 50 (step S304: YES), control unit 140 turns off first camera 210 and turns on second camera 220 (step S305). In this state, no image is captured by first camera 210, and therefore object detection using images captured by first camera 210 is not performed. On the other hand, image capture by second camera 220 is performed, and therefore face detection and face authentication are performed using images captured by second camera 220. As a result, a state is achieved in which object detection has a low priority and face detection and face authentication have a high priority.

[0056] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the third embodiment will be described.

[0057] As described with reference to FIGS. 6 and 7 , in the information processing device 10 according to the third embodiment, the first camera 210 and the second camera 220 are switched on and off depending on the presence of an object approaching the vehicle 50. In this way, it is possible to increase the priority of object detection when there is no object approaching the vehicle 50, and to increase the priority of face detection and face authentication when there is an object approaching the vehicle 50. More specifically, in a situation where there is no object around the vehicle 50 and there is no need to perform face detection or face authentication, increasing the priority of object detection can achieve a state in which object detection can be more appropriately performed. On the other hand, in a situation where there is an object around the vehicle 50 and there is a need to perform face detection or face authentication, increasing the priority of face detection and face authentication can achieve a state in which face detection and face authentication can be more appropriately performed.

[0058] Fourth Embodiment An information processing device 10 according to a fourth embodiment will be described with reference to Fig. 8. The fourth embodiment differs only in part of the configuration and operation from the first to third embodiments described above, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0059] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the information processing device according to the fourth embodiment. Note that in Fig. 8, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0060] As shown in Fig. 8, the information processing device 10 according to the fourth embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, an acquisition unit 135, a control unit 140, and a spoofing determination unit 150. That is, the information processing device 10 according to the fourth embodiment further includes, in addition to the configuration of the first embodiment (see Fig. 2), a spoofing determination unit 150. The spoofing determination unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0061] The spoofing determination unit 150 is configured to be able to determine whether or not a target is being spoofed. Here, "spoofing" refers to an act in which another person impersonates the target by using, for example, a photograph, video, or a 3D mask. The spoofing determination unit 150 may determine whether or not a target is being spoofed by determining whether or not the target is a living organism. The spoofing determination unit 150 may be configured to be able to determine whether or not a target is being spoofed by using, for example, an image of the target. More specifically, the spoofing determination unit 150 may request the target to perform a predetermined action (for example, moving one's eyes or one's hands) and determine whether or not the target performs the requested action based on whether or not the target is being spoofed.

[0062] The control unit 140 according to the fourth embodiment is configured to be able to control the priority of the spoofing determination unit 150 described above, in addition to the object detection unit 110, the face detection unit 120, and the face authentication unit 130. For example, the control unit 140 may perform control so that the priority of the spoofing determination unit 150 is higher than the priority of the object detection unit 110, the face detection unit 120, and the face authentication unit 130. That is, the control unit 140 may perform control so that the spoofing determination process is executed with higher priority than other processes. Furthermore, the control unit 140 may perform control so that the priority of the spoofing determination unit 150 is lower than the priority of the object detection unit 110, the face detection unit 120, and the face authentication unit 130. That is, the control unit 140 may perform control so that other processes are executed with higher priority than the spoofing determination process.

[0063] The determination result by the spoofing determination unit 150 may be used as information for confirming the identity of the person, together with the result of face authentication by the face authentication unit 130 described above. For example, even if face authentication by the face authentication unit 130 is successful, if the spoofing determination unit 150 determines that "spoofing has occurred," the person may not be recognized as the person in question. Furthermore, the determination result by the spoofing determination unit 150 may be used as a condition for executing control other than face authentication. For example, if face authentication by the face authentication unit 130 is successful, the doors of the vehicle 50 may be unlocked, and if the spoofing determination unit 150 determines that "spoofing has not occurred," the engine of the vehicle 50 may be started. In this case, the priority of the face authentication unit 130 may be increased in an initial stage to prioritize face authentication, and after face authentication is successful, the priority of the spoofing determination unit 150 may be increased to prioritize spoofing determination. (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the fourth embodiment will be described.

[0064] 8 , in the information processing device 10 according to the fourth embodiment, in addition to the priorities of the object detection unit 110, the face detection unit 120, and the face authentication unit 130, the priority of the spoofing determination unit 150 is also controlled based on situation information. In this way, it becomes possible to appropriately execute the processes executed by each of the object detection unit 110, the face detection unit 120, the face authentication unit 130, and the spoofing determination unit 150 according to the situation. Such technical effects become more pronounced as the number of processes to be executed simultaneously in parallel increases, as in this embodiment.

[0065] Fifth Embodiment An information processing device 10 according to a fifth embodiment will be described with reference to Fig. 9. The fifth embodiment differs from the fourth embodiment described above only in some configurations and operations, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0066] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the fifth embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the information processing device according to the fifth embodiment. Note that in Fig. 9, elements similar to those shown in Fig. 8 are denoted by the same reference numerals.

[0067] 9, the information processing device 10 according to the fifth embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, an acquisition unit 135, a control unit 140, and a spoofing determination unit 150. In particular, the spoofing determination unit 150 according to the fifth embodiment includes a marker display unit 151.

[0068] The marker display unit 151 is configured to be able to display a marker that provides guidance regarding the spoofing determination when there is a target for which the determination by the spoofing determination unit 150 has not yet been completed. For example, when there is a target whose face has been detected by the face detection unit 120 but the spoofing determination for that target has not yet been completed, the marker display unit 151 displays a marker that provides guidance regarding the spoofing determination. The marker display unit 151 may display the marker on, for example, a part of the vehicle body (body, mirror, window, etc.). Alternatively, the marker display unit 151 may project the marker onto the ground or the like using the vehicle's lights or the like.

[0069] Note that "guidance related to spoofing determination" according to this embodiment includes various guidance for appropriately performing spoofing determination. Specifically, the marker display unit 151 may display a marker to cause the target to move closer to a device that performs spoofing determination (e.g., a near-infrared camera, a body temperature sensor, etc.). In this case, the marker may indicate, for example, the target's destination location or direction of movement. Alternatively, the marker display unit 151 may display a marker to request the target to perform a predetermined action. In this case, the marker may indicate, for example, the content of the action or the direction of movement. The marker may be, for example, an arrow mark indicating a location or direction, or the marker itself may move to indicate a location or direction.

[0070] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the fifth embodiment will be described.

[0071] 9, the information processing device 10 according to the fifth embodiment displays a marker that provides guidance regarding the spoofing determination. In this way, it becomes possible to guide a target for which the spoofing determination has not been completed, and to efficiently perform the spoofing determination.

[0072] Sixth Embodiment An information processing device 10 according to a sixth embodiment will be described with reference to Figures 10 and 11. Note that the sixth embodiment differs only in part of the configuration and operation from the first to fifth embodiments described above, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0073] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the sixth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the information processing device according to the sixth embodiment. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0074] 10 , the information processing device 10 according to the sixth embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, an acquisition unit 135, a control unit 140, and a door lock control unit 160. That is, the information processing device 10 according to the sixth embodiment further includes a door lock control unit 160 in addition to the configuration of the first embodiment (see FIG. 2 ). The door lock control unit 160 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1 ).

[0075] The door lock control unit 160 is configured to be able to unlock the vehicle doors when the face authentication unit 130 has successfully completed face authentication. The door lock control unit 160 may be configured to be able to unlock the doors of the vehicle 50 separately. For example, the door lock control unit 160 may be configured to be able to unlock only the driver's seat door of the vehicle 50 or only the rear seat door. The door lock control unit 160 may also be configured to be able to unlock all the doors of the vehicle 50 at once.

[0076] The door lock control unit 160 according to the sixth embodiment particularly includes a driver determination unit 161. The driver determination unit 161 is configured to be able to determine whether or not a subject whose face has been successfully authenticated by the face authentication unit 130 is the driver of the vehicle 50. The door lock control unit 160 is configured to execute different control depending on whether the subject whose face has been successfully authenticated is the driver or someone other than the driver. The difference in control at this time will be explained in detail in the following operation explanation.

[0077] (Door Lock Control Operation) Next, the door lock control operation by the information processing device 10 according to the sixth embodiment (i.e., the operation of the door lock control unit 160) will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of the door lock control operation in the information processing device according to the sixth embodiment.

[0078] 11 , in the door lock control operation by the information processing device 10 according to the sixth embodiment, the door lock control unit 160 first determines whether or not the target face authentication has been successful (step S601). If the target face authentication has not been successful (step S601: NO), the subsequent processing is omitted (i.e., the doors of the vehicle 50 are not unlocked).

[0079] If the facial authentication of the target is successful (step S601: YES), the driver determination unit 161 determines whether the person whose facial authentication was successful is the driver of the vehicle 50 (step S602). If the person whose facial authentication was successful is the driver (step S602: YES), the door lock control unit 160 unlocks all the doors of the vehicle (step S603). In other words, if the facial authentication of the driver is successful, the door lock control unit 160 also unlocks the doors corresponding to other passengers whose facial authentication was not successful (for example, the doors of the passenger seat and the rear seat).

[0080] On the other hand, if the person whose face has been successfully authenticated is not the driver (step S602: NO), the door lock control unit 160 unlocks the door corresponding to the person whose face has been successfully authenticated (step S604). For example, if the person whose face has been successfully authenticated is a passenger sitting in the back seat, the door lock control unit 160 unlocks only the door for the back seat.

[0081] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the sixth embodiment will be described.

[0082] As described with reference to FIGS. 10 and 11 , in the information processing device 10 according to the sixth embodiment, the door locks are unlocked in different ways depending on whether the person whose face authentication was successful is the driver. This makes it possible to ensure security for the driver's seat while also appropriately unlocking the other doors. Specifically, it is possible to prevent passengers other than the driver from getting into the driver's seat without permission (i.e., passengers other than the driver from being able to drive the vehicle 50). Furthermore, since facial authentication of other passengers is not required as long as the driver is present, the burden of authenticating passengers can be reduced.

[0083] Seventh Embodiment An information processing device 10 according to a seventh embodiment will be described with reference to Figures 12 and 13. Note that the seventh embodiment differs only in part of the configuration and operation from the first to sixth embodiments described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0084] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the seventh embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the information processing device according to the seventh embodiment. Note that in Fig. 12, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0085] 12 , the information processing device 10 according to the seventh embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, an acquisition unit 135, a control unit 140, and an alert output unit 170. That is, the information processing device 10 according to the seventh embodiment further includes an alert output unit 170 in addition to the configuration of the first embodiment (see FIG. 2 ). The alert output unit 170 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1 ).

[0086] The alert output unit 170 is configured to output alert information when a seat in the driver's seat of the vehicle is detected while facial authentication of the vehicle driver has not been successful. The alert output unit 170 may output the alert information as an image using a display mounted on the vehicle 50, for example. Alternatively, the alert output unit 170 may output the alert information as audio using a speaker mounted on the vehicle 50. Alternatively, the alert output unit 170 may output the alert information to a terminal (e.g., a smartphone) held by the driver of the vehicle 50.

[0087] (Alert Output Operation) Next, an alert output operation by the information processing device 10 according to the seventh embodiment (i.e., the operation of the alert output unit 170 described above) will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the alert output operation in the information processing device according to the seventh embodiment.

[0088] 13 , in the alert output operation by the information processing device 10 according to the seventh embodiment, the alert output unit 170 first determines whether or not a person is seated in the driver's seat of the vehicle 50 (step S701). Note that the person being seated in the driver's seat may be detected by a sensor installed on the driver's seat or a camera capturing an image of the driver's seat. If a person being seated in the driver's seat is not detected (step S701: NO), the subsequent processing is omitted. That is, the alert output unit 170 does not output alert information.

[0089] On the other hand, if a seat in the driver's seat is detected (step S701: YES), the alert output unit 170 determines whether facial authentication of the driver of the vehicle 50 has been successful (step S702). If facial authentication of the driver has not been successful (step S702: NO), the alert output unit 170 outputs alert information (step S703). That is, the alert output unit 170 determines that a person other than the driver has sat in the driver's seat and outputs alert information to notify the driver of the danger. On the other hand, if facial authentication of the driver has been successful (step S702: YES), the processing of step S703 is omitted. That is, it is determined that the person sitting in the driver's seat is the driver, and alert information is not output.

[0090] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the seventh embodiment will be described.

[0091] 12 and 13 , in the information processing device 10 according to the seventh embodiment, when the driver's seat is detected in a state where face authentication of the driver has not been successful, alert information is output. In this way, it is possible to prevent a passenger other than the driver from getting into the driver's seat without permission (i.e., a passenger other than the driver from being able to drive the vehicle 50).

[0092] Eighth Embodiment An information processing device 10 according to an eighth embodiment will be described with reference to Figures 14 and 15. Note that the eighth embodiment differs only in part of the configuration and operation from the first to seventh embodiments described above, and other parts may be the same as the first to seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0093] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the eighth embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the information processing device according to the eighth embodiment. Note that in Fig. 14, elements similar to those shown in Fig. 10 are denoted by the same reference numerals.

[0094] 14, the information processing device 10 according to the eighth embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, an acquisition unit 135, a control unit 140, and a door lock control unit 160. That is, the information processing device 10 according to the sixth embodiment is configured to include the same components as those of the sixth embodiment (see FIG. 10). However, the door lock control unit 160 according to the eighth embodiment is configured to include a parent-child determination unit 162.

[0095] The parent-child determination unit 162 is configured to be able to determine whether the subject whose face has been successfully authenticated by the face authentication unit 130 is the parent or child when the occupants of the vehicle 50 are a parent and a child. The door lock control unit 160 according to the eighth embodiment is configured to execute different control depending on whether the subject whose face has been successfully authenticated is the parent or the child. The difference in control at this time will be explained in detail in the following operation explanation.

[0096] (Door Lock Control Operation) Next, a door lock control operation by the information processing device 10 according to the eighth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of the door lock control operation in the information processing device according to the eighth embodiment.

[0097] 15 , in the door lock control operation by the information processing device 10 according to the eighth embodiment, the door lock control unit 160 first determines whether or not the target face authentication has been successful (step S801). If the target face authentication has not been successful (step S801: NO), the subsequent processing is omitted (i.e., the doors of the vehicle 50 are not unlocked).

[0098] If the facial authentication of the subject is successful (step S801: YES), the parent-child determination unit 162 determines whether the subject is a parent and child (step S802). The parent-child determination unit 162 may determine whether the subject is a parent and child based on pre-registered information. Alternatively, the parent-child determination unit 162 may determine that the subject is a parent and child when a parent and child appear in the same image. If the subject is not a parent and child (step S802: NO), the door lock control unit 160 unlocks the door (step S804). That is, the door lock control unit 160 determines that only adults are occupants of the vehicle 50 and unlocks the door based on the result that the facial authentication was successful.

[0099] If the subject is a parent and child (step S802: YES), the parent-child determination unit 162 determines whether the person whose face authentication was successful is the parent (step S803). If the person whose face authentication was successful is the parent (step S803: YES), the door lock control unit 160 unlocks the doors of the vehicle 50 (step S804). That is, the door lock control unit 160 determines that the parent is near the child and unlocks the doors. On the other hand, if the person whose face authentication was successful is not the parent (step S803: NO), the door lock control unit 160 does not unlock the doors of the vehicle 50 (step S805). That is, the door lock control unit 160 determines that the parent is not near the child (the child may be the only person), and keeps the doors locked. In this case, the control unit 140 may maintain the priority of the face authentication unit 130 high in order to properly perform face authentication of the parent from now on.

[0100] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the eighth embodiment will be described.

[0101] 14 and 15 , in the information processing device 10 according to the eighth embodiment, when the passengers in the vehicle 50 are a parent and a child, the door lock will not be unlocked unless the facial authentication of the parent is successful. This prevents the door lock of the vehicle 50 from being unlocked by only the facial authentication of the child when the parent is not present. This makes it possible to prevent a child from accidentally sitting in the driver's seat or from engaging in inappropriate behavior by themselves.

[0102] Ninth Embodiment An information processing device 10 according to a ninth embodiment will be described with reference to Fig. 16. Note that the ninth embodiment differs only in part of the configuration and operation from the first to eighth embodiments described above, and other parts may be the same as the first to eighth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0103] (Face Recognition Operation) First, the flow of face recognition operation by the information processing device 10 according to the ninth embodiment will be described with reference to Fig. 16. Fig. 16 is a flowchart showing the flow of face recognition operation in the information processing device according to the ninth embodiment.

[0104] 16 , in the face authentication operation by the information processing device 10 according to the second embodiment, the face authentication unit 130 first determines whether multiple faces have been detected by the face detection unit 120 (step S901). That is, the face authentication unit 130 determines whether multiple faces to be authenticated have been detected. If multiple faces have not been detected (step S901: NO), the face authentication unit 130 performs face authentication as usual (step S902). That is, the face authentication unit 130 performs face authentication on one detected face.

[0105] If multiple faces are detected (step S901: YES), the face authentication unit 130 determines whether the faces of a parent and a child are detected (step S903). That is, the face authentication unit 130 determines whether the faces of a parent and a child are detected. If the faces of a parent and a child are not detected (step S903: NO), the face authentication unit 130 performs face authentication on the multiple detected faces in order of closest to the vehicle 50 (step S904). That is, the face authentication unit 130 performs face authentication by prioritizing targets that are closer to the vehicle 50.

[0106] On the other hand, if the faces of a parent and child are detected (step S903: YES), the face authentication unit 130 first performs face authentication using the parent's face (step S905). Then, after the parent's face authentication is completed, the face authentication unit 130 performs face authentication using the child's face (step S906). In this way, when the subject is a parent-child pair, the face authentication unit 130 first performs face authentication of the parent, and then performs face authentication of the child.

[0107] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the ninth embodiment will be described.

[0108] 16, in the information processing device 10 according to the ninth embodiment, facial authentication of the parent is performed with priority over this facial authentication. In this way, facial authentication of the parent who is more responsible is completed with priority, thereby making it possible to enhance security in the vehicle.

[0109] Tenth Embodiment An information processing device 10 according to a tenth embodiment will be described with reference to Fig. 17. The tenth embodiment differs only in part of the configuration and operation from the first to ninth embodiments described above, and other parts may be the same as the first to ninth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0110] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the tenth embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the functional configuration of the information processing device according to the tenth embodiment. Note that in Fig. 17, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0111] As shown in FIG. 17 , the information processing device 10 according to the tenth embodiment is configured to include, as components for realizing its functions, an object detection unit 110, a face detection unit 120, a face authentication unit 130, a control unit 140, a seat information storage unit 180, and a control execution unit 190. That is, the information processing device 10 according to the tenth embodiment further includes the seat information storage unit 180 and the control execution unit 190 in addition to the configuration of the first embodiment (see FIG. 2 ). The seat information storage unit 180 may be realized by, for example, the storage device 14 (see FIG. 1 ) described above. The control execution unit 190 may be a processing block realized by, for example, the processor 11 (see FIG. 1 ) described above.

[0112] The seat information storage unit 180 is configured to store at least one of the seat position and seat status of a vehicle occupant. The seat status is a parameter that can be set for each seat, such as the seat reclining angle, the direction and air volume of the air conditioner, the strength of the seat heater, and audio system settings. When there are multiple occupants in the vehicle, the seat information storage unit 180 may store the seat position and seat status for each occupant. The seat information storage unit 180 may also store the seat position and seat status of past occupants (e.g., occupants from several months ago). The information stored in the seat information storage unit 180 can be read out by the control execution unit 190 as needed.

[0113] The control execution unit 190 is configured to be able to execute control based on the seat position and seat status stored in the seat information storage unit 180 when face authentication of a passenger in the vehicle 50 is successful. Specifically, when face authentication of a passenger is successful, the control execution unit 190 reads information on the seat position and seat status of the passenger identified by face authentication from the seat information storage unit 180. Then, the control execution unit 190 executes control for the identified passenger in accordance with the read seat position and seat status.

[0114] For example, the control execution unit 190 executes control to unlock the door lock of the seat in which the identified passenger was sitting. Alternatively, the control execution unit 190 executes processing to adjust the seat in which the identified passenger is about to sit, based on the stored seat status. Specifically, the control execution unit 190 executes control to change the seat reclining angle to an angle previously set by the identified passenger. Alternatively, the control execution unit 190 executes control to change the air volume of the air conditioner to an air volume previously set by the identified passenger.

[0115] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the tenth embodiment will be described.

[0116] 17 , in the information processing device 10 according to the tenth embodiment, when facial authentication of a passenger is successful, control is executed based on the stored seat position and seat status. In this way, it is possible to appropriately execute processing tailored to the passenger identified by facial authentication.

[0117] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0118] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0119] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0120] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an object detection means that detects an object, a face detection means that detects the face of a target, a face authentication means that performs face authentication using a face image of the target, an acquisition means that acquires situation information that indicates a situation, and a control means that controls the priority of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0121] (Supplementary Note 2) The information processing device described in Supplementary Note 2 is the information processing device described in Supplementary Note 1, in which the object detection means detects the object present in the vicinity of the vehicle, the face detection means detects the face of the target present in the vicinity of or inside the vehicle, and the face authentication means performs the face authentication related to use of the vehicle.

[0122] (Appendix 3) The information processing device described in Appendix 3 is the information processing device described in Appendix 2, in which the vehicle is equipped with a first camera that photographs the area around the vehicle and a second camera provided at each door of the vehicle, and the control means controls the photographing by the first camera and the second camera based on the situation information including position information of the target.

[0123] (Appendix 4) The information processing device described in Appendix 4 is the information processing device described in any one of Appendices 1 to 3, further comprising an impersonation determination means for determining whether the target is impersonating, and the control means controls the priority of the object detection means, the face detection means, the face authentication means, and the impersonation determination means based on the situation information.

[0124] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in Appendix 4, further comprising a marker display means for displaying a marker that provides guidance regarding the impersonation determination when there is an object for which determination by the impersonation determination means has not been completed.

[0125] (Appendix 6) The information processing device described in Appendix 6 is the information processing device described in any one of Appendices 2 to 5, further including a door lock control means that unlocks the doors of the vehicle when face authentication by the face authentication means is successful, and the door lock control means unlocks the doors when there are multiple objects around the vehicle and face authentication is successful for the driver of the vehicle, even if face authentication for objects other than the driver is not successful.

[0126] (Appendix 7) The information processing device described in Appendix 7 is the information processing device described in any one of Appendices 2 to 6, further comprising an alert output means for outputting alert information when a seat in the driver's seat of the vehicle is detected while face authentication of the driver of the vehicle has not been successful.

[0127] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendices 2 to 7, further including a door lock control means that unlocks the door lock of the vehicle when face authentication by the face authentication means is successful, and the door lock control means does not unlock the door lock when a parent and child are in the vehicle, even if face authentication for the child is successful, unless face authentication for the parent is successful.

[0128] (Supplementary Note 9) The information processing device described in Supplementary Note 9 is the information processing device described in any one of Supplements 1 to 8, wherein, when a parent and child are present, the face authentication means performs face authentication on the parent before face authentication on the child.

[0129] (Appendix 10) The information processing device described in Appendix 10 is an information processing device described in any one of claims 2 to 9, further comprising: a storage means for storing at least one of the seat position and seat status of a passenger in the vehicle; and a control execution means for executing control based on the seat position and the seat status when face authentication of the passenger is successful.

[0130] (Supplementary Note 11) The information processing method described in Supplementary Note 11 is an information processing method in an information processing device that includes an object detection means that detects an object, a face detection means that detects a face of a target, and a face authentication means that performs face authentication using a face image of the target, and that acquires situation information that indicates a situation, and controls the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0131] (Appendix 12) The recording medium described in Appendix 12 is a recording medium on which a computer program is recorded that causes a computer to execute an information processing method in an information processing device that includes object detection means that detects an object, face detection means that detects the face of a target, and face authentication means that performs face authentication using a face image of the target, the information processing method acquiring situation information that indicates a situation, and controlling the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0132] (Supplementary Note 13) The computer program described in Supplementary Note 13 is a computer program that causes a computer to execute an information processing method in an information processing device that includes object detection means that detects an object, face detection means that detects a face of a target, and face authentication means that performs face authentication using a face image of the target, and that acquires situation information that indicates a situation, and controls the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information.

[0133] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0134] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 50 Vehicle 110 Object detection unit 120 Face detection unit 130 Face authentication unit 135 Acquisition unit 140 Control unit 150 Impersonation determination unit 151 Marker display unit 160 Door lock control unit 161 Driver determination unit 162 Parent / child determination unit 170 Alert output unit 180 Seat information storage unit 190 Control execution unit 210 First camera 220 Second camera

Claims

1. an object detection means for detecting an object; a face detection means for detecting a face of a target; a face authentication means for performing face authentication using a face image of the target; acquisition means for acquiring situation information indicating a situation; a control means for controlling priorities of the object detection means, the face detection means, and the face authentication means based on the situation information; An information processing device comprising:

2. the object detection means detects the object present around the vehicle, the face detection means detects a face of the target present around or inside the vehicle; The facial authentication means performs the facial authentication regarding the use of the vehicle. The information processing device according to claim 1 .

3. The vehicle includes a first camera that captures an image of the surroundings of the vehicle and a second camera that is provided at each door of the vehicle, the control means controls the photographing by the first camera and the second camera based on the situation information including position information of the target. The information processing device according to claim 2 .

4. The target further comprises a spoofing determination means for determining whether or not the target is spoofed; the control means controls priorities of the object detection means, the face detection means, the face authentication means, and the spoofing determination means based on the situation information.

3. The information processing device according to claim 1 or 2.

5. The device further comprises a marker display means for displaying a marker that provides guidance regarding the spoofing determination when there is a target for which the determination by the spoofing determination means has not been completed. The information processing device according to claim 4 .

6. The vehicle further includes a door lock control means for unlocking a door lock of the vehicle when face authentication by the face authentication means is successful, the door lock control means, when there are a plurality of objects around the vehicle and face authentication for the driver of the vehicle is successful, unlocks the door even if face authentication for objects other than the driver is not successful; The information processing device according to claim 2 .

7. The system further includes an alert output means for outputting alert information when a seating position in the driver's seat of the vehicle is detected in a state where face authentication of the driver of the vehicle has not been successful. The information processing device according to claim 2 .

8. The vehicle further includes a door lock control means for unlocking a door lock of the vehicle when face authentication by the face authentication means is successful, When a parent and a child are in the vehicle, the door lock control means does not unlock the door lock unless face authentication for the parent is successful, even if face authentication for the child is successful. The information processing device according to claim 2 .

9. An information processing device comprising: an object detection means for detecting an object; a face detection means for detecting a face of a target; and a face authentication means for performing face authentication using a face image of the target, Obtaining situation information indicating the situation; controlling the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information; Information processing methods.

10. An information processing device comprising: an object detection means for detecting an object; a face detection means for detecting a face of a target; and a face authentication means for performing face authentication using a face image of the target, Obtaining situation information indicating the situation; controlling the priorities of the object detection means, the face detection means, and the face authentication means based on the situation information; A computer program that causes a computer to execute an information processing method.