Information processing device, information processing system, information processing method, and recording medium

Abstract

To reduce a time required to acquire biometric information of a user using a vehicle.SOLUTION: An information processing device includes first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject is riding, control means for controlling imaging means for imaging the subject on the basis of the vehicle information, second acquisition means for acquiring biometric information of the subject on the basis of a target image including the subject imaged by the imaging means, and estimation means for estimating whether the subject can be imaged from outside the vehicle on the basis of the vehicle information, and when it is estimated that the subject can be imaged from outside the vehicle, the control means controls the imaging means on the basis of the vehicle information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium. [Background technology]

[0002] As an example of this type of device, a device has been proposed in which, when imaging an occupant in the rear seat of a vehicle, the imaging device takes an image under a second imaging condition that is different from a first imaging condition used when imaging an occupant in the driver's seat of the vehicle (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2023 / 175686 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a recording medium that aim to improve the technology related to the above-mentioned prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing device includes a first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject is riding, a control means for controlling an imaging means for imaging the subject based on the vehicle information, and a second acquisition means for acquiring biometric information of the subject based on a target image including the subject captured by the imaging means.

[0006] One aspect of the information processing system includes a first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject is riding, a control means for controlling an imaging means for capturing an image of the subject based on the vehicle information, and a second acquisition means for acquiring biometric information of the subject based on a target image including the subject captured by the imaging means.

[0007] One aspect of the information processing method involves obtaining vehicle information regarding the appearance of a vehicle in which a subject is riding, controlling an imaging means for imaging the subject based on the vehicle information, and obtaining biometric information of the subject based on a target image including the subject captured by the imaging means.

[0008] One aspect of the recording medium has a computer program recorded on it that causes a computer to execute an information processing method that acquires vehicle information regarding the appearance of a vehicle in which a subject is riding, controls an imaging means that images the subject based on the vehicle information, and acquires biometric information of the subject based on a target image that includes the subject captured by the imaging means. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram illustrating an example of a configuration of an information processing apparatus according to an embodiment. [Figure 2] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 3] FIG. 10 is a block diagram showing another example of the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 1 is a block diagram illustrating an example of a configuration of a calculation device according to an embodiment. [Figure 5] FIG. 10 is a block diagram showing another example of the configuration of the arithmetic device according to the embodiment. [Figure 6] FIG. 10 is a block diagram showing another example of the configuration of the arithmetic device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] First Embodiment A first embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Figures 1 and 2. In the following, the first embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 10.

[0011] In FIG. 1 , the information processing device 10 includes a first acquisition unit 11, a control unit 12, and a second acquisition unit 13. The information processing device 10 may include only some of the first acquisition unit 11, the control unit 12, and the second acquisition unit 13. In this case, one or more other devices different from the information processing device 10 may include the remaining parts of the first acquisition unit 11, the control unit 12, and the second acquisition unit 13. The information processing device 10 and the one or more other devices may constitute an information processing system. In this case, the information processing system may include the information processing device 10 and one or more other devices. It can be said that the information processing system includes the first acquisition unit 11, the control unit 12, and the second acquisition unit 13. Note that the information processing device 10 including the first acquisition unit 11, the control unit 12, and the second acquisition unit 13 may constitute a part of the information processing system. In this case, it can be said that the information processing system includes the first acquisition unit 11, the control unit 12, and the second acquisition unit 13.

[0012] The first acquisition unit 11 acquires vehicle information related to the exterior of a vehicle in which a subject is riding. The subject may be a subject of biometric authentication. The vehicle information may include, for example, at least one of an exterior image related to the vehicle's exterior, information indicating at least one of the vehicle length, width, and height, information indicating at least one of the window position, shape, type, and color, the steering wheel position, the vehicle model, the vehicle manufacturer, whether or not a roof is present, and a feature indicating at least one of these. For example, in the case of a vehicle whose length, width, and height are 490 cm, 194 cm, and 185 cm, respectively, the feature indicating the vehicle length, width, and height may be (490, 194, 185).

[0013] The control unit 12 controls an imaging means for capturing an image of a target based on the vehicle information. The "imaging means" is not limited to a camera, but is a concept that includes a device having a camera. Examples of a device having a camera include at least one of a PTZ camera, a smartphone, a robot having a camera, and a drone having a camera.

[0014] When an object in a vehicle is imaged from outside the vehicle, the object is often imaged through a vehicle window. For example, the position of the vehicle window varies depending on the vehicle model. For example, in the case of a camera with a fixed position, the timing of imaging an object in a vehicle with a relatively high vehicle height may be different from the timing of imaging an object in a vehicle with a relatively low vehicle height so that the object fits within the angle of view of the camera. For example, in the case of a drone equipped with a camera, the position of the drone may be changed so that the object fits within the angle of view of the camera.

[0015] "Controlling the imaging means based on vehicle information" may include, for example, estimating the position of a window from the vehicle information and controlling the imaging means so that the target is within the angle of view of the camera. For example, there may be multiple imaging means capable of imaging the target. In this case, the imaging means that images the target may be different for each vehicle. In other words, "controlling the imaging means based on vehicle information" may include, for example, selecting at least one imaging means suitable for imaging the target from multiple imaging means in accordance with the vehicle identified from the vehicle information.

[0016] The second acquisition unit 13 acquires biometric information of the target based on a target image including the target captured by the imaging means. The target image may be a visible light image or a near-infrared image. The biometric information of the target may be, for example, the target image itself, or an extracted image generated by extracting a partial region of the target image. Examples of the extracted image include at least one of a face image generated by extracting a facial region of the target from the target image and an eye image generated by extracting an eye region of the target from the target image. The biometric information of the target may be, for example, a feature extracted from at least one of the target image and the extracted image. The biometric information of the target may be used for biometric authentication of the target.

[0017] The operation of the information processing device 10 will be further described with reference to the flowchart of Fig. 2. In Fig. 2, the first acquisition unit 11 of the information processing device 10 acquires vehicle information relating to the appearance of the vehicle in which the target is riding (step S101). The control unit 12 of the information processing device 10 controls the imaging means for capturing an image of the target based on the vehicle information (step S102). The second acquisition unit 13 of the information processing device 10 acquires biometric information of the target based on the target image (step S103).

[0018] In this way, the information processing device 10 may perform an information processing method in which it acquires vehicle information regarding the appearance of the vehicle in which the subject is riding, controls an imaging means for capturing an image of the subject based on the vehicle information, and acquires biometric information of the subject based on a target image including the subject captured by the imaging means.

[0019] The information processing device 10 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may have recorded thereon a computer program for causing the computer to execute an information processing method for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides, controlling an imaging means for capturing an image of the subject based on the vehicle information, and acquiring biometric information of the subject based on a target image captured by the imaging means.

[0020] (Technical Effects) For example, entrance management is often performed in large facilities such as factories and warehouses. Furthermore, biometric authentication is sometimes used for entrance management to improve security and user convenience. Users of large facilities often use vehicles. When biometric authentication of a user (corresponding to the above-mentioned target) is performed, if it takes a relatively long time to acquire biometric information, traffic congestion may occur on roads around the large facility. In the information processing device 10, the control unit 12 controls the imaging means based on vehicle information. Therefore, it is expected that the target (corresponding to the above-mentioned user) will be imaged from a position appropriate for each vehicle. In addition, the second acquisition unit 13 acquires the target's biometric information from the target image. Therefore, the information processing device 10 can acquire the target's biometric information without the target getting out of the vehicle. Therefore, the information processing device 10 can reduce the time required to acquire the target's biometric information.

[0021] Second Embodiment A second embodiment of the information processing device, information processing system, information processing method, and recording medium will be described with reference to Figures 3 and 4. Hereinafter, the second embodiment of the information processing device, information processing system, information processing method, and recording medium will be described using information processing device 100. Note that, for the second embodiment, descriptions that overlap with the description of the first embodiment will be omitted as appropriate.

[0022] 3, the information processing device 100 includes an arithmetic unit 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The arithmetic unit 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 may be connected via a data bus 160. Note that the information processing device 100 does not necessarily include at least one of the input device 140 and the output device 150.

[0023] The arithmetic device 110 may include a processor 1101. The arithmetic device 110 may include other processors in addition to the processor 1101. That is, the arithmetic device 110 may include one or more processors. The processor 1101 may be a multi-core processor. When the arithmetic device 110 includes a single processor 1101 that is a multi-core processor, it can be said that the arithmetic device 110 logically includes multiple processors.

[0024] The processor 1101 may be, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0025] The storage device 120 may include a memory 1201. The storage device 120 may include other memories in addition to the memory 1201. That is, the storage device 120 may include one or more memories. The memory 1201 may be, for example, at least one of a random access memory (RAM), a read-only memory (ROM), a hard disk drive, a magneto-optical disk drive, a solid-state drive (SSD), and an optical disk array. Therefore, the storage device 120 may include the memory 1201 as a non-transitory recording medium. The storage device 120 is capable of storing desired data. The memory 1201 of the storage device 120 may store a computer program 1201a executed by the calculation device 110. The storage device 120 may temporarily store data that the calculation device 110 temporarily uses when the calculation device 110 is executing the computer program 1201a.

[0026] The computer program 1201a may be recorded on a computer-readable, non-transitory recording medium. In this case, the computer program 1201a may be stored in the memory 1201 by reading the recording medium using a recording medium reading device (not shown) included in the information processing device 100. The recording medium may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program. The computer program 1201a may be acquired (in other words, downloaded) from a device (not shown) external to the information processing device 100 via the communication device 130. The acquired computer program 1201a may be stored in the memory 1201.

[0027] The communication device 130 may be capable of communicating with devices external to the information processing device 100. The communication device 130 may perform wired communication or wireless communication.

[0028] The input device 140 is a device capable of accepting information input to the information processing device 100 from outside. The input device 140 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the information processing device 100. The input device 140 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 100, such as a USB (Universal Serial Bus) memory. Note that when information is input to the information processing device 100 via the communication device 130 (in other words, when the information processing device 100 acquires information via the communication device 130), the communication device 130 may function as an input device.

[0029] The output device 150 is a device capable of outputting information to the outside of the information processing device 100. The output device 150 may output, as the information, visual information such as characters or images, auditory information such as sound, or tactile information such as vibration. The output device 150 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 150 may be capable of outputting information to a recording medium detachable from the information processing device 100, such as a USB memory. Note that when the information processing device 100 outputs information via the communication device 130, the communication device 130 may function as the output device.

[0030] The processor 1101 of the arithmetic device 110, together with the memory 1201 of the storage device 120 in which a computer program 1201a is stored (in other words, together with the memory 1201 and the computer program 1201a stored in the memory 1201), may execute the processing to be performed by the information processing device 100. For example, the processor 1101 may execute the computer program 1201a, thereby realizing logical functional blocks in the arithmetic device 110 (for example, in the processor 1101) for executing the processing to be performed by the information processing device 100.

[0031] 4, the arithmetic device 110 may have a first acquisition unit 111, a control unit 112, and a second acquisition unit 113 as logically realized functional blocks or as physically realized processing circuits. At least one of the first acquisition unit 111, the control unit 112, and the second acquisition unit 113 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0032] Note that when the first acquisition unit 111, the control unit 112, and the second acquisition unit 113 are realized as functional blocks, the first acquisition unit 111, the control unit 112, and the second acquisition unit 113 may be realized by a single processor (for example, the processor 1101). Alternatively, the first acquisition unit 111, the control unit 112, and the second acquisition unit 113 may be realized by different processors. Alternatively, parts of the first acquisition unit 111, the control unit 112, and the second acquisition unit 113 may be realized by one processor, and the remaining parts of the first acquisition unit 111, the control unit 112, and the second acquisition unit 113 may be realized by one or more other processors different from the one processor.

[0033] The "first acquisition unit 111," "control unit 112," and "second acquisition unit 113" are components corresponding to the "first acquisition unit 11," "control unit 12," and "second acquisition unit 13" in the first embodiment, respectively. The information processing device 100 may constitute a part of an information processing system. In this case, it can be said that the information processing system includes the first acquisition unit 111, the control unit 112, and the second acquisition unit 113.

[0034] The first acquisition unit 111 acquires vehicle information related to the exterior of the vehicle in which the target is riding. The control unit 112 controls an imaging unit that captures an image of the target based on the vehicle information. For example, the imaging unit may be a drone equipped with a camera. In this case, the control unit 112 may estimate or identify the height of the vehicle's windows based on the vehicle information. The control unit 112 may control the drone as the imaging unit to fly at a flight altitude corresponding to the height of the vehicle's windows. In this case, the control unit 112 may control the drone to fly around the vehicle once, or may control the drone to fly only a portion of the vehicle's periphery. For example, if the vehicle information indicates that the vehicle's rear passenger windows are privacy glass or that tinted film is attached to the rear passenger windows, the control unit 112 may control the drone to fly in front of the vehicle (e.g., around the windshield).

[0035] The second acquisition unit 113 acquires biometric information of the target based on the target image. The information processing device 100 may or may not include an imaging means. If the information processing device 100 does not include an imaging means, the control unit 112 may control the imaging means via the communication device 130. The biometric authentication of the target may be performed by the information processing device 100 or by a device different from the information processing device 100.

[0036] (Technical Effects) According to the information processing device 100 of the second embodiment, similarly to the information processing device 10 of the first embodiment, it is possible to reduce the time required to acquire biological information of a target.

[0037] Third Embodiment A third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 5. Hereinafter, the third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the third embodiment, descriptions that overlap with the descriptions for the first and second embodiments will be omitted as appropriate.

[0038] The information processing device 100 according to the third embodiment may include a calculation device 110a instead of the calculation device 110. The calculation device 110a may have one or more processors, similar to the calculation device 110. As shown in FIG. 5, the calculation device 110a may include a first acquisition unit 111, a control unit 112, a second acquisition unit 113, an estimation unit 114, and a notification unit 115 as logically realized functional blocks or as physically realized processing circuits. Note that at least one of the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, and the notification unit 115 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0039] Note that when the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, and the alarm unit 115 are realized as functional blocks, the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, and the alarm unit 115 may be realized by a single processor (for example, the processor 1101). Alternatively, the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, and the alarm unit 115 may be realized by different processors. Alternatively, some of the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, and the alarm unit 115 may be realized by a single processor, and the remaining parts of the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, and the alarm unit 115 may be realized by one or more other processors different from the single processor.

[0040] The estimation unit 114 may estimate, based on the vehicle information acquired by the first acquisition unit 111, whether or not it is possible to capture an image of the target from outside the vehicle in which the target is riding. In other words, the estimation unit 114 may estimate, based on the vehicle information, whether or not it is possible to acquire biometric information of the target from outside the vehicle. For example, if the vehicle indicated by the vehicle information is a vehicle without a rear seat (e.g., a truck), the estimation unit 114 may estimate that it is possible to capture an image of the target from outside the vehicle. For example, if the vehicle indicated by the vehicle information is a vehicle with a rear seat and the rear seat window is a vehicle (e.g., a passenger car), the estimation unit 114 may estimate that it is not possible to capture an image of the target from outside the vehicle.

[0041] If the estimation unit 114 estimates that the target can be imaged from outside the vehicle, the control unit 112 may control the imaging means based on the vehicle information. On the other hand, if the estimation unit 114 estimates that the target cannot be imaged from outside the vehicle, the notification unit 115 may notify a person performing entrance management (e.g., at least one of a security guard and a guard) of information indicating that the target cannot be imaged from outside the vehicle (e.g., at least one of a text message, an image, and a sound) via at least one of the communication device 130 and the output device 150. In this case, the person performing entrance management may guide the vehicle in which the target is riding to a designated parking space and call out to the target to get off for entry or exit procedures. Note that the person performing entrance management will hereinafter be referred to as the "manager" as appropriate.

[0042] (Technical Effects) According to the information processing device 100 of the third embodiment, it is possible to control the imaging means or prompt a manager (for example, at least one of a security guard and a guard) to take action in accordance with the estimation result by the estimation unit 114.

[0043] <Fourth embodiment> A fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 5. Hereinafter, the fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate.

[0044] The information processing device 100 according to the fourth embodiment may include a calculation device 110a shown in FIG. 5 instead of the calculation device 110. For example, when entering a factory or the like, advance application by the entrant is often required from the viewpoint of at least one of safety management, information management, and accident prevention. For example, the estimation unit 114 may acquire application information regarding the advance application by the entrant via the communication device 130. The estimation unit 114 may estimate whether or not the target biometric information can be acquired from outside the vehicle, based on the vehicle information acquired by the first acquisition unit 111 and the application information.

[0045] For example, if the application information indicates that three people will be riding in the vehicle indicated by the vehicle information and the vehicle information indicates that the rear seat window has privacy glass, the estimation unit 114 may estimate that the target cannot be imaged from outside the vehicle. For example, if the application information indicates that one person will be riding in the vehicle indicated by the vehicle information and the vehicle information indicates that the rear seat window has privacy glass, the estimation unit 114 may estimate that the target can be imaged from outside the vehicle.

[0046] (Technical Effects) According to the information processing device 100 according to the fourth embodiment, it is possible to more appropriately estimate whether or not an image of a target can be captured from outside the vehicle.

[0047] Fifth Embodiment A fifth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 5. Hereinafter, the fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the fifth embodiment, descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate.

[0048] The information processing device 100 according to the fifth embodiment may include a calculation device 110a shown in Fig. 5 instead of the calculation device 110. In the fifth embodiment, a vehicle in which a target rides is equipped with a camera capable of capturing an image of the target. Examples of the camera include at least one of an in-vehicle camera and a driver monitor camera.

[0049] When the estimation unit 114 estimates that the target cannot be imaged from outside the vehicle, the second acquisition unit 113 may acquire an interior image of the target captured by a camera mounted on the vehicle via the communication device 130. The second acquisition unit 113 may acquire biometric information of the target based on the interior image of the vehicle. Note that the second acquisition unit 113 may acquire an image of the target captured by a camera of a communication terminal carried by the target, instead of or in addition to the interior image of the vehicle. Note that an example of the communication terminal is at least one of a smartphone, a tablet terminal, and a laptop personal computer.

[0050] (Technical Effects) According to the information processing device 100 of the fifth embodiment, even if it is difficult to capture an image of a target from outside the vehicle, it is possible to acquire biometric information of the target without the target getting out of the vehicle.

[0051] Sixth Embodiment A sixth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 5. Hereinafter, the sixth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the sixth embodiment, descriptions that overlap with the descriptions of the first to fifth embodiments will be omitted as appropriate.

[0052] The information processing device 100 according to the sixth embodiment may include a calculation device 110a shown in FIG. 5 instead of the calculation device 110. For example, the notification unit 115 may acquire application information related to an advance application by an attendee via the communication device 130. The notification unit 115 may acquire authentication result information related to the result of biometric authentication of the target. Note that the biometric authentication of the target may be performed by the information processing device 100 or by a device different from the information processing device 100. Note that the calculation device 110a may not include the estimation unit 114.

[0053] For example, if the number of occupants of a vehicle indicated by the application information (in other words, the number of targets) is greater than the number of people for whom biometric authentication has succeeded for a vehicle indicated by the authentication result information, the notification unit 115 may issue a warning to an administrator (for example, at least one of a security guard and a guard). In other words, if the number of people for whom biometric authentication has succeeded for a vehicle indicated by the authentication result information is less than the number of occupants of a vehicle indicated by the application information, the notification unit 115 may issue a warning to an administrator.

[0054] Here, "biometric authentication has been successful" may mean that the subject has been identified as a specific individual. The authentication result information may include information (e.g., name) for identifying the subject whose biometric authentication has been successful. For example, when the notification unit 115 issues a warning, the notification unit 115 may notify the administrator of the names of the occupants of a vehicle whose biometric authentication has not been successful (in other words, the subjects). Note that the notification unit 115 may identify the names of the occupants whose biometric authentication has not been successful based on the application information.

[0055] (Technical Effects) According to the information processing device 100 of the sixth embodiment, it is possible to notify an administrator (for example, at least one of a security guard and a guard) whether or not the target biometric authentication has been performed appropriately.

[0056] Seventh Embodiment A seventh embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 6. Hereinafter, the seventh embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the seventh embodiment, descriptions that overlap with the descriptions of the first to sixth embodiments will be omitted as appropriate.

[0057] The information processing device 100 according to the seventh embodiment may include a calculation device 110b instead of the calculation device 110. The calculation device 110b may include one or more processors, similar to the calculation device 110. As shown in FIG. 6, the calculation device 110b may include a first acquisition unit 111, a control unit 112, a second acquisition unit 113, an estimation unit 114, a notification unit 115, and an image processing unit 116 as logically realized functional blocks or as physically realized processing circuits. At least one of the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, the notification unit 115, and the image processing unit 116 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. The calculation device 110b may not include the estimation unit 114.

[0058] When the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, the notification unit 115, and the image processing unit 116 are realized as functional blocks, the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, the notification unit 115, and the image processing unit 116 may be realized by a single processor (for example, the processor 1101). Alternatively, the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, the notification unit 115, and the image processing unit 116 may be realized by different processors. Alternatively, a portion of the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, the notification unit 115, and the image processing unit 116 may be realized by a single processor, and the remaining portions of the first acquisition unit 111, the control unit 112, the second acquisition unit 113, the estimation unit 114, the notification unit 115, and the image processing unit 116 may be realized by one or more other processors different from the single processor.

[0059] For example, the imaging means may be a drone equipped with a camera. The camera of the drone may continue capturing images while the drone is flying around the vehicle. The image processing unit 116 may acquire multiple images captured by the camera of the drone via, for example, the communication device 130. The image processing unit 116 may acquire the multiple images as image data or video data.

[0060] For example, the image processing unit 116 may detect an occupant (i.e., an object) of a vehicle based on multiple images captured by a camera of a drone. When an occupant of a vehicle is detected, the image processing unit 116 may attempt to detect the face of the detected occupant based on the multiple images captured by the camera of the drone. The image processing unit 116 may also identify the position (i.e., seat) of the detected occupant in the vehicle based on the multiple images captured by the camera of the drone. The image processing unit 116 may associate the position of the detected occupant in the vehicle with a face detection result indicating whether a face has been detected.

[0061] For example, facial recognition may be performed as the biometric authentication of the target. In this case, facial recognition may be performed on an occupant (in other words, the target) whose face is detected by the image processing unit 116. On the other hand, it is difficult to perform facial recognition on an occupant whose face is not detected by the image processing unit 116. Therefore, when there is an occupant associated with a face detection result indicating that the face has not been detected, the notification unit 115 may notify an administrator (e.g., at least one of a security guard and a security guard) of the location in a vehicle associated with the occupant. Note that when there is an occupant associated with a face detection result indicating that the face has been detected, the notification unit 115 may also notify an administrator of the location in a vehicle associated with the occupant.

[0062] (Technical Effects) In the information processing device 100 according to the seventh embodiment, an occupant whose face has not been detected may be notified to an administrator (for example, at least one of a security guard and a security guard) together with the location of the occupant. Therefore, according to the information processing device 100 according to the seventh embodiment, the administrator can easily grasp the location of the occupant to be checked.

[0063] Eighth Embodiment An eighth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 6. Hereinafter, the eighth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 100. Note that, for the eighth embodiment, descriptions that overlap with the descriptions of the first to seventh embodiments will be omitted as appropriate.

[0064] The information processing device 100 according to the eighth embodiment may include a calculation device 110b shown in FIG. 6 instead of the calculation device 110. For example, the imaging means may be AR (Augmented Reality) glasses worn by an administrator (e.g., at least one of a security guard and a security guard). The AR glasses may have a camera capable of capturing images of the administrator's surroundings. The camera of the AR glasses may continue capturing images while the administrator is wearing the AR glasses. The image processing unit 116 may acquire multiple images captured by the camera of the AR glasses, for example, via the communication device 130. The image processing unit 116 may acquire the multiple images as image data or as video data. The administrator may wear a head-mounted camera instead of the AR glasses. In this case, the image processing unit 116 may acquire multiple images captured by the head-mounted camera.

[0065] For example, the image processing unit 116 may identify portions of a vehicle that have been checked by the administrator based on multiple images captured by the camera of the AR glasses. The image processing unit 116 may identify portions of a vehicle that have not been checked by the administrator based on the portions that have been checked by the administrator. If there are portions of a vehicle that have not been checked by the administrator, the notification unit 115 may notify the administrator of the portions that have not been checked by the administrator. On the other hand, if there are no portions that have not been checked by the administrator, the notification unit 115 may not notify the administrator, or may notify the administrator that checking of all portions of a vehicle has been completed.

[0066] (Technical Effects) For example, some people may attempt to gain entry by fraudulent means, such as hiding behind a seat in a vehicle or hiding in the luggage compartment of the vehicle. For example, during relatively busy times such as in the morning and evening, the administrator may not be able to thoroughly check. In response to this, in the information processing device 100 according to the eighth embodiment, the notification unit 115 may notify the administrator if there is a part of a vehicle that the administrator has not checked. Therefore, the information processing device 100 according to the eighth embodiment can prevent the administrator from failing to check. As a result, it is possible to prevent people from gaining entry by fraudulent means.

[0067] Ninth Embodiment A ninth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 6. Hereinafter, the ninth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the ninth embodiment, descriptions that overlap with the descriptions of the first to eighth embodiments will be omitted as appropriate.

[0068] The information processing device 100 according to the ninth embodiment may include a calculation device 110b shown in FIG. 6 instead of the calculation device 110. For example, the imaging means may be a drone having a camera. The camera of the drone may continue capturing images while the drone is flying around the vehicle. The image processing unit 116 may acquire multiple images captured by the camera of the drone via, for example, the communication device 130. The image processing unit 116 may acquire the multiple images as image data or video data.

[0069] For example, the image processing unit 116 may detect an occupant (in other words, an object) of a vehicle based on multiple images captured by a camera of a drone. When an occupant of a vehicle is detected, the image processing unit 116 may attempt to detect the face of the detected occupant based on multiple images captured by the camera of the drone. Furthermore, when an occupant of a vehicle is detected, the image processing unit 116 may identify the position (in other words, the seat) of the detected occupant in the vehicle based on multiple images captured by the camera of the drone. The image processing unit 116 may associate the position of the detected occupant in the vehicle with a face detection result indicating whether a face has been detected.

[0070] The second acquisition unit 113 may acquire, as a target image, an image including an occupant whose face has been detected by the image processing unit 116. The second acquisition unit 113 may acquire biometric information of the occupant (in other words, the target) from the target image. In this case, the second acquisition unit 113 may associate the biometric information with a location in a vehicle. For example, the notification unit 115 may acquire authentication result information regarding the result of biometric authentication. Note that the biometric authentication may be performed by the information processing device 100 or by a device different from the information processing device 100.

[0071] When the number of occupants detected by the image processing unit 116 is greater than the number of occupants whose biometric authentication was successful, as indicated by the authentication result information, the notification unit 115 may identify the locations in the vehicle of the occupants whose biometric authentication was successful, based on the locations in the vehicle associated with the biometric information used for the biometric authentication of the occupants whose biometric authentication was successful, as indicated by the authentication result information. The notification unit 115 may identify the locations in the vehicle of the occupants whose biometric authentication was not successful, based on the locations in the vehicle of the occupants detected by the image processing unit 116. The notification unit 115 may notify a manager (e.g., at least one of a security guard and a security guard) of the locations in the vehicle of the occupants whose biometric authentication was not successful.

[0072] (Technical Effects) According to the information processing device 100 of the ninth embodiment, similarly to the information processing device 100 of the seventh embodiment, the manager can easily grasp the position of the occupant to be checked.

[0073] <Additional Notes> Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0074] (Appendix 1) A first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides; a control means for controlling an imaging means for imaging the object based on the vehicle information; a second acquisition means for acquiring biometric information of the subject based on a subject image including the subject captured by the imaging means; An information processing device comprising:

[0075] (Appendix 2) an estimation means for estimating whether or not the target can be imaged from outside the vehicle based on the vehicle information; When it is estimated that the object can be imaged from outside the vehicle, the control means controls the image capturing means based on the vehicle information. 2. The information processing device according to claim 1.

[0076] (Appendix 3) When it is estimated that the object cannot be imaged from outside the vehicle, a notification unit is provided to notify that the object cannot be imaged from outside the vehicle. 3. The information processing device according to claim 2.

[0077] (Appendix 4) The estimation means estimates whether or not the target can be photographed from outside the vehicle based on the vehicle information and application information related to a prior application by the visitor. 3. The information processing device according to claim 2.

[0078] (Appendix 5) a notification means for issuing a warning when the number of subjects riding in the vehicle indicated by the application information is greater than the number of subjects who have been successfully biometrically authenticated indicated by authentication result information indicating the result of biometric authentication performed using the biometric information; 5. The information processing device according to claim 4.

[0079] (Appendix 6) the imaging means is a drone having a camera, The drone is provided with a notification means for notifying the location of a target whose face has not been detected when the target's face is not detected from the image captured by the camera of the drone. 6. The information processing device according to claim 1,

[0080] (Appendix 7) an image processing means for acquiring an image from a camera attached to the head of a supervisor and identifying the part of the vehicle that the supervisor has confirmed; a notification means for notifying the manager of any part of the vehicle that has not been checked by the manager if the manager has not checked all parts of the vehicle; 7. The information processing device according to claim 1, further comprising:

[0081] (Appendix 8) and a notification means for notifying the location in the vehicle of a target whose biometric authentication has not been performed, based on the location in the vehicle of a target whose biometric authentication has been successful, which is indicated by authentication result information indicating the result of biometric authentication performed using the biometric information. 8. The information processing device according to claim 1,

[0082] (Appendix 9) A first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides; a control means for controlling an imaging means for imaging the object based on the vehicle information; a second acquisition means for acquiring biometric information of the subject based on a subject image including the subject captured by the imaging means; An information processing system comprising:

[0083] (Appendix 10) Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; controlling an imaging means for imaging the target based on the vehicle information; and acquiring biological information of the target based on a target image including the target captured by the imaging means. Information processing methods.

[0084] (Appendix 11) On the computer, Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; controlling an imaging means for imaging the target based on the vehicle information; and acquiring biological information of the target based on a target image including the target captured by the imaging means. A recording medium on which a computer program for executing an information processing method is recorded.

[0085] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 9 and 10 in the same dependent relationship as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1, 9, and 10, but also to various hardware, software, various recording means for recording software, or systems, some or all of the configurations described as Supplements may be made dependent on them in the same manner, within the scope of each of the above-mentioned embodiments.

[0086] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0087] 10, 100... information processing device, 11, 111... first acquisition unit, 12, 112... control unit, 13, 113... second acquisition unit

Claims

1. a first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which the subject is riding; a control means for controlling an imaging means for imaging the object based on the vehicle information; a second acquisition means for acquiring biometric information of the subject based on a subject image including the subject captured by the imaging means; An information processing device comprising:

2. an estimation means for estimating whether or not the target can be imaged from outside the vehicle based on the vehicle information; When it is estimated that the object can be imaged from outside the vehicle, the control means controls the image capturing means based on the vehicle information. The information processing device according to claim 1 .

3. When it is estimated that the object cannot be imaged from outside the vehicle, a notification means is provided to notify that the object cannot be imaged from outside the vehicle. The information processing device according to claim 2 .

4. The estimation means estimates whether or not the target can be photographed from outside the vehicle based on the vehicle information and application information related to a prior application by the visitor. The information processing device according to claim 2 .

5. a notification means for issuing a warning when the number of subjects riding in the vehicle indicated by the application information is greater than the number of subjects who have been successfully biometrically authenticated indicated by authentication result information indicating the result of biometric authentication performed using the biometric information; The information processing device according to claim 4 .

6. the imaging means is a drone having a camera, The drone is provided with a notification means for notifying the location of a target whose face is not detected when the target's face is not detected from the image captured by the camera of the drone. The information processing device according to claim 1 .

7. an image processing means for acquiring an image from a camera attached to the head of a supervisor and identifying the part of the vehicle that the supervisor has confirmed; a notification means for notifying the manager of any part of the vehicle that has not been checked by the manager if the manager has not checked all parts of the vehicle; The information processing device according to claim 1 , comprising:

8. a first acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which the subject is riding; a control means for controlling an imaging means for imaging the object based on the vehicle information; a second acquisition means for acquiring biometric information of the subject based on a subject image including the subject captured by the imaging means; An information processing system comprising:

9. Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; controlling an imaging means for imaging the target based on the vehicle information; and acquiring biological information of the target based on a target image including the target captured by the imaging means. Information processing methods.

10. On the computer, Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; controlling an imaging means for imaging the target based on the vehicle information; and acquiring biological information of the target based on a target image including the target captured by the imaging means. A recording medium on which a computer program for executing an information processing method is recorded.

Images