Information processing system, information processing device, information processing method, and recording medium

Abstract

This information processing system (10) comprises: an image acquisition means (110) that acquires an image of a subject moving from inside of a prescribed region to outside of the prescribed region; a tracking means (120) that tracks the subject included in the image; and a control means (130) that, on the basis of the result of tracking, controls the authentication level of an authentication process that is executed for a subject moving from outside of the prescribed region to inside of the prescribed region. According to this information processing system, it is possible to appropriately execute an authentication process for subjects entering and exiting a prescribed region.

Description

Information processing system, information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing device, an information processing method, and a recording medium.

[0002] There are known systems that perform authentication processing to allow a target to pass (e.g., unlock doors). For example, Patent Document 1 discloses a system that acquires a facial image of a target approaching a vehicle and unlocks the vehicle doors based on the facial image. Patent Document 2 discloses a system that performs authentication processing using image authentication technology such as face recognition and motion recognition, and controls locking devices installed in each door of the vehicle.

[0003] As another related technique, Patent Document 3 discloses object tracking by detecting an object outside the vehicle.

[0004] Japanese Patent Publication No. 2022-534284 Japanese Patent Application Laid-Open No. 2020-100963 International Publication No. 2020 / 250584

[0005] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0006] One aspect of the information processing system disclosed herein comprises an image acquisition means for acquiring an image of an object moving from inside a specified area to outside the specified area, a tracking means for tracking the object included in the image, and a control means for controlling an authentication level of an authentication process performed on an object moving from outside the specified area to inside the specified area based on the results of the tracking.

[0007] One aspect of the information processing device disclosed herein comprises an image acquisition means for acquiring an image of an object moving from inside a specified area to outside the specified area, a tracking means for tracking the object included in the image, and a control means for controlling an authentication level of an authentication process performed on an object moving from outside the specified area to inside the specified area based on the results of the tracking.

[0008] One aspect of the information processing method disclosed herein involves using at least one computer to acquire an image of an object moving from inside a specified area to outside the specified area, tracking the object included in the image, and controlling the authentication level of an authentication process performed on the object moving from outside the specified area to inside the specified area based on the tracking results.

[0009] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring an image of an object moving from inside a specified area to outside the specified area, tracking the object included in the image, and controlling, based on the tracking result, an authentication level of an authentication process performed on an object moving from outside the specified area to inside the specified area.

[0010] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. FIG. 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. FIG. 2 is a flowchart showing an operation flow of the information processing system according to the first embodiment. FIG. 3 is a plan view showing an example of face authentication in an information processing system according to a second embodiment. FIG. 4 is a conceptual diagram showing an example of setting an authentication level in an information processing system according to a third embodiment. FIG. 1 is a block diagram showing a functional configuration of an information processing system according to a fourth embodiment. FIG. 2 is a flowchart showing an operation flow of the information processing system according to the fourth embodiment. FIG. 3 is a flowchart showing an operation flow of an authentication necessity determination operation in an information processing system according to a fifth embodiment. FIG. 4 is a flowchart showing an operation flow of an information processing system according to a sixth embodiment. FIG. 5 is a block diagram showing a functional configuration of an information processing system according to a seventh embodiment. FIG. 5 is a flowchart showing a flow of a door control operation in an information processing system according to the seventh embodiment. FIG. 6 is a block diagram showing a functional configuration of an information processing system according to an eighth embodiment. FIG. 6 is a flowchart showing an operation flow of the information processing system according to the eighth embodiment. FIG. 7 is a block diagram showing a functional configuration of an information processing system according to a ninth embodiment. FIG. 7 is a flowchart showing an operation flow of the information processing system according to the ninth embodiment. FIG. 8 is a table showing an example of setting an authentication level in an information processing system according to the ninth embodiment. FIG. 9 is a block diagram showing a functional configuration of an information processing system according to a tenth embodiment. FIG. 9 is a flowchart showing an operation flow of the information processing system according to the tenth embodiment. FIG. 10 is a block diagram showing a functional configuration of an information processing device according to an eleventh embodiment.

[0011] Hereinafter, embodiments of an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0012] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3. FIG.

[0013] (Hardware Configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0014] 1 , an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0015] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks for tracking targets and controlling authentication levels are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0016] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0017] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0018] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0019] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0020] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0021] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing system 10 as audio.

[0022] 1 illustrates an example of an information processing system 10 including multiple devices, but all or some of the functions may be realized by a single device (information processing device). In this case, the information processing device may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, input device 15, and output device 16) may be provided by an external device connected to the information processing device. Furthermore, some of the calculation functions of the information processing device may be realized by an external device (e.g., an external server, a cloud, etc.).

[0023] (Functional Configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0024] 2, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, and a control unit 130. Each of the image acquisition unit 110, the tracking unit 120, and the control unit 130 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0025] The image acquisition unit 110 is configured to be able to acquire an image including an object (hereinafter referred to as a "object image" as appropriate). Note that the "object" here is not limited to a human being, but may include, for example, animals such as dogs and cats, robots, etc. The image acquisition unit 110 acquires an image of an object moving from inside a predetermined area to outside the predetermined area. The image acquisition unit 110 may acquire not only an image of the object moving from inside the predetermined area to outside the predetermined area, but also an image before the movement (i.e., an image of the object before it moves outside the predetermined area) and an image after the movement (i.e., an image of the object after it moves outside the predetermined area). The image acquisition unit 110 may also acquire an image used in the authentication process described below.

[0026] The image acquisition unit 110 acquires an image of the target from, for example, a camera that captures an image of the target. The camera that captures the image of the target may be a camera included in the information processing system 10, or may be a camera external to the information processing system. The camera may be a visible light camera or a near-infrared camera. The image acquisition unit 110 may also be configured to acquire images from multiple cameras. In this case, the multiple cameras may be different types of cameras (for example, cameras with different imaging ranges, imaging angles, imaging quality, etc.). The target image acquired by the image acquisition unit 110 is configured to be output to the tracking unit 120.

[0027] The tracking unit 120 is configured to be able to use the target image acquired by the image acquisition unit 110 to track the target included in the image (i.e., the process of tracking the position of the target). Note that a specific method of tracking using an image can be appropriately adopted from existing technologies, so a detailed description thereof will be omitted here. The tracking unit 120 continues to track the target after it moves outside a predetermined area. The tracking unit 120 may track the target using multiple frames of images (in other words, video) acquired by the image acquisition unit 110. The tracking result by the tracking unit 120 (hereinafter appropriately referred to as the "tracking result") is configured to be output to the control unit 130.

[0028] The control unit 130 is configured to control the authentication level of the authentication process performed on an object moving from outside the specified area to inside the specified area based on the tracking result by the tracking unit 120. The object on which the authentication process is performed may be, for example, an object that has moved from inside the specified area to outside and then attempts to return from outside to inside the specified area. The "authentication level" here may be a level indicating the level of authentication accuracy. For example, a higher authentication level may result in higher authentication accuracy, and a lower authentication level may result in lower authentication accuracy. A high authentication level (i.e., high authentication accuracy) reduces the probability of falsely accepting a stranger, thereby improving security performance. On the other hand, if the authentication level is set too high, the probability of rejecting the correct person increases, which may hinder user convenience. On the other hand, if the authentication level is set too low (i.e., low authentication accuracy), the probability of rejecting the correct person decreases, which improves user convenience. On the other hand, if the authentication level is set too low, the probability of falsely accepting a stranger increases, which may reduce security performance. The authentication level may be controlled, for example, by changing the authentication threshold used to determine the success or failure of the authentication process. In this case, the control unit 130 may increase the authentication threshold when increasing the authentication level, and decrease the authentication threshold when decreasing the authentication level. Alternatively, the authentication level may be controlled by changing whether or not the authentication process is required. In this case, the control unit 130 may set the authentication process to be required when increasing the authentication level, and set the authentication process to be unnecessary when decreasing the authentication level. Alternatively, the authentication level may be controlled by changing the number (types) of authentication processes. In this case, the control unit 130 may increase the number of authentication processes when increasing the authentication level, and decrease the number of authentication processes when decreasing the authentication level.

[0029] The above-described authentication process may be executed by the control unit 130. That is, the control unit 130 may have a function for executing the authentication process of the target. In this case, the control unit 130 may acquire information used in the authentication process and execute the authentication process based on the controlled authentication level. Alternatively, the authentication process may be executed by an authentication device external to the information processing system 10. In this case, the control unit 130 may transmit information used in the authentication process and information related to the authentication level to the external authentication device, and then receive the authentication result from the authentication device. The control unit 130 may also have a function for outputting various information related to the authentication process (e.g., information used for authentication, information related to the controlled authentication level, information related to the authentication result, etc.) to the target. The control unit 130 may, for example, display various information related to the authentication process on a display provided in the above-described output device 16 (see FIG. 1 ). Alternatively, the control unit 130 may output various information related to the authentication process as audio via a speaker provided in the output device 16.

[0030] The authentication process may be a process executed to permit a target to move from outside a predetermined area to inside the predetermined area. For example, if the target authentication process is successful, a process may be executed to open a gate through which the target passes when moving inside the predetermined area or to unlock a door lock. The information processing system 10 may be configured to execute a process to permit the target to move as described above. That is, the information processing system 10 may be configured to have a function to control a gate, a door lock, or the like. The predetermined area is not particularly limited, and examples include a building or facility requiring entry permission (e.g., a company or apartment building with an entrance gate), a room requiring entry permission, and a mobile object (e.g., a car). In another embodiment described below, a configuration in which the predetermined area is a mobile object will be described in detail.

[0031] (Operation Flow) Next, the operation flow of the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the operation flow of the information processing system according to the first embodiment.

[0032] 3, when the operation of the information processing system 10 according to the first embodiment is started, the image acquisition unit 110 first acquires an image of an object moving from inside a predetermined area to outside the predetermined area (step S101). Note that the object image may be captured only when an object moving from inside to outside the predetermined area is detected. Alternatively, the object image may be captured continuously, and the image acquired by the image acquisition unit 110 when an object moving from inside to outside the predetermined area is detected.

[0033] Next, the tracking unit 120 tracks the target using the target image acquired by the image acquisition unit 110 (step S102). Note that the tracking unit 120 may stop tracking if it loses sight of the target being tracked. Thereafter, the tracking unit 120 may resume tracking if it detects the lost target. The tracking unit 120 may stop tracking when a predetermined period has elapsed since starting tracking.

[0034] Next, the control unit 130 controls the authentication level of the authentication process to be performed on the target moving from outside the predetermined area to inside the predetermined area based on the information from the tracking unit 120 (step S103). The control unit 130 may change the authentication level at the timing of performing the authentication process. Alternatively, the control unit 130 may change the authentication level as needed while tracking the target. In this case, the control unit 130 may change the authentication level every time the tracking result changes. Alternatively, the control unit 130 may change the authentication level at predetermined intervals. When the authentication process for the target being tracked has ended, the control unit 130 may end control of the authentication level.

[0035] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0036] As described with reference to FIGS. 1 to 3 , the information processing system 10 according to the first embodiment tracks an object moving from inside a predetermined area to outside the predetermined area, and changes the authentication level of the authentication process based on the tracking results. Changing the authentication level in this manner makes it possible to perform appropriate authentication processing for an object that enters and exits the predetermined area in a relatively short time. For example, an object that moves outside the predetermined area by a predetermined distance and then immediately attempts to return to the inside of the predetermined area is considered to have little need for authentication processing. Therefore, the information processing system 10 according to the present embodiment lowers the authentication level for an object that can be tracked without losing sight of the object after moving outside the predetermined area and is considered to have little need for authentication processing, making the authentication process more likely to be successful. On the other hand, the information processing system 10 according to the present embodiment increases the authentication level for an object that cannot be accurately tracked after moving outside the predetermined area and is considered to have a high need for authentication processing. In this way, appropriate authentication processing can be performed without unnecessarily increasing the burden on the object.

[0037] Second Embodiment An information processing system 10 according to a second embodiment will be described with reference to Fig. 4. Note that the second embodiment describes a specific example of authentication processing, and the system configuration, overall operational flow, etc. may be the same as those of the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit explanations of other overlapping parts as appropriate.

[0038] (Biometric authentication) First, biometric authentication performed by the information processing system 10 according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a plan view showing an example of face authentication in the information processing system according to the second embodiment.

[0039] In the information processing system 10 according to the second embodiment, the control unit 130 is configured to be able to control the authentication level of biometric authentication. Biometric authentication is performed using biometric information of a target, and examples thereof include face authentication using a face, iris authentication using an iris, and fingerprint authentication using a fingerprint.

[0040] As shown in FIG. 4 , the information processing system 10 according to the second embodiment may be configured to perform face authentication. When performing face authentication, the image acquisition unit 110 may acquire a face image of a target moving from outside a predetermined area to inside the predetermined area. Then, the control unit 130 may perform face authentication based on the face image acquired by the image acquisition unit 110. When performing face authentication, a face area in which the target's face is present is first detected from the face image. The face area may be detected as a rectangular area including the target's face, such as the area surrounded by a dashed line in the figure. Then, facial features may be extracted from the detected face area. Then, face authentication may be performed by comparing the extracted facial features with pre-registered facial features. Specifically, it may be determined whether a score indicating the degree of match between the extracted facial features and the registered facial features exceeds a predetermined authentication threshold. In this case, the control unit 130 may control the authentication level of face authentication by changing the authentication threshold.

[0041] The information processing system 10 according to the second embodiment may be configured to perform multiple types of biometric authentication. For example, the information processing system 10 may be configured to perform both face authentication and iris authentication. In this case, the control unit 130 may control the authentication level of the biometric authentication by changing the authentication threshold of either the face authentication or the iris authentication. Alternatively, the control unit 130 may control the authentication level of the biometric authentication by changing the authentication thresholds of both the face authentication and the iris authentication. Alternatively, the control unit 130 may control the authentication level of the biometric authentication by eliminating the need for either the face authentication or the iris authentication.

[0042] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0043] 4, in the information processing system 10 according to the second embodiment, the authentication level of the biometric authentication is changed based on the tracking result of the target. In this way, it is possible to perform appropriate biometric authentication on a target that has temporarily moved outside a predetermined area without unnecessarily increasing the burden on the target.

[0044] Third Embodiment An information processing system 10 according to a third embodiment will be described with reference to Fig. 5. Note that the third embodiment describes a specific example of a predetermined area, and the system configuration, overall operational flow, etc. may be the same as those of the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0045] (Authentication process in a mobile object) First, a specific example of guide information in the information processing system 10 according to the third embodiment will be described with reference to Fig. 5. Fig. 6 is a plan view showing an example of guide information in the information processing system according to the third embodiment.

[0046] In the information processing system 10 according to the third embodiment, the inside of the mobile body is set as the inside of the predetermined area, and the outside of the mobile body is set as the outside of the predetermined area. That is, in the information processing system 10 according to the third embodiment, the image acquisition unit 110 acquires images of an object moving from the inside of the mobile body to the outside of the mobile body, and the tracking unit 120 tracks the object that has left the mobile body. Then, the control unit 130 controls the authentication level of the authentication process executed for an object moving from the outside of the mobile body to the inside of the mobile body.

[0047] As shown in Fig. 5, the moving body may be a vehicle 50. In this case, when an occupant of the vehicle 50 gets out of the vehicle 50, the image acquisition unit 110 acquires an image of the occupant, and the tracking unit 120 tracks the occupant who has gotten out of the vehicle 50. The authentication process is executed, for example, as a process for unlocking the door lock of the vehicle 50. That is, the authentication process is executed when the occupant returns to the vehicle 50, and if the authentication process is successful, the door lock is unlocked. In this case, not only the door lock is unlocked, but also control may be executed to automatically open the door.

[0048] As already described, the authentication level of the authentication process is controlled based on the tracking result. For example, when the target can be tracked without losing sight of it, the control unit 130 sets the authentication level to a low level, making it easier for the authentication process to be successful. Specifically, as shown in FIG. 5A, when a passenger who gets off the vehicle 50 returns immediately, the authentication level may be set to a low level. On the other hand, when the target is lost during tracking, the control unit 130 sets the authentication level to a high level, making it harder for the authentication process to be successful. As shown in FIG. 5B, when a passenger who gets off the vehicle 50 enters a building (i.e., becomes unable to be tracked) and returns to the vehicle 50 after a while, the authentication level may be set to a high level.

[0049] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0050] 6, in the information processing system 10 according to the third embodiment, the authentication level of the authentication process for a passenger who has returned to the mobile body is controlled based on the tracking result of the passenger who has disembarked from the mobile body. In this way, it becomes possible to perform appropriate biometric authentication for a subject who has been away from the mobile body for a relatively short time without unnecessarily increasing the burden on the subject.

[0051] In the present embodiment, the vehicle 50 is given as an example of a moving body, but the moving body is not limited to the vehicle 50. For example, the moving body may be a train, a ship, an airplane, etc. In the following embodiments, the description will be given taking as an example a configuration in which the moving body (mainly a vehicle) described in the third embodiment is set as the predetermined area.

[0052] Fourth Embodiment An information processing system 10 according to a fourth embodiment will be described with reference to Figures 6 and 7. Note that the fourth embodiment differs only in part of the configuration and operation from the first to third embodiments described above, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0053] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment. Note that in Fig. 6, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0054] 6, the information processing system 10 according to the fourth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, and a control unit 130. In particular, the control unit 130 according to the fourth embodiment includes a tracking score calculation unit 131 and an authentication necessity determination unit 132.

[0055] The tracking calculation unit 131 is configured to calculate a tracking score indicating the reliability of tracking based on the tracking result of the tracking unit 120. For example, if the target is tracked without losing sight of it, the tracking score calculation unit 131 may calculate a high tracking score. On the other hand, if the target is lost during tracking, the tracking score calculation unit 131 may calculate a low tracking score. More specifically, the tracking score calculation unit 131 may execute a process to lower the tracking score each time a state occurs in which the target goes out of the camera's imaging range or the target is hidden by an obstruction or the like and becomes invisible. The tracking score calculated by the tracking score calculation unit 131 is configured to be output to the authentication necessity determination unit 132.

[0056] The authentication necessity determining unit 132 determines whether authentication processing is necessary when moving from the outside of the mobile body to the inside of the mobile body, depending on the tracking score calculated by the tracking score calculation unit 131. For example, if the tracking score is higher than a predetermined score, the authentication necessity determining unit 132 may unlock the door lock of the mobile body without performing authentication processing. In this case, the authentication level is effectively low. Alternatively, if the tracking score is lower than the predetermined score, the authentication necessity determining unit 132 may unlock the door lock of the mobile body only if the authentication processing is successful. In this case, the authentication level is high compared to when the above-mentioned authentication processing is not performed. Note that when multiple authentication processing is performed, the authentication necessity determining unit 132 may determine whether to perform each of the multiple authentication processing.

[0057] (Operation Flow) Next, the operation flow of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the operation flow of the information processing system according to the fourth embodiment. Note that in Fig. 7, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0058] 7 , when the operation of the information processing system 10 according to the fourth embodiment is started, the image acquisition unit 110 first acquires an image of a target moving from inside the moving body to outside the moving body (step S101). Then, the tracking unit 120 uses the target image acquired by the image acquisition unit 110 to track the target that has moved outside the moving body (step S102).

[0059] Next, the tracking score calculation unit 131 calculates a tracking score based on the tracking result by the tracking unit 120 (step S401). After that, the authentication necessity determination unit 132 determines whether authentication processing is necessary or not, depending on the tracking score calculated by the tracking score calculation unit 131 (step S402). Note that a more specific configuration for determining whether authentication processing is necessary or not will be described in detail in another embodiment described later.

[0060] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0061] 6 and 7, in the information processing system 10 according to the fourth embodiment, whether or not authentication processing is required is determined based on the tracking score. In this way, it is possible to accurately control the likelihood of success of authentication processing according to the reliability of tracking.

[0062] Fifth Embodiment An information processing system 10 according to a fifth embodiment will be described with reference to Fig. 8. Note that the fifth embodiment describes a specific example of the authentication necessity determination operation in the fourth embodiment described above (i.e., the processing of step S107 in Fig. 7), and the system configuration, overall operational flow, etc. may be the same as those of the fourth embodiment. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0063] (Authentication Necessity Determining Operation) First, an authentication necessity determining operation (i.e., an operation for determining whether authentication processing is necessary based on the tracking score) in the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the authentication necessity determining operation in the information processing system according to the fifth embodiment.

[0064] The information processing system 10 according to the fifth embodiment is configured to be able to perform face authentication (see FIG. 4 ) and liveness determination as biometric authentication. Liveness determination is a process for determining whether a target is a living organism. In other words, liveness determination is a process for determining whether a target is impersonating another. The method of liveness determination is not particularly limited, and may be, for example, a method for determining whether a target is a living organism based on the results of analyzing a target image. More specifically, the method may instruct the target to perform a predetermined action (for example, moving the eyes from side to side), and determine that the target is a living organism if the target moves as instructed.

[0065] 8 , when the authentication necessity determining operation in the information processing system 10 according to the fifth embodiment is started, the authentication necessity determining unit 132 first determines whether the tracking score exceeds a first threshold (step S501). The "first threshold" here is a threshold set for determining whether the reliability of tracking is sufficiently high (for example, whether there is an extremely high possibility that the subject that left the moving body and the subject that returned are the same subject).

[0066] If the tracking score exceeds the first threshold (step S501: YES), the authentication necessity determining unit 132 determines that neither facial authentication nor liveness assessment is necessary (step S502). In this case, the door lock of the moving object is unlocked without performing either facial authentication or liveness assessment. That is, movement into the moving object is permitted without performing the target authentication process.

[0067] If the tracking score does not exceed the first threshold (step S501: NO), the authentication necessity determining unit 132 determines whether the tracking score is below the second threshold (step S503). The "second threshold" here is a value lower than the first threshold and is set to determine a state in which the reliability of tracking is low (for example, a state in which it cannot be guaranteed that the subject that left the moving body and the subject that returned are the same).

[0068] If the tracking score is below the second threshold (step S503: YES), the authentication necessity determining unit 132 determines that both face authentication and liveness assessment are necessary (step S504). In this case, if both face authentication and liveness assessment are successful, the door lock of the moving object is unlocked. That is, movement into the moving object is permitted only after strict authentication processing of the target is performed.

[0069] On the other hand, if the tracking score is not below the second threshold (step S503: NO), the authentication necessity determining unit 132 determines that either facial authentication or liveness assessment is required (step S505). In this case, if at least one of facial authentication and liveness assessment is successful, the door lock of the moving object is unlocked. In other words, after a simplified authentication process for the target is performed, movement into the moving object is permitted.

[0070] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0071] As described with reference to FIG. 8 , in the information processing system 10 according to the fifth embodiment, whether or not authentication processing is required is determined based on the magnitude relationship between the tracking score and multiple thresholds. This makes it possible to accurately control the likelihood of success of authentication processing depending on the reliability of tracking. Specifically, when the tracking score is high, all authentication processing is unnecessary, thereby allowing movement inside the moving body without increasing the burden on the user. When the tracking score is low, requiring success of all authentication processing prevents inappropriate targets (e.g., people who are not the owner of the vehicle 50) from being allowed to move inside the moving body. Furthermore, when the tracking score is medium, requiring success of only part of the authentication processing prevents inappropriate targets from being allowed to move inside the moving body without significantly increasing the burden on the user.

[0072] In the above-described embodiment, an example was given in which two types of authentication processes, face authentication and liveness determination, were executed, but it would also be possible to determine whether more authentication processes are required. That is, it would be possible to control the likelihood of success of authentication processes in more detail by appropriately determining whether three or more types of authentication processes are required depending on the tracking score.

[0073] Sixth Embodiment An information processing system 10 according to a sixth embodiment will be described with reference to Fig. 9. Note that the sixth embodiment differs from the first to fifth embodiments described above only in some of its operations, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0074] (Operation Flow) Next, the operation flow of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the operation flow of the information processing system according to the sixth embodiment.

[0075] 9 , when the operation of the information processing system 10 according to the sixth embodiment is started, the image acquisition unit 110 first acquires images of multiple targets moving from inside the moving body to outside the moving body (step S601). The multiple targets here are, for example, passengers (e.g., the driver and passengers) who appeared in the same vehicle 50. The image acquisition unit 110 may acquire a single image that includes all of the multiple targets, or may acquire multiple images that include the multiple targets separately.

[0076] Next, the tracking unit 120 uses the target images acquired by the image acquisition unit 110 to track the multiple targets that have moved outside the moving body (step S602). That is, tracking is performed separately for each of the multiple targets.

[0077] Next, the tracking score calculation unit 131 determines whether a passing-by has occurred based on the tracking results of the multiple targets (step S603). Here, "passing-by" refers to a state in which at least one of the multiple targets overlaps with another person and is therefore hidden from the camera. When a passing-by occurs, for example, there is a possibility that the tracking target and the other person may be swapped, which is thought to reduce the reliability of tracking. For this reason, the tracking score calculation unit 131 according to this embodiment executes a process to reduce the tracking score when a passing-by has occurred. However, the extent to which the tracking score is reduced varies depending on the circumstances when the passing-by has occurred, as follows:

[0078] If no passing has occurred (step S603: NO), the subsequent processing may be omitted. That is, the tracking score calculation unit 131 does not need to execute processing to lower the tracking score. On the other hand, if a passing has occurred (step S603: YES), the tracking score calculation unit 131 determines whether the passing is between passengers (step S604). Whether the passing is between passengers can be determined based on the tracking results of each of the multiple targets.

[0079] In the case of a passing encounter between fellow passengers (step S604: YES), the tracking score calculation unit 131 reduces the extent of the decrease in the tracking score due to the passing encounter (step S605). This is because, in the case of a passing encounter between fellow passengers, even if the subjects are switched, both passengers are still passengers of the moving object, and there is little need to make it difficult for the authentication process to succeed.

[0080] On the other hand, if the passing is not between fellow passengers (i.e., if the passing is with a third party who is not a fellow passenger) (step S604: NO), the tracking score calculation unit 131 increases the amount of reduction in the tracking score due to the passing (step S606). If the passing is not between fellow passengers, if a switch occurs, there is a possibility that the third party will be permitted to move inside the moving body. For this reason, if a passing with a third party occurs, it is necessary to make it difficult for the authentication process to succeed.

[0081] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

[0082] 9, in the information processing system 10 according to the sixth embodiment, when a passing of a tracking target occurs, the extent of the decrease in tracking is changed depending on whether the passing is between passengers or not. In this way, it is possible to appropriately control the likelihood of success of authentication processing, taking into account the degree of decrease in the reliability of tracking due to the passing of a tracking target.

[0083] Seventh Embodiment An information processing system 10 according to a seventh embodiment will be described with reference to Figures 10 and 11. The seventh embodiment differs only in part of the configuration and operation from the first to sixth embodiments described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0084] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the information processing system according to the seventh embodiment. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0085] 10 , the information processing system 10 according to the seventh embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, a control unit 130, a baggage determination unit 140, and a door control unit 150. That is, the information processing system 10 according to the seventh embodiment further includes, in addition to the configuration of the first embodiment (see FIG. 2 ), the baggage determination unit 140 and the door control unit 150. Note that each of the baggage determination unit 140 and the door control unit 150 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1 ).

[0086] The luggage determination unit 140 is configured to detect or predict whether an object approaching a moving object is carrying luggage. For example, the luggage determination unit 140 may detect whether the object is carrying luggage by analyzing the area around the hand in the object image. Alternatively, the luggage determination unit 140 may predict that the object is carrying luggage (e.g., holding a jacket that was taken off during the process) when the object's body shape or clothing has changed. Note that changes in body shape or clothing can be detected, for example, by comparing an image of the object when it moves from inside to outside the moving object with an image of the object when it returns to the moving object. The determination result of the luggage determination unit 140 is configured to be output to the door control unit 150.

[0087] The door control unit 150 is configured to be able to control the opening and closing of the doors of the mobile body. Specifically, the door control unit 150 is configured to be able to automatically open the doors of the mobile body based on the result of the authentication process and the determination result of the baggage determination unit 140. In other words, the door control unit 150 is configured to be able to open the doors even when the target has not performed an operation to open the doors. Note that, when multiple doors are installed in the mobile body, the door control unit 150 is configured to be able to specify and open / close a door. The door control unit 150 may also be configured to be able to unlock the doors. Below, a specific description will be given of the operation of the door control unit when controlling the opening and closing of the doors of the mobile body (hereinafter referred to as "door control operation" as appropriate).

[0088] (Door Control Operation) Next, the flow of the door control operation by the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of the door control operation in the information processing system according to the seventh embodiment.

[0089] 11 , when the door control operation by the information processing system 10 according to the seventh embodiment is started, the door control unit 150 first determines whether or not the authentication process of the target approaching the moving object has been successful (step S701). If the authentication process has not been successful (step S701: NO), the subsequent processes may be omitted. In other words, the door control unit 150 may not execute the process of opening the door.

[0090] On the other hand, if the authentication process is successful (step S701: YES), the door control unit 150 determines whether the target is carrying luggage (step S702) based on the determination result of the luggage determination unit 140. If the target is carrying luggage (step S702: YES), the door control unit 150 identifies a location where the target will store the luggage (step S703).

[0091] The door control unit 150 may store, for example, the target's past behavioral history and identify a location where the target will store luggage based on the behavioral history. For example, if it is known from the target's past behavioral history that the target often stores luggage in the passenger seat, the door control unit 150 may identify the passenger seat as a luggage storage location. Alternatively, the door control unit 150 may identify a location with no passengers or a location with ample space as a luggage storage location. For example, the door control unit 150 may identify an empty rear seat or a trunk as a luggage storage location. Alternatively, the door control unit 150 may identify a location closest to the target's current position as a luggage storage location. For example, if the target is approaching the rear of the vehicle, the door control unit 150 may identify the trunk at the rear of the vehicle as a luggage storage location.

[0092] Thereafter, the door control unit 150 executes a process of automatically opening the door corresponding to the identified location (step S704). Note that the door control unit 150 may output a voice message such as "The door will open automatically" when opening the door. Alternatively, the door control unit 150 may execute control to turn on a lamp located near the door that is about to open. Furthermore, the door control unit 150 may execute control to automatically close the door when the target has finished storing the luggage.

[0093] If the target person does not have any luggage (step S702: NO), the door control unit 150 executes control to unlock the door (step S705).

[0094] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the seventh embodiment will be described.

[0095] 10 and 11 , in the information processing system 10 according to the seventh embodiment, when the authentication process of the target is successful and the target is carrying luggage, a process of automatically opening a door corresponding to a location where the luggage is to be stored is executed. In this way, even if the target's hands are full with luggage (i.e., it is difficult to open or close the door), the luggage can be stored in the mobile object through the automatically opened door.

[0096] Eighth Embodiment An information processing system 10 according to an eighth embodiment will be described with reference to Figures 12 and 13. The eighth embodiment differs only in part of the configuration and operation from the first to seventh embodiments described above, and other parts may be the same as the first to seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0097] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the eighth embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the information processing system according to the eighth embodiment. Note that in Fig. 12, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0098] 12, the information processing system 10 according to the eighth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, a control unit 130, and a time measurement unit 160. That is, the information processing system 10 according to the eighth embodiment further includes the time measurement unit 160 in addition to the configuration of the first embodiment (see FIG. 2). Note that the time measurement unit 160 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0099] The time measurement unit 160 is configured to be able to measure the time that has elapsed since the target left the moving body. The time measurement unit 160 may start measuring the elapsed time by detecting the timing at which the target left the moving body from the target image. Alternatively, the time measurement unit 160 may start measuring the elapsed time when tracking of the target by the tracking unit 120 begins. Information regarding the elapsed time measured by the time measurement unit 160 is output to the control unit 130. The control unit 130 according to this embodiment is configured to be able to control the authentication level based on the elapsed time measured by the time measurement unit 120 in addition to the tracking result by the tracking unit 120.

[0100] (Operation Flow) Next, the operation flow of the information processing system 10 according to the eighth embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the operation flow of the information processing system according to the eighth embodiment. Note that in Fig. 13, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0101] 13 , when the operation of the information processing system 10 according to the eighth embodiment is started, the image acquisition unit 110 first acquires an image of a target moving from inside the moving body to outside the moving body (step S101). Then, the tracking unit 120 uses the target image acquired by the image acquisition unit 110 to track the target that has moved outside the moving body (step S102).

[0102] Next, the time measurement unit 160 measures the elapsed time since the target left the moving object (step S801). Then, the control unit 130 controls the authentication level based on the tracking result by the tracking unit 120 and the elapsed time measured by the time measurement unit 160 (step S802). For example, the control unit 130 may control the authentication level to be lower when the tracking reliability is high and the elapsed time is short. Alternatively, the control unit 130 may control the authentication level to be higher when the tracking reliability is low and the elapsed time is long. The control unit 130 may control the authentication level based on an integrated score calculated from the tracking result and the elapsed time.

[0103] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the eighth embodiment will be described.

[0104] As described with reference to FIGS. 12 and 13 , in the information processing system 10 according to the eighth embodiment, the authentication level of the authentication process is controlled based on the tracking result as well as the elapsed time since the target left the moving body. If the elapsed time is short, the target approaching the moving body is likely to be the same target that left the moving body. Therefore, by lowering the authentication level and making it easier for the authentication process to succeed, it is possible to suppress an increase in the burden on the target. Also, there are cases where the elapsed time is long. Therefore, by raising the authentication level and making it harder for the authentication process to succeed, it is possible to prevent inappropriate targets from being allowed to move inside the moving body.

[0105] Ninth Embodiment An information processing system 10 according to a ninth embodiment will be described with reference to Figures 14 to 16. Note that the ninth embodiment differs only in part of the configuration and operation from the first to eighth embodiments described above, and other parts may be the same as the first to eighth embodiments. Therefore, hereinafter, only the parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0106] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the information processing system according to the ninth embodiment. Note that in Fig. 14, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0107] 14, the information processing system 10 according to the ninth embodiment includes, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, and a control unit 130. In particular, the control unit 130 according to the ninth embodiment includes a seat movement determination unit 133.

[0108] The seat movement determination unit 133 is configured to be able to determine seat movement of a passenger in the moving body. The seat movement determination unit 133 determines seat movement based on the tracking result by the tracking unit 120. For example, when an object that has left the driver's seat of the moving body gets into the moving body from the passenger's seat, the seat movement determination unit 133 determines that the object has moved from the driver's seat to the passenger's seat. Note that when there are multiple passengers in the moving body, the seat movement determination unit 133 may determine seat movement for each of the multiple passengers.

[0109] The control unit 130 according to this embodiment is configured to be able to control the authentication level based on the determination result of the above-described seat movement determination unit 133. A method for controlling the authentication level based on seat movement will be described in detail below.

[0110] (Operation Flow) Next, the operation flow of the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the operation flow of the information processing system according to the ninth embodiment. Note that in Fig. 15, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0111] 15 , when the operation of the information processing system 10 according to the ninth embodiment is started, the image acquisition unit 110 first acquires an image of a target moving from inside the moving body to outside the moving body (step S101). Then, the tracking unit 120 uses the target image acquired by the image acquisition unit 110 to track the target that has moved outside the moving body (step S102).

[0112] Next, the seat movement determination unit 133 determines whether or not the target seat has moved based on the tracking result by the tracking unit 120 (step S901). If the target seat has not moved (step S901: NO), the subsequent processing may be omitted. In this case, as described in the other embodiments above, the authentication level may be controlled without taking seat movement into consideration.

[0113] On the other hand, if the seat of the subject has moved (step S901: YES), the seat movement determination unit 133 determines whether the seat movement is to the driver's seat (step S902). If the seat movement is to the driver's seat (step S902: YES), the control unit 130 sets the authentication level higher (step S903). That is, control is performed so that the authentication process of the subject who moves to the driver's seat is relatively less likely to succeed. On the other hand, if the seat movement is to a seat other than the driver's seat (step S902: NO), the control unit 130 sets the authentication level lower (step S904). That is, control is performed so that the authentication process of the subject who moves to a seat other than the driver's seat is relatively more likely to succeed.

[0114] (Specific Example of Authentication Level Setting) Next, a specific example of authentication level setting by the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 16. Fig. 16 is a table showing an example of authentication level setting in the information processing system according to the ninth embodiment.

[0115] 16, the authentication level may be set not only depending on whether the destination seat is the driver's seat or not, but also depending on the seat types of the source and destination seats. For example, the authentication level may be set according to the importance set for each seat type (e.g., driver's seat > passenger seat > rear seat). In this case, the authentication level may be set higher as the importance of the source seat type becomes lower and the importance of the destination seat type becomes higher.

[0116] Specifically, if the subject moves from the rear seat to the driver's seat, the authentication level may be set to "6". If the subject moves from the passenger seat to the driver's seat, the authentication level may be set to "5". If the subject moves from the rear seat to the passenger seat, the authentication level may be set to "4". If the subject moves from the driver's seat to the passenger seat, the authentication level may be set to "3". If the subject moves from the passenger seat to the rear seat, the authentication level may be set to "2". If the subject moves from the driver's seat to the rear seat, the authentication level may be set to "1".

[0117] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the ninth embodiment will be described.

[0118] As described with reference to Figures 14 to 16, in the information processing system 10 according to the ninth embodiment, the authentication level is controlled based on the seat movement of the target. In this way, the authentication level can be controlled taking into consideration the importance of the seat in the moving body. In particular, the driver's seat of the moving body is the seat in which the driver sits, and therefore has a higher importance than other seats that are not involved in driving. Therefore, by increasing the authentication level of the target that moves to the driver's seat, it is possible to perform more appropriate authentication processing.

[0119] Tenth Embodiment An information processing system 10 according to a tenth embodiment will be described with reference to Figures 17 and 18. The tenth embodiment differs from the ninth embodiment described above only in part of its configuration and operation, and other parts may be the same as the first to ninth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0120] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the functional configuration of the information processing system according to the tenth embodiment. Note that in Fig. 17, the same elements as those shown in Fig. 14 are denoted by the same reference numerals.

[0121] 17, the information processing system 10 according to the eighth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, a control unit 130 having a seat determination unit 133, and a seat setting change unit 170. That is, the information processing system 10 according to the tenth embodiment further includes the seat setting change unit 170 in addition to the configuration of the ninth embodiment (see FIG. 14). Note that the seat setting change unit 170 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0122] The seat setting change unit 170 is configured to be able to change various seat settings. For example, the seat setting change unit 170 is configured to automatically change settings that can be adjusted for each seat, such as the seat angle (recline), the strength of the seat heater, and the direction and strength of the air conditioner, for each seat.

[0123] (Operation Flow) Next, the operation flow of the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the operation flow of the information processing system according to the tenth embodiment. Note that in Fig. 18, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0124] 18 , when the operation of the information processing system 10 according to the tenth embodiment is started, the image acquisition unit 110 first acquires an image of an object moving from inside the moving body to outside the moving body (step S101). Then, the tracking unit 120 uses the object image acquired by the image acquisition unit 110 to track the object that has moved outside the moving body (step S102).

[0125] Next, the seat movement determination unit 133 determines whether or not the target seat has moved based on the tracking result by the tracking unit 120 (step S901). Note that if the target seat has not moved (step S901: NO), the subsequent processing may be omitted.

[0126] On the other hand, if the target's seat has been moved (step S901: YES), the seat setting change unit 170 reads the seat setting of the target's original seat (step S1001). Then, the seat setting change unit 170 reflects the original seat setting in the target's destination seat (step S1002). For example, if the target moves from the driver's seat to the passenger seat, the seat setting change unit 170 reflects the driver's seat setting in the passenger seat.

[0127] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the tenth embodiment will be described.

[0128] As described in FIGS. 17 and 18 , in the information processing system 10 according to the tenth embodiment, when a seat of a target is moved, the seat setting of the source of the move is reflected in the seat of the destination of the move. Preferences for seat settings vary depending on the target. It is considered that the seat setting of the source of the move has already been adjusted to the target's preferred state. Therefore, by reflecting the seat setting of the source of the move in the seat of the destination, the seat setting of the destination can be automatically changed to the target's preferred state. This makes it possible to improve the convenience of the target.

[0129] Eleventh Embodiment An information processing device according to an eleventh embodiment will be described with reference to Fig. 19. Note that the information processing device according to the eleventh embodiment is configured by configuring the information processing systems 10 described in the first to tenth embodiments as a single device, and its configuration and operation may be similar to those of the information processing system 10 described above. For this reason, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0130] (Functional Configuration) First, the functional configuration of the information processing device according to the eleventh embodiment will be described with reference to Fig. 19. Fig. 19 is a block diagram showing the functional configuration of the information processing device according to the eleventh embodiment. Note that in Fig. 19, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0131] 19, the information processing device 500 according to the eleventh embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a tracking unit 120, and a control unit 130. That is, the information processing device 500 according to the eleventh embodiment includes the same components as the information processing system 10 according to the first embodiment (see FIG. 2).

[0132] The information processing device 500 according to the eleventh embodiment is configured as a device mounted on a vehicle 50. The information processing device 500 may be configured, for example, by an ECU (Electronic Control Unit) provided in the vehicle 50. The image acquisition unit 110 may be configured to acquire target images from, for example, an in-vehicle camera. The tracking unit 120 may be configured to track passengers of the vehicle 50. The control unit 130 may be configured to be able to control the authentication level of the authentication process performed on a target moving from outside the vehicle to inside the vehicle.

[0133] (Technical Effects) Next, technical effects obtained by the information processing device 500 according to the eleventh embodiment will be described.

[0134] In the information processing device 500 according to the eleventh embodiment, a target moving from the inside to the outside of the vehicle 50 is tracked, and based on the tracking result, the authentication level of the authentication process in the vehicle 50 is changed. In this way, it becomes possible to perform appropriate biometric authentication on a target that has been away from the vehicle 50 for a relatively short time, without unnecessarily increasing the burden on the target.

[0135] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0136] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0137] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0138] (Supplementary Note 1) The information processing system described in Supplementary Note 1 is an information processing system that includes an image acquisition means that acquires an image of an object moving from inside a specified area to outside the specified area, a tracking means that tracks the object included in the image, and a control means that controls an authentication level of an authentication process that is performed on an object moving from outside the specified area to inside the specified area based on the tracking result.

[0139] (Supplementary Note 2) The information processing system according to Supplementary Note 2 is the information processing system according to Supplementary Note 1, in which the authentication process is biometric authentication using biometric information of the target.

[0140] (Supplementary Note 3) The information processing system according to Supplementary Note 3 is the information processing system according to Supplementary Note 1 or 2, in which the inside of the predetermined area is the inside of a moving body, and the outside of the predetermined area is the outside of the moving body.

[0141] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in Appendix 3, in which the control means calculates a tracking score indicating the reliability of the tracking based on the tracking result, and determines whether or not the authentication process is necessary when moving from outside the mobile body to inside the mobile body depending on the tracking score.

[0142] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in Appendix 4, wherein the authentication process is face authentication and liveness determination of the target, and the control means controls the authentication level of the authentication process to allow a first target approaching the moving body with the tracking score exceeding a first threshold to move into the moving body without performing the face authentication and the liveness determination.

[0143] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in Appendix 5, wherein the control means controls the authentication level of the authentication process to allow a second target approaching the moving body when the tracking score is below a second threshold that is lower than the first threshold, to move inside the moving body if both the face authentication and the liveness determination are successful.

[0144] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in Appendix 6, wherein the control means controls the authentication level of the authentication process to allow a third object approaching the moving body when the tracking score is below the first threshold and exceeds the second threshold, to move inside the moving body if at least one of the face authentication and the liveness determination is successful.

[0145] (Appendix 8) The information processing system described in Appendix 8 is the information processing system described in any one of Appendices 4 to 7, wherein the tracking means tracks multiple targets that move from inside the moving body to outside the moving body, and the control means makes the decrease in the tracking score caused by the multiple targets passing each other smaller than the decrease in the tracking score caused by the multiple targets passing each other and a third party different from the multiple targets.

[0146] (Appendix 9) The information processing system described in Appendix 9 is the information processing system described in any one of Appendices 3 to 8, further comprising: a door control means for controlling opening and closing of a door of the mobile body depending on the result of the authentication process; and a luggage determination means for detecting or predicting that an object approaching the mobile body is carrying luggage, wherein the door control means automatically opens the door of the mobile body used by the object to store luggage when the authentication process is successful and it is detected or predicted that the object is carrying luggage.

[0147] (Supplementary Note 10) The information processing system described in Supplementary Note 10 is the information processing system described in any one of Supplements 3 to 9, further comprising a measuring means for measuring the elapsed time since the target has left the moving body, and the control means controls the authentication level of the authentication process based on the tracking result and the elapsed time.

[0148] (Appendix 11) The information processing system described in Appendix 11 is the information processing system described in any one of Appendices 3 to 10, wherein the control means determines seat movement in the target moving body based on the tracking result, and controls the authentication level of the authentication process so that the authentication process of a target moving to the driver's seat of the moving body is less likely to succeed than the authentication process of a target moving to a seat other than the driver's seat.

[0149] (Appendix 12) The information processing device described in Appendix 12 is an information processing device that includes an image acquisition means that acquires an image of an object moving from inside a specified area to outside the specified area, a tracking means that tracks the object included in the image, and a control means that controls an authentication level of an authentication process that is performed on an object moving from outside the specified area to inside the specified area based on a result of the tracking.

[0150] (Appendix 13) The information processing method described in Appendix 13 is an information processing method that, by at least one computer, acquires an image of an object moving from inside a predetermined area to outside the predetermined area, tracks the object included in the image, and controls an authentication level of an authentication process that is performed on an object moving from outside the predetermined area to inside the predetermined area based on the tracking result.

[0151] (Appendix 14) The recording medium described in Appendix 14 is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring an image of an object moving from inside a predetermined area to outside the predetermined area, tracking the object included in the image, and controlling, based on the tracking result, an authentication level of an authentication process that is executed on an object moving from outside the predetermined area to inside the predetermined area.

[0152] (Supplementary Note 15) The computer program described in Supplementary Note 15 is a computer program that causes at least one computer to execute an information processing method, which acquires an image of an object moving from inside a predetermined area to outside the predetermined area, tracks the object included in the image, and controls an authentication level of an authentication process that is executed on the object moving from outside the predetermined area to inside the predetermined area based on the tracking result.

[0153] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0154] REFERENCE SIGNS LIST 10 Information processing system 11 Processor 50 Vehicle 110 Image acquisition unit 120 Tracking unit 130 Control unit 131 Tracking score calculation unit 132 Authentication necessity determination unit 133 Seat movement determination unit 140 Baggage determination unit 150 Door control unit 160 Time measurement unit 170 Seat setting change unit 500 Information processing device

Claims

1. Image acquisition means for acquiring an image of an object moving from the inside of a predetermined area to the outside of the predetermined area; Tracking means for tracking the object included in the image; Control means for controlling the authentication level of authentication processing to be executed for an object moving from the outside of the predetermined area to the inside of the predetermined area based on the result of the tracking; An information processing system comprising:

2. The authentication processing is biometric authentication using biometric information of the object. The information processing system according to claim 1.

3. The inside of the predetermined area is the inside of a moving body, and the outside of the predetermined area is the outside of the moving body. The information processing system according to claim 1 or 2.

4. The control means: Calculates a tracking score indicating the reliability of the tracking based on the result of the tracking; Determines the necessity of the authentication processing when moving from the outside of the moving body to the inside of the moving body according to the tracking score. The information processing system according to claim 3.

5. The authentication processing is face authentication and liveness determination of the object. For a first object approaching the moving body in a state where the tracking score exceeds a first threshold, the control means controls the authentication level of the authentication processing to permit movement into the moving body without performing the face authentication and the liveness determination. The information processing system according to claim 4.

6. For a second object approaching the moving body in a state where the tracking score is lower than a second threshold lower than the first threshold, the control means controls the authentication level of the authentication processing to permit movement into the moving body when both the face authentication and the liveness determination are successful. The information processing system according to claim 5.

7. For a third object approaching the moving body in a state where the tracking score is lower than the first threshold and exceeds the second threshold, the control means controls the authentication level of the authentication processing to permit movement into the moving body when at least one of the face authentication and the liveness determination is successful. The information processing system according to claim 6.

8. The tracking means performs tracking of a plurality of objects that have moved from the inside of the moving body to the outside of the moving body. The control means makes the decrease width of the tracking score caused by the plurality of targets passing by each other smaller than the decrease width of the tracking score caused by a third party different from the plurality of targets passing by the plurality of targets. The information processing system according to claim 4.

9. By at least one computer, An image of a target moving from the inside of a predetermined area to the outside of the predetermined area is acquired, Tracking of the target included in the image is performed, Based on the result of the tracking, the authentication level of the authentication process to be executed for the target moving from the outside of the predetermined area to the inside of the predetermined area is controlled. Information processing method.

10. At least one computer is caused to Acquire an image of a target moving from the inside of a predetermined area to the outside of the predetermined area, Perform tracking of the target included in the image, Based on the result of the tracking, the authentication level of the authentication process to be executed for the target moving from the outside of the predetermined area to the inside of the predetermined area is controlled. A computer program for executing an information processing method.