Personal identification system

CN114694207BActive Publication Date: 2026-08-28SUBARU CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202111312869.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-12-28
Filing Date
2021-11-08
Publication Date
2026-08-28
Estimated Expiration
2041-11-08

AI Technical Summary

Benefits of technology

[0021] According to one or more embodiments of the present invention, when registering personal information, a facial image in which the driver's facial orientation and gaze direction are uniquely fixed can be obtained, which has the effect of identifying the driver with high accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114694207B_ABST
    Figure CN114694207B_ABST
Patent Text Reader

Abstract

The present application provides a personal identification system capable of acquiring a face image in which a driver's face orientation and line of sight direction are uniquely fixed. The personal identification system includes an imaging section, a personal identification section, a display image control section, a first display section, and a second display section. The imaging section is disposed at an outer edge of the first display section and captures a face image of the driver. The display image control section controls a display screen on which the first display section and the second display section are displayed. The personal identification section performs personal registration and personal identification of the driver using a first face image captured when the driver visually recognizes the first display section and a second face image captured when the driver visually recognizes the second display section. When the personal registration is performed by the personal identification section, the display image control section displays an image obtained by controlling a face orientation of a virtual image based on face orientation data extracted from the second face image on the second display section.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to personal identification systems. Background Technology

[0002] There are known driver monitoring systems that monitor the driver's condition in order to assist in the safe driving of vehicles.

[0003] In such a driver monitoring system, the system needs to identify the individual driving the vehicle, therefore, the personal information used to identify the individual needs to be registered in the system.

[0004] Here, facial images are typically used as information for identifying individuals, and techniques for extracting facial information, gaze information, etc., from images captured by a camera are disclosed (for example, see Patent Document 1).

[0005] Furthermore, in the driver monitoring system, personal information used for identification includes, for example, facial images captured by cameras located inside the vehicle and facial feature data extracted from those images. The driver monitoring system can identify the individual currently sitting in the driver's seat by comparing the feature data extracted from the facial image of the driver with the already registered feature data.

[0006] Existing technical documents

[0007] Patent documents

[0008] Patent Document 1: Japanese Patent Application Publication No. 2019-75162 Summary of the Invention

[0009] Technical issues

[0010] However, since the orientation and gaze direction of the driver's face in the facial image obtained when registering personal information are not uniquely fixed, for example, based on the orientation of the face, there is a problem that facial features cannot be extracted with high precision, thus making it impossible to correctly identify an individual.

[0011] Therefore, the present invention was made in view of the above-mentioned problems, and its object is to provide a personal identification system that can obtain a facial image in which the driver's facial orientation and gaze direction are uniquely fixed when registering personal information.

[0012] Technical solution

[0013] Method 1; One or more embodiments of the present invention provide a personal identification system, characterized by comprising: a first display unit disposed in the center of the vehicle width direction in front of the driver's seat; a second display unit disposed in front of the driver's seat; a camera unit disposed on the outer edge of the first display unit; a display image control unit that controls the display images displayed by the first display unit and the second display unit; and a personal identification unit that performs personal registration and personal identification of the driver using at least a first facial image and a second facial image, wherein the first facial image is a facial image of the driver captured by the camera unit when the driver in the driver's seat visually recognizes the first display unit, and the second facial image is a facial image of the driver captured by the camera unit when the driver visually recognizes the second display unit.

[0014] Method 2; One or more embodiments of the present invention provide a personal identification system, characterized in that a camera unit, an image display control unit, a personal identification unit, and the aforementioned first display unit are disposed in a driving state monitoring device for monitoring the aforementioned driver.

[0015] Method 3; One or more embodiments of the present invention provide a personal identification system, characterized in that, when the driver registers the person, after the personal identification unit acquires the first facial image, the display image control unit displays an image on the second display unit, and the personal identification unit acquires the second facial image.

[0016] Method 4; One or more embodiments of the present invention provide a personal identification system, characterized in that the above-mentioned display image control unit displays an image obtained by controlling the facial orientation of a virtual image associated with the driver based on facial orientation data extracted from the above-mentioned second facial image on the above-mentioned second display unit.

[0017] Method 5; One or more embodiments of the present invention provide a personal identification system, characterized in that the above-mentioned display image control unit displays an image obtained by converting the second facial image based on facial orientation data extracted from the second facial image on the second display unit.

[0018] Method 6; One or more embodiments of the present invention provide a personal identification system, characterized in that the above-mentioned display image control unit displays an image indicating the progress of the above-mentioned personal registration on the above-mentioned second display unit.

[0019] Method 7; One or more embodiments of the present invention provide a personal identification system, characterized in that the second display unit is composed of a head-up display.

[0020] Invention Effects

[0021] According to one or more embodiments of the present invention, when registering personal information, a facial image in which the driver's facial orientation and gaze direction are uniquely fixed can be obtained, which has the effect of identifying the driver with high accuracy. Attached Figure Description

[0022] Figure 1 This is a diagram illustrating the configuration of a personal identification system 1 according to a first embodiment of the present invention.

[0023] Figure 2 This diagram illustrates the configuration of the camera unit, the first display unit, and the second display unit in the personal identification system 1 according to the first embodiment of the present invention.

[0024] Figure 3 This is a diagram illustrating the process of personal registration in the personal identification system 1 according to the first embodiment of the present invention.

[0025] Figure 4 This is a diagram illustrating the flow of image output processing from the personal identification system 1 according to the first embodiment of the present invention to the second display unit.

[0026] Figure 5 This diagram illustrates the transfer of images displayed on the first and second display units during personal registration in the personal identification system 1 according to the first embodiment of the present invention.

[0027] Figure 6 This is a diagram illustrating the process of personal registration in a personal identification system 1A according to a second embodiment of the present invention.

[0028] Figure 7 This is a diagram illustrating the process of outputting an image to a second display unit in a personal identification system 1A according to a second embodiment of the present invention.

[0029] Figure 8 This is a diagram illustrating an image displayed on a second display unit in a personal identification system, which is a modified example of the present invention.

[0030] Symbol Explanation

[0031] 1: Personal Identification System

[0032] 1A: Personal Identification System

[0033] 10: Camera Department

[0034] 20: First Display Section

[0035] 30: Personal Identification Department

[0036] 40: Display Image Control Unit

[0037] 100: Driving Status Monitoring Device

[0038] 200: Second Display Unit Detailed Implementation

[0039] The following uses Figures 1 to 8 The embodiments of the present invention will be described.

[0040] <First Implementation Method>

[0041] use Figures 1 to 5 The personal identification system 1 of this embodiment will be described.

[0042] <The Composition of Personal Identification System 1>

[0043] like Figure 1 As shown, the personal identification system 1 of this embodiment is configured to include a driving status monitoring device 100 and a second display unit 200.

[0044] like Figure 2 As shown, the driving state monitoring device 100 is a device that acquires a facial image of the driver of a vehicle through the camera unit 10 described later, extracts feature points from the acquired facial image, and monitors the driver's driving state based on the state of the extracted feature points (face orientation, eye opening, etc.).

[0045] It should be noted that the detailed composition will be described in detail separately.

[0046] like Figure 2 As shown, the second display unit 200 is a display unit provided in front of the driver's seat, such as a head-up display (HUD), which can display basic information images facing the driver through the windshield.

[0047] It should be noted that, although in Figure 2 An example of a HUD that projects onto the windshield is shown, but it could also be a HUD that projects onto a combination unit located on the dashboard.

[0048] It should be noted that in this embodiment, it is not limited to HUD, but also includes a display unit that presents an image in front of the driver's seat.

[0049] <Composition of the Driving Status Monitoring Device 100>

[0050] like Figure 1 As shown, the driving status monitoring device 100 is composed of a camera unit 10, a first display unit 20, a personal identification unit 30, and a display image control unit 40.

[0051] like Figure 2As shown, the camera unit 10 is disposed on the outer edge of the first display unit 20, which will be described later, and acquires images (including moving images and still images) of the driver in the driver's seat, including at least the face.

[0052] The camera unit 10 is, for example, a camera that has built-in imaging elements such as CCD (Charge Coupled Device) or CIS (CMOS Image Sensor).

[0053] Furthermore, the camera unit 10 is, for example, a near-infrared camera or an RGB camera, which captures the driver's face by receiving reflected light from the near-infrared light being illuminated. The camera unit 10 sends the captured image signal to the personal identification unit 30 and the display image control unit 40, which will be described later.

[0054] like Figure 2 As shown, the first display unit 20 is a display screen located in the center of the vehicle width direction in front of the driver's seat, which displays information related to personal registration, for example, to the driver.

[0055] It should be noted that the first display unit 20 can also serve as a display unit for a navigation system mounted on a vehicle.

[0056] The personal identification unit 30 extracts facial features from the image captured by the camera unit 10 and identifies the driver based on these features.

[0057] In addition, when registering personal information, the personal identification unit 30 saves the facial image of the driver captured by the camera unit 10 to a memory (not shown) to identify the individual.

[0058] Here, the personal identification unit 30 is, for example, a part of the functions of a GPU (Graphics Processing Unit) that has known RAM, ROM, and I / O bus (not shown), and performs control according to the control program stored in ROM.

[0059] The image control unit 40 generates images that are displayed on the first display unit 20 and the second display unit 200.

[0060] Here, it is shown that the image control unit 40 is part of the functions of a GPU (Graphics Processing Unit), which includes, for example, known RAM, ROM, and I / O bus (not shown), and performs control according to the control program stored in ROM.

[0061] <Processing of Personal Identification System 1>

[0062] use Figure 3 and Figure 5The processing of the personal identification system 1 in this embodiment will be explained.

[0063] It should be noted that the following uses Figure 3 The process performed when registering personal information in Personal Identification System 1 is explained.

[0064] In addition, Figure 5 The execution is shown in the middle. Figure 3 The processing flow shown is an example of a display of a screen shown on the first display unit 20 and the second display unit 200.

[0065] The display image control unit 40 displays a registration screen for registering personal information on the first display unit 20 (step S110).

[0066] Then, it is determined whether the registration start operation present on the screen for registering personal information has been executed (step S120). If the registration start operation has not been executed ("No" in step S120), the process returns to step S120 and waits. Then, if the registration start operation has been executed ("Yes" in step S120), the process proceeds to step S130.

[0067] The personal recognition unit 30 acquires a facial image (first facial image) of the driver from the camera unit 10 (step S130). Here, the image acquired by the camera unit 10 is a facial image (first facial image) of the driver visually recognizing the first display unit 20.

[0068] Therefore, prompts can be made to look at the display on the first display unit 20.

[0069] Furthermore, if the input for starting registration is performed by operating the touch panel provided on the first display unit 20, the buttons located around the first display unit 20, etc., the driver's face can be turned toward the first display unit 20.

[0070] Then, the personal identification unit 30 confirms whether the driver's facial image (first facial image) obtained in step S130 was correctly acquired (step S140).

[0071] Since facial features required for the personal identification unit 30 to identify the driver are extracted from the facial image (first facial image) acquired here, it is necessary to confirm whether the facial orientation of the acquired facial image is within a predetermined range.

[0072] Specifically, the personal identification unit 30 extracts the orientation of the face (Yaw, Pitch, Roll) from the acquired facial image of the driver (first facial image) to determine whether the orientation of the face is within a predetermined range.

[0073] If the driver's facial image (first facial image) is not facing within the predetermined range (No in step S140), the process returns to step S130, and the driver's facial image (first facial image) is acquired again.

[0074] On the other hand, if the facial orientation of the driver's facial image (first facial image) is within a predetermined range ("Yes" in step S140), the process proceeds to step S150.

[0075] Here, an example is shown of a process that confirms once that the orientation of the face falls within a predetermined range, but it is also possible to confirm multiple times that the orientation of the face falls within the predetermined range. In this case, the personal identification unit 30 can acquire multiple facial images of faces with orientations within the predetermined range and determine the driver's feature values ​​based on the acquired multiple facial images.

[0076] Next, the display image control unit 40 displays an instruction on the first display unit 20 to view the second display unit 200, and displays an image on the second display unit 200 to obtain a facial image of the driver (second facial image) (step S150).

[0077] It should be noted that the details of the process in step S150 will be described later.

[0078] Then, the personal identification unit 30 confirms whether the driver's facial image (second facial image) obtained in step S150 was correctly acquired (step S160).

[0079] The personal identification unit 30 confirms whether the facial orientation of the driver's facial image (second facial image) acquired in step S150 is within a predetermined range.

[0080] If the driver's facial image (second facial image) is not facing within the predetermined range (No in step S160), the process returns to step S150, and the driver's facial image (second facial image) is acquired again.

[0081] On the other hand, if the facial orientation of the driver's facial image (second facial image) is within a predetermined range ("Yes" in step S160), the process proceeds to step S170.

[0082] Here, the processing in step S160 can be modified in the same way as the processing exemplified in step S140 to perform multiple checks on the facial orientation entering a predetermined range. In this case, the personal identification unit 30 can acquire multiple facial images (second facial images) where the facial orientation is within the predetermined range, and determine the driver's feature quantity based on the acquired multiple facial images (second facial images).

[0083] Then, the personal identification unit 30 stores the driver's facial image (first facial image) acquired in step S130 and the driver's facial image (second facial image) acquired in step S150 in a memory not shown (step S170).

[0084] Here, facial image data is associated with information such as the driver's name, gender, and age, and stored in memory as personal information.

[0085] Then, the display image control unit 40 displays the status of completed personal information registration on the first display unit 20 and the second display unit 200 (step S180), and ends the process.

[0086] <Image processing performed on the second display unit 200 (step S150)>

[0087] use Figure 4 For Figure 3 The processing performed in step S150 related to the generation of the image to be displayed on the second display unit 200 and the acquisition of the second facial image will be described.

[0088] The image control unit 40 displays an instruction on the first display unit 20 to view the second display unit 200, and then the personal identification unit 30 acquires the driver's facial image (second facial image) from the camera unit 10 (step S151).

[0089] Then, the personal recognition unit 30 calculates the driver's facial orientation (yaw, pitch, roll) based on the acquired facial image (second facial image) and transmits the calculation result to the display image control unit 40 (step S152).

[0090] Then, based on the transmitted information about the driver's facial orientation, the display image control unit 40 reads a 3D virtual image stored in a memory (not shown) and rotates the 3D virtual image. Figure 5 The virtual image shown is displayed on the second display unit 200 (step S153), and the process returns to... Figure 3 Step S160.

[0091] Here, the driver's facial image acquired in step S151 is a facial image taken from an oblique angle. Therefore, the display image control unit 40 rotates the 3D virtual image based on the direction of the face calculated from the image and the setting direction of the second display unit 200.

[0092] In other words, when the driver faces the second display unit 200, the display image control unit 40 performs a process to rotate the virtual image so that the 3D virtual image facing forward is displayed on the second display unit 200.

[0093] Furthermore, the 3D virtual avatar image is continuously displayed on the second display unit 200 until the second facial image can be correctly acquired. That is, the second display unit 200 continuously displays a 3D virtual avatar image that matches the driver's facial orientation.

[0094] <Functions and Effects>

[0095] As described above, the personal identification system 1 of this embodiment includes a camera unit 10, a personal identification unit 30, a display image control unit 40, a first display unit 20 disposed in the center of the vehicle width direction in front of the driver's seat, and a second display unit 200 disposed in front of the driver's seat. The camera unit 10 is disposed on the outer edge of the first display unit 20 and captures an image of the driver's face. The display image control unit 40 controls the display screen displayed on the first display unit 20 and the second display unit 200. The personal identification unit 30 uses at least the first facial image and the second facial image to perform personal registration and personal identification of the driver. The first facial image is captured by the camera unit 10 when the driver visually recognizes the first display unit 20, and the second facial image is captured by the camera unit 10 when the driver visually recognizes the second display unit 200.

[0096] That is, when acquiring the first facial image, since the image generated by the display image control unit 40 is displayed on the first display unit 20, the driver's facial orientation and gaze can be uniquely fixed in the direction of the first display unit 20. Similarly, when acquiring the second facial image, since the image generated by the display image control unit 40 is displayed on the second display unit 200, the driver's facial orientation and gaze can be uniquely fixed in the direction of the second display unit 200.

[0097] Therefore, it is possible to extract the facial features of the driver with high precision from the first and second facial images, thereby improving the accuracy of personal identification.

[0098] Furthermore, the second facial image can also be used as a registration image during the simulated driving process of a driver.

[0099] In addition, when the personal identification system 1 of this embodiment performs personal registration in the personal identification unit 30, it displays an image obtained by controlling the facial orientation of the virtual image based on facial orientation data extracted from the second facial image on the second display unit 200.

[0100] That is, when acquiring the second facial image, because the second display unit 200 displays a virtual image that moves in accordance with the orientation of the driver's face, the driver looks more intently at the second display unit 200, thereby enabling the driver's facial orientation and gaze to be uniquely fixed.

[0101] Therefore, it is possible to extract the driver's facial features with high precision from the second facial image, thereby improving the accuracy of personal identification.

[0102] Furthermore, the virtual avatar image displayed on the second display unit can be generated by simply rotating the virtual avatar image pre-stored in the memory, thus achieving this without increasing the processing load of the personal identification system 1.

[0103] Therefore, the display image control unit 40 does not require a high-performance GPU, large-capacity memory, etc., and can be configured into a personal identification system 1 at low cost.

[0104] In addition, when the driver registers his / her personal information, the personal identification system 1 of this embodiment displays an image on the second display unit 200 after the personal identification unit 30 acquires the first facial image, and the personal identification unit 30 acquires the second facial image.

[0105] That is, before the acquisition of the first facial image obtained when the driver visually recognizes the first display unit 20 is completed, the display image control unit 40 does not display anything on the second display unit 200. Therefore, the display unit that the driver should look at becomes clear, thereby enabling the driver's facial orientation and line of sight to be uniquely fixed.

[0106] Therefore, it is possible to extract the facial features of the driver with high precision from the first and second facial images, thereby improving the accuracy of personal identification.

[0107] Furthermore, during personal registration, the image display control unit 40 displays an image on the second display unit 200, thus guiding the driver's facial orientation and gaze. This allows for the quick and efficient processing of the driver's facial image during registration.

[0108] Furthermore, the second display unit 200 of the personal identification system 1 according to this embodiment is composed of a head-up display.

[0109] In other words, the position of the eyes that can visually recognize images is much narrower than that of an LCD screen, so when using a head-up display, the driver's face orientation and line of sight can be further restricted.

[0110] Therefore, it is possible to extract facial features of the driver from the second facial image with high accuracy, thereby improving the accuracy of personal identification.

[0111] In addition, the camera unit 10, personal identification unit 30, display image control unit 40 and first display unit 20 of the personal identification system 1 of this embodiment are provided in a driving state monitoring device 100 for monitoring the driving state of the driver.

[0112] That is, when the vehicle is equipped with a driving status monitoring device 100 that monitors the driver's driving status, the camera unit 10, the personal identification unit 30, the display image control unit 40 and the first display unit 20 can be used to form a personal identification system.

[0113] Therefore, by simply adding a second display unit 200, a personal identification system 1 can be constructed, thereby achieving cost reduction.

[0114] <Second Implementation Method>

[0115] use Figure 6 and Figure 7 The personal identification system 1A of this embodiment will be described.

[0116] This embodiment is an example of changing the image generation process displayed on the second display unit 200 for the personal identification system 1 described above.

[0117] <Processing of Personal Identification System 1A>

[0118] like Figure 6 As shown, the processing of Personal Identification System 1A will... Figure 3 The processing flow of the Personal Identification System 1 shown is changed from step S150 to step S300.

[0119] Therefore, only step S300 will be described below.

[0120] <Image processing performed on the second display unit 200 (step S300)>

[0121] use Figure 7 The processing related to image generation and second facial image acquisition for display on the second display unit 200 of the personal identification system 1A will be described.

[0122] The display image control unit 40 displays a message on the first display unit 20 such as "viewing the second display unit 200", and then the personal identification unit 30 acquires the driver's facial image (second facial image) from the camera unit 10 (step S301).

[0123] The personal recognition unit 30 calculates the driver's facial orientation (yaw, pitch, roll) based on the acquired facial image and transmits the facial orientation information to the display image control unit 40 (step S302).

[0124] The display image control unit 40 converts the second facial image into a 3D image based on the transmitted facial orientation information (step S303).

[0125] Then, the image display control unit 40 displays the second facial image obtained by 3D conversion on the second display unit 200 (step S304).

[0126] The driver's facial image (second facial image) acquired in step S301 is an image taken from an oblique angle. Therefore, the display image control unit 40 performs viewpoint conversion on the second facial image through perspective projection conversion to generate a frontal facial image of the driver.

[0127] Then, until the second facial image can be correctly acquired, the driver's frontal facial image is continuously displayed in the second display unit 200.

[0128] <Functions and Effects>

[0129] When registering a person, the personal identification system 1A of this embodiment displays an image obtained by converting the second facial image based on facial orientation data extracted from the second facial image on the second display unit 200.

[0130] That is, when acquiring the second facial image, the driver's frontal facial image obtained by perspective projection transformation of the second facial image is displayed on the second display unit 200, so the driver looks more at the second display unit 200, thereby uniquely fixing the driver's facial orientation and line of sight.

[0131] Therefore, it is possible to extract the driver's facial features with high precision from the second facial image, thereby improving the accuracy of personal identification.

[0132] <Variation Example>

[0133] In the personal identification system 1, 1A, when registering a person, the image display control unit 40 can display an image indicating the progress of the personal registration on the second display unit 200.

[0134] That is, when acquiring the second facial image, by displaying values, progress bars, etc. indicating the progress of the personal registration process on the second display unit 200, the driver can grasp how long he still needs to observe the second display unit 200, and thus can uniquely fix the driver's facial orientation and gaze for a certain period of time.

[0135] Therefore, it is possible to extract the driver's facial features with high precision from the second facial image, thereby improving the accuracy of personal identification.

[0136] In addition, such as Figure 8 As shown, numerical values ​​and progress bars indicating the progress of the personal registration process can be displayed simultaneously with the aforementioned virtual avatar images.

[0137] It should be noted that by recording the processing of the personal identification unit 30 and the display image control unit 40 on a computer-readable recording medium, and by having the personal identification unit 30 and the display image control unit 40 read and execute the program recorded on the recording medium, the personal identification system 1, 1A of the present invention can be realized. The computer system referred to herein includes hardware such as an OS and / or peripheral devices.

[0138] Furthermore, in the case of using a WWW (World Wide Web) system, "computer system" also includes the homepage providing environment (or display environment). Additionally, the aforementioned program can be transmitted from a computer system storing the program in a storage device, etc., via a transmission medium or through transmission waves in the transmission medium to other computer systems. Here, "transmission medium" for transmitting the program refers to a medium with the function of transmitting information, such as a network (communication network) like the Internet, or a communication line (communication line) like a telephone line.

[0139] Alternatively, the program described above can be a part of a program used to implement the aforementioned functions. Furthermore, it can be a so-called difference file (difference program) capable of implementing the aforementioned functions through combination with programs already recorded in the computer system.

[0140] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the specific configuration is not limited to these embodiments and may include designs that do not depart from the spirit of the present invention.

Claims

1. A personal identification system, characterized in that, have: The first display unit is located in the center of the vehicle width direction in front of the driver's seat; A second display unit is located in front of the driver's seat; The camera unit is located at the outer edge of the first display unit; The display image control unit controls the display images displayed by the first display unit and the second display unit. as well as The personal identification unit utilizes at least a first facial image and a second facial image for driver registration and identification. The first facial image is a photograph of the driver's face taken by the camera unit when the driver in the driver's seat visually identifies the first display unit by looking at it in accordance with the instructions displayed on the first display unit. The second facial image is a photograph of the driver's face taken by the camera unit when the driver visually identifies the second display unit by looking at it in accordance with the instructions displayed on the first display unit. Before the acquisition of the first facial image is completed, the display image control unit does not display anything on the second display unit.

2. The personal identification system according to claim 1, characterized in that, A driving state monitoring device comprising a camera unit, a display image control unit, a personal identification unit, and a first display unit is configured to monitor the driving state of the driver.

3. The personal identification system according to claim 2, characterized in that, When the driver registers his / her personal information, after the personal identification unit acquires the first facial image, the display image control unit displays the image on the second display unit, and the personal identification unit acquires the second facial image.

4. The personal identification system according to claim 3, characterized in that, The image display control unit displays an image on the second display unit obtained by controlling the facial orientation of the virtual avatar associated with the driver based on facial orientation data extracted from the second facial image.

5. The personal identification system according to claim 3, characterized in that, The image display control unit displays an image obtained by converting the second facial image based on facial orientation data extracted from the second facial image on the second display unit.

6. The personal identification system according to claim 3, characterized in that, The image display control unit displays an image indicating the progress of the individual's registration on the second display unit.

7. The personal identification system according to claim 4, characterized in that, The image display control unit displays an image indicating the progress of the individual's registration on the second display unit.

8. The personal identification system according to claim 5, characterized in that, The image display control unit displays an image indicating the progress of the individual's registration on the second display unit.

9. The personal identification system according to any one of claims 1 to 8, characterized in that, The second display unit is composed of a head-up display.

10. The personal identification system according to claim 1, characterized in that, The first facial image includes a facial image of the driver captured by the camera unit when the driver performs input to start registration by operating a touch panel provided on the first display unit.

11. The personal identification system according to claim 1 or 10, characterized in that, The first facial image includes a facial image of the driver captured by the camera unit when the driver performs input to begin registration by operating a button located around the periphery of the first display unit.

Citation Information

Patent Citations

  • Image processing apparatus

    JP2019075162A

  • Image processing device, image processing method, and program

    CN103248810A

  • Facial recognition device and use method

    CN106228148A

  • Method for image-based driver identification in a motor vehicle

    US20070183635A1

  • Eye Tracking

    US20200319705A1