Apparatus, method, and computer-readable medium for controlling vehicle doors

Abstract

Enabling precise control of a door to be controlled by a user based on a line of sight of the user. A line-of-sight detection means (11) detects the user's line of sight based on an image obtained by detecting the user. A determination means (12) determines, based on the detected line of sight of the user, whether or not the user has viewed an area corresponding to a specific door for a predetermined time or longer. An authentication means (13) authenticates the user based on the image obtained by detecting the user. A door control means (14) unlocks the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully completed the authentication.

Description

Technical area

[0001] The present disclosure relates to a vehicle door control device, a method, and a computer-readable medium. Technical background

[0002] Patent Literature 1 describes a smart entry system. In the smart entry system described in Patent Literature 1, a user carries an electronic key and approaches a vehicle. An in-vehicle electronic key authentication device wirelessly communicates with the electronic key carried by the user to authenticate the electronic key. Furthermore, a camera in the vehicle captures an image of the user carrying the electronic key. In the vehicle, the user directs their line of sight toward an area corresponding to a door to be selected from a plurality of areas, each of which is preset for doors.A computing device detects the user's line of sight from the image captured by the camera and determines the door selected by the user based on the detected line of sight. A door unlocking device unlocks the door selected by the user. Citation listPatent literature

[0003] Patent Literature 1: Japanese Unexamined Patent Application No. 2008-2095. Summary of the inventionTechnical problem

[0004] In Patent Literature 1, the door unlocking device unlocks the door corresponding to the area to which the user directs the line of sight. The user can direct the line of sight to any area to select a desired door. However, the line of sight may fluctuate while the user is walking, and there is a possibility that the user cannot accurately determine the door to be opened.

[0005] In view of the above circumstances, an object of the present disclosure is to provide a vehicle door control apparatus, a method, and a computer-readable medium that can accurately control a door to be controlled by a user based on a line of sight of the user. Solution to the problem

[0006] To achieve the above-mentioned object, the present disclosure provides a vehicle door control device as a first aspect.The vehicle door control device comprises: line-of-sight detection means for detecting a line of sight of a user based on an image obtained by detecting the user who intends to travel in a vehicle having a plurality of doors; determination means for determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a specific door for a predetermined time or longer; authentication means for authenticating the user using the image; and door control means for unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user succeeds in authentication.

[0007] The present disclosure provides, as a second aspect, a vehicle door control method. A method for providing a vehicle door includes: detecting a line of sight of a user based on an image obtained by detecting the user who intends to travel in a vehicle having a plurality of doors; determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a specific door for a predetermined time or longer; authenticating the user using the image; and unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user succeeds in authentication.

[0008] The present disclosure provides, as a third aspect, a computer-readable medium. The computer-readable medium stores a program for causing a processor to execute processing including: detecting a line of sight of a user based on an image obtained by detecting the user who intends to travel in a vehicle having a plurality of doors; determining, based on the detected line of sight, whether the user has viewed an area corresponding to a specific door for a predetermined time or longer; authenticating the user using the image; and unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user succeeds in authentication. Advantageous effects of the invention

[0009] The vehicle door control apparatus, method, and computer-readable medium according to the present disclosure can accurately control the door to be controlled by the user based on the user's line of sight. Brief description of the drawings Fig. 1 is a block diagram showing a schematic configuration example of a vehicle door control device according to the present disclosure. Fig. 2 is a block diagram showing a vehicle door control device according to a first embodiment of the present disclosure. Fig. is a schematic representation of a vehicle and an area to which a user's line of sight is directed. Fig. 4 is a flowchart illustrating an operation procedure of a vehicle control door device. Fig. 5 is a block diagram showing a vehicle control device according to a second embodiment of the present disclosure. Fig. 6 is a block diagram showing a hardware configuration of the vehicle control device. Example embodiment

[0010] Before describing embodiments of the present disclosure, an overview of the present disclosure is first provided. Fig. Figure 1 shows a schematic configuration example of a vehicle door control device according to the present disclosure. A vehicle door control device 10 includes a line-of-sight detection device 11, a determination device 12, an authentication device 13, and a door control device 14.

[0011] The line-of-sight detecting means 11 detects a user's line of sight based on an image of a person who intends to travel in a vehicle with a plurality of doors, that is, the user. The determining means 12 determines, based on the line of sight detected by the line-of-sight detecting means 11, whether or not the user has viewed an area corresponding to a specific door among the plurality of doors of the vehicle for a predetermined time or longer.

[0012] The authentication means authenticates the user based on the image obtained by capturing the user attempting to enter the vehicle. The door control means unlocks the specific door when it determines that the user has viewed the specific door for the predetermined time or longer and the user has successfully completed the authentication.

[0013] In the present disclosure, the door control device 14 unlocks the specific door in a case where the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has succeeded in authentication. Since the door corresponding to the area the user has viewed for the predetermined time or longer is controlled in the present disclosure, it is possible to reduce the possibility that a door other than the one the user intends to open is controlled. Therefore, the vehicle door control device 10 according to the present disclosure can accurately control the door to be controlled by the user based on the user's line of sight.

[0014] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings. Note that in the following description and in the drawings, omissions and simplifications are made for the sake of clarity. Furthermore, the same and similar elements in the drawings are denoted by the same reference numerals, and redundant descriptions are omitted where necessary.

[0015] Fig. 2 shows a vehicle door control device according to a first exemplary embodiment of the present disclosure. A vehicle door control device 100 includes an occupant detection unit 101, a line-of-sight detection unit 102, a door determination unit 103, a facial authentication unit 104, and a door control unit 105. The vehicle door control device 100 may be physically configured as a device that includes, for example, one or more memories and one or more processors. At least some of the functions of the units in the vehicle door control device 100 may be implemented such that the one or more processors operate in accordance with a command read from the one or more memories. The vehicle door control device 100 is mounted on a vehicle, for example. The vehicle door control device 100 corresponds to the device shown in Fig. 1 illustrated vehicle door control device 10.

[0016] The occupant detection unit 101 captures a camera image from a camera 130. The camera 130 is a camera mounted on the vehicle and captures an image of an area around the vehicle. The camera 130 captures an image of a person who intends to travel in the vehicle, i.e., an occupant. The vehicle occupant is also referred to as a user. The camera 130 can be installed, for example, in a B-pillar of the vehicle, i.e., a pillar between a front door and a rear door.

[0017] Although in Fig. 2, only one camera 130 is shown, the number of cameras 130 is not limited to one. The occupant detection unit 101 may acquire camera images from a plurality of cameras 130. For example, the occupant detection unit 101 may acquire camera images from a camera that captures an image of a left portion of the vehicle, a camera that captures an image of a right portion of the vehicle, and a camera that captures an image of a rear portion of the vehicle.

[0018] The occupant detection unit 101 detects the user who wishes to ride in the vehicle based on the camera image. For example, the occupant detection unit 101 extracts a facial image or facial region of a person near the vehicle from the camera image. When the facial image or facial region is extracted, the occupant detection unit 101 determines that the user is detected. The line-of-sight detection unit 102 detects the line of sight of the user detected by the occupant detection unit 101 based on the camera image. For example, the line-of-sight detection unit 102 detects the user's eyes from the image of the facial region in the camera image, i.e., the facial image, and detects each direction in which the user's eyes are directed. The detection of the gaze direction can be performed using any known algorithm. The line-of-sight detection unit 102 corresponds to the Fig. 1 shown line of sight detection means 11.

[0019] The vehicle includes a plurality of doors 150. In addition, a plurality of areas corresponding to the plurality of doors 150 are defined in the vehicle. The door determination unit 103 determines, based on the user's line of sight detected by the line-of-sight detection unit 102, whether or not the user has viewed an area corresponding to a specific door for a predetermined time or longer. If the user has viewed the area corresponding to the specific door for the predetermined time or longer, the door determination unit 103 determines the specific door as a door to be controlled. In other words, the door determination unit 103 determines the door corresponding to the area to which the user's line of sight was directed for the predetermined time or longer as the door to be controlled. The door determination unit 103 corresponds to the Fig. 1 means of determination 12.

[0020] Fig. schematically shows the vehicle and the user's line of sight. In this example, the user is approaching a vehicle 200 from the right side of the vehicle 200. The line-of-sight detection unit 102 detects the line of sight of a user 210 based on a camera image. For example, it is assumed that the user 210 is looking at a front door while approaching the vehicle 200 if he / she wants to open the front door. Furthermore, it is assumed that the user 210 is looking at a rear door if he / she wants to open the rear door. It is assumed that the user 210 is looking at a trunk or tailgate if he / she wants to open the trunk or tailgate.

[0021] In a case where the user's line of sight 210 is directed toward a specific door for a certain time or longer, the door determination unit 103 determines that a door that the user 210 wishes to open is the door in the line of sight direction. For example, if the user's line of sight has been directed toward an area 211 corresponding to the front door for a certain time or longer, the door determination unit 103 determines the front door as a door to be controlled. In a case where the user's line of sight has been directed toward an area 212 corresponding to the rear door for the predetermined time or longer, the door determination unit 103 determines the rear door as the door to be controlled.In a case where the user's line of sight has been directed to an area 213 corresponding to the trunk or the tailgate for the predetermined time or longer, the door determination unit 103 determines the trunk or the tailgate as the door to be controlled.

[0022] Note that Fig. 3 shows an example in which the user 210 on the right side of the vehicle 200 opens a door on the right side of the vehicle, but the present embodiment is not limited to this. Areas corresponding respectively to the door on the right side of the vehicle and a door on the left side of the vehicle may be set on the right side of the vehicle. In this case, the door determination unit 103 may determine the door on the right side or the door on the left side as the door to be controlled depending on an area to which the user's line of sight is directed. The number of doors to be controlled is not necessarily one, and the door determination unit 103 may determine a plurality of doors as the doors to be controlled in a case where the user's line of sight is directed to a specific area for the predetermined time or more.

[0023] The door determination unit 103 may change the predetermined time depending on the direction of the user's face in the camera image. The ease of line-of-sight detection or the accuracy of line-of-sight detection may change depending on the direction of the user's face with respect to the camera 130. For example, in a case where the user's face is tilted sharply with respect to the camera 130, the detection accuracy of the line of sight is considered lower than in a case where the user's face faces the camera 130. The door determination unit 103 may set the predetermined time longer in a case where the user's face is directed in a direction where the detection accuracy of the line of sight direction is lower, compared to a case where the user's face is directed in a direction where the detection accuracy of the line of sight direction is higher.

[0024] Instead of or in addition to changing the predetermined time depending on the line-of-sight direction, the door determination unit 103 may change the predetermined time depending on the distance between the user and the vehicle. Since the image of the user in the camera image becomes smaller with increasing distance, the ease or accuracy of detecting the line-of-sight direction is expected to decrease with increasing distance. In a case where the distance between the user and the vehicle is large and therefore the detection accuracy of the line-of-sight direction is expected to be low, the door determination unit 103 may set the predetermined time longer than in a case where the distance is short. The distance between the user and the vehicle may be estimated from the camera image or measured separately using a sensor that can measure the distance, such as Light Detection and Ranging (LiDAR).In a case where the predetermined time changes depending on the direction of the face and / or the distance, the predetermined time can be appropriately set according to the ease or accuracy of detecting the line of sight, which changes depending on the direction of the face and the distance. Therefore, it is assumed that the door determination unit 103 can more accurately determine the door to be controlled.

[0025] The facial authentication unit 104 authenticates the user recognized by the occupant recognition unit 101. In the present embodiment, the facial authentication unit 104 authenticates the user through facial authentication using a camera image from the camera 130. For example, a facial image of a person authorized to ride in the vehicle or a feature set extracted from the facial image is registered in the facial authentication unit 104. The facial authentication unit 104 compares a facial image contained in the camera image or a feature value extracted from the facial image with the registered facial image or feature value.The facial authentication unit 104 calculates a verification value indicating the degree of similarity between the facial image contained in the camera image or the feature set extracted from the facial image and the registered facial image or feature set. The facial authentication unit 104 determines that the user's facial authentication is successful if the verification value is a predetermined threshold or higher. The facial authentication unit 104 corresponds to the method shown in FIG. Fig. 1 authentication means 13.

[0026] The door control unit 105 unlocks a specific door when it is determined that the user has viewed an area corresponding to the specific door for the specified time or longer, and when the user has successfully completed facial authentication. In other words, in a case where the user's facial authentication in the facial authentication unit 104 is successful, the door control unit 105 unlocks the door determined by the door determination unit 103 as the door to be controlled. The door control unit 105 corresponds to the Fig. 1 shown door control means 14.

[0027] For example, if the user has viewed the area corresponding to the entrance door for at least the specified time and facial authentication is successful, the door control unit 105 unlocks the entrance door. The door control unit 105 can not only unlock the door but also open the door. For example, if the door is an electric sliding door, the door control unit 105 transmits a control signal to a control device such as an electronic control unit (ECU) that controls the electric sliding door and controls a motor that drives the electric sliding door. For example, if the door is a hinged door, the door control unit 105 can bring the door into a semi-closed state through a mechanism.

[0028] In the present embodiment, in a case where the user approaches the vehicle, the door determination unit 103 may determine whether the user has viewed an area corresponding to a specific door for the predetermined time or longer after the distance between the user and the vehicle is within a first distance. In other words, the door determination unit 103 may determine the door to be controlled in a case where the user approaches the vehicle by the first distance. Similarly, the face authentication unit 104 may authenticate the user through face authentication after the distance between the user and the vehicle is within the first distance. The determination of the door to be controlled by the door determination unit 103 and the face authentication by the face authentication unit 104 may be performed in parallel.Furthermore, the door control unit 105 may control the door after the distance between the user and the vehicle is within a second distance that is shorter than the first distance.

[0029] For example, the door determination unit 103 and the face authentication unit 104 may perform the determination of the door to be controlled and face authentication when the user approaches the vehicle within 5 m, and the door control unit 105 may control the door when the user approaches the vehicle within 1 m. In this case, the determination of the door to be controlled and face authentication may be completed before the user approaches the vehicle, and the door may be unlocked after the user has sufficiently approached the vehicle.

[0030] Next, an operating procedure is described. Fig. 4 shows an operation flow of the vehicle door control device 100. The operation flow of the vehicle door control device 100 corresponds to a vehicle door control method. The occupant detection unit 101 detects a user in the surroundings of the vehicle based on a camera image from the camera 130 (step S1). The facial authentication unit 104 performs facial authentication on the user detected in step S1 (step S2).

[0031] The line-of-sight detection unit 102 determines whether the distance between the user and the vehicle is within the first distance (step S3). In a case where the line-of-sight detection unit 102 determines that the distance between the user and the vehicle is within the first distance in step S3, the line-of-sight detection unit 102 detects a line of sight of the user detected in step S1 (step S4). Either of steps S2 and S4 may be performed first, or both may be performed in parallel. Furthermore, in a case where face authentication fails in step S2, the processing in and after step S3 is not necessarily performed.

[0032] The door determination unit 103 determines whether or not the user's line of sight has been directed toward an area corresponding to a specific door for the predetermined time or longer in the line of sight detection unit 102 (step S5). If it is determined in step S5 that the user's line of sight has not been directed toward the area corresponding to the specific door for the predetermined time or longer, the processing returns to step S4, and the user's line of sight is detected in step S4. If it is determined in step S5 that the user's line of sight has been directed toward the area corresponding to the specific door for the predetermined time or longer, the door determination unit 103 determines the specific door as a door to be controlled (step S6).

[0033] The door control unit 105 determines whether the distance between the user and the vehicle is within the second distance (step S7). If it is determined in step S7 that the distance between the user and the vehicle is within the second distance and the facial authentication in step S2 is successful, the door control unit 105 controls the door determined in step S6 (step S8). In step S8, the door control unit 105 unlocks, for example, the door determined to be controlled. If the facial authentication fails in step S2, the door control unit 105 does not control the door.

[0034] In the present embodiment, the line-of-sight detection unit 102 detects the user's line of sight, and in a case where the user's line of sight is directed to an area corresponding to a specific door, the door determination unit 103 determines such a door as the door to be controlled. If the user successfully performs facial authentication in the facial authentication unit 104, the door control unit 105 unlocks the door determined by the door determination unit 103 as the door to be controlled. In the present embodiment, the door corresponding to the area in which the user has searched for at least the predetermined time is controlled. Therefore, the door determination unit 103 can correctly determine the door the user wishes to open, and the door control unit 105 can unlock the door the user wishes to open.

[0035] A second embodiment of the present disclosure will be described below. Fig. 5 shows a vehicle door control device according to a second embodiment of the present disclosure. In the present embodiment, a vehicle door control device 100a includes, in addition to the configuration of the vehicle door control device 100 according to the Fig. 2, a living body determination unit 106 is provided. In a case where a user is moving toward a vehicle, the living body determination unit 106 determines whether a user's face in a camera image is a living body face or not based on the camera image of the camera 130. For example, the living body determination unit 106 determines whether the user's face in the camera image is an artificial object such as a photograph or the user's own face. The living body determination unit 106 is also referred to as a living body determination means.

[0036] For example, when the user is moving toward the vehicle, it is assumed that the user's line of sight changes with the change in the distance between the user and the vehicle when the user approaches the vehicle while looking at a specific door. On the other hand, in a case where a person who is not authorized to use the vehicle approaches the vehicle while showing a photograph of the user's face, it is assumed that the user's line of sight determined from the camera image is constant even if the distance changes. The living body determination unit 106 can determine whether the user's face in the camera image is the face of the living body or not based on the change in the line of sight of the moving user.

[0037] For example, when the user walks toward the vehicle, the living body determination unit 106 determines whether or not the line of sight detected by the line of sight detection unit 102 has changed with a change in the distance between the user and the vehicle. Based on a result of the determination, the living body determination unit 106 determines whether or not the user's face is the face of the living body. In a case where the user's line of sight changes while the user is moving, the living body determination unit 106 determines that the user's face in the camera image is the face of the living body. If the user's line of sight does not change, the living body determination unit 106 determines that the user's face in the camera image is not the face of the living body.

[0038] Instead of or in addition to determining whether the face in the camera image is the face of the living body based on the change in the line of sight, the living body determination unit 106 may determine whether the face in the camera image is the face of the living body based on a movement of a torso and a movement of the user's face in the camera image. For example, the living body determination unit 106 detects a vertical movement of a portion of the user's face in the camera image and a vertical movement of a portion of the user's torso in the camera image. The living body determination unit 106 determines whether the vertical movement of the face portion is interlocked with the vertical movement of the torso portion.

[0039] For example, if a person approaches the vehicle while a photograph of the user's face is displayed, it is assumed that a portion of the face as a photograph and a portion of a torso as a living body, that is, a portion below the neck, do not move together in the camera image to cause an unnatural movement. In a case where the vertical movement of the user's face portion in the camera image is interlocked with the vertical movement of the user's torso portion in the camera image, the living body determination unit 106 determines that the face in the camera image is the face of the living body.In a case where the vertical movement of the user's face portion in the camera image is not interlocked with the vertical movement of the user's upper body portion in the camera image, the living body determination unit 106 determines that the face in the camera image is not the face of the living body.

[0040] In the present embodiment, if the living body determination unit 106 determines that the user's face in the camera image is not the living body's face, the face authentication unit 104 determines that the user's authentication has failed. Alternatively, the face authentication unit 104 does not necessarily perform face authentication if the living body determination unit 106 determines that the user's face in the camera image is not the living body's face. In the present embodiment, if the living body determination unit 106 determines that the user's face in the camera image is not the living body's face, the face authentication in the face authentication unit 104 fails. Therefore, the door control unit 105 does not control the door.

[0041] In the present embodiment, the living body determination unit 106 determines whether the user's face in the camera image is the living body's face or not. If the face is not determined to be the living body's face in the living body determination unit 106, the user's face authentication in the face authentication unit 104 fails. Therefore, a malicious person can be prevented from impersonating the user by using the user's face photograph, and security can be enhanced. Other effects are similar to those described in the first embodiment.

[0042] Next, a hardware configuration of the vehicle door control device 100 will be described. Fig.6 shows an example of the hardware configuration of the vehicle door control device 100. The vehicle door control device 100 includes a processor (central processing unit (CPU)) 501, a read-only memory (ROM) 502, and a random access memory (RAM) 503. In the vehicle door control device 100, the processor 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. The vehicle door control device 100 may include other circuitry, such as a peripheral circuit, a communication circuit, and an interface circuit, which are not illustrated here.

[0043] ROM 502 is a non-volatile memory. ROM 502 uses, for example, a semiconductor memory such as a flash memory with a relatively small capacity. ROM 502 stores a program executed by processor 501.

[0044] The program described above includes a group of instructions (or software code) that causes a computer to perform one or more of the functions described in the embodiments when the program is read by the computer. The program may be stored in a non-transitory, computer-readable medium or a tangible storage medium. Computer-readable media or tangible storage media include, for example, RAM, ROM, flash memory, a solid-state drive (SSD) or other storage technology, a compact disc (CD), a digital versatile disc (DVD), a Blu-ray Disc (registered trademark) or other optical disk storage, a magnetic cartridge, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a transitory, computer-readable medium or a communications medium.Examples of temporary computer-readable media or communication media include electrical, optical, acoustic or other forms of transmitted signals.

[0045] RAM 503 is a volatile memory device. Various types of semiconductor memory, such as dynamic random access memory (DRAM) or static random access memory (SRAM), are used as RAM 503. RAM 503 can be used as an internal buffer for temporarily storing data, etc.

[0046] The processor 501 develops the program stored in the ROM 502 in the RAM 503 and executes the program. The functions of the units in the vehicle door control device 100 can be implemented by the CPU 501, which executes the program.

[0047] It should be noted that the vehicle door control device 100 is not necessarily a single device. The vehicle door control device 100 may consist of a plurality of spatially separated devices. Furthermore, the vehicle door control device 100 does not necessarily have all the functions mounted on the vehicle. For example, at least one of the line-of-sight detection unit 102, the door determination unit 103, and the face authentication unit 104 in the vehicle door control device 100 may be arranged outside the vehicle. In this case, a functional unit arranged in the vehicle and a functional unit arranged outside the vehicle may transmit and receive information via a wireless communication network.

[0048] Although the example embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the above example embodiments, and the present disclosure also includes changes or modifications made to the above example embodiments without departing from the scope of the present disclosure.

[0049] For example, some or all of the embodiments described above may be described in the following supplementary notes, but the present disclosure is not limited to the following supplementary notes. [Supplementary Note 1]

[0050] A vehicle door control device comprising: a line-of-sight detecting means for detecting a line of sight of a user based on an image obtained by detecting the user intending to travel in a vehicle having a plurality of doors; determining means for determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a particular door for a predetermined time or longer; an authentication means for authenticating the user based on the image; and a door control means for unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully performed the authentication. [Supplementary Note 2]

[0051] The vehicle door control device according to Additional Note 1, wherein the determining means changes the predetermined time in accordance with a direction of a face of the user in the image. [Supplementary Note 3]

[0052] The vehicle door control device according to Additional Note 1 or 2, wherein the determining means changes the predetermined time in accordance with a distance between the user and the vehicle. [Supplementary Note 4]

[0053] The vehicle door control device according to any one of Supplementary Notes 1 to 3, wherein the determining device determines whether the user has viewed the area corresponding to the specific door for the predetermined time or longer after a distance between the user and the vehicle is within a first distance, and the door control device unlocks the specific door after the distance between the user and the vehicle is within a second distance that is shorter than the first distance. [Supplementary Note 5]

[0054] The vehicle door control device according to any one of supplementary notes 1 to 4, wherein the authentication means authenticates the user by facial authentication. [Supplementary Note 6]

[0055] The vehicle door control device according to Additional Note 5, further comprising a living body determination means for determining, based on the image, whether a face of the user in the image is a living body face or not while the user is moving toward the vehicle, wherein the authentication means does not authenticate the user if the user's face in the image is not determined to be the face of the living body. [Supplementary Note 7]

[0056] The vehicle door control device according to Supplementary Note 6, wherein the living body determining means determines whether or not the detected line of sight has changed with a change in the distance between the user and the vehicle, and determines whether or not the face of the user in the image is the face of the living body based on a result of the determination. [Supplementary Note 8]

[0057] The vehicle door control device according to Supplementary Note 6 or 7, wherein the living body determining means determines whether or not the face of the user in the image is the face of the living body based on a movement of a torso of the user in the image and a movement of the face in the image. [Supplementary Note 9]

[0058] The vehicle door control device according to Supplementary Note 8, wherein the living body determination means determines whether or not a vertical movement of a portion of the user's face in the image is locked with a vertical movement of a portion of the user's torso in the image, and determines whether or not the user's face in the image is the living body face based on a result of the determination. [Supplementary Note 10]

[0059] A method for controlling vehicle doors: Detecting a line of sight of a user based on an image obtained by detecting the user intending to travel in a vehicle having a plurality of doors; Determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a particular door for a predetermined time or longer; Authentication of the user based on the image; and Unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully performed the authentication. [Supplementary Note 11]

[0060] A non-transitory computer-readable medium storing a program to cause a processor to perform processing that includes: Detecting a line of sight of a user based on an image obtained by detecting the user intending to travel in a vehicle having a plurality of doors; Determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a particular door for a predetermined time or longer; Authentication of the user based on the image; and Unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully performed the authentication. Reference character list 10 VEHICLE DOOR CONTROL DEVICE 11 LINE-OF-SIGHT DETECTION MEANS 12 DETERMINATION MEANS 13 AUTHENTICATION MEANS 14 DOOR CONTROL DEVICES 100 VEHICLE DOOR CONTROL DEVICE 101 OCCUPANT DETECTION UNIT 102 LINE OF SIGHT DETECTION UNIT 103 DOOR DETERMINATION UNIT 104 FACIAL AUTHENTICATION UNIT 105 DOOR CONTROL DEVICE 106 UNIT FOR DETERMINING THE LIVING BODY 130 CAMERA 150 DOOR 200 VEHICLES 210 USERS 211 to 213 REGION 501 PROCESSOR 502 ROM 503 RAM 504 BUS QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] JP 2008-2095

[0003]

Claims

[1] A vehicle door control device comprising: a line-of-sight detecting means for detecting a line of sight of a user based on an image obtained by detecting the user intending to travel in a vehicle having a plurality of doors; determining means for determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a particular door for a predetermined time or longer; an authentication means for authenticating the user based on the image; and a door control means for unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully performed the authentication. [2] The vehicle door control device according to claim 1, wherein the determining means changes the predetermined time in accordance with a direction of a face of the user in the image. [3] A vehicle door control device according to claim 1 or 2, wherein the determining means changes the predetermined time depending on a distance between the user and the vehicle. [4] Vehicle door control device according to one of claims 1 to 3, wherein the determining device determines whether the user has viewed the area corresponding to the specific door for the predetermined time or longer after a distance between the user and the vehicle is within a first distance, and the door control device unlocks the specific door after the distance between the user and the vehicle is within a second distance that is shorter than the first distance. [5] The vehicle door control device according to any one of claims 1 to 4, wherein the authentication means authenticates the user by facial authentication. [6] The vehicle door control device according to claim 5, further comprising living body determining means for determining whether a face of the user in the image is a living body face or not based on the image while the user is moving toward the vehicle, wherein the authentication means does not authenticate the user when the face of the user in the image is not determined to be the living body face. [7] The vehicle door control device according to claim 6, wherein the living body determination means determines whether or not the detected line of sight has changed with a change in the distance between the user and the vehicle, and determines whether or not the face of the user in the image is the face of the living body based on a result of the determination. [8] The vehicle door control device according to claim 6 or 7, wherein the living body determining means determines whether the face of the user in the image is the face of the living body or not based on a movement of a torso of the user in the image and a movement of the face in the image. [9] The vehicle door control device according to claim 8, wherein the living body determination means determines whether or not a vertical movement of a portion of the user's face in the image is locked with a vertical movement of a portion of the user's torso in the image, and determines whether or not the user's face in the image is the face of the living body based on a result of the determination. [10] A method for controlling vehicle doors, comprising: Detecting a line of sight of a user based on an image obtained by detecting the user intending to travel in a vehicle having a plurality of doors; Determining, based on the detected line of sight, whether or not the user has viewed an area corresponding to a particular door for a predetermined time or longer; Authentication of the user based on the image; and Unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully performed the authentication. [11] A non-transitory computer-readable medium storing a program for causing a processor to perform processing comprising: Detecting a line of sight of a user based on an image obtained by detecting the user intending to travel in a vehicle having a plurality of doors; Determining, based on the detected line of sight, whether the user has viewed an area corresponding to a particular door for a predetermined time or longer; Authentication of the user based on the image; and Unlocking the specific door in a case where it is determined that the user has viewed the area corresponding to the specific door for the predetermined time or longer and the user has successfully performed the authentication.

Images