Vehicle-mounted virtual image display device

Abstract

To provide a virtual image display device for a vehicle that is able to detect quickly and accurately the position of the eyes of a driver immediately after the driver gets on the vehicle.SOLUTION: A virtual image display device for a vehicle includes: a display unit 120 that emits display light of an image; a reflection unit 130 that reflects the display light to project the image on a windshield 10 positioned in front of a driver; and a control unit 140 that superimposes and displays the image, as a virtual image 20, overlapping an object by adjusting a position of the image projected on the windshield, based on positions EP of eyes of the driver obtained from a face image of the driver acquired by an occupant camera 50 and based on a position of the object Ob present ahead of the vehicle 1 detected by a front sensor 60. When the driver gets on the vehicle, the control unit causes the display unit to display a guidance for the driver to hold a viewing direction when driving is assumed.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a virtual image display device for a vehicle.

Background Art

[0002] Patent Document 1 describes a control method for a vehicle seat including a head-up display mechanism and a vehicle seat. In Patent Document 1, the occupant's eye point is detected by a camera member. When the vehicle seat is moved, based on the seat movement amount, the position of the eye point after movement is calculated and predicted by a control unit.

[0003] And when the display light emitted from the head-up display mechanism and reflected by the windshield does not reach the changed eye point, the display device or the free-form surface mirror of the head-up display mechanism is moved so that the display light reaches the eye point.

[0004] Thereby, the path of the display light is automatically and appropriately arranged at the position of the eye point. <00000%16>

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In a vehicle virtual image display device, when superimposing a corresponding virtual image (AR = augmented reality display) onto an object in front of the vehicle, it is necessary to accurately detect the driver's eye position immediately after the driver gets in (before the vehicle starts moving). However, the driver's actions immediately after getting in are irregular, including, for example, adjusting the seat, fastening the seatbelt, checking luggage, setting a destination on the navigation system, or operating the audio system. Therefore, it is difficult for the head-up display mechanism of Patent Document 1 to accurately grasp the driver's eye position immediately after getting in.

[0007] In view of the above-mentioned problems, the purpose of this disclosure is to provide a vehicle virtual image display device that can quickly and accurately detect the position of the driver's eyes immediately after the driver gets into the vehicle. [Means for solving the problem]

[0008] To achieve the above objectives, this disclosure employs the following technical means.

[0009] One disclosure that achieves the above objective is , a display unit (120) that emits display light for the image, A reflective section (130) that reflects display light and projects an image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto a projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image as a virtual image (20) onto the object; The control unit is It is possible to communicate with a memory unit (80) that has in advance stored information on the eye positions of multiple drivers who are expected to use the vehicle. When a driver is in the vehicle, the display should show guidance to the driver to maintain the correct viewing direction as they would while driving. It is designed to be so, When authenticating the driver who is actually in the vehicle, if the information regarding the driver's eye position is not stored in the memory unit, a guidance message will be displayed on the display unit, and, Even if the driver's eye position is stored in the memory unit, if the driver moves the seat position in the vehicle, a guidance message will be displayed on the display unit. . Other disclosures that achieve the above objectives include a display unit (120) that emits display light for an image, A reflective section (130) that reflects display light and projects an image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto a projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image as a virtual image (20) onto the object; The control unit is When a driver is in the vehicle, guidance is displayed on the display unit to help the driver maintain the viewing direction as they would while driving. When the driver is on board, and the vehicle is stationary when the driver is not on board, guidance displays will be shown in response to the driver's requested operation. Other disclosures that achieve the above objectives include a display unit (120) that emits display light for an image, A reflective section (130) that reflects display light and projects an image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto a projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image as a virtual image (20) onto the object; The control unit is When a driver is in the vehicle, guidance is displayed on the display unit to help the driver maintain the viewing direction as they would while driving. If the system detects an item worn by the driver that reduces the accuracy of eye position detection from the facial image, a warning image will be displayed on the screen instructing the driver to remove the item. Other disclosures that achieve the above objectives include a display unit (120) that emits display light for an image, A reflective section (130) that reflects display light and projects an image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto a projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image as a virtual image (20) onto the object; The control unit is When a driver is in the vehicle, guidance is displayed on the display unit to help the driver maintain the viewing direction as they would while driving. If the eye position moves unnaturally while the guidance display is active, a message will be displayed indicating that the process should be restarted or that the virtual image display will be stopped.

[0010] According to the present disclosure, immediately after the driver gets on the vehicle, it becomes possible to quickly and accurately detect the position of the driver's eyes, and it becomes possible to superimpose and display a virtual image on an object from the start of driving.

[0011] In addition, the reference numerals in parentheses for each of the above means indicate the correspondence with the specific means described in the embodiments described later.

Brief Description of the Drawings

[0012] [Figure 1] It is an explanatory diagram showing the overall configuration of the head-up display device according to the first embodiment. [Figure 2] It is an explanatory diagram showing an example of a virtual image superimposed on an object. [Figure 3] It is an explanatory diagram showing the configuration of the control unit. [Figure 4] It is an explanatory diagram showing a first example of the guidance display. [Figure 5] It is an explanatory diagram showing a second example of the guidance display. [Figure 6]This is an explanatory diagram showing the display format when adjusting the position of the superimposed virtual image. [Figure 7] This is an explanatory diagram showing the display format when the position of the superimposed virtual image has been adjusted. [Figure 8] This is an explanatory diagram showing a cautionary image of the second embodiment. [Modes for carrying out the invention]

[0013] Several embodiments for implementing this disclosure are described below with reference to the drawings. In each embodiment, parts corresponding to matters described in a preceding embodiment are denoted by the same reference numerals, and redundant explanations may be omitted. If only a part of the configuration is described in each embodiment, other parts of the configuration can be applied to other embodiments described in advance. Not only are combinations of parts that are explicitly shown to be combinable in each embodiment possible, but embodiments can also be partially combined even if not explicitly shown, as long as there are no particular problems with the combination.

[0014] (First Embodiment) A first embodiment of a vehicle virtual image display device will be described with reference to Figures 1 to 7. As shown in Figure 1, the vehicle virtual image display device is a device that projects an image from a display unit 120 onto a windshield 10 in front of the driver (viewer) of a vehicle 1. The windshield 10 corresponds to the projection member of this disclosure.

[0015] In other words, the vehicle virtual image display device projects display light representing the image emitted from the display unit 120 onto the projection position 10a on the windshield 10 of the vehicle 1. The display light is the light indicated by the dashed-dot arrow in Figure 1, which extends from the display unit 120 to the windshield 10. The vehicle virtual image display device then displays the image as a virtual image 20 on the forward extension of the line connecting the driver and the projection position 10a of the vehicle 1, allowing the driver to see it. Such a vehicle virtual image display device is called a head-up display (HUD) device and will be referred to as "HUD device 100" below.

[0016] In addition, the HUD device 100 of this embodiment adjusts the projection position 10a (position of the projected image) to form a virtual image 20 on a line connecting the driver's eye position EP and a predetermined object Ob located in front of the vehicle 1, and superimposes the virtual image 20 onto the object Ob (AR display). AR is an abbreviation for Augmented Reality. Such a HUD device 100 is sometimes called an AR-HUD device 100.

[0017] The virtual image 20 displayed by AR is, for example, direction of travel information 20a (turn-by-turn display at intersections) as destination guidance information from a car navigation system, as shown in Figure 2. The direction of travel information 20a is displayed in 3D, for example, and as the vehicle 1 travels, the display position is adjusted to match the position of the approaching intersection as it approaches, and is superimposed on the intersection. In Figure 2, the virtual image 20 displays fixed information 20b that does not change in display position below the display area, such as vehicle speed, shift lever position, and destination.

[0018] The windshield 10 is a shield on the front side of the vehicle 1, and is made of laminated glass, for example, consisting of two panes of glass and an interlayer placed between them. The windshield 10 is curved so that when viewed from above the vehicle 1 and when viewed from the side of the vehicle 1, the interior side of the vehicle 1 is concave, and through the same effect as a normal concave mirror, the virtual image 20 is magnified and can be displayed at a greater distance.

[0019] As shown in Figure 3, Vehicle 1 is equipped with an occupant camera 50, a forward sensor 60, a vehicle ECU 70, and a memory unit 80, etc.

[0020] The occupant camera 50 primarily acquires the driver's facial image (eye position EP) in order to determine the driver's eye position EP, which will be handled by the control unit 140 described later. The occupant camera 50 is installed in front of the ceiling of the vehicle 1 and may use, for example, a CCD camera, a CMOS camera, or an infrared camera. The occupant camera 50 outputs the acquired driver's facial image data to the control unit 140 (decision processing unit 142), which will be described later.

[0021] Furthermore, the occupant camera 50 is not limited to a dedicated camera as described above. For example, if vehicle 1 is equipped with a DSM (Driver Status Monitor, registered trademark) that detects driver distraction or drowsiness and provides driving assistance, the camera set up in the DSM may also be used.

[0022] The forward sensor 60 is a sensor that detects objects Ob present in front of the vehicle 1, and is installed, for example, at the front end of the vehicle 1. Examples of objects Ob include moving objects such as pedestrians, cyclists, animals other than humans, and other vehicles (vehicles ahead). Other examples of objects Ob include stationary objects such as fallen objects on the road, guardrails, curbs, road signs, lane markings, driving lane lines, median strips, intersections, roadside structures, and tunnels. In this embodiment, the object Ob is, for example, an intersection in the destination guidance route described in Figure 2.

[0023] The forward sensor 60 can be a forward camera, millimeter-wave radar, LiDAR (Light Detection and Ranging / Laser Imaging Detection and Ranging), sonar that receives reflected ultrasonic waves, etc. In this case, a forward camera is used as the forward sensor 60. The forward camera can be, for example, a CCD camera, a CMOS camera, or an infrared camera. The forward sensor 60 outputs the acquired data of the target object Ob to the control unit 140 (decision processing unit 142).

[0024] The vehicle ECU 70 is the part that controls the operation of each functional part of the vehicle 1, and outputs various vehicle data detected by various vehicle sensors to the control unit 140 (decision processing unit 142). Examples of various vehicle data include the ignition switch ON signal, vehicle speed signal, engine speed signal, shift lever position signal, fuel level signal, destination guidance information from the car navigation system, etc.

[0025] The memory unit 80 is a part that pre-stores authentication information corresponding to multiple drivers who are expected to use the vehicle 1, as well as eye position EP information (registration information). The memory unit 80 may be installed not only in the vehicle 1, but also in a cloud on the internet, a predetermined base station, etc.

[0026] Examples of multiple drivers include family members who share vehicle 1, or members of a common community (apartment building, club, shared group, etc.) such as Person A, Person B, and Person C.

[0027] Furthermore, the authentication information is information for recognizing multiple drivers, and can be, for example, the authentication facial images of people known to be driving vehicle 1 (Person A, Person B, Person C, etc.). The authentication information may also be, for example, the authentication ID set on the mobile device carried by each driver.

[0028] Furthermore, the eye position EP information is coordinate data indicating the actual eye position EP acquired by the occupant camera 50 when each driver assumes a driving posture. The coordinate data is, for example, data on the camera's 3D coordinate system in the vehicle interior space, defined based on the set position of the occupant camera 50.

[0029] Furthermore, the position of the object Ob detected by the forward sensor 60 is set on the sensor's 3D coordinate system in the space in front of the vehicle 1, which is defined based on the setting position of the forward sensor 60. In addition, the sensor's 3D coordinate system is converted to the camera's 3D coordinate system, so that the position of the object Ob, along with the driver's eye position EP, is determined on the camera's 3D coordinate system.

[0030] The HUD device 100 includes a housing 110, a display unit 120, a reflector unit 130, and a control unit 140, etc.

[0031] The housing 110 is a case member that houses the display unit 120, the reflector unit 130, etc., and is, for example, a rectangular parallelepiped. The control unit 140 may also be housed within the housing 110. An opening 111 is formed on the upper side (windshield 10 side) of the housing 110 to allow the display light from the display unit 120 to exit (pass through). A light-transmitting dustproof sheet is provided in the opening 111 to prevent dust and dirt from entering the housing 110. The housing 110 is located within the instrument panel of the vehicle 1. An instrument panel opening is also formed on the upper surface of the instrument panel to allow the display light to pass through.

[0032] The display unit 120 is illuminated by light transmitted from a backlight, for example, and displays a predetermined image on the display surface 121, in this case an image showing the direction of travel indication information 20a and a fixed display 20b, and is controlled (image processed) by the control unit 140. The display unit 120 uses, for example, a TFT liquid crystal display using thin film transistors (TFT).

[0033] The backlight is located on the back side of the display unit 120 (opposite the display surface 121) and, when power is supplied, emits light, illuminating the display unit 120 with light for image display. For example, a light-emitting diode (LED) is used for the backlight. Multiple LEDs are provided and arranged in a grid pattern. The backlight's emission state is controlled by the control unit 140, and the light is irradiated along the optical axis relative to the display unit 120.

[0034] The display unit 120 emits display light representing an image towards a plane mirror 131 on the opposite side of the backlight, using light emitted from the backlight. In this embodiment, the surface of the display unit 120 from which the display light is emitted (display surface 121) is, for example, oriented horizontally, and the optical axis of the display light is oriented in the vertical direction of the vehicle 1 (the emission direction is oriented towards the upper side of the vehicle 1).

[0035] The reflective section 130 is a component that reflects the display light emitted from the display section 120 and projects an image onto the windshield 10 located in front of the driver, and has a flat mirror 131 and a concave mirror 132.

[0036] The plane mirror 131 is a mirror with a flat reflective surface, and its reflective surface is positioned to face the display unit 120 and the concave mirror 132. The plane mirror 131 is configured to reflect the display light from the display unit 120 onto the concave mirror 132.

[0037] The concave mirror 132 is a mirror that magnifies the reflected image from the plane mirror 131, and the reflective surface of the concave mirror 132 is positioned to face the plane mirror 131 and the projection position 10a of the windshield 10. The concave mirror 132 is configured to reflect the display light emitted from the display unit 120 and reflected by the plane mirror 131 through the opening 111 of the housing 110 to the projection position 10a of the windshield 10.

[0038] The concave mirror 132 is supported by a shaft extending horizontally (in the left-right width direction) of the vehicle 1 and is rotated by a drive unit. When the drive unit is activated by the control unit 140, the tilt angle (reflection angle) of the concave mirror 132 shown in Figure 1 is adjusted (angle control). By adjusting the tilt angle of the concave mirror 132, the reference position of the virtual image 20 (the entire virtual image 20) is changed, allowing drivers of different physiques to individually shift the projection position 10a and view the virtual image 20 at a suitable position.

[0039] The control unit 140 is responsible for display control related to image processing of the display unit 120 and angle control of the concave mirror 132. In addition, when a driver gets into the vehicle 1, the control unit 140 displays guidance on the display unit 120 to the driver so that they maintain the viewing direction as they would when driving (details will be described later). As shown in Figure 3, the control unit 140 includes a guidance processing unit 141, a judgment processing unit 142, and an AR display control unit 143, etc.

[0040] The guidance processing unit 141 is able to communicate with the memory unit 80 and authenticates the driver who is in the vehicle. Authentication methods include using facial images from the passenger camera 50 (comparison with an authentication facial image), or using an authentication ID set on a mobile terminal carried by each driver.

[0041] In addition, the guidance processing unit 141, after the above authentication, if the authentication information of the driver who actually boarded the vehicle and the information of the eye position EP are not stored in the storage unit 80, instructs the display unit 120 to display guidance to the driver and requests the judgment processing unit 142 to perform a judgment process on the eye position EP. The "guidance display" is intended to prompt the driver to maintain the viewing direction as if they were driving.

[0042] The determination processing unit 142 determines the eye position EP information of the driver who is actually riding in the vehicle, and outputs the determined eye position EP information to the AR display control unit 143.

[0043] The AR display control unit 143 controls the display state (display position) of the image of the direction of travel indication information 20a in the display unit 120 so that the virtual image 20 (direction of travel indication information 20a, which is an AR display) is superimposed on the object Ob, based on the position of the driver's eyes EP and the position of the object Ob, and also controls the angle of the concave mirror 132.

[0044] The HUD device 100 is configured as described above, and the operation and effects of the HUD device 100 will be explained below with reference to Figures 4 to 7.

[0045] When the driver gets into vehicle 1 and the ignition switch is turned on, the guidance processing unit 141 of the control unit 140 authenticates the driver who has gotten into the vehicle.

[0046] The guidance processing unit 141 communicates with the storage unit 80 and determines whether or not there is eye position EP data for the driver who has boarded the vehicle, based on the authentication information of multiple drivers and eye position EP data that have been stored in the storage unit 80 in advance.

[0047] 1. If there is no data on the eye position EP. If there is no data on the eye position EP of the driver who is in the vehicle, the guidance processing unit 141 instructs the display unit 120 to display guidance. The guidance display on the display unit 120 is perceived by the driver as a virtual image 20.

[0048] The guidance display can be, for example, a text image 20c that prompts the driver to maintain their normal driving posture and direction of view, as shown in Figures 4 and 5. The text image 20c can display, for example, "Look straight ahead."

[0049] Alternatively, a graphic image 20d indicating the area to be viewed may be provided as a guidance display. The graphic image 20d may be, for example, an image prompting the driver to face forward in the driving position (Figure 4), or an image indicating the area in front to be viewed in the driving position (a circular mark, Figure 5).

[0050] The guidance processing unit 141 then outputs a request to the determination processing unit 142 for determination processing regarding the eye position EP.

[0051] The determination processing unit 142 determines that it is necessary to calculate the eye position EP of the driver who is in the vehicle, as the data for the eye position EP is not stored in the storage unit 80. Therefore, the determination processing unit 142 calculates the eye position EP from the driver's face image acquired by the occupant camera 50, and also acquires data on the position of the object Ob from the forward sensor 60 and various vehicle data from the vehicle ECU 70. During the calculation of the eye position EP, the display unit 120 displays an image of adjustment in progress, for example, as shown in Figure 6. When the calculation of the eye position EP is complete, an image of adjustment completion, for example, as shown in Figure 7, is displayed. The determination processing unit 142 then outputs the calculated eye position EP data, the acquired data on the position of the object Ob, and various vehicle data to the AR display control unit 143.

[0052] The AR display control unit 143 controls the drive unit of the concave mirror 132 so that the reference position of the virtual image 20 is in a position suitable for the driver, based on the eye position EP data calculated from the facial image of the occupant camera 50.

[0053] The AR display control unit 143 then forms an image of the virtual image 20 based on the eye position EP data calculated from the face image of the occupant camera 50, the position data of the target object Ob, and various vehicle data, and instructs the display unit 120 to display it. In the display unit 120, the display position of the image corresponding to the virtual image 20 related to the AR display (for example, the direction of travel indication information 20a) is changed so that it overlaps with the position of the target object Ob, which changes moment by moment.

[0054] 2. If there is eye position EP data On the other hand, if data on the eye position EP of the driver who is in the vehicle is available, the guidance processing unit 141 outputs a request to the determination processing unit 142 for determination processing regarding the eye position EP without instructing the display unit 120 to display guidance.

[0055] The determination processing unit 142 determines that the driver's eye position EP data stored in the memory unit 80 is usable data, and acquires the position data of the object Ob from the forward sensor 60 and various vehicle data from the vehicle ECU 70. The determination processing unit 142 then outputs the eye position EP data, the position data of the object Ob, and the various vehicle data to the AR display control unit 143.

[0056] The AR display control unit 143 controls the drive unit of the concave mirror 132 so that the reference position of the virtual image 20 is in a position suitable for the driver, based on the eye position EP data stored in the memory unit 80.

[0057] The AR display control unit 143 then forms an image of the virtual image 20 based on the eye position data EP, the object position data Ob, and various vehicle data stored in the memory unit 80, and instructs the display unit 120 to display it. In the display unit 120, the display position of the image corresponding to the virtual image 20 related to the AR display (for example, the direction of travel indication information 20a) is changed so that it overlaps with the position of the object Ob, which changes moment by moment.

[0058] Furthermore, even if the eye position EP data is stored in the storage unit 80, the judgment processing unit 142 will display guidance on the display unit 120 if the driver moves the seat position of the vehicle 1 when boarding.

[0059] In other words, if the eye position EP data obtained from the memory unit 80 differs from the eye position EP calculated from the face image of the occupant camera 50, the determination processing unit 142 outputs the eye position EP data calculated from the face image to the AR display control unit 143. The AR display control unit 143 instructs the display unit 120 to display guidance and controls the display of the display unit 120 based on the eye position EP data calculated from the face image, the position data of the target object Ob, and various vehicle data.

[0060] Furthermore, when the vehicle 1 is stationary and the driver is not in the vehicle, the control unit 140 displays guidance in response to the driver's requested operation (input).

[0061] As described above, in this embodiment, when a driver gets into the vehicle 1, the control unit 140 causes the display unit 120 to display guidance to the driver so that they maintain the viewing direction as if they were driving.

[0062] This makes it possible to quickly and accurately detect the driver's eye position immediately after the driver gets in the vehicle, enabling the superimposition of a virtual image 20 onto the object Ob from the moment driving begins. Furthermore, since the position of the virtual image 20 to be displayed can be adjusted on the HUD device 100 side based on the detected eye position EP, the driver's adjustment operation is eliminated.

[0063] Furthermore, the control unit 140 is capable of communicating with a storage unit 80 that has pre-stored eye position EP information corresponding to multiple drivers who are expected to use the vehicle 1. When the control unit 140 authenticates a driver who has actually boarded the vehicle from a facial image, if the eye position EP information of the driver who has actually boarded the vehicle is not stored in the storage unit 80, it displays guidance on the display unit 120.

[0064] As a result, if the memory unit 80 contains data on the eye position EP, it becomes unnecessary to calculate the data on the eye position EP, thereby reducing the effort required for control.

[0065] Furthermore, even if the control unit 140 has stored information about the driver's eye position EP while they are actually in the vehicle in the storage unit 80, if the driver moves the seat position in the vehicle 1, the control unit 140 will display guidance on the display unit 120. As a result, the eye position EP will change as the seat position moves, so by displaying guidance, it becomes possible to determine the driver's correct eye position EP.

[0066] Furthermore, when the vehicle 1 is stationary and the driver is not in the vehicle, the control unit 140 displays guidance in response to the driver's requested operation. This ensures that the system is based on the driver's requested operation when the vehicle is stationary, enabling safe driving.

[0067] Furthermore, when displaying guidance, the control unit 140 displays on the display unit 120 a graphic image 20d indicating the area to be viewed, in addition to a character image 20c that prompts attention to maintaining the viewing direction. This makes the guidance display easy for the driver to understand.

[0068] (Second Embodiment) Figure 8 shows the guidance display of the second embodiment. In the second embodiment, when the control unit 140 (guidance processing unit 141) detects an item worn by the driver that reduces the accuracy of eye position detection from the driver's facial image, it displays a warning image 20e on the display unit 120 instructing the driver to remove the item. The control unit 140 displays the warning image 20e on the display unit 120 at any time an item is detected, not just when the driver is in the vehicle.

[0069] Wearing items include, for example, sunglasses or masks. If the driver is wearing sunglasses or a mask, it is not possible to accurately determine the position of the eyes EP. Therefore, the control unit 140 displays a warning image 20e on the display unit 120, for example, "Please remove your sunglasses and mask."

[0070] This allows the driver to accurately determine the position of their eyes (EP) by prompting them to remove any devices they are wearing, even if they are wearing protective gear.

[0071] (Third embodiment) The control unit 140 may, during guidance display, display a message indicating that the driver's eye position EP moves unnaturally, or a message indicating that the display of the virtual image 20 should be stopped.

[0072] The message indicating that a redo is needed could be, for example, "The AR display will be turned off because the adjustment is not complete," or "Please turn the ignition switch on again and adjust." This would alert the driver and allow them to redo the adjustment so that they can understand the correct eye position EP.

[0073] (Fourth Embodiment) The control unit 140, upon authentication of the driver, may store information on the eye position EP in the storage unit 80 for drivers entering the vehicle 1 for the first time, and may also prohibit the display of guidance for a predetermined period, and then display guidance after the predetermined period has elapsed. The predetermined period can be, for example, about 1 to 2 weeks.

[0074] This is because drivers who are using Vehicle 1 for the first time tend to want to avoid the detailed settings related to Vehicle 1, so guidance displays are omitted until they become familiar with Vehicle 1.

[0075] (Other embodiments) The disclosures in this specification and drawings are not limited to the exemplary embodiments. The disclosures include the exemplary embodiments and variations thereof by those skilled in the art. For example, the disclosures are not limited to combinations of parts and / or elements shown in the embodiments. The disclosures are implementable in a variety of combinations. The disclosures may have additional parts that can be added to the embodiments. The disclosures include embodiments in which parts and / or elements have been omitted. The disclosures include substitutions or combinations of parts and / or elements between one embodiment and another. The scope of the disclosed technical areas is not limited to the descriptions of the embodiments. Some of the scope of the disclosed technical areas are indicated by the claims and should be understood to include all modifications within the meaning and scope equivalent to the claims.

[0076] Furthermore, in each of the above embodiments, the windshield 10 of the vehicle 1 was used as the projection member for the display light emitted from the display unit 120, but it is not limited to this, and a combiner or the like, which is specifically provided for the HUD device 100, may also be used.

[0077] Furthermore, although the above embodiments described the display unit 120 as using a liquid crystal display (TFT liquid crystal display), other types of displays, such as organic EL displays, may be used instead.

[0078] Furthermore, in each of the above embodiments, the reflecting section 130 is provided with a flat mirror 131 and a concave mirror 132. However, for example, the display light from the display section 120 may be directed towards the concave mirror 132, thereby eliminating the flat mirror 131. [Explanation of symbols]

[0079] 1 vehicle 10. Windshield (projection element) 20 Illusion 50 Crew Cameras 60 Front Sensors 80 Storage section 100 Head-up display device (vehicle virtual image display device) 120 Display section 130 Reflector 140 Control Unit EP eye position Ob object

Claims

1. A display unit (120) that emits display light for the image, A reflecting unit (130) that reflects the aforementioned display light and projects the image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto the projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image onto the object as a virtual image (20), The control unit, It is possible to communicate with a storage unit (80) that has in advance stored information on the eye positions corresponding to multiple drivers who are expected to use the vehicle, When the driver boards the vehicle, the display unit is configured to provide guidance to the driver to maintain the viewing direction as it would be during driving. When authenticating the driver who is actually in the vehicle, if the information regarding the driver's eye position is not stored in the memory unit, the guidance is displayed on the display unit, and A virtual image display device for a vehicle, which, even if the information of the driver's eye position while actually riding in the vehicle is stored in the memory unit, displays the guidance on the display unit if the driver moves the seat position of the vehicle.

2. A display unit (120) that emits display light for the image, A reflecting unit (130) that reflects the aforementioned display light and projects the image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto the projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image onto the object as a virtual image (20), The control unit, When the driver is in the vehicle, the display unit will provide guidance to the driver to maintain the viewing direction as it would be during driving. A virtual image display device for a vehicle that, when the driver is in the vehicle and when the vehicle is stationary at a time when the driver is not in the vehicle, displays the guidance in response to the driver's request.

3. A display unit (120) that emits display light for the image, A reflecting unit (130) that reflects the aforementioned display light and projects the image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto the projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image onto the object as a virtual image (20), The control unit, When the driver is in the vehicle, the display unit will provide guidance to the driver to maintain the viewing direction as it would be during driving. A virtual image display device for vehicles, which, when it detects an item worn by the driver that reduces the accuracy of detecting the position of the eyes from the facial image, displays a warning image on the display unit instructing the driver to remove the item.

4. The control unit displays the warning image at the time it detects the attached object, as described in claim 3.

5. A display unit (120) that emits display light for the image, A reflecting unit (130) that reflects the aforementioned display light and projects the image onto a projection member (10) located in front of the driver, A virtual image display device for a vehicle, comprising: a control unit (140) that adjusts the position of the image projected onto the projection member based on the position of the driver's eyes (EP) obtained from the driver's facial image acquired by the occupant camera (50) and the position of an object (Ob) located in front of the vehicle (1) detected by the forward sensor (60), and superimposes the image onto the object as a virtual image (20), The control unit, When the driver is in the vehicle, the display unit will provide guidance to the driver to maintain the viewing direction as it would be during driving. A vehicle virtual image display device that, when the position of the eyes moves unnaturally during the guidance display, displays a message to start over or a message to stop displaying the virtual image.

Images