Head-up display device and display control system

By adjusting the image display position and method in the HUD device, the image repetition problem caused by changes in the occupant's eye position is solved, ensuring the clear front and back relationship between the images, and improving visual observation and perspective.

CN119078509APending Publication Date: 2024-12-06NIPPON SEIKI CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202410706116.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-06-06
Filing Date
2024-06-03
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In the HUD device, the change in the eye position of the occupant causes the displayed image to be unable to effectively overlap with the information related to the foreground object, affecting the visual observation effect, especially when the image position is repeated, it is difficult to understand the front and back relationship between images.

Method used

In the HUD device, the display position and method of the image are adjusted according to the change of the eye position of the occupant, and the repetition of the image position is avoided, and the display change control and repeated elimination control are used to ensure the difference in display position between images and enhance the perspective feeling of visual observation and Expression in depth.

Benefits of technology

It is realized that the front and back relationship between images is kept clear when the occupant's eye position changes, the visual observation and perspective of the HUD device are improved, and the occupant's ability to understand the front and back information is enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119078509A_ABST
    Figure CN119078509A_ABST
Patent Text Reader

Abstract

A head-up display device and a display control system, the head-up display device causing a passenger to visually observe by projecting and displaying one or more images superimposed on a foreground on a display region virtually set in front of a vehicle, the head-up display device comprising: a display unit for projecting and displaying a first image and a second image on the display region; and a control unit that performs control so that the first image is disposed on the rear side of the second image viewed from the occupant and displayed on the display unit, the control unit performs first control in accordance with the eye position of the occupant in the height direction, so that the display positions and / or display modes of the first and / or second images are disposed in the display region differently, and performs second control in accordance with the eye position of the occupant in the height direction. The second control is performed when an overlap occurs in the vertical direction between the first and second images due to the first control, and the first and / or second images are rearranged to avoid the overlap. According to the present invention, even if the position of the eyes in the height direction of the passenger changes, control is performed so that the positions of the displayed images in the vertical direction do not overlap, and the passenger can understand the front-back relationship between the images.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a head-up display device and a display control system used for a moving body such as a vehicle, which allows a virtual display object to be visually observed by overlapping it with the foreground of the moving body. Background Art

[0002] For example, Patent Document 1 describes a head-up display device (hereinafter referred to as a HUD device), which can use virtual display objects (virtual images) to improve the expressiveness in the depth direction (the front and rear direction of the vehicle) and intuitively provide information prompts to passengers (drivers) and other visual observers. The HUD device configures the virtual image at a predetermined position in the depth or up, down, left, and right directions in the foreground (the real scene in the forward direction observed by the passengers of the vehicle), forming an augmented reality (AR) in which the virtual image is added to the real scene (foreground) such as the road surface for display.

[0003] It is known that in such a HUD device, the following control is performed to generate information related to the foreground object, such as speed limit information or front vehicle following information, which exists in the foreground of the vehicle, as an image (virtual image), and to display the image (virtual image) at a position close to the foreground object as viewed by the occupant. In addition, it is known that, as viewed from the occupant, the visual observation object located on the upper side (the side that is perceived as the inner side when viewed from the visual observer) is arranged on the inner side of the virtual image forming surface (hereinafter referred to as the display area), and the visual observation object located on the lower side (the side that is perceived as the near front side when viewed from the visual observer) is arranged on the near front side of the above-mentioned display area, thereby, for example, by displaying the speed limit information on the approaching side on the near front side and displaying the front vehicle following information on the moving away side on the inner side, the front and rear relationship of each information is expressed.

[0004] In addition, it is known to perform the following control: setting a virtual vanishing point (the point where two or more originally parallel lines intersect when they are drawn non-parallel in the line perspective method) inside or outside the field of view of the image (virtual image), configuring a navigation image or a traffic sign image (virtual image) on a white line image simulating a driving lane toward the virtual vanishing point, and displaying these images (virtual images) along the road surface as viewed from the occupant.

[0005] Through these controls, it is possible to achieve the effects of enabling the occupants to (1) visually observe that the displayed image (virtual image) is information related to the foreground object; (2) visually observe to be able to understand the foreground relationship of each piece of information related to the foreground object; and (3) visually observe that each image (virtual image) is arranged along the road surface.

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2021-051231 Summary of the invention

[0009] Problems to be solved by the invention

[0010] In addition, in the above-mentioned HUD device, each image configured and projected in a display area (virtual image imaging surface) virtually set in front of the vehicle is displayed under the assumption that the position of the eye in the height direction of the occupant is at a reference position. Therefore, when the position of the eye in the height direction of the occupant changes due to the height, etc., the observation method of the foreground object and the image (virtual image) representing information related to the foreground object observed by the occupant changes. Due to this change, the displayed image (virtual image) may have problems such as (1) not being visually observed as information related to the foreground object; or (2) not being visually observed as each image (virtual image) being arranged along the road surface. It is known that these problems can be solved by changing the display position of each image (virtual image) in the up and down direction.

[0011] However, by changing the display position of each image (virtual image), the display position of each image in the up-down direction may sometimes be repeated (overlapped), in which case it may be difficult to understand the front-to-back relationship between the images. The HUD device that generates a virtual image imaging surface (display area) inclined relative to the road surface changes the display distance (imaging distance) according to the position of the image in the up-down direction. Therefore, if the positions of each image in the up-down direction are repeated, the difference in display distance between the images disappears or becomes smaller, thereby reducing the advantages of the HUD device using an inclined virtual image imaging surface (display area), such as being able to perform a display that improves the expressiveness in the depth direction (the front-to-back direction of the vehicle), and more naturally realizing the visual observability of a virtual image with a sense of perspective.

[0012] The present invention is made to solve such a problem, and its purpose is to provide a head-up display device and a display control system, which can make the occupant understand the front-back relationship between images by controlling the positions of the displayed images in the vertical direction without duplication even when the position of the occupant's eyes in the height direction changes.

[0013] Other objects of the present invention will be apparent to those skilled in the art by referring to the following exemplary technical solutions and best embodiments and the accompanying drawings.

[0014] Means for solving problems

[0015] In order to easily understand the outline of the present invention, the technical aspects of the present invention are exemplified below.

[0016] The first technical solution is a head-up display device, which allows a passenger to visually observe the images by projecting and displaying one or more images in a display area virtually set in front of a vehicle in a manner overlapping with a foreground, wherein the device comprises: a display unit, which projects a first image and a second image into the display area for display; and a control unit, which controls the display unit to arrange the first image on the inner side of the second image as viewed from the occupant, and display the first image on the display unit, wherein the control unit performs a first control to arrange the first image and / or the second image in the display area in a manner that makes the display position and / or display method different according to the position of the occupant's eyes in the height direction, and through the first control, when overlap occurs between the first image and the second image in the up and down direction, a second control is performed to re-arrange the first image and / or the second image to avoid the overlap.

[0017] Here, when the lower side (the side that is felt as the near front side when viewed from the occupant) in the display area virtually set in front of the vehicle is set as the near front side, and the upper side (the side that is felt as the back side when viewed from the occupant) is set as the back side, the "first image" projected and displayed by the display unit is, for example, as shown in FIG. Figure 5 As shown in an example of the display method in (a), the speed limit information NI is displayed on the near front side, and the second image is the speed limit information FI displayed on the back side. In addition, the "position of the eyes in the height direction of the occupant" can be determined based on, for example, the angle information of the reflective component (concave mirror) of the head-up display device set by the occupant, or can be determined by performing image recognition on the shooting information obtained by the camera (on-board sensing device 200) of the vehicle.

[0018] In addition, the "first control" configures the first image and / or the second image in the display area in a manner that makes the display position and / or display method different according to the position of the occupant's eyes in the height direction, but here, "displaying in a manner that makes the display position different" means, for example, when the position of the occupant's eyes in the height direction is changed according to the height of the occupant, etc., display change control is performed to configure the position of the first image and / or the second image to be moved to the inner side or near the front side of the display area that is conjugate with the display surface of the display unit according to the amount of change. In addition, "displaying in a manner that makes the display method different" means, for example, display change control is performed to make the size, number, brightness, color, clarity, etc. of display elements such as text or decorations constituting the first image and / or the second image different according to the first image and the second image.

[0019] In addition, the "second control" is to reconfigure the first image or the second image to avoid duplication when duplication occurs in the vertical direction between the first image and the second image due to the first control, but here, "duplication" means, for example, a case where at least a portion of the first area in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the first image and the second area in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the second image overlap (repeat) in the vertical direction. In addition, "reconfiguration" means, for example, performing duplication elimination control such that the first image, which is desired to be visually observed from the back side when viewed from the passenger, is moved to the upper side of the display area, or the second image, which is desired to be visually observed from the front side when viewed from the passenger, is moved to the lower side of the display area. However, it is known that in human visual characteristics, the closer the distance between the visual observation object (the first image and the second image) and the visual observer (passenger) is, the higher the depth discrimination ability is. Therefore, in a HUD device that generates a virtual image forming surface (display area) inclined relative to the road surface, the lower side of the display area is closer to the occupant than the upper side (display distance). Therefore, it is more conducive for the occupant to grasp the front-to-back relationship between the images than moving the first image, which is an image desired to be visually observed on the inner side, upward and moving the second image, which is desired to be visually observed on the near front side, downward.

[0020] According to the first technical solution, the control unit performs a first control (display change control) to arrange the display position and / or display mode of the first image and / or the second image in the display area in a different manner according to the position of the eye in the height direction of the passenger. Through the first control, when duplication occurs between the first image and the second image in the height direction, a second control (duplication elimination control) is performed to re-arrange the first image and / or the second image to avoid duplication. In other words, when the control unit detects a change in the position of the eye in the height direction of the passenger, the display change control of changing the display position and / or display mode of the first image and / or the second image is performed. As a result of the display change control, if there is duplication between the images, the duplication elimination control of moving the second image that is desired to be visually observed on the near front side downward is performed. Therefore, when duplication occurs between the images by the display change control, it is difficult for the passenger to understand the front-to-back relationship between the images. However, by performing the duplication elimination control of moving the second image that is desired to be visually observed on the near front side downward, for example, a difference is set in the display position in the up-down direction between the images, thereby making it easier for the passenger to understand the front-to-back relationship between the images. That is, even if the eye position of the passenger changes in the height direction, by controlling the displayed images so that the vertical positions do not overlap, it is possible to ensure that the passenger can understand the front-back relationship between the images.

[0021] In the second technical solution subordinate to the first technical solution, the control unit can perform the second control when the repetition occurs between the first area in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the first image, and the second area in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the second image, respectively.

[0022] Here, the "first area" is, for example, Figure 7 As shown in an example of the display method in (a), the display area NA in the vertical direction of the speed limit information NI located on the approaching side, and the "second area" refers to the display area FA in the vertical direction of the speed limit information FI located on the far side. According to the second technical solution, the control unit determines the repetition in the vertical direction between the first area (the display area NA in the vertical direction of the speed limit information NI located on the approaching side) and the second area (the display area FA in the vertical direction of the speed limit information FI located on the far side) to which the first image belongs, and performs the second control when the repetition occurs. In this case, since the repetition is detected only by comparing the display position of the lower end of the first image with the display position of the upper end of the second image, the repetition can be detected with less processing load than when comparing the pixels between the images. Therefore, by performing the second control of setting a difference in the display position in the vertical direction after detecting the repetition between the images with less processing load, the occupant can understand the front-to-back relationship between the images.

[0023] In a third technical solution dependent on the first technical solution, the control unit may perform the first control and the second control when the first image and the second image are images related to a foreground in front of the vehicle.

[0024] According to the third technical solution, if the first image and the second image are images related to the foreground in front of the vehicle, the control unit performs the first control and the second control. According to the third technical solution, the grasping of the front-to-back relationship between such images is particularly important when the images are related to the foreground in front of the vehicle, and by performing the second control on such images, it is possible to ensure that the occupant grasps the front-to-back relationship between the images.

[0025] In the fourth technical solution subordinate to the first technical solution, the control unit can set a virtual vanishing point of the line perspective method inside or outside the display area, so as to configure the first image and the second image along the vehicle line of the foreground driving lane simulating passing through the virtual vanishing point and display the first image and the second image within a prescribed range that can be visually observed by the occupant. In this case, the first control and the second control are performed.

[0026] Here, the "virtual vanishing point" refers to, for example, a point where two or more originally parallel lines intersect when drawn non-parallel in linear perspective (for example, Figure 5 VP of (a) is the direction of sight when the occupant, as a visual observer, observes inward. In addition, the "prescribed range" is a value determined by a threshold value of whether the occupant can visually observe that each image (the first image and the second image) is arranged along the road surface, and is a value obtained by experiments or simulations. For example, Figure 5 As shown in an example of the display method in (a), the slope of the virtual lane VL simulating the driving lane WL is 35°, and the two speed limit information (NI, FI) as the first image and the second image are also arranged in a manner of 35°. However, when the two images NI and FI are arranged in a manner to be perpendicular, that is, when the two speed limit information (NI, FI) are arranged in a manner to be 90°, the occupant cannot visually observe that the images are arranged along the road surface. Therefore, the "prescribed range" is a range of values ​​(slopes) set to prevent such an arrangement, for example, 8° or more and less than 66°.

[0027] For example, Figure 6 As shown in an example of the display method in (a), the virtual lane VL configuring the front side speed limit information NI (second image) and the back side speed limit information FI (first image) has a different slope from the virtual lane AL passing through the center of the driving lane WL in the real world (foreground in front of the vehicle). When the difference in the slope becomes larger, it is possible to visually observe that the images are not along the road surface. Therefore, according to the fourth technical solution, for example, Figure 7 As shown in an example of a display method in (a), the control unit performs a first control (display change control) to change the display position of the virtual vanishing point VP in such a manner that the virtual vehicle line VL used to configure each image has the same slope as the virtual vehicle line AL passing through the center of the driving lane WL in the real world, and to change the display position or display method of the speed limit information NI (second image) configured on the near front side and the speed limit information FI (first image) configured on the inner side in such a manner that the virtual vehicle line VL passes toward the virtual vanishing point VP.

[0028] However, according to Figure 7 In the example of the display method shown in (a), the area (first area NA) surrounded by two horizontal line segments passing through the upper and lower ends of the speed limit information NI (second image) displayed on the near side overlaps with the area (second area FA) surrounded by two horizontal line segments passing through the upper and lower ends of the speed limit information FI (first image) displayed on the back side, and overlaps in the vertical direction between the images. Therefore, for example, Figure 8As shown in an example of a display method in (a), the control unit performs a second control (de-duplication control) to avoid repetition between images by moving the speed limit information (second image) displayed on the near front side along the virtual lane VL toward the virtual vanishing point VP downward and to the left within a prescribed range (for example, greater than 8° and less than 66°).

[0029] Thus, according to the fourth technical solution, the control unit displays the first image and the second image in a prescribed range (for example, greater than 8° and less than 66°) that can be visually observed by the occupant in such a manner that the first image and the second image are arranged along the virtual lane VL that simulates the foreground driving lane passing through the virtual vanishing point VP, and in this case, the first control (display change control) and the second control (repetition elimination control) are performed. Here, arranging each image along the virtual lane VL that passes through the virtual vanishing point VP is a method often used when it is desired to grasp the front-back relationship between images. Therefore, the first control (display change control) of changing the display position of the first image and / or the second image and / or changing the display method is performed on such images. Through this first control, if there is duplication between the images, the second control (repetition elimination control) of, for example, moving the second image that is desired to be visually observed on the near front side to the lower side is executed. In this way, by setting a difference in the display position in the up-down direction between the images, it is possible to ensure the grasp of the front-back relationship between the images.

[0030] In a fifth aspect dependent upon the first to fourth aspects, the control unit may avoid the overlap by performing control to move the second image to a lower side of the display area as viewed from the occupant in the second control.

[0031] According to the fifth technical solution, the control unit avoids duplication between images by the second control of moving the second image to the lower side of the display area when viewed from the occupant. This is because it is known that in the visual characteristics of humans, the closer the distance from the visual observer (occupant) to the visual observation object (the first image, the second image) is, the higher the depth discrimination ability is. Therefore, in a head-up display device that generates a virtual image forming surface (display area VA) inclined relative to the road surface, the lower side of the display area is closer to the occupant than the upper side (display distance). Therefore, it is more conducive for the occupant to grasp the front-back relationship between the images than moving the first image, which is an image desired to be viewed from the back side, to the upper side and moving the second image, which is desired to be viewed from the near front side, to the lower side.

[0032] In the sixth technical solution subordinate to the first to fifth technical solutions, the control unit can control the second image to move to the left or right side of the display area as viewed from the occupant in a manner such that the second image moves away from the center position of the display area, even when the second image is arranged in the lower area of ​​the display area by the first control and the duplication cannot be avoided by moving the second image to the lower side of the lower area by the second control.

[0033] Here, the "lower region" refers to, for example, Figure 1 As shown in (b), the display area VA is divided into two areas on the lower side by a boundary line (in the figure, a dashed line). For example, sometimes the second image cannot be moved downward due to the limitation of the display area of ​​the head-up display device such as a small display area in the vertical direction. In this case, the control unit can set a difference between the display positions of the first image and the second image by moving the second image to the left or right in a manner away from the center position of the display area. In this case, even if the difference in the display position in the vertical direction is small, the front-back relationship can be easily grasped by expanding the difference in the display position in the horizontal direction.

[0034] In the seventh technical solution belonging to the first to sixth technical solutions, the control unit can carry out control in the second control to cause the second image to move downward within a prescribed range visually observable by the occupant and / or to move to the left or right in a manner away from the center position of the display area in a manner along a virtual lane configuration simulating a virtual vanishing point of a linear perspective set on the inner side or the outer side of the display area.

[0035] For example, Figure 7 As shown in an example of the display method in (a), the vehicle speed limit information NI on the front side as the second image and the vehicle speed limit information FI displayed on the back side as the first image are arranged on the virtual lane VL. When these images leave the virtual lane VL, it may cause a sense of discomfort to the occupants. Therefore, the control unit, for example, Figure 8 As shown in an example of the display method in (a), the speed limit information NI displayed as the second image on the near front side along the virtual lane VL is controlled to move to the lower side of the display area VA and to the left side in a manner away from the center position. Therefore, according to the seventh technical solution, by moving each image on the virtual lane VL passing through the virtual vanishing point VP, it is possible to suppress the sense of discomfort caused to the occupants and easily grasp the front-back relationship between the images.

[0036] In the eighth technical solution belonging to the first to seventh technical solutions, the control unit can perform the first control and the second control when the position of the occupant's eyes in the height direction is below a prescribed reference position, and perform the first control when it is above the prescribed reference position.

[0037] Here, the "prescribed reference position" refers to, for example, the angular position of the concave mirror as a reflective component when the eye movement range is at the reference position. The concave mirror is connected to a driving unit, and the driving unit can rotate the concave mirror within a prescribed angle range according to the eye position of the occupant in the height direction set by the occupant or detected under the control of the control unit, thereby changing the arrival point of the display light in the windshield. That is, the position in the display area where the image (virtual image) is configured can be changed as the position of the eye movement range (the position of the eye in the height direction of the occupant) changes. Therefore, the control unit performs the first control on both the occupant with a shorter stature whose eye movement range position drops compared to the prescribed reference position and the occupant with a taller stature whose eye movement range position rises compared to the reference position. However, as a result of performing the first control, the occupant with a shorter stature whose eye movement range position drops produces duplication between images, so the second control is performed only on the occupant with a shorter stature to avoid duplication between images. Therefore, efficient duplication elimination control without performing useless control can be achieved.

[0038] In the 9th technical scheme belonging to the 1st technical scheme to the 8th technical scheme, the control unit can perform control so that the occupant can visually observe in a manner such that the upper end is inclined closer to the inner side than the lower end, when the end of the display area on the side close to the vehicle is set as the lower end and the end on the side away from the vehicle is set as the upper end.

[0039] According to the ninth technical solution, the control unit can use the upper end of the display area (for example, Figure 1 (b) The viewing angle of Up) is greater than that of the lower end (for example, Figure 1 The display area VA as an inclined virtual image imaging surface such as the inner side of the viewing angle Dn of (b) can improve the display of the expressiveness in the depth direction (the front and rear direction of the vehicle), and can more naturally realize the visual observation of the image with a sense of perspective. In addition, the display distance (imaging distance) can be adjusted according to the display position, and a display with a sense of depth can be realized in a relatively large range on the upper end side, so that the front and rear relationship between images can be easily grasped.

[0040] A tenth technical solution is a display control system, comprising: a head-up display device, which projects and displays one or more images in a display area virtually set in front of a vehicle in a manner overlapping with a foreground; and a processing device, which generates the images and arranges them in the display area, wherein the head-up display device has: a display unit, which projects a first image and a second image in the display area for display; and a control unit, which controls the first image to be arranged on the back side of the second image as viewed from the occupant and displayed on the display unit, the processing device performs a process of arranging the first image and / or the second image in the display area in a manner that makes the display position and / or display mode of the first image and / or the second image different when there is a change in the position of the eye of the occupant in the height direction set by the operation input of the occupant or detected, and when there is an overlap between the first image and the second image in the height direction, re-arranging the first image and / or the second image to avoid the overlap, and instructing the head-up display device to display the first image and the second image.

[0041] According to the tenth technical solution, when there is a change in the eye position of the occupant in the height direction set by the occupant's operation input or detected, the processing device performs a process of arranging the first image and / or the second image in the display area in a manner that makes the display position and / or display mode of the first image and / or the second image different (display change processing), and when duplication occurs between the first image and the second image in the height direction, re-arranging the first image and / or the second image to avoid duplication (duplication elimination processing), and instructing the head-up display device to display the first image and the second image. Therefore, when duplication occurs between images by the display change processing, it is difficult for the occupant to understand the front-back relationship between the images, but by performing a duplication elimination processing to move the second image that is desired to be visually observed at the near front side to the lower side, for example, to set a difference in the position in the upper-lower direction between the images, it is possible to provide a display control system that makes it easier for the occupant to understand the front-lower relationship between the images.

[0042] Those skilled in the art should be able to easily understand that the technical solutions of the present invention illustrated can be further modified without departing from the spirit of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 FIG. 1 is a diagram showing an example of application of the head-up display device according to the embodiment of the present invention to a vehicle. Figure 1 (a) is a diagram cited to illustrate the relationship between the eye position of the occupant in the height direction and the display area. Figure 1 (b) is a diagram cited to explain the relationship between the display area (virtual image forming surface) virtually set in front of the vehicle and the viewing angle.

[0044] Figure 21 is a block diagram showing a configuration of a vehicle control system to which the head-up display device according to the embodiment of the present invention is applied.

[0045] Figure 3 is a diagram showing a cross-sectional structure of a head-up display device according to an embodiment of the present invention, Figure 3 (a) indicates that the eye movement range is at the reference position. Figure 3 (b) indicates that the concave mirror as the reflecting component is moved from Figure 3 (a) The reference position is rotated counterclockwise.

[0046] Figure 4 1 is a flowchart showing the operation of the head-up display device according to the embodiment of the present invention.

[0047] Figure 5 1 is a diagram showing a way of viewing an image when viewing from the eye position (standard position) in the height direction of an occupant in the head-up display device according to the embodiment of the present invention. Figure 5 (a) is a diagram showing an example of the display method. Figure 5 (b) is a diagram showing an example of another display method.

[0048] Figure 6 FIG. 1 is a diagram showing a way of viewing an image when the eye position of an occupant in the height direction changes (is lowered from a standard position) in the head-up display device according to the embodiment of the present invention. Figure 6 (a) is a diagram showing an example of the display method. Figure 6 (b) is a diagram showing an example of another display method.

[0049] Figure 7 is a diagram showing a display mode when an overlap occurs in the vertical direction between images arranged in a display area as a result of the head-up display device according to an embodiment of the present invention performing the “first control”. Figure 7 (a) is a diagram showing an example thereof, Figure 7 (b) is a diagram showing another example. Figure 8 FIG. 1 is a diagram showing an example of a display mode when the head-up display device according to the embodiment of the present invention performs “second control”. Figure 8 (a) indicates Figure 7 In the case where the image shown in (a) is subjected to the "second control", Figure 8 (b) indicates Figure 7 The image shown in (b) is a case where the "second control" is performed.

[0050] Fig. 9This is a diagram showing an example of a display form when control is performed to move the second image from the center to the left side of the display area when the second image cannot be moved downward in the “second control” performed by the head-up display device according to the embodiment of the present invention.

[0051] Explanation of symbols

[0052] 100: head-up display device (HUD); 110: drive unit; 120: display unit; 120a: display surface; 121: light source; 122: liquid crystal display element; 141: concave mirror; 160: control unit; 200: vehicle-mounted sensing device; 300: driving assistance device; 400: navigation device; 500: operation input device; 1000: vehicle control system (display control system); V: virtual image; VA: display area; LS: speed limit sign; LI: speed limit information; LA: display area for speed limit information (first area); CF: front vehicle; CI: front vehicle following information ; CA: display area for the vehicle following information ahead (second area); NS: speed limit sign on the approaching side; NI: speed limit information on the approaching side (first image); NA: display area for the speed limit information on the approaching side (first area); FS: speed limit sign on the departing side; FI: speed limit information on the departing side (second image); FA: display area for the speed limit information on the departing side (second area); WL: driving lane; VP: virtual vanishing point; VL: virtual lane toward the virtual vanishing point; AL: virtual lane passing through the center of the driving lane. DETAILED DESCRIPTION

[0053] The best embodiment described below is used to facilitate understanding of the present invention. Therefore, those skilled in the art should note that the present invention is not improperly limited to the embodiment described below (hereinafter referred to as the present embodiment).

[0054] Hereinafter, a vehicle control system 1000 to which the head-up display device according to the present embodiment is applied will be described with reference to the drawings by way of example.

[0055] (Structure of Embodiment)

[0056] Figure 1 1 is a diagram showing an example of application of a head-up display device (hereinafter referred to as HUD device 100 ) according to the present embodiment to a vehicle 10 . Figure 1 (a) is a diagram cited to explain the relationship between the position of the eye of the occupant 14 in the height direction and the display area VA. Figure 1 (b) is a diagram cited to explain the relationship between the display area VA (virtual image forming surface) virtually set in front of the vehicle 10 and the viewing angle AV.

[0057] like Figure 1 As shown in (a) of FIG. 1 , the projection display of the HUD device 100 is to display an image (virtual image V) by reflecting the display light L projected by the HUD device 100 installed inside the instrument panel 11 of the vehicle 10 through the windshield 13 of the vehicle 10 toward the passenger 14 of the vehicle 10 (the driver sitting in the driver's seat of the vehicle 10). In other words, the HUD device 100 displays the image (virtual image V) from the display unit (described later). Figure 2 The display light L (image) emitted by the vehicle 120 is projected onto the windshield 13 as a projection component, and the passenger 14 visually observes the display light L (image) based on the projection. As a result, the passenger 14 can visually observe the image (virtual image V) by overlapping it with the scene in front of the vehicle 10.

[0058] In this case, the HUD device 100 projects the display light L with a slope of 45° or less (0° to 45°) relative to the road surface on which the vehicle 10 is traveling, so that the upper portion of the image (virtual image V) is tilted more toward the side away from the occupant 14 than the lower portion. As a result, the occupant 14 can mainly visually observe the image (virtual image V) displayed superimposed on the road surface on the front side of the vehicle 10, and can obtain various information represented by the content of the image.

[0059] In addition, the HUD device 100 sets an angle of view AV. If the virtual range in the space where an image (virtual image V) can be formed is set as the virtual image forming surface (display area VA) in the HUD device 100, the angle of view AV is a viewing angle defined by a virtual line connecting the viewpoint EP of the occupant 14 (the center of the eye movement range as the viewing angle defined by the virtual line connecting the eye of the occupant and the outer edge of the display area VA) and the outer edge of the display area VA. The angle of view AV is an angle range in which the image (virtual image V) can be visually observed by the occupant 14 from the viewpoint EP.

[0060] like Figure 1 As shown in (b), in the HUD device 100, the horizontal viewing angle in the horizontal direction (for example, about 10 to 12 degrees) is set larger than the vertical viewing angle in the vertical direction (for example, about 4 to 5 degrees). When observed from the viewpoint EP, the front range overlapping with the display area VA as the virtual image forming surface becomes the range of the viewing angle AV. The display area VA corresponds to the display surface 120a of the HUD device 100 described later (in other words, the display area VA and the display surface 120a of the display unit 120 described later are in a conjugate relationship), and the image (virtual image V) visually observed in the display area VA corresponds to the image projected on the display surface 120a of the HUD device 100.

[0061] A display area VA is set on the display surface 120a of the display unit 120, and an image (virtual image V) is displayed in the display area VA. In addition to foreground objects such as traffic signs or a front vehicle (not shown) or a driving lane, which are real scenes in front of the vehicle 10, the image (virtual image V) also includes virtual images such as speed limit information or virtual lanes drawn in line perspective that simulate the driving lane as information related to the foreground object. In addition, "line perspective" is a method of expressing the perspective of a visually observed object becoming smaller as it moves away from the near side to the inside by lines, and is typically a method of expressing a perspective drawing using convergent parallel lines. Figure 1 In (b), for example, a virtual vanishing point VP is set at a horizon line (not shown), and parallel line segments extending from the near side to the back side are drawn so as to converge at the virtual vanishing point VP at an infinite point in principle.

[0062] exist Figure 1 In (b), the longitudinal direction of the display unit 120 is set as the vertical viewing angle, and the lateral direction is set as the horizontal viewing angle. In the display area VA, the area between the upper end Up and the lower end Dn of the viewing angle AV is divided into two by a boundary line (a dashed line in the figure), and the lower side (the side that is closer when viewed from the occupant 14) of the divided area can be set as the "near front side", and the upper side (the side that is farther away when viewed from the occupant 14) can be set as the "back side". In addition, the boundary line is an example and is not limited to this.

[0063] Figure 2 1 is a block diagram showing a configuration example of a vehicle control system 1000 to which the HUD device 100 according to the present embodiment is applied.

[0064] like Figure 2 As shown, the vehicle control system 1000 includes a HUD device 100, an in-vehicle sensor device 200, a driving assistance device 300, a navigation device 400, and an operation input device 500. These can bidirectionally transmit information via a CAN (Control Area Network) 600 as an in-vehicle LAN.

[0065] The vehicle-mounted sensing device 200 is a sensor type required to recognize the driving environment of the vehicle 10 including the surroundings in front, including a camera or LiDAR (Light Detection And Ranging). In addition, it also includes an IMU (Inertial Measurement Unit) or a vehicle speed sensor for detecting the behavior of the vehicle 10. The information recognized or detected by the vehicle-mounted sensing device 200 is transmitted to the driving assistance device 300, the navigation device 400, and the HUD device 100 of this embodiment via the CAN 600.

[0066] In addition, the camera at least captures the front view (real scene) of the vehicle 10, and LiDAR uses near-infrared light, visible light, or ultraviolet light, for example, to illuminate obstacles in front of the vehicle 10 captured by the camera, and uses a light sensor to capture the reflected light, and determines the distance to the obstacle based on the time difference. IMU can use a 3-axis acceleration sensor and a 3-axis angular velocity sensor (gyro sensor) to measure the driving condition or posture of the vehicle (based on the acceleration [m / s 2 ] detects translational motion in the three-axis direction and rotational motion based on the angular velocity [deg / s]).

[0067] The driving assistance device 300 has at least one of the driving assistance functions based on ADAS (Advanced Driver-Assistance System) such as LKAS (Lane Keeping Assist System) and ACC (Adaptive Cruise Control System) that assist the driving operation of the occupant 14 as a visual observer, and the automatic driving function that can replace the driver's driving operation. In addition, the driving assistance device 300 can recognize or detect the driving environment and behavior in front of the vehicle 10 based on the information obtained from the vehicle-mounted sensing device 200, and control the vehicle 10 (the driving system, braking system, and steering system not shown) according to the analysis results of the information obtained here, and transmit the analysis results of these information to the HUD device 100, the navigation device 400, etc. via the CAN 600.

[0068] The navigation device 400 uses a global satellite navigation system (GNSS: Global Navigation Satellite System) or a gyro sensor (GPS or other sensor 402), and the information processing unit 401 obtains map information from the map DB 404 or through wireless communication with the outside of the vehicle to provide a peripheral facility guide or route guide for the vehicle 10. The navigation device 400 transmits a signal outputted by a reminder display to the HUD device 100 via the CAN 600 at an appropriate time according to the guide information.

[0069] The information processing unit 401 performs information processing such as destination or facility search and guidance based on the location information of the vehicle obtained from the vehicle-mounted sensing device 200, the driving assistance device 300, the operation input device 500, and the built-in sensors such as GPS or gyro sensors (GPS and other sensors 402). Moreover, based on the result of the information processing, for example, when it is detected that the vehicle is approaching an intersection where it should turn, a virtual image V such as an arrow indicating a right turn or a left turn at the intersection is generated and transmitted to the HUD device 100. In order to control the position of the above-mentioned eye movement range, the information processing unit 401 also controls the concave mirror 141 (see FIG. 1 ) as a reflective component of the HUD device 100 described later. Figure 3 The drive signal for controlling the rotation of (a) (b)) is output via CAN600.

[0070] The information processing unit 401 outputs a display instruction to the HUD device 100 when there is a change in the eye position of the occupant 14 in the height direction set by the operation input of the occupant 14 or detected. Then, the HUD device 100 that has received the display instruction arranges the display position or display method of the first image or the second image in the display area VA in a manner that makes the display position or display method of the first image or the second image different, and when there is an overlap between the first image and the second image in the vertical direction, re-arranges the first image or the second image to avoid the overlap, and displays the first image and the second image. In addition, the HUD device 100 may perform a process of arranging the display position or display method of the first image and the second image in the display area VA in a manner that makes the display position or display method of the first image and the second image different, and when there is an overlap between the first image and the second image in the vertical direction, re-arranges the first image and the second image to avoid the overlap, and displays the first image and the second image.

[0071] Here, when the lower side (the side that is felt as the near front side when viewed from the occupant) of the display area VA virtually set in front of the vehicle 10 is set as the near front side, and the upper side (the side that is felt as the back side when viewed from the occupant) is set as the back side, the “first image” projected and displayed by the display unit 120 is, for example, as shown in FIG. Figure 5 As shown in an example of the display method in (a), the speed limit information NI is displayed on the near front side, and the second image is the speed limit information FI displayed on the back side. In addition, the "position of the eyes in the height direction of the occupant" can be determined based on, for example, the angle information of the reflective component (concave mirror 141) of the HUD device 100 set by the occupant 14, or can be determined by performing image recognition on the shooting information obtained by the camera (on-vehicle sensing device 200) of the vehicle 10.

[0072] In addition, the "first control" configures the first image and / or the second image in the display area VA in a manner that makes the display position and / or display method different according to the position of the eyes of the occupant 14 in the height direction, but here, "displaying in a manner that makes the display position different" means, for example, when the position of the eyes of the occupant 14 in the height direction is changed according to the height of the occupant 14, the position of the first image and / or the second image is moved to the inner side or near the front side of the display area VA that is conjugate with the display surface 120a of the display unit 120 according to the amount of change. In addition, "displaying in a manner that makes the display method different" means, for example, display change control that makes the size, number, brightness, color, clarity, etc. of display elements such as text or decorations constituting the first image (or the second image) different according to the first image and the second image.

[0073] In addition, the “second control” is to reconfigure the first image or the second image to avoid duplication when duplication occurs in the vertical direction between the first image and the second image due to the first control. Here, “duplication” means, for example, a first area (for example, in the vertical direction) in the display area VA surrounded by two horizontal line segments passing through the upper end and the lower end of the first image. Figure 7 In an example of a display method shown in (a), a display area NA in the vertical direction of the speed limit information NI located on the approaching side overlaps (overlaps) with at least a portion of a second area in the display area surrounded by two horizontal line segments passing through the upper and lower ends of the second image (a display area FA in the vertical direction of the speed limit information FI located on the departing side) in the vertical direction.

[0074] In addition, "reconfiguration" means, for example, performing a duplication elimination control such as moving the first image that the occupant 14 desires to visually observe at the back side to the upper side of the display area VA or moving the second image that the occupant 14 desires to visually observe at the near front side to the lower side of the display area VA. However, it is known that in human visual characteristics, the closer the distance from the visual observer (the occupant 14) to the visual observation object (the first image and the second image) is, the higher the depth discrimination ability is. Therefore, in the HUD device 100 that generates a virtual image forming surface (the display area VA) inclined relative to the road surface, the lower side of the display area VA is closer to the occupant than the upper side (display distance). Therefore, it is more convenient for the occupant 14 to grasp the front-back relationship between the images than moving the first image that is the image that is desired to be visually observed at the back side to the upper side and moving the second image that is desired to be visually observed at the near front side to the lower side.

[0075] The storage unit 403 is a memory allocated with a program area and a work area, for example, a static RAM, a dynamic RAM, or a flash memory. Here, in the program area, for example, various programs required for destination or facility search and guidance required for navigation are written, and in the work area, information generated during the execution of the above various programs or display information including images to be displayed on the HUD device 100 are allocated and temporarily written.

[0076] In addition, the navigation device 400 has a map database (map DB404). Map DB404 can obtain and store the latest map information, for example, by communicating with an external center (not shown) via a V2X (Vehicle to X) type communication system (not shown). Here, the map information stored in map DB404 is mapping data that is digitized in a manner that represents the driving environment of the vehicle 10. As mapping data, high-precision dynamic mapping digital data is particularly preferred. "Dynamic mapping" refers to a digital map that combines huge dynamic information that changes all the time, such as traffic rules or engineering information, accidents or traffic jams, pedestrians or signal information, and static information such as high-precision three-dimensional position information (road surface information, oblique line information, three-dimensional structures).

[0077] The operation input device 500 is, for example, a switch disposed near a steering wheel (steering handle). The operation input device 500 is operated by the occupant 14 as a visual observer to switch the HUD device 100 on / off, select the execution function of the driving assistance device 300 such as LKAS and ACC that executes ADAS, set the air volume of the air conditioner, and set the instruction of the driving unit 110 (see Figure 3 (a)(b)) performs setting information (position of the eye movement range) on the rotation action of the reflecting component (concave mirror 141), etc.

[0078] The HUD device 100 includes a driving unit 110 , a display unit 120 , and a control unit 160 .

[0079] The drive unit 110 and the concave mirror 141 (see Figure 3 The concave mirror 141 is connected to (a)(b) and can rotate to a predetermined angle position according to a control signal generated by the control unit 160. The rotation position of the concave mirror 141 in the HUD device 100 has several steps and can be adjusted within this range. The concave mirror 141 uses a stepping motor for the rotation drive and can rotate a predetermined number of steps corresponding to the position (setting information) of the eye movement range set by the operation of the operation input device 500.

[0080] The driving unit 110 controls the angular fixed position of the concave mirror 141 by using a rotation driving mechanism of a stepping motor. Therefore, as an angular range set on the concave mirror 141, a predetermined number of steps can be set in the clockwise direction and the counterclockwise direction with the reference position as the center.

[0081] The display unit 120 is mainly composed of a light source 121 composed of a light emitting diode mounted on a wiring substrate, and a TFT (Thin Film Transistor Liquid Crystal) type liquid crystal display element 122 located on the emission side (just above) of the light source 121 in such a manner that the illumination light from the light source 121 is transmitted to form display light L. This means that the light source 121 is provided behind the liquid crystal display element 122, and the liquid crystal display element 122 displays a predetermined image using the light emitted from the light source 121.

[0082] The display unit 120 has a display surface 120a (see Figure 3 (a)(b)), a display light L consisting of light in the visible light band is output, for example, a light source 121 emitting white light can be applied, and the light emitted from the light source 121 is transmitted through the liquid crystal display element 122 to output the display light L containing the desired image. The liquid crystal display element 122 forms the desired image based on the display image data (driving signal) generated by the rendering operation performed by the control unit 160.

[0083] The control unit 160 can display an image to be displayed, for example, not only a guide image such as the driving lane WL, but also a speed or remaining energy of the vehicle 10, time, and a route guide image on the display unit 120 (liquid crystal display element 122) using image data such as numerical values ​​or icons based on the vehicle information transmitted from the driving assistance device 300 or the navigation device 400. In addition, the image to be displayed is not limited to the vehicle information such as the speed or remaining energy of the vehicle, and all display methods can be used.

[0084] The control unit 160 outputs a drive signal for the reminder display to the liquid crystal display element 122 in a manner visually observed by the occupant 14 as a visual observer, based on image information generated and transmitted by the information processing unit 401 of the navigation device 400 or the driving assistance device 300. In addition, the control unit 160 is also connected to the light source 121 of the transmissive illumination liquid crystal display element 122, and can turn it on, turn it off, or adjust the brightness by outputting a drive signal.

[0085] The control unit 160 can control the display position of the image (virtual image) to be visually observed, for example, according to the setting information related to the position of the eye movement range obtained by the passenger 14 as the visual observer by operating the operation input device 500. Specifically, according to the setting information related to the position of the eye movement range, the angle of the reflective component (concave mirror 141) adjusted by the drive unit 110 is rotationally adjusted. And, when the angle is different from the reference position, the display position of the virtual image V (image) relative to the display area VA is changed according to the adjusted angle.

[0086] Here, the "reference position" refers to the angular position of the concave mirror 141 when the eye movement range is at the reference position. The concave mirror 141 is connected to the drive unit 110, and the drive unit 110 can rotate the concave mirror 141 within a predetermined angular range according to the eye position of the occupant 14 in the height direction set by the occupant 14 or detected under the control of the control unit 160, thereby changing the arrival point of the display light L in the windshield 13. That is, the position in the display area VA where the image is arranged can be changed as the position of the eye movement range (the eye position of the occupant in the height direction) changes.

[0087] The control unit 160 controls the display unit 120 to arrange the first image on the back side of the second image as viewed from the occupant 14. At this time, the control unit 160 may perform a "first control" to arrange the first image or the second image in the display area VA in a manner that makes the display position or display method different according to the eye position of the occupant 14 in the height direction, and perform a "second control" to re-arrange the first image or the second image to avoid repetition when overlap occurs between the first image and the second image in the vertical direction through the first control. In addition, the control unit 160 may also perform a "first control" to arrange the first image and the second image in the display area VA in a manner that makes the display position or display method different according to the eye position of the occupant in the height direction, and perform a "second control" to re-arrange the first image and the second image to avoid repetition when overlap occurs between the first image and the second image in the vertical direction through the first control.

[0088] Here, when the lower side (the side that is felt as the near front side when viewed from the occupant) of the display area VA virtually set in front of the vehicle 10 is set as the near front side, and the upper side (the side that is felt as the back side when viewed from the occupant) is set as the back side, the “first image” projected and displayed by the display unit 120 is, for example, as shown in FIG. Figure 5As shown in an example of the display method in (a), the speed limit information NI is displayed on the near front side, and the second image is the speed limit information FI displayed on the back side. In addition, the "position of the eyes in the height direction of the occupant" can be determined based on, for example, the angle information of the reflective component (concave mirror 141) of the HUD device 100 set by the occupant 14 or the shooting information obtained by using the camera (vehicle-mounted sensing device 200) of the vehicle 10.

[0089] In addition, the "first control" configures the first image and / or the second image in the display area in a manner that makes the display position and / or display method different according to the position of the eye of the occupant 14 in the height direction, but here, "displaying in a manner that makes the display position different" means, for example, when the position of the eye of the occupant in the height direction is changed according to the height of the occupant 14, etc., the display change control is performed to move the position of the first image and / or the second image to the inner side or near the front side of the display area VA that is conjugate with the display surface 120a of the display unit 120 according to the amount of change. In addition, "displaying in a manner that makes the display method different" means, for example, display change control is performed to display the size, number, brightness, color, clarity, etc. of display elements such as text or decorations constituting the first image and the second image in a manner different from that of the first image and the second image.

[0090] In addition, the "second control" is to reconfigure the first image or the second image to avoid duplication when duplication occurs in the vertical direction between the first image and the second image due to the first control, but here, "duplication" means, for example, a first area (for example, in the first area) in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the first image, respectively. Figure 7 In an example of a display method shown in (a), a display area NA in the vertical direction of the speed limit information NI located on the approaching side overlaps (overlaps) with at least a portion of a second area in the display area surrounded by two horizontal line segments passing through the upper and lower ends of the second image (a display area FA in the vertical direction of the speed limit information FI located on the departing side) in the vertical direction.

[0091] In addition, "reconfiguration" means, for example, performing a duplication elimination control such as moving the first image that the occupant 14 desires to visually observe at the back side to the upper side of the display area VA or moving the second image that the occupant 14 desires to visually observe at the near front side to the lower side of the display area VA. However, it is known that in human visual characteristics, the closer the distance from the visual observer (the occupant 14) to the visual observation object (the first image and the second image) is, the higher the depth discrimination ability is. Therefore, in the HUD device 100 that generates a virtual image forming surface (the display area VA) inclined relative to the road surface, the lower side of the display area VA is closer to the occupant than the upper side (display distance). Therefore, it is more convenient for the occupant 14 to grasp the front-back relationship between the images than moving the first image that is the image that is desired to be visually observed at the back side to the upper side and moving the second image that is desired to be visually observed at the near front side to the lower side.

[0092] The control unit 160 may control the first area (for example, in the first area) of the display area VA surrounded by two horizontal line segments passing through the upper end and the lower end of the first image. Figure 7 In an example of a display method shown in (a), when there is overlap between a display area NA in the vertical direction of the speed limit information NI located on the approaching side and a second area in the display area VA surrounded by two horizontal line segments passing through the upper and lower ends of the second image, respectively (a display area FA in the vertical direction of the speed limit information FI located on the departing side), "second control" is performed.

[0093] The control unit 160 may perform the first control and the second control when the first image and the second image are images related to the foreground in front of the vehicle 10 .

[0094] The control unit 160 may set the inner side or the outer side of the display area VA, for example Figure 5 The first image (NI) and the second image (FI) are displayed within a predetermined range (for example, 8° or more and less than 66°) that can be visually observed by the occupant 14 in such a manner that the first image (NI) and the second image (FI) are arranged along a virtual vehicle line VL that simulates a foreground driving lane WL passing through the virtual vanishing point VP, and in this case, the "first control" and the "second control" are performed.

[0095] Here, the "virtual vanishing point VP" refers to, for example, the point where two or more originally parallel lines intersect when drawn non-parallel in the linear perspective method, and is the line of sight direction when the occupant 14 as a visual observer observes in a manner of looking inward. In addition, the "prescribed range" refers to a value determined by a threshold value of whether the occupant 14 can visually observe that each image (the first image and the second image) is arranged along the road surface, and is a value obtained by experiment or simulation. For example, Figure 5 As shown in an example of the display method in (a), the slope of the virtual lane VL simulating the driving lane WL is 35°, and the two speed limit information (NI, FI) as the first image and the second image are also arranged in a manner with a slope of 35°. However, when the two images (speed limit information NI, FI) are arranged in a vertical manner, that is, when the two speed limit information (NI, FI) are arranged in a manner with a slope of 90°, the occupant 14 cannot visually observe that the images are arranged along the road surface. Therefore, the "prescribed range" is a range of values ​​set so that such an arrangement is not performed, for example, greater than 8° and less than 66°.

[0096] The control unit 160 can avoid duplication by controlling the second image to move to the lower side of the display area VA from the perspective of the occupant 14 in the "second control". This is because it is known that in human visual characteristics, the closer the distance from the visual observer (occupant) to the visual observation object (first image, second image) is, the higher the depth discrimination ability is. Therefore, in the HUD device 100 that generates a virtual image imaging surface (display area VA) inclined relative to the road surface, the lower side of the display area VA is closer to the occupant than the upper side (display distance). Therefore, it is more conducive for the occupant 14 to grasp the front-back relationship between the images than to move the first image, which is an image desired to be visually observed at the back side, to the upper side and to move the second image, which is desired to be visually observed at the near front side, to the lower side.

[0097] Furthermore, even if the second image is arranged in the lower area of ​​the display area VA by the "first control", when the second image cannot be avoided by moving the second image to the lower side of the lower area by the "second control", the control unit 160 may control the second image to move to the left or right side of the display area VA as viewed from the occupant 14 so as to move away from the center position of the display area VA. Here, the "lower area" refers to, for example, Figure 1 As shown in (b), the display area VA is divided into two by a boundary line (in the figure, a dot-dash line), thereby dividing the display area VA into two areas on the lower side.

[0098] In addition, the control unit 160 can perform a control in which, in the "second control", the second image is configured along a virtual lane VL of a driving lane WL that simulates a line perspective method passing through a virtual vanishing point VP set on the inner side or outer side of the display area VA, and moves downward within a specified range (for example, greater than 8° and less than 66°) that can be visually observed by the occupant 14, or moves to the left or right side in a manner away from the center position of the display area VA.

[0099] In addition, the control unit 160 may also control the second image to move downward within a predetermined range (e.g., 8° or more and less than 66°) that can be visually observed by the occupant 14 in a manner arranged along the virtual vehicle line VL, and to move to the left or right in a manner away from the center position of the display area VA. For example, sometimes the second image cannot be moved downward due to the limitation of the display area VA of the HUD device 100 such as the display area VA being small in the up and down direction. In this case, the control unit 160 can set a difference between the display positions of the first image and the second image by moving the second image to the left or right in a manner away from the center position of the display area VA.

[0100] Furthermore, the control unit 160 may perform the “first control” and the “second control” when the position of the eye of the occupant 14 in the height direction is below a predetermined reference position, and perform the “first control” when it is above the predetermined reference position.

[0101] Here, the "predetermined reference position" refers to the angular position of the concave mirror 141 when the eye movement range is at the reference position. The concave mirror 141 is connected to the drive unit 110, and the drive unit 110 can rotate the concave mirror 141 within a predetermined angle range according to the eye position of the occupant 14 in the height direction set by the occupant 14 or detected under the control of the control unit 160, thereby changing the arrival point of the display light in the windshield. That is, the position in the display area where the image (virtual image) is arranged can be changed as the position of the eye movement range (the position of the eye in the height direction of the occupant) changes. Therefore, the control unit 160 performs the first control on both the occupant with a shorter stature whose eye movement range position is lowered compared to the predetermined reference position and the occupant with a taller stature whose eye movement range position is raised compared to the reference position. However, as a result of performing the first control, the occupant with a shorter stature whose eye movement range position is lowered generates duplication between images, so the second control is performed only on the occupant with a shorter stature to avoid duplication between images.

[0102] In addition, the control unit 160 can control the display so that the occupant 14 can visually observe the display in a manner that the upper end is tilted to the inner side than the lower end, when the end of the display area VA on the side close to the vehicle 10 is set as the lower end (Dn of the viewing angle) and the end on the side away from the vehicle 10 is set as the upper end (Up of the viewing angle). The control unit 160 can perform a display that improves the expressiveness in the depth direction (the front-rear direction of the vehicle) by using the display area VA as an inclined virtual image imaging surface with the upper end being closer to the inner side than the lower end, and can realize the visual observability of the image with a sense of perspective more naturally.

[0103] exist Figure 3 , the internal structure of the HUD device 100 of this embodiment is shown in a rough cross-sectional view. Figure 3 (a) shows the cross-sectional structure when the eye movement range is at the reference position. Figure 3 (b) indicates that the concave mirror as the reflecting component is moved from Figure 3 The cross-sectional structure when the reference position of (a) is rotated counterclockwise.

[0104] according to Figure 3 In (a) and (b), the HUD device 100 is mainly composed of a display unit 120 , a first reflector 130 , a second reflector 140 , and a housing 150 .

[0105] The display unit 120 has a display surface 120a, and outputs display light L composed of light in the visible light band. For example, a light source 121 that emits white light can be used, and the light emitted from the light source 121 is transmitted through the liquid crystal display element 122 to output the display light L containing a desired image. The liquid crystal display element 122 forms a desired image based on display image data (driving signal) generated by the rendering operation performed by the control unit 160.

[0106] The first reflector 130 includes a cold mirror 131. The cold mirror 131 reflects light in the visible light band (450 to 750 nm) including the light emitting band of the display unit 120 at a high reflectivity of, for example, 80% or more, and reflects light outside the visible light band at a low reflectivity. In this case, the cold mirror 131 is a cold mirror that reflects light outside the visible light band, especially in the infrared band (heat rays from external light such as sunlight), at a low reflectivity of, for example, 15% or less. In addition, light that is not reflected by the reflective layer of the cold mirror 131 is configured to pass through the cold mirror 131. The cold mirror 131 can prevent the liquid crystal display element 122 from being heated by sunlight or the like and from becoming hot.

[0107] The second reflector 140 includes a concave mirror 141 as a reflecting member that reflects the display light L from the cold mirror 131 (that is, the liquid crystal display element 122 ) and a mirror holder 142 that holds the concave mirror 141 .

[0108] The concave mirror 141 has a second reflective layer 141a formed by vapor deposition on a resin substrate made of polycarbonate having a concave surface. The second reflective layer 141a of the concave mirror 141 faces the cold mirror 131 and the translucent cover 153 and is provided at an inclined position facing the translucent cover 153 .

[0109] The concave mirror 141 amplifies the display light L from the cold mirror 131 and reflects (projects) it toward the translucent cover 153 (windshield 13 of the vehicle 10). This means that the concave mirror 141 amplifies the display light L reflected by the cold mirror 131, and projects the amplified display light L through the translucent cover 153 toward the windshield 13. In addition, the concave mirror 141 is bonded to the mirror holder 142 by a double-sided adhesive member. The mirror holder 142 is made of a synthetic resin such as ABS (Acrylonitrile Butadiene Styrene) and is fixed to the housing 150.

[0110] The concave mirror 141 is connected to the driving unit 110 and can rotate within a predetermined angle range according to the situation. As a result, the arrival point of the display light (L) in the windshield 13 can be changed. That is, the position of the eye movement range of the HUD device 100 changes. As a result, the position of the eye in the height direction for the visual observer 14 to visually observe the image and the display position in the display area VA where the image is displayed can be changed.

[0111] Here, the lower the position of the eye movement range, the higher the display position of the image (virtual image V) in the display area VA. This means that the angle formed by two straight lines, namely, the straight line parallel to the road surface and the straight line connecting the eyes of the occupant 14 and the image (virtual image V) based on the position of the eyes in the height direction of the occupant 14 as a visual observer, i.e., the depression angle, changes in a decreasing direction. On the other hand, the higher the position of the eye movement range, the lower the display position of the image in the display area VA. This means that the angle formed by two straight lines, namely, the straight line parallel to the road surface and the straight line connecting the eyes of the occupant 14 and the image (virtual image V) based on the position of the eyes in the height direction of the occupant 14 as a visual observer, i.e., the depression angle, changes in a increasing direction.

[0112] In other words, when Figure 3 When the concave mirror 141 in the reference position shown in (a) rotates clockwise, Figure 3 As shown in (b) of FIG. 1 , the position of the eye movement range becomes lower, and conversely, when rotating in the counterclockwise direction, the position of the eye movement range becomes higher. In addition, since the depression angle is uniquely determined according to the position of the eye movement range by a prescribed calculation formula, it is equivalent to calculating the display position of the image by the position of the eye movement range and calculating the display position of the image in the display area VA by the depression angle.

[0113] The outer shell 150 is made of, for example, a black light-shielding synthetic resin material and is formed into a roughly box-shaped shape. The projection unit composed of the display unit 120, the first reflector 130, and the second reflector 140 is held and accommodated in a space portion 151 which serves as its internal space. The outer shell 150 has an opening window portion 152 which is opened at the upper portion (on the windshield 13 side) of the concave mirror 141 of the second reflector 140.

[0114] In addition, a translucent cover 153 as an emission portion is provided on the housing 150 so as to block the opening window portion 152. The translucent cover 153 is formed into a curved shape (curved surface shape) using a translucent synthetic resin material (e.g., acrylic resin), and has a function as a light-transmitting member that transmits (passes) the display light L reflected by the concave mirror 141. That is, the display light L reflected by the cold mirror 131 and the concave mirror 141, that is, the display light L output by the projection portion passes through the translucent cover 153 formed on the housing 150 and is projected onto the windshield 13, thereby displaying an image.

[0115] In addition, the HUD device 100 projects the output display light L (image) toward the lower side of the windshield 13. Therefore, when observing from the side of the passenger 14 as a visual observer, the image can be observed from the lower area of ​​the windshield 13 in a manner overlapping with the foreground object of the vehicle 10. Therefore, the passenger 14 as a visual observer mainly observes the image displayed on the road surface near the vehicle 10. In addition, due to the structure of the projection unit of the HUD device 100, the output image is observed to be tilted in a manner that the upper part of the output image is closer to the inner side of the vehicle 10 than the lower part.

[0116] (Operation of Implementation Method)

[0117] Figure 4 : is a flowchart showing the operation of the HUD device 100 according to this embodiment. Figures 5 to 9 This is a diagram showing an example of a display method in which one or more images (NI, FI, VL, etc.) are projected and displayed in a manner overlapping with a foreground (FS, CF, etc.) of an actual scene in front of the vehicle 10 in the HUD device 100 of the present embodiment on a display area VA virtually set in front of the vehicle 10. Specifically, Figure 5 (a) shows an example of an observation method (display method) of an image when observing from the position of the eye in the height direction of the occupant 14 (standard position), Figure 5 (b) shows another example of display method. Figure 6 (a) shows an example of an observation method (display method) of an image when the position of the eye of the occupant 14 in the height direction changes (the standard position becomes lower), Figure 6(b) shows an example of another display method.

[0118] in addition, Figure 7 (a) shows an example of a display mode when the HUD device 100 of the present embodiment performs display change control ("first control") and overlaps images arranged in the display area VA in the vertical direction. Figure 7 (b) shows another example of display method. Figure 8 (a) shows the HUD device 100 of this embodiment. Figure 7 An example of a display method when the image shown in (a) is subjected to deduplication control ("second control"), Figure 8 (b) indicates Figure 7 An example of a display method when the image shown in (b) is subjected to duplicate elimination control ("second control"). Fig. 9 An example of a display mode is shown in which control is performed to move the second image from the center of the display area VA to the left when the second image cannot be moved downward in the de-duplication control ("second control") performed by the HUD device 100 of the present embodiment.

[0119] Below, while referring to Figures 4 to 9 , while explaining Figure 2 The operation of the HUD device 100 according to the present embodiment is shown.

[0120] First, the information processing unit 401 of the navigation device 400 generates an image to be displayed on the HUD device 100 of the present embodiment (step S101), and outputs a display instruction together with the generated image to the HUD device 100. Here, the generated image includes, for example, a foreground object (e.g., Figure 5 (a) Speed ​​limit sign NS, FS or Figure 5 (b) the information about the preceding vehicle CF, etc.), that is, the speed limit information (for example, Figure 5 (a) NI, FI) or the vehicle ahead following information (e.g. Figure 5 (b) CI), or an image of navigation information.

[0121] In addition, the speed limit information NI, FI or the front vehicle following information CI can be generated by the driving assistance device 300. The navigation information is information including the surrounding facility guide or the route guide generated by the navigation device 400 (information processing unit 401). In addition, vehicle information such as vehicle speed, engine speed, remaining gasoline, various warnings, or general information such as time and outside temperature is also generated as an image (virtual image V) and displayed on the HUD device 100 of this embodiment.

[0122] Figure 5 1 is a diagram showing how an image is observed when the image is observed from the eye position (standard position) in the height direction of the occupant 14 in the HUD device 100 of the present embodiment. Figure 5 (a) is an example of a display method in which the approaching speed limit information NI and the departing speed limit information FI are generated as images (virtual images V) and displayed in the display area VA of the HUD device 100. The vehicle 10 first travels on a road with a 40 km / h speed limit sign NS, and then travels on a road with a 60 km / h speed limit sign FS. Therefore, it is preferred that the images of the two speed limit information NI and FI are arranged along the road surface, and these images are displayed in a manner that allows the chronological relationship between the images to be understood.

[0123] according to Figure 5 In one example of a display method shown in (a), a virtual vanishing point VP of line perspective is set inside the display area VA, and two speed limit information NI and FI are arranged on a virtual lane VL simulating a driving lane WL toward the virtual vanishing point VP. Here, the virtual vanishing point VP is set so that the virtual lane VL toward the virtual vanishing point VP has the same slope (rising angle) as the virtual lane AL passing through the center of the driving lane WL (white line image) in the real world. As a result, the occupant 14 can visually observe that each image (speed limit information NI, FI) is arranged along the road surface.

[0124] In addition, each image can be arranged at a position offset from the virtual lane VL, but if the offset from the virtual lane VL is large, the relevance of each image to the road surface will be low, and it may be visually observed that each image is not along the road surface. Therefore, it is necessary to arrange each image within a predetermined range from the virtual lane VL.

[0125] Here, the "predetermined range" is determined based on a threshold value of whether the occupant 14 can visually observe that each image is arranged along the road surface, and is a value set based on experiments or simulations. For example, Figure 5 The virtual vehicle lines VL and AL in (a) have a slope of 35°, and the two speed limit information NI and FI are arranged in a manner of also having a slope of 35°. However, when the two images (speed limit information NI and FI) are arranged in a manner of being perpendicular, that is, when the images are arranged in a manner of being ...

[0126] For the same reason, the two virtual lanes VL and AL may also be at different angles, but the difference in the slopes of the two virtual lanes VL and AL needs to be less than a predetermined value. In addition, the virtual vanishing point VP may be set outside the display area VA of the HUD device 100. In addition, a method of expression may be used in which the virtual lane VL simulating the driving lane WL (white line image) is generated in a manner toward the virtual vanishing point VP, and each image is arranged and displayed in a manner along the virtual lane VL. By using this expression method, the occupant 14 can visually observe that each image is arranged in a manner further along the road surface.

[0127] In addition, Figure 5 In (a), the speed limit information NI of the approaching side is arranged on the lower side (the front side observed from the occupant 14), and the speed limit information FI of the distant side is arranged on the upper side (the inner side observed from the occupant 14). It is known that in the visual characteristics of humans, from the perspective of the visual observer (occupant 14), it can be visually observed that the visual observation object located on the upper side exists on the distant side, and the visual observation object located on the lower side exists on the approaching side. Therefore, the occupant 14 can visually observe that the speed limit information NI of the approaching side is displayed on the front side, and the speed limit information FI of the distant side is displayed on the inner side, and can easily understand the front and back relationship between the images. In addition, in order to generate an inclined display area VA, the HUD device 100 changes the display distance according to the upper and lower positions of the display area VA. Therefore, by setting a difference in the upper and lower positions between the images, it is easier to understand the front and back relationship between the images.

[0128] Figure 5 (b) is an example of a display method in which the front vehicle following information CI and the speed limit information LI are generated as images (virtual images V) and projected and displayed on the display area VA. Since these images are information related to the foreground object, it is preferable to display these images in a manner that the passenger 14 as a visual observer can understand that the displayed images (virtual images V) are related information of the foreground object and in a manner that the antecedent relationship between the images can be understood. Therefore, according to Figure 5 In the display mode shown in (b), the front vehicle following information CI is arranged and displayed near the front vehicle CF, and the speed limit information LI is arranged and displayed near the speed limit sign LS. Thus, the occupant 14 can understand that each image is information related to the foreground object.

[0129] In addition, according to Figure 5In the display mode shown in (b), the speed limit information LI is arranged on the lower side, and the front vehicle following information CI is arranged on the upper side. Therefore, the passenger 14 can visually observe that the speed limit information LI is displayed on the near front side of the display area VA, and the front vehicle following information CI is displayed on the inner side of the display area VA, thereby improving the understanding of the front-to-back relationship between the images. In addition, Figure 5 (a) and Figure 5 An example of the display mode shown in (b) shows a case where the position of the eyes of the occupant 14 in the height direction is standard, that is, a way of observing the image of the occupant 14 having a standard height.

[0130] The HUD device 100 (control unit 160) of the present embodiment, which receives the display instruction from the navigation device 400 (information processing unit 401), determines whether the position of the eye of the occupant 14 in the height direction is less than a predetermined value (step S102). Here, if the position of the eye of the occupant 14 in the height direction is less than the predetermined value (step S102 "Yes"), the control unit 160 performs display change control ("first control"), and if the position of the eye of the occupant 14 in the height direction is less than the predetermined value (step S102 "No"), it shifts to image display control (step S106). The position of the eye of the occupant 14 in the height direction is determined based on the angle information of the concave mirror 141 as the reflection member of the HUD device 100 set by operating the operation input device 500 or based on the information obtained by image recognition of the shooting information obtained by the camera (vehicle-mounted sensing device 200) provided in the vehicle 10.

[0131] Here, when the control unit 160 performs display change control (step S103), when the eye position of the passenger 14 in the height direction is lower than the standard position, the observation mode of the image observed by the passenger 14 changes from Figure 5 (a) Figure 5 The display mode shown in (b) is changed. Here, Figure 6 (a) indicates that the ratio Figure 5 (a) Observation method of an image observed from a low viewpoint.

[0132] according to Figure 6 An example of a display method shown in (a) of FIG. 1 is that a virtual lane line VL for configuring an image of the approaching speed limit information NI and the departing speed limit information FI has a different slope from a virtual lane line AL passing through the center of a driving lane WL (white line image) in the real world that is the foreground of the vehicle 10. As described above, when the difference in the slope of each image (the approaching speed limit information NI and the departing speed limit information FI) becomes larger, it is possible that each image is visually observed to be not along the road surface. Therefore, in the display change control (step S103), the control unit 160, for example, Figure 7 As shown in an example of this display method in (a), the position of the virtual vanishing point VP is changed in such a way that the virtual lane line VL used to configure the image (virtual image V) has the same slope as the virtual lane line AL passing through the center of the driving lane WL (white line image) in the real world, and the display position of the image (virtual image V) of the approaching speed limit information NI and the departing speed limit information FI is changed in such a way that they pass through the virtual lane line VL.

[0133] Here, the sense of incongruity may be reduced by changing the display mode of the image (virtual image V) (making it different) without changing the display position of the image (virtual image V). In the case of changing the display mode, it is conceivable that the control unit 160 makes the size, number, brightness, color, clarity, etc. of display elements such as text or decorations constituting the approaching speed limit information NI and the departing speed limit information FI different from each other according to the first image and the second image. For example, by increasing the clarity of the approaching speed limit information NI displayed on the near front side and reducing the clarity of the departing speed limit information FI, the sense of perspective is emphasized, thereby reducing the sense of incongruity.

[0134] In addition, the control unit 160 may also set the image (virtual image) within a predetermined range (e.g., 8° or more and less than 66°) from the virtual lane VL and make the difference in the slope of the two virtual lanes VL and AL less than a predetermined value. Figure 6 (a) shows different image positions of the speed limit information NI and FI and the slope of the virtual lane VL. Figure 7 In the display method shown in (a), an area (first area NA) surrounded by two horizontal line segments passing through the upper and lower ends of the image of the approaching speed limit information NI is repeated with an area (second area FA) surrounded by two horizontal line segments passing through the upper and lower ends of the image of the receding speed limit information FI, and the images are repeated in the upper and lower directions.

[0135] Figure 6 (b) indicates that the ratio Figure 5 The display method (b) shown in FIG. 1 is a method of observing an image from a low viewpoint. Figure 6 As shown in (b), the front vehicle following information CI overlaps with the front vehicle. Figure 5 The viewing method different from the display method shown in (b) may cause a sense of discomfort to the occupant 14. Therefore, in the display change control ("first control"), the control unit 160 Figure 7As shown in (b), the image display position of the vehicle following information (CI) is changed in such a way that the vehicle following information (CI) is located below the vehicle in front as viewed from the occupant. In addition, the display position of the image may be changed to reduce the sense of incongruity by making the image display method different. Figure 7 In the display mode shown in (b), an area (first area CA) surrounded by two horizontal line segments passing through the upper and lower ends of the image of the front vehicle following information CI and an area (second area LA) surrounded by two horizontal line segments passing through the upper and lower ends of the image of the speed limit information LI are repeated, and the images are repeated in the upper and lower directions.

[0136] Therefore, the control unit 160 determines whether the image (virtual image V) is repeated in the vertical direction (step S104). Here, when there is a repetition in the vertical direction of the image (virtual image V) (step S104 "Yes"), the control unit 160 performs a repetition elimination control of each image (virtual image V) (step S105), and when there is no repetition (step S104 "No"), it transfers to the image display control (step S106). As a result of performing the "display change control" of step S103, for example, Figure 7 (a) Figure 7 As shown in the display mode of (b), repetition occurs at the top and bottom of the image. As described above, from the perspective of the occupant 14, the visual observation objects (vehicle speed limit information FI on the far side and vehicle following information CI in front) located on the upper side are visually observed to exist on the inner side, and the visual observation objects (vehicle speed limit information NI on the approaching side and vehicle speed limit information LI) located on the lower side are visually observed to exist on the near front side. Therefore, when there is repetition in the up and down directions of the image (virtual image V), it is difficult to understand the front and back relationship of each image. In addition, in the inclined display area VA, when the positions of the images in the up and down directions are the same or repeated, the difference in the display distance between the images disappears or becomes smaller, so it is difficult to understand the front and back relationship between the images.

[0137] Therefore, the control unit 160 performs a duplicate elimination control (second control) (step S105). The duplicate elimination control performed here is a control performed to eliminate duplication when there is duplication between images. Figure 8 (a) shows the Figure 7 An example of a display mode when the display mode shown in (a) is subjected to duplicate elimination control.

[0138] exist Figure 7 In (a), the images of the approaching speed limit information NI and the departing speed limit information FI are arranged on a virtual lane VL that is directed toward a virtual vanishing point VP. When the image (virtual image V) moves away from the virtual lane VL, it may cause a sense of discomfort to the occupant 14. Figure 8 In the example shown in (a), the control unit 160 moves the image of the speed limit information NI on the approaching side downward and to the left along the virtual lane VL. It is known that in human visual characteristics, the closer the distance to the visual observer (passenger 14), the higher the depth discrimination ability. In the HUD device 100 using an inclined display area VA, the lower side of the display area VA is closer to the passenger 14 than the upper side (display distance). Therefore, it is more effective to grasp the front-to-back relationship between images than to move the image (virtual image V) that is desired to be visually observed on the inner side, that is, the speed limit information FI on the distant side, upward, and move the image that is desired to be visually observed in the front, that is, the speed limit information NI on the approaching side, downward. In addition, each image can be configured within a range specified by the distance from the virtual lane VL (for example, greater than 8° and less than 66°), and the depth discrimination ability can be set accordingly. Figure 7 (a) Image positions of different vehicle speed limit information NI and FI.

[0139] exist Figure 8 (b) shows the Figure 7 An example of a display mode when deduplication control is performed on an image (virtual image V) in the display mode shown in (b). Figure 8 In (b), the control unit 160 can eliminate the duplication of images by controlling the image desired to be visually observed on the near front side, that is, the image of the vehicle speed limit information LI, to move downward. Here, the reason why the image desired to be visually observed on the far side, that is, the front vehicle following information CI, is not moved upward but the image desired to be visually observed on the near front side, that is, the vehicle speed limit information LI, is moved downward is as follows: Figure 8 The display method shown in (a) is the same as the case.

[0140] In addition, sometimes the display area VA in the vertical direction is small and the image cannot be moved downward. In this case, the control unit 160, for example, Fig. 9 As shown in the display mode, the vehicle speed limit information LI is controlled to move to the left side in a manner away from the center of the display area VA, and as a result, away from the front vehicle following information CI. As a result, although the vertical overlap between the images cannot be eliminated, the position difference in the left-right direction is enlarged, making it easy for the occupant 14 to understand the front-back relationship of the displayed images (virtual images V).

[0141] Next, the control unit 160 waits for the display timing of these images, reads these images generated by the navigation device 400 (information processing unit 401) or the driving assistance device 300 from the built-in VRAM area (not shown), and performs image display control (step S106) to output them to the display unit 120. Finally, the display unit 120 transmits the illumination light from the light source 121, forms the display light L, and projects and displays the desired image (virtual image V).

[0142] (Variation Example)

[0143] According to the HUD device 100 of the present embodiment described above, the information processing unit 401 of the navigation device 400 is configured to acquire setting information related to the position of the eye movement range set by the occupant 14 via the operation input device 500, and issue a display command to the HUD device 100. The HUD device 100 that receives the setting information performs the first control (display change control) when the position of the eye in the height direction of the occupant 14 is below a predetermined value. When duplication occurs in the vertical direction between images by the first control, a difference is set in the vertical position between the images by the second control (duplication elimination control), so that the front-back relationship between the images can be easily understood. However, the functions of acquiring the operation input and generating the image are not limited to the navigation device 400 (information processing unit 401), and may be replaced by the driving assistance device 300. In addition, the HUD device 100 may perform these functions independently of the navigation device 400 or the driving assistance device 300 by acquiring these functions.

[0144] Alternatively, the HUD device 100 may be regarded as a simple display device that performs only image display control, and the navigation device 400 (information processing unit 401 ) or the driving assistance device 300 may be responsible for all of image generation, display change control, and deduplication control, and output display instructions to the HUD device 100 .

[0145] (Effects of Embodiments)

[0146] As described above, the HUD device 100 of this embodiment is, for example, Figure 5 As shown in (a) of FIG. 1 , the head-up display device projects and displays one or more images (NI, FI) in a manner overlapping with the foreground (FS, WL, etc.) on a display area VA virtually set in front of the vehicle 10 so that the passenger 14 can visually observe the images. Figure 2 As shown, the vehicle comprises: a display unit 120 that projects a first image (e.g., FI) and a second image (e.g., NI) onto a display area VA for display; and a control unit 160 that controls the display unit 120 to arrange the first image (e.g., FI) behind the second image (e.g., NI) as viewed from the occupant 14. The control unit 160, for example, Figure 4As shown, based on the position of the eyes of the occupant 14 in the height direction (step S102), a first control (step S103) is performed to configure the first image and / or the second image in the display area VA in a manner that makes the display position and / or display method different. Through the first control, when repetition occurs between the first image and the second image in the up and down directions (step S104 "yes"), a second control (step S105) is performed to reconfigure the first image and / or the second image to avoid repetition.

[0147] According to the HUD device 100 of the present embodiment, when the control unit 160 detects a change in the position of the eye in the height direction of the occupant 14, the control unit 160 performs display change control (first control) to change the display position of the first image and / or the second image and / or change the display mode. If the result of the display change control is that there is duplication between the images, for example, a duplication elimination control (second control) is performed to eliminate the duplication by moving the second image desired to be visually observed at the near front side downward. Therefore, when duplication occurs between images by the display change control (first control), it is not easy for the occupant 14 to grasp the front-to-back relationship between the images. However, by setting a difference in the display position between the images in the up-down direction by performing the duplication elimination control (second control) to move the second image desired to be visually observed at the near front side downward, it is easier for the occupant 14 to understand the front-to-back relationship between the images.

[0148] In addition, according to the HUD device 100 of the present embodiment, the control unit 160 controls the first area (for example, Figure 7 NA of (a)) and the second region to which the second image belongs (for example, Figure 7 The first image is displayed in the vertical direction of the FA of (a), and the second control (repetition elimination control) is performed when repetition occurs. In this case, since repetition is detected only by comparing the display position of the lower end of the first image with the display position of the upper end of the second image, repetition can be detected with less processing load than when comparing pixels between images.

[0149] In addition, according to the HUD device 100 of the present embodiment, if the first image and the second image are images related to the foreground in front of the vehicle 10, the control unit 160 performs the first control and the second control. The grasp of the front-back relationship between such images is particularly important when the images are related to the foreground in front of the vehicle 10, and by performing the second control on such images, it is possible to ensure that the occupant 14 grasps the front-back relationship between the images.

[0150] In addition, according to the HUD device 100 of the present embodiment, the control unit 160 displays the first image and the second image in a predetermined range (for example, 8° or more and less than 66°) that can be visually observed by the occupant 14 in such a manner that the first image and the second image are arranged along the lane VL of the driving lane simulating the foreground passing through the virtual vanishing point VP, and in this case, the first control (display change control) and the second control (de-duplication control) are performed. Here, arranging each image along the virtual lane VL passing through the virtual vanishing point VP is a method often used when it is desired to grasp the front-back relationship between images, and the first control (display change control) of changing the display position and / or display mode of the first image and / or the second image is performed on such images. Through the first control, if there is duplication between images, for example, de-duplication control is performed to move the second image that is desired to be visually observed on the near front side to the lower side, and the second control (de-duplication control) of providing a difference in the display position in the up-down direction between the images is performed, thereby ensuring the grasp of the front-back relationship.

[0151] In addition, according to the HUD device 100 of the present embodiment, the control unit 160 avoids duplication between images by performing the second control (duplication elimination control) of moving the second image to the lower side of the display area VA when viewed from the occupant 14. This is because it is known that in human visual characteristics, the closer the distance (display distance) from the visual observer (occupant 14) to the visual observation object (first image, second image) is, the higher the depth discrimination ability is. Therefore, in the HUD device 100 that generates a virtual image inclined relative to the road surface, the lower side of the display area VA is closer to the occupant 14 than the upper side. Therefore, it is more convenient for the occupant 14 to understand the front-back relationship between the images than moving the first image, which is an image to be viewed from the back side, to the upper side and moving the second image, which is to be viewed from the near front side, to the lower side.

[0152] In addition, according to the HUD device 100 of the present embodiment, for example, the second image may not be moved downward due to the limitation of the display area VA of the HUD device 100, such as the display area VA being small in the vertical direction. In this case, the control unit 160 may set a difference between the display positions of the first image and the second image by moving the second image to the left or right so as to be away from the center position of the display area VA. In this case, even if the difference in the display position in the vertical direction is small, the front-back relationship can be easily grasped by increasing the difference in the display position in the horizontal direction.

[0153] In addition, according to the HUD device 100 of the present embodiment, the control unit 160 is, for example, Figure 8As shown in an example of the display method in (a), the speed limit information NI displayed on the near front side as the second image along the virtual lane VL is moved to the lower side of the display area VA and moved to the left side in a manner away from the center position. Therefore, by moving the image on the virtual lane VL passing through the virtual vanishing point VP, it is possible to suppress the sense of discomfort caused to the occupant 14 and easily grasp the front-back relationship between the images.

[0154] In addition, according to the HUD device 100 of the present embodiment, the control unit 160 performs the first control (display change control) on both the occupant with a shorter stature whose eye movement range position has dropped compared to the predetermined reference position and the occupant with a taller stature whose eye movement range position has risen compared to the reference position. However, as a result of performing the first control (display change control), it is highly likely that the occupant with a shorter stature whose eye movement range position has dropped will have a duplication between images, so the second control (duplication elimination control) is performed only on the occupant with a shorter stature to avoid duplication between images. Therefore, efficient duplication elimination control can be performed without performing useless control, and the anteroposterior relationship between images can be easily grasped.

[0155] In addition, according to the HUD device 100 of the present embodiment, the control unit 160 can use the display area VA as an inclined virtual image imaging surface with the upper end (up of the viewing angle) of the display area VA further back than the lower end (Dn of the viewing angle), thereby improving the display of the expressiveness in the depth direction (the front-back direction of the vehicle), and can realize the visual observability of the image with a sense of perspective more naturally. In addition, the display distance (imaging distance) can be adjusted according to the display position, and a display with a sense of depth can be realized with a relatively large range on the upper end side, so that the front-back relationship between images can be easily grasped.

[0156] The display control system of this embodiment is, for example, Figure 2As shown, the head-up display device (HUD device 100) includes: a head-up display device (HUD device 100) that projects and displays one or more images in a display area VA virtually set in front of the vehicle 10 in a manner overlapping with the foreground; and a processing device (for example, the information processing unit 401 of the navigation device 400) that generates an image display control system (vehicle control system 1000). In addition, the head-up display device includes: a display unit 120 that projects and displays the first image and the second image in the display area VA; and a control unit 160 that controls the display unit 120 to arrange the first image behind the second image when viewed from the occupant 14 and display the first image. Furthermore, the processing device executes a process of configuring the first image and / or the second image in the display area VA in a manner that makes the display position and / or display method of the first image and / or the second image different when there is a change in the position of the eyes of the occupant 14 in the height direction set by the operation input of the occupant 14 or detected, and when there is an overlap between the first image and the second image in the height direction, reconfiguring the first image and / or the second image to avoid overlap, and instructing the head-up display device to display the first image and the second image.

[0157] According to the display control system of the present embodiment, when there is a change in the eye position of the occupant 14 in the height direction set or detected by the operation input of the occupant 14, the processing device arranges the first image and / or the second image in the display area VA in a manner that the display position and / or display mode are different (display change processing), and when there is overlap between the first image and the second image in the height direction, the processing device re-arranges the first image and / or the second image to avoid overlap (overlap elimination processing), and instructs the HUD device 100 to display the first image and the second image. Therefore, when overlap occurs between images by the display change processing (first control), it is difficult for the occupant 14 to understand the front-back relationship between the images. However, by performing the overlap elimination processing (second control) of moving the second image that is desired to be visually observed at the near front side to the lower side, for example, and providing a difference in the display position in the upper-lower direction between the images, it is possible to provide a display control system (vehicle control system 1000) that makes it easier for the occupant 14 to understand the front-back relationship between the images.

[0158] In addition, in the display control system (vehicle control system 1000) of this embodiment, the functions executed by the processing device (for example, the information processing unit 401 of the navigation device 400) are realized by a program executed by a computer. In this case, the information processing unit 401 has a computer composed of at least one control device (for example, a processor) and at least one storage device (for example, a RAM) as hardware for executing the above-mentioned program.

[0159] In addition, the above-mentioned program may be recorded in one or more computer-readable recording media instead of being temporarily recorded. The recording medium may or may not have the information processing unit 401. In the latter case, the above-mentioned program may be supplied to the above-mentioned information processing unit 401 via any transmission medium, whether wired or wireless.

[0160] In addition, at least a part of the above functions may also be implemented by a logic circuit. For example, an integrated circuit formed with a logic circuit is also included in the scope of the present invention. In addition, for example, the above functions can also be implemented by a quantum computer. In addition, each process described in this embodiment may also be performed by AI (Artificial Intelligence). In this case, AI may operate in the information processing unit 401, and may also operate in other devices (for example, a cloud server, etc.).

[0161] The present invention is not limited to the above-described exemplary embodiments, and a person skilled in the art can easily modify the above-described exemplary embodiments within the scope of the claims.

Claims

1. A head-up display device that projects and displays one or more images in a display area virtually set in front of a vehicle so as to overlap with a foreground, thereby allowing a passenger to visually observe the images, characterized in that: The head-up display device has: a display unit that projects the first image and the second image onto the display area for display; and a control unit configured to control the display unit so that the first image is displayed on the display unit in a manner that the first image is arranged on the back side of the second image as viewed from the occupant, The control unit performs a first control to arrange the first image and / or the second image in the display area in a different display position and / or display mode according to the position of the eye of the occupant in the height direction, When overlap occurs between the first image and the second image in a vertical direction due to the first control, the control unit performs a second control for rearranging the first image and / or the second image to avoid the overlap.

2. The head-up display device according to claim 1, characterized in that: The control unit performs the second control when the repetition occurs between a first area in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the first image, and a second area in the display area surrounded by two horizontal line segments passing through the upper end and the lower end of the second image, respectively.

3. The head-up display device according to claim 1, characterized in that: The control unit performs the first control and the second control when the first image and the second image are images related to a foreground in front of the vehicle.

4. The head-up display device according to claim 1, characterized in that: A virtual vanishing point of line perspective is set inside or outside the display area, and the foreground driving lane passing through the virtual vanishing point is simulated as a virtual lane. The first image and the second image are displayed within a specified range where the occupant can visually observe that the first image and the second image are arranged along the virtual lane. In this case, the control unit performs the first control and the second control.

5. The head-up display device according to claim 1, characterized in that: The control unit avoids the overlap by performing control to move the second image to a lower side of the display area viewed from the occupant in the second control.

6. The head-up display device according to claim 1, characterized in that: The control unit controls to configure the second image in the lower area of ​​the display area through the first control. When the duplication cannot be avoided even if the second image is moved to the lower side of the lower area through the second control, the control moves the second image to the left or right side of the display area observed by the occupant in a manner away from the center position of the display area.

7. The head-up display device according to claim 1, characterized in that: In the second control, the control unit controls to simulate a driving lane passing through a virtual vanishing point of a line perspective method set on the inner side or the outer side of the display area as a virtual lane, and moves the second image downward within a prescribed range that the occupant can visually observe that the lane is configured along the virtual lane, and / or moves the second image to the left or right in a manner away from the center position of the display area.

8. The head-up display device according to claim 1, characterized in that: The control unit performs the first control and the second control when the position of the eye of the occupant in the height direction is below a predetermined reference position, and performs the first control when the position is above the predetermined reference position.

9. The head-up display device according to any one of claims 1 to 8, characterized in that: The control unit controls the display so that the occupant can visually observe the display in a manner in which the upper end is inclined to the inner side than the lower end, when the end of the display area on the side close to the vehicle is set as the lower end and the end on the side away from the vehicle is set as the upper end.

10. A display control system comprising: a head-up display device that projects and displays one or more images in a display area virtually set in front of a vehicle in a manner overlapping with a foreground; and a processing device that generates the image and arranges it in the display area, characterized in that: The head-up display device comprises: a display unit that projects and displays the first image and the second image on the display area; and a control unit configured to control the display unit so that the first image is displayed on the display unit in a manner that the first image is arranged on the back side of the second image as viewed from the occupant, The processing device performs processing that, when there is a change in the position of the occupant's eyes in the height direction set by the occupant's operation input or detected, configures the first image and / or the second image in the display area in a manner that makes the display position and / or display method different, and when overlap occurs between the first image and the second image in the up-down direction, reconfigures the first image and / or the second image to avoid the overlap, and the processing device instructs the head-up display device to display the first image and the second image.

Citation Information

Patent Citations

  • Head-up display device

    JP2021051231A