Head-up display device

Abstract

This head-up display (HUD) device having a light-field-type stereoscopic display unit averts loss of proper light-field rendering ability due to overlap between pixels for displaying one image and pixels for displaying another image. The HUD device has a light-field-type stereoscopic display unit 230 and a control unit 300, wherein the control unit 300 carries out overlap suppression control processes that include: determining, between first pixels in a display used when a first image is displayed in a first display position and second pixels used when a second image is displayed in a second display position, at least one of whether overlap has occurred and whether there is a possibility of overlap occurring; if overlapping has occurred or there is a possibility of overlap occurring, prioritizing display of the image with the higher display priority level; and hiding the display of, or reducing the brightness of, at least the overlapping portion of the pixels of the image with the lower priority level.

Description

[Technical field]

[0001] The present invention relates to a Head-up Display (HUD) device that displays virtual images, and more particularly to a HUD device having a light field type stereoscopic display unit (light field display) that can project (project) image display light onto a projection member such as a windshield or combiner of a vehicle (vehicle) and display multiple virtual images in front of a driver (viewer or user) at a desired virtual image display distance. [Background technology]

[0002] Patent Document 1 discloses a technology that enables a HUD device using a light field display to display multiple annotations (information such as text, objections, signs, commands, etc. displayed by the display) at different focal lengths (e.g., claims 1 and 2, paragraph

[0012] , Figures 3 to 6, etc.). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6580800 Summary of the Invention [Problem to be solved by the invention]

[0004] A ray of light in space can be represented by its position within a plane when it passes through the plane whose normal is the optical axis, and the angle (in other words, its direction) that the ray makes with the optical axis.

[0005] Taking this into consideration, a light field type stereoscopic display device (stereoscopic display unit), for example, uses a combination of a high-definition flat display and small lenses (lens array) to control the "position of lit pixels" on the flat display and reproduce light rays specified at any position and direction.

[0006] In addition, the depth position (depth distance) of a three-dimensional image in light space (light field), for example as seen from the light field display side, can be adjusted as appropriate by changing the "lighting pattern of the lit pixels (lit picture elements)" on the flat display.

[0007] In this way, light rays can be reproduced at any position (position on a two-dimensional surface), direction, and depth by controlling the lighting positions and lighting patterns of pixels on a flat display.

[0008] The inventors have conducted various studies on generating light field data (data for displaying images having information on at least one of lit pixels and lighting patterns on a flat display) by rendering, and as a result, the following problems have become apparent.

[0009] In the following description, it is assumed that a flat display has a large number of pixels (picture elements) arranged in a rectangular area in a planar view, and that the horizontal direction of the rectangle corresponds to the horizontal direction, which is the direction along the line segment connecting the left and right eyes of an observer (or a viewer who views a stereoscopic image) who observes a stereoscopic image in real space. The vertical direction of the rectangle corresponds to the height of the observer (viewer) (referred to as the height direction). In addition, the direction along the line segment (normal) perpendicular to the rectangle and away from the rectangle is referred to as the depth direction.

[0010] Here, it is assumed that two different stereoscopic images are displayed at different depth positions. When the two stereoscopic images are displayed at the same depth position, if the horizontal distance between the stereoscopic images in space is appropriately set, it is possible to prevent the horizontally adjacent pixels for displaying the stereoscopic images from overlapping on the flat display (however, when the stereoscopic images are arranged very close to each other, the overlapping of pixels may become a problem. This does not mean that the present invention does not encounter any problems in this regard).

[0011] On the other hand, when two stereoscopic images are displayed at different depth positions, there is a high possibility that the pixels for displaying the stereoscopic images, which are arranged in the horizontal direction on the flat display, will overlap with each other. This is for the following reasons.

[0012] An example will be described below (however, the description is not limited to this). One light point constituting a stereoscopic image emits a pair of light rays for the left eye and the right eye. The angle (convergence angle) formed when the pair of light rays intersect at the light point increases as the depth distance from the light field display (for example, the center position of the lens) to the stereoscopic image decreases. At this time, the larger the convergence angle, the larger the interval between the pixels on the flat display corresponding to each of the two light rays. Therefore, for example, when the depth distance of one stereoscopic image is changed during display, the convergence angle increases and the interval between the two pixels corresponding to the two light rays increases, resulting in at least one of the pixels for displaying one of the stereoscopic images entering the arrangement area of ​​the pixels for displaying the other stereoscopic image, and in some cases, overlapping one of the pixels for displaying the other stereoscopic image.

[0013] In other words, one pixel is used for displaying two stereoscopic images, resulting in pixel collision. In this case, it is unclear which stereoscopic image the pixel is to be used for displaying, and proper light field rendering cannot be performed. In the worst case, this means that both of the two stereoscopic images cannot be properly displayed. The above-mentioned problems have been identified by the present inventor.

[0014] One of the objectives of the present invention is to avoid a situation in which proper light field rendering cannot be performed in a HUD device having a light field type stereoscopic display unit due to overlap between pixels for displaying one image and pixels for displaying another image.

[0015] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings. [Means for solving the problem]

[0016] In order to facilitate an understanding of the outline of the present invention, embodiments according to the present invention will be exemplified below.

[0017] In a first aspect, the head-up display device is a head-up display (HUD) device that displays a virtual image, A display and an optical member are included, and a stereoscopic image is rays of light A light field stereoscopic display unit that reproduces the an optical system that projects the light beam reproduced by the stereoscopic display unit onto a projection target; A control unit that controls display of an image on the display; having When the distance between the stereoscopic display unit and the stereoscopic image is defined as a depth distance, and the direction along the depth distance when the stereoscopic image is viewed from the stereoscopic display unit is defined as a depth direction, The control unit is setting a first display position including at least a position in a depth direction of a first image showing the first information, and a second display position including at least a position in a depth direction of a second image showing the second information; determining whether or not a first pixel on the display used to display the first image at the first display position overlaps with a second pixel used to display the second image at the second display position, and / or whether there is a possibility of overlap; If it is determined that the first pixel and the second pixel overlap or are likely to overlap, The display of the image with the higher display priority is given priority, and overlap suppression control is implemented, including turning off or reducing the brightness of at least the pixels in the overlapping portion of the image with the lower display priority.

[0018] In the first aspect, when the display pixels of the first and second images overlap or may overlap on the display, lighting of the display pixels of the image with a higher priority is prioritized based on the display priority (priority order). By turning off the display pixels of the image with a lower priority (priority order) or reducing the brightness (in other words, implementing overlap suppression control), pixel overlap is avoided. This enables generation by rendering of light field data.

[0019] When a portion of the display pixels of a first image overlaps (or there is a possibility of overlapping) with a portion of the display pixels of a second image, overlap suppression control may be performed only on the display pixels of the image with the lower priority in the overlapping portion, or overlap suppression control may be performed on the entire image with the lower priority.

[0020] In the former case, the portion of the lower priority image displayed using non-overlapping pixels is visible, and information can be presented to the viewer (observer) through that portion of the image. In the latter case, the entire lower priority image is made invisible or its visibility is reduced, allowing the viewer (observer) to focus their attention solely on the (virtual image of) the higher priority image, and thus obtain or sense information efficiently.

[0021] In a second embodiment dependent on the first embodiment, The control unit is When at least one of the first and second images is a dynamic image corresponding to a virtual image superimposed on a moving object, the likelihood of overlap may be determined based on a prediction of the movement of the object.

[0022] According to the second aspect, for example, for an image to be superimposed on a moving object, the possibility of overlap of display pixels can be determined based on a motion prediction of the object, and overlap avoidance control can be implemented.

[0023] For example, when a warning sign is superimposed on a person entering a road, the possibility of overlapping with other signs can be determined based on the movement of the object, and the warning sign can be displayed with priority as appropriate. In this case, safety can be ensured by displaying warnings and other messages that are important for ensuring safety with priority.

[0024] In a third aspect dependent on the first or second aspect, The control unit is The overlap suppression control may be implemented by prioritizing the displays in descending order of priority as follows: warning display, navigation display, POI (Point Of Interest) display, and other displays.

[0025] According to the third aspect, for example, it is possible to efficiently and quickly take measures necessary to avoid duplication according to a list of predetermined priorities. By prioritizing information in the order of highest priority, such as warnings, navigation information, and POI information, it is possible to present information considered necessary (important) for driving to the user of the HUD device with priority.

[0026] In a fourth aspect dependent on any one of the first to third aspects, Further comprising a driving scene determination unit, The control unit may variably control the priority order of the display images in accordance with the driving scene.

[0027] According to the fourth aspect, by updating (changing) the display priority depending on the driving scene, it is possible to prioritize displays that are useful for the current driving scene, and to display practical information while suppressing crosstalk.

[0028] In a fifth aspect dependent on any one of the first to fourth aspects, Further comprising a visual detection unit, The control unit is After displaying one of the images in accordance with the priority order, if the visibility detection unit detects that the displayed image has been viewed by a viewer, at least a portion of the display restriction on the pixels of the other image that was restricted from display may be lifted.

[0029] According to the fifth aspect, after the highest priority image (virtual image) is viewed, at least a portion of the restrictions on an image (virtual image) whose display has been restricted under specified conditions is lifted, thereby enabling the viewer to view beneficial displays of other images (virtual images).

[0030] In a sixth aspect dependent on any one of the first to fifth aspects, The control unit is When pixels for displaying the first image and pixels for displaying the second image do not overlap but are within a predetermined distance, or when it is determined that the distance between the pixels has become closer to within the predetermined distance due to movement of at least one of the pixels, the overlap suppression control may be performed on the pixels of the image with the lower priority.

[0031] According to the sixth aspect, when there are adjacent pixels within a predetermined distance among the display pixels of the first and second images, it is possible to start overlap suppression control (in other words, overlap avoidance processing) for the display pixels of the image with the lower priority. A state in which images are adjacent to each other can be said to be a state in which the images are difficult to distinguish from each other (a state in which visibility is reduced) even if there is no overlap. In this state, by quickly performing processing to eliminate (suppress) the conflict between the images, it is possible to effectively suppress the decrease in visibility.

[0032] In a seventh aspect dependent on any one of the first to sixth aspects, The control unit is When the pixels for displaying the first image and the pixels for displaying the second image do not overlap, but it is determined that the two pixels have come within a predetermined distance due to movement of at least one of them, and the distance between the two pixels becomes even smaller over time, a fade-out process may be implemented to gradually reduce the brightness of the pixels of the image with the lower priority.

[0033] According to the seventh aspect, the degree of visibility restriction is gradually increased by implementing fade-out control, and this makes it possible to make the visual change accompanying the visibility control gentler. This makes it possible to reduce discomfort caused by the visual change.

[0034] In an eighth aspect dependent on any one of the first to seventh aspects, The control unit is A notification image may be displayed to inform the user that a restriction is imposed on the display of an image with a low priority due to the overlap suppression control.

[0035] According to the eighth aspect, the viewer is notified that not all of the information is completely displayed, but that at least one piece of information is not displayed or is incompletely displayed, so that the viewer can accurately grasp the current display situation.

[0036] In a ninth aspect dependent on the fourth aspect, The driving scene determined by the driving scene determination unit is The first scene is a clear urban area (urban or traffic volume is above a certain value), or a clear highway (urban), or a crowded intersection, or a school route. A second scene in a city area on a clear day (in the countryside or with traffic volume below a certain level), or on a highway on a clear day (in the countryside), or when the driver is looking away or returning from looking away, or in a location or area where accidents frequently occur, A third scene is a nighttime urban area (urban or traffic volume above a certain value) or a nighttime highway (urban); A fourth scene is a nighttime urban area (rural area or traffic volume is less than a certain value) or a nighttime highway (rural area); The fifth scene, during a traffic jam stop; The sixth scene is when there are restrictions on vehicle movement (including no U-turns or construction work). The seventh scene during autonomous driving, at least four of the following: As indications to which priority is given, warning display, Navigation display, POI display, At least two of the Traffic Sign Recognition (TSR) indicia may be included.

[0037] According to the ninth aspect, for example, the display priority of each of the four (at least two of the seven) display contents can be determined in advance, for example, in a list format, corresponding to the seven driving scenes (at least four of the seven driving scenes). This allows the priority of the display contents (display information) to be quickly updated according to each driving scene, and appropriate display control to be performed.

[0038] In a tenth aspect dependent from the ninth aspect, The warning display is: A first warning about high relative velocity objects (including oncoming vehicles and pedestrians); A second warning for low relative velocity objects (including vehicles traveling in the same direction); and A third warning regarding the situation around the vehicle (including natural disasters and traffic accidents); Including, The first warning is set to have a higher priority for display than the second and third warnings, Regarding the second warning and the third warning, in the first to sixth scenes, the second warning is set to have a higher priority, but in the seventh scene, the second warning and the third warning may be set to have the same priority.

[0039] In a tenth aspect, the warning display is further divided into three types (first, second, and third warnings), and a priority is set for each of them for each driving scene. The first warning has the highest priority, and in the first to sixth scenes, the second warning has a higher priority than the third warning, but in the seventh scene (during autonomous driving), the second and third warnings are set to have approximately the same priority, taking into consideration that the driver is basically not involved in driving.

[0040] According to this aspect, even when there are multiple warning displays and the display pixels of one warning display overlap with the display pixels of another warning display, the overlap of pixels can be suppressed according to the priority (priority order) that takes into account the driving scene set for each warning content (warning type). Since the warning can always be displayed appropriately, safety is improved.

[0041] Those skilled in the art will easily understand that the exemplified embodiments according to the present invention can be further modified without departing from the spirit of the present invention. [Brief description of the drawings]

[0042] [Figure 1] FIG. 1 is a diagram for explaining the principle of stereoscopic display using a light field method (light ray reproduction method). [Diagram 2] FIG. 2(A) is a diagram showing an example of the basic configuration of a light field type (light reproduction type) stereoscopic display unit (stereoscopic display device) and an example of the display (generation) of a stereoscopic image, and FIG. 2(B) is a diagram showing an example of a HUD device using a stereoscopic display unit (stereoscopic display device) in which a virtual image is displayed by light rays for the left eye and right eye emitted from a single light point that constitutes a stereoscopic image. [Diagram 3] FIG. 3(A) is a diagram for explaining the display of a stereoscopic image in a stereoscopic display section (stereoscopic display device) using a lenticular lens, and FIG. 3(B) is a perspective view of the stereoscopic display section (stereoscopic display device) using a lenticular lens. [Figure 4]FIG. 4(A) is a diagram showing an example of the arrangement of display pixels (without overlap) on a flat display when two stereoscopic images are displayed at the same depth position, and FIG. 4(B) is a diagram showing an example of the arrangement of display pixels (with overlap) on a flat display when two stereoscopic images at different depth positions are displayed. [Diagram 5] 5(A) and (B) are diagrams showing examples of measures taken when display pixels overlap on a flat display when two stereoscopic images at different depth positions are displayed. [Figure 6] FIG. 6(A) shows an example of overlapping display pixels when two stereoscopic images at different depth positions are displayed and one of the stereoscopic images is moved horizontally, and FIGS. 6(B) and (C) show examples of measures to avoid overlapping display pixels. [Figure 7] FIG. 7(A) shows an example of overlap of display pixels when two stereoscopic images at different depth positions are displayed and one of the stereoscopic images is moved horizontally, FIG. 7(B) shows an example of a pre-emptive measure when overlap of display pixels is predicted, and FIGS. 7(C) and (D) show examples of measures to avoid overlap of display pixels. [Figure 8] FIG. 8 is a diagram showing an example of the configuration of a HUD device using a light field type (light ray reproduction type) stereoscopic display unit (stereoscopic display device), and an example of a virtual image display. [Figure 9] Figure 9(A) is a diagram showing an example of display priority (display priority order), Figures 9(B) and (C) are diagrams showing an example of suppressing overlap between virtual images displayed by a HUD device by implementing measures to avoid overlap of display pixels, and Figure 9(D) is a diagram showing an example of display when control to suppress overlap between virtual images is released. [Figure 10] 10A and 10B are diagrams showing an example in which overlap between virtual images displayed by a HUD device is suppressed by implementing measures to avoid overlap of display pixels. [Figure 11] 11(A) to 11(C) are diagrams showing an example in which overlap between virtual images displayed by a HUD device is suppressed by implementing measures to avoid overlap of display pixels. [Figure 12]FIG. 12A is a diagram showing an example of the system configuration of a HUD device, and FIG. 12B is a diagram showing an example of a specific configuration of the main parts of the HUD device. [Figure 13] FIG. 13 is a diagram illustrating an example of a functional block configuration of the control unit (HMI control unit). [Figure 14] FIG. 14 is a diagram showing, in a table format, an example of setting the display priority for each display content (presentation information) according to a driving scene. [Figure 15] 10 is a flowchart showing an example of an operational procedure of control for avoiding overlapping of display pixels in a HUD device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0043] The best mode described below is used to easily understand the present invention. Therefore, those skilled in the art should be aware that the present invention is not unduly limited by the mode described below.

[0044] Fig. 1 is a diagram for explaining the principle of light field type (light reproduction type) stereoscopic display. In Fig. 1, two stereoscopic images IM10 and IM20 are displayed at different depth positions (depth distances) by a light field type stereoscopic display unit (also called a stereoscopic display device, hereinafter simply called a stereoscopic display unit) 230.

[0045] The stereoscopic display unit (sometimes called a light field display) 230 uses a flat display 210 using a liquid crystal panel or the like in combination with a lenticular lens 220 as an optical element 220, and controls the "position of lit pixels" on the flat display 210 to reproduce light rays specified at any position and direction.

[0046] Further, the depth positions (or depth distances L10, L20) of the stereoscopic images IM10, IM20 as viewed from the stereoscopic display unit 230 side can be adjusted as appropriate by changing the "lighting pattern of lit pixels (lit picture elements)" on the flat display. Note that in Fig. 1, the depth distances L10, L20 are the distances from the lens center of the lenticular lens constituting the stereoscopic display unit 230 to the respective stereoscopic images IM10, IM20. However, using the lens center as the reference is just an example, and the depth distances may be defined based on another point.

[0047] In addition, in Figure 1, the left eye AL and the right eye AR are positioned at the position where the light rays emitted by the stereoscopic images IM10, IM20 (reproduction light of the stereoscopic images IM10, IM20) are formed, and the distances from each eye AL, AR to each stereoscopic image IM10, IM20 are defined as image display distances L30, L40.

[0048] The horizontal direction is defined as the direction along the line segment connecting the left and right eyes AL, AR of an observer who observes the stereoscopic images IM10, IM20 in real space (or a viewer who visually recognizes the stereoscopic images IM10, IM20). In Fig. 1, a plurality of pixels (picture elements) G are arranged in the horizontal direction on the flat display 210. In Fig. 1, non-lit pixels are represented by white squares, and lit pixels are represented by black squares.

[0049] The lighting (light emission) pattern PT1 of the pixels (display pixels) for displaying the stereoscopic image IM10 is different from the lighting (light emission) pattern PT2 of the display pixels for the stereoscopic image IM20. Due to this difference in pattern, the depth distances L10, L20 of the stereoscopic images IM10, IM20 can be different values.

[0050] Furthermore, the lighting pattern PT1 is located above the lighting pattern PT2 on the paper, and the positions of the lit pixels (lit pixels) in the horizontal direction are different. In other words, by adjusting the positions of the lit pixels, the horizontal positions of the two stereoscopic images IM10 and IM20 in the three-dimensional space can be made different.

[0051] In Fig. 1, the lighting patterns PT1 and PT2 do not overlap, and there is no overlap of lighting pixels. However, for example, when the depth distance of at least one of the stereoscopic images IM10 and IM20 is changed, it is possible that the lighting pixels may overlap. In this case, the display pixels of the stereoscopic image IM10 and the display pixels of the stereoscopic image IM20 collide, and light field data cannot be generated by rendering (this point will be described later).

[0052] Please refer to Fig. 2. Fig. 2(A) is a diagram showing an example of the basic configuration of a light field type (light ray reproduction type) stereoscopic display unit (stereoscopic display device) and an example of display (generation) of a stereoscopic image, and Fig. 2(B) is a diagram showing an example of displaying a virtual image by light rays for the left eye and the right eye emitted from a single light point constituting a stereoscopic image in a HUD device using the stereoscopic display unit (stereoscopic display device). In Fig. 2, parts common to Fig. 1 are given the same reference numerals (note that this also applies to the following figures).

[0053] The flat display 210 has a quadrangular area (display area, or display surface) 215 in a plan view. A large number of pixels (picture elements) are arranged two-dimensionally in a grid pattern on this display surface 215. The horizontal direction of the quadrangular display surface 215 corresponds to the horizontal direction, which is the direction along a line segment connecting the left and right eyes of an observer (or a viewer who views a stereoscopic image) who observes a stereoscopic image in real space. The vertical direction of the display surface 215 corresponds to the height of the observer (viewer) (referred to as the height direction). Also, the direction along a line segment (normal line) perpendicular to the display surface 215 and away from the display surface 215 is the depth direction. Also, in FIG. 2(A), a pixel (picture element) IML used to generate display light EL(1) for the left eye and a pixel (picture element) IMR used to generate display light ER(1) for the right eye are shown on the display surface 215.

[0054] As the optical member RS, in addition to the above-mentioned lenticular lens 220, a parallax barrier 225 may be used. However, these are merely examples and the present invention is not limited to these.

[0055] As shown in the upper left of FIG. 2A, the lenticular lens 220 has a configuration in which cylindrical lenses are arranged in the horizontal direction, and has a light beam separation function that separates light beams for the left and right eyes.

[0056] The parallax barrier 225 is, for example, a rectangular shield 225a-225n with narrow width, arranged at a predetermined pitch in the horizontal direction with gaps (slits) SL, and generates display light (directional display light) of different images for the left and right eyes by shielding part of the display light of the same image with the shield. It is common to a lenticular lens in that it separates light rays for the left and right eyes.

[0057] When light separated by an optical element RS having a light beam separation function (in other words, reproduction light E(L1), E(R1) for each eye reproducing an image) enters both eyes AL and AR located at the light imaging point, a person sees an apparent three-dimensional image IM at the point where convergence (intersection of light) occurs. In other words, this can also be considered as the three-dimensional image IM being displayed (or generated) by the three-dimensional display unit 230. In the example of FIG. 2(A), the convergence angle is θc.

[0058] Next, refer to Fig. 2(B). In Fig. 2(B), an eye box EB is set in front of the viewer (such as the driver of a vehicle), and eye point EP(C) is located at the center of the eye box EB. If virtual image formation planes PS(L) and PS(R) corresponding to the left and right eyes are set in front of the windshield 2, a virtual image V(C) is located at the center of the overlapping area. The convergence angle of the virtual image V(C) is θd, and the virtual image V(C) is recognized as a three-dimensional image by the viewer (user).

[0059] This stereoscopic virtual image V(C) is displayed (formed) as follows: Reproduction light E(L1), E(R1) for each of the left and right eyes of the virtual stereoscopic image IM generated by the 3D display shown in Fig. 2(A) is reflected (reflected at least once) by a curved mirror (concave mirror, etc.) 171 included in the optical system of the HUD device, and is projected (projected) onto the windshield 2 as display light E(L1), E(R1), and the reflected light reaches both eyes of the viewer and forms an image in front of the windshield (projection target member) 2, thereby displaying (forming) the virtual image V(C).

[0060] Next, reference is made to Fig. 3. Fig. 3(A) is a diagram for explaining the display of a stereoscopic image in a stereoscopic display section (stereoscopic display device) using a lenticular lens, and Fig. 3(B) is a perspective view of the stereoscopic display section (stereoscopic display device) using a lenticular lens.

[0061] In Fig. 3(A), the lenticular lens 220 as an optical member is configured by arranging (aligning) a plurality of cylindrical lenses (cylindrical lenses) F1 to Fn as optical elements at a predetermined pitch along the horizontal direction (direction W in Fig. 4(B)) to form a lens array structure that is periodic in the horizontal direction. The cylindrical lenses (F1 to Fn) as optical elements are vertically elongated cylindrical lenses (cylindrical lenses) whose surface (back surface) facing the flat display 210 is a flat surface that transmits light, and whose opposite surface (front surface) is a spherical lens (however, this does not exclude the case where the lens is aspherical). In the example of Fig. 4(A), the curvature of the spherical surface of the lens is uniform.

[0062] In Fig. 3(A), the left eye pixels (L pixels) L1-Ln are arranged (formed) at positions corresponding to the left halves of the cylindrical lenses F1-Fn as optical elements. The right eye pixels (R pixels) R1-Rn are arranged (formed) at positions corresponding to the right halves of the cylindrical lenses F1-Fn as optical elements. Each pixel is further made up of R (red), G (green), and B (blue) sub-pixels, but the sub-pixels are not shown in Fig. 3(A).

[0063] Please refer to Fig. 3(B). In the lenticular lens 220 shown in Fig. 3(B), optical elements (cylindrical lenses) F1a to F8a that refract light are arranged at a predetermined pitch along the lateral direction (horizontal direction). This forms a light beam separation section having a predetermined resolution in the lateral direction (horizontal direction). In Fig. 4(B), the lateral direction (horizontal direction) is H, the longitudinal direction (vertical direction) is T, and the depth direction is J.

[0064] Next, reference will be made to Fig. 4. Fig. 4(A) is a diagram showing an example of the arrangement of display pixels on a flat display when two stereoscopic images are displayed at the same depth position (without overlap), and Fig. 4(B) is a diagram showing an example of the arrangement of display pixels on a flat display when two stereoscopic images are displayed at different depth positions (with overlap).

[0065] In FIG. 4(A), the first and second stereoscopic images IM1 and IM2 are both displayed at a position S2 that is a distance D1 (image display distance D1) away from the viewpoint position S1 (positions of the left and right eyes AL and AR).

[0066] 4(A) also shows four pixels (picture elements) IM1L, IMIR, IM2L, and IM2R in the flat display 210. IM1L is a pixel (picture element) used to reproduce a light ray for the left eye of the stereoscopic image IM1, and IM1R is a pixel (picture element) used to reproduce a light ray for the right eye of the stereoscopic image IM1. IM2L is a pixel (picture element) used to reproduce a light ray for the left eye of the stereoscopic image IM2, and IM2R is a pixel (picture element) used to reproduce a light ray for the right eye of the stereoscopic image IM2. In this example, there is no overlap of display pixels.

[0067] Next, FIG. 4(B) is referred to. In the example of FIG. 4(B), the stereoscopic image IM2 is at a position S1' that is an image display distance D1' away from the viewpoint position S1. In this respect, it is different from FIG. 4(A). In the example of FIG. 4(B), the pixel IM1L used to reproduce the light ray for the left eye of the first stereoscopic image IM1 and the pixel IM2L used to reproduce the light ray for the left eye of the second stereoscopic image IM2 overlap. In this case, it is uncertain which one should be displayed, and therefore, proper light field rendering cannot be performed. In the present invention, this problem is addressed by implementing a priority display control based on a display priority (priority).

[0068] Please refer to Fig. 5. Fig. 5(A) and (B) are diagrams showing examples of measures to be taken when display pixels overlap on a flat display when two stereoscopic images with different depth positions are displayed. In Fig. 5(A), the display priority of the first stereoscopic image IM1 is higher than that of the second stereoscopic image IM2.

[0069] In Fig. 5(A), with regard to the overlapping pixels in Fig. 4(B) shown above, priority is given to pixel IM1L used to reproduce the light beam for the left eye of the first stereoscopic image IM1, and IM2L is ignored, depending on the priority of the image to be displayed (in other words, the priority of the information to be presented by that image). This means that pixel IM2L used to reproduce the light beam for the left eye of the second stereoscopic image IM2 is not lit. This avoids overlapping display pixels, and enables the generation of light field data by rendering.

[0070] 5A, for the second stereoscopic image IM2, IM2L is not lit and only IM2R is lit. Therefore, the image cannot be displayed as a stereoscopic image, and a non-stereoscopic image is displayed.

[0071] Next, refer to Fig. 5(B). In Fig. 5(B), two display examples, B1 and B2, are shown. In display example B1, the second stereoscopic image IM2 itself is hidden. This eliminates the overlap of display pixels. However, if the display of display example B1 is simply continued, the presentation of information by the second stereoscopic image IM2 cannot continue forever.

[0072] Therefore, when the display example B1 is displayed, notification information indicating that the display is not displayed is also presented to the driver of the vehicle, and when a predetermined time has elapsed and it is confirmed that, for example, IM1 has been viewed by the viewer, the display example moves to B2, where the second stereoscopic image IM2 is displayed. This makes it possible to present information using the second stereoscopic image IM2. Then, after the predetermined time has elapsed, the display example returns to B1. This resumes the presentation of information using the stereoscopic image IM1 with higher priority.

[0073] In addition, when the display example B2 is displayed, if the notification necessity of the non-displayed IM1 to the viewer changes and increases, the high-priority IM1 may be displayed again (the low-priority IM2 may be hidden) as shown in the display example B1. The "notification necessity" may be determined, for example, by the degree of danger derived from the degree of seriousness of the possible occurrence, the degree of urgency derived from the length of the reaction time required for the viewer (driver of the vehicle) to take a reaction action, the degree of effectiveness derived from the status of the vehicle and the viewer (or other passengers of the vehicle 1), or a combination of these (the index of the notification necessity is not limited to these). That is, the control unit 300 described later may have a function of calculating the notification necessity based on information acquired via the I / O interface 741 described later.

[0074] Next, reference will be made to Fig. 6. Fig. 6(A) is a diagram showing an example in which overlapping of display pixels occurs when two stereoscopic images at different depth positions are displayed and one of the stereoscopic images is moved horizontally, and Fig. 6(B) and (C) are diagrams showing examples of measures to avoid overlapping of display pixels.

[0075] 6, the second stereoscopic image IM2 is, for example, a warning display (for example, a frame display surrounding the person) that warns the person who has entered the road, and the second stereoscopic image IM2 moves horizontally as the person moves. By detecting the direction and speed of the person's movement, and by performing predictive analysis based on the detected information, the horizontal movement of the second stereoscopic image IM2 can be predicted, and the corresponding movement of the display pixels can also be predicted.

[0076] Then, when the prediction determines that there is a possibility (preferably, a high possibility) of overlapping of display pixels, overlap suppression control (overlap avoidance processing) is implemented in advance, for example, at a point in time before overlapping of display pixels actually occurs.

[0077] In Fig. 6(A), a past time is t0, a current time is t1, and a time when the movement is predicted is t2. The horizontal positions of the second stereoscopic image IM2 at each time are indicated as IM2(t0), IM2(t1), and IM2(t2). At time t1, there is no overlap of display pixels, but at time t2, it is predicted that there will be an overlap of display pixels IM1L and IM2L (see Fig. 4(B)).

[0078] In (B) and (C) of FIG. 6, at time t1, which is a time point before overlapping of the display pixels IM1L and IM2L occurs, processing for avoiding overlapping (overlap suppression control) is started in advance.

[0079] In FIG. 6B, pixel IM2L is not lit. This prevents overlapping of pixels. In this case, the displayed image IM2 is a non-stereoscopic image.

[0080] In Fig. 6C, at time t1, both display pixels IM2L and IM2R are turned off, and the image IM2 is not displayed.

[0081] Next, reference is made to Fig. 7. Fig. 7(A) is a diagram showing an example in which overlapping of display pixels occurs when two stereoscopic images at different depth positions are displayed and one of the stereoscopic images is moved horizontally, Fig. 7(B) is a diagram showing an example of a pre-emptive measure when overlapping of display pixels is predicted, and Figs. 7(C) and (D) are diagrams showing examples of measures for avoiding overlapping of display pixels.

[0082] The situation in Fig. 7(A) is almost the same as that in Fig. 6(A), except that in Fig. 7(A), the distance between the position (IM2(t1)) of the second image IM2 at time t1 and the first image IM1 is D2, which is equal to or less than a predetermined distance (predetermined threshold distance) Dth.

[0083] In FIG. 7(B), the lighting luminance of display pixels IM2L and IM2R is reduced, resulting in reduced visibility of the second image IM2 (IM2 at time t1). In FIG. 7(C), display pixel IM2L is turned off, and the second image IM2 becomes a non-stereoscopic image. In FIG. 7(D), display pixel IM2R is also turned off, and the second image IM2 becomes non-display.

[0084] Here, for example, by continuously performing the controls of Fig. 7(B), (C), and (D), or by continuously performing the controls of Fig. 7(B) and (D), it is possible to perform display control (fade-out control) in which the second image IM2 gradually disappears from time t1 to time t2. This makes it possible to prevent the second image IM2 from suddenly disappearing at time t2, and ensure natural vision.

[0085] Next, reference will be made to Fig. 8. Fig. 8 is a diagram showing an example of the configuration of a HUD device using a light field type (light ray reproduction type) stereoscopic display unit (stereoscopic display device), and an example of a virtual image display.

[0086] 8 includes a flat display 210, a lenticular lens 220 as an optical member having a light beam separation function, which is arranged in contact with or close to the flat display (display unit in a broad sense) 210, and a control unit (HMI control unit) 300 that controls image display (illumination of pixels) on the flat display 210. A stereoscopic display unit (stereoscopic display device) 230 is configured by the flat display 210 and the lenticular lens 220.

[0087] The HUD device 100 also has an optical system 121 that includes a folding mirror 174 and a curved mirror (concave mirror, magnifying mirror) 171 as reflecting members.

[0088] The curved mirror (concave mirror, magnifying mirror) 171 projects the display light (in other words, reproduced light) of the first image (first stereoscopic image) M (V1) virtually displayed by the stereoscopic display unit 230 and the display light (in other words, reproduced light) of the second image (second stereoscopic image) M (V2) onto the windshield 2 as a projection target member (reflective translucent member) provided on the vehicle 1 through the transparent window 176. A part of the projected light is reflected by the windshield 2 and projected onto the eye A of the driver or the like, and as a result, the first and second virtual images V1 and V2 are displayed (visually recognized) at positions in front of the vehicle 1 at virtual image display distances L1 and L2.

[0089] Here, the first virtual image V1 is, for example, the virtual image Q1 of a navigation arrow in Figures 9(B) to (D), and the second virtual image V2 is, for example, the virtual image Q2 of an attention calling frame for calling the attention of person 44 in Figures 9(B) to (D).

[0090] 8, the inclination can be adjusted appropriately by rotating curved mirror 171 using rotating section (actuator) 175. Also, the inclination of stereoscopic display section 230 can be adjusted using adjustment section (actuator) 173.

[0091] Next, reference will be made to Fig. 9. Fig. 9(A) is a diagram showing an example of display priority (display priority order), Fig. 9(B) and (C) are diagrams showing an example of suppressing overlap between virtual images displayed by the HUD device by implementing measures to avoid overlap of display pixels, and Fig. 9(D) is a diagram showing a display example when control for suppressing overlap between virtual images is released.

[0092] An example of a priority list that determines the display priority (priority order) is shown in Fig. 9(A). The display priority order is, from highest to lowest, warning display, navigation display, POI display, and other display (non-overlapping contents such as vehicle speed display and TSR (traffic sign recognition) information in Fig. 9(A)).

[0093] Based on this list, the control unit (HMI control unit) 300 of the HUD device 100 performs overlap suppression control regarding the display of overlapping or potentially overlapping contents. Note that the display priority (priority order) may be determined (changed) based on the notification necessity calculated based on information acquired from the I / O interface, instead of (or in addition to) the above-mentioned preset priority list.

[0094] In Figure 9 (B), in the virtual image display area 3 of the windshield 2, a virtual image Q0 displaying vehicle speed as non-superimposed content with a fixed virtual image display distance, a virtual image Q1 of a navigation arrow superimposed on the road surface 40, and a virtual image Q2 of a warning display (here, a warning frame) to alert a person 44 entering the road are displayed.

[0095] The virtual image Q1 of the navigation arrow can be distinguished into a front portion Q1a extending along the center line 42 (in other words, extending in the depth direction) and a rear portion Q1b extending in the left-right direction (the width direction of the vehicle).

[0096] Also, the distance W1 between the arrow element AR1 of the portion Q1a extending in the depth direction and the attention frame Q2 is smaller than a predetermined distance (here, Wth) as a threshold value. In other words, it may be determined that there is a possibility (high possibility in this case) of overlap of the display pixels described above because the attention frame Q2 approaches within a predetermined distance from the arrow element AR1. Therefore, the overlap suppression control described above is implemented. In FIG. 9(B), the visibility is reduced (for example, the display brightness is reduced) not only for the portion corresponding to the display pixel, but also for the entire arrow element AR1 including that portion. This makes it difficult for double vision to occur, resulting in a display that is easy to see.

[0097] In Fig. 9(C), person 44 is moving further into the road. Accordingly, virtual image Q2 of the attention warning frame also moves to the right along the width direction of vehicle 1 (this corresponds to the horizontal direction described above). When a position is reached where overlapping of display pixels occurs, the entire arrow element AR1, including the portion displayed by those pixels, is hidden. This eliminates double vision and makes the display easier to see.

[0098] In Fig. 9(C), the viewer (driver) sees the attention-calling frame Q2, and the possibility of overlap is eliminated, so the display restriction by the overlap suppression control is lifted. As a result, the arrow elements AR1 and AR2 return to their normal display state.

[0099] Conventionally, when attempting to display content with different virtual image display distances (here, a warning display and a navigation display) close together horizontally, even when the pixels used to display the warning display at a designated position overlap with the pixels used to display the navigation display at a designated position and / or there is a high possibility of overlapping, rendering of light field data taking these into consideration was not performed.

[0100] In this embodiment, appropriate overlap suppression control (overlap avoidance processing) of display pixels is performed, and therefore the visibility of a displayed image (virtual image) is improved.

[0101] Next, reference is made to Fig. 10. Fig. 10(A) and (B) are diagrams showing an example in which overlap between virtual images displayed by a HUD device is suppressed by implementing measures to avoid overlap of display pixels.

[0102] In the example of Figure 10 (A), a vehicle speed display J1 of "80 km / h", a navigation arrow display J2, a warning display J3 of "Exceeding speed" and a warning mark J4 (collectively referred to here as "warning displays"), and a POI display J5 indicating destination 46 are displayed.

[0103] The navigation arrow display J2 and the warning display J4 overlap, but in the overlapping area, the warning display J4, which has a higher priority, is given priority and is displayed in front. Also, in the example of Fig. 10(A), the overall visibility of the navigation arrow display J2 is reduced to make it easier to see.

[0104] 10B, the navigation arrow display J4 with low priority is entirely hidden, making the attention-call mark J4 as a warning display more visible.

[0105] Next, reference is made to Fig. 11. Fig. 11(A) to (C) are diagrams showing an example in which overlap between virtual images displayed by a HUD device is suppressed by implementing measures to avoid overlap of display pixels.

[0106] Figure 11 (A) shows a first POI display (a display indicating the presence of a convenience store) J10 placed on the foreground (closer to vehicle 1) in the virtual image display area 3, a display J20 of TSR (traffic sign recognition) information such as "speed limit" and "school route" placed behind J10, and a second POI display J30 (a display indicating the location of destination 47) placed on the background (farther from vehicle 1).

[0107] In FIG. 11A, J10 and J20 partially overlap, but in the overlapping portion, J10, which has a higher display priority, is displayed preferentially.

[0108] In addition, in Fig. 11(B), J20, which has a low display priority, is hidden. However, to inform the driver that there is a hidden content, a display of "1 item hidden" is added.

[0109] In Fig. 11(C), after the visibility of J10 is confirmed, J20, which was not displayed until then, is displayed. Note that it is also possible to return to the state of Fig. 11(A) after this.

[0110] Next, reference will be made to Fig. 12. Fig. 12(A) is a diagram showing an example of the system configuration of a HUD device, and Fig. 12(B) is a diagram showing an example of the specific configuration of the main parts of the HUD device.

[0111] The system shown in Figure 12 (A) has a display control unit (display control device) 300 included in the control unit 290, an object detection unit 801, a vehicle information detection unit 803, the three-dimensional display unit 230 previously shown in Figure 8, a first actuator 177, and a second actuator 179.

[0112] The control unit (HMI control unit) 300 has an I / O interface 741, a processor 742, and a memory 743. The control unit (HMI control unit) 300, the object detection unit 801, and the vehicle information detection unit 803 are connected to a communication line (such as a BUS).

[0113] Moreover, the first actuator 177 and the second actuator 179 can be used as the rotating section (rotating mechanism) 175 and the adjusting section 173 shown in Fig. 8. These can also be said to be an adjusting system for the optical system or the display section.

[0114] The object detection unit 801 can be configured, for example, by an external sensor or an external camera provided on the vehicle 1. The vehicle information detection unit 803 can be configured, for example, by a speed sensor, a vehicle ECU, an external communication device, a sensor that detects the position of the eyes, a yaw rate sensor that detects the pitch angle (inclination angle) of the vehicle 1, or a height sensor. The display control unit (display control device) 300 appropriately performs predetermined image processing based on the detection information from the object detection unit 801 and the information from the vehicle information detection unit 803, and achieves both a suitable display of perspective and reliable notification of information to the viewer (driver, HUD user).

[0115] In addition, the one or more processors 742 can, for example, acquire position information of the road surface 40, and based on the acquired information, drive at least one of the first and second actuators 177, 179 to adjust the virtual image display position, etc.

[0116] Next, Fig. 12(B) will be referred to. As shown in Fig. 12(B), the control unit (HMI control unit) 300 has a light field rendering unit 302 and a display driving unit 336. The light field rendering unit 302 has an input / output interface (I / F) 304, an image generating unit (light field data generating unit) 310, a multi-viewpoint image storage unit (image database) 312, a left-eye image buffer 332, and a right-eye image buffer 334.

[0117] In the multi-viewpoint image storage unit (image database) 302, for example, samples of multi-viewpoint images (original images) for the display object are stored.

[0118] An image generating unit (light field data generating unit) 310 generates light field data. The generated data is temporarily stored in image buffers 332 and 334 for the left and right eyes, and then supplied to a display unit (flat display) 210 via a display unit driving unit 336 as a left-eye parallax image GL and a right-eye parallax image GR.

[0119] The vehicle 1 also has an pupil imaging camera 900 that images the user's eyes, a gaze detection unit (viewpoint position detection unit) 902 that detects the user's viewpoint position, a visual confirmation detection unit (visual confirmation unit) 903 that detects (confirms) that the viewer has viewed a specific display, a surrounding imaging camera 17, and a driving scene determination unit 19 that includes an image processing unit 21.

[0120] Next, Fig. 13 will be referred to. Fig. 13 is a diagram showing an example of the configuration of functional blocks of the control unit (HMI control unit). The control unit (HMI control unit) 300 has, as functional blocks, for example, a display mode determination unit 302, an overlap detection unit 303 that detects at least one of overlap and overlap possibility of display pixels, an overlap mode detection unit 304 that detects what kind of overlap mode there is, an overlap suppression control unit 305, and an image generation control unit 306.

[0121] Here, the overlap suppression control unit 305 performs overlap suppression control. The image generation control unit 306 controls the generation operation by rendering the light field data, for example.

[0122] Next, reference is made to Fig. 14. Fig. 14 is a diagram showing, in a table format, an example of setting the display priority for each display content (presentation information) according to the driving scene.

[0123] In FIG. 14, the driving scenes determined by the driving scene determination unit 19 (see FIG. 12(B)) are shown as follows: a first scene of a city area on a clear day (city or traffic volume is equal to or greater than a predetermined value), or a highway (city) on a clear day, or a crowded intersection, or a school route; a second scene of a city area on a clear day (countryside or traffic volume is less than a predetermined value), or a highway (countryside) on a clear day, or when the driver is looking away or returning from looking away, or a location or area where accidents frequently occur; a third scene of a city area at night (city or traffic volume is equal to or greater than a predetermined value), or a highway (city) at night; a fourth scene of a city area at night (countryside or traffic volume is less than a predetermined value), or a highway (countryside) at night; a fifth scene of a traffic jam while stopped; a sixth scene of a case where the vehicle is restricted in traveling (including a U-turn is prohibited or under construction); and a seventh scene of an automatic driving scene. It is not necessary to include all of these seven driving scenes, but it is preferable to include at least four of them.

[0124] FIG. 14 also shows a warning display, a navigation display, a POI display, and a traffic sign recognition (TSR) display as display contents (information presented by display) to which priority is assigned.

[0125] Also, numbers are added inside the table in Fig. 14, and the lower the number, the higher the display priority (priority order). In Fig. 14, the display priority of each of the four display contents corresponding to the seven driving scenes is determined in advance in a list format (table format). This allows the priority of the display contents (display information) to be updated quickly according to each driving scene, and appropriate display control to be performed.

[0126] In principle, the priority order is as follows, from highest to lowest: warning display, navigation display, POI display, TSR information, etc. However, in the sixth scene, the priority order of TSR information, etc. is exceptionally set to "1".

[0127] In addition, in Figure 14, the warning display is further divided into a first warning for high relative speed objects (including oncoming vehicles and pedestrians), a second warning for low relative speed objects (including vehicles traveling in the same direction), and a third warning for notifications regarding the situation around the vehicle (including notifications of natural disasters and traffic accidents).

[0128] The warning display is further divided into three types (1st, 2nd, and 3rd warning), and a priority is set for each of them for each driving scene. Here, the 1st warning has the highest priority, and as for the 2nd and 3rd warnings, the 2nd warning has a higher priority than the 3rd warning in the 1st to 6th scenes, but in the 7th scene (during autonomous driving), the driver is basically not involved in driving, so the 2nd and 3rd warnings are set to have the same priority (both are set to a priority of "3" in Fig. 14).

[0129] Even when there are multiple warning displays and the display pixels of one warning display overlap with the display pixels of another warning display, the system can suppress pixel overlap according to the priority (priority order) that takes into account the driving scene set for each warning content (warning type). Since warnings can always be displayed appropriately, safety is improved.

[0130] Next, reference is made to Fig. 15. Fig. 15 is a flowchart showing an example of an operational procedure of control for avoiding overlapping of display pixels in a HUD device.

[0131] For example, the light field rendering unit 302 in FIG. 12(B) first sets a first display position that includes at least the depth position of a first image showing first information, and a second display position that includes at least the depth position of a second image showing second information (step S1).

[0132] Next, it is determined whether a first pixel used when displaying a first image at a first display position and a second pixel used when displaying a second image at a second display position overlap, or whether there is a possibility of overlap (step S2).

[0133] Next, if it is determined that there is a high possibility that the first pixel and the second pixel overlap, the image with the higher priority between the first information and the second information is displayed preferentially, and overlap suppression control (overlap avoidance processing) is implemented, which includes not displaying at least the overlapping pixels of the image with the lower priority (step S3).

[0134] In this way, according to the present invention, in a HUD device having a light field type stereoscopic display unit, it is possible to avoid (suppress) a situation in which proper light field rendering cannot be performed due to overlap between pixels for displaying one image and pixels for displaying another image.

[0135] In this specification, the term "vehicle" may be broadly interpreted as a vehicle. In addition, terms related to navigation (e.g., signs, etc.) are also broadly interpreted, taking into consideration the perspective of broad navigation information useful for vehicle operation, etc. In addition, the HUD device includes those used as simulators (e.g., aircraft simulators, game consoles, etc.). In addition, the types of display units and optical members are not limited to those in the above embodiment, and various types may be adopted.

[0136] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art could easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims. [Explanation of symbols]

[0137] 1···vehicle (own vehicle), 2···projected part (windshield, etc.), 3···HUD display area, 17···surroundings imaging camera, 19···driving scene determination unit, 21···image processing unit, 22···viewer (observer, driver, user), 300···control unit (HMI control unit), 36···attribute determination unit for display object, 40···road surface, 100···HUD device, 171···curved mirror (concave mirror, etc.), 210···flat display as display unit, 220....Optical member (lenticular lens, etc.), 230....3D display unit (3D display unit), 290....Control device, 300....Control unit (HMI (human interface) control unit), 310....Image generation unit (light field data generation unit), 900....Pupil imaging camera, 902....Gaze detection unit, 903....Visibility detection unit (visibility confirmation unit), IM1, IM2...First and second images, first and second display images, or first and second stereoscopic images

Claims

1. A head-up display (HUD) device for displaying a virtual image, comprising: a light field type stereoscopic display unit including a display and an optical member and reproducing light rays of a stereoscopic image; an optical system that projects the light beam reproduced by the stereoscopic display unit onto a projection target; A control unit that controls display of an image on the display; having When the distance between the stereoscopic display unit and the stereoscopic image is defined as a depth distance, and the direction along the depth distance when the stereoscopic image is viewed from the stereoscopic display unit is defined as a depth direction, The control unit is setting a first display position including at least a position in a depth direction of a first image showing the first information, and a second display position including at least a position in a depth direction of a second image showing the second information; determining whether or not a first pixel on the display used when displaying the first image at the first display position overlaps with a second pixel used when displaying the second image at the second display position, and / or whether there is a possibility of overlap; If it is determined that the first pixel and the second pixel overlap or are likely to overlap, Implementing overlap suppression control including giving priority to the display of an image having a higher display priority and turning off or reducing the brightness of at least the pixels of the overlapping portion of an image having a lower display priority; A head-up display device.

2. The control unit is The head-up display device according to claim 1, characterized in that when at least one of the first and second images is a dynamic image corresponding to a virtual image superimposed on a moving object, the possibility of the overlap is determined based on a prediction of the movement of the object.

3. The control unit is 3. The head-up display device according to claim 1, wherein the overlap suppression control is performed by prioritizing the displays in the order of highest priority, namely, a warning display, a navigation display, a POI (Point Of Interest) display, and other displays.

4. Further comprising a driving scene determination unit, 4. The head-up display device according to claim 1, wherein the control unit variably controls a priority order of the display images in accordance with a driving scene.

5. Further comprising a visual detection unit, The control unit is and after displaying one of the images in accordance with the priority order, when the visibility detection unit detects that the displayed image has been viewed by a viewer, releasing at least a part of the display restriction on pixels of the other image, the display of which has been restricted. The head-up display device according to any one of claims 1 to 4.

6. The control unit is When a pixel for displaying the first image and a pixel for displaying the second image do not overlap but are within a predetermined distance, or when it is determined that a distance between the pixels has become closer to within the predetermined distance due to a movement of at least one pixel, the overlap suppression control is performed on the pixel of the image having a lower priority.

6. The head-up display device according to claim 1, wherein the head-up display device is a head-up display.

7. The control unit is when it is determined that the pixels for displaying the first image and the pixels for displaying the second image do not overlap but that the two pixels have come close to each other within a predetermined distance due to the movement of at least one of them, and the distance between the two pixels becomes smaller over time, a fade-out process is performed to gradually reduce the brightness of the pixels of the image having a lower priority.

7. The head-up display device according to claim 1, wherein the head-up display device is a head-up display.

8. The control unit is displaying a notification image indicating that a restriction is imposed on display of an image with a low priority due to the overlap suppression control; The head-up display device according to any one of claims 1 to 7.

9. The driving scene determined by the driving scene determination unit is A first scene of a city area on a sunny day (a city or a city with a traffic volume of a certain value or more), or a highway on a sunny day (a city), or a busy intersection, or a school route, A second scene in a city on a clear day (in the countryside or with traffic volume below a certain level), or on a highway on a clear day (in the countryside), or when the driver is looking away or returning from looking away, or in a location or area where accidents frequently occur; A third scene of a nighttime urban area (urban area or area with traffic volume above a certain value) or a nighttime highway (urban area); A fourth scene of a nighttime urban area (rural area or traffic volume below a certain value) or a nighttime highway (rural area); The fifth scene, during a traffic jam stop, The sixth scene is when there are restrictions on vehicle movement (including no U-turns or construction work). The seventh scene during autonomous driving, at least four of As indications to which priority is given, warning display, Navigation display, POI display, Traffic Sign Recognition (TSR) indications; The head-up display device according to claim 4 .

10. The warning display is: A first warning about high relative velocity objects (including oncoming vehicles and pedestrians); A second warning for low relative velocity objects (including vehicles traveling in the same direction); and A third warning regarding the situation around the vehicle (including natural disasters and traffic accidents); Including, The first warning is set to have a higher priority for display than the second and third warnings, Regarding the second warning and the third warning, the second warning is set to have a higher priority in the first to sixth scenes, but the second warning and the third warning are set to have the same priority in the seventh scene. The head-up display device according to claim 9 .

Images