Display control device, head-up display device, and display control method

Abstract

To make it less easy to notice the change of the perceived size of a virtual image caused by change of a display distance.SOLUTION: A headup display device 20 displays a virtual image of a static content V20 in a virtual display region 100 inclined to a road surface to have a near-sighted position 101, which is near to an observer, and a far-sighted position 102, which is far from the observer. An image position adjusting unit 510 adjusts the position of the static content V20. An image size adjusting unit 520 adjusts the size of the static content V20 so that the observer sees the static content of a second size smaller than a first size when the static content V20 is arranged in the far-sighted position 102, the first size being the size of the static content V20 when the static content is displayed in the near-sighted position 101.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to a display control device, a head-up display device, and a display control method that are used in a vehicle and allow an image to be visually superimposed on a view in front of the vehicle. [Background technology]

[0002] Patent Document 1 discloses a head-up display device (HUD device) in which the upper end of a virtual image display area in which an image (virtual image) is displayed is positioned farther from the observer than the lower end. Such a HUD device can change the distance (display distance) from the observer to the image (virtual image) by changing the display position of the image (virtual image) within the virtual image display area. In other words, it is possible to add an appearance of depth to the image (virtual image). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-51231 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a known optical illusion (sometimes called the Corridor Illusion) in which the retinal image of a visual object perceived (and / or judged by the human brain) at a far-sighted position appears larger than the retinal image of the visual object perceived at a near-sighted position.

[0005] Even in a HUD device in which the virtual image display area is tilted from a direction perpendicular to the road surface, due to the influence of the optical illusion described above, a virtual image seen at a far-sighted position far from the observer tends to appear larger than a virtual image seen at a near-sighted position.

[0006] A summary of certain embodiments disclosed herein is provided below. It should be understood that these aspects are presented merely to provide the reader with an overview of these particular embodiments, and are not intended to limit the scope of the disclosure. Indeed, the disclosure may encompass a variety of aspects not set forth below.

[0007] The present disclosure relates to preventing a virtual image viewed at a far-sighted position from appearing larger than a virtual image viewed at a near-sighted position, and also to making it difficult to notice a change in the perceived size of the virtual image due to a change in display distance.

[0008] Therefore, a display control device in a first embodiment described in this specification is a display control device that controls a head-up display device that displays a virtual image of static content in a display area that is tilted with respect to a road surface so as to have a near-vision position close to a viewer and a far-vision position far from the viewer, and includes an image position adjustment unit that adjusts the position of the static content, and when the size of the static content when displayed at the near-vision position is a first size, when the static content is placed at the far-vision position: To prevent the image from appearing larger as the viewing distance increases and an image size adjustment unit that performs a first size adjustment process to adjust the size of the static content so that it is visually recognized by a viewer as a second size smaller than the first size.

[0009] In the first embodiment, the size of the static content displayed at a far-sighted position, which tends to be perceived as large, is made smaller than when it is displayed at a near-sighted position. That is, it has the advantage that the tendency to be perceived as large due to an increase in the display distance can be suppressed (or offset or reversed) by reducing the size. The size of the static content can be represented by the angle (viewing angle) formed by the visual object projected onto the eye. However, since the position of the observer's eye is not constant, here, the size of the static content is the angle (viewing angle) formed by the visual object with a predetermined point inside the vehicle as the apex. The first size can be said to be the angle (viewing angle) formed by the static content when displayed at a near-sighted position with a predetermined point as the apex, and the second size can be said to be the angle (viewing angle) formed by the static content when displayed at a far-sighted position with the predetermined point as the apex.

[0010] Also, in the display control device in the second embodiment that can be subordinate to the first embodiment, in the first size adjustment process, the image size adjustment unit adjusts the first size and the second size so as to satisfy the following formula: Ms < AS21 / AS11 < 1. Here, Ms is the ratio of the size of an object at a far-sighted position to the size of an object at a near-sighted position as seen from a predetermined position in nature, AS11 is the first size, and AS21 is the second size.

[0011] In the second embodiment, the magnification (reduction rate) AS21 / AS11 of the second size at the far-sighted position with respect to the first size at the near-sighted position is set to be larger than the ratio of the size of an object at a far-sighted position as seen from a predetermined position to the size of an object at a near-sighted position as seen from the same predetermined position. That is, the first size adjustment process in the second embodiment becomes gentler than the expression of the change in size with respect to the distance by perspective, and while suppressing the amount of change in the size of the virtual image, it is also assumed to have the advantage that the tendency to be perceived as large due to an increase in the display distance can be suppressed (or offset or reversed).

[0012] In a display control device according to a third embodiment that may be dependent on the first or second embodiment, static content is displayed so as to appear higher in relation to the road surface than the display area. In the third embodiment, a first size adjustment process is performed on content that is displayed so as to appear higher in relation to the road surface than the display area.

[0013] Furthermore, in a display control device in a fourth embodiment that may be dependent on one or more of the first to third embodiments, the image position adjustment unit further executes a first image movement process that moves static content from one of a near-vision position or a far-vision position to the other based on an operation by the observer, and the first image movement process includes a visibility reduction process that reduces the visibility of the static content or hides it and displays one or more frame images surrounding the static content, a manual image movement process that moves the one or more frame images from one of a near-vision position or a far-vision position to the other based on an operation by the observer, and a visibility increase process that reduces the visibility of the frame image or hides it and increases the visibility of the static content or re-displays it at the position where the one or more frame images are located.

[0014] In the fourth embodiment, when a viewer moves static content by operation, the static content is hidden and one or more frame images surrounding the static content are displayed. The viewer can adjust the position of the static content (frame image) by operation while looking at the frame image. Once the position of the static content (frame image) is determined, the frame image is hidden and the static content is displayed again. In this way, when the static content moves between the near-vision position and the far-vision position (in other words, the display distance of the static content changes), the displayed (or highly visible) image is switched from the static content to the frame image, which is expected to have the advantage of making it less noticeable that the change in perceived size due to the change in display distance occurs.

[0015] Furthermore, in a display control device in a fifth embodiment that can be dependent on the fourth embodiment, the image position adjustment unit, in a manual image movement process, 1) when one or more frame images are moved from a near-sighted position to a far-sighted position, makes one frame image smaller or narrows the spacing between the multiple frame images depending on the positions of the one or more frame images, and 2) when one or more frame images are moved from a far-sighted position to a near-sighted position, makes one frame image larger or widens the spacing between the multiple frame images depending on the positions of the one or more frame images.

[0016] In the fifth embodiment, when a border image moves, it is possible to suppress (or cancel out or reverse) a change in the perceived size of the border image due to a change in display distance. By making the border image smaller (narrowing the interval between multiple border images) as the display distance of one or more border images increases, it is possible to suppress, cancel out, or reverse (conversely, make the border image perceived as smaller) a change in the perceived size of the border image (which tends to be perceived as larger). On the other hand, by making the border image larger (widening the interval between multiple border images) as the display distance of one or more border images decreases, it is possible to suppress, cancel out, or reverse (conversely, make the border image perceived as larger) a change in the perceived size of the border image (which tends to be perceived as smaller).

[0017] Furthermore, in a display control device of a sixth embodiment that can be dependent on the fourth embodiment, the image position adjustment unit hides static content in the visibility reduction process, and when one or more frame images are moved from one of the near-vision position or the far-vision position to the other in the manual image movement process, maintains the size of the one or more frame images or maintains the spacing between the multiple frame images, and when the static content is re-displayed by the visibility increase process, adjusts the size of the static content depending on the position at which the static content is displayed.

[0018] In the sixth embodiment, when a frame image is moved, the size of the frame image does not change regardless of the position, which is expected to have the advantage of reducing the sense of incongruity caused by the change in size due to the movement. Also expected to have the advantage of reducing the processing load of the size change due to the movement.

[0019] Further, in a seventh embodiment that may depend on one or more of the fourth to sixth embodiments, the display control device, the image position adjustment unit further performs a second image movement process of moving static content from one of a near vision position and a far vision position to the other based on at least one of vehicle information regarding a vehicle on which a head-up display is mounted, environmental information regarding an environment in which the vehicle travels, and user information regarding an observer, and in the second image movement process, a second size adjustment process different from the first size adjustment process is performed.

[0020] Also, in an eighth embodiment that may depend on the seventh embodiment, the display control device, when the second size adjustment process sets the size of static content displayed at the near vision position to a third size, if the static content is arranged at the far vision position, the size of the static content is adjusted so as to be visually recognized by the observer at a fourth size smaller than the third size, and the image size adjustment unit adjusts the third size and the fourth size so as to satisfy the following formula in the second size adjustment process. AS22 / AS12 < AS21 / AS11 < 1. Here, AS11 is the first size, AS21 is the second size, AS12 is the third size, and AS22 is the fourth size.

[0021] Also, the head-up display device in the ninth embodiment includes the display control device according to any one of the first to eighth embodiments, a display for displaying an image on a display surface, and one or more relay optical systems for projecting display light of the image displayed by the display onto an external projection portion so as to display a virtual image of the image within a display area that overlaps the foreground when viewed from an eyebox, and a display area conjugate to the display surface is inclined with respect to the road surface.

[0022] Furthermore, the display control method in the tenth embodiment is a display control method for controlling a head-up display device that displays a virtual image of static content in a display area inclined with respect to the road surface so as to have a near-vision position close to the observer and a far-vision position far from the observer, and includes adjusting the position of the static content, and performing a first size adjustment process that adjusts the size of the static content so that, when the size of the static content when displayed at the near-vision position is a first size, when the static content is placed at the far-vision position, it is perceived by the observer at a second size smaller than the first size. [Brief explanation of the drawings]

[0023] [Figure 1] FIG. 1 is a diagram showing an application example of a vehicle display system. [Figure 2] FIG. 2 is a diagram showing the configuration of the image display unit. [Figure 3] FIG. 3 is a diagram showing an example of a virtual image displayed by the head-up display device. [Figure 4] FIG. 4 is a block diagram of a vehicle display system. [Figure 5] FIG. 5 is a diagram showing the viewing angle of static content displayed at the near-vision position in the virtual image display area and the viewing angle of static content displayed at the far-vision position. [Figure 6A] FIG. 6A is a graph illustrating the variation in size of static content with viewing distance in some embodiments. [Figure 6B] FIG. 6B is a graph illustrating the variation in size of static content with viewing distance in some embodiments. [Figure 6C] FIG. 6C is a graph illustrating the variation in size of static content with viewing distance in some embodiments. [Figure 6D] FIG. 6D is a graph illustrating the variation in size of static content with viewing distance in some embodiments. [Figure 7] FIG. 7 is a diagram illustrating the size adjustment process in some embodiments. [Figure 8] FIG. 8 is a diagram illustrating the size adjustment process in some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0024] The following provides an explanation of this embodiment with reference to Figures 1 to 8. Note that the present invention is not limited to the following embodiment (including the contents of the drawings). Of course, modifications (including the deletion of components) can be made to the following embodiment. In addition, in the following explanation, explanations of well-known technical matters will be omitted as appropriate to facilitate understanding of the present invention.

[0025] Referring to Fig. 1, a vehicle display system 10 of this embodiment is made up of an image display unit 20, a display control device 30 that controls the image display unit 20, and electronic devices connected to the display control device 30, which will be described later.

[0026] The image display unit 20 in the vehicular display system 10 is a head-up display (HUD) device provided in the dashboard 5 of the vehicle 1. The image display unit 20 emits display light 40 toward a front windshield 2 (an example of a projection target), and the front windshield 2 reflects the display light 40 of the image M displayed by the image display unit 20 toward an eye box 200. By placing an eye 4 inside the eye box 200, an observer can view a virtual image V of the image M displayed by the image display unit 20 at a position superimposed on the foreground, which is real space viewed through the front windshield 2. In the drawings used in this embodiment, the left-right direction of the vehicle 1 is defined as the X-axis direction (the left side when facing forward of the vehicle 1 is the X-axis positive direction), the up-down direction is defined as the Y-axis direction (the upper side of the vehicle 1 traveling on a road surface is the Y-axis positive direction), and the front-rear direction of the vehicle 1 is defined as the Z-axis direction (the front of the vehicle 1 is the Z-axis positive direction).

[0027] The term "eyebox" used in the description of this embodiment refers to (1) a region within which at least a portion of the virtual image V of image M is visible, but no portion of the virtual image V of image M is visible outside the region; (2) a region within which at least a portion of the virtual image V of image M is visible at a predetermined luminance or higher, but the entire virtual image V of image M is below the predetermined luminance outside the region; or (3) a region within which, if the image display unit 20 is capable of displaying a virtual image V that can be viewed stereoscopically, at least a portion of the virtual image V is stereoscopically visible, but no portion of the virtual image V is stereoscopically visible outside the region. In other words, when the observer positions their eyes (both eyes) 4 outside the eyebox 200, the observer cannot view the entire virtual image V of image M, the entire visibility of the virtual image V of image M is very low and difficult to perceive, or the virtual image V of image M cannot be viewed stereoscopically. The predetermined luminance is, for example, approximately 1 / 50 of the luminance of the virtual image of image M viewed at the center of the eyebox.

[0028] The virtual image display area 100 is a flat, curved, or partially curved area where an image M generated inside the image display unit 20 is formed as a virtual image V, and is also called an imaging surface. The virtual image display area 100 is a position where a display surface 21a (e.g., an exit surface of a liquid crystal display panel) of a display 21 (described later) of the image display unit 20 is formed as a virtual image. That is, the virtual image display area 100 corresponds to the display surface 21a (described later) of the image display unit 20 (in other words, the virtual image display area 100 has a conjugate relationship with the display surface 21a of the display 21 (described later).) It can be said that the virtual image viewed in the virtual image display area 100 corresponds to an image displayed on the display surface 21a (described later) of the image display unit 20. It is preferable that the virtual image display area 100 itself has low visibility so that it is not actually visible to the observer's eyes 4 or is difficult to view.

[0029] The downward angle based on the front-rear and left-right directions (XZ plane) of the host vehicle 1 is defined as the depression angle θv. The smaller the depression angle θv, the further upward (positive Y-axis direction) the observer sees the position, and the larger the depression angle θv, the further downward (negative Y-axis direction) the observer sees the position. In the virtual image display area 100 of this embodiment, the depression angle θv at the near-vision position 101, which is close to the observer 4, is larger than the depression angle θv at the far-vision position 102, which is far from the observer 4. In other words, the virtual image display area 100 is arranged so that the upper area is farther away than the lower area as seen by the observer.

[0030] In the description of this embodiment, the virtual image display area 100 is positioned entirely downward (the upper end is positioned at a position where one looks down) when viewed from the eyebox 200 (more specifically, for example, when viewed from the center 205 of the eyebox 200), but a portion of it may be positioned upward (the upper end is positioned at a position where one looks up) when viewed from the eyebox 200 (more specifically, for example, when viewed from the center 205 of the eyebox 200).

[0031] An angle (tilt angle θt in FIG. 1) formed between the horizontal direction (XZ plane) and the left-right direction (X-axis direction) of the vehicle 1 is set in the virtual image display area 100. The virtual image display area 110 in FIG. 1 is disposed tilted from the road surface 310 with the left-right direction (X-axis direction) of the vehicle 1 as its axis, and has a tilt angle θt of, for example, 30 degrees. However, the tilt angle θt is not limited to this and can be changed within the range of 0≦θt<45 degrees.

[0032] The virtual image display area 120 (100) may be provided substantially parallel to the road surface 310. The virtual image display area 120 (100) may be curved concavely on the viewer side. The virtual image display area 130 (100) may be curved convexly on the viewer side.

[0033] 2 is a diagram showing the configuration of the HUD device 20 of this embodiment. The HUD device 20 includes a display 21 having a display surface 21a that displays an image M, and a relay optical system 25.

[0034] 2 is composed of a liquid crystal display panel 22 and a light source unit 24. The display surface 21a is the viewer-side surface of the liquid crystal display panel 22, and emits display light 40 for an image M. The angle of the virtual image display area 100 (including the tilt angle θt) can be set by setting the angle of the display surface 21a with respect to an optical axis 40p of the display light 40 that travels from the center of the display surface 21a through the relay optical system 25 and the projection portion toward the eyebox 200 (the center of the eyebox 200).

[0035] The relay optical system 25 is arranged on the optical path of the display light 40 emitted from the display 21 (light traveling from the display 21 toward the eyebox 200), and is composed of one or more optical components that project the display light 40 from the display 21 onto the front windshield 2 outside the HUD device 20. The relay optical system 25 in FIG. 2 includes one concave first mirror 26 and one flat second mirror 27.

[0036] The first mirror 26 has, for example, a free-form surface shape having positive optical power. In other words, the first mirror 26 may have a curved surface shape with different optical powers in different regions, that is, the optical power added to the display light 40 may differ depending on the region (optical path) through which the display light 40 passes. Specifically, the optical power added by the relay optical system 25 may differ between the first image light 41, the second image light 42, and the third image light 43 (see FIG. 2 ) traveling from each region of the display surface 21a toward the eyebox 200.

[0037] The second mirror 27 is, for example, a flat mirror, but is not limited to this and may be a curved surface having optical power. That is, the relay optical system 25 may combine multiple mirrors (for example, the first mirror 26 and the second mirror 27 in this embodiment) to add different optical power depending on the region (optical path) through which the display light 40 passes. The second mirror 27 may be omitted. That is, the display light 40 emitted from the display 21 may be reflected by the first mirror 26 to the projection target (front windshield) 2.

[0038] Furthermore, in this embodiment, the relay optical system 25 includes two mirrors, but is not limited to this, and may additionally or alternatively include one or more refractive optical elements such as lenses, diffractive optical elements such as holograms, reflective optical elements, or combinations thereof.

[0039] Furthermore, the relay optical system 25 of this embodiment has the function of setting the distance to the virtual image display area 100 and the function of generating a virtual image that is an enlarged image of the image displayed on the display surface 21a, using this curved shape (an example of optical power), but in addition to this, it may also have the function of suppressing (correcting) distortion of the virtual image that may occur due to the curved shape of the front windshield 2.

[0040] In addition, the relay optical system 25 may be fitted with actuators 28 and 29 controlled by the display control device 30, so that the relay optical system 25 is rotatable.

[0041] The liquid crystal display panel 22 receives light from the light source unit 24, and emits spatially light-modulated display light 40 toward the relay optical system 25 (second mirror 27). The liquid crystal display panel 22 is, for example, rectangular in shape, with the shorter side aligned in the direction in which pixels corresponding to the vertical direction (Y-axis direction) of the virtual image V as seen by the observer are arranged. The observer views the light transmitted through the liquid crystal display panel 22 via a virtual image optical system 90. The virtual image optical system 90 is a combination of the relay optical system 25 and the front windshield 2 shown in FIG. 2.

[0042] The light source unit 24 is composed of a light source (not shown) and an illumination optical system (not shown).

[0043] The light source (not shown) is, for example, a plurality of chip-type LEDs, and emits illumination light to a liquid crystal display panel (an example of a spatial light modulation element) 22. The light source unit 24 is composed of, for example, four light sources, and is arranged in a row along the long side of the liquid crystal display panel 22. The light source unit 24 emits illumination light toward the liquid crystal display panel 22 under the control of the display control device 30. The configuration of the light source unit 24 and the arrangement of the light sources are not limited to this.

[0044] The illumination optical system (not shown) is composed of, for example, one or more lenses (not shown) arranged in the emission direction of the illumination light from the light source unit 24, and a diffusion plate (not shown) arranged in the emission direction of the one or more lenses.

[0045] The display 21 may be a self-luminous display or a projection display that projects an image onto a screen, in which case the display surface 21a is the screen of the projection display.

[0046] The display device 21 may be provided with an actuator (not shown) including a motor controlled by the display control device 30, so that the display surface 21a can be moved and / or rotated.

[0047] The relay optical system 25 has two rotation axes (a first rotation axis AX1 and a second rotation axis AX2) that move the eyebox 200 in the up-down direction (the Y-axis direction). When the HUD device 20 is attached to the vehicle 1, the first rotation axis AX1 and the second rotation axis AX2 are set so that they are not perpendicular to the left-right direction (the X-axis direction) of the vehicle 1 (in other words, not parallel to the YZ plane). Specifically, the angle between the first rotation axis AX1 and the second rotation axis AX2 and the left-right direction (the X-axis direction) of the vehicle 1 is set to less than 45 degrees, and more preferably less than 20 degrees.

[0048] The HUD device 20 includes a first actuator 28 that rotates the first mirror 26 about a first rotation axis AX1, and a second actuator 29 that rotates the first mirror 26 about a second rotation axis AX2. In other words, the HUD device 20 rotates one relay optical system 25 about two axes (the first rotation axis AX1 and the second rotation axis AX2). Note that the first actuator 28 and the second actuator 29 may be integrated into one two-axis actuator.

[0049] In another embodiment, the HUD device 20 rotates the two relay optical systems 25 about two axes (a first rotation axis AX1 and a second rotation axis AX2). For example, the HUD device 20 may include a first actuator 28 that rotates the first mirror 26 about the first rotation axis AX1 and a second actuator 29 that rotates the second mirror 27 about the second rotation axis AX2.

[0050] Note that the arrangement of the first rotation axis AX1 and the second rotation axis AX2 is not limited to this, as long as rotation about the first rotation axis AX1 causes a relatively large amount of vertical movement of the eyebox 200 and rotation about the second rotation axis AX2 causes a relatively large amount of vertical movement of the virtual image display area 100. Furthermore, driving by the actuator may include movement in addition to or instead of rotation.

[0051] Additionally, the HUD device 20 in other embodiments may not drive the relay optical system 25. In other words, the HUD device 20 may not have an actuator that rotates and / or turns the relay optical system 25. The HUD device 20 in this embodiment may have a wide eyebox 200 that covers the range of eye heights of drivers who are expected to use the vehicle 1.

[0052] The image display unit 20, under the control of a display control device 30 (described later), displays images near real objects 300, such as a road surface 310 of a driving lane, a fork in the road, a road sign, an obstacle (e.g., a pedestrian, a bicycle, a motorcycle, another vehicle), and a feature (e.g., a building, a bridge), which are present in the foreground, which is the real space (real scene) visually recognized through the front windshield 2 of the vehicle 1, at a position overlapping the real object 300, or at a position set based on the real object 300, thereby allowing an observer (typically, an observer seated in the driver's seat of the vehicle 1) to perceive visual augmented reality (AR). In the description of this embodiment, an image whose display position can be changed depending on the position of the real object 300 present in the real scene is defined as an AR image (dynamic content), and an image whose display position is set regardless of the position of the real object 300 is defined as a non-AR image (static content).

[0053] 3 is a diagram showing a real object 300 present in the foreground, which is visually recognized when an observer faces forward from the driver's seat of the vehicle 1, and a virtual image V displayed by the HUD device 20 of this embodiment. The virtual image V shown in FIG. 3 includes an AR (Augmented Reality) virtual image V10 whose display position, direction, and shape can be changed depending on the position, direction, and shape of the real object 300, and a non-AR virtual image V20 whose display position, direction, and shape are set regardless of the position, direction, and shape of the real object 300. The AR virtual image V10 is displayed at a position (target position PT) corresponding to the position of the real object 300 present in the real scene. The AR virtual image V10 is displayed, for example, at a position superimposed on the real object 300 or near the real object 300 to emphasize and notify the presence of the real object 300. That is, the "position corresponding to the position of the real object 300 (target position PT)" is not limited to a position superimposed on the real object 300 as viewed by the observer, but may be a position near the real object 300. Note that it is preferable that the AR virtual image V10 does not obstruct the view of the real object 300, but the embodiment is arbitrary.

[0054] 3 includes navigation virtual images V11 and V12 indicating a guide route, enhanced virtual images V14 and V15 that emphasize and notify of objects of attention, and a POI virtual image V15 that indicates a landmark, a predetermined building, etc. The position (target position PT) corresponding to the position of the real object 300 is the position of the road surface 311 (an example of the real object 300) on which the navigation virtual images V11 and V12 are superimposed, the position around the person 313 (an example of the real object 300) in the enhanced virtual image V13, the position near another vehicle 314 (an example of the real object 300) in the enhanced virtual image V14, and the position around the building 315 (an example of the real object 300) in the POI virtual image V15.

[0055] The non-AR virtual image (static content) V20 is disposed below the virtual image display area 100, and the area of ​​the road surface 311, which is the real object 300, overlapping with the non-AR virtual image (static content) V20 is closer to the vehicle 1 than the area of ​​the road surface 311 overlapping with the navigation virtual image V11 (V11, V12) in FIG. 3. The non-AR virtual image (static content) V20 shown in FIG. 3 is a speed virtual image V21 indicating the speed of the vehicle 1, a sign virtual image V22 indicating the speed limit (road sign), etc., and is an image whose display position is set regardless of the position of the real object 300. The upper end 100u of the virtual image display area 110 in FIG. 3 is disposed farther from the observer than the lower end 100b. That is, the virtual image V has a longer imaging distance (display distance) as the display position moves upward (in the positive Y-axis direction), and is perceived as being farther away. The static content V20 is expressed as being raised higher relative to the road surface 310 than the virtual image display area 100. For example, even if the angle between the virtual image display area 100 in which the static content V20 is displayed and the road surface 310 is 20 degrees, the static content V20 is represented so that the angle between the static content V20 and the road surface 310 perceived by the optical illusion is 90 degrees.

[0056] The display control device 30 in Figure 4 includes one or more I / O interfaces 31, one or more storage units 33, and one or more processing circuits 35, and includes the functions of a display control unit 500. Figure 4 is merely one embodiment, and the components shown may be combined into fewer components, or additional components may be present. For example, some or all of the functions of the display control unit 500 may be provided separately from the display control unit 500.

[0057] As shown in the figure, the processing circuit 35 is operatively coupled to the I / O interface 31. The I / O interface 31 communicates with a number of electronic control units (vehicle ECUs 421) and a number of on-board sensors (posture sensors 410, vehicle speed sensors 422, operation units 430, and eye position detection units 440) in accordance with the CAN (Controller Area Network) standard (also referred to as CAN communication). Note that the communication standard adopted by the I / O interface 31 is not limited to CAN and may include wired communication interfaces such as CANFD (CAN with Flexible Data Rate), LIN (Local Interconnect Network), Ethernet (registered trademark), MOST (Media Oriented Systems Transport; MOST is a registered trademark), UART, or USB, or in-vehicle communication (internal communication) interfaces that are short-range wireless communication interfaces within a range of several tens of meters, such as a personal area network (PAN) such as a Bluetooth (registered trademark) network or a local area network (LAN) such as an 802.11x Wi-Fi (registered trademark) network. The I / O interface 31 may also include an external communication interface for communication outside the vehicle, such as a wide area communication network (e.g., an Internet communication network) based on a cellular communication standard such as a wireless wide area network (WWAN0, IEEE802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, or 5G. The I / O interface 31 may also include a function for processing (converting, calculating, analyzing) information received from other electronic devices connected thereto.

[0058] As shown, the processing circuitry 35 is operatively coupled to the storage unit 33. More specifically, the processing circuitry 35 can execute programs stored in the storage unit 33 to control the display system 10 (HUD device 20), for example, by generating and / or transmitting image data. The processing circuitry 35 can include at least one general-purpose microprocessor (e.g., a central processing unit (CPU)), at least one application-specific integrated circuit (ASIC), at least one field-programmable gate array (FPGA), or any combination thereof. The storage unit 33 can include any type of magnetic media, such as a hard disk, any type of optical media, such as a CD or DVD, any type of semiconductor memory, such as volatile memory, and non-volatile memory. Volatile memory can include DRAM and SRAM, and non-volatile memory can include ROM and NVRAM.

[0059] The HUD device 20 is operatively coupled to the processing circuitry 35. Thus, the image displayed by the light modulation elements 51 may be based on image data received from the processing circuitry 35. The processing circuitry 35 controls the image displayed by the light modulation elements 51 based on information obtained from the I / O interface 31.

[0060] The processing circuitry 35 constructs a plurality of functional blocks by executing various programs stored in the storage unit 33. Specifically, the processing circuitry 35 has an image position adjustment unit 510, an image size adjustment unit 520, and a determination unit 530 as functional blocks of the display control unit 500.

[0061] Based on information obtained from the I / O interface 31, the image position adjustment unit 510 moves the static content V20 (1) upward in the positive direction of the Y axis (moving from the near-sighted position 101 to the far-sighted position 102), or (2) downward in the negative direction of the Y axis (moving from the far-sighted position 102 to the near-sighted position 101).

[0062] The image position adjustment unit 510 changes the position of the virtual image V by (1) changing the image data to be displayed on the display 21, (2) offsetting the position at which the image is displayed on the display surface 21a of the display 21, (3) driving the actuator 23 to offset the position at which it is projected onto the projection target 2, or a combination of these.

[0063] Based on operation information acquired from the operation unit 430 via the I / O interface 31, the image position adjustment unit 510 executes a first image movement process to move the static content V20 (1) upward in the positive Y-axis direction (moving from the near-sighted position 101 to the far-sighted position 102), or (2) downward in the negative Y-axis direction (moving from the far-sighted position 102 to the near-sighted position 101).

[0064] In addition, the image position adjustment unit 510 may perform a second image movement process based on at least one of vehicle information about the vehicle 1, environmental information about the environment in which the vehicle 1 is traveling, and user information about the observer, which are acquired from the I / O interface 31, to move the static content V20 (1) upward in the positive Y-axis direction (from the near-sighted position 101 to the far-sighted position 102), or (2) downward in the negative Y-axis direction (from the far-sighted position 102 to the near-sighted position 101).

[0065] The vehicle information indicates the speed acquired from the vehicle speed sensor 422. The image position adjustment unit 510 may execute a second image movement process in which (1) if the speed is faster than a predetermined speed threshold, the image is moved upward in the positive Y-axis direction (from the near-vision position 101 to the far-vision position 102), and (2) if the speed is slower than the predetermined speed threshold, the image is moved downward in the negative Y-axis direction (from the far-vision position 102 to the near-vision position 101). Note that the image position adjustment unit 510 may change the position of the image stepwise and / or continuously depending on the speed.

[0066] The vehicle information may also be attitude information indicating the attitude of the host vehicle 1 acquired from the attitude sensor 410. The image position adjustment unit 510 may perform a second image movement process in which (1) when the pitch angle (an example of attitude information) of the host vehicle 1 indicates that the host vehicle 1 is tilted forward more than a predetermined attitude threshold, the image is moved upward in the positive direction of the Y axis (from the near-vision position 101 to the far-vision position 102), and (2) when the pitch angle (an example of attitude information) of the host vehicle 1 indicates that the host vehicle 1 is tilted backward more than a predetermined attitude threshold, the image is moved downward in the negative direction of the Y axis (from the far-vision position 102 to the near-vision position 101). The image position adjustment unit 510 may change the position of the image stepwise / continuously according to the attitude information (an example of vehicle information). The vehicle information is information related to the host vehicle 1 and is not limited to the speed information or attitude information described above. The vehicle information may also be information indicating the driving mode of the host vehicle 1.

[0067] The environmental information may be road information indicating the type of road on which the host vehicle 1 is traveling, which is acquired from a navigation device (not shown). The image position adjustment unit 510 may perform a second image movement process in which (1) when it is estimated that the host vehicle 1 is traveling on a road on which the host vehicle 1 can travel at high speed (for example, a highway), the image is moved upward in the positive Y-axis direction (from the near-vision position 101 to the far-vision position 102), and (2) when it is estimated that the host vehicle 1 is traveling on a road on which the host vehicle 1 can travel at low speed (for example, an ordinary road or an urban area), the image is moved downward in the negative Y-axis direction (from the far-vision position 102 to the near-vision position 101).

[0068] Furthermore, the environmental information may be illuminance information indicating the illuminance around the host vehicle 1, which is acquired from an illuminance sensor (not shown). The image position adjustment unit 510 may perform a second image movement process in which (1) when the illuminance around the host vehicle 1 is higher than a predetermined illuminance threshold, the image is moved upward in the positive Y-axis direction (from the near-vision position 101 to the far-vision position 102), and (2) when the illuminance around the host vehicle 1 is lower than the predetermined illuminance threshold, the image is moved downward in the negative Y-axis direction (from the far-vision position 102 to the near-vision position 101). The image position adjustment unit 510 may change the position of the image stepwise and / or continuously according to the illuminance information (an example of environmental information). The environmental information is information about the environment around the host vehicle 1, and is not limited to the road information or illuminance information described above.

[0069] The user information may be eye height information indicating the height of the viewer's eyes, acquired from the eye position detection unit 440. The image position adjustment unit 510 may execute a second image movement process in which (1) if the viewer's eye height is higher than a predetermined height threshold, the image is moved upward in the positive Y-axis direction (from the near-vision position 101 to the far-vision position 102), and (2) if the viewer's eye height is lower than the predetermined height threshold, the image is moved downward in the negative Y-axis direction (from the far-vision position 102 to the near-vision position 101). Note that the image position adjustment unit 510 may change the position of the image stepwise and / or continuously according to the eye height information (an example of user information).

[0070] The user information may also be biometric information including the viewer's heart rate, etc., acquired from a biometric sensor (not shown). The image position adjustment unit 510 may perform a second image movement process in which (1) when it is estimated from the biometric information that the viewer is in a mildly tense state, the image is moved upward in the positive direction of the Y axis (from the near-vision position 101 to the far-vision position 102), and (2) when it is estimated from the biometric information that the viewer is in a severely tense state, the image is moved downward in the negative direction of the Y axis (from the far-vision position 102 to the near-vision position 101). The image position adjustment unit 510 may change the position of the image stepwise and / or continuously in accordance with the biometric information (an example of user information). The user information is information about the viewer and is not limited to the eye height information or biometric information described above.

[0071] The image size adjustment unit 520 performs size adjustment processing to (1) reduce the size when the image position adjustment unit 510 moves the static content V20 upward in the positive direction of the Y axis (from the near-vision position 101 to the far-vision position 102), and (2) increase the size when the image position adjustment unit 510 moves the static content V20 downward in the negative direction of the Y axis (from the far-vision position 102 to the near-vision position 101). Here, the size of the static content V20 is the angle formed by the visual object (static content V20) as seen from the viewpoint, and is also called the visual angle or angular size. That is, as shown in FIG. 5, the image size adjustment unit 520 makes the visual angle AS1 of the static content V20 displayed at the near-vision position 101 in the virtual image display area 100 larger than the visual angle AS2 of the static content V20 displayed at the far-vision position 102. The image size adjustment unit 520 may include table data, calculation formulas, etc. for setting the viewing angle AS of the static content V20 from the display distance of the static content V20 (or the vertical position (display height) at which the static content V20 is displayed, or operation information, vehicle information, environmental information, user information that are the basis for setting these display distances and display heights).

[0072] 6A to 6D are graphs showing a change characteristic Q of the size of static content V20 with respect to viewing distance in some embodiments, and a change characteristic P of the size of an object in the natural world with respect to viewing distance, where the horizontal axis is distance VD and the vertical axis is the visual angle of the static content V20 or the object in the natural world viewed from a distance VD away. Assuming that the actual size of an object in the natural world is BS, the change characteristic P of the visual angle of an object viewed from a distance VD away is expressed by the relational expression P = 2 arctan(BS / VD). That is, at a greater distance VD, the rate of change of the visual angle with respect to a change in distance VD is small, and at a shallower distance VD, the rate of change of the visual angle with respect to a change in distance VD is large. The image size adjustment unit 520 adjusts the visual angle AS of the static content V20 so that the change characteristic Q of the visual angle with respect to a viewing distance of the static content V20 changes more gradually with respect to distance VD than the change characteristic P of the visual angle with respect to a viewing distance of an object in the natural world.

[0073] In the change characteristic Q1 in some embodiments, as shown in FIG. 6A, the change rate of the viewing angle AS with respect to the change in the distance VD at a deep position of the distance VD is small, and the change rate of the viewing angle AS with respect to the change in the distance VD at a shallow position of the distance VD is large. Let the viewing angle of an object in nature at a predetermined distance VD1 at the myopic position 101 be M1, the viewing angle of the static content V20 be AS1, the viewing angle of an object in nature at a predetermined distance VD2 at the hyperopic position 102 be M2, and the viewing angle of the static content V20 be AS2. Then, the ratio of the viewing angle at the hyperopic position 102 to the viewing angle at the myopic position 101 is expressed by the relational expression M2 / M1 < AS2 / AS1 < 1 (in the claims, M2 / M1 is described as Ms). For example, the ratio Ms of the size M2 when the distance VD of an object in nature is 10 [meter] (assuming the hyperopic position 102) to the size M1 when it is 4 [meter] (assuming the myopic position 101) is about 40%. On the other hand, the image size adjustment unit 520 sets the ratio AS2 / AS1 of the viewing angle AS2 when the static content V20 is displayed at 10 [meter] (assuming the hyperopic position 102) to the viewing angle AS1 when it is displayed at 4 [meter] (assuming the myopic position 101) to be about 90%.

[0074] In the change characteristic Q2 in some embodiments, as shown in FIG. 6B, the viewing angle AS may gradually decrease linearly as the distance VD increases.

[0075] Also, in the change characteristic Q3 in some embodiments, as shown in FIG. 6C, the change rate of the viewing angle AS with respect to the change in the distance VD at a deep position of the distance VD is large, and the change rate of the viewing angle AS with respect to the change in the distance VD at a shallow position of the distance VD is small. In particular, in the change characteristic Q3 shown in FIG. 6C, the change rate of the viewing angle AS with respect to the change in the distance VD at a shallow position of the distance VD is zero.

[0076] In some embodiments, the change characteristic Q4 may change the viewing angle AS stepwise as the distance VD changes, as shown in Fig. 6D. Specifically, the change characteristic Q4 in Fig. 6D is constant at a viewing angle AS2 regardless of the distance VD when the distance VD is large, and is constant at a viewing angle AS1 regardless of the distance VD when the distance VD is small.

[0077] The image position adjustment unit 510 executes a first image movement process that moves the static content V20 from one of the near vision position 101 and the far vision position 102 to the other, based on the observer's operation of the operation unit 430. The first image movement process includes a visibility reduction process that reduces the visibility of the static content V20 or hides it, and displays one or more frame images V30 that surround the static content V20, a manual first image movement process that moves the one or more frame images from one of the near vision position 101 and the far vision position 102 to the other, based on the observer's operation, and a visibility increase process that reduces the visibility of the frame image V30 or hides it, and increases the visibility of the static content V20 at the position where the one or more frame images V30 are arranged, or re-displays it.

[0078] In the first manual image movement process, the image position adjustment unit 510: 1) when one or more frame images are moved from the near-sighted position 101 to the far-sighted position 102, the image position adjustment unit 510 makes one frame image smaller or narrows the spacing between the multiple frame images depending on the position of the one or more frame images V30; and 2) when one or more frame images are moved from the far-sighted position 102 to the near-sighted position 101, the image position adjustment unit 510 makes one frame image larger or widens the spacing between the multiple frame images depending on the position of the one or more frame images.

[0079] FIG. 7 illustrates a size adjustment process in some embodiments, changing in order from (a) to (d). When an operation to move static content V20 is detected, the image position adjustment unit 510 performs a visibility reduction process to reduce the visibility of the static content V20 (or may hide it) from the relatively high visibility state shown in FIG. 7(a) to that shown in FIG. 7(b) and display multiple (e.g., four) frame images V30 surrounding the static content V20. The image position adjustment unit 510 narrows the spacing between the multiple frame images V30 as shown in FIG. 7(c) in accordance with the position of the static content V20 that moves based on the observer's operation. When the movement based on the operation is completed, the image position adjustment unit 510 performs a visibility increase process to hide the frame image V30 (or may reduce its visibility) and increase the visibility (brightness) of the static content V20 at the position where the multiple frame images V30 are arranged, as shown in FIG. 7(d). When the viewer operates to move the static content, the static content is hidden and one or more frame images surrounding the static content are displayed. The viewer can adjust the position of the static content (frame image) by operating while looking at the frame image. Once the position of the static content (frame image) is determined, the frame image is hidden and the static content is redisplayed. In this way, when the static content moves between the near-vision position and the far-vision position (in other words, the display distance of the static content changes), the displayed (or highly visible) image is switched from the static content to the frame image, which is expected to have the advantage of making it less noticeable that the change in perceived size due to the change in display distance occurs.

[0080] Furthermore, in some embodiments, the image position adjustment unit 510 hides the static content V20 in the visibility reduction process as shown in FIG. 8(b). When one or more frame images are moved from one of the near-vision position 101 and the far-vision position 102 to the other in the manual first image movement process, the image position adjustment unit 510 maintains the size of one or more frame images or maintains the spacing between the frame images as shown in FIG. 8(c). When the static content V20 is redisplayed in the visibility increase process, the image position adjustment unit 510 adjusts the size of the static content V20 depending on the display position of the static content V20 as shown in FIG. 8(d). In this embodiment, when the frame image moves, it is possible to suppress (or offset or reverse) a change in the perceived size of the frame image due to a change in display distance. By making the frame image smaller (narrowing the spacing between the frame images) as the display distance of one or more frame images increases, it is possible to suppress, offset, or reverse (conversely, make the frame image perceived as being larger) a change in the perceived size of the frame image. On the other hand, by making the frame images larger (increasing the spacing between the frame images) as the display distance of one or more frame images becomes shorter, the change in the perceived size of the frame images (which tend to be perceived as smaller) can be suppressed, offset, or reversed (conversely, made to be perceived as larger).

[0081] In some embodiments, the image position adjustment unit 510 further performs a second image movement process to move the static content V20 from one of the near vision position 101 and the far vision position 102 to the other, based on at least one of vehicle information about the vehicle in which the HUD device 20 is installed, environmental information about the environment in which the vehicle is traveling, and user information about the observer. The determination unit 530 determines whether the first image movement process is a manual process based on operation information, or an automatic second image movement process based on vehicle information, environmental information, and user information. In the second image movement process, the image size adjustment unit 520 performs a second size adjustment process different from the first size adjustment process.

[0082] When the second size adjustment process sets the size of the static content V20 when displayed at the myopic position 101 to the third size, if the static content V20 is arranged at the hyperopic position 102, the size of the static content V20 is adjusted so that it is visually recognized by the observer at a fourth size smaller than the third size. The image size adjustment unit 520 adjusts the third size and the fourth size so as to satisfy the following formula in the second size adjustment process. AS22 / AS12 < AS21 / AS11 < 1. Here, AS11 is the first size, AS21 is the second size, AS12 is the third size, and AS22 is the fourth size.

Explanation of Signs

[0083] 1: Own vehicle 2: Front windshield (projection target part) 4: Observer (eye) 5: Dashboard 10: Display system 20: Image display unit (HUD device) 21: Display 21a: Display surface 22: Liquid crystal display panel 23: Actuator 24: Light source unit 25: Relay optical system 26: First mirror 27: Second mirror 28: First actuator 29: Second actuator 30: Display control device 31: I / O interface 33: Storage unit 35: Processing circuit 40: Display light 40p: Optical axis 41: First image light 42: Second image light 43: Third image light 51: Light modulation element 90: Virtual image optical system 100: Virtual image display area 100b: Bottom end 100u: Upper end 101 :Myopia position 102 :Hyperopic position 110: Virtual image display area 120: Virtual image display area 130: Virtual image display area 200: Eye Box 205: Center 300: Real object 410: Attitude sensor 421: Vehicle ECU 422: Vehicle speed sensor 430:Operation unit 440: Eye position detection unit 500: Display control unit 510: Image position adjustment section 520: Image size adjustment section 530: Judgment section AS: viewing angle AS1: viewing angle AS2: viewing angle M: Image M1: Size M2: Size Ms :Ratio P: Change characteristics Q: Change characteristics Q1: Change characteristics Q2: Change characteristics Q3: Change characteristics Q4: Change characteristics V: Virtual image V10: AR Virtual Image V20: Non-AR virtual image (static content) V30: Frame image VD: distance

Claims

1. A display control device (30) controls a head-up display device (20) that displays a virtual image of static content (V20) in a display area (100) that is tilted with respect to a road surface so as to have a near-vision position (101) close to a viewer and a far-vision position (102) far from the viewer, an image position adjustment unit (510) that adjusts the position of the static content (V20); an image size adjustment unit (520) that performs a first size adjustment process to adjust the size of the static content (V20) so that, when the size of the static content (V20) when displayed at the near-vision position (101) is a first size, the static content (V20) is visually recognized by a viewer at a second size smaller than the first size when the static content (V20) is placed at the far-vision position (102) to prevent the static content (V20) from being perceived as large due to an increase in display distance; In the first size adjustment process, the image size adjustment unit (520) adjusts the first size and the second size so as to satisfy the following formula: Ms<AS21 / AS11<1 where Ms is the ratio of the size of the object at the far vision position (102) to the size of the object at the near vision position (101) as viewed from a predetermined position in nature, AS11 is the first size, and AS21 is the second size. A display control device (30).

2. The static content (V20) is expressed as being raised higher than the display area relative to the road surface.

2. A display control device (30) according to claim 1.

3. The image position adjustment unit (510) further performing a first image movement process of moving the static content (V20) from one of the near-vision position (101) and the far-vision position (102) to the other based on an operation by the viewer; The first image movement process includes: a visibility reduction process of reducing the visibility of the static content (V20) or hiding it and displaying a frame image surrounding the static content (V20); a manual image movement process for moving the frame image from one of the near-vision position (101) and the far-vision position (102) to the other based on an operation by the observer; a visibility increasing process of reducing the visibility of the frame image or not displaying it, and increasing the visibility of the static content (V20) at the position where the frame image is arranged or re-displaying it, 3. A display control device (30) according to claim 1 or 2.

4. The image position adjustment unit (510) performs the following in the manual image movement process: 1) When the frame image is moved from the near-sighted position (101) to the far-sighted position (102), the frame image is made smaller or the intervals between the plurality of separated portions constituting the frame image are narrowed according to the position of the frame image; 2) When the frame image is moved from the far-sighted position (102) to the near-sighted position (101), the frame image is enlarged or the spacing between the plurality of separated portions constituting the frame image is increased depending on the position of the frame image; 4. A display control device (30) according to claim 3.

5. The image position adjustment unit (510) In the visibility reduction process, the static content (V20) is hidden, In the manual image movement process, when the frame image is moved from one of the near vision position (101) and the far vision position (102) to the other, the size of the frame image is maintained, or the intervals between the plurality of parts that are spaced apart from each other and that make up the frame image are maintained; When the static content (V20) is redisplayed by the visibility increasing process, the size of the static content (V20) is adjusted depending on the position where the static content (V20) is displayed.

4. A display control device (30) according to claim 3.

6. The image position adjustment unit (510) further performing a second image movement process to move the static content (V20) from one of the near-vision position (101) and the far-vision position (102) to the other based on at least one of vehicle information regarding a vehicle in which the head-up display device is installed, environmental information regarding an environment in which the vehicle is traveling, and user information regarding the viewer; In the second image movement process, a second size adjustment process different from the first size adjustment process is executed. A display control device (30) according to any one of claims 1 to 5.

7. The second size adjustment process adjusts the size of the static content (V20) so that, when the size of the static content (V20) when displayed at the near-vision position (101) is a third size, the static content (V20) is visually recognized by the viewer at a fourth size smaller than the third size when the static content (V20) is placed at the far-vision position (102); In the second size adjustment process, the image size adjustment unit (520) adjusts the third size and the fourth size so as to satisfy the following formula:

7. A display control device (30) according to claim 6. AS22 / AS12<AS21 / AS11<1 However, AS11 is the first size, AS21 is the second size, AS12 is the third size, and AS22 is the fourth size.

8. A display control device (30) according to any one of claims 1 to 7; a display (21) for displaying an image on a display surface; and one or more relay optical systems (25) that project the display light of the image displayed by the display (21) onto an external projection target, thereby displaying a virtual image (V) of the image within a display area (100) that overlaps with the foreground as viewed from the eyebox (200).

Images