Display control device, display device, and display control method

Abstract

To suppress reduction in the discriminability of a near image / far image and improve easiness to view a display image.SOLUTION: A display control device for executing display control of an image comprises a control unit 140 which controls the display mode of the image. The images include: near images (D1 to D3) displayed nearer with a viewer as a criterion; and far images (F1 to F3) displayed farther. The control unit 140, in a case where it is determined that there is such a situation that the discriminability between the near image and the far image is reduced or in a case where it is determined that the discriminability should be increased, executes display mode change processing including at least one of changing the display mode of the background of the near image, adding an image of a frame surrounding the near image, adding an image of a line to at least a portion of the periphery of the near image, and adding the image of the line so as to be across at least two of a plurality of display contents when the plurality of display contents are included as the near image.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a display control device, a display device, a display control method, etc., that are mounted on a vehicle such as an automobile. [Background technology]

[0002] Patent Document 1 discloses a control device and a control method for a multi-display device having a plurality of display devices.

[0003] The multi-display device of Patent Document 1 (for example, Figures 1 and 19) uses a CID (Center Information Display) that displays map information and the current position of the vehicle, an ICD (Instrumental Cluster Display) that displays a speedometer, etc., and a HUD (Head-Up Display) device.

[0004]

[0002] of Patent Document 1 states, "Conventionally, in systems that use multiple display devices in conjunction with one another, there has been a problem in that when a user is paying attention to information displayed on one display device, it is difficult for the user to notice changes in the information displayed on the other display devices. Furthermore, when the information displayed on each display device is related to one another, it is difficult to grasp the relationship."

[0005] As a solution to this problem, for example, claim 1 states that "attention-guiding information (information that emphasizes a specific image) that induces attention is added." [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-71398 Summary of the Invention [Problem to be solved by the invention]

[0007] The inventors have investigated a technology for displaying images in multiple display areas with different display distances (near / far mixed display technology), and as a result have found that it is sometimes difficult for a viewer to distinguish between an image that appears close by (near image) and an image that appears far away (far image).

[0008] For example, a distant image may be placed near a nearby image. Also, if both the nearby image and the distant image include, for example, multiple display contents that are erected on the road surface, each display content may be perceived individually, and the sense of perspective may be diminished, which may reduce the distinguishability between the nearby display content and the distant display content.

[0009] In this case, the viewer may feel visually annoyed. Also, it cannot be said that the viewer will not perceive important information delayed because they may perceive ADAS (Adaptive Assistant System) information, warning signs superimposed on leading vehicles that require caution (distant information), and vehicle speed indicators that are visible in the foreground as mixed together.

[0010] Here, even if awareness guidance information is added as in the technology of Patent Document 1, it does not provide a fundamental solution to the problem of reduced discrimination between near and far images, that is, the difficulty in distinguishing between near and far images.

[0011] Furthermore, when there are multiple display contents, it is not possible to distinguish which of them is a nearby image and which is a distant image, and each display content is perceived separately, resulting in visual annoyance, but this does not provide a fundamental solution to this problem.

[0012] One object of the present invention is to suppress a decrease in the discrimination between a near image and a far image, and to improve the visibility of a displayed image.

[0013] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings. [Means for solving the problem]

[0014] In order to facilitate an understanding of the outline of the present invention, the following examples are given of embodiments according to the present invention.

[0015] In a first aspect of the present invention, a display control device includes: A display control device that performs image display control, a control unit for controlling a display mode of the image, the images include a near image displayed closer to the viewer and a far image displayed farther away from the viewer; The control unit When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved, changing the display mode of the background of the nearby image; and, Adding a frame image surrounding the neighboring image; and, adding a line image to at least a portion of the periphery of the neighboring image; and, When the neighboring image includes a plurality of display contents, a line image is added so as to span at least two of the plurality of display contents. The display mode change process includes at least one of the above.

[0016] In the first mode, of the distant images and nearby images displayed at different display distances, a display mode change process is performed on the nearby images in certain cases, making them easier to distinguish from the distant images and improving the visibility of the displayed images.

[0017] Since the human field of view has a certain extent, for example, even when a viewer looks at a distant image, a nearby image may also be in the viewer's field of view. Since the distant image and the nearby image have different display distances (for example, the distance to the image or the display surface of the image based on the viewer's viewpoint), they are generally distinguishable from each other based on the difference in display distance, but there are also cases where the difference in distance between the two images is relatively small.

[0018] Furthermore, for example, when there are multiple display contents as distant images and they are displayed together, it becomes difficult to distinguish them from the multiple display contents as nearby images that are visible in the foreground.

[0019] In such cases, by performing display mode change processing including adding a background to the nearby image, changing the background (including changing the shape, color, etc.), adding a frame, adding a line image (including adding a line image that spans multiple display contents), etc., it is possible to naturally show that multiple display contents are displayed together.

[0020] In other words, it is possible to increase the distinctiveness (visual distinctiveness) of nearby images (when there are multiple display contents, a group of nearby images) from distant images without causing any sense of incongruity.

[0021] Therefore, even if a nearby image falls within the view range, the viewer can focus on the distant image without being particularly aware of the nearby image, which reduces the annoyance. Thus, an easy-to-view display is realized.

[0022] In a second aspect dependent on the first aspect, When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved, When the number of display contents included in the distant image is greater than a predetermined threshold, Or, When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold, Or, When it is detected that the importance of at least one display content displayed as the distant image has increased, may be.

[0023] In the second aspect, a case where it is determined that the discriminability between a near image and a far image is reduced is exemplified by a case where the number of display contents as far images exceeds a threshold value, and a case where it is determined that the discriminability should be improved is exemplified by a case where the importance (display priority) of the display contents as far images is increased.

[0024] In the illustrated situation, it is desirable for the viewer (such as a driver) to pay attention to the information presented by the distant image, and it is necessary to avoid the viewer being distracted by the nearby image. Therefore, the display mode of the nearby image is changed to enhance the distinguishability of the nearby image from the distant image. This makes it possible to present various types of information in an easy-to-see display.

[0025] In a third aspect dependent from the second aspect, The predetermined display content having high importance is AR display content superimposed on real scenery, Or, Display content for driving assistance information provided by the Advanced Driver Assistance System (ADAS) (ADAS display content), may be.

[0026] In the third mode, AR display content and ADAS display content treat distant images as highly important display content. These displays contribute to safe driving and often present important information, so they are treated as important display content.

[0027] In a fourth aspect dependent from the second aspect, When it is detected that the importance of the at least one display content has increased, When the navigation display is on, if the distance to the branch point where steering is required is within a predetermined distance, Or, If the ADAS display content already displayed increases the risk to safe driving, may be.

[0028] The fourth aspect illustrates a case where it may be determined that the importance of the display content as a distant image has increased. When approaching a point where steering (operation of the steering wheel, etc.) is required, or when the risk of the ADAS display content increases, a warning or other notice is displayed, and the viewer (driver, etc.) needs to quickly notice the notice and take appropriate action. Therefore, it is preferable to suppress the annoyance caused by the nearby image entering the field of view. Therefore, in the above case, a display mode change process is executed for the nearby image.

[0029] In a fifth aspect dependent on any one of the first to fourth aspects, The display control device is mounted on a vehicle, The height direction of the vehicle is defined as a vertical direction, the width direction of the vehicle is defined as a horizontal direction or a left-right direction, and the direction perpendicular to the vertical and horizontal directions is defined as a depth direction, In a case where a plurality of display contents are displayed as the neighboring image and the plurality of display contents are arranged horizontally at intervals, The display mode change process includes: The process may be a process of making the viewer perceive that the plurality of display contents are arranged in a cohesive manner in the horizontal direction.

[0030] In the fifth mode, when a plurality of display contents as neighboring images are arranged horizontally, the display mode change process is carried out so as to give the impression that the display contents are arranged together.

[0031] If each display content is perceived individually (separately), the viewer will need to judge whether it is a near image or a far image for each display content, which is expected to increase the viewer's burden and inconvenience.

[0032] Therefore, for example, a background of a predetermined shape (it is also possible to add a predetermined color or a pattern such as a gradation) can be displayed across the display area of ​​each display content, or a line image with curved portions can be displayed across the display content on the left and right ends, giving the impression that each display content arranged in a row is united in the left-right direction (however, this is just an example and is not limited to this).

[0033] This allows the viewer to intuitively recognize that this is the display area of ​​the near image, thereby enhancing the distinguishability of the near image from the far image in a natural way without causing any discomfort to the viewer.

[0034] In a sixth aspect dependent from the fifth aspect, The display mode change process includes: The process is a process of making the viewer perceive that the plurality of display contents are arranged cohesively in the horizontal direction, The increase in the overall visibility of the plurality of display contents perceived as a unity may be suppressed.

[0035] In the sixth aspect, the display mode change process in the fifth aspect described above does not, for example, "improve the discernibility of nearby images by increasing visibility and attracting attention through emphasis processing" as in Patent Document 1 shown above, but clarifies that the increase in visibility of multiple displayed contents as a whole is suppressed.

[0036] In other words, in this embodiment, while suppressing an increase in visibility and maintaining natural vision within the viewer's field of vision, for example, by "facilitating visual separation of nearby images from distant images," the discriminability (recognizability) of distant images is increased. Thus, the viewer can easily focus on distant images of high importance.

[0037] In a seventh aspect dependent on the fifth or sixth aspect, The display mode change process includes: Furthermore, the method may include processing for creating a sense of depth in at least a part of the display area of ​​the plurality of display contents by using at least one of linear perspective and aerial perspective that adjusts the degree of definition.

[0038] In the seventh aspect, the multiple display contents included in the near image are not only given a sense of unity in the horizontal direction, but also given a sense of perspective in the depth direction. To express the sense of perspective, for example, linear perspective can be used. Alternatively, aerial perspective (perspective expression based on changes in sharpness, whereby nearby objects have high sharpness and distant objects have low sharpness and become blurred) can also be used.

[0039] When a distant image is superimposed on a real scene, each display content is often arranged with a sense of perspective. Therefore, by incorporating perspective expression into the nearby image, the consistency between the two images increases, resulting in a more natural visual experience.

[0040] On the other hand, the perspective used in nearby images is different from the perspective of distant images, and therefore nearby images displayed using perspective (in other words, the display area of ​​the nearby image) are intuitively easier to distinguish from distant images.

[0041] Therefore, it is possible to ensure a natural visual perception, reduce the sense of discomfort felt by the viewer, and make it easier to distinguish between the two images.

[0042] In an eighth aspect dependent on any one of the fifth to seventh aspects, The display mode change process includes: The method may include a process of changing the display of the near image, which is mainly displayed in achromatic colors, from the far image, which is mainly displayed in chromatic colors.

[0043] In the eighth aspect, it is made clear that the display mode after the display mode change process for the nearby image has been performed can be mainly displayed in achromatic colors.

[0044] Distant images include AR images, ADAS images, etc., and are often displayed in chromatic colors such as red, yellow, blue, etc. to easily attract the viewer's attention. This is because the road surfaces on which vehicles travel are often achromatic (for example, dark colors), and the white lines and other markings on the road surfaces are also achromatic, so it is difficult to attract the viewer's attention if they are displayed in similar colors.

[0045] In light of this, the nearby image (including the background) can be given a different impression from the distant image by coloring it primarily with achromatic colors (for example, gray, black, white, and gradations using these colors). This makes it easier to intuitively distinguish the nearby image from the distant image.

[0046] For example, it is conceivable that the background of the display area for a plurality of display contents is colored a dark color such as gray, while the majority of the display contents are represented by white characters, figures, etc. (However, this is just an example and is not limiting.) This makes it possible to realize an easy-to-read display without causing discomfort.

[0047] In a ninth aspect dependent on any one of the fifth to eighth aspects, The display area of ​​the near image may be disposed below the display area of ​​the far image.

[0048] The ninth aspect clarifies that, from the viewer's perspective, the display area of ​​the nearby image is located below the display area of ​​the distant image. When the viewer looks at the distant image, if the viewer slightly lowers his or her line of sight, the nearby image often comes into view, and the viewer often feels annoyed due to the mixed vision of the distant image and the nearby image. Therefore, the display mode change process for the nearby image as described above is effective.

[0049] In a tenth aspect, the display device comprises: a head-up display device that displays a distant image; A display device or a head-up display device that displays a nearby image by display control by a display control device according to any one of the first to ninth aspects; Includes:

[0050] According to the tenth aspect, it is possible to provide a display device that can suppress a decrease in the distinguishability between a near image and a far image and improve the visibility of a displayed image.

[0051] In an eleventh aspect, a display control method includes: A display control method for controlling display of a near image displayed closer to a viewer and a far image displayed farther away, the method comprising: a step of determining whether or not a situation exists in which the discriminability between the near image and the far image is reduced, or whether or not the discriminability should be improved; When the result of the determination is positive, a step of executing a display mode change process including at least one of changing a display mode of the background of the nearby image, adding a frame image surrounding the nearby image, adding a line image to at least a part of the periphery of the nearby image, and, when the nearby image includes a plurality of display contents, adding a line image so as to span at least two of the plurality of display contents; Includes:

[0052] According to the eleventh aspect, it is possible to suppress a decrease in the distinguishability between a near image and a far image and improve the visibility of a displayed image by a relatively simple method.

[0053] Those skilled in the art will easily understand that the exemplified embodiments according to the present invention can be further modified without departing from the spirit of the present invention. [Brief explanation of the drawings]

[0054] [Figure 1] FIG. 1 is a diagram showing a configuration example of an example of a display device (an in-vehicle display device including a display device and an HUD device) and an example of setting a virtual image display surface by the HUD device. [Figure 2] 2A and 2B are diagrams showing another example of a display device using a display device and a HUD device. [Figure 3] FIG. 3 is a diagram showing an example of a display by the display device shown in FIGS. 2(A) and 2(B). [Figure 4] FIG. 4 is a diagram showing an example of the configuration of a display device using two HUD devices. [Figure 5] FIG. 5 is a diagram showing an example of a display on the display device shown in FIG. [Figure 6] Figure 6(A) is a diagram showing an example of the display of a nearby image and a distant image before the display mode change process, and Figures 6(B) and (C) are diagrams showing an example of the display of a nearby image and a distant image after the display mode change process. [Figure 7] Figure 7(A) is a diagram showing an example of the display of a nearby image and a distant image before the display mode change process, and Figures 7(B) and (C) are diagrams showing other examples of the display of a nearby image and a distant image after the display mode change process. [Figure 8] Figure 8(A) is a diagram showing an example of the display of a nearby image and a distant image before the display mode change process, and Figures 8(B), (C), and (D) are diagrams showing further examples of the display of a nearby image and a distant image after the display mode change process. [Figure 9] Figure 9(A) shows an example of the display of a nearby image and a distant image before the display mode change process, and Figures 9(B) and (C) show how the display mode of the nearby image changes gradually as the vehicle approaches a branch point where steering is required. [Figure 10] 10A and 10B are diagrams showing an example of a distant image determined to be of high importance, and an example of a nearby image after the display mode change process. [Figure 11] Figure 11(A) shows a driving scene in which both the near image and the far image are visible through the windshield before the display mode change process, and Figure 11(B) shows a driving scene in which the importance of the far image has increased and the display mode change process has been performed on the near image. [Figure 12] FIG. 12 is a diagram showing an example of the configuration of a system that controls the display of a display device. [Figure 13]FIG. 13 is a flowchart showing an example of a display control procedure for a nearby image. DETAILED DESCRIPTION OF THE INVENTION

[0055] The best mode described below is used to facilitate understanding of the present invention, and therefore, those skilled in the art should be aware that the present invention is not unduly limited by the embodiments described below.

[0056] Please refer to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an example of a display device (an in-vehicle display device including a display device and an HUD device) and an example of setting a virtual image display surface by the HUD device.

[0057] 1, the direction along the line segment connecting the viewer's left and right eyes (in other words, the width direction of the vehicle 1) is the left-right direction (or lateral direction), the direction along the line segment that is perpendicular to the left-right direction and perpendicular to the ground or a surface equivalent to the ground (here, road surface 6) is the up-down direction (or height direction), and the direction along the line segment that is perpendicular to both the left-right direction and the up-down direction (directions indicating the forward and backward directions of the vehicle 1) is the front-rear direction. The front direction is also sometimes referred to as the depth direction. The left-right direction can also be expressed as the X direction, the up-down direction as the Y direction, and the front-rear direction as the Z direction.

[0058] Furthermore, in this specification, the expressions near image / far image are used, where a near image is an image displayed closer to the viewer, and a far image is an image displayed further back than the near image. In other words, an image displayed in a display area (display surface) closer to the viewer is a near image, and an image displayed in a display area (display surface) further back is a far image. A near image can also be referred to as a near-placed image or a near-side image. A far image can also be referred to as a far-placed image or a far-side image.

[0059] The display device here is an in-vehicle display device mounted on a vehicle 1. This in-vehicle display device includes at least one of a display device (including a control unit 140, a display control unit 107, and a display (display device) 108 such as a liquid crystal panel) and a head-up display (HUD) device 100 (including a control unit 140 and a device main body 120). In the example of FIG. 1, both are mounted on the vehicle 1.

[0060] The HUD device 100 is installed in a dashboard (in other words, an instrument panel) 41, for example.

[0061] The device body 120 has a display 150 such as a liquid crystal panel, a screen (display unit) 160 having a display surface 164, and a curved mirror (concave mirror or the like) 170 having a light reflecting surface 179.

[0062] Curved mirror (concave mirror, etc.) 170 reflects light from screen 160 and projects (projects) display light K onto windshield (projected member) 2 provided on vehicle 1. A portion of display light K is reflected from windshield (projected member) 2 and incident on viewpoint (eye) A of a viewer (driver, etc.), and apparent light beams E1 to E3 corresponding to the incident light beams are focused at image points in front of the viewer, thereby displaying a virtual image on virtual image display surface PS. Note that virtual image display surface PS is a virtual (apparent) surface set in real space in front of the viewer, corresponding to display surface 164 on screen 160.

[0063] The virtual image display surface PS may be, for example, an elevation surface a perpendicular to the road surface 6, inclined surfaces b and c inclined relative to the road surface 6, a road surface superimposed surface d superimposed on the road surface 6, and a surface e in which the side closer to the viewer is an elevation surface (including a pseudo elevation surface) and the farther side is an inclined surface. In displays using surfaces other than the elevation surface a, the display distance of the virtual image varies depending on the display position on the virtual image display surface, thereby enabling 3D display.

[0064] Next, reference is made to Fig. 2. Fig. 2(A) and (B) are diagrams showing another example of a display device using a display device and a HUD device. In Fig. 2, parts that are common to Fig. 1 are given the same reference numerals. This also applies to other drawings.

[0065] The examples of FIGS. 2(A) and 2(B) have in common that a distant image V1 is displayed by the HUD device 100, and a nearby image V2 is displayed by a display (display device) 108 installed inside the vehicle.

[0066] However, the display (display device) 108 in Fig. 2(B) is provided closer to the viewer (driver) (closer to the steering wheel 4) than in Fig. 2(A). In this respect, there is a structural difference.

[0067] 2(A) and 2(B), a display 151 that displays an original image is provided in the HUD device 100. However, an optical system that guides display light from the display 151 to a curved mirror (concave mirror or the like) 170 is omitted.

[0068] Next, reference is made to Fig. 3. Fig. 3 is a diagram showing an example of a display by the display device shown in Figs.

[0069] 3, three display contents are displayed as nearby images, arranged in a row horizontally (left and right) at intervals on the display (display device) 108. The one on the left is a barcode display D1 showing various information (for example, vehicle temperature and RPM data), the one in the center is a vehicle speed display (displaying "80 km / h") D2, and the one on the right is a display showing the current time (displaying "12:56 pm") D3.

[0070] In addition, a navigation display F1 and a fuel gauge display F2 are displayed as AR displays so as to be superimposed on the real view in front of the vehicle 1. These are displayed on a virtual image display surface 111 set in front of the vehicle 1.

[0071] The distant images F1 and F2 are viewed by the driver (viewer) through the windshield 2. The display areas of the near images D1 to D3 are located below the distant images F1 and F2 from the viewer's (driver's) perspective, and the vertical distance is small. A viewer looking at something far away can see the near images D1 to D3 by slightly lowering their line of sight. However, because the field of view is broad, it can be assumed that the near images D1 to D3 will often fall within the viewer's field of view even when the viewer is looking at the distant images F1 and F2.

[0072] Next, reference is made to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of a display device using two HUD devices. In Fig. 4, the nearby image V2 is displayed as a virtual image by the HUD device 101. Furthermore, the nearby image V2 is displayed on the far side of the windshield 2 as seen by the viewer.

[0073] The distant image V1 is displayed as a virtual image by the HUD device 100, similar to the example in Fig. 2. Note that one of the HUD devices may be referred to as a "first HUD device" and the other as a "second HUD device."

[0074] Next, reference is made to Fig. 5. Fig. 5 is a diagram showing an example of a display by the display device shown in Fig. 4. The display content is the same as that in Fig. 3. However, in Fig. 4, the display (display device) 108 of Fig. 3 is not provided. A display area 113 is set on the instrument panel 41 for convenience, and nearby images D1 to D3 are displayed in this display area 113.

[0075] Next, reference will be made to Fig. 6. Fig. 6(A) is a diagram showing a display example of a near image and a far image before the display mode change process, and Fig. 6(B) and (C) are diagrams showing a display example of a near image and a far image after the display mode change process.

[0076] In the example of Fig. 6, the control unit 140 (see Fig. 1) can perform a display mode change process on the nearby image. The display mode change process can be performed, for example, when it is determined that the situation is such that the distinguishability between the nearby image and the distant image is reduced, or when it is determined that the distinguishability should be improved.

[0077] In the display mode change process, display control may be performed that includes, for example, at least one of changing the display mode of the background of the nearby image, adding a frame image surrounding the nearby image, adding a line image to at least a portion of the periphery of the nearby image, and, if the nearby image includes multiple display contents, adding a line image so that it spans at least two of the multiple display contents.

[0078] 6A shows a normal display mode of a nearby image (display mode before the display mode change process). This display mode is the same as that shown in FIG.

[0079] In Figure 6(B), in addition to F1 and F2, the distant images also include speed limit information F3, a warning sign (text saying "Caution: Strong Winds") F4, and information indicating the distance to the vehicle ahead F5. F3 can be seen as an important navigation display, while F4 and F5 are driving assistance information (ADAS information, ADAS images) provided by the advanced driver assistance system (ADAS).

[0080] Here, the predetermined threshold for the number of display contents as distant images is m (here, m=2).

[0081] In the state of Fig. 6(A), the number of display contents included in the distant image does not exceed the threshold (m=2), but in the state of Fig. 6(B), it exceeds the threshold. When the number of display contents in the distant image exceeds the threshold, the burden on the viewer (driver) to look at each display content and understand its meaning increases.

[0082] Here, if the viewer is looking at the distant images F1 to F5 and nearby images D1 to D3 enter his / her field of view (field of vision), the viewer's burden will further increase. In particular, if D1 to D3 are grasped (perceived) individually (separately), the viewer will feel annoyed. Furthermore, since the viewer needs to individually recognize the information presented by each display content, the viewer's cognitive burden will increase.

[0083] Therefore, the control unit 140 performs a display mode change process on the nearby image. The display mode change process allows the plurality of display contents D1 to D3, which are arranged at intervals in the horizontal direction, to be intuitively grasped as a unity in the left-right direction. Furthermore, this display change makes it easier to distinguish between the nearby image and the distant image. Therefore, even when the nearby image enters the field of view (visibility), the nearby image can be intuitively recognized as distinct from the distant image. As a result, the viewer can direct their attention to the distant image without being distracted by the nearby image.

[0084] In this case, the change in the display mode of the nearby image does not improve visibility (attractiveness) by highlighting or the like as in Patent Document 1, but has a visual effect of making it easier to distinguish from distant images while suppressing an increase in visibility, so that the nearby image can be separated from the distant image without creating a sense of incongruity. Therefore, it is possible to improve the visibility of the distant image without creating a sense of incongruity.

[0085] 6(B), a background 115 is applied across the leftmost display content D1 and the rightmost display content D3. This background may be an area of ​​a predetermined outline with a predetermined color or pattern 115c.

[0086] Also, in FIG. 6(B), the vehicle speed display ("80 km / h") D2 in the center is intentionally excluded from the area of ​​the background 115. In other words, the background 115 has a cutout portion in the shape of an inverted trapezoid. The pair of opposing oblique sides of this inverted trapezoid helps to create a perspective that is the opposite of that of normal linear perspective. In other words, in FIG. 6(B), the addition of the background makes it easier to intuitively grasp the unity of the displayed content in the left-right direction, and also creates a perspective that is different from that of normal linear perspective. This helps to align with the display contents F1 and F5 of distant images that are displayed in perspective, ensure a natural visual perception, and prevent any sense of incongruity.

[0087] In FIG. 6(C), the background 116 has a color (or a pattern, etc.) applied to an area having a trapezoidal outline. The three display contents D1 to D3 are arranged within the trapezoidal background 116. In FIG. 6(C) as well, the unity of the display contents D1 to D3 in the left-right direction is easily perceived. In addition, the pair of oblique sides of the trapezoid creates a sense of perspective. This makes it easier to achieve consistency with the distant image, and makes it easier to distinguish between the distant image and the nearby image while maintaining natural vision. This results in an easy-to-view display.

[0088] Next, reference will be made to Fig. 7. Fig. 7(A) is a diagram showing a display example of a near image and a far image before the display mode change process, and Fig. 7(B) and (C) are diagrams showing other examples of the display of a near image and a far image after the display mode change process.

[0089] Figure 7(A) is the same as Figure 6(A). Figures 7(B) and (C) are modifications of the example of Figure 6(C) shown above (an example in which a trapezoidal background is added). In Figure 7(B), aerial perspective is used to create a sense of perspective. The trapezoidal background has a stepwise or continuous change in sharpness, with the sharpness higher at the bottom and decreasing at the top, creating a so-called gradation display.

[0090] This creates a natural sense of perspective, which has the effect of improving consistency with the perspective of the distant image, maintaining a natural visual sensation, and making it easier to distinguish from the distant image.

[0091] In the example of Figure 7(C), a grid-like line image 119 drawn using linear perspective is added inside a trapezoidal background 118. This creates a natural sense of perspective. The obtained effect is the same as in the case of Figure 7(B).

[0092] Next, reference will be made to Fig. 8. Fig. 8(A) is a diagram showing a display example of a near image and a far image before the display mode change process, and Fig. 8(B), (C), and (D) are diagrams showing further examples of the display of a near image and a far image after the display mode change process.

[0093] Fig. 8(A) is the same as Fig. 6(A). In Fig. 8(B), a display mode change process is performed on the nearby image, and a line image Q is added around (around) the display contents D1 to D3 of the nearby image.

[0094] This line image Q is composed of line segments Q1 and Q4 extending in the left-right direction, a hypotenuse Q2 connected to line segment Q1, and a hypotenuse Q3 connected to line segment Q4. The addition of this line image Q creates the impression that the display contents D1 to D3 are arranged together. The presence of the hypotenuses Q2 and Q3 also creates a perspective that is different from the perspective of a distant image. This also makes it easier to distinguish between a nearby image and a distant image. The addition of a perspective also has the effect of improving consistency with the display contents F1 and F5 drawn in perspective. Therefore, even if the display mode is changed, a natural visual perception is maintained and the viewer does not feel uncomfortable.

[0095] In Fig. 8(C), the line image has horizontally extending line segments P1 and P7, a lane P2 connected to line segment P1, a diagonal line P4 connected to line segment P7, and a horizontally extending line segment P3 connecting the upper ends of the pair of opposing diagonal lines. The obtained effect is the same as that in Fig. 8(B).

[0096] In Fig. 8(D), a frame P8 is added to surround the three display contents D1 to D3. Note that a color or pattern may be added inside the frame P8. Fig. 8(D) emphasizes that the multiple display contents D1 to D3 are arranged together, and that what is inside the frame is a nearby image. This makes it easy to distinguish between distant images and nearby images, resulting in an easy-to-view display.

[0097] Next, reference will be made to Fig. 9. Fig. 9(A) is a diagram showing an example of display of a near image and a far image before the display mode change process, and Fig. 9(B) and (C) are diagrams showing that the display mode of the near image changes stepwise as the vehicle approaches a branch point where steering is required.

[0098] In FIG. 9(A), a highway exit 904 can be seen in the distance through the windshield 2. This highway exit 904 corresponds to a branching point where the vehicle needs to be steered. The HUD device displays a pointer J1 at the exit 904 to call attention (or to guide the driver's gaze). The nearby area is displayed as usual.

[0099] In Fig. 9(B), the vehicle approaches an exit 904, and the distance to the exit 904 is within a predetermined threshold. As a result, a sign display (AR display) 906 that more clearly shows the exit 904 is displayed. Accordingly, a display mode change process is performed on the nearby image. In Fig. 9(B), the change process of adding a line image Q, as previously shown in Fig. 8(B), is performed.

[0100] In FIG. 9(C), the vehicle approaches the exit 904. As a result, a display 907 for guiding the vehicle is displayed on the road surface. Accordingly, the display mode of the nearby image is changed. In FIG. 9(C), the display mode is changed to create a sense of perspective using gradation, as previously shown in FIG. 7(B). As a result, the sense of perspective of the nearby image is consistent with the display 907 for guiding the vehicle on the road surface as a distant image (displayed with a unique sense of perspective), maintaining a natural visual perception. Meanwhile, intuitive distinction between the distant display and the nearby display is improved. This results in an easy-to-see display.

[0101] Next, reference will be made to Fig. 10. Fig. 10(A) and (B) are diagrams showing an example of a distant image determined to be of high importance, and an example of a nearby image after the display mode change process.

[0102] 10A, a speed limit display LS1 is displayed as an AR display. Also, an attention-calling mark M1 is displayed by the ADAS superimposed on the forward vehicle G1. This attention-calling mark M1 corresponds to a distant image of high importance.

[0103] In response to this, a display mode change process is performed on the nearby image, and the display mode is changed to that shown in FIG. 6(B) above.

[0104] 10(B), the preceding vehicle G2 is located far away and does not pose any particular problem. However, a person B1 has entered the road, and the ADAS displays a frame C1 as a warning display. This frame C1 as a warning display corresponds to a distant image with high importance.

[0105] In response to this, the display mode change process is performed on the nearby image, and the display mode is changed to that shown in FIG. 8(D) above.

[0106] Next, let us refer to Fig. 11. Fig. 11(A) is a diagram showing a driving scene in which both a near image and a far image before the display mode change process are visible through the windshield, and Fig. 11(B) is a diagram showing a driving scene in which the importance of the far image has increased and the display mode change process has been performed on the near image.

[0107] In Fig. 11(A), both the near image and the far image are visible in front of the vehicle through the windshield 2. A leading vehicle G3 is visible in the distance in front of the vehicle. Also, a speed limit display (AR display) LS1 is displayed as a far image.

[0108] Figure 11(B) shows a driving scene that requires more caution than Figure 11(A). The road ahead of the vehicle curves to the left. The vehicle is traveling at high speed. There are also vehicles G4, G5, and G6 ahead, and the driver must pay particular attention to the distance between the vehicle and the nearest vehicle G4.

[0109] The distant image displays a speed limit LS2, a warning mark U1 for the preceding vehicle G4, a mark (following distance mark) W1 that helps maintain a safe distance between vehicles, and multiple arrows W2 that guide the vehicle's course. The multiple arrows W2 are arranged to follow the white lines 9 on the road surface 6. The number of display contents as distant images has increased considerably, and the importance of the display (display priority) has also increased.

[0110] Furthermore, if a nearby image is placed directly below a distant image and the nearby image enters the field of view, there is a high possibility that the cognitive burden on the viewer will increase.

[0111] Therefore, the display mode change process is performed on the neighboring images. Here, the three display contents as the neighboring images are surrounded by a frame, the inside of which is colored, and a background is added to the entire image.

[0112] After this display mode change process, the neighboring image is displayed mainly in achromatic colors for the following reasons.

[0113] As shown in Figure 11, distant images include AR images, ADAS images, etc., and are often displayed in chromatic colors such as red, yellow, and blue to easily attract the viewer's attention.

[0114] This is because the road surface 6 on which vehicles travel is often achromatic (e.g., dark), and the white lines 9 and other marks on the road surface are also achromatic, so it is difficult to attract the viewer's attention using similar colors.

[0115] In light of this, the nearby image (including the background) can be given a different impression from the distant image by coloring it primarily with achromatic colors (for example, gray, black, white, and gradations using these colors). This makes it easier to intuitively distinguish the nearby image from the distant image.

[0116] 11(B), the background color S1 of the nearby image is, for example, light gray, the barcode display D1 is displayed in black and white (or a cool color that is a receding color), and the vehicle speed display D2 is displayed in white, resulting in a display that is primarily achromatic. This allows the nearby image to be distinguished from the distant image in a natural way without causing any sense of incongruity, reducing the burden on the viewer.

[0117] Next, reference will be made to Fig. 12. Fig. 12 is a diagram showing an example of the configuration of a system that controls the display of a display device.

[0118] The in-vehicle display device (display device) 180 has an I / O interface 30, a processor (control device) 172 having a control unit (display control unit) 140, an image processing unit 210, an image display unit 230, a storage unit (memory) 350, and an exterior communication connection device 420.

[0119] The image display unit 230 includes the display control unit 107 and the display 108 shown in FIG. 1, and the display 150 and the display control unit 163 (not shown in FIG. 1) which are components of the HUD device 100.

[0120] The I / O interface 30 is connected to a road information database 403, a vehicle position detection unit 405, an outside vehicle sensor 407, a gaze direction detection unit 409, an eye position detection unit 411, a mobile information terminal 413, and a vehicle ECU 415.

[0121] The vehicle ECU 415 is provided with necessary information as needed from various sensors such as a pitch angle sensor 417 and a steering angle sensor 419. The I / O interface 30 is also connected to an external vehicle communication connection device 420.

[0122] The storage unit (memory) 350 also includes, for example, a real object and its position detection module 510, a surrounding environment detection module 512, a vehicle situation detection module 514, an image type determination module 516, an image placement determination module 518, a graphic display module 520, and a display mode determination module 522.

[0123] The display mode determination module 522 includes a display mode determination module 327 for a nearby image (nearby display) and a display mode determination module 329 for a distant image (distant display). The processor 172 operates in accordance with the above modules, thereby constructing, for example, a control unit 140 and various processing units as functional blocks. The control unit 140 controls the above-mentioned display mode change process for the nearby image, etc.

[0124] Next, reference will be made to Fig. 13. Fig. 13 is a flowchart showing an example of a display control procedure for a nearby image.

[0125] In step S1, the driving situation of the vehicle, the surrounding environment, etc. are detected and various information is acquired. In step S2, the display content of the nearby image is determined based on the acquired various information.

[0126] In step S3, it is determined whether or not a display mode change process is required when displaying the display content of the nearby image. In other words, it is determined whether or not the display mode change condition is met. If the result is "Y," then in step S4, a display mode change process is performed. The display mode change process can include, for example, adding a background, adding a line image, adding a frame, displaying a gradation, changing the background color, and the like.

[0127] If the answer is N in step S3, the display is performed in the normal display mode in step S5. In step S6, an end determination is made, and if the answer is N, the process returns to step S1, and if the answer is Y, the process ends.

[0128] As described above, according to the present invention, it is possible to suppress a decrease in the distinguishability between a near image and a far image, and improve the visibility of a displayed image.

[0129] The present invention can be modified and applied in various ways. For example, the display mode change process for the nearby image is not limited to the example described in the above embodiment, and various display modes can be adopted as appropriate.

[0130] In this specification, the term "vehicle" may be broadly interpreted as a vehicle. Terms related to navigation (e.g., AR display, ADAS display, etc.) are also broadly interpreted. HUD devices and display devices (and display devices in a broad sense) also include those used as simulators (e.g., aircraft simulators, simulators as game devices, etc.).

[0131] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims. [Explanation of symbols]

[0132] 1···vehicle (host vehicle), 2···windshield (projection target member), 6···road surface, 30···I / O interface, 41···instrument panel (dashboard), 100···HUD device, 108···display unit (liquid crystal panel, etc.), 109···display surface of display unit, 120···main body of HUD device, 140···control unit (display control unit), 160···display unit (liquid crystal panel, etc.) of HUD device ), 160···Screen, 164···Display surface of screen, 170···Curved mirror (concave mirror, etc.), 179···Reflecting surface of curved mirror, 210···Image processing unit, 230···Image display unit, 350···Memory unit, 522···Display mode determination module, 327···Display mode determination module for near image, 329···Display mode determination module for far image, K···Display light, PS···Image display surface

Claims

1. a first HUD device that generates a distant image by reflecting light from a first display device toward a projection target using a curved mirror; a second HUD device that generates a near image that is displayed closer than the far image by directly projecting light from a second display onto the projection target; and a display control device that executes display control of the second HUD device, a control unit for controlling a display mode of the distant image and the near image, The control unit When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved, changing the display mode of the background of the nearby image; and, Adding a frame image surrounding the neighboring image; and, adding a line image to at least a portion of the periphery of the neighboring image; and, When the neighboring image includes a plurality of display contents, a line image is added so as to span at least two of the plurality of display contents. Execute a display mode change process including at least one of the following: In a case where a plurality of display contents are displayed as the neighboring image and the plurality of display contents are arranged at intervals, The display mode change process includes: a process of making a viewer perceive that the plurality of display contents are arranged in a cohesive manner, the background, the frame image, and the line image in the display mode change process have a pair of oblique sides that are opposed to each other in the horizontal direction; Display control device.

2. When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved, When the number of display contents included in the distant image is greater than a predetermined threshold, Or, When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold, Or, When it is detected that importance has increased for at least one display content displayed as the distant image, The display control device according to claim 1 , wherein:

3. The predetermined display content having high importance is AR display content superimposed on a real scene; Or, Display content for driving assistance information provided by an advanced driver assistance system (ADAS) (ADAS display content); The display control device according to claim 2 , wherein:

4. When it is detected that the importance of the at least one display content has increased, When the navigation display is on, if the distance to the branch point where steering is required is within a predetermined distance, Or, If there is an increased risk to safe driving regarding the ADAS display content that is already being displayed, The display control device according to claim 2 , wherein:

5. The display mode change process includes: a process of making the viewer perceive that the plurality of display contents are arranged cohesively in the horizontal direction; The display control device according to any one of claims 1 to 4.

6. The display mode change process includes: The process is a process of making the viewer perceive that the plurality of display contents are arranged cohesively in the horizontal direction, The increase in the overall visibility of the multiple displayed contents perceived as a unit is suppressed. The display control device according to claim 5 .

7. The display mode change process includes: The method further includes processing for creating a sense of depth in at least a part of a display area of ​​the plurality of display contents by at least one of linear perspective and aerial perspective that adjusts the degree of definition. The display control device according to claim 5 or 6.

8. The display mode change process includes: a process of changing the display of the near image to a display mainly in achromatic colors, in contrast to the far image, which is mainly in chromatic colors; The display control device according to any one of claims 5 to 7.

9. a display area for the near image is disposed below a display area for the far image; The display control device according to any one of claims 5 to 8.

10. a head-up display device that displays a distant image; a display device or a head-up display device that displays a nearby image under display control by the display control device according to any one of claims 1 to 9; A display device comprising:

11. A display control method for controlling display modes of a distant image and a near image, comprising: a step of determining whether or not a situation exists in which the discriminability between the near image and the far image is reduced, or whether or not the discriminability should be improved; When the result of the determination is positive, a step of executing a display mode change process including at least one of changing a display mode of the background of the nearby image, adding a frame image surrounding the nearby image, adding a line image to at least a part of the periphery of the nearby image, and, when the nearby image includes a plurality of display contents, adding a line image so as to span at least two of the plurality of display contents; In a case where a plurality of display contents are displayed as the neighboring image and the plurality of display contents are arranged at intervals, The display mode change process includes: a process of making a viewer perceive that the plurality of display contents are arranged in a cohesive manner, the background, the frame image, and the line image in the display mode change process have a pair of oblique sides that are opposed to each other in the horizontal direction; Display control method.

Images