Display control device, display device, and display control method

Abstract

This invention relates to a display control device, a display apparatus, and a display control method, which suppresses the reduction in recognizability of near / far images and improves the visibility of displayed images. The display control device that performs display control of an image has a control unit (140) that controls the display mode of an image. The image includes a near image (D1 to D3) displayed closer to the viewer and a far image (F1 to F3) displayed further away. The control unit (140) performs a display mode change process, which includes at least one of the following: changing the display mode of the background of the near image; adding an image with a frame surrounding the near image; adding an image with lines on at least a portion of the periphery of the near image; and, in the case where multiple display contents are included as the near image, adding an image with lines that span at least two of the multiple display contents.

Description

TECHNICAL FIELD

[0001] The present application relates to a display control device, a display device, a display control method, and the like mounted on a vehicle such as an automobile. BACKGROUND

[0002] A control device and a control method of a multi-display device having a plurality of display devices are shown in Patent Literature 1.

[0003] In the multi-display device of Patent Literature 1 (for example, Figure 1 and FIG. 19), a CID (Center Information Display) that displays map information or a current position of the own vehicle and the like, an ICD (Instrumental Cluster Display) that displays a speedometer and the like, and a HUD (Head-Up Display) device are used.

[0004] In "0002" of this Patent Literature 1, it is written that "in the past, in a system in which a plurality of display devices are linked and utilized, there is a problem that, when attention is paid to information displayed on one display device, even if information displayed on the other display device changes, the user hardly notices. In addition, when information displayed on each display device is associated with each other, it is difficult to grasp the association."

[0005] As a countermeasure thereof, for example, in claim 1, it is written that "awareness guide information (information that emphasizes a specific image) that adds a guide awareness".

[0006] PRIOR ART DOCUMENTS

[0007] PATENT LITERATURE

[0008] Patent Literature 1: Japanese Patent Laid-Open No. 2017-71398 SUMMARY

[0009] PROBLEMS TO BE SOLVED BY THE INVENTION

[0010] The present inventors have researched a technology of displaying an image in a plurality of display regions having different display distances (near / far mixed display technology), and as a result thereof, it has been found that there is a case where it is difficult to distinguish between an image observed in the near distance (near image) and an image observed in the far distance (far image) from the viewpoint of a visual recognition person.

[0011] For example, there is a case where a distant image is configured in the vicinity of a near image. In addition, in a case where both the near image and the distant image contain, for example, a plurality of display contents which are vertically arranged with respect to a road surface, or the like, there is a case where each of the display contents is individually recognized, a lack of sense of perspective is felt, or the like, and the recognition between the display content of the near and the display content of the distant is reduced.

[0012] In this case, there is a case where a visual recognizer feels a visual disturbance. In addition, it cannot be said that there is no case where ADAS (Advanced Driver Assistance System) information, or a caution mark overlaid on a preceding vehicle which needs to be noticed, or the like (distant information) and a vehicle speed display which is observed on the preceding side are mixed and perceived, and perception of important information is delayed.

[0013] Here, even if the awareness guide information is added as in the technology of Patent Document 1, the problem of the reduction in the recognition of the near image / distant image, such as the difficulty in distinguishing the near image and the distant image, cannot be fundamentally solved.

[0014] In addition, the problem that when there are a plurality of display contents, it is difficult to distinguish which of them is the near image and which is the distant image, the display contents are perceived in disorder, and a visual disturbance occurs cannot be fundamentally solved.

[0015] An object of the present application is to suppress the reduction in the recognition of the near image / distant image, and to improve the visibility of the display image.

[0016] Other objects of the present application will be apparent to those skilled in the art from consideration of the following examples with reference to the best modes and the accompanying drawings.

[0017] Means for solving the problem

[0018] In order to easily understand the gist of the present application, the manner according to the present application is exemplified below.

[0019] In the first manner of the present application, a display control device performs display control of an image, and

[0020] has: a control section which controls a display manner of the image,

[0021] the image contains a near image which is displayed closer and a distant image which is displayed farther, with respect to a visual recognizer,

[0022] the control section performs display manner changing processing in a case where it is determined that a recognition of the near image and the distant image is reduced, or in a case where it is determined that it is best to improve the recognition, the display manner changing processing contains at least one of:

[0023] change a display mode of a background of the close-up image,

[0024] and

[0025] add an image of a frame surrounding the close-up image,

[0026] and

[0027] add an image of a line on at least a part of a periphery of the close-up image,

[0028] and

[0029] in a case where a plurality of display contents are included as the close-up image, add an image of a line in a manner of crossing at least two of the plurality of display contents.

[0030] In the first mode, among a distant image and a close-up image displayed at different display distances, display mode change processing is performed on the close-up image in a prescribed case to simplify recognition from the distant image and improve visibility of the displayed image.

[0031] Since a human visual field has a prescribed range, for example, even in a case where a visual recognizer observes a distant image, there is a case where a close-up image also enters the visual field. The distant image and the close-up image have different display distances (for example, distances to an image or a display surface of an image from a viewpoint of a visual recognizer), and thus, basically, it is possible to recognize the case by a difference between the display distances, but there is also a case where a difference between distances between the two images is relatively small.

[0032] Further, for example, in a case where a plurality of display contents are displayed as distant images and these are displayed uniformly, it is difficult to distinguish these from a plurality of display contents observed on a front side as close-up images.

[0033] In such a case, by implementing display mode change processing including addition of a background, change of a background (change including shape, color, and the like), addition of a frame, addition of a line image (addition of a line image in a manner of crossing a plurality of display contents), and the like on the close-up image, it is possible to express, for example, a case where a plurality of display contents are displayed uniformly in a natural form.

[0034] In other words, it is possible to improve recognizability (visual recognizability) of the close-up image (close-up image of a group when there are a plurality of display contents) with respect to the distant image without causing discomfort.

[0035] Thus, even assuming that the close-up image enters a visual field range, a visual recognizer is able to gaze at the distant image without paying particular attention to the close-up image, for example, thereby reducing a sense of strangeness. Thus, it is possible to realize a display that is easy to observe.

[0036] In the second method, which is subordinate to the first method, it could be:

[0037] The following are situations where the recognizability of the near image and the far image is reduced, or situations where it is best to improve the recognizability:

[0038] When the amount of displayed content contained in the distant image exceeds a predetermined threshold,

[0039] or,

[0040] As for the distant image, in cases where highly important content is displayed at least one or more times a predetermined threshold, that content is shown.

[0041] or,

[0042] Regarding at least one display content shown as the distant image, an increased importance was detected.

[0043] In the second approach, an example of a situation where the recognizability of near and far images is determined to be reduced is when the number of displayed contents as far images exceeds a threshold. Additionally, an example of a situation where the importance (display priority) of displayed contents as far images is increased is taken as a way to best improve recognizability.

[0044] In the example scenario, it is desired that the visual observer (driver, etc.) pay attention to the information cues presented by a distant image, and it is necessary to prevent nearby images from entering the field of vision and becoming difficult to observe. Therefore, a display modification process is implemented for nearby images to improve their recognizability relative to distant images. This allows for various information cues to be presented based on an easily observable display.

[0045] In the third method, which is subordinate to the second method, it could be:

[0046] The content to be displayed for the high-importance provisions is as follows:

[0047] AR content that is overlaid on the real scene.

[0048] or,

[0049] The display content of driver assistance information using Advanced Driver Assistance Systems (ADAS) (ADAS display content).

[0050] In the third approach, AR or ADAS displays treat distant images as high-priority content. These displays contribute to safe driving and are treated as important content because they frequently highlight crucial information.

[0051] In the fourth method, which is subordinate to the second method, it could be:

[0052] Regarding the at least one displayed content, the situation where increased importance is detected is as follows:

[0053] When navigation is displayed, if the distance to the branch point where a turn is required is within the specified distance...

[0054] or,

[0055] Regarding the ADAS display content that has been shown, there are situations where the danger to safe driving has increased.

[0056] In the fourth approach, an example is given of a situation where the importance of the displayed content, which is a distant image, can be determined to be increased. When approaching a location requiring steering (such as steering wheel operation), or when the danger of ADAS (Advanced Driver Assistance Systems) content increases, a attention alert or warning display may be shown, requiring the visual observer (driver, etc.) to pay attention to the display as early as possible and take appropriate action. Therefore, it is preferable to suppress the confusion caused by the near-field image entering the field of vision. Thus, in the above-mentioned cases, a display mode change process is performed on the near-field image.

[0057] In the fifth method, which is subordinate to any of the first to fourth methods, it can be

[0058] The display control device is mounted on the vehicle.

[0059] The height direction of the vehicle is defined as the longitudinal direction, the width direction of the vehicle is defined as the transverse or left-right direction, and the direction orthogonal to the longitudinal and transverse directions is defined as the depth direction.

[0060] When multiple display contents are shown as the near image, and these multiple display contents are arranged horizontally with intervals between them,

[0061] The display mode change process is a process that enables the visual observer to perceive that the multiple display contents are uniformly configured in the horizontal direction.

[0062] In the fifth approach, when multiple display contents are arranged horizontally as near images, a display mode change process is implemented to give the impression that each display content is configured uniformly.

[0063] When visual content is perceived individually (in a fragmented manner), the visual observer needs to determine whether the image is near or far for each piece of content, which increases the burden on the visual observer and adds to the confusion.

[0064] Therefore, for example, in the display area of ​​each display content, a background of a prescribed shape (and may also be accompanied by a prescribed color or gradient pattern) is displayed, or a line image with curved parts is displayed in a way that spans the left and right ends of the display content, giving the impression that the display content arranged in a row is unified in the left and right direction (however, this is just one example, but not limited to this).

[0065] Therefore, the display area of ​​the image can be intuitively identified. Thus, the recognizability of the image relative to the distant image can be improved in a natural way without causing discomfort to the visual observer.

[0066] In the sixth method, which is subordinate to the fifth method, it could be:

[0067] The display mode change process is a process that makes the visual observer perceive that the multiple display contents are uniformly configured in the horizontal direction.

[0068] However, the increase in visual recognizability of the multiple displayed contents perceived as a whole as a unified whole is suppressed.

[0069] In the sixth method, the display method change processing described in the fifth method is not, for example, as in the previously shown Patent Document 1, "to increase visual recognizability and attract attention by emphasizing the processing, thereby improving the recognizability of the near image", but rather explicitly suppresses the increase in the overall visual recognizability of multiple display contents.

[0070] In other words, this method improves the recognizability (identifiability) of distant images by suppressing the increase in visual recognizability and maintaining natural vision within the visual observer's field of vision, for example, by "making nearby images visually similar to distant images." Therefore, the visual observer can easily focus on distant images of high importance.

[0071] In the seventh method, which is subordinate to the fifth or sixth method, it could be:

[0072] The display mode change processing further includes: processing that creates a sense of depth in at least a portion of the display area of ​​the plurality of display contents by means of at least one of linear distance method and atmospheric distance method that adjusts the degree of sharpness.

[0073] In the seventh approach, for multiple displayed contents contained in a nearby image, in addition to giving a unified impression in the horizontal direction, it also clarifies the creation of a sense of distance in the depth direction. To represent distance, for example, linear distance can be used. Alternatively, atmospheric distance can be used (which utilizes the principle that images located nearby have high sharpness, while images located far away have low sharpness and more halo, representing distance based on sharpness variations).

[0074] When a distant image is superimposed on the real scene, it is common to configure the displayed content in a way that conveys a sense of distance. Therefore, by introducing a sense of distance into the nearby image as well, the matching between the two images is increased, resulting in a more natural visual effect.

[0075] On the other hand, the perception of distance used for near images is different from that used for distant images. Therefore, near images (in other words, the display area of ​​near images) that incorporate perspective can be easily and intuitively distinguished from distant images.

[0076] This ensures a natural visual experience, reduces discomfort for the visual observer, and makes it easy to distinguish between two images.

[0077] In the eighth method, which is subordinate to any of the fifth to seventh methods, it could be:

[0078] The display mode change process includes: changing the near image to a display primarily composed of achromatic colors, relative to the distant image which is mainly displayed in color.

[0079] In the eighth method, the following point is clarified, which enables the display mode of nearby images to be mainly achromatic after the display mode is changed.

[0080] When a distant image includes AR or ADAS images, it is often displayed in color, such as red, yellow, or blue, to easily attract the attention of the visual observer. This is because the road surface, where vehicles travel, is often achromatic (e.g., dark-colored), and the white lines painted on the road are also achromatic. Displaying these in similar colors would be less likely to attract the visual observer's attention.

[0081] With this in mind, for near images (including the background), by coloring them primarily with achromatic colors (for example, including gray, black, white, and gradients using these colors), it is possible to give them a different impression than distant images. Thus, near images are easily and intuitively distinguished from distant images.

[0082] For example, one could envision coloring the background of the display area containing multiple pieces of content with a dark color such as gray, while on the other hand, using blank text or graphics to represent more than half of the display content (however, this is just one example and is not a limitation). This would allow for a display that is easy to observe without causing discomfort.

[0083] In the ninth method, which is subordinate to any of the fifth through eighth methods, it could be:

[0084] The display area of ​​the near image is positioned below the display area of ​​the far image.

[0085] In the ninth method, it is clearly stated that, from the perspective of the visual observer, the display area of ​​the near image is located below the display area of ​​the distant image. When the visual observer views a distant image, if they lower their gaze slightly, the near image often enters their field of vision, and the confusion caused by the mixed vision of the distant and near images often increases. Therefore, the processing of changing the display method of the nearby image as described above is effective.

[0086] In the tenth embodiment, the display device includes:

[0087] A head-up display device that displays a distant image; and

[0088] A display device or a head-up display device that displays a near image by means of a display control device of any of the first to ninth methods.

[0089] According to the tenth method, a display device can be provided that can suppress the reduction in the recognizability of near / far images and improve the visibility of the displayed image.

[0090] In the eleventh method, the display control method, based on a visual observer, controls the display of a near image displayed at a closer distance and a distant image displayed at a farther distance, characterized by comprising:

[0091] The steps include determining whether the recognizability of the near image and the far image is reduced, or determining whether it is best to improve the recognizability; and

[0092] When the determination result is positive, a display mode change process is performed, the display mode change process including at least one of the following: changing the display mode of the background of the near image; adding an image of a frame surrounding the near image; adding an image of a line on at least a portion of the periphery of the near image; and, in the case where the near image includes multiple display contents, adding an image of a line that spans at least two of the multiple display contents.

[0093] According to the eleventh method, it is possible to suppress the reduction in the recognizability of near / far images and improve the visibility of displayed images through a relatively simple method.

[0094] Those skilled in the art will readily understand that further modifications can be made to the exemplified manner according to the invention without departing from the spirit of the invention. Attached Figure Description

[0095] Figure 1This diagram illustrates a structural example of a display device (an in-vehicle display device including a display device and a HUD device) and a setting example of the virtual image display surface using the HUD device.

[0096] Figure 2 (A) and (B) are diagrams showing other examples of display devices that use a display device and a HUD device.

[0097] Figure 3 It means to utilize Figure 2 Figures (A) and (B) show an example of a display device.

[0098] Figure 4 This is a diagram illustrating a structural example of a display device that uses two HUD devices.

[0099] Figure 5 It means to utilize Figure 4 The diagram shows an example of a display device.

[0100] Figure 6 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 6 (B) and (C) are examples of displaying near and far images after the display mode change process.

[0101] Figure 7 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 7 (B) and (C) are other examples of how the display of near and far images changes after the display mode is modified.

[0102] Figure 8 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 8 (B), (C), and (D) are further examples of how the display of near and far images changes after the display mode is modified.

[0103] Figure 9 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 9 (B) and (C) are diagrams showing how the display of the nearby image changes in stages as the point of approaching the branch point where a turn is required.

[0104] Figure 10 (A) and (B) are examples of distant images deemed to be of high importance and examples of near images after the display method has been changed.

[0105] Figure 11(A) is a diagram showing the driving scene as observed through the windshield from both the near and far images before the display mode change processing. Figure 11 (B) is an example of a driving scenario where the importance of distant images is increased, and the display method of nearby images is changed.

[0106] Figure 12 This is a diagram illustrating an example of the structure of a system that controls the display of a display device.

[0107] Figure 13 This is a flowchart illustrating an example of the display control steps for a nearby image. Detailed Implementation

[0108] The preferred embodiments described below are used for ease of understanding of the invention. Therefore, those skilled in the art should note that the invention is not unduly limited to the embodiments described below.

[0109] See Figure 1 . Figure 1 This diagram illustrates a structural example of a display device (an in-vehicle display device including a display device and a HUD device) and a setting example of the virtual image display surface using the HUD device.

[0110] In addition, Figure 1 In this context, the direction along the line segment connecting the left and right eyes of the visual observer (in other words, the width direction of vehicle 1) is defined as the left-right direction (or lateral direction). The direction along the line segment orthogonal to the left-right direction and orthogonal to the ground or a surface equivalent to the ground (in this case, road surface 6) is defined as the up-down direction (or height direction). The direction along the line segments orthogonal to both the left-right and up-down directions (representing the direction in which vehicle 1 moves forward and backward) is defined as the front-back direction. Additionally, the front direction is sometimes also called the depth direction. The left-right direction can also be labeled as the X direction, the up-down direction as the Y direction, and the front-back direction as the Z direction.

[0111] Furthermore, this specification uses the term "near-view image" or "far-view image." A near-view image is the image displayed in front of the viewer, while a far-view image is the image displayed further inwards. In other words, from the viewer's perspective, the image displayed in the display area (display surface) in front is the near-view image, and the image displayed in the display area (display surface) further inwards is the far-view image. The near-view image can also be called a near-positioned image or a front-view image. The far-view image can also be called a rear-positioned image or a rear-view image.

[0112] The display device here refers to an in-vehicle display device mounted on vehicle 1. This in-vehicle display device includes at least one of a display device (including a control unit 140, a display control unit 107, and a display (display device) 108 such as an LCD panel) and a head-up display (HUD) device 100 (including a control unit 140 and a device body 120). Figure 1 In the example, both are mounted on vehicle 1.

[0113] HUD device 100 is, for example, installed in the dashboard (in other words, instrument panel) 41.

[0114] The main body of the device 120 includes: a display 150 such as an LCD panel, a screen (display unit) 160 with a display surface 164, and a curved mirror (concave mirror, etc.) 170 with a light-reflecting surface 179.

[0115] A curved mirror (concave mirror, etc.) 170 reflects light from the screen 160, projecting the display light K onto the windshield (projected component) 2 of the vehicle 1. In the windshield (projected component) 2, a portion of the display light K is reflected and incident on the viewpoint (eye) A of the visual observer (driver, etc.). Lights E1 to E3, corresponding to the optical diopter of each incident light, are imaged at an imaging point in front of the visual observer, thereby displaying a virtual image on the virtual image display surface PS. Furthermore, the virtual image display surface PS is an imaginary (optically diopter) surface set in the real space in front of the visual observer, corresponding to the display surface 164 in the screen 160.

[0116] In addition, the virtual image display surface PS can be, for example, a vertical surface a perpendicular to the road surface 6, inclined surfaces b and c tilted relative to the road surface 6, a road surface overlap surface d overlapping the road surface 6, and a surface e with the side closer to the viewer being a vertical surface (including a suspected vertical surface) and the side farther from the viewer being an inclined surface. In displays using surfaces other than vertical surface a, the display distance of the virtual image varies depending on its display position on the virtual image display surface, thus enabling 3D display.

[0117] Next, refer to Figure 2 . Figure 2 (A) and (B) are diagrams illustrating other examples of display devices that utilize both a display device and a HUD device. Figure 2 In the middle, to and Figure 1 The same reference numerals should be used for the same parts. This also applies to other figures.

[0118] Figure 2 The common feature of examples (A) and (B) is that a distant image V1 is displayed by the HUD device 100, and a nearby image V2 is displayed by the display (display device) 108 installed in the vehicle.

[0119] but, Figure 2 The display (display device) 108 in (B) and Figure 2 (A) In contrast, the viewpoint from the visual observer (driver) is positioned on the side in front of the steering wheel (the side closest to steering wheel 4). This is a structural difference.

[0120] In addition, Figure 2 In (A) and (B), a display 151 for displaying the original image is provided in the HUD device 100. However, the optical system that guides the display light from the display 151 to the curved mirror (concave mirror, etc.) 170 is omitted.

[0121] Next, refer to Figure 3 . Figure 3 It means to utilize Figure 2 (A) Figure 2 (B) is a diagram showing an example of a display device.

[0122] exist Figure 3 In the display (display device) 108, as a near-field image, three display contents are spaced apart horizontally (left and right direction) and arranged in a column. At the left is a barcode display D1 indicating various information (such as vehicle temperature or RPM data); at the center is a vehicle speed display (displayed as "80 km / h") D2; and at the right is a display indicating the current time (displayed as "12:56 pm") D3.

[0123] Additionally, in front of vehicle 1, a navigation display F1 and a fuel gauge display F2 are displayed as AR displays, overlapping with the real-world view. These are displayed on a virtual image display surface 111 located in front of vehicle 1.

[0124] Distant images F1 and F2 are visually recognized by the driver (visual observer) through the windshield 2. From the driver's perspective, the display area of ​​near images D1 to D3 is located below the distant images F1 and F2, with a relatively small vertical distance. The visual observer can observe near images D1 to D3 by slightly lowering their line of sight. However, since the field of vision is limited, it is assumed that even when the visual observer is viewing distant images F1 and F2, near images D1 to D3 will frequently enter the field of vision.

[0125] Next, refer to Figure 4 . Figure 4 This diagram illustrates a structural example of a display device using two HUD units. Figure 4 In the windshield 2, the near image V2 is displayed as a virtual image via the HUD device 101. Furthermore, from the perspective of a visual observer, the near image V2 is displayed on the inside of the windshield 2.

[0126] Regarding the distant image V1, and Figure 2 The same example applies, where the image is displayed as a virtual image via HUD device 100. Furthermore, either HUD device can be referred to as the "first HUD device," and the other as the "second HUD device."

[0127] Next, refer to Figure 5 . Figure 5 It means to utilize Figure 4 The diagram shows an example of a display device. The displayed content is... Figure 3 Same. However, in Figure 4 The middle part does not have a setting Figure 3 The display (display device) 108. A suitable display area 113 is set on the instrument panel 41, and the near images D1 to D3 are displayed on the display area 113.

[0128] Next, refer to Figure 6 . Figure 6 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 6 (B) and (C) are examples of displaying near and far images after the display mode change process.

[0129] exist Figure 6 In the example, control unit 140 (refer to...) Figure 1 It can perform display mode change processing on nearby images. Display mode change processing can be performed, for example, when it is determined that the recognizability of nearby images and distant images is reduced, or when it is determined that it is best to improve recognizability.

[0130] In the display mode change process, display control is performed, which includes, for example, at least one of the following: changing the display mode of the background of a near image; adding an image that surrounds the near image; adding an image that adds a line on at least a portion of the periphery of the near image; and, in the case where multiple display contents are included as the near image, adding an image that adds a line across at least two of the multiple display contents.

[0131] Figure 6 (A) Indicates the normal display mode for near images (the display mode before the display mode change process). This display mode is different from the previous one. Figure 3 The display method shown is the same.

[0132] exist Figure 6In (B), in addition to F1 and F2, speed limit information F3, a warning display (text such as "Strong Wind Warning") F4, and information indicating the distance to the vehicle ahead F5 are added as distant images. F3 can be regarded as an important navigation display, while F4 and F5 can be regarded as driver assistance information (ADAS information, ADAS image) utilizing the Advanced Driver Assistance System (ADAS).

[0133] Here, a predetermined threshold is set to m (where m = 2) for the number of displayed contents as distant images.

[0134] exist Figure 6 In state (A), the amount of displayed content contained in the distant image does not exceed the threshold (m=2), but... Figure 6 (B) The threshold is exceeded. When the number of displayed contents of a distant image exceeds the threshold, the visual observer (driver) has to observe each displayed content, increasing the burden on them to grasp its meaning.

[0135] Here, when a visual observer is viewing distant images F1 to F5, if nearby images D1 to D3 enter their field of vision, the visual observer's workload increases further. In particular, the visual observer experiences confusion when D1 to D3 are perceived individually (disorganizedly). Furthermore, the visual observer's cognitive burden increases because they need to individually identify the information cues presented in each displayed element.

[0136] Therefore, the control unit 140 performs a display mode change process on the near image. This display mode change process unifies the multiple display contents D1 to D3, which are arranged horizontally at intervals, in the left-right direction, allowing for intuitive understanding. Furthermore, this display change makes it easier to distinguish between near and far images. Therefore, even when a near image enters the field of view, it is possible to intuitively recognize and differentiate between near and far images. As a result, the visual observer can notice the distant image while not focusing on the near image.

[0137] In this case, the change in the display method of the near image is not a process that improves visual recognizability (attractiveness) through emphasis processing as in Patent Document 1, but rather has the following visual effect: while suppressing the increase in visual recognizability, it is easy to distinguish from the distant image and separates the near image from the distant image without causing discomfort. Therefore, it can improve the visibility of the distant image without creating a sense of incongruity.

[0138] exist Figure 6 In (B), a background 115 is added across the display content D1 on the left and the display content D3 on the right. The background may also have a specified color or pattern 115c added within a specified area.

[0139] In addition, Figure 6 In (B), the central vehicle speed display (displayed as "80km / h") D2 is intentionally excluded from the area of ​​background 115. In other words, an inverted trapezoidal cutout is provided on background 115. The opposing hypotenuses of this inverted trapezoid help to create a sense of distance that is the opposite of the usual linear perspective. In other words, in Figure 6 In (B), the addition of a background makes it easy to intuitively grasp the unity of the displayed content in the left and right directions, and also gives a sense of distance that is different from the usual linear perspective method. This matches the display content F1 and F5 of distant images displayed using the perspective method, helping to ensure natural vision without causing discomfort.

[0140] exist Figure 6 In (C), the background 116 is colored (or can be a pattern, etc.) within a trapezoidal area. Three display elements, D1 to D3, are positioned within the trapezoidal background 116. Figure 6 In (C), the uniformity of the displayed content D1 to D3 in the left-right direction is also easily perceived. Furthermore, the pair of hypotenuses of the trapezoid also create a sense of distance. Therefore, it is easy to match with distant images and to easily distinguish between distant and near images while ensuring a natural visual experience. Thus, it becomes an easy-to-observe display.

[0141] Next, refer to Figure 7 . Figure 7 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 7 (B) and (C) are other examples of how the display of near and far images changes after the display mode is modified.

[0142] Figure 7 (A) and Figure 6 (A) Same. Figure 7 (B) and (C) are those previously shown Figure 6 A variation of example (C) (the example with an attached trapezoidal background). Figure 7 In (B), the concept of atmospheric perspective is used to represent a sense of distance. In a trapezoidal background, the sharpness is changed in stages or continuously, with the lower side becoming sharper and the upper side becoming sharper, thus creating a so-called gradient display.

[0143] This creates a natural sense of distance. It achieves the following effects: improved consistency with distant images, and easier differentiation from distant images while maintaining a comfortable visual experience.

[0144] exist Figure 7In example (C), a grid-like line image 119, drawn using the method of line perspective, is added inside the trapezoidal background 118. This creates a natural sense of depth. The resulting effect is similar to... Figure 7 The situation is the same as in (B).

[0145] then, Figure 8 (A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 8 (B), (C), and (D) are further examples of how the display of near and far images changes after the display mode is modified.

[0146] Figure 8 (A) and Figure 6 (A) Same. Figure 8 In (B), the display mode of the near image is changed, and a line image Q is added around the display content D1 to D3 of the near image.

[0147] The line image Q is composed of line segments Q1 and Q4 extending in the left-right direction, a hypotenuse Q2 connected to line segment Q1, and a hypotenuse Q3 connected to line segment Q4. By adding this line image Q, the viewer is given the impression that the various displayed contents D1 to D3 are uniformly arranged. Furthermore, due to the presence of hypotenuses Q2 and Q3, a different sense of distance is created compared to distant images. This also makes it easier to distinguish between near and far images. In addition, the addition of a sense of distance also has the effect of improving consistency with the displayed contents F1 and F5 depicted using the perspective method. Therefore, even if the display method is changed, a natural visual experience can be maintained without causing discomfort to the viewer.

[0148] exist Figure 8 In (C), the line image has: line segments P1 and P7 extending laterally, a carriage line P2 connected to line segment P1, a diagonal line P4 connected to line segment P7, and a line segment P3 connecting the upper ends of a pair of opposing diagonal lines and extending laterally. The resulting effect is similar to... Figure 8 (B) Same.

[0149] exist Figure 8 In (D), a frame P8 is added to enclose the three display contents D1 to D3. Furthermore, colors or patterns can be added inside frame P8. Figure 8 In (D), the viewer is given the impression that multiple displayed contents D1 to D3 are uniformly arranged and that the images within their frames are near images. Therefore, it makes it easy to distinguish between near and far images, resulting in an easy-to-observe display.

[0150] Next, refer to Figure 9 . Figure 9(A) is a diagram showing an example of the display of the near and far images before the display mode change process. Figure 9 (B) and (C) are diagrams showing how the display of the nearby image changes in stages as the point of approaching the branch point where a turn is required.

[0151] exist Figure 9 In (A), the highway exit 904 is observed from a distance via the windshield 2. This highway exit 904 corresponds to a branch point where vehicles need to turn. A pointer J1, intended to draw attention (or guide viewpoint), is displayed at exit 904 via a HUD device. For close-up displays, a normal display is used.

[0152] exist Figure 9 In (B), the vehicle approaches exit 904, and the distance to exit 904 is within a specified threshold. Therefore, a more explicit signage display (AR display) 906 indicating exit 904 is displayed. Subsequently, the display method of the nearby image is changed. Figure 9 In (B), the previous implementation Figure 8 (B) shows the modification process for the additional line image Q.

[0153] exist Figure 9 In (C), the vehicle is approaching exit 904. As a result, a vehicle guidance display 907 is shown on the road surface. Consequently, the display method for the nearby image is changed. Figure 9 In (C), as before Figure 7 (B) illustrates a display method that alters the perception of distance through gradual changes. As a result, the perception of distance for near images is matched with the display 907 (a display with independent perception of distance) guiding vehicles on the road surface as a distant image, thus maintaining a natural visual experience. Furthermore, the intuitive recognizability of the distant and near images is enhanced. Therefore, it becomes an easy-to-observe display.

[0154] Next, refer to Figure 10 . Figure 10 (A) and (B) are examples of distant images deemed to be of high importance and examples of near images after the display method has been changed.

[0155] exist Figure 10 (A) shows the speed limit display LS1 as an AR display. Additionally, via ADAS, a attention warning sign M1 is displayed overlaid on the vehicle ahead G1. This attention warning sign M1 corresponds to a distant image of high importance.

[0156] Correspondingly, the display mode of nearby images is changed to the previously shown format. Figure 6 (B) Display method.

[0157] In addition, Figure 10 In (B), the vehicle G2 ahead is located far away and there is no particular problem. However, person B1 enters the road, and the ADAS displays a warning box C1. The warning box C1 corresponds to a distant image of high importance.

[0158] Correspondingly, the display mode of nearby images is changed to match... Figure 8 (B) Same display method.

[0159] Next, refer to Figure 11 . Figure 11 (A) is a diagram showing the driving scene as observed through the windshield from both the near and far images before the display mode change processing. Figure 11 (B) is an example of a driving scenario where the importance of distant images is increased, and the display method of nearby images is changed.

[0160] exist Figure 11 In (A), both the near-field image and the far-field image are observed in front of the vehicle through the windshield 2. In front of the vehicle, a vehicle G3 is observed at a distance. Additionally, as a distant image, a speed limit display (AR display) LS1 is displayed.

[0161] Figure 11 (B) is more Figure 11 (A) Driving scenarios requiring extra attention: The road ahead curves to the left. Additionally, the vehicle is traveling at high speed. Furthermore, with vehicles G4, G5, and G6 ahead, special attention must be paid to the following distance from the nearest vehicle, G4.

[0162] As part of the distant image display: a speed limit display LS2, a warning sign U1 indicating the vehicle ahead G4, a marker W1 to help maintain a safe following distance, and a display W2 of multiple arrows guiding the vehicle's path. The multiple arrows W2 are arranged along the white line 9 on the road surface 6. The number of items displayed as distant images has been significantly increased, and the importance (priority) of the displays has also been improved.

[0163] In addition, when a near image is positioned directly below a distant image, the visual recognition workload is likely to increase when the near image enters the field of vision.

[0164] Therefore, the display method of the near image is changed. Here, the three display contents of the near image are enclosed in a box, and the inside of the box is colored to serve as an additional background for the whole.

[0165] After this display mode change, nearby images are displayed primarily in achromatic mode. The reasons are as follows.

[0166] like Figure 11 As clearly described in the text, when a distant image contains AR or ADAS images, the display often uses colors such as red, yellow, or blue to easily attract the attention of the visual observer.

[0167] This is because the road surface 6 of vehicles is often achromatic (e.g., dark color), and the white lines 9 painted on the road surface are also achromatic. When using colors of the same color family, it is difficult to attract the attention of visual observers.

[0168] With this in mind, for near images (including the background), by coloring them primarily with achromatic colors (for example, including gray, black, white, and gradients using these colors), it is possible to give them a different impression than distant images. Thus, near images are easily and intuitively distinguished from distant images.

[0169] exist Figure 11 In example (B), the background color S1 of the near image is, for example, light gray (grey), the barcode display D1 is displayed in white and black (or as a receding cool color), and the speed display D2 is blank, thus creating a display primarily based on achromatic colors. This allows for a natural and comfortable distinction between near and distant images, reducing the burden on the visual observer.

[0170] Next, refer to Figure 12 . Figure 12 This is a diagram illustrating an example of the structure of a system that controls the display of a display device.

[0171] The vehicle-mounted display device (display device) 180 includes: an I / O interface 30, a processor (control device) 172 with a control unit (display control unit) 140, an image processing unit 210, an image display unit 230, a storage unit (memory) 350, and an external communication connection device 420.

[0172] The image display unit 230 has: Figure 1 The display control unit 107 and display 108 shown, as well as the display 150 and display control unit 163, which are structural elements of the HUD device 100 (in Figure 1 (Not shown in the image).

[0173] The following components are connected to the I / O interface 30: a road information database 403, a vehicle position detection unit 405, an external sensor 407, a line-of-sight detection unit 409, an eye position detection unit 411, a portable information terminal 413, and a vehicle ECU 415.

[0174] Various sensors, such as the pitch angle sensor 417 or the steering angle sensor 419, provide necessary information to the vehicle ECU 415 as appropriate. Additionally, the I / O interface 420 connects to an external communication connection device 420.

[0175] In addition, the storage unit (memory) 350 includes, for example, a real object and its position detection module 510, a surrounding environment detection module 512, a vehicle condition detection module 514, an image type determination module 516, an image configuration determination module 518, a graphics display module 520, and a display mode determination module 522.

[0176] The display mode determination module 522 includes a display mode determination module 327 for near images (near display) and a display mode determination module 329 for distant images (distant display). The processor 172 operates according to the above modules, thereby constructing, for example, a control unit 140 or various processing units as functional blocks. The control unit 140 controls the display mode change processing of the near images, etc.

[0177] Next, refer to Figure 13 . Figure 13 This is a flowchart illustrating an example of the display control steps for a nearby image.

[0178] In step S1, the vehicle's operating status, surrounding environment, and other information are detected to obtain various data. In step S2, the content to be displayed in the nearby image is determined based on the obtained information.

[0179] In step S3, when displaying the content of a nearby image, it is determined whether to perform a display mode change process. In other words, it is determined whether the conditions for changing the display mode are met. If yes, the display mode change process is implemented in step 4. The display mode change process may also include processes such as background addition, line image addition, frame addition, gradient display, and background color change.

[0180] If the result in step S3 is negative, the display proceeds in the normal display mode in step S5. A termination determination is made in step S6; if the result is negative, the process returns to step S1; otherwise, it ends.

[0181] As explained above, according to the present invention, the reduction in the recognizability of near / far images can be suppressed, thereby improving the visibility of the displayed image.

[0182] This invention can be modified and applied in various ways. For example, in processing changes to the display method of nearby images, it is not limited to the examples in the above embodiments, and various display methods can be appropriately adopted.

[0183] Furthermore, in this specification, the term "vehicle" can be broadly interpreted as a means of transportation. Additionally, navigation-related terms (such as AR display, ADAS display, etc.) are also broadly interpreted. Furthermore, HUD devices or display devices (and display devices in the broader sense) also include devices used as simulators (such as aircraft simulators, simulators for gaming devices, etc.).

[0184] This invention is not limited to the embodiments described in the above examples. Furthermore, those skilled in the art can readily modify the embodiments described in the above examples to fit the scope of the claims.

[0185] Explanation of reference numerals in the attached figures

[0186] 1…Vehicle (this vehicle), 2…Windshield (projected component), 6…Road surface, 30…I / O interface, 41…Instrument panel, 100…HUD device, 108…Display (LCD panel, etc.), 109…Display surface of the display, 120…Main body of the HUD device, 140…Control unit (display control unit), 160…Display (LCD panel, etc.) of the HUD device, 160…Screen, 164…Display surface of the screen, 170…Curved mirror (concave mirror, etc.), 179…Reflective surface of the curved mirror, 210…Image processing unit, 230…Image display unit, 350…Storage unit, 522…Display mode determination module, 327…Display mode determination module for near images, 329…Display mode determination module for distant images, K…Display light, PS…Image display surface

Claims

1. A display control device, characterized in that, Perform image display control, and It includes: a control unit that controls the display mode of the image. The image includes a close-up image displayed at a closer distance relative to the visual observer and a distant image displayed at a greater distance. When the control unit determines that the recognizability between the near image and the far image is reduced, or when it determines that it is best to improve the recognizability, it performs a display mode change process, the display mode change process including at least one of the following: Change the display method of the background of the nearby image. as well as, Add an image with a frame surrounding the nearby image. as well as, An image with lines added to at least a portion of the periphery of the near image. as well as, In the case where multiple display contents are included as the near image, an image is added in a manner that spans at least two of the multiple display contents. In the display mode change process, the background, the frame image, and the line image have a pair of opposing diagonal edges in the horizontal direction.

2. The display control device according to claim 1, characterized in that, The following are situations where the recognizability of the near image and the far image is reduced, or situations where it is best to improve the recognizability: When the amount of displayed content contained in the distant image exceeds a predetermined threshold, or, As for the distant image, in cases where highly important content is displayed at least one or more times a predetermined threshold, that content is shown. or, Regarding at least one display content shown as the distant image, an increased importance was detected.

3. The display control device according to claim 2, characterized in that, The content to be displayed for the high-importance provisions is as follows: AR content that is overlaid on the real scene. or, The display content of driver assistance information using Advanced Driver Assistance Systems (ADAS) (ADAS display content).

4. The display control device according to claim 2, characterized in that, Regarding the at least one displayed content, the case in which an increased importance is detected is: When navigation is displayed, if the distance to the branch point where a turn is required is within the specified distance... or, Regarding the ADAS display content that has been shown, there are situations where the danger to safe driving has increased.

5. The display control device according to any one of claims 1 to 4, characterized in that, The display control device is mounted on the vehicle. The height direction of the vehicle is defined as the longitudinal direction, the width direction of the vehicle is defined as the transverse or left-right direction, and the direction orthogonal to the longitudinal and transverse directions is defined as the depth direction. When multiple display contents are shown as the near image, and these multiple display contents are arranged horizontally with intervals between them, The display mode change process is a process that enables the visual observer to perceive that the multiple display contents are uniformly configured in the horizontal direction.

6. The display control device according to claim 5, characterized in that, The display mode change process is a process that makes the visual observer perceive that the multiple display contents are uniformly configured in the horizontal direction. However, the increase in visual recognizability of the multiple displayed contents perceived as a whole as a unified whole is suppressed.

7. The display control device according to claim 5 or 6, characterized in that, The display mode change processing further includes: processing that creates a sense of depth in at least a portion of the display area of ​​the plurality of display contents by means of at least one of linear distance method and atmospheric distance method that adjusts the degree of sharpness.

8. The display control device according to any one of claims 5 to 7, characterized in that, The display mode change process includes: changing the near image to a display primarily composed of achromatic colors, relative to the distant image which is mainly displayed in color.

9. The display control device according to any one of claims 5 to 8, characterized in that, The display area of ​​the near image is positioned below the display area of ​​the far image.

10. A display device, characterized in that, Include: A head-up display device that displays a distant image; and A display device or head-up display device that displays a near image by means of display control using the display control device according to any one of claims 1 to 9.

11. A display control method, based on a visual observer, controls the display of a near image displayed at a closer distance and a distant image displayed at a farther distance, characterized in that, Include: The steps include determining whether the recognizability of the near image and the far image is reduced, or determining whether it is best to improve the recognizability; and When the determination result is positive, a display mode change process is executed, wherein the display mode change process includes at least one of the following: changing the display mode of the background of the nearby image; An image that includes a frame surrounding the near image; and an image that includes lines on at least a portion of the periphery of the near image; And, in the case where multiple display contents are included as the near image, an image in which lines are added in a manner that spans at least two of the multiple display contents. In the display mode change process, the background, the frame image, and the line image have a pair of opposing diagonal edges in the horizontal direction.

Images