Display control device, display device, and display control method

Abstract

To achieve HUD display which suppresses hindrance of visual recognition of an actual scene, reduces discomfort, and is easy for a crew member to view.SOLUTION: A display control device 700 which is mounted on a vehicle 1 and performs image display control has a control part 140 for controlling visibility levels of display objects 304 and 306, wherein when performing low visibility processing of setting the visibility levels of the display objects to a second visibility level lower than a first visibility level, the control part distinguishes the display objects into a contour part that includes a line constituting the contour of the display object and is the outermost part, and a non-contour part that is the inside part of the contour part, and does not lower the visibility of the contour part and lowers the visibility of the non-contour part.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a display control device mounted on a vehicle such as an automobile, a display device such as a head-up display (HUD) device, a display control method, and the like. [Background technology]

[0002]

[0013] of Patent Document 1 states that "the display control means generates a guide image for superimposing and displaying the guidance information on the windshield so that the display object detected by the display object detection means and the guidance information overlap when viewed from within the vehicle cabin, and causes the guide image to be superimposed and displayed on the windshield via the display means."

[0003] Furthermore,

[0014] states that "when the position of the object to be displayed changes beyond a predetermined display setting area, the display control means darkens the guide image or changes the guide image from a normal image to a simplified image that is smaller than the normal image." [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2015-11666 Summary of the Invention [Problem to be solved by the invention]

[0005] The present inventors have identified the following problems.

[0006] In a head-up display (HUD) device, when a display by the HUD (hereinafter referred to as "HUD display") is superimposed on the real view, the HUD display may in some cases interfere with the visibility of the real view by the occupant (driver, etc.). For example, location information may be displayed in a position that blocks the occupant's (viewer's) forward view, which may reduce the visibility of the foreground or reduce the viewer's visual attention to the foreground.

[0007] As a countermeasure, as described in Patent Document 1, it is possible to reduce the visibility (attractiveness) of the HUD display by making it darker or smaller, but it is possible that the reduced visibility (attractiveness) will make the HUD display difficult to see, which may cause occupants to feel uncomfortable.

[0008] In other words, it is important to simultaneously prevent the HUD display from interfering with the visibility of the actual scene and ensure the visibility (attractiveness) of the HUD display so that useful information is displayed in an easy-to-see manner to the occupants, and in this regard, there is room for improvement in HUD devices.

[0009] One of the objects of the present invention is to realize a HUD display or the like that is easy for the occupant to see while suppressing interference with the visibility of the actual scenery and reducing the sense of discomfort.

[0010] Other objects of the present invention will become apparent to those skilled in the art by reference to the following exemplary embodiments and best modes for carrying out the invention, and the accompanying drawings. [Means for solving the problem]

[0011] In order to facilitate an understanding of the outline of the present invention, the following examples are given of embodiments according to the present invention.

[0012] In a first aspect, a display control device includes: A display control device mounted on a vehicle for controlling image display, a control unit for controlling a visibility level of a display object; The control unit When performing low visibility processing to set the visibility level of the display object to a second visibility level lower than the first visibility level, A display object is divided into a contour portion, which is the outermost portion including the lines that form the outline of the display object, and a non-contour portion, which is the portion inside the contour portion, and the visibility of the non-contour portion is reduced without reducing the visibility of the contour portion.

[0013] According to the first aspect, a display object is divided into an outline portion and a non-outline portion, and low-visibility processing is performed on the non-outline portion. Because the visibility of the outline portion is maintained, a passenger (viewer) can recognize the overall outer shape of the display object based on the outline portion, and therefore can recognize the existence of the display object and also intuitively recognize information contained in the display object.

[0014] On the other hand, for non-outline portions (portions inside the outline portions of the display object) that occupy most of the display object, the visibility level is lowered by, for example, lowering at least one of transmittance, saturation, lightness, and luminance. In the low-visibility processing, for example, a colored (e.g., primary color) non-outline portion can be made colorless (in other words, transparent) or can be made a light color with high transparency.

[0015] This allows the occupant (viewer) to view the real scene behind the non-contour portion through the non-contour portion even if the non-contour portion is superimposed on the real scene.

[0016] In this way, by maintaining the visibility of the outline portion of the display object and reducing the visibility (which can also be rephrased as eye-catchingness) of the non-outline portion, the recognizability of the display object is ensured, while at the same time, even if the display object is displayed in a position that blocks the occupant's forward view, for example, the reduction in visibility of the actual scenery (foreground, etc.) can be suppressed.

[0017] In addition, the gaze of the occupant (viewer) is guided to the display object, and the situation where visual attention to the actual scene (foreground, etc.) is insufficient is less likely to occur. Also, an increase in the burden on the occupant (viewer: driver, etc.), such as feeling annoyed by the display, is suppressed.

[0018] In a second aspect dependent on the first aspect, The control unit A first area including a location corresponding to a near real scene and a second area including a location corresponding to a distant real scene are set within a virtual display area in a real space ahead as seen by an occupant of the vehicle, In the low visibility processing, calculating a total area of ​​display objects displayed in the second area whose visibility level exceeds a visibility threshold; If the calculated total area exceeds the display area threshold, For at least one of the display objects displayed in the second area, the visibility level of the non-contour portion may be reduced to below the visibility threshold, and the total area may be adjusted to be below the display area threshold.

[0019] In the second aspect, a visibility threshold and a display area threshold are set, and the areas of the areas that exceed the visibility threshold among the areas occupied by individual display objects in space are found, and the total area is found by adding up these areas.

[0020] If the total area exceeds the display area threshold, for example, low visibility processing is performed on at least one of the display objects to reduce the visibility level of the non-outline portion, and the low visibility processing of the non-outline portion of the display object is continued until the total area becomes equal to or less than the display area threshold, and the low visibility processing is stopped when the above condition is met.

[0021] This makes it possible to reduce the display area where the visibility level of the display object is equal to or higher than a certain level, and makes it easier to ensure the forward visibility of the occupant (viewer).

[0022] Only the non-contoured parts of the display object are reduced in visibility, and the contoured parts remain as they are, so that it is possible to ensure forward visibility while also making it easy to find the display or to understand its contents.

[0023] In a third aspect dependent from the second aspect, The display object is assigned an importance level indicating the importance of the display; The control unit When adjusting the total area to be equal to or less than the display area threshold, if there are multiple display objects, The lower the importance level of a display object, the higher the priority of the adjustment is, and the process of reducing the visibility level in the non-contour portion is performed on the display object. If the total area becomes equal to or less than the display area threshold as a result, the process of reducing the visibility level in the non-contour portion of the display object with the high importance level may not be performed.

[0024] According to the third aspect, the low-visibility processing is applied to display objects in order of importance, starting from the display object with the lowest importance level, and when the display area threshold is achieved, the low-visibility processing is not applied to display objects with a high importance level. This prevents unnecessary low-visibility processing, and makes it possible to prioritize the presentation of information for display objects with a high importance level.

[0025] In a fourth aspect dependent on the second or third aspect, The control unit A third area is set within the second area; At least one of the visibility level threshold and the display area threshold may be set to a different value depending on whether the display object is located within the second area or the third area.

[0026] In a fourth aspect, a third region can be set within the second region, and a threshold (at least one of a visibility level threshold and a display area threshold) different from that of the second region can be adopted for this third region.

[0027] This allows the visibility level to be set more precisely, enabling more precise display control. For example, it also makes it possible to adaptively set the visibility level in accordance with the driving situation, etc.

[0028] In a fifth aspect dependent on the second or fourth aspect, The control unit The speed of change in the case where the visibility of the non-outline portion of the display object is increased as a result of the display object being moved from the second area to the first area may be slower than the speed of change in the case where the visibility of the non-outline portion of the display object is decreased as a result of the display object being moved from the first area to the second area.

[0029] In the fifth mode, it is assumed that the visibility level needs to be changed as the display object moves.

[0030] When the display object enters the second region, it is preferable to quickly reduce the visibility level of the display object (display image) so as not to obstruct the visibility of the actual scene.

[0031] On the other hand, if the visibility level is immediately increased when the display object moves out of the second area, it is possible that, for example, the occupant will gaze at the display object, which may cause the occupant to lose attention to the road ahead. Therefore, the speed at which the visibility level is increased is made slow. This prevents the driver or the like from gazing at the display object more than necessary.

[0032] In a sixth aspect dependent on any one of the second to fifth aspects, The control unit When the visibility of a non-contour portion of a display object that was displayed in the second area is increased as a result of the display object being moved to the first area, a difference may be set in the rate of change in the increase in visibility depending on the importance level of the display object.

[0033] The sixth aspect, like the fifth aspect described above, assumes a case where a change in visibility level is required as a display object moves.

[0034] However, in the sixth aspect, the manner in which the visibility level is increased (including, for example, the rate at which brightness, etc. is increased, and the increase characteristics of brightness, etc. over time (setting the rate of change over time, etc.)) is varied depending on the importance level of the display object (for example, whether or not it contains important information related to the vehicle).

[0035] For example, if the display object is a display related to the driving lane of the vehicle (a display with a high level of importance), if the occupant does not immediately find or understand the display object, it cannot be denied that this could lead to, for example, an accident. In consideration of this point, by making the change speed, etc. (change manner) of the increase in visibility level of the display object related to the driving lane of the vehicle faster when the vehicle moves out of the second area Z2 compared to the change speed, etc. (change manner) of a display with a low level of importance, it becomes easier for the occupant to find and understand the display object, and quick recognition becomes possible.

[0036] In a seventh aspect dependent on any one of the first to sixth aspects, The control unit In the low visibility processing, the visibility level of a non-outline portion of the display object is reduced, and the visibility level of an outline portion of the display object is increased. Or, In the low visibility processing, the visibility level of the non-outline portion of the display object may be reduced, and the visibility level of the outline portion of the display object may be increased, and then the visibility levels may be reduced, or may be returned to the visibility level before the increase, or may be reduced below the visibility level before the increase.

[0037] In the seventh aspect, a process for increasing the visibility of the outline portion of a display object is performed in parallel with a process for decreasing the visibility of the non-outline portion of the display object. Since the effect of making the actual scene easier to see is obtained by decreasing the visibility of the non-outline portion, which occupies a large area, increasing the visibility of the outline portion, which occupies a small area, does not pose any particular problem in terms of the visibility of the actual scene.

[0038] On the other hand, by increasing the visibility of the outline, it is possible to improve the ease of finding the display and the ease of understanding the content.

[0039] As a variation of the above control, processing may be performed in which the visibility of the outline portion is increased and then decreased, or the visibility is returned to the level before the increase, or the visibility is decreased below the level before the increase.

[0040] By temporarily increasing the visibility of the outline, the occupant (viewer) can focus on the displayed object and understand its contents. Therefore, the increased visibility of the outline is subsequently reduced to prioritize ensuring the visibility of the actual scene. The above control also helps to suppress the discomfort caused by the outline remaining at a high visibility level.

[0041] In an eighth aspect dependent on any one of the first to seventh aspects, The control unit When reducing the visibility of a non-outline portion of a display object, if the non-outline portion has a highly conspicuous area and a less conspicuous area, the visibility is preferentially reduced in the more conspicuous area; If it is necessary to further reduce the visibility, the visibility of the less conspicuous area may be reduced.

[0042] In the eighth aspect, the non-contour portion is divided into areas with high and low visibility, and when performing low visibility processing, the areas with high visibility are given priority. If a display object has high visibility, it means that the real scene behind it is difficult to see.

[0043] Therefore, by reducing the visibility of the highly conspicuous parts of the display object, the actual scene can be made easier to see. Also, for the less conspicuous parts of the display object, visibility is maintained, so the visibility of the display object can be ensured.

[0044] In a ninth aspect dependent on any one of the first to eighth aspects, The control unit When multiple display objects of the same type are displayed, low visibility processing is applied to some of the display objects. Or, When a plurality of display objects of the same type are displayed, low-visibility processing may be applied to some of the display objects, and other display objects that are not subjected to low-visibility processing may be hidden.

[0045] In a ninth aspect, when a plurality of display objects of the same type are displayed (for example, when navigation arrow elements are arranged at predetermined intervals), some of the display objects may be subjected to low-visibility processing, or, further, those that are not subjected to low-visibility processing may be erased, thereby reducing the number of display objects (display elements).

[0046] By performing low-visibility processing on some display objects (display elements) and maintaining visibility for the rest, for example, the visibility of a collection of multiple display objects of the same type is reduced, reducing annoyance, etc. On the other hand, the recognizability of the information indicated by the collection can be maintained to a certain extent.

[0047] Furthermore, display objects for which low visibility processing is not performed can be erased (made invisible). In this case, for example, it is possible to obtain the effect of further reducing the annoyance and discomfort caused by multiple (e.g., a fairly large number) display objects being dispersed and arranged in the space in front of the occupant (viewer).

[0048] In a tenth aspect dependent on any one of the second to sixth aspects, The control unit The position of the second region may be changed based on the acquired first information.

[0049] In a tenth aspect, the position of the second area is variably controlled. The area to which the occupant should pay attention varies depending on the vehicle state, occupant state, and driving environment. Taking this into consideration, by changing the position of the second area depending on the vehicle state, occupant state, driving environment, etc., the second area can be set in an appropriate position depending on the situation.

[0050] In an eleventh aspect dependent on the tenth aspect, the first information includes at least one of a steering angle, a pitching angle, a position of both eyes, and a driving location; The control unit detecting a traveling direction of the vehicle from the steering angle, and changing the position of the second area in the same direction as the traveling direction; and, detecting a vertical sway of the vehicle from the pitching angle, and changing the position of the second area in a direction opposite to the direction of the sway; and, When the positions of both eyes are higher than the reference position, the position of the second area is changed to be higher, and when the positions of both eyes are lower than the reference position, the position of the second area is changed to be lower. and, changing the position of the second area to a preset position relative to the travel location; At least one of the following may be performed.

[0051] In the eleventh aspect, the vehicle state, occupant state, driving environment, etc. can be detected based on at least one of information of the steering angle, pitching angle, eye position, and driving location, and the position of the second area can be changed based on the detection results.

[0052] For example, when an occupant is steering the steering wheel, the occupant often pays attention to the direction of travel, so the direction of travel of the vehicle can be detected from the detection signal of the steering sensor and the position of the second area can be moved in the same direction as the direction of travel.

[0053] Furthermore, for example, by detecting the vertical sway of the vehicle based on pitching angle information and changing the position of the second area in the direction opposite to the direction of the sway, it is possible to prevent a display object that was displayed within the second area from moving out of the second area due to the sway.

[0054] Furthermore, by adjusting the position (height position) of the second area in accordance with the positions of both eyes (height position of the viewpoint), the second area can be positioned at an appropriate position as seen by the occupant.

[0055] Furthermore, the direction in which the occupants pay attention may differ depending on the location of the vehicle. Therefore, by adaptively adjusting the position of the second area depending on the location of the vehicle, the display object can be stably displayed at an appropriate position in the second area.

[0056] In a twelfth aspect dependent on any one of the second to sixth aspects, The control unit The size of the second region may be changed based on the acquired first information.

[0057] In the twelfth aspect, the size of the second region is changed, which can provide the same effects as the above tenth aspect (the aspect in which the position of the second region is changed).

[0058] In a thirteenth aspect dependent from the twelfth aspect, the first information includes at least one of a steering angle, a pitching angle, a position of both eyes, and a driving location; The control unit, based on the first information, When the steering angle is large, the second area is changed to be larger than the reference size. and, When the pitching angle is large, the second region is changed to be larger than the reference size. and, If the positions of both eyes are higher or lower than the reference position, the second region is changed to be larger than the reference size. and, changing the size of the second area to a size that is preset for the travel location; At least one of the following may be performed.

[0059] In the thirteenth aspect, it is possible to obtain the same effect as in the seventh aspect (a mode in which the position of the second area is changed based on sensor information or the like).

[0060] The following case may be considered as an example of "changing the size of the second area to a size preset for the driving location." For example, when driving in an urban area, occupants often pay attention to a wider area than when driving on a highway, etc. Therefore, when it is detected from the detection signal of the GPS receiver that the vehicle is driving in an urban area, the second area is set to be larger. This makes it possible to display (place) a display object in an appropriate position in the enlarged second area.

[0061] In a fourteenth aspect, the display device comprises: an image generation unit that generates an image; a display unit that displays the image; an optical system including an optical member that reflects display light of the image and projects the image onto the projection target; A display control device according to any one of the first to thirteenth aspects; It has.

[0062] According to the fourteenth aspect, it is possible to realize an image display that is easy for the occupants to see while suppressing the obstruction of the visibility of the actual scene and reducing the sense of discomfort, thereby realizing, for example, a display device (e.g., a HUD device) that is highly practical, highly functional, and easy to use with sufficient consideration given to safety.

[0063] In a fifteenth aspect, a display control method includes: A display control method for controlling a visibility level and a display mode of a display object, comprising: When performing low visibility processing to set the visibility level of the display object to a second visibility level lower than the first visibility level, A display object is divided into a contour portion, which is the outermost portion including the lines that form the outline of the display object, and a non-contour portion, which is the portion inside the contour portion, and the visibility of the non-contour portion is reduced without reducing the visibility of the contour portion.

[0064] According to the fifteenth aspect, by maintaining the visibility of the outline portion of the display object and reducing the visibility (which can also be rephrased as eye-catchingness) of the non-outline portion, it is possible to ensure the recognizability of the display object while suppressing a reduction in the visibility of the actual scenery (foreground, etc.) even when, for example, the display object is displayed in a position that blocks the occupant's forward view.

[0065] This display control method can be applied to display control of a display device such as a liquid crystal display (LCD) or a projection display device such as a projector, in addition to display control by a HUD device. It also contributes to enriching the display modes of display devices and realizing image display that suits the driving situation.

[0066] Those skilled in the art will easily understand that the exemplified embodiments according to the present invention can be further modified without departing from the spirit of the present invention. [Brief explanation of the drawings]

[0067] [Figure 1] FIG. 1A is a diagram showing an example of the configuration of an in-vehicle system (in-vehicle display system) including an HUD device and a display such as a liquid crystal panel, and FIG. 1B is a diagram showing an example of a display by the HUD device. [Figure 2] FIG. 2(A) is a diagram showing an example of display objects displayed in first and second areas set within a display area (however, an example in which the present invention is not applied to display objects in the second area), and FIG. 2(B) is a diagram showing an example in which the present invention is applied to display objects in the second area. [Figure 3]FIG. 3(A) is a diagram showing another example of display objects displayed in the first and second areas set within the display area (however, this is an example in which the present invention is not applied to the display objects in the second area), and FIG. 3(B) is a diagram showing an example in which the present invention is applied to the display objects in the second area. [Figure 4] 4A and 4B are diagrams showing still another example of display objects displayed in the first and second areas set within the display area (an example in which the present invention is applied to display objects in the second area). [Figure 5] 5(A) to 5(E) are diagrams showing examples (application examples) of navigation displays to which the present invention is applied. [Figure 6] 6(A) to 6(C) are diagrams showing other examples (application examples) of navigation displays to which the present invention is applied. [Figure 7] FIG. 7(A) is a diagram showing an example in which the position of the second region is variably controlled, and FIG. 7(B) is a diagram showing an example in which the size of the second region is variably controlled. [Figure 8] FIG. 8(A) is a diagram showing an example of the configuration of an in-vehicle display system, and FIG. 8(B) is a diagram showing an example of the configuration of a control unit. [Figure 9] FIG. 9 is a flowchart showing an example of a control procedure of the control unit (display control device). DETAILED DESCRIPTION OF THE INVENTION

[0068] The best mode of implementation described below is used to facilitate understanding of the present invention, and therefore, those skilled in the art should be aware that the present invention is not unduly limited by the best mode of implementation described below.

[0069] Please refer to Figure 1. Figure 1(A) is a diagram showing an example of the configuration of an in-vehicle system (in-vehicle display system) including a HUD device and a display such as a liquid crystal panel, and Figure 1(B) is a diagram showing an example of a display by the HUD device. The in-vehicle system of Figure 1(A) includes a display device (including at least one of a display device and a HUD device) as a component.

[0070] In Fig. 1(A), the width direction (left-right or lateral direction) of the vehicle 1 is referred to as the X direction. The direction (up-down or height direction) along a line that is perpendicular to the left-right direction and perpendicular to the ground or a surface equivalent to the ground (here, road surface 6) is referred to as the Y direction. The direction (front-rear direction, direction indicating the forward and backward directions of the vehicle 1) along a line that is perpendicular to both the left-right and up-down directions is referred to as the Z direction. This also applies to other drawings (Fig. 2, Fig. 3, etc.).

[0071] The display device here is an in-vehicle display device mounted on a vehicle 1. The in-vehicle display device in Fig. 1(A) has a display device (including a display control unit 108, a display control unit 107, and a display 108 such as a liquid crystal panel) and a head-up display (HUD) device 100 (including a control unit 140 and a device main body 120).

[0072] The HUD device 100 is installed, for example, in a dashboard 41. The device main body 120 has a display 150 such as a liquid crystal panel, a screen (display unit) 160 having a display surface 164, and a curved mirror (concave mirror, etc.) 170 having a light reflecting surface 179. The curved mirror (concave mirror, etc.) 170 reflects light (display light) from the screen 160 and projects (projects) display light K onto a windshield (projected member) 2 provided in the vehicle 1. A portion of the display light K is reflected from the windshield (projected member) 2 and incident on a viewpoint (eye) A of an occupant (such as a driver, or sometimes referred to as a viewer). Apparent light beams E1 to E3 corresponding to the incident light beams are focused at image points in front of the viewer, thereby displaying a virtual image (picture) on a virtual image display surface PS.

[0073] The virtual image display surface 9 corresponds to the display surface 164 on the screen 160 and is a virtual (apparent) surface set in real space in front of a passenger (a viewer such as a driver).

[0074] The virtual image display surface 9 may be, for example, an elevation surface a perpendicular to the road surface 6, inclined surfaces b and c inclined relative to the road surface 6, a road surface superimposed surface d superimposed on the road surface 6, and a surface e in which the side closer to the occupant (viewer) is an elevation surface (including a pseudo elevation surface) and the farther side is an inclined surface. In displays using surfaces other than the elevation surface a, the display distance of the virtual image varies depending on the display position on the virtual image display surface, and therefore 3D display is possible.

[0075] The above-described configuration of the HUD device is an example, and the present invention can be applied to various HUD devices, such as a 3D HUD device using a lenticular lens or a parallax-type 3D HUD device. The type of HUD device is not important. The present invention can also be applied to a case where AR display is performed using a display (such as a liquid crystal panel 108).

[0076] Please refer to Figure 1(B). In Figure 1(B), parts common to Figure 1(A) are assigned the same reference numerals. In front of the driver (viewer) 5, who is an occupant, a HUD display area (sometimes simply referred to as a display area) 202 is provided on a virtual image display surface (for example, virtual image display surface a in Figure 1(A)).

[0077] The HUD display area (display area) 202 is divided into a first area Z1 and a second area Z2. The second area Z2 is the area inside the dashed rectangle 204. The first area Z1 is the area in the display area 202 other than the first area Z1.

[0078] The first area Z1 is an area that includes an area corresponding to the near (closer) actual scene (foreground) as seen by the occupant (driver, etc.) 5, and the second area Z2 is an area that includes an area corresponding to the far (distant) actual scene (foreground).

[0079] In FIG. 1B, the first and second regions Z1 and Z2 are rectangular regions, but are not limited to this.

[0080] 1(B), the first and second areas Z1 and Z2 are provided inside the HUD display area 202, but this is not limiting. For example, the entire HUD display area 202 may be the first area, and the display surface of the display 108, such as a liquid crystal display panel, may be the second display area.

[0081] Furthermore, a third region Z3 (the region inside the dashed rectangle in FIG. 1(B)) can be further provided within the second region Z2.

[0082] By setting the first and second regions Z1 and Z2, the visibility level can be changed depending on whether the display object OB is in the first region Z1 or the second region Z2. The visibility level can be controlled by adjusting at least one of the transmittance, saturation, brightness, and luminance of the display object, for example.

[0083] The first area Z1 includes a portion corresponding to a near actual scene. The second area Z2 includes a portion corresponding to a distant actual scene. In the second area Z2, it is necessary to ensure good visibility for the occupant 5 (the ability to see far at a glance), or to prevent the display object from interfering with the view of the actual scene, causing discomfort or annoyance. Therefore, the control unit 140 performs low visibility processing on the non-contour portions of the display object displayed in the second area Z2 (the details of which will be described later).

[0084] Furthermore, when the third region Z3 is provided, the control unit 140 can apply a threshold value (described later) to the display object OB4 displayed in the third region Z3, which is different from the threshold value applied to the display objects OB2 and OB3 in the second region Z2, in the low visibility processing. This allows for more detailed control of visibility in accordance with, for example, the driving situation, etc.

[0085] In this specification, the process in which the control unit 140 sets a visibility level (sometimes referred to as a second visibility level) lower than a reference visibility level (sometimes referred to as a first visibility level) for the non-contour part of a display object (or the process of changing the visibility to a lower level, etc.) is referred to as "low visibility processing."

[0086] 1(B), as indicated by the arrow AR1, there may be cases where the display object OB2 displayed in the second region Z2 moves to the position of the display object OB1 in the first region Z1. There may also be cases where the display object OB1 displayed in the first region Z1 moves to the position of the display object OB2 in the second region Z2, as indicated by the arrow AR2. In these cases, it is necessary to change the visibility of the moved display object, but there may also be cases where it is preferable to provide a difference between the movement in the direction of the arrow AR1 and the movement in the direction of the arrow AR2 rather than making the speed of the change in visibility uniform.

[0087] Furthermore, even when the display object OB2 in the first area Z1 moves to the position of the display object OB1 in the second area Z2 (moves in the direction of the arrow AR1), it may be preferable to appropriately set the change characteristics of visibility (such as the shape of the characteristic line indicating the rate of change over time) depending on, for example, whether or not the display object OB2 is an indication of a high level of importance with respect to, for example, the driving situation.

[0088] The following will provide a step-by-step explanation. Next, reference will be made to Fig. 2. Fig. 2(A) is a diagram showing an example of display objects displayed in first and second areas set within a display area (however, this is an example in which the present invention is not applied to display objects in the second area), and Fig. 2(B) is a diagram showing an example in which the present invention is applied to display objects in the second area. In Fig. 2, parts that are common to Fig. 1(B) are given the same reference numerals (this also applies to the following drawings).

[0089] 2(A), a vehicle (host vehicle) 1 is traveling on a straight road at a speed of 50 km / h. A vehicle speed display SP (displaying "50 km / h") is located below the center of the first area Z1.

[0090] The symbols W10 and W50 indicate the boundary lines between the road surface and the sidewalk, and W20 to W40 indicate white lines on the road surface.

[0091] From the driver 5's perspective, there is a preceding vehicle PV ahead that requires caution. Further ahead and to the left of the preceding vehicle PV, a road (left-turn road) 308 where the host vehicle 1 should turn left is visible. The HUD device 100 displays route guidance (navigation image) consisting of three arrow elements (display objects) 306 indicating a left turn, superimposed on the left-turn road 308. Each arrow element (display object) 306 is colored yellow, for example.

[0092] Furthermore, the HUD device 100 displays an attention-calling display (or a warning display) 304 to the preceding vehicle PV.

[0093] 2A, the route guidance (three arrow elements 306) and the warning display 304 for the preceding vehicle PV are displayed in the second area Z2 with the first visibility. The route guidance (three arrow elements 306) overlaps with the left turn road 308, and in some cases, this may obstruct the passenger (driver) 5 from seeing the left turn road 308.

[0094] Therefore, in FIG. 2(B), low visibility processing is performed on the route guidance (three arrow elements 306) to maintain the visibility of the outline portion while reducing the visibility of the non-outline portion (for example, reducing the first visibility to a lower second visibility).

[0095] 2(B), the yellow coloring of each arrow element (display object) 306 is removed and the arrow element (display object) 306 is made colorless and transparent. This makes it easier for the passenger (driver) 5 to see the left turn road 308 through the arrow element (display object) 306.

[0096] As described above, in the example of FIG. 2(B), when control unit 140 performs low visibility processing to set the visibility level of a display object to a second visibility level that is lower than the first visibility level, control unit 140 distinguishes the display object into a contour portion, which is the outermost portion including the lines that form the outline of the display object, and a non-contour portion, which is the portion inside the contour portion, and reduces the visibility of the non-contour portion without reducing the visibility of the contour portion.

[0097] Here, the "outline portion" includes the lines (outline lines) that form the outline of the display object, and may also include the vicinity of the outline lines (in other words, the outermost (near the outside) part of the display object). Furthermore, the "non-outline portion" is the part (area) inside the outline portion, or in other words, can be referred to as "the main body part, internal area, or inner part of one display object surrounded by the outline lines (outline lines)."

[0098] 2(B), the display object 306 is divided into an outline portion and a non-outline portion, and low-visibility processing is performed on the non-outline portion. Because the visibility of the outline portion is maintained, the occupant (viewer) can recognize the overall external shape of the display object based on the outline portion, and therefore can recognize the existence of the display object and also intuitively recognize the information contained in the display object.

[0099] On the other hand, for a non-outline portion (a portion inside the outline portion of a display object) that occupies a large portion of a display object, the visibility level is lowered by, for example, lowering at least one of transmittance, saturation, brightness, and luminance. In the low-visibility processing, for example, a colored (e.g., primary color) non-outline portion can be made colorless (in other words, transparent) or can be made a light color with high transparency.

[0100] This makes it easier for the occupant (driver) 5 to see (confirm) the actual scene (left-turn road 308) on the other side through the non-contour part, even if the non-contour part is superimposed on the actual scene (left-turn road 308 in Figure 2(B)).

[0101] In this way, by maintaining the visibility of the outline portion of the display object and reducing the visibility (which can also be rephrased as eye-catchingness) of the non-outline portion, the recognizability of the display object is ensured, while at the same time, even if the display object is displayed in a position that blocks the occupant's forward view, for example, the reduction in visibility of the actual scenery (foreground, etc.) can be suppressed.

[0102] In addition, the line of sight of the occupant (driver) 5 is guided to the display object, and the situation where visual attention to the actual scene (foreground, etc.) is insufficient is less likely to occur. Also, an increase in the burden on the occupant (viewer: driver, etc.) 5, such as feeling bothered by the display, is suppressed.

[0103] In the example of FIG. 2(B), the control unit 140 specifically performs the following control, for example.

[0104] The control unit 171 sets a first area Z1 including an area corresponding to a near real view and a second area Z2 including an area corresponding to a distant real view within a virtual display area in the real space ahead as seen by the occupant 5 of the vehicle 1, and in the low visibility processing, calculates the total area of ​​the display objects (arrow elements 306 in FIG. 2(B)) displayed in the second area Z2 whose visibility level exceeds the visibility threshold, and if the calculated total area exceeds the display area threshold, may lower the visibility level of the non-contour portion of at least one of the display objects displayed in the second area to below the visibility threshold, thereby adjusting the total area to be below the display area threshold.

[0105] In this way, a visibility threshold and a display area threshold are set, and the areas of the areas that each display object occupies in space that exceed the visibility threshold are found, and the total area is calculated by adding up these areas.

[0106] If the total area exceeds the display area threshold, for example, low visibility processing is performed on at least one of the display objects to reduce the visibility level of the non-outline portion, and the low visibility processing of the non-outline portion of the display object is continued until the total area becomes equal to or less than the display area threshold, and the low visibility processing is stopped when the above condition is met.

[0107] This makes it possible to reduce the display area where the visibility level of the display object is equal to or higher than a certain level, and makes it easier to ensure the forward visibility of the occupant (viewer).

[0108] Only the non-contoured parts of the display object are reduced in visibility, and the contoured parts remain as they are, so that it is possible to ensure forward visibility while also making it easy to find the display or to understand its contents.

[0109] 2(B), the visibility of the attention-calling display 304 regarding the preceding vehicle PV remains unchanged, and low-visibility processing is performed on the non-contour portion only of the arrow element 306. Such visibility control is possible, for example, by setting an importance level for the display object.

[0110] An importance level indicating the importance of display is assigned to the display objects 304 and 306, and when the control unit 171 adjusts the total area to be equal to or less than the display area threshold, if there are multiple display objects, the lower the importance level of a display object, the higher the priority of the adjustment, and the control unit 171 performs processing to reduce the visibility level of the non-contour portion.

[0111] 2B, the importance level of the attention drawing mark 304 is higher than the importance level of the arrow element 306, which is a navigation display. Therefore, in the low-visibility processing, the arrow element 306 is given priority.

[0112] If the total area becomes equal to or less than the display area threshold, the visibility level of the non-contoured portion of the display object with a high level of importance (the attention-drawing mark 304 in FIG. 2B) is not reduced. This type of display control realizes the HUD display shown in FIG. 2B.

[0113] Low visibility processing is applied to display objects in order of importance level, starting with the display object with the lowest importance level, and when the display area threshold is achieved, low visibility processing is not applied to display objects with a high importance level. This control prevents unnecessary low visibility processing and makes it possible to prioritize the presentation of information for display objects with a high importance level.

[0114] Next, referring again to Fig. 1(B) shown above, a third area Z3 is set within the second area Z2. At least one of the "visibility level threshold" and the "display area threshold" may be set to a different value depending on whether the display object is within the second area Z2 or the third area Z3.

[0115] In other words, a threshold value (at least one of the visibility level threshold value and the display area threshold value) different from that of the second area Z2 can be adopted for the display object OB4 displayed in the third area Z3.

[0116] This allows the visibility level to be set more precisely, enabling more precise display control. For example, it also makes it possible to adaptively set the visibility level in accordance with the driving situation, etc.

[0117] Furthermore, in FIG. 1(B), the control unit 140 may increase the visibility of the non-contour portion of the display object OB2 when the display object OB2 that was displayed in the second area Z2 moves to the first area Z1 (when the movement indicated by the arrow AR1 occurs) at a slower rate than the increase in the visibility of the non-contour portion of the display object OB1 when the display object OB1 that was displayed in the first area Z1 moves to the second area Z2 (when the movement indicated by the arrow AR2 occurs).

[0118] Here, it is assumed that the visibility level needs to be changed as the display object moves.

[0119] When the display object enters the second region Z2, it is preferable to quickly reduce the visibility level of the display object (display image) so as not to obstruct the visibility of the actual scene.

[0120] On the other hand, if the visibility level is immediately increased when the display object moves out of the second region Z2, for example, the occupant (driver, etc.) 5 may stare at the display object, which may cause the occupant to lose attention to the road ahead. Therefore, the speed at which the visibility level is increased is made slow. This prevents the driver, etc. from staring at the display object more than necessary.

[0121] Furthermore, when the control unit 140 increases the visibility of the non-contour part of the display object OB2 as a result of the display object OB2 being displayed in the second area Z2 moving to the first area Z1 (in other words, when the movement indicated by the arrow AR1 occurs), the control unit 140 may set a difference in the rate of change in the increase in visibility depending on the importance level of the display object OB2.

[0122] For example, if the display object is a display related to the driving lane of the vehicle (a display with a high level of importance), if the occupant does not immediately find or understand the display object, it cannot be denied that this could lead to, for example, an accident. In consideration of this point, by making the change speed, etc. (change manner) of the increase in visibility level of the display object related to the driving lane of the vehicle faster when the vehicle moves out of the second area Z2 compared to the change speed, etc. (change manner) of a display with a low level of importance, it becomes easier for the occupant to find and understand the display object, and quick recognition becomes possible.

[0123] The visibility control described above is an example, and various modifications and applications are possible. Other control examples (application examples, etc.) will be described below with reference to Figs.

[0124] Please refer to Fig. 3. Fig. 3(A) is a diagram showing another example of display objects displayed in the first and second areas set within the display area (however, this is an example in which the present invention is not applied to the display objects in the second area), and Fig. 3(B) is a diagram showing an example in which the present invention is applied to the display objects in the second area.

[0125] In Figure 3(A), in the first area Z1, an icon D1 indicating the remaining fuel, a vehicle speed display D2, a time display D3, and a chromatic color portion BG (which is also considered to be one display object) forming the background of each display D1 to D3 are displayed.

[0126] Additionally, in the second area Z2, a sign indicating a speed limit (speed limit sign) LS2 is displayed to the left front as seen from the driver 5. For example, the outermost peripheral edge of this speed limit sign is colored red, the inner circle is colored white or yellow, and the number "100" is colored blue. The outer peripheral edge and inner circle are highly conspicuous.

[0127] 3(A), three preceding vehicles G4, G5, and G6 are present ahead of the host vehicle 1. In the second area Z2, markers (colored triangular marks) W1 to W3 for visually estimating the inter-vehicle distance are displayed on the road surface, and a partial circular mark (or circular mark) U1 for calling attention is displayed below the preceding vehicle G4.

[0128] Moreover, colored arrow elements W4 to W8 for navigation are displayed on the right side of the second area Z2.

[0129] In the display example of FIG. 3(A), a large number of display objects are distributed and arranged in the space in front of the driver 5, and the passenger (driver, etc.) 5 may feel that it is cluttered.

[0130] Therefore, in Figure 3(B), low visibility processing is performed on the non-contour parts in the second region Z2, and the inner circle part of the speed limit sign LS2 (the part that was colored white or yellow) is made colorless and transparent, for example, and the markers (colored triangular marks) W1 to W3 for visually estimating the distance between vehicles are made colorless and transparent, for example.

[0131] Furthermore, of the five arrow elements W4 to W8 displayed on the right side, W5 and W7 have been colored and are now achromatic.

[0132] In other words, when a plurality of display objects of the same type are displayed (for example, when navigation arrow elements W4 to W8 are arranged at predetermined intervals), low visibility processing is performed on some of them.

[0133] By performing low-visibility processing on some display objects (display elements) and maintaining visibility for the rest, for example, the visibility of a collection of multiple display objects of the same type is reduced, reducing annoyance, etc. On the other hand, the recognizability of the information indicated by the collection can be maintained to a certain extent.

[0134] Furthermore, by leaving W4, W6, and W8 of the five arrow elements W4 to W7 as chromatic and making W5 and W7 achromatic, the chromatic and achromatic parts are appropriately distributed in space (in other words, the chromatic and achromatic parts are arranged locally and are not visually separated), thereby preventing the occurrence of visual discomfort.

[0135] Furthermore, when focusing on the speed limit sign LS2, when reducing the visibility of the non-contour area, if the non-contour area contains areas with high and low visibility, the visibility is reduced preferentially in the areas with high visibility, and if further reduction in visibility is necessary, the visibility of the areas with low visibility is reduced.

[0136] In other words, the non-contour portion of the speed limit sign LS2 includes areas with high visibility (the red outer periphery and the white or yellow inner circle) and areas with low visibility (the numbers). Therefore, when distinguishing between these areas and implementing low-visibility processing, priority is given to the areas with high visibility. In the example of Figure 2(B), low-visibility processing is implemented for the inner circle, which has the largest area.

[0137] A highly conspicuous display object also means that the real scene behind it is difficult to see. Therefore, by reducing the visibility of the highly conspicuous portion of the display object, the real scene can be made easier to see. Furthermore, since the visibility of the less conspicuous portion of the display object is maintained, the visibility of the display object can be ensured.

[0138] Next, reference is made to Fig. 4. Fig. 4(A) and (B) are diagrams showing still another example of display objects displayed in the first and second areas set within the display area (an example in which the present invention is applied to display objects in the second area). In Fig. 4, parts that are common to Fig. 3 are given the same reference numerals.

[0139] In FIG. 4(A), low visibility processing of non-outline portions is performed on all of the arrow elements W4 to W8 in the second region Z2.

[0140] In addition, in FIG. 4(A), in parallel with the low visibility processing of the non-contour portion of the display object in the second region Z2, low visibility processing is also performed in the first region Z1, and the chromatic background portion BG (considered to be one display object) is hidden.

[0141] These display controls further improve the visibility of the actual scene.

[0142] In the example of FIG. 4(B), among the display objects of the same type (plurality of arrow elements W4 to W8), low-visibility processing is performed on some display objects W4, W6, and W8, and other display objects (W5 and W7 in FIG. 4(A)) that are not subjected to low-visibility processing are erased, thereby reducing the number of display objects (display elements).

[0143] In this way, display objects that are not subjected to low visibility processing can be erased (made invisible). In this case, for example, it is possible to obtain the effect of further reducing the annoyance and discomfort caused by multiple (e.g., a fairly large number) display objects being dispersed and arranged in the space in front of the occupant (viewer) 5.

[0144] Next, reference will be made to Fig. 5. Fig. 5(A) to (E) are diagrams showing examples (application examples) of navigation displays to which the present invention is applied.

[0145] In FIG. 5(A), a vehicle 1 is traveling on a highway 6, and an exit 904 is visible in the distance on the left.

[0146] In FIG. 5B, a chromatic sign 906 indicating the presence of an exit (exit) is displayed so as to be superimposed on the exit 904, and a circular pointer PS7 for attracting attention is also displayed.

[0147] In Figure 5(C), low-visibility processing is applied to the non-outline portion of the sign 906, making the non-outline portion colorless and transparent. At the same time, the outline of the outline portion is thickened to emphasize the outline of the sign, thereby increasing visibility.

[0148] In Fig. 5(D), the visibility of the outline of the sign 906 is reduced. In the example of Fig. 5(D), the visibility is reduced more than in Fig. 5(B), making it easier to see the exit 904 located on the other side of the sign 906.

[0149] 5(E), the sign 906 is hidden and replaced with a navigation display 907 superimposed on the road surface. In other words, the display is switched from one erected on the road surface to one superimposed on the road surface.

[0150] In this way, in the low visibility processing, the control unit 140 may lower the visibility level of the “non-contour portion” of the display object, and at the same time, may increase the visibility level of the “contour portion” of the display object.

[0151] Furthermore, in the low-visibility processing, the visibility level of the "non-outline portion" of the display object may be lowered, and in parallel with this, the visibility level of the "outline portion" of the display object may be increased, and then decreased, or returned to the visibility level before the increase, or decreased below the visibility level before the increase. In Fig. 5(D), the visibility level is decreased below the visibility level before the increase.

[0152] By reducing the visibility of the non-contour parts of the display object, the effect of making the actual scene easier to see is obtained by reducing the visibility of the non-contour parts that occupy a large area, so even if the visibility of the contour parts that occupy a small area is increased, there is no particular problem with the visibility of the actual scene.

[0153] On the other hand, by increasing the visibility of the outline, it is possible to improve the ease of finding the display and the ease of understanding the content.

[0154] Furthermore, the visibility of the outline may be increased and then decreased, or returned to the visibility level before the increase, or decreased below the visibility level before the increase.

[0155] By temporarily increasing the visibility of the outline, the occupant (viewer) can focus on the displayed object and understand its contents. Therefore, the increased visibility of the outline is subsequently reduced to prioritize ensuring the visibility of the actual scene. The above control also helps to suppress the discomfort caused by the outline remaining at a high visibility level.

[0156] Next, reference will be made to Fig. 6. Fig. 6(A) to (C) are diagrams showing other examples (application examples) of navigation displays to which the present invention is applied.

[0157] In Fig. 6(A), there is a truck (lorry) 320 requiring caution ahead (slightly in the distance) on the left side of the vehicle 1. Also, a navigation arrow (with the non-contoured portion colored) 220 is displayed superimposed on the road surface.

[0158] In Figure 6(B), a pointer PS5 is displayed superimposed on the track 320, and the non-outlined portion of the navigation arrow 220 is changed from a chromatic color to colorless and transparent, reducing visibility, while the outlined portion has a thicker outline, increasing visibility.

[0159] In FIG. 6(C), the visibility of the outline of the navigation arrow 220 is returned to its original level (the visibility level of FIG. 6(A)).

[0160] In this way, the low-visibility processing can also be performed on the road surface superimposed display. Furthermore, according to the display control of Figures 6(A) to 6(C), it is possible to obtain the same visual effect as the example of Figure 5.

[0161] Next, reference will be made to Fig. 7. Fig. 7(A) is a diagram showing an example in which the position of the second region is variably controlled, and Fig. 7(B) is a diagram showing an example in which the size of the second region is variably controlled.

[0162] In Fig. 7(A), the control unit 140 changes the position of the second area Z2 based on the acquired first information. In other words, the position of the second area Z2 (in other words, the position of the dashed-line figure (rectangle) 204 that determines the boundary of the second area Z2) is variably controlled. In Fig. 7(A), the directions in which the position is changed are indicated by arrows DL, DR, DP, and DN.

[0163] The area to which the occupant should pay attention (the area in the real space ahead) differs depending on the vehicle state, the occupant state, and the driving environment. Taking this into consideration, the position of the second area Z2 can be changed depending on the vehicle state, the occupant state, the driving environment, etc., so that the second area can be set in an appropriate position depending on the situation.

[0164] Here, the first information may include, for example, at least one of the following information: "steering angle," "pitching angle," "eye position," and "driving location."

[0165] For example, the control unit 140 may perform at least one of the following: detect the driving direction of the vehicle 1 from the steering angle and change the position of the second area in the same direction as the driving direction; detect the vertical sway of the vehicle 1 from the pitching angle and change the position of the second area in the opposite direction to the swaying direction; if the position of both eyes is higher than the reference position, change the position of the second area Z2 to be higher than the standard position; if the position of both eyes is lower than the reference position, change the position of the second area Z2 to be lower than the standard position; and change the position of the second area Z2 to a position that is preset for the driving location.

[0166] In other words, the control unit 140 may detect the vehicle state, occupant state, driving environment, etc. based on at least one of information on the steering angle, pitching angle, eye position, and driving location, and change the position of the second area based on the detection results.

[0167] For example, when an occupant is steering the steering wheel, the occupant often pays attention to the direction of travel, so the direction of travel of the vehicle 1 can be detected from the detection signal of the steering sensor and the position of the second area Z2 can be moved in the same direction as the direction of travel.

[0168] Furthermore, for example, by detecting the vertical sway of the vehicle 1 based on pitching angle information and changing the position of the second area Z2 in the direction opposite to the direction of the sway, it is possible to prevent a display object displayed within the second area Z2 from moving outside the second area Z2 due to the sway.

[0169] Furthermore, by adjusting the position (height position) of the second area Z2 in accordance with the positions of both eyes (height position of the viewpoint), the second area Z2 can be positioned at an appropriate position as seen by the occupant 5.

[0170] Furthermore, the direction in which the occupant 5 pays attention may differ depending on the location where the vehicle 1 is traveling. Therefore, by adaptively adjusting the position of the second area Z2 depending on the location where the vehicle 1 is traveling, the display object can be stably displayed at an appropriate position in the second area Z2.

[0171] 7(B), the control unit 140 may change (adjust) the size of the second area Z2 based on the acquired first information. In FIG. 7(B), the areas that can be expanded are depicted as areas ZL, ZR, ZP, and ZN (all of which are hatched).

[0172] By appropriately changing the size of the second region Z2, it is possible to obtain the same effect as in the example of FIG. 7(A) (an example in which the position of the second region Z2 is changed).

[0173] The first information may include at least one of the following: a steering angle, a pitching angle, an eye position, and a driving location. Based on the first information, the control unit 140 may perform at least one of the following: when the steering angle is large, change the second area to a size larger than a reference size; when the pitching angle is large, change the second area to a size larger than a reference size; when the eye position is higher or lower than the reference position, change the second area to a size larger than the reference size; and change the size of the second area to a size preset for the driving location.

[0174] In the example of FIG. 7(B), it is possible to obtain the same effect as in the example of FIG. 7(A) (an example in which the position of the second area Z2 is changed based on sensor information or the like).

[0175] The following case may be considered as an example of "changing the size of the second area to a size preset for the driving location." For example, when driving in an urban area, occupants often pay attention to a wider area than when driving on a highway, etc. Therefore, when it is detected from the detection signal of the GPS receiver that the vehicle is driving in an urban area, the second area is set to be larger. This makes it possible to display (place) a display object in an appropriate position in the enlarged second area.

[0176] Next, reference will be made to Fig. 8. Fig. 8(A) is a diagram showing an example of the configuration of an in-vehicle display system, and Fig. 8(B) is a diagram showing an example of the configuration of a control unit.

[0177] In FIG. 8(A), the in-vehicle display system includes a HUD device (broadly speaking, a display device) 100, an information acquisition unit 119, an eye-pickup camera 43, a viewpoint position detection unit 45, a steering sensor 47, a pitch angle sensor 49, a vehicle ECU 51, an outside-vehicle sensor 53, and a GPS receiver (equipped with an antenna AN) 55.

[0178] The HUD device 100 includes a display control device 700. The display control device 700 includes a control unit 140. The control unit 140 includes an I / O interface 741, at least one processor 742, and a memory 743.

[0179] The HUD device 100 also has an image generation unit 112, a display unit 113, an optical system 116, and an actuator 179 that drives optical components that make up the optical system 116 to change their positions, etc. The information acquisition unit 119 acquires information (first information) obtained from various sensors, etc., via a communication bus 727. This information acquisition unit 119 may be provided within the HUD device 100.

[0180] As explained above, the HUD device 100 projects and displays a display image (image display light) onto the windshield (windshield, etc.) 2 of the vehicle (own vehicle) 1, or onto a combiner, etc., provided between the windshield 2 and the occupant, thereby presenting the occupant 5 with, for example, information that is useful for driving the vehicle.

[0181] The control unit 140 (or the processor 742) executes, for example, a process such as the process flow described below.

[0182] The external vehicle sensor 53 detects the positions and details of objects present in the environment outside the vehicle, such as other vehicles, pedestrians, and road traffic signs.

[0183] The steering sensor 47 detects the steering angle of the steering wheel, and the pitch angle sensor 49 detects the attitude of the vehicle 1 in the pitching direction.

[0184] The viewpoint position detection unit 45 detects, for example, the eye position and line of sight of the occupant 5 based on the image captured by the pupil (or face) imaging camera 43.

[0185] The GPS receiver 55 receives radio signals emitted from GPS satellites and detects the position of the vehicle 1 .

[0186] There are a plurality of types of vehicle ECUs 51, such as an engine ECU and a meter ECU, which operate actuators based on information from sensors and transmit necessary information to the control unit 140 and other vehicle ECUs as needed.

[0187] In Figure 8 (B), the control unit 140 (or the processor 702) has, as functional blocks, an area setting unit 745, an object setting unit 746, an object importance setting unit 747, a display object visibility setting unit 748, and a display element number setting unit 749.

[0188] The display object visibility setting unit 748 sets the visibility levels of the non-contour parts and contour parts of the display object as appropriate according to the driving environment and the like.

[0189] The display element number setting unit 749 has the function of setting the number of display elements to be displayed and the position at which display elements are to be hidden, for example, when display elements are to be hidden, as in the example of Figure 4 (B).

[0190] Next, reference will be made to Fig. 9. Fig. 7 is a flowchart showing an example of a control procedure of the control unit (display control device).

[0191] In step S1, a visibility threshold and a display area threshold are set.

[0192] In step S2, a first area and a second area (and a third area, if necessary) are set in the head-up display (HUD) device. Note that the first area is sometimes called a "constrained area" because visibility is often restricted therein, and the second area is sometimes called a "non-constrained area" because visibility is relatively less restricted therein.

[0193] In step S3, display objects (display targets, display elements) to be displayed on a head-up display (HUD) device are set.

[0194] In step S4, an importance level is set for the display objects present in the second region (constrained region).

[0195] In step S5, it is determined whether the display area (total area) of the displays whose visibility level exceeds the visibility threshold in the second region exceeds the display area threshold. If the answer is "Yes," the process proceeds to step S6, and if the answer is "No," the process proceeds to step S7.

[0196] In step S6, the visibility level of the non-contour portion of at least one of the display objects with a low level of importance is reduced to equal to or below the visibility threshold value (or less), and then the process returns to step S5.

[0197] In step S7, the display object is displayed on a head-up display (HUD) device.

[0198] In step S8, it is determined whether or not the display should be ended. If the answer is Y, the display is ended, and if the answer is N, the process returns to step S2.

[0199] As described above, according to this embodiment, it is possible to realize a HUD display that is easy for the occupant to see while suppressing interference with the visibility of the actual scenery and reducing the sense of discomfort.

[0200] In the above description, the terms "first region" and "second region" are used for convenience, but these terms can be rephrased as appropriate.

[0201] For example, the "first area" may be called an "unrestricted area" in which no particular restrictions (or conditions) are imposed on the number of display elements, the size of the display elements, etc., allowing for a high degree of freedom in display, or a "restricted (condition) restricted area" in which display restrictions (conditions) are restricted.

[0202] The "second area" may also be called a "restricted area" or the like in which certain restrictions (conditions) are imposed on the number of display elements, the size of the display elements, and the like.

[0203] In addition, in the above explanation, the expression "exceeds" is used for convenience, but this can also be replaced with "not less than." Furthermore, the expression "not more than" can be replaced with terms such as "less than" or "fall below." Such slight rephrasing can be done as appropriate.

[0204] In this specification, the term "vehicle" can be broadly interpreted as a vehicle. Navigation-related terms (e.g., signs) are also broadly interpreted, taking into account the broader definition of navigation information useful for vehicle operation. HUD devices and display devices (and display devices in the broader sense) also include those used as simulators (e.g., aircraft simulators, simulators for game devices, etc.).

[0205] The present invention is not limited to the exemplary implementations described above, and those skilled in the art will be able to easily modify the exemplary implementations described above to the extent that they fall within the scope of the claims. [Explanation of symbols]

[0206] 1 Vehicle (host vehicle), 2 Windshield (projection target), 6 Road surface (including equivalent surfaces such as the ground and floor), 41 Dashboard, 100 HUD device, 140 Control unit (processor), 202 Display area (HUD display area) of HUD device (display device), 204 Boundary line of second area (or figure determining the boundary), 304... Caution display, 306... Navigation arrow element (arrow display object), 308... Left turn road, 745... Area setting section, 746... Object setting section, 747... Object importance setting section, 748... Display object visibility setting section, 749... Setting section for number of display elements, PV... Leading vehicle, LS2... Speed ​​limit sign, W1 to W3... Mark for visually checking inter-vehicle distance, W4 to W8... Navigation arrow (arrow mark), Z1... First area (non-restricted area), second area (restricted area), Z3... Third area, SP... Vehicle speed display, OB1 to OB4... Display object (HUD display, image, virtual image, display element)

Claims

1. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object; The control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; a first area including a location corresponding to a near real scene and a second area including a location corresponding to a distant real scene are set within a virtual display area in a real space ahead as seen by an occupant of the vehicle; In the low visibility processing, calculating a total area of ​​display objects displayed in the second area whose visibility level exceeds a visibility threshold; If the calculated total area exceeds the display area threshold, adjusting the visibility level of the non-outline portion of at least one of the display objects displayed in the second area to be equal to or lower than the visibility threshold so that the total area is equal to or lower than the display area threshold; Display control device.

2. The display object is assigned an importance level indicating the importance of the display; The control unit When adjusting the total area to be equal to or less than the display area threshold, if there are multiple display objects, a display object having a lower importance level is considered to have a higher priority in the adjustment, and a process of reducing the visibility level of the non-outline portion is performed on the display object; and when the total area becomes equal to or less than the display area threshold as a result, the process of reducing the visibility level of the non-outline portion of the display object having a high importance level is not performed. The display control device according to claim 1 .

3. The control unit a third region is set within the second region; at least one of a visibility level threshold and a display area threshold is varied depending on whether the display object is located within the second area or the third area; The display control device according to claim 1 .

4. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object; The control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; a first area including a location corresponding to a near real scene and a second area including a location corresponding to a distant real scene and in which the low visibility processing is performed, are set within a virtual display area in a real space ahead as seen by an occupant of the vehicle; a change speed when the visibility of a non-outline portion of a display object that has been displayed in the second area is increased as a result of the display object moving to the first area is slower than a change speed when the visibility of the non-outline portion of the display object that has been displayed in the first area is decreased as a result of the display object moving to the second area. Display control device.

5. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object; The control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; a first area including a location corresponding to a near real scene and a second area including a location corresponding to a distant real scene and in which the low visibility processing is performed, are set within a virtual display area in a real space ahead as seen by an occupant of the vehicle; when the visibility of a non-outline portion of a display object that has been displayed in the second area is increased as a result of the display object being moved to the first area, a change speed of the increase in visibility is differentiated depending on an importance level of the display object. Display control device.

6. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object, the control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; In the low visibility processing, the visibility level of a non-outline portion of the display object is reduced, and the visibility level of an outline portion of the display object is increased. Or, In the low visibility processing, the visibility level of the non-outline portion of the display object is reduced, and the visibility level of the outline portion of the display object is increased, and then the visibility levels are reduced, or the visibility levels are returned to the visibility levels before the increase, or the visibility levels are reduced below the visibility levels before the increase. Display control device.

7. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object; The control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; When reducing the visibility of a non-outline portion of one display object, if the non-outline portion has a highly conspicuous area and a less conspicuous area, the visibility is preferentially reduced in the more conspicuous area; If it is necessary to further reduce the visibility, reduce the visibility of the less conspicuous area. Display control device.

8. The control unit When multiple display objects of the same type are displayed, low visibility processing is applied to some of the display objects. Or, When multiple display objects of the same type are displayed, low-visibility processing is applied to some of the display objects, and other display objects that are not subjected to low-visibility processing are hidden. The display control device according to claim 1 .

9. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object; The control unit The control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; a first area including a location corresponding to a near real scene and a second area including a location corresponding to a distant real scene and in which the low visibility processing is performed, are set within a virtual display area in a real space ahead as seen by an occupant of the vehicle; changing the position of the second region based on the acquired first information; Display control device.

10. the first information includes at least one of a steering angle, a pitching angle, a position of both eyes, and a driving location; The control unit detecting a traveling direction of the vehicle from the steering angle, and changing the position of the second area in the same direction as the traveling direction; and, detecting a vertical sway of the vehicle from the pitching angle, and changing the position of the second region in a direction opposite to the direction of the sway; and, When the positions of both eyes are higher than the reference position, the position of the second area is changed to be higher, and when the positions of both eyes are lower than the reference position, the position of the second area is changed to be lower. and, changing the position of the second area to a preset position relative to the travel location; Execute at least one of The display control device according to claim 9 .

11. A display control device mounted on a vehicle for controlling image display, comprising: a control unit for controlling a visibility level of a display object; The control unit When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; a first area including a location corresponding to a near real scene and a second area including a location corresponding to a distant real scene and in which the low visibility processing is performed, are set within a virtual display area in a real space ahead as seen by an occupant of the vehicle; changing the size of the second region based on the acquired first information; Display control device.

12. the first information includes at least one of a steering angle, a pitching angle, a position of both eyes, and a driving location; The control unit, based on the first information, When the steering angle is large, the second area is changed to be larger than the reference size. and, When the pitching angle is large, the second region is changed to be larger than the reference size. and, If the positions of both eyes are higher or lower than the reference position, the second region is changed to be larger than the reference size. and, changing the size of the second area to a size that is preset for the traveling location; Execute at least one of The display control device according to claim 11.

13. an image generation unit that generates an image; a display unit that displays the image; an optical system including an optical member that reflects display light of the image and projects it onto a projection target; A display control device according to any one of claims 1 to 12; A display device having:

14. A display control method for controlling a visibility level and a display mode of a display object, comprising: When low visibility processing is performed to set the visibility level of the display object to a second visibility level lower than the first visibility level, The display object is divided into an outline portion, which is the outermost portion including lines that form the outline of the display object, and a non-outline portion, which is the portion inside the outline portion, and the visibility of the non-outline portion is reduced without reducing the visibility of the outline portion; When reducing the visibility of a non-outline portion of one display object, if the non-outline portion has a highly conspicuous area and a less conspicuous area, the visibility is preferentially reduced in the more conspicuous area; If it is necessary to further reduce the visibility, reduce the visibility of the less conspicuous area. Display control method.

Images