Display control device, display control method, program, and vehicle display system
The display control device adjusts AR image visibility based on vehicle speed and road conditions to reduce distractions, improving safety by minimizing attention to close-range AR images.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2026-03-12
AI Technical Summary
AR images in vehicle head-up displays move differently in near and far distances, causing unnecessary visual attention and potential distractions, especially at high speeds, which can impede safe driving.
A display control device that adjusts the conspicuousness of AR images based on vehicle speed and road conditions, reducing visibility of close-range images by controlling display position and distance, transparency, color, size, and emphasis, and applying depth perception techniques.
Reduces unnecessary visual attention to AR images at high speeds, enhancing safety by minimizing distractions and ensuring drivers focus on the road ahead.
Smart Images

Figure 2026044369000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a display control device suitable for use in, for example, a head-up display device that displays a virtual image generated by augmented reality superimposed on a specific object included in the forward field of view of a vehicle. [Background technology]
[0002] In recent years, vehicles have begun to be equipped with AR-HUD (Augmented Reality Head-Up Display) devices. These devices link Advanced Driver Assistance Systems (ADAS) equipment with navigation information to detect oncoming vehicles and pedestrians, and superimpose alert information and other information onto the vehicle's forward field of view (scenery) seen by the occupant (driver) through the windshield, thereby minimizing the occupant's (driver's) eye movement.
[0003] For example, Patent Document 1 describes a head-up display (HUD) technology that displays virtual images, including AR images created by augmented reality (AR), to the driver by projecting and reflecting image light onto a vehicle's windshield or combiner. This HUD device includes an image display device having a light source and a display element to form an image, a virtual image display means that displays a virtual image in a virtual image display area in front of the vehicle by projecting and reflecting the image light emitted from the image display device onto the windshield or combiner, and a control means that controls the image display device and the virtual image display means. The control means has a control function that limits the proportion of the virtual image in the entire virtual image display area to a predetermined proportion or less. Therefore, by appropriately selecting and displaying AR images on the device, it is possible to both ensure the driver's field of view and provide driving support by displaying AR images. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent Publication No. 2019-113809 (see paragraphs
[0008] ,
[0009] , and Figure 6). Summary of the Invention [Problem to be solved by the invention]
[0005] According to the technology described in Patent Document 1, AR images can be displayed with high visibility. However, when a vehicle passes an overlaid object (another vehicle, pedestrian, obstacle, traffic sign, etc. in the forward field of view), the AR image moves slowly within the field of view (display area) in the distance (long distance), whereas it appears to move quickly within the field of view in the near distance (short distance). This is based on the principle of perspective, where even if the same distance is moved in a two-dimensional view, the apparent distance of movement is shorter in the distance (appears to have moved less (slowly)), whereas the apparent distance of movement is longer in the near distance (short distance) (appears to have moved a lot (fast)). For this reason, unnecessary visual attention is generated in the near distance (short distance), which may result in occupants staring at the AR image more than necessary, which may impede safe driving.
[0006] Therefore, the object of the present invention is to provide a display control device, etc., which reduces the conspicuousness of close-range AR images when the vehicle speed is high, thereby making them less noticeable and preventing unnecessary distractions from hindering safe driving.
[0007] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings. [Means for solving the problem]
[0008] In order to facilitate an understanding of the outline of the present invention, the following examples are given of embodiments according to the present invention.
[0009] A first aspect of the present invention is a display control device having a control unit that controls a display unit that displays a virtual image generated by augmented reality superimposed on a specific object in the vehicle's forward field of view, and controls the conspicuousness of the virtual image based on the acquired vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling, and the condition for the conspicuousness of the virtual image to be controlled by the control unit is that when the display position of the virtual image moves from the back side of the screen of the display unit through a display position threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
[0010] Here, the "specific object in the forward field of view" refers to, for example, another vehicle (e.g., vehicle 2 in FIG. 8B) traveling ahead of the vehicle (e.g., host vehicle 1 in FIG. 8B), a crossing pedestrian, a bicycle, structures such as buildings and traffic signs, advertisements, and other scenery ahead of the vehicle that changes as the vehicle moves. Furthermore, the "object distance" refers to, for example, the distance to a specific object in the forward field of view of the vehicle detected by the imaging unit 10 (forward object detection unit) shown in FIG. 1. The display position and display distance of the virtual image are set to have a predetermined positional relationship with the specific object (object) according to the detected object's position (including object distance as well as object direction). The set display position of the virtual image is the vertical and horizontal position as seen from the eye position (eye point) of the occupant (driver), and the display distance is the depth distance (depth of 3D representation) as seen from the eye position (eye point) of the occupant (driver). The control unit controls the display position and display distance of the virtual image (an AR image displayed as a virtual image generated by augmented reality within the display area) within the virtual image display area. Controlling the display distance means controlling how far in front of the vehicle the virtual image is displayed from the perspective of the occupant. In other words, the control unit controls the virtual image so that it is visible at a position a predetermined distance ahead of the vehicle. For example, if there are two vehicles (a leading vehicle and a trailing vehicle) traveling ahead of the vehicle in the forward field of view of the vehicle, the distance from the occupant to the position where the leading vehicle is displayed will be longer than the distance from the occupant to the position where the trailing vehicle is displayed (the trailing vehicle), so the leading vehicle can be displayed as if it is farther away than the trailing vehicle.
[0011] "Conspicuousness" refers to the degree to which a user gazes at a virtual image without being aware of it. For example, it can be defined by the color of the virtual image. In this case, warm colors such as red or yellow or a white or black background color can be said to be highly conspicuous and easy to see. It can also be defined by the display mode of the virtual image, such as its transmittance, size, or emphasis. Conspicuousness can be controlled by changing the display distance depending on the superimposed object in the forward field of view (obstacles including other vehicles that interfere with driving, or objects that do not affect driving).
[0012] In a first aspect, a control unit controls the visual appeal of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling. For example, when the vehicle speed is equal to or greater than a speed threshold, the visual appeal of the AR image within the display distance area (within a short distance) is reduced to make it less noticeable, thereby preventing unnecessary visual appeal and obstructing safe driving. Note that, for example, as shown by hatching in (a) and (b) of Figures 7A and 7B, "within a predetermined display distance area" refers to the range area from the display position threshold Th to the host vehicle 1 displayed on the front side of the screen when the display position of the virtual image (no entry mark) moves from the back side of the screen through the display position threshold Th to the front side of the screen. Furthermore, the "display position threshold Th" refers to the boundary position between the back side of the screen and the front side of the screen where visual appeal control (for example, control to reduce the visual appeal of the virtual image) is required to prevent unnecessary visual appeal. Specifically, for example, if the maximum display distance that can be displayed on the display unit is 100 [m], it is necessary to control the visibility; for example, within 30 [m] is the "display position threshold", and the range area on the front side of the screen from 30 [m] to 0 [m] is the "within the specified display distance area".
[0013] In a second aspect dependent on the first aspect, the control unit may perform control such that, if the vehicle speed or the speed limit is less than a speed threshold, the conspicuousness of the virtual image whose display position is located within the predetermined display distance area or whose display position moves from the display position threshold toward the front side of the screen within the predetermined display distance area is the same as the conspicuousness of the virtual image whose display position is located outside the predetermined display distance area or whose display position moves outside the predetermined display distance area from the back side of the screen to the display position threshold; and, if the vehicle speed or the speed limit is equal to or greater than the speed threshold, the conspicuousness of the virtual image whose display position moves from the display position threshold toward the front side of the screen within the predetermined display distance area is reduced compared to the conspicuousness of the virtual image whose display position is located outside the predetermined display distance area or whose display position moves outside the predetermined display distance area from the front side of the screen to the display position.
[0014] Here, the "speed threshold" is defined depending on the driving environment, such as whether the vehicle is driving on a highway or in an urban area. When the vehicle is driving on a highway, for example, 80 km / h corresponds to the "speed threshold," and when the vehicle is driving in an urban area, for example, 50 km / h corresponds to the "speed threshold." Note that the speed threshold may be substituted by a speed limit indicated by a traffic sign or the like, regardless of the vehicle speed when the vehicle is driving.
[0015] Furthermore, the degree to which one gazes at a virtual image without being aware of it is defined as "visibility," and this degree is indicated on a level of 1 to 10, expressed as a three-level parameter of "high," "medium," and "low." For example, if a warning image that notifies a dangerous situation has a "high" level of visibility (level 10), "control to maintain visibility" means, for example, making the visibility "medium" (level 9-4), and "control to reduce visibility" means, for example, making the visibility "low" (level 3-0). The level indicated by 1 to 10 and the range (definition) of "high," "medium," and "low" are adjustable, and can be controlled, for example, by the color, transmittance, size, and emphasis level of the virtual image, which are defined in advance for each numerical value.
[0016] In the second aspect, if the vehicle speed or speed limit is equal to or greater than the speed threshold, the control unit performs control to reduce the conspicuousness of a virtual image whose display position moves from a display position threshold Th (see, for example, (b) of Figure 7) within a predetermined display distance range toward the front of the screen compared to the conspicuousness of a virtual image whose display position is located outside the predetermined display distance range (toward the back of the screen) or moves outside the predetermined display range from the front of the screen to the display position.This reduces the conspicuousness of a virtual image that moves at high speed within the field of view within the predetermined display distance range (within a short distance), making it less noticeable, thereby contributing to safer driving.
[0017] In a third aspect dependent on the first or second aspect, the control unit may set the display position threshold closer to the back of the screen as the vehicle speed or the speed limit is higher if the vehicle speed or the speed limit is equal to or higher than the speed threshold, and may set the display position threshold closer to the front of the screen as the vehicle speed or the speed limit is lower if the vehicle speed or the speed limit is lower than the speed threshold.
[0018] 5, for example, if the vehicle speed or the speed limit is equal to or greater than the speed threshold, the control unit sets the display position threshold Th so that the higher the vehicle speed or the speed limit, the closer to the back of the screen (the display position threshold is Th1), and if the vehicle speed or the speed limit is less than the speed threshold, the control unit sets the display position threshold Th so that the lower the vehicle speed or the speed limit, the closer to the front of the screen (the display position threshold is Th2). For example, when driving at high speed, the occupant (driver) drives while paying attention to distant objects, so close-range information is unnecessary. Therefore, unnecessary attention is avoided early by performing control to reduce conspicuity from a distance. On the other hand, when driving at a relatively low speed, such as in urban areas or residential areas, the occupant often drives while focusing on close-range areas around the vehicle. Therefore, maintaining conspicuity up to a short distance enables optimal information presentation according to the driving situation.
[0019] In a fourth aspect dependent on the first to third aspects, the control unit may change the predetermined display distance area depending on the specific object on which the virtual image is superimposed.
[0020] In the fourth aspect, as shown in Fig. 6, for example, the display distance range for reducing conspicuity is set to, for example, up to x [m] (display position threshold is Th') when the specific object to be superimposed is a pedestrian or other object requiring careful driving, up to x+A [m] (display position threshold is Th') when the specific object is related to driving operations such as a no entry traffic sign, and up to x+A+B [m] (display position threshold is Th) when the specific object is not related to driving operations such as an advertisement. In this way, by changing the display distance (second display distance) within a short distance for reducing conspicuity depending on the specific object to be superimposed within the forward field of view, flexible information presentation according to the driving scene while reducing conspicuity at short distances is possible.
[0021] For example, if one is driving at a low speed of 40 km / h in an urban area, the display distance area x may be set to, for example, 20 m (the stopping distance at 40 km / h is 22 m), and since pedestrians as specific objects within this distance are not particularly affected, the conspicuousness may be reduced), A may be set to 10 m (since the content of traffic signs as specific objects cannot be read if they are erased at a long distance, x+A=30 m), and B may be set to 20 m (since advertisements as specific objects are often displayed relatively large, x+A+B=50 m).
[0022] In a fifth aspect dependent on the first to fourth aspects, the control unit may perform control to reduce the visibility of the virtual image by making the virtual image transparent or fading it out when the display position of the virtual image is located within the specified display distance area or moves within the specified display distance area from the display position threshold toward the front of the screen.
[0023] In a fifth aspect, when the virtual image moves within the display distance range (close distance), the control unit controls the transmittance to eliminate (transmit) the virtual image, gradually transmit the virtual image near the close distance, or fade it out, thereby reducing its conspicuousness. This makes the virtual image less noticeable even when it moves at high speed within the field of view at close distances, eliminating unnecessary distractions and reducing the possibility of impeding safe driving. Note that, for example, when the specific object is a traffic sign, the close distance is 45 [m], which is 1.5 times the close distance of 30 [m].
[0024] In a sixth aspect which is dependent on the first to fourth aspects, the control unit may perform control such that, when the display position of the virtual image is located within the predetermined display distance area or moves within the predetermined display distance area from the display position threshold toward the front side of the screen, the color of the virtual image is made the same as the color of the virtual image to reduce the eye-catching nature.
[0025] In a sixth aspect, when a virtual image moves, for example, within the display distance range (within a short distance), the control unit can make the virtual image less noticeable by, for example, changing the color of the virtual image, which was previously displayed in red for warning purposes, to the same color as the color of the superimposed object in the field of view, such as another vehicle or pedestrian.As a result, unnecessary attention is no longer generated, and the possibility of obstructing safe driving is reduced.
[0026] In a seventh aspect which is dependent on the first to fourth aspects, the control unit may perform control to reduce the visibility by shrinking the virtual image or gradually shrinking it from near the second display distance when the display position of the virtual image is located within the specified display distance area or moves within the specified display distance area from the display position threshold toward the front of the screen.
[0027] In the seventh aspect, when the virtual image moves, for example, within a predetermined display distance range (within a short distance), the control unit can reduce the visual appeal by shrinking the virtual image or controlling it to gradually shrink from a short distance, thereby making the virtual image less noticeable and, as a result, reducing the possibility of it hindering safe driving without creating unnecessary visual appeal.
[0028] In an eighth aspect which is dependent on the first to fourth aspects, when the display position of the virtual image moves from the vicinity within the specified display distance area toward the front side of the screen, and if an enhancement process has been applied to the virtual image, the control unit may perform control to weaken or disable the enhancement process depending on the distance from the vehicle, thereby reducing the eye-catching nature of the virtual image.
[0029] In the eighth aspect, when a virtual image is displayed within a predetermined display distance range (within a short distance) or in its vicinity, and a specific object has been subjected to collaborative processing such as contour lines or three-dimensional representation, such as an advertisement superimposed on a building, the eye-catching effect can be reduced by weakening or eliminating the emphasis depending on the distance from the vehicle, thereby making the virtual image less noticeable and, as a result, reducing the possibility of it hindering safe driving without creating unnecessary eye-catching effects.
[0030] In a ninth aspect which is dependent on the first to fourth aspects, when the display position of the virtual image moves from the vicinity within the specified display distance area toward the front side of the screen, if the virtual image includes a video that emphasizes the virtual image, the control unit may perform control to stop the video and reduce the attention to detail.
[0031] In the ninth aspect, when a virtual image is within a predetermined display distance range (near distance) or its vicinity, for example, when there is a virtual image with animation to emphasize the presence of a pedestrian in the forward field of view, the virtual image becomes less noticeable at a second display distance (near distance) by superimposing an image without animation, and as a result, unnecessary attention is not generated, and the possibility of it impeding safe driving is reduced.
[0032] In a tenth aspect which is dependent on the first to fourth aspects, the control unit may perform control such that, when the display position of the virtual image is located within the predetermined display distance area or moves within the predetermined display distance area from the display position threshold toward the front side of the screen, the control unit cancels the superimposition of the virtual image and the specific object, and displays the virtual image in a form that is independent of the position of the specific object, thereby reducing the visual appeal.
[0033] In the tenth aspect, for example, if a pedestrian represented by a virtual image is present in the forward field of view and moves within a specified display distance, the superimposed display is stopped, and the virtual image is displayed in a form that is not dependent on the position of the superimposed object, such as a static icon, making the virtual image less noticeable.As a result, unnecessary distractions are not generated, and the possibility of obstructing safe driving is reduced.
[0034] An eleventh aspect of the present invention is a display control method for controlling a display unit that displays a virtual image generated by augmented reality superimposed on a specific object in the forward field of view of a vehicle, the display control method comprising the steps of: a control unit acquiring the vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling; and a control unit controlling the conspicuousness of the virtual image based on the acquired vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling. The condition for controlling the conspicuousness of the virtual image by the control unit is that, when the display position of the virtual image moves from the back side of the screen of the display unit through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
[0035] In the eleventh aspect, a display control method can be provided in which the control unit controls the conspicuity of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling, thereby reducing the conspicuity of the AR image within the display distance area (within a short distance) and making it less noticeable when the vehicle speed is above a speed threshold, thereby preventing unnecessary distractions from obstructing safe driving.
[0036] A twelfth aspect of the present invention is a program for a display control device having a control unit that controls a display unit that displays a virtual image generated by augmented reality superimposed on a specific object in the vehicle's forward field of view, the program causing a processor of the control unit to execute a process of acquiring the vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling, and a process of controlling the conspicuity of the virtual image based on the acquired vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling, and the condition for the conspicuity of the virtual image to be controlled by the control unit is that when the display position of the virtual image moves from the back side of the screen of the display unit through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
[0037] In the 12th aspect, a processor possessed by the control unit reads and executes a program recorded in memory, thereby controlling the conspicuity of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling. For example, when the vehicle speed is above a speed threshold, the conspicuity of the AR image within the display distance area (within a short distance) is reduced to make it less noticeable, thereby providing a program that does not generate unnecessary attention and does not hinder safe driving.
[0038] A thirteenth aspect of the present invention is a vehicular display system comprising an imaging device that captures an image of the forward field of view of the vehicle, a vehicle ECU, and a display control device that controls a display device that displays a virtual image generated by augmented reality superimposed on a specific object in the forward field of view of the vehicle, wherein the display control device has a control unit that controls the conspicuousness of the virtual image based on the vehicle speed of the vehicle acquired via the vehicle ECU or the speed limit of the road on which the vehicle is traveling acquired from the imaging device or map information, and the condition for controlling the conspicuousness of the virtual image by the control unit is that when the display position of the virtual image moves from the back side of the screen of the display device through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
[0039] In the thirteenth aspect, a display control device controls the conspicuity of a virtual image based on the vehicle speed obtained via the vehicle ECU or the speed limit of the road on which the vehicle is traveling. For example, when the vehicle speed is equal to or greater than a speed threshold, the conspicuity of an AR image within the display distance area (within a short distance) is reduced to make it less noticeable, thereby providing a vehicle display system that does not generate unnecessary distractions and does not hinder safe driving.
[0040] Those skilled in the art will easily understand that the exemplified embodiments according to the present invention can be further modified without departing from the spirit of the present invention. [Brief explanation of the drawings]
[0041] [Figure 1] FIG. 1 is a block diagram showing the configuration of a vehicle display system including a display control device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a flowchart showing the basic processing operation of the display control device according to the embodiment of the present invention. [Figure 3A] FIG. 3A is a flowchart showing a specific procedure for the process of "setting the display position threshold Th for reducing conspicuousness" in step ST15 of FIG. [Figure 3B] FIG. 3B is a flowchart showing a specific procedure for the process of "setting a display distance area for reducing conspicuity" in step ST15 of FIG. [Figure 3C] FIG. 3C is a flowchart showing a specific procedure for the "control of the visual appeal of the virtual image" process in step ST19 of FIG. [Figure 4A] FIG. 4A is a flowchart showing an example of a specific procedure for the "control 1 for reducing the conspicuousness of a virtual image" process in step ST193 of FIG. 3C. [Figure 4B] FIG. 4B is a flowchart showing an example of a specific procedure for "control 2 for reducing the conspicuousness of a virtual image" in step ST193 of FIG. 3C. [Figure 4C]FIG. 4C is a flowchart showing an example of a specific procedure for "control 3 for reducing the conspicuousness of a virtual image" in step ST193 of FIG. 3C. [Figure 4D] FIG. 4D is a flowchart showing an example of a specific procedure for "control 4 for reducing the conspicuousness of a virtual image" in step ST193 of FIG. 3C. [Figure 4E] FIG. 4E is a flowchart showing an example of a specific procedure for "control 5 for reducing the conspicuousness of a virtual image" in step ST193 of FIG. 3C. [Figure 4F] FIG. 4F is a flowchart showing an example of a specific procedure for "control 6 for reducing the conspicuousness of a virtual image" in step ST193 of FIG. [Figure 5] FIG. 5 is a conceptual diagram of the operation when setting a display position threshold that reduces conspicuousness in accordance with the vehicle speed or the road speed limit in the display control device according to the embodiment of the present invention. [Figure 6] FIG. 6 is an operational diagram showing how the display distance threshold for reducing conspicuousness is changed in accordance with a specific object to be superimposed in the display control device according to the embodiment of the present invention. [Figure 7] FIG. 7 is a conceptual diagram of the operation of the display control device according to the embodiment of the present invention when controlling the conspicuousness of a virtual image within the display distance area in accordance with the vehicle speed or the road speed limit. [Figure 8A] FIG. 8A is an operational concept diagram cited to explain the outline of the operation of "control 1 for reducing the conspicuousness of a virtual image" in FIG. 4A. [Figure 8B] FIG. 8B is an operational concept diagram cited to explain the outline of the operation of "control 2 for reducing the conspicuousness of a virtual image" in FIG. 4B. [Figure 8C] FIG. 8C is an operational concept diagram cited to explain the outline of the operation of "control 3 for reducing the conspicuousness of a virtual image" in FIG. 4C. [Figure 8D] FIG. 8D is a diagram cited for explaining the outline of the operation of "control 4 for reducing the conspicuousness of a virtual image" in FIG. 4D. [Figure 8E] FIG. 8E is an operational concept diagram cited to explain the outline of the operation of "control 5 for reducing the conspicuousness of a virtual image" in FIG. 4E. [Figure 8F] FIG. 8F is an operational concept diagram cited to explain the outline of the operation of "control 6 for reducing the conspicuousness of a virtual image" in FIG. 4F. DETAILED DESCRIPTION OF THE INVENTION
[0042] The best mode described below is used to facilitate understanding of the present invention, and therefore, those skilled in the art should be aware that the present invention is not unduly limited by the mode described below (hereinafter referred to as the present mode).
[0043] (Configuration of the embodiment) Please refer to FIG. 1. FIG. 1 is a block diagram showing the configuration of a vehicular display system 110 including a display control device 30 according to this embodiment. As shown in FIG. 1, the vehicular display system 110 according to this embodiment includes an imaging device (hereinafter referred to as an imaging unit 10) including a front camera or the like that captures an image of the forward field of view of a vehicle (for example, see the host vehicle 1 in FIG. 5 and subsequent figures), a vehicle speed measurement unit 20 including a vehicle speed sensor or the like that measures the vehicle speed, and the display control device 30 according to this embodiment, all of which are bidirectionally connected via a vehicle ECU (electronic control unit) (not shown) and a CAN (Control Area Network) 40, which is an in-vehicle LAN. The imaging unit 10 can also be considered a forward object detection unit that detects the distance to a specific object in the forward field of view of the vehicle. Here, the display position and display distance of the virtual image are set so as to have a predetermined positional relationship with the specific object (object) according to the position of the detected object (including not only the object direction but also the object distance). The display position of the virtual image to be set is the vertical and horizontal position as seen from the eye position (eye point) of the occupant (driver), and the display distance is the depth distance (depth of 3D representation) as seen from the eye position (eye point) of the occupant (driver). Note that the object distance refers to the distance to a specific object in the field of view ahead of the vehicle detected by the imaging unit 10 (forward object detection unit).
[0044] The display control device 30 of this embodiment superimposes a virtual image generated by augmented reality on a specific object in the forward field of view of the vehicle and displays it. The display control device 30 includes an information acquisition unit 31, a display unit 32, and a control unit 33. The information acquisition unit 31 acquires the vehicle's forward field of view, vehicle speed, and speed limit of the road on which the vehicle is traveling from the imaging unit 10 and the vehicle speed measurement unit 20 (or the vehicle ECU), and outputs the information to the control unit 33. Here, the vehicle speed is dynamic information detected by, for example, a vehicle speed sensor mounted on the vehicle or generated by calculation. The speed limit can be acquired by the imaging unit 10 capturing an image of a traffic sign passing by the vehicle while traveling and performing image recognition, or by searching map information from positioning data such as GPS. The display unit 32 is a display device, such as a TFT (Thin Film Transistor) liquid crystal display or an organic EL (Electro-Luminescence) display, that displays a virtual image generated by augmented reality superimposed on a specific object in the forward field of view acquired by the information acquisition unit 31.
[0045] The control unit 33 can control the visibility of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling, which are acquired by the information acquisition unit 31. Here, "a specific object in the field of view ahead" refers to the scenery ahead of the vehicle that changes as the vehicle moves, such as other vehicles traveling ahead of the vehicle, pedestrians crossing the road, bicycles, structures such as buildings and traffic signs, advertisements, etc. The control unit 33 can control the display position and display distance of the virtual image (an AR image displayed as a virtual image generated by augmented reality within the screen (display area) of the display unit 32).
[0046] Controlling the display distance means controlling how far in front of the vehicle the virtual image is displayed as seen by the occupant. In other words, the control unit 33 controls the display unit 32 so that the virtual image is visible at a position a predetermined distance ahead of the vehicle. For example, if there are two vehicles (a leading vehicle and a trailing vehicle) traveling ahead of the vehicle in the forward field of view of the vehicle, the distance from the occupant to the position where the leading vehicle is displayed will be longer than the distance from the occupant to the position where the trailing vehicle is displayed (the trailing vehicle), and therefore the leading vehicle can be displayed on the display unit 32 as if it were farther away than the trailing vehicle.
[0047] "Conspicuousness" refers to the degree to which a user gazes at a virtual image without being aware of it. For example, it can be defined by the color of the virtual image. In this case, warm colors such as red or yellow or a white or black background color can be said to be highly conspicuous and easy to see. It can also be defined by the display mode of the virtual image, such as its transmittance, size, or emphasis. Conspicuousness can be controlled by changing the display distance depending on the superimposed object in the forward field of view (obstacles, including other vehicles, that may interfere with driving, or objects that do not affect driving). The transmittance of the virtual image can be reduced (to improve conspicuousness) by increasing the brightness, lightness, or saturation of the virtual image (the image that forms the virtual image) displayed by the display unit 32.
[0048] The control unit 33 controls the display position of the virtual image within the display area (screen) of the virtual image and the display distance of the image. Here, controlling the display position means that the control unit 33 controls the display unit 32 so that the image is displayed at an arbitrary position within the display area of the virtual image as seen by the occupant (driver). Controlling the display distance means controlling how far forward from the vehicle the virtual image is displayed as seen by the occupant (driver). In other words, controlling the display distance means that the control unit 33 controls the display unit 32 so that the virtual image is viewed at a position a predetermined distance ahead of the vehicle.
[0049] The control of the display distance can be achieved by the control unit 33 controlling the display of an image within the display area of the virtual image in a manner that imparts a sense of depth. Displaying the virtual image in a manner that imparts a sense of depth can be achieved, for example, by controlling the rendering of the virtual image using perspective (e.g., one-point perspective) based on the position of an object on which the virtual image is to be superimposed, which can be calculated from information about a specific object, or the distance from the vehicle to the object. Alternatively, the display surface of the display unit 12 (e.g., a liquid crystal display or organic EL display surface) can be tilted to tilt the virtual surface on which the virtual image is displayed (the surface corresponding to the display surface of the display unit 32) forward relative to the vertical direction of the vehicle, thereby imparting depth to the virtual image. In this case, the control unit 33 may control the rendering of the virtual image in a manner that imparts a sense of depth, taking into account the projection of an image to be viewed from the viewpoint of the occupant (driver) onto the virtual surface. As the viewpoint position of the occupant (driver), the control unit 33 may use an assumed viewpoint position stored in advance in the built-in memory, or may use line-of-sight information from a viewpoint sensor (not shown) that detects the viewpoint position of the occupant (driver).
[0050] The control unit 33 can also determine whether the vehicle speed of the traveling vehicle or the speed limit of the traveling road is equal to or greater than a speed threshold. If the vehicle speed or the speed limit is equal to or greater than the speed threshold, the display mode can be controlled by, for example, controlling the display mode so that the virtual image maintains the same visual appeal as the virtual image outside the predetermined display distance area (in the rear of the screen) in a display distance area (within the hatched short distance) within the display position threshold Th, as shown in FIG. 7(b). If the vehicle speed or the speed limit is less than the speed threshold, the display mode can be controlled by controlling the display mode so that the visual appeal of the virtual image decreases in the predetermined display distance area (within the short distance), as shown in FIG. 7(a). Here, the "speed threshold" is defined depending on the driving environment, such as whether the vehicle is traveling on a highway or in an urban area. When the vehicle is traveling on a highway, the "speed threshold" is, for example, 80 km / h, and when traveling in an urban area, the "speed threshold" is, for example, 50 km / h. 7(a) and 7(b), the "predetermined display distance region" refers to a range region from the display position threshold Th to the host vehicle 1 displayed on the front side of the screen when the display position of the virtual image (no entry mark) moves from the rear side of the screen through the display position threshold Th to the front side of the screen, and the "display position threshold Th" refers to the boundary position between the rear side of the screen and the front side of the screen where control of the visual appeal by the control unit 33 (for example, control to reduce the visual appeal) is required to prevent unwanted visual appeal. Specifically, for example, if the upper limit display distance that can be displayed on the display unit 32 is 100 [m], the "display position threshold" is, for example, within 30 [m], and the range region on the front side of the screen from 30 [m] to 0 [m] where the visual appeal of the virtual image needs to be controlled is the "predetermined display distance region."
[0051] Here, the degree to which one gazes at a virtual image without being aware of it is defined as "visibility," and this degree is expressed as a level from 1 to 10. If this degree is expressed as a three-level parameter of "high," "medium," and "low," for example, if a warning image that notifies a dangerous situation has a "high" visibility (level 10), "maintaining visibility" means making the visibility "medium" (level 9-4), and "control to reduce visibility" means making the visibility "low" (level 3-0). The level indicated by 1 to 10 and the range (definition) of "high," "medium," and "low" are adjustable, and can be controlled, for example, by the color, transmittance, size, and emphasis level of the virtual image, which are defined in advance for each value.
[0052] If the vehicle speed or speed limit is less than the speed threshold, for example, as shown in Figure 7, the control unit 33 can perform control to make the attractiveness of a virtual image indicated by a no-entry mark, whose display position is located within a predetermined display distance area or moves from the display position threshold Th toward the front of the screen within the predetermined display distance area, the same as the attractiveness of a virtual image whose display position is located outside the predetermined display distance area or moves from the back of the screen outside the predetermined display distance area to the display position threshold.On the other hand, if the vehicle speed or speed limit is equal to or greater than the speed threshold Th, the control unit 33 can perform control to reduce the attractiveness of a virtual image whose display position is moving from the display position threshold Th toward the front of the screen within the predetermined display distance area compared to the attractiveness of a virtual image whose display position is located outside the predetermined display distance area or moves from the front of the screen outside the predetermined display area to the display position.
[0053] 5, for example, if the vehicle speed or speed limit is equal to or greater than a speed threshold (e.g., 80 km / h for highway driving, 50 km / h for city driving), the control unit 33 sets the display position threshold Th so that the higher the dynamically acquired vehicle speed or speed limit, the closer to the back of the screen (in this case, the display position threshold is Th1). If the vehicle speed or speed limit is less than the speed threshold, the control unit 33 sets the display position threshold Th so that the lower the vehicle speed or speed limit, the closer to the front of the screen (in this case, the display position threshold is Th2). For example, when driving at high speed, the occupant (driver) drives while paying attention to distant objects, and information about nearby areas is unnecessary. Therefore, unnecessary attention is avoided early by reducing conspicuity from a distance. On the other hand, when driving at a relatively low speed, such as in city driving or residential areas, the occupant often focuses attention on the short distance around the vehicle 1. Therefore, by maintaining conspicuity up to a short distance, optimal information presentation according to the driving situation is possible.
[0054] Furthermore, the control unit 33 may change the display distance range depending on the specific object on which the virtual image is superimposed. For example, as shown in Fig. 6, the display distance range for reducing the conspicuousness may be set to, for example, up to x [m] (display position threshold is Th') when the specific object to be superimposed is a pedestrian or the like that requires careful driving, up to x + A [m] (display position threshold is Th') when the specific object is related to driving operation such as a no entry traffic sign, and up to x + A + B [m] (display position threshold is Th) when the specific object is not related to driving operation such as an advertisement.
[0055] Taking the example of driving at a low speed of 40 km / h in an urban area, x is, for example, 20 m (the stopping distance at 40 km / h is 22 m), and conspicuity may be reduced because pedestrians as specific objects within this distance are not particularly affected), A is 10 m (because traffic signs as specific objects cannot be read if they are erased at a long distance, x + A = 30 m), and B is 20 m (because advertisements as specific objects are often displayed relatively large, x + A + B = 50 m). In this way, by changing the display distance (second display distance) within a short distance at which conspicuity is reduced according to the specific object in the superimposed forward field of view, flexible information presentation according to the driving situation is possible while reducing conspicuity at short distances.
[0056] In addition, when the display position of the virtual image is located within a predetermined display distance area or moves within the predetermined display distance area from the display position threshold Th toward the front of the screen, the control unit 33 can perform control to reduce the visibility of the virtual image by making it transparent or fading it out.
[0057] In addition, the control unit 33 may perform control to reduce the visual appeal by changing the color of the virtual image to the same color as the virtual image when the display position of the virtual image is located within a predetermined display distance area or has moved within the predetermined display distance area from the display position threshold Th toward the front of the screen.
[0058] In addition, the control unit 33 may perform control to reduce the visibility of the virtual image by shrinking the virtual image or gradually shrinking it from near the second display distance when the display position of the virtual image is located within a predetermined display distance area or moves within the predetermined display distance area from the display position threshold Th toward the front of the screen.
[0059] In addition, if the display position of the virtual image moves from the vicinity within a specified display distance area toward the front of the screen and the virtual image has been subjected to an emphasis process, the control unit 33 may perform control to weaken or disable the emphasis process depending on the distance from the vehicle, thereby reducing its visibility.
[0060] In addition, when the display position of the virtual image moves from the vicinity within a specified display distance area toward the front of the screen, if the virtual image includes a moving image (animation) that emphasizes the virtual image, the control unit 33 may perform control to stop the moving image and reduce its visual appeal.
[0061] In addition, when the display position of the virtual image moves from the vicinity within a specified display distance area toward the front of the screen, the control unit 33 may perform control to cancel the superimposition of the virtual image with a specific object and display the virtual image in a form that is independent of the position of the specific object, thereby reducing its visual appeal.
[0062] The control unit 33 is equipped with a processor (CPU: Central Processing Unit), memory, and peripheral LSIs such as a graphics controller. The processor sequentially reads programs stored in the memory and operates in cooperation with the graphics controller to execute the above-mentioned functions. The memory is equipped with storage elements such as RAM (Random Access Memory), SRAM (Static RAM), or ROM (Read Only Memory), each of which is assigned a program area and a work area. The program area is assigned to the program of this embodiment (display control program) executed by the processor, and the work area is assigned and stores a preset speed threshold, a default display position threshold Th, an image of the foreground of the vehicle including a specific object, and a virtual image generated by augmented reality.
[0063] (Operation of the embodiment) Please refer to Fig. 2. Fig. 2 is a flowchart showing the basic processing operation of the display control device 30 according to this embodiment. Hereinafter, the operation of the display control device 30 according to this embodiment shown in Fig. 1 will be described with reference to Fig. 2.
[0064] 2, the control unit 33 first detects the start-up of the vehicle (see host vehicle 1 shown in FIG. 5 and subsequent figures) (step ST11). Here, a vehicle ECU (not shown) detects that an ignition switch (IG) is turned ON (IG-ON) and notifies the control unit 33, thereby enabling the control unit 33 to detect the start-up of the vehicle. When the control unit 33 confirms the start-up of the vehicle (step ST11 "YES"), it acquires an image of the forward field of view to be superimposed from the imaging unit 10 via the information acquisition unit 31 (step ST12).
[0065] Next, the control unit 33 generates a virtual image (an AR image displayed as a virtual image generated by augmented reality within the display area) to be displayed on the display unit 32 (step ST13). The control unit 33 then acquires the vehicle speed or the speed limit of the road on which the vehicle is traveling via the information acquisition unit 31 via the CAN 40 (step ST14). The vehicle speed is dynamic information detected by the vehicle speed measurement unit 20 installed in the vehicle or generated by calculation. The speed limit can be acquired by capturing an image of a traffic sign the vehicle passes while traveling with the image capture unit 10 and performing image recognition, or by searching map information from positioning data such as GPS. After acquiring an image of a specific target in the forward field of view of the vehicle to be superimposed and information regarding the vehicle speed or the speed limit, the control unit 33 executes a process of setting a display position threshold Th for reducing conspicuity (step ST15). The display position threshold Th for reducing conspicuity can be determined according to the vehicle speed or the speed limit. FIG. 5 shows a conceptual diagram of the operation.
[0066] If the vehicle speed or speed limit is equal to or greater than the speed threshold, the control unit 33 sets the display position threshold Th (default value) so that the higher the vehicle speed or speed limit, the closer to the back of the screen, and if the vehicle speed or speed limit is less than the speed threshold, the lower the vehicle speed or speed limit, the closer to the front of the screen, the closer to the front of the screen. Figure 3A shows a specific processing procedure, and Figure 5 shows a conceptual diagram of the operation.
[0067] 3A. In FIG. 3A, the control unit 33 first compares the vehicle speed or speed limit dynamically acquired via the information acquisition unit 31 with a speed threshold previously stored in the control unit 33 (memory) to determine whether the acquired vehicle speed or speed limit is equal to or greater than the speed threshold (step ST151a). If the vehicle speed or speed limit is equal to or greater than the speed threshold (YES in step ST151a), the control unit 33 sets the display position threshold Th so that the higher the vehicle speed or speed limit is, the closer to the back of the screen (display position threshold is Th1) (step ST152a), as shown in FIG. 5. If the vehicle speed or speed limit is less than the speed threshold (NO in step ST151a), the control unit 33 sets the display position threshold Th so that the lower the vehicle speed or speed limit is, the closer to the front of the screen (display position threshold is Th2) (step ST153a).
[0068] In order to reduce the visual appeal, the display position threshold (including the predetermined display distance range) may be determined according to the specific object to be superimposed. The detailed procedure is shown in Figure 3B, and the conceptual diagram of the operation is shown in Figure 6. In Figure 6, an advertisement (SALE), a no entry traffic sign, and a highlighted pedestrian are shown as specific objects.
[0069] Referring to Fig. 3B, in Fig. 3B, when the specific object to be superimposed is a pedestrian crossing the road (see Fig. 6) and attention is required when driving (step ST151b "YES"), the control unit 33 sets the predetermined display distance region (within a short distance) in which conspicuity is reduced to, for example, a region from the position of the vehicle 1 to a display position threshold x [m] (closest display distance), and performs control to reduce conspicuity by, for example, erasing virtual images that are less than the display distance threshold x [m] (step ST152b).
[0070] On the other hand, if the specific object is a no-entry traffic sign (see FIG. 6) that affects driving operations (step ST153b "YES"), the control unit 33, for example, determines the display position threshold x+A [m] as the predetermined display distance area (short distance) and erases virtual images that are below the display threshold x+A [m] (step ST154b). Also, if the specific object to be superimposed is an advertisement (see FIG. 6) that does not affect driving operations (step ST153b "NO"), for example, determines the display position threshold x+A+B [m] as the predetermined display distance area (within short distance) and erases virtual images that are within the display distance area (within short distance) (step ST155b). In this way, by changing the predetermined display distance area for reducing conspicuity depending on the specific object in the forward field of view to be superimposed, flexible information presentation according to the driving scene is possible while reducing conspicuity within the predetermined display distance area (within short distance).
[0071] For example, if we take the case of driving at a low speed of 40 km / h in an urban area, the display position threshold x is, for example, 20 m (the stopping distance at 40 km / h is 22 m), and since pedestrians as specific objects within this distance are not particularly affected, conspicuity can be reduced), the display distance threshold A is 10 m (since the content of traffic signs as specific objects cannot be read if they are erased at a long distance, x+A=30 m), and the display distance threshold B is 20 m (since advertisements as specific objects are often displayed relatively large, x+A+B=50 m).
[0072] Returning to FIG. 2 for the explanation, after setting the display position threshold (and the predetermined display distance region) for reducing the visual appeal (step ST15), the control unit 33 controls the visual appeal of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling. Here, the condition for the control unit 33 to control the visual appeal of the virtual image is that, when the display position of the virtual image moves from the depth of the screen of the display unit 32 through the display threshold Th toward the front of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance region that is less than the display position threshold Th on the front side of the screen. For this reason, for example, as shown in FIGS. 7(a) and 7(b), when the control unit 33 controls the visual appeal of the virtual image represented by a mark indicating no entry from the depth of the screen toward the front of the screen (step ST17), if the virtual image passes the display position threshold Th (step ST17 "YES") and the display position of the virtual image is within the predetermined display distance region (within a short distance) (step ST18 "YES"). In addition, if the virtual image does not pass the display position threshold Th and is located at the back of the screen in step ST17 (step ST17 "NO"), or if the display position of the virtual image is not in the specified display distance area (step ST18 "NO"), the control to move the virtual image from the back of the screen to the front of the screen in step ST16 (step ST16) and subsequent processing are repeatedly executed.
[0073] A specific processing procedure for controlling the visual appeal of a virtual image is shown in FIG. 3C, and conceptual diagrams of the operation are shown in FIGS. 7(a) and 7(b).
[0074] 3C. In FIG. 3C, the control unit 33 first determines whether the vehicle speed or the speed limit acquired via the information acquisition unit 31 is less than a predetermined speed threshold (recorded in the memory of the control unit 33) (step ST191). If the vehicle speed information is a first speed (step ST16 "YES"), for example, as shown in FIG. 7B, the control unit 33 performs control to maintain the visual appeal of the virtual image outside a predetermined display distance range (long distance) (step ST17). If the vehicle speed information is a second speed faster than the first speed (step ST18 "YES"), for example, as shown in FIG. 7B, the control unit 33 performs control to reduce the visual appeal of the virtual image within a predetermined display distance range (close distance indicated by hatching) (step ST19).
[0075] Next, six examples will be used to explain in detail the detailed procedure of the "control for reducing the attractiveness of a virtual image at close range" process in step ST19 of Fig. 2. Fig. 4A shows a flowchart for "control 1 for reducing the attractiveness of a virtual image," Fig. 4B shows a flowchart for "control 2 for reducing the attractiveness of a virtual image," Fig. 4C shows a flowchart for "control 3 for reducing the attractiveness of a virtual image," Fig. 4D shows a flowchart for "control 4 for reducing the attractiveness of a virtual image," Fig. 4E shows a flowchart for "control 5 for reducing the attractiveness of a virtual image," and Fig. 4F shows a flowchart for "control 6 for reducing the attractiveness of a virtual image."
[0076] 8A to 8F show conceptual operational diagrams of "Control 1 for reducing the attractiveness of a virtual image," "Control 2 for reducing the attractiveness of a virtual image," "Control 3 for reducing the attractiveness of a virtual image," "Control 4 for reducing the attractiveness of a virtual image," "Control 5 for reducing the attractiveness of a virtual image," and "Control 6 for reducing the attractiveness of a virtual image," corresponding to FIGS. 4A to 4F, respectively.
[0077] As described above, when the vehicle speed or the speed limit is less than the speed threshold, the control unit 33 determines the conspicuousness of a virtual image when the display position of the virtual image is located within the predetermined display distance area (within a short distance) or when the virtual image moves within the predetermined display distance area (within a short distance) toward the front side of the screen from the display position threshold Th (see (a) or (b) of FIG. 7 ) and the conspicuousness of a virtual image when the display position of the virtual image is located outside the predetermined display distance area (toward the back of the screen) or when the virtual image moves outside the predetermined display distance area (toward the back of the screen) from the back side of the screen to the display position threshold Th (see (a) or (b) of FIG. 7 ). )) is set to be the same as (maintains its attractiveness), and if the vehicle speed or speed limit is equal to or greater than the speed threshold, the attractiveness of the virtual image whose display position is within a predetermined display distance range (within a short distance) and moves from the display position threshold Th (see (a) or (b) of Figure 7) towards the front side of the screen is reduced compared to the attractiveness of a virtual image whose display position is outside the predetermined display distance range (deep side of the screen) or moves outside the predetermined display range (deep side of the screen) from the front side of the screen to the display position. Here, the degree to which a user gazes at a virtual image without being aware of it is defined as "visibility," and this degree is expressed as a level from 1 to 10, with three parameters: "high," "medium," and "low." If a warning image that notifies a user of a dangerous situation has a "high" level of visibility (level 10), "maintaining visibility" means making the visibility "medium" (level 9-4), and "control to reduce visibility" means making the visibility "low" (level 3-0). The levels from 1 to 10 can be controlled, for example, by the color, transmittance, size, and emphasis level of the virtual image, which are defined in advance for each numerical value. Details of this are explained below.
[0078] First, "Control 1 for reducing the visual appeal of a virtual image" will be described with reference to FIGS. 4A and 8A. In FIG. 4A, the control unit 33 first determines whether the virtual image has entered a predetermined display distance region (within a short distance) (step ST191a). Here, the predetermined display distance region (within a short distance) refers to, for example, a range region from the display position threshold Th to the host vehicle 1 displayed on the near side of the screen when the display position of the virtual image (no entry mark) moves from the far side of the screen through the display position threshold Th to the near side of the screen, as shown by hatching in FIGS. 7A and 7B. The "display position threshold Th" is the boundary position between the far side of the screen and the near side of the screen, where visual appeal control (for example, control to reduce the visual appeal of the virtual image) is required to prevent unwanted visual appeal.
[0079] If movement of the virtual image within a predetermined display area (within a short distance) is confirmed in step ST1931a ("YES" in step ST1931a), the control unit 33 performs control to reduce the visual appeal by, for example, erasing the virtual image or gradually increasing the transmittance near the short distance to make the virtual image transparent, as shown in the conceptual operation diagram of FIG. 8A (step ST1932a). Here, the control to reduce the visual appeal refers to, for example, lowering the visual appeal level from 9 to 4 at the depth of the screen to 3 to 0. Note that, in step ST1932a, control to reduce the visual appeal may be performed by fading out the virtual image. On the other hand, if movement of the virtual image within a predetermined display distance area (within a short distance) is not confirmed ("NO" in step ST1931a), the control unit 33 performs control to maintain the visual appeal of the virtual image at the same level as that of the virtual image located at the depth of the screen, for example, at a level of 9 to 4 (step ST1933a).
[0080] In this way, when the virtual image moves within a specified display distance range (within a short distance), the control unit 33 controls the transmittance to eliminate (transmit) the virtual image, or gradually transmit it near a short distance, or fade it out to reduce its conspicuousness, so that the virtual image becomes inconspicuous even when moving at high speed within the field of view within a short distance, and unnecessary attention is no longer generated, thereby reducing the possibility of it impeding safe driving.
[0081] Next, "Control 2 for reducing the visual appeal of a virtual image" will be described with reference to Fig. 4B and Fig. 8B. In Fig. 4B, the control unit 33 first determines whether the virtual image has moved within a predetermined display distance range (within a short distance) (step ST1931b). If it is confirmed that the virtual image has moved within the predetermined display distance range (within a short distance) (step ST1931b "YES"), the control unit 33 performs control to reduce the visual appeal of the virtual image (virtual image 3) by changing the color of the virtual image to the same color as a specific object to be superimposed, such as another vehicle 2, as shown in Fig. 8B (step ST192b). On the other hand, if movement of the virtual image (virtual image 3) into the specified display distance range (within close distance) is not confirmed (step ST1931 "NO"), the control unit 33 performs control to maintain the visibility of the virtual image (virtual image 3) by displaying the virtual image (virtual image 3) in the same color as other vehicles 2, for example, a color that expresses a warning, as in the case where the virtual image (virtual image 3) is located at the back of the screen (step ST1933b).
[0082] In this way, when the virtual image (virtual image 3) moves outside the specified display distance (within a short distance), the control unit 33 can make the virtual image less noticeable by, for example, changing the virtual image 3, which was displayed in red for warning purposes, to the same color as the color of the superimposed object in the field of view, such as another vehicle 2 or a pedestrian, and as a result, unnecessary attention is not generated, thereby reducing the possibility of obstructing safe driving.
[0083] Next, "Control 3 for reducing the visual appeal of a virtual image" will be described with reference to FIGS. 4C and 8C. In FIG. 4C, the control unit 33 first determines whether the virtual image has moved to a location within a predetermined display distance range (short distance) (step ST1931c). If the movement of the virtual image to a location within the predetermined display distance range (short distance) is confirmed (step ST1931c "YES"), the control unit 33 performs control to reduce the visual appeal of the virtual image by gradually reducing the size of the virtual image indicating "No Entry" from its normal size, as shown in FIG. 8C (step ST1932c). Next, the control unit 33 determines whether the virtual image has moved to a predetermined display distance range (short distance) (step ST1933c). If the movement of the virtual image to a location within the predetermined display distance range (short distance) is confirmed (step ST1933c "YES"), the control unit 33 performs control to reduce the visual appeal of the virtual image by minimizing its size (step ST194c). In addition, if it is not confirmed in steps ST1931c and ST1933c that the virtual image has moved to a location within the specified display distance range (within a short distance) (steps ST1931c "NO", ST1933c "NO"), in either case, the virtual image is displayed at a normal size, and control is performed to maintain its visibility at the back of the screen (step ST195c).
[0084] In this way, when the virtual image moves within a predetermined display distance range (within a short distance), the control unit 33 can reduce the conspicuousness of the virtual image by gradually shrinking the virtual image or displaying it at the minimum size, thereby making the virtual image less noticeable and, as a result, reducing the possibility of it hindering safe driving without causing unnecessary attention.
[0085] Next, "Control 4 for reducing the visual appeal of a virtual image" will be described with reference to FIGS. 4D and 8D. In FIG. 4D, the control unit 33 first determines whether the virtual image at the back of the screen is emphasized (step ST1931d). In FIG. 8D, an example is shown in which the advertising text "SALE" is emphasized by adding a three-dimensional effect, contours, and color. If the virtual image is emphasized as shown in FIG. 8D (step ST1931d "YES"), the control unit 33 determines whether the virtual image is within a predetermined display distance range (within a short distance) or has moved near the display area (step ST1932d).
[0086] If it is confirmed that the virtual image has moved to the vicinity within the predetermined display distance range (within the short distance) (step ST1932d "YES"), the control unit 33 cancels the emphasis control by, for example, removing the stereoscopic effect, contour lines, or color from the virtual image located at the back of the screen that has been emphasized, as shown in FIG. 8D, or performs control to weaken the emphasis control level according to the distance from the vehicle (step ST1933d). If it is determined in step ST1931d that the virtual image is not emphasized (step ST1931d "NO"), the control unit 33 displays the virtual image located at the back of the screen that has not been emphasized (step ST1935d). If it is determined in step ST1932d that the virtual image has not moved to the vicinity within the predetermined display distance range (within the short distance) (step ST1932d "NO"), the control unit 33 displays the virtual image that has been emphasized (step ST1934).
[0087] In this way, when the virtual image is within the display distance range (within a short distance) or in its vicinity, for example, if an advertisement superimposed on a building is subjected to emphasis control such as three-dimensional expression, the eye-catching effect can be reduced by weakening or eliminating the emphasis depending on the distance from the vehicle, which makes the virtual image less noticeable and, as a result, reduces the possibility of obstructing safe driving without generating unnecessary eye-catching effects.
[0088] Next, "Control 5 for reducing the visual appeal of a virtual image" will be described with reference to FIGS. 4E and 8E. In FIG. 4E, the control unit 33 first determines whether or not a virtual image located far away (at a long distance) is rendered with AR representation including animation (moving image) (step ST1931e). FIG. 8E (a) shows a virtual image rendered with AR representation, to which animation (a cylinder moving up and down) surrounding a pedestrian is added. Here, if it is determined that the virtual image is rendered with AR representation including animation (step ST1931e "YES"), the control unit 33 further determines whether or not the virtual image has moved within a predetermined display distance region (within a short distance) (step ST1932e).
[0089] In step ST1932e, if it is confirmed that the virtual image including the animation has moved within a predetermined display distance range (within a short distance) (step ST1932e “YES”), the control unit 33 stops the animation and displays a still virtual image (see FIG. 8E (b)) superimposed on a specific target on the display unit 32, as shown in FIG. 8E (b) (step ST1933e). On the other hand, if it is confirmed that the virtual image has not moved within the predetermined display distance range (within a short distance) (step ST1932e “NO”), a virtual image (see FIG. 8E (a)) with an AR representation using animation surrounding a pedestrian is displayed superimposed on a specific target on the display unit 32, as in the case where the virtual image is located on the near side of the screen (step ST1934e). In addition, if it is determined in step ST1931e that the virtual image at the back of the screen is not an AR representation including a moving image (step ST1931e "NO"), the control unit 33 displays a still virtual image on the display unit 32 (step ST1935e).
[0090] In this way, for example, if there is a virtual image with a moving image (animation) to emphasize the presence of a pedestrian within the vehicle's forward field of view, the animation can be stopped within a specified display distance range (within close range) and a still virtual image can be displayed, making the virtual image less noticeable.As a result, unnecessary attention is not generated, and the possibility of it hindering safe driving can be reduced.
[0091] Next, "Control 6 for reducing the visual appeal of a virtual image" will be described with reference to FIGS. 4F and 8F. In FIG. 4F, the control unit 33 first determines whether a virtual image with AR rendering is displayed at the back of the screen (step ST1931f). FIG. 8F (a) shows an example of a virtual image with AR rendering of a pedestrian running on a road. If it is determined that a virtual image with AR rendering is displayed at the back of the screen (step ST1931f "YES"), the control unit 33 further determines whether the virtual image has moved within a predetermined distance range (within a short distance) (step ST1932f). If it is confirmed that the virtual image with AR rendering has moved within a predetermined display distance range (within a short distance) (step ST1932f "YES"), the control unit 33 cancels the AR rendering and displays the virtual image in a form that does not depend on the position of a specific object, such as an icon, to reduce the visual appeal (step ST1933f), as shown in FIG. 8F (b). On the other hand, if it is determined that the virtual image with AR rendering is not at the back of the screen (ST1932f "NO"), the control unit 33 displays the virtual image with AR rendering (step ST1934f), for example, as shown in (a) of Fig. 8F. Note that if a virtual image without AR rendering is displayed at the back of the screen in step ST1931f (step ST1931f "NO"), a normal virtual image without AR rendering is displayed (step ST1935F), as in the case where the virtual image is located at the back of the screen.
[0092] In this way, for example, if a pedestrian running on a sidewalk with AR representation is ahead and the virtual image moves within a specified display distance range (within a short distance), the AR representation is canceled and replaced with a static icon or the like, and displayed in a form that is not dependent on the position of a specific object, making the virtual image less noticeable.As a result, unnecessary attention is not generated, and the possibility of it hindering safe driving is reduced.
[0093] Note that the flowcharts shown in Figures 2, 3, and 4A to 4F do not limit the present invention to the processing procedures shown in the flowcharts, and steps may be added, deleted, or the order may be changed within the scope that does not deviate from the gist and technical concept of the invention.
[0094] (Effects of the Example) As described above, the display control device of this embodiment is a display control device 30 having a control unit 33 that controls a display unit 32 that displays a virtual image generated by augmented reality (e.g., see the host vehicle 1 in FIG. 5 ) superimposed on a specific object in the forward field of view of the vehicle (e.g., other vehicles traveling ahead of the vehicle, pedestrians crossing the road, structures such as buildings and traffic signs, advertisements, and the scenery ahead of the vehicle that changes as the vehicle moves), as shown in FIG. 1 . In the display control device 30, the control unit 33 controls the conspicuousness of the virtual image based on the acquired vehicle speed or the speed limit of the road on which the vehicle is traveling. In this case, the conspicuousness of the virtual image is controlled by the control unit 33 if, as the display position of the virtual image moves from the rear side of the screen of the display unit 34 through the display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance region (e.g., see (a) or (b) of FIG. 7 ) that is less than the display position threshold Th on the front side of the screen.
[0095] According to the display control device 30 of this embodiment, by controlling the conspicuity of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling, for example, when the vehicle speed or the speed limit is equal to or greater than a speed threshold, the conspicuity of the AR image within the display distance area (within a short distance) is reduced to make it less noticeable, thereby providing a display control device that does not generate unnecessary distractions and does not hinder safe driving.
[0096] Furthermore, in the display control device 30 of this embodiment, if the vehicle speed or speed limit is less than the speed threshold, the control unit 33 controls the visual appeal of a virtual image whose display position is located within a predetermined display distance region or whose display position moves from the display position threshold toward the front side of the screen within the predetermined display distance region to be the same as the visual appeal of a virtual image whose display position is located outside the predetermined display distance region or whose display position moves from the back side of the screen outside the predetermined display distance region to the display position threshold.On the other hand, if the vehicle speed or speed limit is equal to or greater than the speed threshold, the control unit 33 controls the visual appeal of a virtual image whose display position moves from the display position threshold toward the front side of the screen within the predetermined display distance region to be reduced compared to the visual appeal of a virtual image whose display position is located outside the predetermined display distance region or whose display position moves from the front side of the screen outside the predetermined display distance region to the display position. In this way, when the vehicle speed or speed limit is equal to or greater than the speed threshold, the conspicuousness of a virtual image whose display position moves from the display position threshold Th (see, for example, (b) of Figure 7) within a specified display distance range toward the front of the screen is reduced compared to the conspicuousness of a virtual image whose display position is located outside the specified display distance range (toward the back of the screen) or moves outside the specified display range from the front of the screen to the display position.This reduces the conspicuousness of a virtual image that moves at high speed within the field of view within the specified display distance range (within a short distance), making it less noticeable, thereby contributing to safe driving.
[0097] Furthermore, in the display control device 30 of this embodiment, if the vehicle speed or speed limit is equal to or greater than a speed threshold, the control unit 33 sets the display position threshold Th so that the higher the vehicle speed or speed limit, the closer the display position threshold Th is to the rear of the screen (display position threshold Th1), as shown in FIG. 5 . If the vehicle speed or speed limit is less than the speed threshold, the control unit 33 sets the display position threshold Th so that the lower the vehicle speed or speed limit, the closer the display position threshold Th is to the front of the screen (display position threshold Th2). For example, when driving at high speeds such as on a highway, the occupant (driver) focuses on the distance (the rear of the screen) and information within the short distance becomes unnecessary, so unnecessary attention is avoided early by reducing conspicuity from a distance. On the other hand, when driving at low speeds such as in urban areas, the occupant often focuses on the short distance around the vehicle 1, so conspicuity is maintained up to a short distance. In this way, it is possible to present optimal information according to the driving situation while reducing conspicuity within the short distance (within a predetermined display distance range).
[0098] Furthermore, in the display control device 30 of this embodiment, the control unit 33 changes the display distance range depending on the specific object on which the virtual image is superimposed. Therefore, for example, as shown in FIG. 6, the display distance range for reducing the visual appeal is set to, for example, up to x [m] (display position threshold is Th') when the specific object to be superimposed is a pedestrian or other object requiring careful driving; for example, up to x+A [m] (display position threshold is Th') when the specific object is related to driving operations such as a no entry traffic sign; and for example, up to x+A+B [m] (display position threshold is Th) when the specific object is not related to driving operations such as an advertisement. In this way, by changing the display distance (second display distance) within a short distance for reducing the visual appeal depending on the specific object in the forward field of view to be superimposed, flexible information presentation according to the driving scene can be achieved while reducing the visual appeal at short distances.
[0099] Furthermore, according to the display control device 30 of this embodiment, when a virtual image moves within a predetermined display distance range (within a short distance), the control unit 33 performs control to reduce the visual appeal by either transmitting or fading out the virtual image. In this way, when a virtual image moves within a predetermined display distance range (within a short distance), the transmittance is controlled to eliminate (transmit) the virtual image, or to gradually transmit the virtual image in the vicinity or to fade out the image to reduce the visual appeal. This makes the virtual image less noticeable even when it moves at high speed within the field of view at a short distance, and therefore reduces the possibility of impeding safe driving.
[0100] Furthermore, according to the display control device 30 of this embodiment, when a virtual image moves within a predetermined display distance range (within a short distance), the control unit 33 performs control to make the color of the virtual image the same as the color of a specific object to reduce its conspicuousness. In this way, when a virtual image moves within a predetermined display distance range (within a short distance), for example, the virtual image that was displayed in red for warning purposes can be made less conspicuous by changing the color to the color of a superimposed object in the field of view, such as another vehicle or pedestrian. As a result, unnecessary attention is not generated, and the possibility of obstructing safe driving can be reduced.
[0101] Furthermore, according to the display control device 30 of this embodiment, when the virtual image moves within a predetermined display distance range (within a short distance), the control unit 33 performs control to reduce the visual appeal by shrinking the virtual image or gradually shrinking it from near the second display distance, thereby making the virtual image less noticeable, and as a result, the possibility of obstructing safe driving can be reduced without generating unnecessary visual appeal.
[0102] Furthermore, according to the display control device 30 of this embodiment, when an emphasis process has been applied to a virtual image that has moved within a predetermined display distance area (within a short distance) or in its vicinity, the control unit 33 performs control to weaken or disable the emphasis process depending on the distance from the vehicle, thereby reducing the visual appeal, making the virtual image less noticeable. As a result, unnecessary attention is not generated, and the possibility of obstructing safe driving can be reduced.
[0103] Furthermore, according to the display control device 30 of this embodiment, when a virtual image that has moved within a predetermined display distance range (within a short distance) or its vicinity has a moving image that emphasizes the virtual image, the control unit 33 performs control to stop the moving image and reduce its visual appeal. As a result, for example, if there is a virtual image with an animation (moving image) that emphasizes the presence of a pedestrian in the forward field of view, the virtual image becomes less noticeable by superimposing an image without animation at a second display distance (short distance) or in the vicinity of the second display distance (near a short distance). As a result, unnecessary visual appeal is not generated, and the possibility of impeding safe driving can be reduced.
[0104] Furthermore, according to the display control device 30 of this embodiment, when the virtual image moves within a predetermined display distance range (within a short distance), the control unit 33 cancels the superimposition of the virtual image on a specific object and displays the virtual image in a form that is independent of the position of the specific object, thereby reducing the visual appeal. In this way, for example, when a pedestrian represented by a virtual image is present in the forward field of view and moves within a second display distance (within a short distance), the superimposed display is stopped and the virtual image is displayed in a form that is independent of the position of the superimposed object, such as a static icon, making the virtual image less noticeable. As a result, unnecessary visual appeal is not generated, and the possibility of impeding safe driving can be reduced.
[0105] The display control method of this embodiment is a display control method for controlling a display unit 32 that displays a virtual image generated by augmented reality by superimposing it on a specific object in the forward field of view of the vehicle, as shown in Fig. 1. The display control method includes a step (ST14) in which a control unit 33 acquires the vehicle speed or the speed limit of the road on which the vehicle is traveling, as shown in Fig. 2, and a step (ST19) in which the control unit 33 controls the conspicuity of the virtual image based on the acquired vehicle speed or the speed limit of the road on which the vehicle is traveling. In this case, the condition for controlling the conspicuity of the virtual image by the control unit 33 is that, when the display position of the virtual image moves from the depth of the screen of the display unit 32 through a display threshold Th (see, for example, (b) of Fig. 7) toward the front side of the screen as the vehicle moves forward (ST16, ST17), the display position of the virtual image is located within a predetermined display distance region that is less than the display position threshold Th on the front side of the screen (ST18).
[0106] According to the display control method of this embodiment, the control unit 33 controls the visual appeal of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling. For example, when the vehicle speed is equal to or greater than a speed threshold, the visual appeal of the AR image within the display distance area (within a short distance) is reduced to make it less noticeable, thereby providing a display control method that does not generate unnecessary visual appeal and does not impede safe driving.
[0107] The program of this embodiment is, for example, a program for a display control device 30 having a control unit 33 that controls a display unit 32 that displays a virtual image generated by augmented reality superimposed on a specific object in the vehicle's forward field of view, as shown in FIG. 1. The program includes, in a processor of the control unit 33, a process (ST14) for acquiring the vehicle speed or the speed limit of the road on which the vehicle is traveling, and a process (ST19) for the control unit 33 to control the visual appeal of the virtual image based on the acquired vehicle speed or the speed limit of the road on which the vehicle is traveling. In this case, the visual appeal of the virtual image is controlled by the control unit 33 when, as the display position of the virtual image moves from the rear side of the screen of the display unit 32 through a display threshold Th (see, for example, FIG. 7(b)) toward the front side of the screen as the vehicle moves forward (ST16, ST17), the display position of the virtual image is located within a predetermined display distance region that is less than the display position threshold Th on the front side of the screen (ST18).
[0108] According to the program of this embodiment, the processor of the control unit 33 reads and executes the program recorded in the memory, thereby controlling the conspicuity of the virtual image based on the vehicle speed or the speed limit of the road on which the vehicle is traveling. For example, when the vehicle speed is equal to or greater than a speed threshold, the conspicuity of the AR image within the display distance area (within a short distance) is reduced to make it less noticeable, thereby providing a program that does not generate unnecessary attention and does not hinder safe driving.
[0109] 1, the vehicular display system of this embodiment is a vehicular display system 110 including an imaging device 10 that captures an image of the forward field of view of the vehicle, a vehicle ECU (not shown), and a display control device 30 that controls a display device (display unit 32) that displays a virtual image generated by augmented reality superimposed on a specific object in the forward field of view of the vehicle. In the vehicular display system 110, the display control device 30 has a control unit 33 that controls the conspicuousness of the virtual image based on the vehicle speed acquired via the vehicle ECU or the speed limit of the road on which the vehicle is traveling acquired from the imaging device 10 or map information. In this case, the conspicuousness of the virtual image is controlled by the control unit if, as the display position of the virtual image moves from the rear side of the screen of the display device (display unit 32) through the display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance region that is less than a display position threshold Th (see, for example, (b) of FIG. 7) on the front side of the screen.
[0110] According to the vehicle display system 110 of this embodiment, the display control device 30 controls the conspicuity of the virtual image based on the acquired vehicle speed or the speed limit of the road on which the vehicle is traveling, thereby reducing the conspicuity of the AR image within a specified display distance area (within a short distance) and making it less noticeable when the vehicle speed is equal to or greater than a speed threshold, thereby providing a vehicle display system 110 that does not generate unnecessary distractions and does not hinder safe driving.
[0111] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims. [Explanation of symbols]
[0112] 1 Vehicle (own vehicle), 2 Other vehicles, 3 Virtual image, 10 Imaging unit (imaging device, forward object detection unit), 20 Vehicle speed measurement unit, 30 Display control device, 31 Information acquisition unit, 32 Display unit (display device), 33 Control unit, 40 CAN, 110 Vehicle display system
Claims
1. A display control device having a control unit that controls a display unit that displays a virtual image generated by augmented reality superimposed on a specific object in a forward field of view of a vehicle, The control unit controlling the conspicuousness of the virtual image based on the acquired vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling; The condition under which the conspicuousness of the virtual image is controlled by the control unit is that when the display position of the virtual image moves from the back side of the screen of the display unit through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
2. The control unit If the vehicle speed or the speed limit is less than a speed threshold, the conspicuousness of the virtual image when the display position of the virtual image is located within the predetermined display distance area or when the virtual image moves within the predetermined display distance area from the display position threshold toward the front side of the screen is set to be the same as the conspicuousness of the virtual image when the display position of the virtual image is located outside the predetermined display distance area or when the virtual image moves outside the predetermined display distance area from the back side of the screen to the display position threshold, 2. The display control device according to claim 1, wherein, when the vehicle speed or the speed limit is equal to or greater than the speed threshold, the visual appeal of the virtual image whose display position moves from the display position threshold toward the front side of the screen within the specified display distance area is reduced compared to the visual appeal of the virtual image whose display position is located outside the specified display distance area or moves outside the specified display area from the front side of the screen to the display position.
3. The control unit If the vehicle speed or the speed limit is equal to or greater than the speed threshold, the display position threshold is set so as to move closer to the depth of the screen as the vehicle speed or the speed limit increases; The display control device according to claim 1 , wherein, if the vehicle speed or the speed limit is less than a speed threshold, the display position threshold is set so as to move closer to the front side of the screen as the vehicle speed or the speed limit decreases.
4. The control unit The display control device according to claim 1 , wherein the predetermined display distance area is changed depending on the specific object on which the virtual image is superimposed.
5. The control unit 3. The display control device according to claim 2, wherein when the display position of the virtual image is located within the specified display distance area or moves within the specified display distance area from the display position threshold toward the front side of the screen, the display control device performs control to reduce the visibility by making the virtual image transparent or fading out.
6. The control unit 3. The display control device according to claim 2, wherein when the display position of the virtual image is located within the specified display distance area or moves within the specified display distance area from the display position threshold toward the front side of the screen, the color of the virtual image is made the same color as the color of the virtual image to reduce the eye-catching nature.
7. The control unit 3. The display control device of claim 2, wherein when the display position of the virtual image is located within the specified display distance area or moves within the specified display distance area from the display position threshold toward the front of the screen, the virtual image is reduced in size or gradually reduced from near the second display distance, thereby reducing the visual appeal.
8. The control unit 3. The display control device according to claim 2, wherein, when the display position of the virtual image moves from a vicinity within the predetermined display distance area toward the front side of the screen, if an emphasis process has been applied to the virtual image, the emphasis process is weakened or disabled depending on the distance from the vehicle to reduce the eye-catching effect.
9. The control unit 3. The display control device according to claim 2, wherein when the display position of the virtual image moves from a vicinity within the specified display distance area toward the front side of the screen, if a video that emphasizes the virtual image is included, the video is stopped to reduce the visual appeal.
10. The control unit 3. The display control device according to claim 2, wherein when the display position of the virtual image moves within the specified display distance area from the display position threshold toward the front side of the screen, the superimposition of the virtual image and the specific object is canceled, and the virtual image is displayed in a form that is independent of the position of the specific object, thereby reducing the visual appeal.
11. A display control method for controlling a display unit that displays a virtual image generated by augmented reality superimposed on a specific object in a forward field of view of a vehicle, comprising: a step in which a control unit acquires a vehicle speed of the vehicle or a speed limit of a road on which the vehicle is traveling; The control unit and controlling the conspicuousness of the virtual image based on the acquired vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling, A display control method in which the condition under which the conspicuousness of the virtual image is controlled by the control unit is that when the display position of the virtual image moves from the back side of the screen of the display unit through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
12. A program for a display control device having a control unit that controls a display unit that displays a virtual image generated by augmented reality superimposed on a specific object in a forward field of view of a vehicle, A processor included in the control unit A process of acquiring a vehicle speed of the vehicle or a speed limit of a road on which the vehicle is traveling; and executing a process of controlling the conspicuousness of the virtual image based on the acquired vehicle speed of the vehicle or the speed limit of the road on which the vehicle is traveling; The condition under which the conspicuousness of the virtual image is controlled by the control unit is that, when the display position of the virtual image moves from the back side of the screen of the display unit through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen.
13. A vehicle display system comprising an imaging device that captures an image of a forward field of view of a vehicle, a vehicle ECU, and a display control device that controls a display device that displays a virtual image generated by augmented reality by superimposing it on a specific object in the forward field of view of the vehicle, The display control device a control unit that controls the conspicuousness of the virtual image based on the vehicle speed of the vehicle acquired via the vehicle ECU or the speed limit of the road on which the vehicle is traveling acquired from the imaging device or map information, The condition for controlling the visual appeal of the virtual image by the control unit is that, as the display position of the virtual image moves from the back side of the screen of the display device through a display threshold toward the front side of the screen as the vehicle moves forward, the display position of the virtual image is located within a predetermined display distance area that is less than the display position threshold on the front side of the screen, in this vehicle display system.
Citation Information
Patent Citations
Head-up display device
JP2019113809A