Virtual image display device and display system

Abstract

The HUD (100) is a virtual image display device that displays a virtual image (Vi) that can be visually recognized by a driver of the vehicle (A). The HUD (100) switches the position of the angle of view (VA) at which the virtual image (Vi) is displayed, among a plurality of positions including a normal position (VP1) and an overlapping position (VP2), by an actuator. The HUD (100) displays the virtual image (Vi) associated with the normal position (VP1) and the overlapping position (VP2), respectively, in accordance with the switching of the position of the angle of view (VA) based on the actuator. Furthermore, in a case where, after the angle of view (VA) is moved from the normal position (VP1) to the overlapping position (VP2), a specific content (CTis) is displayed within the angle of view at the overlapping position (VP2), the HUD (100) starts the display of an associated content (CTr) that is preliminarily associated with the specific content (CTis) before the movement of the angle of view (VA) to the overlapping position (VP2) is completed.

Description

[0001] Cross-references to related applications

[0002] This application is based on Japanese Patent Application No. 2020-174732, filed in Japan on October 16, 2020, and Japanese Patent Application No. 2021-150313, filed in Japan on September 15, 2021, by reference to the contents of the application on which the reference is made in its entirety. Technical Field

[0003] Based on the disclosure of this specification, therein relates to a virtual image display device and a display system that displays a virtual image that can be visually recognized by the occupants of a vehicle. Background Technology

[0004] Patent Document 1 discloses a head-up display device that includes an adjustment mechanism that mechanically moves the projection range of light on a display image projected as a virtual image. As a scene adaptation control, the head-up display device moves the position of the projection range via the adjustment mechanism to display the entirety of objects with high display priority.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-189139

[0006] In structures like those in Patent Document 1 that include a mechanism to move the viewing angle of the displayed virtual image, the mechanical movement of the viewing angle requires time. Therefore, when processing to display specific content within the moved viewing angle is performed after the viewpoint movement is complete, a time lag occurs before the display begins due to the viewpoint movement. If this time lag is perceived by vehicle occupants, even if the viewing angle capable of displaying the virtual image can be expanded, the occupants may experience a sense of unease. Consequently, there is a risk of damaging the virtual image display device. Summary of the Invention

[0007] The purpose of this disclosure is to provide a virtual image display device and display system that can improve convenience.

[0008] To achieve the above objective, one disclosed method is a virtual image display device that displays a virtual image that can be visually recognized by vehicle occupants, comprising: a switching mechanism that switches the position of the viewing angle for displaying the virtual image between multiple positions, including a first position and a second position; and a display control unit that displays virtual images associated with the first position and the second position respectively based on the switching of the viewing angle position by the switching mechanism, wherein if, after the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is completed.

[0009] In this method, associated content, pre-established with specific content, is displayed before the viewpoint has moved from the first position to the second position. Therefore, the time lag before the display begins, caused by the viewpoint movement based on the switching mechanism, is difficult for vehicle occupants to perceive. Thus, even with a switching mechanism to expand the viewing angle capable of displaying the virtual image, display incongruity is reduced. Consequently, the convenience of the virtual image display device is improved.

[0010] Furthermore, the reference numbers in parentheses in the claims are merely one example of the correspondence with the specific structures in the embodiments described later, and do not limit the scope of the technology. Attached Figure Description

[0011] Figure 1 This is a diagram illustrating the virtual image display function of the HUD according to the first embodiment of this disclosure.

[0012] Figure 2 It is a block diagram representing the electrical structure of the display system.

[0013] Figure 3 This is a diagram representing an example of a checklist.

[0014] Figure 4 This is a diagram showing the detailed changes in the displayed content when the viewpoint position is moved.

[0015] Figure 5 This is a diagram showing an example of the display in the typical location when a lane departure warning is being implemented.

[0016] Figure 6 This is an example of a display shown during a viewpoint movement from the normal position to the overlapping position when a lane departure warning is being implemented.

[0017] Figure 7 This is a diagram showing an example of the overlapping position displayed when a lane departure warning is implemented.

[0018] Figure 8 This is another example of the display during viewpoint movement when a lane departure warning is in effect.

[0019] Figure 9 This is another example of a diagram showing the overlapping position when a lane departure warning is implemented.

[0020] Figure 10 This is another example of the display during viewpoint movement when a lane departure warning is in effect.

[0021] Figure 11This is a diagram showing an example of a display in a typical location indicating a change in the status of the workshop's maintenance control.

[0022] Figure 12 This is a diagram illustrating an example of a viewpoint movement from a normal position to an overlapping position during a change in the state of notification to maintain control of the workshop.

[0023] Figure 13 This is a diagram illustrating an example of an overlapping display indicating a change in the status of the workshop's control measures.

[0024] Figure 14 This is another example of a display during a viewpoint movement that indicates a change in the status of the workshop's control.

[0025] Figure 15 This is another example of a diagram showing an overlapping position in a situation where the workshop is notified of a change in the state of control.

[0026] Figure 16 This is another example of a display during a viewpoint movement that indicates a change in the status of the workshop's control.

[0027] Figure 17 This is another example of a diagram showing an overlapping position in a situation where the workshop is notified of a change in the state of control.

[0028] Figure 18 This is another example of a display during a viewpoint movement that indicates a change in the status of the workshop's control.

[0029] Figure 19 This is another example of a diagram showing an overlapping position in a situation where the workshop is notified of a change in the state of control.

[0030] Figure 20 This is an example of a display showing the typical location of a turn-by-turn prompt for route guidance.

[0031] Figure 21 This is an example of the display shown during a turn prompt, indicating a movement of the view from the normal position to the overlapping position.

[0032] Figure 22 This is an example diagram showing the display of overlapping turn prompts.

[0033] Figure 23 This is another example of a diagram showing the overlapping position of a turn indicator.

[0034] Figure 24This is another example of a diagram showing the overlapping position of a turn indicator.

[0035] Figure 25 This is another example of a diagram showing the overlapping position of a turn indicator.

[0036] Figure 26 This is an example of a sign recognition aid display when the viewpoint is in a normal position.

[0037] Figure 27 This is an example of a sign recognition aid display after the viewpoint is moved to an overlapping position.

[0038] Figure 28 This is an example of a sign recognition aid display after the viewpoint returns to its normal position.

[0039] Figure 29 This is another example of a sign recognition aid display after the viewpoint has moved to an overlapping position.

[0040] Figure 30 This is another example of a sign recognition aid display after the viewpoint has moved to an overlapping position.

[0041] Figure 31 This is another example of a sign recognition aid display after the viewpoint has moved to an overlapping position.

[0042] Figure 32 This is a flowchart showing the details of the display control processing implemented by the head-up ECU.

[0043] Figure 33 It is a flowchart showing the detailed content of the display control processing implemented by the instrument ECU.

[0044] Figure 34 This is a block diagram showing the electrical structure of the display system according to the second embodiment.

[0045] Figure 35 This is a diagram illustrating an example of the viewing positions defined by the HUD of the second embodiment and the content displayed at each viewing position.

[0046] Figure 36 This is a block diagram showing the electrical structure of the display system according to the second embodiment.

[0047] Figure 37 This is an example of a display shown during a viewpoint movement from a normal position to an overlapping position when a forward target warning is being implemented.

[0048] Figure 38 This is a diagram showing an example of an overlapping display when a forward landmark warning is in effect.

[0049] Figure 39 This is a diagram showing an example of a typical location where parking space guidance is implemented.

[0050] Figure 40 This is a diagram illustrating an example of a viewpoint movement from a normal position to an overlapping position during the implementation of parking space guidance.

[0051] Figure 41 This is a diagram illustrating an example of an overlapping display when parking space guidance is implemented.

[0052] Figure 42 This is a diagram illustrating an example of a viewpoint movement from an overlapping position to a normal position during the implementation of parking space guidance.

[0053] Figure 43 This diagram shows an example of the display in its normal position when a narrow-road driving assistance display is implemented.

[0054] Figure 44 This is a diagram illustrating an example of the display during a viewpoint shift from the normal position to an overlapping position when a narrow-road driving assistance display is implemented.

[0055] Figure 45 This diagram shows an example of the display at the overlapping position when a narrow road driving assistance display is implemented.

[0056] Figure 46 This is an example of a narrow-road driving assistance display after the viewpoint is returned to its normal position.

[0057] Figure 47 This is a diagram illustrating an example of a display in a typical position when a vision-aiding display is implemented.

[0058] Figure 48 This is a diagram illustrating an example of the display during a viewpoint movement from a normal position to an overlapping position when a view-assisted display is implemented.

[0059] Figure 49 This is a diagram illustrating an example of a display at an overlapping position when a vision-assisted display is implemented.

[0060] Figure 50 This is a diagram illustrating an example of the display during a viewpoint movement from an overlapping position to a normal position when a view-assisted display is implemented. Detailed Implementation

[0061] Hereinafter, several embodiments of the present disclosure will be described based on the accompanying drawings. Furthermore, corresponding components in each embodiment will be labeled with the same reference numerals, thus sometimes omitting repeated descriptions. Where only a portion of the structure is described in each embodiment, the structures of other previously described embodiments can be applied to the other parts of that structure. In addition, not only combinations of structures explicitly shown in the descriptions of each embodiment, but also structures of multiple embodiments can be partially combined with each other, even without explicit description, as long as it does not particularly hinder the combination. Moreover, un-explicit combinations of structures described in multiple embodiments and variations are also disclosed in the following description.

[0062] (First Implementation)

[0063] The virtual image display device of the first embodiment of this disclosure is functionally installed in Figure 1 as well as Figure 2 The head-up display (hereinafter, HUD) 100 is shown. The HUD 100, together with the instrument display device 30, constitutes the display system 110. The display system 110 is used in the vehicle A to coordinate the virtual image display based on the HUD 100 and the screen display based on the instrument display device 30, thereby providing the driver with various information related to the vehicle A.

[0064] The HUD100 and instrument display device 30 are communicatively connected to the communication bus of the vehicle network installed in vehicle A. Other vehicle ECUs, such as the camera ECU (Electronic Control Unit) 21, navigation ECU 22, and driver assistance ECU 23, are also connected to the communication bus of the vehicle network. These structures, acting as nodes connected to the communication bus, can communicate with each other. Specific nodes among these ECUs can also be directly electrically connected to each other, enabling communication without using the communication bus 99.

[0065] Camera ECU 21 is a processing unit including a processor, RAM, and storage, electrically connected to one or more onboard cameras mounted on vehicle A. Image data of the vehicle's surroundings captured by the onboard cameras is input to Camera ECU 21. Camera ECU 21 analyzes images captured by the onboard camera (hereinafter, the front camera) in front of vehicle A and detects the vehicle Af ahead (refer to...). Figure 10 The distance up to, the left and right markings Lml and Lmr of this vehicle (refer to) Figure 7 The relative position of the vehicle and the road sign RS in front of the vehicle (refer to) Figure 26The camera ECU 21 provides the driver assistance ECU 23 with the detection information of the vehicle ahead (Af) and the lane markings (Lml, Lmr). The camera ECU 21 also provides the HUD 100 and the instrument display device 30 with the recognition information of the road sign (RS) identified by the Traffic Sign Recognition function.

[0066] The navigation ECU 22 is a processing device with a processor, RAM, and storage, which implements route guidance up to the destination set by the occupant. During route guidance, if the navigation ECU 22 approaches a guidance area that guides straight ahead, left or right turns, branching off, or merging, it provides path information about that guidance area to the HUD 100 and the instrument display device 30.

[0067] The driver assistance ECU 23 is a processing unit with a processor, RAM, and storage, which implements multiple assistance functions to assist the driver of vehicle A. As an example, the driver assistance ECU 23 has driver assistance functions such as LDW (Lane Departure Warning) and ACC (Adaptive Cruise Control).

[0068] The driver assistance ECU 23, through the LDW function, determines whether the vehicle has left its lane based on the detection information of lane markings Lml and Lmr obtained from the camera ECU 21. Upon determining that the vehicle has left its lane, the driver assistance ECU 23 provides lane departure information to the HUD 100 and the instrument display device 30, and issues a lane departure warning to the driver.

[0069] The driver assistance ECU 23, through the ACC function, maintains a safe distance from the vehicle ahead (Af) based on whether vehicle A is traveling at a target speed or based on detection information of the vehicle ahead (Af) obtained from the camera ECU 21, and ensures that vehicle A follows the vehicle ahead (Af). When the ACC function is activated, the driver assistance ECU 23 provides status information indicating the control status of the ACC function to the HUD 100 and the instrument display device 30.

[0070] Next, the detailed structure of the instrument display device 30 and HUD100 will be explained in turn.

[0071] The instrument display device 30 is one of several display devices mounted in vehicle A, providing information to the driver by displaying images on the screen. The instrument display device 30 has a structure similar to a combination instrument cluster, with the display screen facing the driver's seat, and is housed in the instrument panel 9. As an example, the instrument display device 30 is located in the interior of vehicle A, in a frontal position easily visible to the driver sitting in the driver's seat. The instrument display device 30 includes an instrument display 31 and an instrument ECU 32.

[0072] The instrument display 31 is, for example, a liquid crystal display (LCD) or an organic EL display. Based on the image data acquired from the instrument ECU 32, the instrument display 31 displays speedometer images, tachometer images, navigation map images, and driver assistance images on the display screen.

[0073] In the display system 110, the instrument cluster ECU 32 functions as an HCU (Human Machine Interface Control Unit), which is an electronic control device that encompasses the user interface functions of vehicle A. The instrument cluster ECU 32 comprehensively controls the displays based on the instrument cluster display 31, the HUD 100, and the central display, among other display devices. Based on various information output to the communication bus, the instrument cluster ECU 32 generates image data to be provided to the instrument cluster display 31.

[0074] The instrument cluster ECU 32 is a computer-based structure including a processing unit, RAM, storage, input / output interfaces, and buses connecting these components. The instrument cluster ECU 32 collaborates with the head-up ECU 70 (described later) to perform computational processing for virtual image display. The instrument cluster ECU 32 generates image data for displaying the virtual image Vi and sequentially outputs the generated image data to the HUD 100. The instrument cluster ECU 32 also generates image data for virtual image display, including lane departure warning, ACC status, turning indicator, and sign recognition (described later), and provides this data to the HUD 100.

[0075] HUD100 is one of several display devices installed in vehicle A. It provides information to the driver by projecting a virtual image Vi in the space in front of the driver. HUD100 is housed in a storage space inside the instrument panel 9. HUD100 projects light (hereinafter, virtual image light Lvi) as the image of the virtual image Vi onto the projection range PA of the windshield WS. The virtual image light Lvi projected onto the windshield WS is reflected to the driver's side within the projection range PA and is perceived by the driver. The driver visually recognizes the display of the virtual image Vi superimposed on the foreground seen through the projection range PA.

[0076] The HUD100 features a PGU (Picture Generation Unit) 61, a magnifying optical system 62, an actuator 63, and a head-up ECU 70.

[0077] The PGU61 has an LCD (Liquid Crystal Display) panel and a backlight. The PGU61 is fixed to the housing of the HUD100 with the display surface of the LCD panel facing the magnifying optical system 62. The PGU61 displays each frame of image data on the display surface of the LCD panel, and illuminates the display surface through the backlight, thereby emitting the virtual image light Lvi, which is used to image the virtual image Vi, towards the magnifying optical system 62.

[0078] The magnifying optical system 62 is a structure including at least one concave mirror, which is formed by vapor-depositing a metal such as aluminum onto the surface of a substrate made of synthetic resin or glass. The magnifying optical system 62 expands the light emitted from PGU 61 by reflection and projects it onto the projection area PA above.

[0079] Actuator 63 is a mechanism that mechanically moves the area of ​​the windshield WS that forms the projection range PA. The projection range PA is the range of the projected virtual image light Lvi, which is the range in which the virtual image Vi is displayed visually to the driver. Actuator 63 rotates the concave mirror about a rotation axis defined relative to the magnifying optical system 62, thereby changing the emission direction of the virtual image light Lvi from the magnifying optical system 62 toward the windshield WS. Through the change in the posture of the concave mirror, actuator 63 ensures that the position of the projection range PA of the virtual image light Lvi, and thus the viewing angle VA perceived by the driver, is at least along the vertical direction US (refer to...). Figure 1 )move.

[0080] In detail, when the imaginary range in the space capable of imaging the virtual image Vi is defined as the imaging plane IS, the viewing angle VA is the field of view angle defined based on the imaginary line connecting the driver's eye point EP and the outer edge of the imaging plane IS. Viewed from the eye point EP, the viewing angle VA is the angular range within which the driver can visually recognize the virtual image Vi. In the HUD100, the horizontal viewing angle in the horizontal direction (e.g., approximately 6°) is set to be larger than the vertical viewing angle in the vertical direction (e.g., approximately 2°). If the viewing angle VA moves in the vertical direction US, it becomes a change in the forward range within the viewing angle VA. As an example, when the actuator 63 positions the viewing angle VA at its lowest point (e.g., a depression angle of approximately 3°), the forward range of 10-20 meters becomes the range within the viewing angle VA. Conversely, when the actuator 63 positions the viewing angle VA at its highest point (e.g., a depression angle of approximately 1°), the forward range of approximately 30-80 meters becomes the range within the viewing angle VA.

[0081] Here, the forward / backward direction ZG and the left / right direction Yo are defined with reference to a vehicle A stationary on a horizontal plane. Specifically, the forward / backward direction ZG is defined along the long side (direction of travel) of vehicle A. The left / right direction Yo is defined along the width of vehicle A. Furthermore, the vertical direction US is defined along the vertical direction of the horizontal plane that defines the forward / backward direction ZG and the left / right direction Yo. For the sake of simplicity, the reference numerals indicating each direction are appropriately omitted.

[0082] The head-up ECU 70 is the control circuit for the HUD 100, which integrates the control of the PGU 61 and the actuator 63. The head-up ECU 70 is structured primarily as a computer, including a processing unit, RAM, memory, input / output interfaces, and buses connecting these components. The head-up ECU 70 also includes drive circuitry for driving the LCD panel, backlight, and actuator 63.

[0083] The head-up ECU 70 establishes an association with the position of the viewing angle VA and changes the content displayed as the virtual image Vi. Specifically, the head-up ECU 70, through the drive control of the actuator 63, switches the position of the viewing angle VA of the virtual image Vi between multiple positions, including the normal position VP1 and the overlapping position VP2. Based on the switching of the position of the viewing angle VA based on the actuator 63, the head-up ECU 70 displays the virtual image Vi associated with the normal position VP1 and the overlapping position VP2, respectively.

[0084] Normal position VP1 is the viewing position where the non-overlapping content CTn is primarily displayed as the virtual image Vi. Normal position VP1 is the reference position for the viewing angle VA, equivalent to a position with a longer duration than the overlapping position VP2. The non-overlapping content CTn refers to the display objects (non-AR displays) that overlap with the foreground, excluding the overlapping content CTs described later. Unlike overlapping content CTs, non-overlapping content CTn does not specifically overlap with any object and is displayed at a specific position within the projection range PA (viewing angle VA). Therefore, non-overlapping content CTn is visually recognized by the driver in a manner relatively fixed to vehicle structures such as the windshield WS. The state of displaying vehicle information such as vehicle speed via non-overlapping content CTn at normal position VP1 becomes the reference state for the virtual image display based on HUD100 (see reference). Figure 5 (Upper part, etc.)

[0085] The overlap position VP2 is the viewing position where the primary overlap content CTs are displayed as a virtual image Vi. The overlap position VP2 is defined as being higher than the normal position VP1. The overlap content CTs are AR displays used in Augmented Reality (AR) displays. The display position of the overlap content CTs is associated with specific overlap objects existing in the foreground, such as specific locations on the road surface, vehicles ahead, pedestrians, and road signs. The overlap content CTs are displayed overlapping with specific overlap objects located within the viewing angle VA, following the overlap objects in a relatively fixed manner, and can move visually to the driver. The shape of the overlap content CTs matches the relative position and shape of the overlap objects and is continuously updated at a predetermined period. The overlap content CTs are displayed in a posture closer to horizontal than the non-overlapping content CTn, for example, formed as a display shape extending in the depth direction from the driver's perspective. As an example, in the event of a specific event that should be notified to the driver, the HUD100 moves the viewing angle VA from the normal position VP1 to the overlap position VP2 and displays the overlap content CTs.

[0086] As described above, in order to achieve virtual image display control that coordinates viewing position and content, the head-up ECU 70 executes a program (virtual image display program) stored in the memory through a processing unit and has multiple functional units. Specifically, the head-up ECU 70 has functional units such as an information acquisition unit 71, a data storage unit 72, and a display control unit 73.

[0087] The information acquisition unit 71 is connected to the communication bus and the instrument cluster ECU 32. The information acquisition unit 71 acquires road sign RS recognition information based on the camera ECU 21, path information based on the navigation ECU 22, and lane departure information and status information based on the driver assistance ECU 23 from the communication bus. Image data generated by the instrument cluster ECU 32 for virtual image display is sequentially input into the information acquisition unit 71. The information acquisition unit 71 is electrically connected to the AR switch 68. The AR switch 68 is a switch that toggles the on / off state of the AR display using overlapping content CTs. The information acquisition unit 71 detects the on / off state of the AR switch 68.

[0088] The data storage unit 72 is a storage area that stores multiple data referenced by the display control unit 73. The data storage unit 72 may be a storage area secured in RAM or a portion of a storage area within memory. The data storage unit 72 contains a checklist 81, mirror position data 82 and 83, and graphic data 84 and 85, which can be referenced by the display control unit 73.

[0089] Checklist 81 (refer to) Figure 2 The Look-up Table is information that establishes a connection between viewpoint and content (see reference). Figure 3 ). Mirror position data 82 (reference) Figure 2 Mirror Position Data A specifies the angular position of the concave mirror when the viewing angle VA is set to the normal position VP1. (Refer to Mirror Position Data 83) Figure 2 Mirror PositionData B) specifies the angular position of the concave mirror when the viewing angle VA is set at the overlapping position VP2. The position data for each mirror 82 and 83 can also be values ​​that can be adjusted by the driver to align with the driver's eye point EP. Graphical data 84 (see reference) Figure 2 Graphic Data A is the image data (material data) used when the viewpoint VA is at the normal position VP1. Graphic Data 85 (reference) Figure 2 Graphic Data B) is the image data (material data) used when the viewpoint VA is located at the overlapping position VP2.

[0090] The display control unit 73 is a control unit that integrates the control of the PGU 61 and the actuator 63, generating image data and control signals output to the PGU 61 and drive signals output to the actuator 63. Based on the on / off state of the AR switch 68, which is controlled by the information acquisition unit 71, the display control unit 73 switches between active and inactive operations that move the viewing angle VA to the overlapping position VP2. When the AR switch 68 is in the off state, the display control unit 73 fixes the viewing angle VA at the normal position VP1, interrupting the display of the overlapping content CTs.

[0091] Based on the information acquired by the information acquisition unit 71 and the contents of the checklist 81, the display control unit 73 determines the position of the viewing angle VA, and selects the content to be displayed for the virtual image based on the determined viewing angle position. Based on the content selection result, the display control unit 73 extracts the material data of the images used to generate the image data from each graphic data 84 and 85. The display control unit 73 appropriately combines the image data generated from each graphic data 84 and 85 with the image data provided by the instrument ECU 32 to generate frames of image data. The display control unit 73 sequentially outputs the image data consisting of multiple consecutive frames to the PGU 61.

[0092] When the display control unit 73 moves the viewing angle VA, the mechanical rotation of the concave mirror via the actuator 63 takes time (e.g., about 1 second). Therefore, after the viewing angle VA has moved from one normal position VP1 to the other (either the overlapping position VP2), and a virtual image Vi (specific content CTis) is displayed within the moved viewing angle VA, a time lag occurs before the display begins due to the movement of the viewing angle VA. The display control unit 73 starts the display of associated content CTr, which is pre-associated with the specific content CTis, before the movement of the viewing angle VA is complete, so that this time lag does not cause any discomfort to the driver.

[0093] Specifically, such as Figure 4 as well as Figure 2 As shown, when the viewing angle VA is moved from the normal position VP1 to the overlapping position VP2, the display control unit 73 displays the associated content CTr. After the actuator 63 moves the viewing angle VA from the normal position VP1 to the overlapping position VP2, the associated content CTr is displayed in a form associated with the specific content CTis displayed within the viewing angle VA at the overlapping position VP2. The term "associated" refers to, for example, the associated content CTr attracting attention to the specific content CTis, the associated content CTr assimilating with the specific content CTis, or a portion of the specific content CTis being displayed as the associated content CTr. Alternatively, as another example, the specific content CTis and the associated content CTr can be associated on the display by forming similar or identical display colors to a degree that would be recognizable to the driver. Furthermore, the case where the associated content CTr contains the same information as the specific content CTis also constitutes a form where the associated content CTr is associated with the specific content CTis.

[0094] The associated content CTR includes first associated content CTR1 and second associated content CTR2. First associated content CTR1 begins to be displayed before time t1, when the actuator 63 begins to move the viewing angle VA from the normal position VP1. First associated content CTR1 ends its display at time t1. First associated content CTR1 is displayed, for example, as a background to the non-overlapping content CTn displayed at the normal position VP1, and flashes multiple times before ending its display at time t1.

[0095] The second associated content CTr2 is displayed during the movement of the viewing angle VA caused by the actuator 63 (hereinafter, the movement period TM1). The second associated content CTr2 begins to be displayed after the time t1 when the display of the first associated content CTr1 ends, and ends before the time t2 when the movement of the viewing angle VA is completed. The second associated content CTr2 is content of a different form from the first associated content CTr1. For example, the first associated content CTr1 is set as non-overlapping content CTn, while the second associated content CTr2 is set as either overlapping content CTs or non-overlapping content CTn. The display control unit 73 generates a display change in which the brightness of the second associated content CTr2 continuously or progressively increases as the viewing angle position approaches the overlapping position VP2. As a result, the second associated content CTr2 becomes a highly attractive display as the viewing angle VA moves through the area.

[0096] On the other hand, when the viewing angle VA moves from the overlapping position VP2 to the normal position VP1, the display control unit 73 does not display the associated content CTr. The display control unit 73 ends the overlapping display of the specific content CTis before the actuator 63 begins moving the viewing angle VA from the overlapping position VP2 to the normal position VP1 at time t3. During the movement of the viewing angle VA by the actuator 63 (hereinafter, the movement period TM2), the display control unit 73 temporarily interrupts the display of all virtual images. The display control unit 73 resumes the display of the non-overlapping content CTn at time t4 when the viewing angle reaches the normal position VP1, or at a time interval (e.g., approximately 1 second) elapsed from time t4. Furthermore, when displaying a portion of the specific content CTis, the associated content CTr displayed during the movement period TM1 can also be displayed during the movement period TM2.

[0097] The instrument cluster ECU 32, in coordination with the switching of the viewing angle VA based on the actuator 63 in the HUD 100, changes the display screen of the instrument cluster display 31. The instrument cluster ECU 32 displays the detailed information PDi associated with the specific content CTis on the display screen. The detailed information PDi is information of the same type as the specific content CTis, providing the driver with more detailed information than the specific content CTis.

[0098] As the viewing angle VA moves from the normal position VP1 to the overlapping position VP2, the instrument ECU 32 generates a color reduction display change during the movement from time t1 to time t2 (TM1), causing the brightness of the detailed information PDi displayed on the screen to decrease continuously or in stages. Thus, as the viewing angle VA moves, the detailed information PDi becomes a less attractive display element. As a result, the driver's gaze is guided to the foreground, similar to the brightness shift from the screen display of the instrument display device 30 to the virtual image display based on the HUD 100.

[0099] At time t2, when the viewing angle VA completes its movement towards the overlapping position VP2, the instrument cluster ECU 32 sets the detailed information PDi to non-display. While the viewing angle VA is at the overlapping position VP2 and the specific content CTis is continuously displayed, the instrument cluster ECU 32 maintains the non-display state of the detailed information PDi. Therefore, the detailed information PDi does not attract the driver's attention and obstruct external visual recognition. Furthermore, the display of other images besides the detailed information PDi also continues from time t2 to time t3.

[0100] On the other hand, when the viewing angle VA moves from the overlapping position VP2 to the normal position VP1, the instrument ECU 32 restarts the display of the detailed information PDi at the timing when the display of the specific content CTis ends. As an example, the display of the detailed information PDi restarts at the moment t3 when the movement of the viewing angle VA begins. In this way, even after the specific content CTis becomes not displayed, the state of being able to confirm the information provided by the specific content CTis is maintained.

[0101] Next, based on Figures 5 to 31 , refer to Figures 1-4 The following description addresses several scenarios where the viewpoint VA is moved from the normal position VP1 to the overlapping position VP2 to display specific content CTis.

[0102] Lane departure warning

[0103] exist Figures 5-10 The image illustrates multiple modes of lane departure warning implemented by the display system 110. Figures 5-7 The image shows the lane departure warning for Mode 1. Figure 5 , Figure 6 as well as Figure 7 The image shows the lane departure warning for Mode 2. Figure 5 , Figure 9 as well as Figure 10 The image shows the lane departure warning for Mode 3.

[0104] Before the lane departure warning in modes 1 to 3 is issued, the display control unit 73 displays the speedometer CTV (see reference) at the normal position VP1 viewpoint VA. Figure 5 (Upper part). The speedometer CTV is a digital display of the vehicle speed, with non-overlapping content CTn. The display control unit 73 determines the implementation of the lane departure warning based on the acquisition of lane departure information by the information acquisition unit 71. The display control unit 73 continuously displays the speedometer CTV and displays a flashing background CTB (see reference). Figure 5 (Lower part)

[0105] The blinking background CTB is the non-overlapping content CTn displayed as the first associated content CTR1. The blinking background CTB is a horizontally rectangular image that is painted over the entire viewpoint VA. The blinking background CTB is displayed as a background to the speedometer CTV so as not to obstruct its visual recognition. The blinking background CTB is, for example, a virtual image Vi set to a warning color such as red. After blinking several times, the blinking background CTB ends its display at time t1 along with the speedometer CTV.

[0106] In the lane departure warning mode 1, if the view VA begins to move at time t1, the control unit 73 will display the guidance content CTGn (see reference). Figure 6 (Upper part). The guidance content CTGn is a non-overlapping content CTn displayed as the second associated content CTR2. The guidance content CTGn is an associated content CTR with a different form from the flashing background CTB, and is a non-flickering image displayed as part of the smeared viewing angle VA. The guidance content CTGn is a horizontal rectangle that connects to the lower edge of the viewing angle VA, and is a virtual image Vi set to a warning color such as red, just like the flashing background CTB. The vertical width of the guidance content CTGn is set to about half to one-third of the vertical viewing angle at the start of the display. The display control unit 73 shrinks the guidance content CTGn vertically according to the upward movement of the viewing angle VA, and moves the entire guidance content CTGn upward under the driver's observation (see reference). Figure 6 (Lower part). The display control unit 73 ends the display of the guide content CTGn before the time t2 when the viewing angle VA reaches the overlapping position VP2.

[0107] If the display control unit 73 completes the movement of the viewing angle VA to the overlapping position VP2 at time t2, it begins to disengage from the display of the warning content CTdw (see reference). Figure 7 (Upper part). Lane departure warning content CTdw is a specific content CTis within lane departure warning. Lane departure warning content CTdw is an overlay content CTs that sets the road surface of the vehicle's lane in the foreground as an overlapping object, warning the vehicle A of leaving its lane. Lane departure warning content CTdw includes the road surface overlay image Prs and the boundary emphasis image Pel.

[0108] The road surface overlap image Prs is displayed as a virtual image in a warning color such as red, and the overlap appears as a portion of the road surface ahead of the vehicle's lane being painted over. When vehicle A is about to detach from the left lane marking Lml, the road surface overlap image Prs overlaps with the vicinity of the left lane marking Lml of the vehicle. The road surface overlap image Prs moves from the left lane marking Lml of the vehicle towards the right lane marking Lmr of the vehicle, displayed as a repeatedly moving animation (see reference). Figure 7 (Lower part), prompting the driver to move towards the center of their lane.

[0109] The boundary emphasis image Pel is an image with a different display color (e.g., white) than the road surface overlap image Prs. When vehicle A is about to leave its lane to the left, the boundary emphasis image Pel is positioned between the road surface overlap image Prs and the lane marking line Lml, extending in a thin band along the left side of the vehicle. The boundary emphasis image Pel is repeatedly displayed and not displayed depending on the animation of the road surface overlap image Prs, and becomes not displayed at certain times when the road surface overlap image Prs moves away from the lane marking line Lml (see reference). Figure 7 (Lower section). In addition, when vehicle A is about to detach to the right of its own lane, the road surface overlap image Prs and the boundary emphasis image Pel are displayed along the demarcation line Lmr on the right side of the vehicle.

[0110] In the lane departure warning mode 2, if the view VA begins to move at time t1, the control unit 73 will display the road surface overlap image Prs and the guidance content CTGs (see reference). Figure 8 (Upper part). The road surface overlay image Prs and the guiding content CTGs are the overlay content CTs displayed as the second associated content CTR2.

[0111] The road surface overlay image Prs is detached from the warning content CTdw (reference). Figure 9 A portion of the road surface ahead of the vehicle is overlaid on the lane marking Lml near the departure side, in a manner that the portion of the road surface ahead of the vehicle is painted over. The road surface overlay image Prs can be either overlay content CTs that are close to the vehicle along with the road surface ahead, or overlay content CTs that overlap with the road surface ahead at a specified distance from the vehicle.

[0112] Guided content CTGs are related to flashing background CTBs (see reference). Figure 5 Different forms of related content CTR are displayed as part of the smearing perspective VA. Guide content CTGs and mode 1 guide content CTGn (see...) Figure 6 Similarly, it is a red virtual image Vi, which is a horizontal rectangle connected to the lower edge of the viewing angle VA. The guidance content CTGs are positioned near the front of the road surface overlay image Prs from the driver's perspective. The display control unit 73 moves the guidance content CTGs toward the vanishing point in the foreground as the viewing angle VA moves upward. Specifically, the guidance content CTGs are reduced in both the vertical and horizontal directions while maintaining the aspect ratio as the viewing angle VA moves upward, and move upward in a manner that is contained between the dividing lines Lml and Lmr (see reference). Figure 8 (Lower section). Through this morphological change, the guiding content CTGs are visually recognized as moving inwards within the vehicle's lane, guiding the driver's gaze further ahead.

[0113] If the display control unit 73 completes the movement of the viewing angle VA to the overlapping position VP2 at time t2, it begins to disengage from the display of the warning content CTdw (see reference). Figure 9 (Upper part). The departure warning content CTdw in Mode 2 is an overlap content CTs that includes the road surface overlap image Prs and the boundary emphasis image Pel. The road surface overlap image Prs begins to appear as the viewpoint VA moves, as described above, and continues to appear after the viewpoint VA has finished moving. The road surface overlap image Prs overlaps with the road surface ahead at a specified distance from the vehicle.

[0114] The boundary emphasis image Pel is depicted, for example, in white, and is displayed overlaid with the road surface overlap image Prs. The boundary emphasis image Pel is depicted as a triangle indicating the center side, prompting the driver to move towards the center of the vehicle's lane. The display control unit 73 displays multiple boundary emphasis images Pel at predetermined intervals along the detour line Lml on the departure side. The multiple boundary emphasis images Pel are magnified and move along the detour line Lml on the road surface overlap image Prs according to the vehicle's movement, and are perceived by the driver as approaching the vehicle along with the road surface ahead (see reference). Figure 9 (Lower part)

[0115] In the Lane Departure Warning of Mode 3, the guidance content CTGs of Mode 2 are omitted (see...). Figure 8 The display control unit 73 displays the road surface overlay image Prs as the second associated content CTr2 (see reference). Figure 10 The upper part). The road surface overlay image Prs is displayed in a configuration that overlaps with the zoning line Lml near the departure side. As the viewing angle VA moves upward, the vanishing point towards the foreground is magnified within a range that does not extend beyond the vehicle's lane (see reference). Figure 10 (Upper part). The road surface overlap image Prs continues to be displayed within the view VA of the overlap position VP2 after the view VA has moved, as part of the departure warning content CTdw (see reference). Figure 9 ).

[0116] <ACC Status Change Notification>

[0117] exist Figures 11-19 The image illustrates multiple modes of ACC status change notifications implemented by display system 110. Figures 11-13 The notification of the change in ACC status for Mode 1 is shown in [the image / document]. Figure 11 , Figure 14 as well as Figure 15 The notification of the ACC status change in Mode 2 is shown. Furthermore, in Figure 11 , Figure 16 as well as Figure 17 The notification of the change in ACC status for Mode 3 is shown in [the image / document]. Figure 11 , Figure 18 as well as Figure 19 The image shows a notification of a change in the ACC status for Mode 4.

[0118] When the ACC function is activated via the driver assistance ECU23, in the view VA located in the normal position VP1, in addition to the speedometer CTv, the target vehicle speed CTts and the target vehicle distance CTtd are also displayed (see reference). Figure 11 (Upper part). Target vehicle speed CTts and target distance CTtd are non-overlapping contents CTn representing the control target value set by the ACC function. Target vehicle speed CTts represents the maximum speed that becomes the upper limit when the ACC function enables vehicle A to cruise at a constant speed. Target distance CTtd represents the length of the distance between the vehicle and the vehicle ahead (hereinafter, target distance) when the ACC function enables vehicle A to follow the vehicle ahead Af.

[0119] The ACC status change notification is implemented when the driver changes (extends) the target inter-vehicle distance set by the ACC function (see reference). Figure 11 (Lower part). The previous display of the ACC status change notification is the same as in modes 1 to 4. The display control unit 73 is triggered by the acquisition of status information indicating the change of the target vehicle distance, and decides to implement the ACC status change notification. Before the moment t1 when the starting view VA moves, the speedometer CTv and the target vehicle speed CTts are set to not be displayed.

[0120] In the ACC state change notification of Mode 1, if the viewpoint VA begins to move at time t1, the display control unit 73 gradually reduces the display brightness of the target workshop CTtd. Through this color-reducing display change, the target workshop CTtd becomes non-displayed during the movement of TM1. Additionally, the display control unit 73 begins displaying a portion of the content CTus (see reference). Figure 12 ).

[0121] Partially displayed content CTus is shown as associated content CTR. Partially displayed content CTus is specific content CTis displayed after the viewpoint VA has moved (see reference). Figure 13 As the viewing angle VA moves upward, the lower portion of a specific content CTis is displayed as partial content CTus. Partial content CTus is an overlapping content CTs that includes the box image Pdb and a set of demarcation line images Pbl, displayed overlapping with the road surface in front.

[0122] If the display control unit 73 completes the movement of the viewing angle VA to the overlapping position VP2 at time t2, then it begins the display of the workshop notification content CTfd (see reference). Figure 13(Upper part). The workshop notification content CTfd is a specific content CTis in the ACC status change notification. The workshop notification content CTfd is an overlapped content CTs that sets the road surface of the vehicle's lane in the foreground as the overlapping object, notifying the driver of the change in the action status of the workshop maintenance control based on the ACC function, specifically the implementation of deceleration control to increase the workshop distance to the vehicle ahead Af. The workshop notification content CTfd includes a box image Pdb and a set of zoning line images Pbl.

[0123] The frame image Pdb is displayed as a virtual image in blue or green, and is a trapezoidal image overlapping the center of the road surface in front of the vehicle's lane. The frame image Pdb is displayed below the vehicle ahead Af so that it does not overlap with the vehicle ahead Af in the driver's vision. If the distance to the vehicle ahead Af is increased by deceleration control based on the ACC function, the display control unit 73 increases the number of frame images Pdb displayed below the vehicle ahead Af (see reference). Figure 13 (Upper part).

[0124] The slash image Pbl is displayed as a virtual image in blue or green, essentially the same as the frame image Pdb, overlapping one on each side of the frame image Pdb. Each slash image Pbl is a thin strip extending from the side of the vehicle toward the vanishing point along adjacent slashes Lml and Lmr. The slash image Pbl is allowed to overlap with the preceding vehicle Af in the driver's vision, extending diagonally from the lower edge to the upper edge of the viewpoint VA at the overlapping position VP2.

[0125] If the display control unit 73 completes the change of the target vehicle distance based on the ACC function, it ends the ACC status change notification and restores the viewing angle VA to the normal position VP1. The vehicle distance notification content CTfd can be set to not display before the time t3 when the movement of the viewing angle VA begins, or it can be gradually set to not display from the top to the bottom as the viewing angle VA moves. If the display control unit 73 completes the movement of the viewing angle VA to the normal position VP1 at time t4, it restarts the display of the speedometer CTv, the target vehicle speed CTts, and the target vehicle distance CTtd (see reference). Figure 11 (Upper part).

[0126] In the ACC state change notification of Mode 2, if the viewpoint VA begins to move at time t1, the display control unit 73 reduces the hue to make the target workshop CTtd non-displayable, and begins to display the partial content CTus (see reference). Figure 14 The partially displayed content CTus is a specific content CTis that is displayed after the viewpoint VA has moved (see reference). Figure 15As part of the display, it includes a bar image Pbr and a set of zoning wall images Pbb. The display control unit 73, together with a portion of the display content CTus, also displays a speedometer CTv. The bar image Pbr, the zoning wall images Pbb, and the speedometer CTv are gradually displayed from bottom to top according to the movement of the viewing angle VA.

[0127] If the display control unit 73 completes the movement of the viewing angle VA to the overlapping position VP2 at time t2, then it begins the display of the workshop notification content CTfd (see reference). Figure 15 The workshop notification content CTfd includes the aforementioned bar image Pbr and a set of zoning wall images Pbb. The bar image Pbr is equivalent to the box image Pdb of mode 1 (see reference). Figure 13 The bar image (Pbr) is a horizontally extending bar shape. The bar image Pbr is displayed visually between the vehicle ahead (Af) and the speedometer (CTv). If the deceleration control via ACC extends the inter-vehicle distance to the vehicle ahead (Af), the number of bar images Pbr displayed below the vehicle ahead (Af) increases (see reference). Figure 15 (Lower part)

[0128] The zoning wall image Pbb is equivalent to the zoning line image Pbl of Mode 1 (see reference). Figure 13 The images are superimposed on both sides of the strip image Pbr and the speedometer CTV. Each zone wall image Pbb includes multiple wall-shaped image units erected vertically from the road surface upwards, arranged in a wall shape along adjacent zone lines Lml and Lmr. If the vehicle-to-vehicle distance Af is increased by deceleration control based on ACC function, the number of wall-shaped image units in each zone wall image Pbb increases (see reference). Figure 15 (Lower part)

[0129] In the ACC status change notification of Mode 3, if the viewpoint VA begins to move at time t1, the display control unit 73 lowers the color tone of the target workshop CTtd and begins displaying the content CTus (see reference). Figure 16 The partially displayed content CTus is a specific content CTis that is displayed after the viewpoint VA has moved (see reference). Figure 17 Part of the content displayed is the associated content CTr of that specific content CTis. The partial display content CTus includes a frame image Pdb that overlaps with the road surface in front and a set of zoning line images Pbl. The frame image Pdb and the zoning line images Pbl are gradually displayed from the bottom to the top as the viewing angle VA moves upward.

[0130] If the display control unit 73 completes the movement of the viewing angle VA to the overlapping position VP2 at time t2, it begins to display the workshop notification content CTfd as the specific content CTis by drawing the entire frame image Pdb and the zoning line images Pbl (see reference). Figure 17 The upper part). The frame image Pdb is depicted as a trapezoidal frame, including an emphasis section below highlighting the vehicle ahead, Af. If the deceleration control via ACC extends the inter-vehicle distance to the vehicle ahead, Af, multiple frame images Pdb are depicted consecutively below the emphasis section (see reference). Figure 17 (Lower section). The zoning image Pbl is the same as the zoning image Pbl of Pattern 1 (refer to...). Figure 13 The images are essentially the same thin strip. The delimited line images Pbl are located on the left and right sides of the box image Pdb, arranged in a pose along the delimited lines Lml and Lmr.

[0131] In the ACC status change notification of Mode 4, if the viewpoint VA begins to move at time t1, the display control unit 73 lowers the color tone of the target workshop CTtd, and the initial display of the content CTus and the speedometer CTV (see reference) Figure 18 The displayed content CTus is specific content CTis (see reference). Figure 19 Part of the content CTus is the associated content CTR of the specific content CTis. The partially displayed content CTus is an overlapping content CTs that includes the box image Pdb and the zoning line images Pbl. The box image Pdb, the individual zoning line images Pbl, and the velocity gauge CTv are gradually displayed from the bottom to the top as the viewing angle VA moves upward.

[0132] If the display control unit 73 completes the movement of the viewing angle VA to the overlapping position VP2 at time t2, it begins displaying the workshop notification content CTfd as specific content CTis (see reference). Figure 19 The workshop notification content CTfd is displayed inside the speedometer CTV. In the workshop notification content CTfd, in addition to the frame image Pdb and the zoning line image Pbl that begin to appear during the movement of the viewpoint VA, a bar image Pbr is also included. The frame image Pdb and the zoning line image Pbl are the same as in Mode 1 (refer to...). Figure 13 The image is essentially the same. The bar image Pbr overlaps with the road surface below the vehicle Af ahead, emphasizing the vehicle Af ahead from below. If the display control unit 73 expands the distance to the vehicle Af ahead through the deceleration control of the ACC function, it moves the bar image Pbr upward and adds multiple frame images Pdb (see reference) below the bar image Pbr. Figure 19 (Lower part)

[0133] <Turn prompt display>

[0134] exist Figures 20-25 The diagram illustrates multiple modes guided by the path implemented by the display system 110. Figures 20-22 The image shows the turn prompts displayed in the path guidance of Mode 1. Figure 20 , Figure 21 as well as Figure 23 The image shows the turning prompt display for Mode 2. Furthermore, in... Figure 20 , Figure 21 as well as Figure 24 The image shows the turn prompt display for Mode 3. Figure 20 , Figure 21 as well as Figure 25 The image shows the turn prompt display for Mode 4.

[0135] When implementing path guidance to the destination based on navigation ECU22, as the guide point approaches, in the view VA located at the normal position VP1, in addition to the speedometer CTv, a route icon CTir (see reference) is also displayed. Figure 20 (Lower section). Guiding points are set based on specific nodes in guiding areas such as intersections, merging sections, and branching sections.

[0136] The route icon CTir is non-overlapping content CTn indicating the remaining distance to the guide point and the direction of the left or right turn at the guide point. The display control unit 73 determines the implementation of the turn prompt display based on the path information of the nearest guide area obtained by the information acquisition unit 71. After displaying the route icon CTir, the display control unit 73 sets all content including the speedometer CTv and the route icon CTir to be hidden and begins the movement of the viewpoint VA towards the overlapping position VP2.

[0137] If the display control unit 73 starts moving the viewing angle VA at time t1, then during the movement of the viewing angle VA for TM1, the display of the lane emphasis content CTe1 begins (see reference). Figure 21 Lane emphasis content CTeel is an overlapping content CTs displayed as associated content CTR, overlapping with the road surface of the vehicle's lane in the foreground to emphasize the vehicle's lane while it is in motion. Lane emphasis content CTeel is a thin strip of image positioned inside the left and right lane dividers Lml and Lmr (see reference). Figure 21 (Upper section). The lane emphasis content CTel moves upwards according to the viewpoint VA, extending along the lane markings Lml and Lmr (see reference). Figure 21 (Lower section). As mentioned above, when a turn prompt is displayed, the lane emphasis content CTeel is displayed as associated content CTR, and this is handled the same in modes 1 to 4.

[0138] In the turn prompt display of Mode 1, if the viewpoint VA moves to the overlapping position VP2 at time t2, the path guidance content CTRg for the specific content CTis will begin to be displayed (see reference). Figure 22 (Upper part). The path guidance content CTRg contains a proximity notification image Pap and a location notification image Ptp.

[0139] The approach notification image Pap is displayed near the lower edge of the viewing angle VA at time t2. The approach notification image Pap has multiple triangular image sections indicating the vehicle's turning direction at the guide point. As the vehicle approaches the guide point, the display control unit 73 magnifies the approach notification image Pap and gradually moves it towards the center of the viewing angle VA (see reference). Figure 22 (Lower part)

[0140] The location notification image Ptp is displayed superimposed on the guide point in a form that rises above the road surface. Like the approach notification image Pap, the location notification image Ptp has multiple triangular image sections indicating the vehicle's turning direction. The location notification image Ptp is displayed behind the approach notification image Pap within the viewing angle VA, and moves towards the center of the viewing angle VA as the vehicle approaches the guide point. At the precise moment the vehicle enters the intersection, the location notification image Ptp collides with the upward-moving approach notification image Pap. After this visual collision, the location notification image Ptp and the approach notification image Pap are integrated into a single, non-overlapping content CTn that clearly indicates the vehicle's turning direction to the driver.

[0141] If the vehicle exits from the intersection serving as the guide point, the display control unit 73 sets the path guidance content CTRg to non-display and then begins the movement of the viewing angle VA towards the normal position VP1. After the predetermined time for the viewing angle VA to move towards the normal position VP1 has elapsed, the display control unit 73 restarts the display of the speedometer CTV (see reference). Figure 20 (Upper part).

[0142] In the turn prompt display of Mode 2, after the view VA moves to the overlapping position VP2 at time t2, a pair of lane emphasis content CTeX is also continuously displayed (see reference). Figure 23 (Upper part). After emphasizing the vehicle's lane based on the lane emphasis content CTeel for a predetermined period of time, the display control unit 73 switches the display included in the path guidance content CTrg from the lane emphasis content CTeel to the proximity notification image Pap (see reference). Figure 23 (Middle section). The proximity notification image Pap has multiple triangular image units indicating the vehicle's changing direction. These multiple triangular image units are displayed overlappingly in a row in the center of the road surface in the vehicle's lane, along the vehicle's direction of travel. As the vehicle approaches the guide point, each image unit moves continuously downwards from the viewing angle VA, and is drawn sequentially.

[0143] When the vehicle enters an intersection, the display control unit 73 switches the display content included in the path guidance content CTrg from the proximity notification image Pap to the location notification image Ptp (see reference). Figure 23(Lower section). The location notification image Ptp is a non-overlapping content CTn composed of multiple triangular images representing the direction of the turn. The location notification image Ptp continues to be displayed after the left or right turn begins until the vehicle exits the intersection.

[0144] In the turn indication display of Mode 3, after the viewpoint VA moves to the overlapping position VP2 at time t2, a pair of lane emphasis content CTel is continuously displayed, and a bar image Pbr is also added (see reference). Figure 24 (Upper part). The bar image Pbr is an image that extends in a bar shape along the horizontal direction of the viewpoint VA, configured between a pair of lane-emphasis content CTel.

[0145] After emphasizing the vehicle's lane based on the lane emphasis content CTel and the lane image Pbr for a predetermined period of time, the display control unit 73 switches the display objects included in the path guidance content CTrg to the proximity notification image Pap (see reference). Figure 24 (Middle section). The approach notification image Pap has an image section that numerically represents the remaining distance to the guide point, and an image section in the shape of an arrow indicating the direction of left or right turn at the guide point. The approach notification image Pap moves towards the vehicle side along with the road surface as the vehicle approaches the guide point, and is drawn sequentially from the viewpoint VA.

[0146] When the guide point enters the viewing angle VA, the display control unit 73 switches the displayed objects included in the path guidance content CTrg from the proximity notification image Pap to the location notification image Ptp (see reference). Figure 24 (Lower section). The location notification image Ptp is a horizontally rectangular image with a perforated section forming a triangle indicating the direction of change. The location notification image Ptp is displayed over the approximate entirety of the viewpoint VA at the overlapping position VP2. The location notification image Ptp continues to be displayed after a left or right turn has begun until the vehicle exits the intersection.

[0147] In the turn indication display of Mode 4, after the viewpoint VA completes its movement towards the overlapping position VP2 at time t2, the path guidance content CTRg containing the proximity notification image Pap begins to be displayed. The proximity notification image Pap includes multiple block-shaped image sections stacked at the right corner of the viewpoint VA (hereinafter, fixed image sections), and multiple block-shaped image sections overlapping the road surface and approaching the vehicle (hereinafter, moving image sections) (see reference). Figure 25 The lowermost fixed image unit disappears upon collision with a moving image unit approaching the vehicle (see reference). Figure 25 (Middle section). Through repeated animations, the proximity notification image Pap shows the driver the approach of the guide point.

[0148] When the guide point enters the viewing angle VA, the display control unit 73 switches the displayed objects included in the path guidance content CTrg from the proximity notification image Pap to the location notification image Ptp (see reference). Figure 25 (Lower section). The location notification image Ptp is non-overlapping content CTn containing multiple triangles representing the direction of change. In the turn prompt display of Mode 4, the location notification image Ptp is also continuously displayed until the vehicle exits the intersection.

[0149] <Sign Recognition Auxiliary Display>

[0150] exist Figures 26-31 The image illustrates several modes of sign recognition-assisted display implemented by display system 110. In this sign recognition-assisted display, the associated content CTR is not displayed. Figures 26-28 The image shows a sign recognition auxiliary display for Mode 1. Figure 26 , Figure 28 as well as Figure 29 The image shows a marker recognition assistance display for Mode 2. Furthermore, in... Figure 26 , Figure 28 as well as Figure 30 The image shows the sign recognition assistance display for Mode 3. Figure 26 , Figure 28 as well as Figure 31 The image shows the sign recognition assistance display for mode 4.

[0151] When the sign recognition function of camera ECU21 is working, in the field of view VA located in the normal position VP1, in addition to the speedometer CTv, the sign icon CTrs is also displayed (see reference). Figure 26 The sign icon CTrs is a non-overlapping content CTn that mimics previously recognized road sign RS (e.g., speed limit 60km / h). If the camera ECU 21 newly detects a road sign RS in front of the vehicle, it outputs the recognition information of the detected road sign RS to the HUD 100. The display control unit 73 determines the implementation of the sign recognition assistance display based on the acquisition of the road sign RS recognition information based on the information acquisition unit 71. In the sign recognition assistance display of modes 1 to 4, before the movement of the viewing angle VA begins at times t1 and t3, the speedometer CTv and the sign icon CTrs, or the recognition assistance content CTr (see reference) are displayed. Figure 27 Content such as ) is set to not be displayed. In addition, in the sign recognition auxiliary display in modes 1 to 4, during the movement of the viewpoint VA, TM1 and TM2, the display of all content is temporarily interrupted.

[0152] In the sign recognition auxiliary display of Mode 1, at time t2, when the viewpoint VA moves to the overlapping position VP2, the display of the auxiliary content CTra begins (refer to...). Figure 27(Upper part). The display control unit 73 first displays a change warning image Ppn as recognition aid content CTr. The change warning image Ppn is an image that mimics the road sign RS, representing the content of a newly detected road sign RS (e.g., speed limit 40km / h). The change warning image Ppn is compared to the sign icon CTrs (refer to...). Figure 26 It is depicted with low chroma and displayed as a virtual image larger than the logo icon CTrs.

[0153] If the display control unit 73 approaches the road sign RS, in addition to changing the warning image Ppn, it also displays the location notification image Ptp (see reference). Figure 27 (Middle section). The location notification image Ptp is a horizontally extending bar-shaped image, displayed overlapping the road surface in front of the vehicle, based on the location of the road sign RS. The location notification image Ptp approaches the change warning image Ppn together with the road surface in front of the vehicle. At the timing when the location notification image Ptp and the change warning image Ppn come into contact, the display control unit 73 temporarily increases the brightness and saturation to emphasize the display of the change warning image Ppn (see reference). Figure 27 (Lower part)

[0154] After the display of the identification assistance content CTra ends, the display control unit 73 begins the movement of the viewing angle VA towards the normal position VP1 at time t3. After the movement of the viewing angle VA towards the normal position VP1 is completed at time t4, the display control unit 73 restarts the display of the speedometer CTv and the marker icon CTrs (see reference). Figure 28 The displayed CTrs icon now displays the same content as the previously hidden change warning image Ppn (speed limit 40km / h).

[0155] In the sign recognition auxiliary display of Mode 2, the display of the recognition auxiliary content CTra begins by changing the animation of the preview image Ppn moving from the lower edge of the viewpoint VA at the overlapping position VP2 (see reference). Figure 29 (Upper part). Similar to Mode 1, the display control unit 73, after displaying the location notification image Ptp, causes the location notification image Ptp to collide with the change preview image Ppn (see reference). Figure 29 (Middle section). After the display control unit 73 brings the location notification image Ptp and the change preview image Ppn into contact, it keeps the change preview image Ppn in an emphasized state and tilts it inward, changing it to a posture that is close to the road surface (see reference). Figure 29 (Lower part)

[0156] Additionally, the display control unit 73 replaces the location notification image Ptp with a wavy image Pw. The wavy image Pw is a horizontally extending, rod-shaped image that overlaps with the road surface of the vehicle's lane. The wavy image Pw indicates the area where a new road sign RS has become valid due to high-speed movement along the vehicle's lane in the direction of travel. The display control unit 73 ends the display of the recognition assistance content CTra at a time when the wavy image Pw is drawn from the viewing angle VA, and begins the process of returning the viewing angle VA to the normal position VP1.

[0157] In the sign recognition assistance display of Mode 3, within the viewpoint VA at the overlapping position VP2, in addition to the recognition assistance content CTra, the speedometer CTv is also displayed. The recognition assistance content CTra includes a change preview image Ppn and the current sign image Psp. The change preview image Ppn is displayed behind the current sign image Psp (see reference). Figure 30 (Upper part). The warning image Ppn moves towards the side of the vehicle along with the road surface in front of it, approaching the current sign image Psp (refer to...). Figure 30 (Middle section).

[0158] The current sign image Psp, like the change warning image Ppn, is an image that mimics the road sign RS (see reference). Figure 30 (Upper part). The current logo image Psp represents the logo icon CTrs that was previously set to not be displayed (see reference). Figure 28 The same content (speed limit 60km / h). The current sign image Psp is displayed at a specified position within the view VA closer to the front than the change warning image Ppn.

[0159] The display control unit 73 causes the change warning image Ppn, which is moving towards the vehicle side, to collide with the current sign image Psp, and ends the display of the current sign image Psp (see reference). Figure 30 (Lower section). The display control unit 73 replaces the current marker image Psp and displays a preview image Ppn with enhanced brightness and saturation, showing a change in the emphasized form, as non-overlapping content CTn. Afterward, the display control unit 73 ends the display of the recognition auxiliary content CTr and begins the movement of the viewing angle VA towards the normal position VP1.

[0160] In the sign recognition assistance display of Mode 4, the change warning image Ppn and the location notification image Ptp, which are essentially the same as those in Mode 2, are displayed as recognition assistance content CTra (see reference). Figure 31 (Upper and middle parts). In mode 4, the shape of the wavy image Pw is different from that in mode 2. Specifically, after the display control unit 73 tilts the change preview image Ppn inward, it displays a wavy image Pw that extends radially from the change preview image Ppn in an arc shape (see reference). Figure 31(Lower part). After repeatedly displaying the animation that expands the ripple image Pw starting from the change preview image Ppn, the display control unit 73 ends the display of the recognition auxiliary content CTra.

[0161] based on Figure 32 and Figure 33 , refer to Figure 1 and Figure 4 The details of the display control processing used to implement the virtual image display method described above are explained. Figure 32 The display control process shown is the process of displaying content in association with the position of the viewing angle VA, which starts from the head-up ECU 70 after the initial processing is completed. Figure 33 The display control process shown is the process of changing the state of the detailed information PDi displayed on the screen according to the movement of the viewing angle VA based on HUD100, which starts from the instrument ECU32 after the initial processing after startup.

[0162] exist Figure 32 In the display control process S101 shown, a signal indicating the on / off state of the AR switch 68 is detected, and the process proceeds to S102. In S102, based on the signal detected in S101, it is determined whether the AR function for displaying overlapping content CTs within the viewing angle VA moving towards the overlapping position VP2 is in an on state. If it is determined in S102 that the AR function is in an off state, the process proceeds to S112. On the other hand, if it is determined in S102 that the AR function is in an on state, the process proceeds to S103.

[0163] In S103, based on the various information acquired by the information acquisition unit 71 and referring to the checklist 81, the position of the viewpoint VA and the content of the virtual image display are determined, and the process proceeds to S104. In S104, based on the decision in S103, it is determined whether a switching operation of the viewpoint VA's position needs to be performed. In S104, if it is determined that no switching operation is needed and the current viewpoint position is maintained, the process proceeds to S111. On the other hand, in S104, if it is determined that a switching operation is needed, the process proceeds to S105.

[0164] In S105, the direction of the switching operation is determined. If the viewing angle VA is moved from the overlapping position VP2 to the normal position VP1, the process proceeds from S105 to S106. In S106, the display of all virtual images Vi ends, and the process proceeds to S107. In S107, based on the mirror position data 82 associated with the normal position VP1, the concave mirror of the magnifying optical system 62 is rotated, causing the viewing angle VA to move towards the normal position VP1.

[0165] On the other hand, when the viewing angle VA is moved from the normal position VP1 to the overlapping position VP2, the process proceeds from S105 to S108. In S108, referring to graphic data 84, the display of the first associated content CTr1 begins, and the process proceeds to S109. In S109, based on the mirror position data 83 associated with the overlapping position VP2, the movement of the viewing angle VA based on the rotation of the concave mirror towards the overlapping position VP2 begins, and the process proceeds to S110. In S110, referring to graphic data 85, the display of the second associated content CTr2 begins, and the process proceeds to S111. Furthermore, if there is no first associated content CTr1 associated with a specific content CTis, S108 can be omitted. Similarly, if there is no second associated content CTr2 associated with a specific content CTis, S110 can be omitted.

[0166] In S111, the viewpoint position is determined. If it is determined in S111 that the normal position VP1 is maintained, or that the movement to the normal position VP1 is completed, proceed to S112. In S112, based on the mirror position data 82, the viewpoint VA is set to the normal position VP1, and proceed to S113. In S113, referring to the graphic data 84, the display of the non-overlapping content CTn determined in S103 begins. Furthermore, if the mirror position data 82 for the normal position VP1 has already been read in S107, S112 can be omitted.

[0167] On the other hand, if it is determined in S111 that the overlapping position VP2 is maintained, or the movement towards the overlapping position VP2 is completed, then proceed to S114. In S114, based on the mirror position data 83, the viewing angle VA is set to the overlapping position VP2, and proceed to S115. In S115, referring to the graphic data 85, the display of the overlapping content CTs determined in S103 begins. Furthermore, if the mirror position data 83 of the overlapping position VP2 has already been read in S109, S114 can be omitted.

[0168] exist Figure 33 In the display control process S31 shown, the position of the viewing angle VA set by the HUD 100 is determined through information sharing with the head-up ECU 70, and then proceeds to S32. In S32, based on the information obtained in S31, it is determined whether the viewing angle position switching operation has occurred. In S32, if it is determined that the viewing angle position should be maintained, the current display or non-display state of the detailed information PDi is maintained. Furthermore, in the initial processing after startup, the process of starting the display of the detailed information PDi can be appropriately implemented.

[0169] If a switching operation is detected in S32, proceed to S33. In S33, determine the direction of movement of the viewing angle VA. If it is determined in S33 that the viewing angle VA is moving towards the normal position VP1, proceed to S34. In S34, wait for the display of the overlapping content CTs in HUD100 to become disconnected, and proceed to S35 when the overlapping content CTs become inactive. In S35, begin displaying the detailed information PDi. Through the above, while the viewing angle VA is in the normal position VP1, the detailed information PDi is displayed on the screen so that the driver can check it at any time.

[0170] If it is determined in S33 that the viewing angle VA has moved to the overlapping position VP2, proceed to S36. In S36, wait for the movement of the viewing angle VA to begin, and at the timing of the start of the movement of the viewing angle VA, proceed to S37. In S37, begin to reduce the hue of the detailed information PDi. Thus, during the movement of the viewing angle VA from the normal position VP1 to the overlapping position VP2, TM1, a morphological change is performed to reduce the visual recognizability of the detailed information PDi. Furthermore, in S37, by continuing the hue reduction, at the timing of the completion of the viewing movement to the overlapping position VP2, the detailed information PDi is set to a non-display state.

[0171] According to the first embodiment described above, the associated content CTr, which is linked to the specific content CThis, is displayed before the viewpoint VA completes its movement from the normal position VP1 to the overlapping position VP2. Therefore, the time lag before the display begins, caused by the movement of the viewpoint VA based on actuator 63, is difficult for occupants of vehicle A, such as the driver, to perceive. Thus, even if actuator 63 is provided to extend the viewpoint VA capable of displaying a virtual image, the sense of display incongruity can be reduced. As a result, the convenience of the HUD 100 can be improved.

[0172] In particular, in high-urgency scenarios, when information prompts using overlapping content CTs are provided, reducing latency is essential for rapid notification. Therefore, processing that displays related content CTRs in advance of specific content CTs can effectively improve the convenience of virtual image display.

[0173] Furthermore, in the first embodiment, at the moment t1 when the movement based on the viewpoint VA of the actuator 63 begins (refer to...) Figure 4 Before the lane departure warning is activated, the associated content CTR (first associated content CTR1) is displayed. As an example, with the lane departure warning activated, the flashing background CTB is displayed as associated content CTR before the viewpoint VA begins to move. Since such associated content CTR begins displaying immediately after the viewpoint position is determined, the perceived delay in display is reduced. As a result, the driver is more likely to perceive that the system on the vehicle side is functioning correctly.

[0174] Furthermore, in the first embodiment, the second associated content CTr2, which has a different form from the first associated content CTr1, moves based on the viewpoint VA of the actuator 63 (during the movement TM1, see reference). Figure 4 As an example, following the implementation of the lane departure warning, after the flashing background CTB is displayed, guidance content CTGn and CTGs are displayed as second associated content CTR2 within the moving viewpoint VA. The first associated content CTR1 and the second associated content CTR2, in different forms, are displayed at different viewpoints, thereby guiding the driver's gaze toward the overlapping position VP2 where the specific content CTIs is displayed. As a result, the driver's perception of the specific content CTIs becomes smoother, thus achieving a highly convenient virtual image display.

[0175] Furthermore, in the first embodiment, during the movement of the field of view VA based on actuator 63 (during movement TM1, see reference 63), Figure 4 The associated content CTR is then displayed. As an example, with the implementation of the ACC status change notification, a portion of the displayed content CTus is shown as the associated content CTR within the moving viewpoint VA. This associated content CTR, along with the specific content CTis displayed at the overlapping position VP2, is continuously visually recognized, thus enabling the driver's gaze to be slowly guided towards the specific content CTis. Based on this, the driver's perception of the specific content CTis becomes smooth, thus achieving a highly convenient virtual image display.

[0176] Furthermore, in the first embodiment, an overlap position VP2 is defined above the normal position VP1, and the display control unit 73 causes specific content CTis to overlap with an object in the foreground. Based on this operation of the HUD 100, highly attractive overlapping content CTis can be displayed at an appropriate timing in a position easily noticed by the driver. Therefore, information prompts that are easy for the driver to understand and not easily perceived as complex can be achieved.

[0177] On the other hand, the normal position VP1 is positioned below. In this normal position VP1, overlapping content CTs are not displayed, thus the information density on the normal position VP1 can be appropriately suppressed. Based on the above, when the viewing angle VA exists in the normal position VP1, information cues that are less likely to be perceived as complex are implemented.

[0178] Furthermore, in the first embodiment, when the departure warning content CTdw, which warns of the departure of vehicle A, is displayed as specific content CTis, the guidance content CTGn, which moves visually to the driver according to the movement of the viewing angle VA, is displayed as associated content CTR. Even if such guidance content CTGn is a simple virtual image Vi, the driver's gaze can be pre-guided to the overlapping position VP2 through visual movement. As a result, the departure warning content CTdw is easily noticeable, achieving a highly convenient virtual image display.

[0179] Furthermore, in the first embodiment, when the departure warning content CTdw is displayed as specific content CTis, the guidance content CTGs that move towards the vanishing point during the movement of the viewing angle VA are displayed as associated content CTR. Such guidance content CTGs can guide the driver's gaze to the distant part of the foreground. As a result, visual recognition of the departure warning content CTdw displayed at the overlapping position VP2 is successfully achieved. Therefore, highly convenient virtual image display is possible.

[0180] Furthermore, in the first embodiment, when the workshop notification content CTfd is displayed as specific content CTis, a portion of the workshop notification content CTfd, namely the partial display content CTus, is displayed as associated content CTr within the viewing angle VA of TM1 during movement. The partial display content CTus can achieve the visual effect of starting the display of the workshop notification content CTfd before the movement of the viewing angle VA is completed. As a result, the time lag from the change of the workshop maintenance control setting to the start of the display of the workshop notification content CTfd is reduced. Thus, if the responsiveness of the display system 110 perceived by the driver is improved, the driver can more easily perceive that the system of vehicle A is responding appropriately.

[0181] Furthermore, in the first embodiment, when the path guidance content CTrg is displayed as specific content CDis, the lane emphasis content CTeel, which highlights the lane of the vehicle in motion, is displayed as associated content CTr. This lane emphasis content CTeel can cooperate with the path guidance content CTrg to predict the future trajectory of the vehicle. As a result, easily understandable path guidance utilizing the expanded viewing angle VA can be implemented, thus further improving the convenience of virtual image display.

[0182] Furthermore, according to the display system 110 of the first embodiment, in coordination with the switching of the position of the viewing angle VA based on the actuator 63, the instrument display device 30 changes the displayed screen. Based on this coordination of virtual image display and screen display, driver-based information can be easily obtained, and the driver's gaze can be appropriately directed towards the foreground. Therefore, highly convenient information prompts are achieved.

[0183] Furthermore, in the first embodiment, while the viewing angle VA is in the normal position VP1, the detailed information PDi associated with the specific content CTis is displayed on the screen. Moreover, once the viewing angle VA has moved to the overlapping position VP2, the detailed information PDi becomes undisplayed. Thus, if the detailed information PDi is temporarily undisplayed, it is less likely that the driver's attention drawn to the detailed information PDi will be obstructed from the content displayed at the overlapping position VP2 and from the driver's understanding of the situation ahead. Therefore, driver convenience is further ensured.

[0184] Furthermore, in the first embodiment, during the movement TM1 of the viewing angle VA from the normal position VP1 to the overlapping position VP2, a morphological change that reduces the visual recognizability of the detailed information PDi is implemented. Thus, even if the driver's attention is focused on the detailed information PDi, the morphological change that reduces visual recognizability allows the driver's gaze to naturally shift away from the detailed information PDi and be guided to the virtual image display. As a result, the driver can be prompted to grasp the situation ahead at appropriate timing.

[0185] Furthermore, in the first embodiment, the guiding content CTGn and CTGs are equivalent to "moving content", the partial display content CTus is equivalent to "a part of (workshop notification content)", the normal position VP1 is equivalent to "first position", and the overlapping position VP2 is equivalent to "second position". The instrument display device 30 is equivalent to "screen display device", the actuator 63 is equivalent to "switching mechanism", and the HUD 100 is equivalent to "virtual image display device".

[0186] (Second Implementation)

[0187] Figure 34 as well as Figure 35 The second embodiment of this disclosure shown is a variation of the first embodiment. The display system 210 of the second embodiment comprises an instrument display device 30 and a HUD 200, etc. The function of outputting image data for virtual image display from the instrument display device 30 to the HUD 200 in the second embodiment is omitted. All image data for virtual image display is generated by the head-up ECU 70.

[0188] The HUD200 includes a projection unit 260, a mirror actuator 263, and a unit actuator 264. The projection unit 260 is an integral structure including a PGU 61 and a magnifying optical system 62. The projection unit 260 can move the virtual image light Lvi (see reference) vertically. Figure 1 The ejection direction is supported by the housing of HUD200.

[0189] The mirror actuator 263 and the unit actuator 264 are equivalent to the actuator 63 in the first embodiment (see reference). Figure 2The structure of the windshield WS is such that the projection area PA (refer to) is within the windshield WS. Figure 1 The mechanism for mechanically moving the area of ​​the projection unit 260. The mirror actuator 263, assembled in the projection unit 260, rotates the concave mirror about a rotation axis defined by the concave mirror of the magnifying optical system 62. The unit actuator 264 rotates the entire projection unit 260 about a rotation axis defined by the projection unit 260 relative to the housing of the HUD 200. The mirror actuator 263 and the unit actuator 264 cooperate to change the emission direction of the virtual image light Lvi from the magnifying optical system 62 to the windshield WS.

[0190] The HUD200 switches the position of the viewing angle VA among three locations by changing the posture of the projection unit 260 and the magnifying optical system 62 within the projection unit 260. In addition to the normal position VP1 and overlapping position VP2, which are substantially the same as in the first embodiment, the HUD200 can also move the viewing angle VA to a predetermined far position VP3, which is above the overlapping position VP2. In the second embodiment, the normal position VP1, overlapping position VP2, and far position VP3 can be adjusted according to the driver's body size and other factors through user operation.

[0191] In the normal position VP1, non-overlapping content CTn is primarily displayed. For example, the speedometer CTv and sign icons CTrs are displayed in the normal position VP1. Overlapping content CTs are not actually displayed in the normal position VP1. On the other hand, overlapping content CTs are primarily displayed in the overlapping position VP2 and the distant position VP3. For example, lane emphasis content CTel and route guidance content CTrg are displayed in the overlapping position VP2 and the distant position VP3. In particular, the location notification image Ptp is overlapped in the distant position VP3, for example.

[0192] When the head-up ECU70 moves the viewing angle VA from the normal position VP1 to the overlapping position VP2 or the distant position VP3, it displays, as in the first embodiment, associated content CTr (see reference) that is pre-established with specific content CTis. Figure 21 as well as Figure 23 Additionally, when moving from the overlapping position VP2 to the distant position VP3, the head-up ECU70 is also able to display the associated content CTR.

[0193] Based on the above, the second embodiment also achieves the same effect as the first embodiment: the time lag before the display starts caused by the viewing angle movement based on each actuator 263, 264 is difficult for the driver to perceive. Therefore, even if the viewing angle VA capable of displaying virtual images is extended, the sense of incongruity in the display is reduced, thus improving the convenience of the HUD200.

[0194] Furthermore, in addition to the normal position VP1 and the overlapping position VP2, the HUD200 in the second embodiment can also move the viewing angle VA to the distant position VP3. Based on the above, the range capable of displaying virtual images can be further expanded, thus further improving the convenience of the HUD200. Moreover, in the second embodiment, the mirror actuator 263 and the unit actuator 264 are equivalent to a "switching mechanism," and the HUD200 is equivalent to a "virtual image display device."

[0195] (Third Implementation)

[0196] Figures 36-50 The third embodiment of this disclosure shown is another variation of the first embodiment. In the third embodiment, in addition to the camera ECU 21, navigation ECU 22, and driver assistance ECU 23, the communication bus of the vehicle network connected to the HUD 100 and the instrument display device 30 is also connected to the radar ECU 24 and the vehicle communication unit 25.

[0197] The radar ECU24 is a circuit device mainly composed of the signal processing circuitry contained in the radar unit, and is electrically connected to the antenna for transmitting and receiving millimeter-wave or quasi-millimeter-wave signals. Similar to the vehicle-mounted camera (front-facing camera), the radar unit is mounted on vehicle A (refer to...) in a configuration and orientation that sets the area in front of the vehicle as the detection range. Figure 1 The radar ECU 24 detects the relative position (distance and direction) and relative speed of objects in front of the vehicle by receiving reflected millimeter-wave or quasi-millimeter-wave waves emitted towards the front of the vehicle. The radar ECU 24 provides the information indicating the relative position and relative speed of the detected objects to the driver assistance ECU 23 as forward object detection information. Furthermore, multiple radar units can be mounted on vehicle A in a configuration that includes the front, rear, and rear sides of the vehicle as detection ranges. Additionally, autonomous sensors, such as optical radar and sonar, which differ from cameras and millimeter-wave radar, can also be mounted on vehicle A.

[0198] The vehicle-to-everything (V2X) communication unit 25 is an external communication unit installed in vehicle A, functioning as a V2X (Vehicle to Everything) communication unit. The V2X communication unit 25 wirelessly transmits and receives information with roadside units located on the side of the road. The V2X communication unit 25 receives object information from the roadside units located at intersections, indicating the position and speed of moving objects entering the intersection. Specifically, the V2X communication unit 25 receives object information related to vehicles, motorcycles, cyclists, and pedestrians entering the intersection. The V2X communication unit 25 provides the received object information to the driver assistance ECU 23.

[0199] The vehicle-mounted communication unit 25 receives location information (hereinafter, parking space information) of vacant parking spaces PkS from roadside units installed on the side of roads where on-street parking is permitted, or from roadside units installed in parking lots of facilities (e.g., shopping malls). When the utilization of parking spaces PkS is managed by a specific management center, the vehicle-mounted communication unit 25 can also collaboratively reserve parking spaces PkS with the navigation ECU 22. The vehicle-mounted communication unit 25 provides the parking space information received from the roadside units to the navigation ECU 22 and the driver assistance ECU 23.

[0200] Next, details will be provided regarding the specific content CTis and associated content CTR displayed by the display system 110 of the third embodiment. In addition to lane departure warnings, ACC status change notifications, and turn prompts similar to those in the first embodiment, the display system 110 can also implement forward landmark warnings, parking space guidance, narrow road driving assistance displays, and field of vision assistance displays. The following is based on... Figures 37-50 , refer to Figure 36 as well as Figure 1 The paper also describes several scenarios in which the viewpoint VA is moved from the normal position VP1 to the overlapping position VP2 to display specific content CTis.

[0201] <Ahead Warning>

[0202] exist Figure 37 as well as Figure 38 In the forward beacon warning shown, the driver is alerted to the presence of a risk beacon Tr approaching ahead of vehicle A. The risk beacon Tr, which is the subject of the warning, is identified by the driver assistance ECU 23 as other vehicles, motorcycles, cyclists, pedestrians, etc. The forward beacon warning is implemented based on the detection of the risk beacon Tr by the driver assistance ECU 23.

[0203] The driver assistance ECU 23 identifies moving objects in front of the vehicle based on detection information obtained from the camera ECU 21 and radar ECU 24, and object information obtained through the vehicle communication unit 25. The driver assistance ECU 23 identifies moving objects that are close to vehicle A (the vehicle itself), i.e., moving objects whose predicted trajectory intersects with the vehicle's predicted trajectory, as risk objects Tr. When a risk object Tr is detected, the driver assistance ECU 23 provides risk object information, indicating the detected risk object Tr and its relative position, to the head-up ECU 70 and the instrument cluster ECU 32. Furthermore, when multiple risk objects Tr are detected, the driver assistance ECU 23 can provide risk object information for each risk object Tr.

[0204] Before initiating a forward target warning, the display control unit 73 displays the speedometer CTv (see reference CTn) as non-overlapping content in the viewing angle VA of the normal position VP1. Figure 5 (Upper part). The display control unit 73 determines the implementation of a forward object warning based on the acquisition of risk object information by the information acquisition unit 71.

[0205] If the display control unit 73 decides to implement the foreground object warning, it continues to display the speedometer CTv and displays the warning image Pai and the direction indication image Ptd (see reference). Figure 37 (Upper part). The warning image Pai and the directional indicator image Ptd are displayed as non-overlapping content CTn at the lower edge of the viewing angle VA, arranged horizontally with the speedometer CTV. The warning image Pai and the directional indicator image Ptd are displayed as associated content CTR in the forward object warning.

[0206] The warning image Pai is displayed as a virtual image in a warning color, such as yellow. The warning image Pai is used to notify the driver that the sensor has detected a risk object Tr and to draw the driver's attention. The warning image Pai is set to be an image primarily composed of an exclamation mark. If the type of risk object Tr is not determined by the driver assistance ECU 23, the warning image Pai is preferably in a form that does not indicate the type of risk object Tr. However, if the driver assistance ECU 23 can accurately determine the type of risk object Tr, the form of the warning image Pai can be appropriately changed to indicate the type of risk object Tr.

[0207] The directional warning image Ptd is displayed as a virtual image in a color substantially the same as the warning image Pai (e.g., yellow). By combining with the warning image Pai, the directional warning image Ptd informs the direction of approach and movement of the hazard object Tr. When the hazard object Tr approaches from the right front of the vehicle, the directional warning image Ptd is depicted as a V-shape indicating a left turn and displayed to the right of the warning image Pai. Conversely, when the hazard object Tr approaches from the left front of the vehicle, the directional warning image Ptd is depicted as a V-shape indicating a right turn and displayed to the left of the warning image Pai.

[0208] The display control unit 73 at time t1 (refer to...) Figure 4 Before the start of the movement of the viewpoint VA, the display of the speedometer CTV ends. If the display control unit 73 starts the movement of the viewpoint VA, it uses the already displayed warning image Pai and direction prompt image Ptd as guidance content CTGt (see reference). Figure 37 (Lower section). The guiding content CTGt is during the movement of the viewpoint VA (TM1 during movement, see below). Figure 4The guide content CTGt moves towards the risk object Tr in the foreground, thereby guiding the driver's line of sight to the risk object Tr. This guide content CTGt can be either non-overlapping content CTn or overlapping content CTs.

[0209] The display control unit 73 reduces the display size of the guide content CTGt towards the center of the viewing angle VA as the viewing angle VA moves upward. As a result, the center of the guide content CTGt slightly shifts towards the center of the viewing angle VA as the viewing angle VA moves upward. The display control unit 73 sets the guide content CTGt to not be displayed until the viewing angle VA has completed its movement towards the overlap position VP2. Based on the above, the guide content CTGt that moves towards the vanishing point in the foreground and then disappears is displayed.

[0210] Here, the display control unit 73 can also change the movement direction of the guidance content CTGt of TM1 during movement according to the left-right direction of the risk object Tr. For example, when the risk object Tr approaches from the right front of the vehicle, the display control unit 73 shifts the display position of the guidance content CTGt to the right of the viewing angle VA during movement. On the other hand, when the risk object Tr approaches from the left front of the vehicle, the display control unit 73 shifts the display position of the guidance content CTGt to the left of the viewing angle VA during movement. Based on the above, the guidance content CTGt can guide the driver's line of sight to the risk object Tr with high precision.

[0211] If the display control unit 73 is at time t2 (refer to...) Figure 4 Once the viewpoint VA is moved to the overlapping position VP2, the object warning content CTta will begin to be displayed (see reference). Figure 38 (Upper part). The sign warning content CTta is a specific content CTis in the forward sign warning. The sign warning content CTta is the overlapping content CTs of the risk sign Tr in the foreground as the overlapping object, warning of the risk sign Tr generated in front of vehicle A. The sign warning content CTta is displayed overlappingly at a certain distance away from the risk sign Tr, so that the risk sign Tr as the overlapping object is not hidden in the driver's vision.

[0212] The object warning content CTta is an animated display using the basic arrow image Pta1 and the emphasized arrow image Pta2 (see reference). Figure 38 (Lower section). Basic arrow image Pta1, emphasis arrow image Pta2, and directional cue image Ptd (see reference). Figure 37Similarly, a V-shaped image indicating the direction of movement of the risk object Tr is superimposed on the lower side of the risk object Tr in the foreground. The basic arrow image Pta1 is displayed as a virtual image, for example, in white. The emphasis arrow image Pta2 is displayed as a virtual image in warning colors such as yellow and amber, which are more attractive than the basic arrow image Pta1. The emphasis arrow image Pta2 repeatedly moves toward the basic arrow image Pta1 according to the direction of movement of the risk object Tr.

[0213] When the risk object Tr approaches from the right front of the vehicle, the display control unit 73 displays a basic arrow image Pta1 indicating the left direction and an emphasis arrow image Pta2 near the right edge of the viewing angle VA (see reference). Figure 38 (Lower section). The display control unit 73 plays an animation that repeatedly moves the emphasized arrow image Pta2, which is displayed to the right of the basic arrow image Pta1, to the left. On the other hand, when the risk marker Tr approaches from the left front of the vehicle, the display control unit 73 displays the basic arrow image Pta1 indicating the right direction and the emphasized arrow image Pta2 near the left edge of the viewing angle VA. The display control unit 73 plays an animation that repeatedly moves the emphasized arrow image Pta2, which is displayed to the left of the basic arrow image Pta1, to the right.

[0214] When the hazard marker Tr reaches approximately the center of the viewing angle VA, the display control unit 73 terminates the display of the hazard warning content CTta so as not to obstruct the driver's direct visual recognition of the hazard marker Tr. After setting the hazard warning content CTta to be inactive, the display control unit 73 moves the viewing angle VA from the overlapping position VP2 to the normal position VP1. Based on the above, the forward hazard warning ends.

[0215] <Parking Space Guidance>

[0216] exist Figures 39-42 The parking space guidance shown directs the driver to an available parking space PkS (refer to...). Figure 42 Parking space guidance is implemented, for example, as part of route guidance based on navigation ECU 22. When setting the destination and route, navigation ECU 22 asks the driver if they wish to reserve a parking space PkS near the destination. Based on the user's action of instructing to reserve a parking space PkS, navigation ECU 22 decides whether to implement parking space guidance at the end of the route guidance process.

[0217] Based on parking space information acquired via the vehicle communication unit 25, the navigation ECU 22 determines the location of the parking space PkS for parking vehicle A. When the remaining distance to the determined parking space PkS is less than a predetermined guidance start distance (e.g., approximately 100m), the navigation ECU 22 requests the head-up ECU 70 and the instrument cluster ECU 32 to begin parking space guidance. During parking space guidance, the accurate determination of the location of the vacant parking space PkS can also be assisted by the driver assistance ECU 23, which acquires detection information from the camera ECU 21 or the radar ECU 24.

[0218] The display control unit 73, triggered by the information acquisition unit 71 receiving a request to implement parking space guidance, begins displaying the parking guidance content CTpn (see reference). Figure 39 (Upper part). The parking guidance content CTpn is displayed together with the speedometer CTv within the view VA located in the normal position VP1. The parking guidance content CTpn is non-overlapping content CTn, which includes the remaining distance image Prd, the cost image Ppp, and the direction guidance image Ppd.

[0219] The remaining distance image Prd represents the remaining distance to the parking space PkS. The fee image Ppp indicates the fee for using the parking space PkS. The parking fee information displayed by the fee image Ppp can be included in the parking space information or pre-stored in the map database referenced by the navigation ECU22. The direction guidance image Ppd indicates whether the parking space PkS is located on the left or right side of the vehicle. The direction guidance image Ppd includes a parking icon Ppi containing the letter "P". The parking icon Ppi is depicted as being tilted inwards from the driver's perspective, displayed in a shape that is attached to the road surface ahead.

[0220] The display control unit 73 continues to display the parking guidance content CTpn until the remaining distance to the parking space PkS is less than a predetermined approach distance (e.g., about 30m). When the remaining distance is less than the approach distance, the display control unit 73 begins to display the approach notification content CTan (see reference). Figure 39 (Lower section). The proximity notification content CTan is displayed as the associated content CTR in the parking space guidance, notifying the parking space PkS of its approach. The display control unit 73 will animate the parking icon Ppi to stand upright in a position perpendicular to the road surface as the proximity notification content CTan.

[0221] Upon displaying the proximity notification content CTan, the display control unit 73 lowers the color tone of each image in the parking guidance content CTpn (excluding the parking icon Ppi) and the speedometer CTv. By lowering the color tone, the display control unit 73 makes the images in the parking guidance content CTpn and the speedometer CTv non-displayable, displaying only the parking icon Ppi (see reference). Figure 40 The parking icon Ppi glows brightly for a short time, then disappears in the direction of the parking space PkS.

[0222] After setting the parking icon Ppi to non-display, the display control unit 73 begins moving the viewing angle VA from the normal position VP1 to the overlapping position VP2. After completing the movement of the viewing angle VA to the overlapping position VP2, the display control unit 73 begins displaying the parking guidance content CTps (see reference). Figure 41 (Upper part). Parking guidance content CTps is specific content CTis in parking space guidance, which is the overlapping content CTs of the road surface ahead as overlapping objects.

[0223] Parking guidance content CTps includes a parking icon Ppi and directional guidance images Ppd1 and Ppd2. The parking icon Ppi gradually appears from the direction of the parking space PkS into the viewing angle VA, and then reappears within the viewing angle VA. The parking icon Ppi is displayed near the left and right edges within the viewing angle VA, on the side where the parking space PkS exists. The parking icon Ppi is displayed in a form similar to a signboard that is upright relative to the ground.

[0224] The directional guidance image Ppd1 is displayed in the approximate center of the viewing angle VA, arranged horizontally alongside the parking icon Ppi. The directional guidance image Ppd1 includes multiple (three) triangular image portions indicating the direction of the parking icon Ppi. The directional guidance image Ppd1 begins to appear alongside the parking icon Ppi and moves downwards within the viewing angle VA along with the parking icon Ppi as the parking space PkS approaches.

[0225] The directional guidance image Ppd2 begins to display at a timed interval when a portion of the parking space PkS enters the viewing angle VA (see reference). Figure 41 (Lower section). The directional guidance image Ppd2 is displayed above the directional guidance image Ppd1, making it more noticeable from the inside of the directional guidance image Ppd1. Like the directional guidance image Ppd1, the directional guidance image Ppd2 includes multiple (three) triangular image sections indicating the direction of the parking space PkS.

[0226] The display control unit 73 moves the direction guidance image Ppd2 downwards according to the movement of vehicle A. As a result, each image segment of the direction guidance image Ppd2 collides sequentially with each image segment of the direction guidance image Ppd1 (see reference). Figure 42 (Upper part). The directional guidance images Ppd1 and Ppd2 cause the colliding image parts to light up and then disappear sequentially, becoming non-displayable. Based on the above, the state becomes one where only the parking icon Ppi is displayed as parking guidance content CTps.

[0227] The display control unit 73 continuously displays parking guidance content CTps (specific content CTis), and begins to move the viewing angle VA from the overlapping position VP2 to the normal position VP1. Based on the movement of vehicle A, in other words, based on the driver's visual approach to the parking space PkS, the display control unit 73 moves the viewing angle VA downwards. As a result, the parking icon Ppi continuously overlaps near the parking space PkS. At the precise time when vehicle A enters the parking space PkS, the display control unit 73 changes the parking icon Ppi to a shape buried in the ground (see reference). Figure 42 (Lower section) The driver is notified of arrival at the parking space PkS, which is the destination. After vehicle A arrives at the parking space PkS, and at a time when the parking space PkS is outside the viewing angle VA, the display control unit 73 sets the parking icon Ppi to be undisplayed. Based on the above, the parking space guidance ends.

[0228] <Narrow Road Driving Assist Display>

[0229] Figures 43-46 The narrow road driving assist shown is implemented in a narrow road driving scenario where vehicle A is traveling on a narrow road, assisting the driver's steering operations. A narrow road is a driving space PaS that is slightly wider than the overall width of vehicle A (see reference). Figure 43 A narrow road can be a road with a narrow width, or it can be a drivable area between a parked vehicle and the shoulder. The driver assistance ECU 23, based on detection information from the camera ECU 21 or radar ECU 24, diagnoses whether the driving space PaS in front of the vehicle is equivalent to a narrow road. If the driver assistance ECU 23 diagnoses that there is a narrow road in front of the vehicle, it decides to implement the narrow road driving assistance display, requiring the head-up ECU 70 and instrument cluster ECU 32, etc., to start the narrow road driving assistance display.

[0230] Furthermore, the road width (PaS) of the narrow driving space diagnosed as a narrow road can be automatically adjusted according to the driver's driving skill. The more skilled the driver, the narrower the road width at which the narrow road driving assist display is implemented, as determined by the driver assistance ECU 23. Additionally, the driver assistance ECU 23 can also determine the implementation of the narrow road driving assist display based on user input from the driver. Furthermore, if the road width in front of the vehicle is the same as or narrower than the vehicle width, meaning that passage is practically impossible, the driver assistance ECU 23 will not implement the narrow road driving assist display.

[0231] The display control unit 73 begins displaying the guidance content CTGp upon receiving an implementation request for a narrow-road driving assistance display from the information acquisition unit 71. The guidance content CTGp is ​​the associated content CTR in the narrow-road driving assistance display. The display control unit 73 sequentially displays the narrow-road notification image Pnn and the narrow-road emphasis image Pen as the guidance content CTGp.

[0232] The narrow-path notification image Pnn, arranged in a configuration with the speedometer CTv within the viewpoint VA of the normal position VP1, is displayed as the first associated content CTR1 (refer to). Figure 43 The narrow road notification image Pnn is non-overlapping content CTn with a predefined display shape and display position within the viewing angle VA. The narrow road notification image Pnn informs the driver that there is a narrow road ahead of the vehicle and shows the driver that vehicle A can pass through the narrow road ahead.

[0233] The display control unit 73 at time t1 (refer to...) Figure 4 Before the viewpoint VA begins to move, the narrow path notification image Pnn and the velocity gauge CTv are set to not display. Then, the narrow path emphasis image Pen is displayed as the second associated content CTr2 (see reference). Figure 44 (Upper part). The narrow path emphasis image Pen is associated content CTr with a different form than the narrow path notification image Pnn. The display control unit 73 starts displaying the narrow path emphasis image Pen before the starting viewing angle VA moves from the normal position VP1 to the overlapping position VP2, and continues displaying the narrow path emphasis image Pen until the movement of the viewing angle VA to the overlapping position VP2 is completed.

[0234] When the viewing angle VA is in the normal position VP1, the display control unit 73 displays a narrow, horizontally elongated image Pen (see reference) that is connected to the lower edge of the viewing angle VA and extends in the left-right direction. Figure 44 (Upper part). The narrow road emphasis image (Pen) is the overlapping content (CTs) that overlaps with the road surface in front of the vehicle. The lateral length of the narrow road emphasis image (Pen) is adjusted according to the road width (PaS) of the driving space in front of the vehicle.

[0235] The display control unit 73 moves upward according to the viewing angle VA (during the movement TM1, refer to...). Figure 4 This expands the narrow-path emphasis image Pen along the vertical direction (see reference). Figure 44 (Middle section). As a result, the narrow road emphasis image Pen is depicted as a trapezoidal shape tilted inward from the driver's perspective, displayed in a form that is close to the road surface in front. The narrow road emphasis image Pen moves as guiding content CTGp towards the driving space PaS in the foreground, thereby guiding the driver's line of sight to the driving space PaS. The narrow road emphasis image Pen completes its movement from the viewing angle VA to the overlapping position VP2 at time t2 (refer to...). Figure 4 ), overlapping with the driving space PaS, forming a shape that covers the entire driving space PaS (see reference). Figure 44 (Lower part)

[0236] After completing the movement of the viewing angle VA to the overlapping position VP2, the display control unit 73 ends the display of the narrow road emphasis image Pen (guidance content CTGp) and begins the display of the narrow road driving assistance content CTnr (see reference). Figure 45 (Upper part). Narrow road driving assistance content CTnr is specific content CTis in the narrow road driving assistance display. It is the overlapping content CTs of objects that are set as overlapping objects in the driving space PaS, just like the narrow road emphasis image Pen. The display control unit 73 displays the left boundary image Pnl and the right boundary image Pnr as narrow road driving assistance content CTnr within the viewing angle VA located at the overlapping position VP2.

[0237] The left boundary image Pnl is a line image overlapping the left boundary of the driving space PaS. The right boundary image Pnr is a line image overlapping the right boundary of the driving space PaS. The left boundary image Pnl and the right boundary image Pnr show the driver the road surface range that constitutes the driving space PaS. Assuming the vehicle is traveling straight as before, the display control unit 73 changes the display color of the left boundary image Pnl and the right boundary image Pnr according to the width of the lateral distance ensured between each boundary of the driving space PaS and the vehicle A. Specifically, when the distance between the boundary and the vehicle A is ensured, the display control unit 73 displays the left boundary image Pnl and the right boundary image Pnr in white or blue, etc. On the other hand, when the distance between the boundary and the vehicle A is insufficient, below a certain value, the display control unit 73 displays the left boundary image Pnl and the right boundary image Pnr in yellow or amber, etc.

[0238] If vehicle A approaches the driving space PaS, the display control unit 73 continues to display the narrow road driving assistance content CTnr (specific content CTis), and begins to move the viewing angle VA from the overlapping position VP2 to the normal position VP1. The display control unit 73 moves the viewing angle VA downwards according to the movement of vehicle A, in other words, according to the driver's visual perception of the approaching driving space PaS. During the downward movement of the viewing angle VA (during the movement TM2, see...), the display control unit 73... Figure 4 Add the vehicle's position image (Pmf) to the narrow road driving assistance content (CTnr) (refer to...). Figure 45 (Lower part)

[0239] The vehicle position image Pmf is an image representing the future position of vehicle A. The vehicle position image Pmf is a horizontally elongated shape, similar to the front bumper of vehicle A, and is displayed near the lower edge of the viewing angle VA with a width corresponding to the width of the vehicle. The vehicle position image Pmf is displayed between the left boundary image Pnl and the right boundary image Pnr, thus visually showing the ratio of the lateral width of the driving space PaS to the width of the vehicle. The vehicle position image Pmf moves left and right between the left boundary image Pnl and the right boundary image Pnr according to the driver's steering operation. If the driving position of vehicle A is too close to the left side of the driving space PaS, the left portion of the vehicle position image Pmf and the left boundary image Pnl turn into a warning color, prompting the driver to steer to the right. On the other hand, if the driving position of vehicle A is too close to the right side of the driving space PaS, the right portion of the vehicle position image Pmf and the right boundary image Pnr turn into a warning color, prompting the driver to steer to the left. Through the above display changes, the narrow road driving assistance function CTnr assists the driver in driving on narrow roads.

[0240] The display control unit 73 displays the time t4 (refer to) when the viewpoint VA completes its movement to the normal position VP1. Figure 4 The display of CTnr (CT driver assistance features) will continue in the future (see reference). Figure 46 Therefore, while vehicle A is traveling within the driving space PaS, narrow-road driving assistance content CTnr continuously assists in narrow-road driving. When vehicle A passes through the driving space PaS and the driving space PaS becomes outside the driver's field of vision VA, the display control unit 73 sets the narrow-road driving assistance content CTnr to non-display. Based on the above, the narrow-road driving assistance display ends.

[0241] <Field of View Assist Display>

[0242] Figures 47-50 The vision assistance display shown is implemented, for example, in environments with poor visibility such as fog or heavy rain. The assistance exists in the turning zone CuS in front of vehicle A (refer to...). Figure 49The driving assistance ECU 23 determines the visibility ahead of the vehicle based on the detection information from the camera ECU 21. If the driving assistance ECU 23 determines that the visibility ahead of the vehicle is poor, it also determines whether the vehicle A's speed exceeds a threshold (e.g., 30 km / h) and whether there is a turning zone CuS ahead of the vehicle. Information indicating the shape of the road ahead (map data) can be obtained from an external network via the in-vehicle communication unit 25, or from the navigation ECU 22. If, in an environment with poor visibility, vehicle A, traveling at a speed exceeding the threshold, approaches a turning zone CuS, the driving assistance ECU 23 decides to implement a visibility assistance display, requesting the head-up ECU 70 and instrument cluster ECU 32 to begin the visibility assistance display. If, based on the detection information from the camera ECU 21, the driving assistance ECU 23 diagnoses a situation where visibility is visible for a certain distance, it notifies the head-up ECU 70 and instrument cluster ECU 32 to terminate the visibility assistance display.

[0243] The display control unit 73, triggered by the implementation request for field-of-view auxiliary display obtained by the information acquisition unit 71, begins displaying the turning notification image Pnc (see reference). Figure 47 The turning notification image Pnc is arranged horizontally with the speedometer CTV and displayed as non-overlapping content CTn near the lower edge of the viewing angle VA. The turning notification image Pnc is displayed as related content CTR in the visual aid display. The turning notification image Pnc is displayed as a virtual image in a warning color, such as yellow. The turning notification image Pnc draws the driver's attention to a high-curvature turning section CuS approaching the front of the vehicle. The turning notification image Pnc is set as an image primarily composed of curved or bent arrows to remind the driver of a turn.

[0244] The display control unit 73 at time t1 (refer to...) Figure 4 Before the viewpoint VA begins to move, instead of the velocity gauge CTv, a line-of-sight guide image Pgg is displayed in the central part of the viewpoint VA (see reference). Figure 48 (Upper part). The line-of-sight guidance image Pgg is an image containing multiple luminous points. These luminous points are displayed as virtual images, such as white or blue. The luminous points are displayed spaced apart from each other and arranged in a generally straight line along the vehicle's lane. The line-of-sight guidance image Pgg can be non-overlapping content CTn with a pre-defined display position within the viewing angle VA, or overlapping content CTs with a changing direction based on the shape of the road in front of the vehicle.

[0245] The display control unit 73 uses the turning notification image Pnc and the line-of-sight guidance image Pgg as guidance content CTGf. The guidance content CTGf is used during the movement of the viewpoint VA (during movement TM1, see reference 1). Figure 4The guide (CTGf) directs the driver's attention towards a distant object by moving the viewpoint toward the vanishing point in the foreground. The guide content (CTGf) directs the driver's attention toward the area ahead where the turning zone (CuS) exists.

[0246] The display control unit 73 reduces the display size of the turn notification image Pnc according to the upward movement of the viewing angle VA. During the movement of the viewing angle VA, the display control unit 73 TM1 ( Figure 4 Midway through (refer to), the display of the end-of-turn notification image Pnc (refer to) Figure 48 (Lower section). Based on the above, the turn notification image Pnc is displayed as moving towards the vanishing point in the foreground and disappearing.

[0247] The display control unit 73 increases the number of light-emitting points of the gaze guide image Pgg as the viewing angle VA moves upward. The higher the light-emitting points are displayed, the smaller the display size becomes. Even after the turn notification image Pnc is set to not display, the display control unit 73 continues to display the gaze guide image Pgg (see reference). Figure 48 (Lower section) directs the driver's attention to the distance.

[0248] The display control unit 73 continues until time t2 (refer to...) Figure 4 The gaze guide image Pgg continues to be displayed until the viewpoint VA moves to the overlapping position VP2. The display control unit 73 starts displaying the turning guidance content CTcs by an animation that splits multiple light points of the gaze guide image Pgg left and right (see reference). Figure 49 (Upper part). Turning guidance content CTcs is a specific content CTis in the vision assistance display. Turning guidance content CTcs is an overlapping content CTis that sets the road surface of the vehicle's lane in the foreground as an overlapping object, showing the driver the shape of the road ahead by overlapping with the road surface.

[0249] The turning guidance content CTcs is an overlapping CTs containing the turning shape image Pcs and the oncoming vehicle notification image Poc. The turning shape image Pcs is an image composed of multiple light-emitting dots split horizontally. The turning shape image Pcs has two columns of light-emitting dots arranged along the road surface ahead, guiding the driver to the shape of the road ahead. The oncoming vehicle notification image Poc is generated when the driver assistance ECU 23 detects an oncoming vehicle Ao traveling in the opposite lane (see reference). Figure 49The wrong-way vehicle notification image (Poc) is displayed in the case of a vehicle approaching from the front. It is an image that alerts the driver to the presence of a vehicle approaching from the front, for example, displayed as a warning image in a yellow or other warning color. The wrong-way vehicle notification image (Poc) is displayed on the side of the oncoming lane relative to the turning shape image (Pcs). The wrong-way vehicle notification image (Poc) has multiple V-shaped image sections that are visually recognizable in a posture perpendicular to the road surface ahead, preventing the vehicle from veering into the oncoming lane. The display of the wrong-way vehicle notification image (Poc) ends when the vehicle A passes to the side of vehicle A (see reference). Figure 50 (Upper part).

[0250] The display control unit 73 terminates the display of the turning guidance content CTcs upon receiving a notification from the information acquisition unit 71 indicating the end of the view assist display, so as not to obstruct the visual recognition of the actual foreground. The display control unit 73 terminates the display of the turning guidance content CTcs at the moment t3 when the starting viewpoint VA moves towards the normal position VP1 (refer to...). Figure 4 Previously, the two columns of luminous dots displayed as the turning shape image Pcs were moved towards the center in the viewing angle VA (see reference). Figure 50 (Middle section). After the display control unit 73 combines the left and right light-emitting points into a single display column, it begins to move the viewing angle VA to the normal position VP1. As the viewing angle VA moves downward, each light-emitting point becomes outside the viewing angle VA, thus ending the auxiliary display (see reference). Figure 50 (Lower part)

[0251] In the third embodiment described above, the same effect as in the first embodiment is achieved: the time lag before the display begins due to viewpoint movement is difficult for the driver to perceive because of the display of the associated content CTR. Therefore, even if the viewing angle VA capable of displaying a virtual image is extended, the sense of incongruity in the display is reduced, thus improving the convenience of the HUD100.

[0252] Furthermore, in the third embodiment, when the warning content CTta of the risk marker Tr warning the vehicle ahead is displayed as specific content CTis, the guidance content CTGt for moving towards the risk marker Tr is displayed as associated content CTR. This guidance content CTGt allows the driver's attention to the risk marker Tr or its vicinity to be drawn earlier. As a result, the driver can easily identify the risk marker Tr and smoothly respond to it. Therefore, a highly convenient virtual image display is achieved.

[0253] Furthermore, in the third embodiment, when the parking guidance content CTps guiding the vehicle to the parking space PkS ahead is displayed as specific content CTis, the approach notification content CTan notifying the vehicle of its approach to the parking space PkS is displayed as associated content CTr. This approach notification content CTan prompts the driver to perform driving operations such as deceleration for parking in the parking space PkS. As a result, the driver can smoothly begin the driving operation of parking vehicle A in the parking space PkS based on the parking guidance content CTps.

[0254] Furthermore, in the third embodiment, when the narrow-road driving assistance content CTnr for driving in the auxiliary driving space PaS is displayed as specific content CTis, the guidance content CTGp for moving towards the driving space PaS is displayed as associated content CTR. This guidance content CTGp allows the driver's attention to be directed towards the narrow driving space PaS earlier. As a result, the driver can smoothly enter the driving space PaS, complementing the driving assistance of the narrow-road driving assistance content CTnr within the narrow road, and quickly pass through the narrow road.

[0255] Furthermore, in the third embodiment, when the turning guidance content CTcs, which represents the shape of the road ahead of the vehicle, is displayed as specific content CTis, the guidance content CTGf, which moves towards the vanishing point in the foreground, is displayed as associated content CTR. This guidance content CTGf allows the driver's attention to be directed further ahead, prompting the driver to prepare for the next turning section CuS. As a result, even in scenarios with poor visibility, the driver can implement appropriate deceleration before entering the turning section CuS and continue driving smoothly within the turning section CuS according to the turning guidance content CTcs.

[0256] Furthermore, in the third embodiment, the guidance content CTGt is equivalent to "target guidance content", and the guidance content CTGp is ​​equivalent to "narrow road guidance content". In addition, the turning guidance content CTcs is equivalent to "shape guidance content", and the guidance content CTGp is ​​equivalent to "foreground guidance content".

[0257] (Other implementation methods)

[0258] The above describes several embodiments of this disclosure, but this disclosure is not limited to the above embodiments and can be applied to various embodiments and combinations without departing from the spirit of this disclosure.

[0259] In Variation 1 of the above embodiment, as a switching mechanism, the position of the viewing angle VA is adjusted along the left-right direction Yo (refer to...). Figure 1The actuator for movement is located in the HUD. Specifically, in Variation 1, left and right notification positions are defined respectively on the left and right sides of the overlapping position VP2. The head-up ECU 70 displays the location notification image Ptp (see reference) in a turn warning display, for example, at a right-turn intersection. Figure 23 In the case of the lower part, the viewpoint position is moved from the overlapping position VP2 to the right notification position. As an example, the head-up ECU 70, based on the steering operation, begins to move the viewpoint position when the right turn of the vehicle begins. Similarly, in the turn prompt display at a left-turn intersection, the head-up ECU 70 moves the viewpoint VA from the overlapping position VP2 to the left notification position when the left turn begins.

[0260] As in Variation 1 above, the number of viewpoint positions that can be set on the HUD is not limited to the number exemplified in the above embodiments. Furthermore, the multiple defined viewpoint positions can be adjacent to each other, separate from each other, or partially overlapping each other. Additionally, the direction of movement of the viewpoint VA is not limited to the vertical direction US; it can be the horizontal direction Yo as in Variation 1, or the forward / backward direction ZG. Moreover, viewpoint movements that combine the vertical direction US, the horizontal direction Yo, and the forward / backward direction ZG can be implemented. The mechanism capable of performing such viewpoint movements can also be appropriately modified.

[0261] The content displayed at each viewpoint can be appropriately changed between overlapping content (CTs) and non-overlapping content (CTn). Similarly, the specific content (CTis) displayed after the viewpoint (VA) moves is not limited to overlapping content (CTs) and can also be non-overlapping content (CTn). Furthermore, the specific content (CTis) can be a warning message informing the driver of an urgent situation, or a notification message informing the driver of the status information of vehicle A that is not urgent. In addition, the associated content (CTr) can be either overlapping content (CTs) or non-overlapping content (CTn).

[0262] Furthermore, the shape, glow color, and display position of the images used for each content can be changed according to the driver's preferences. Additionally, the language and unit type can be appropriately changed based on user settings such as the driver's preferences, as well as settings such as the country and region where vehicle A is used.

[0263] In Variation 2 of the above embodiment, the associated content CTR is displayed only before the viewpoint movement begins. That is, in Variation 2, the display of the associated content CTR during the movement TM1 from the normal position VP1 to the overlapping position VP2 is omitted. As described above, the display period of the associated content CTR can be appropriately changed during the period before the movement to the overlapping position VP2 is completed.

[0264] In Variation 3 of the above-described embodiment, the display changes of the instrument display device 30 in coordination with the movement of the viewing angle VA based on HUD 100 are not implemented. Specifically, in Variation 3, the color reduction of the detailed information PDi of TM1 during movement and the interruption of the display of the detailed information PDi during the display of specific content CTis are not implemented.

[0265] In Variation 4 of the above-described embodiment, some or all of the processing functions of the head-up ECU 70 are installed in an integrated control unit such as an HCU (Human Machine Interface Control Unit). Such an HCU may also integrate the processing functions of the instrument ECU 32. In Variation 4 above, the HUD is also referred to as a "virtual image display device".

[0266] In variation 5 of the above embodiment, the detailed information PDi is continuously displayed while the viewing angle VA is at the overlapping position VP2. After the viewing angle VA moves to the overlapping position VP2, the detailed information PDi continues to be displayed in a state with reduced visual recognizability compared to when the viewing angle VA is at the normal position VP1. As an example, the detailed information PDi is set to a low brightness or low chroma state.

[0267] In the PGU61 of the HUD100, an EL (Electroluminescence) panel can be used instead of an LCD panel and backlight. Alternatively, a plasma display panel, cathode ray tube, or LED display can be used instead of an EL panel in the PGU61. Furthermore, a laser projector or DLP (Digital Light Processing) and screen can be used instead of an LCD panel and backlight. In the PGU61 with this structure, the image displayed on the screen is projected onto the windshield WS via a magnifying optical system 62, forming a virtual image Vi. Furthermore, the optical elements used in the magnifying optical system 62 are not limited to concave mirrors; various mirrors, lenses, and holographic optical elements can be appropriately varied.

[0268] The processing units of the head-up ECU 70 and instrument cluster ECU 32 in the above embodiments are hardware for computational processing integrated with RAM. The processing unit is a structure including at least one CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processing unit may also include, for example, a FPGA (Field-Programmable Gate Array) and IP cores with other dedicated functions. On the other hand, the RAM may include video RAM for image generation. The processing unit executes various processes for implementing the virtual image display method of this disclosure by accessing the RAM. The memory is a structure including a non-volatile storage medium (a persistent tangible computer-readable medium). Various programs (display control programs, etc.) executed by the processing unit are stored in the memory of each ECU 32, 70.

[0269] In the above embodiments, the functions provided by the head-up ECU 70 and the instrument cluster ECU 32 can also be provided by software and hardware executing the software, software only, hardware only, or a combination thereof. Furthermore, when such functions are provided by electronic circuits as hardware, each function can also be provided by digital circuits or analog circuits including multiple logic circuits.

[0270] Furthermore, the form of the storage medium storing the program that enables the aforementioned virtual image display method can be appropriately changed. For example, the storage medium is not limited to a structure provided on a circuit board; it can be provided in the form of a memory card, inserted into a slot, and electrically connected to the control circuitry of the HCU. Moreover, the storage medium can also be an optical disc or a hard disk drive, which serves as the basis for copying programs to the HCU.

[0271] The control unit and method described in this disclosure can also be implemented using a dedicated computer, which is configured as a processor programmed to perform one or more functions embodied in a computer program. Alternatively, the apparatus and method described in this disclosure can also be implemented using dedicated hardware logic circuitry. Alternatively, the apparatus and method described in this disclosure can also be implemented using one or more dedicated computers, which are configured as a combination of a processor executing a computer program and one or more hardware logic circuits. Furthermore, the computer program can also be stored as instructions executed by a computer on a computer-readable non-transferable tangible recording medium.

Claims

1. A virtual image display device for displaying a virtual image that can be visually recognized by occupants of a vehicle, wherein, The virtual image display device includes: A switching mechanism switches the viewing position of the virtual image between multiple positions, including a first position and a second position; and The display control unit displays virtual images associated with the first position and the second position respectively, based on the switching of the viewpoint position according to the switching mechanism. When the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is complete. When the display control unit displays a lane departure warning message that warns the vehicle of leaving its lane as the specific content, it also displays moving content that appears to move visually to the occupant depending on the viewing angle as the associated content. The pre-establishment of association between the associated content and the specific content means that the associated content attracts attention to the specific content, or the associated content is assimilated with the specific content, or a part of the specific content is displayed as the associated content.

2. The virtual image display device according to claim 1, wherein, When the display control unit displays the warning content of a risk object that is generated in front of the vehicle as the specific content, it also displays the guide content of the risk object that moves toward the foreground in the viewpoint as the associated content.

3. The virtual image display device according to claim 1, wherein, When the display control unit displays narrow-road driving assistance content that assists the vehicle in navigating a narrow road by overlapping with the road surface in the foreground as the specific content, it also displays narrow-road guidance content that moves toward the driving space in the foreground as the viewing angle moves as the associated content.

4. The virtual image display device according to claim 1, wherein, When the display control unit displays shape guide content that represents the shape of the road ahead by overlapping with the road surface in the foreground as the specific content, it also displays foreground guide content that moves toward the vanishing point in the foreground as the viewpoint moves.

5. The virtual image display device according to claim 1, wherein, The display control unit begins displaying the associated content before the movement of the viewpoint based on the switching mechanism begins.

6. The virtual image display device according to claim 5, wherein, If the associated content displayed before the start of movement based on the perspective of the switching mechanism is set as the first associated content, then The display control unit displays second associated content during the movement of the viewpoint based on the switching mechanism. The second associated content is associated content in a different form than the first associated content.

7. The virtual image display device according to claim 1, wherein, The display control unit begins displaying the associated content as the viewing angle moves based on the switching mechanism.

8. The virtual image display device according to claim 1, wherein, In the switching mechanism, the second position is defined above the first position. The display control unit causes the specific content to overlap with objects in the foreground.

9. The virtual image display device according to claim 1, wherein, When the display control unit displays the workshop notification content that keeps the workshop under control as the specific content, it also displays a portion of the workshop notification content as the associated content within the moving viewpoint.

10. The virtual image display device according to claim 1, wherein, When the display control unit displays the path guidance content that overlaps with the road surface in the foreground as the specific content, it also displays the lane emphasis content that emphasizes the lane of the vehicle in motion as the associated content.

11. The virtual image display device according to any one of claims 1 to 10, wherein, When the display control unit displays the parking guidance content that guides the vehicle to the parking space in front as the specific content, it also displays the approach notification content that notifies the vehicle of its approach to the parking space as the associated content.

12. A virtual image display device for displaying a virtual image that can be visually recognized by occupants of a vehicle, wherein, The virtual image display device includes: A switching mechanism switches the viewing position of the virtual image between multiple positions, including a first position and a second position; and The display control unit displays virtual images associated with the first position and the second position respectively, based on the switching of the viewpoint position according to the switching mechanism. When the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is complete. When the display control unit displays a lane departure warning message that warns the vehicle of leaving its lane as the specific content, it also displays movement content that moves toward a vanishing point in the foreground during a change of viewing angle as the associated content. The pre-establishment of association between the associated content and the specific content means that the associated content attracts attention to the specific content, or the associated content is assimilated with the specific content, or a part of the specific content is displayed as the associated content.

13. A virtual image display device for displaying a virtual image that can be visually recognized by occupants of a vehicle, wherein, The virtual image display device includes: A switching mechanism switches the viewing position of the virtual image between multiple positions, including a first position and a second position; and The display control unit displays virtual images associated with the first position and the second position respectively, based on the switching of the viewpoint position according to the switching mechanism. When the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is complete. When the display control unit displays the warning content of a risk object that is generated in front of the vehicle as the specific content, it also displays the guide content of the risk object that moves toward the foreground in the viewpoint as the associated content. The pre-establishment of association between the associated content and the specific content means that the associated content attracts attention to the specific content, or the associated content is assimilated with the specific content, or a part of the specific content is displayed as the associated content.

14. A virtual image display device for displaying a virtual image that can be visually recognized by occupants of a vehicle, wherein, The virtual image display device includes: A switching mechanism switches the viewing position of the virtual image between multiple positions, including a first position and a second position; and The display control unit displays virtual images associated with the first position and the second position respectively, based on the switching of the viewpoint position according to the switching mechanism. When the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is complete. When the display control unit displays narrow-road driving assistance content that assists the vehicle in navigating the narrow road space by overlapping with the road surface in the foreground as the specific content, it also displays narrow-road guidance content that moves towards the driving space in the foreground as the viewing angle shifts as the associated content. The pre-establishment of association between the associated content and the specific content means that the associated content attracts attention to the specific content, or the associated content is assimilated with the specific content, or a part of the specific content is displayed as the associated content.

15. A virtual image display device for displaying a virtual image that can be visually recognized by occupants of a vehicle, wherein, The virtual image display device includes: A switching mechanism switches the viewing position of the virtual image between multiple positions, including a first position and a second position; and The display control unit displays virtual images associated with the first position and the second position respectively, based on the switching of the viewpoint position according to the switching mechanism. When the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is complete. When the display control unit displays shape guide content that overlaps with the road surface in the foreground to represent the shape of the road ahead as the specific content, it also displays foreground guide content that moves toward the vanishing point in the foreground as the viewpoint moves as the associated content. The pre-establishment of association between the associated content and the specific content means that the associated content attracts attention to the specific content, or the associated content is assimilated with the specific content, or a part of the specific content is displayed as the associated content.

16. A virtual image display device for displaying a virtual image that can be visually recognized by occupants of a vehicle, wherein, The virtual image display device includes: A switching mechanism switches the viewing position of the virtual image between multiple positions, including a first position and a second position; and The display control unit displays virtual images associated with the first position and the second position respectively, based on the switching of the viewpoint position according to the switching mechanism. When the switching mechanism moves the viewing angle from the first position to the second position and displays specific content within the viewing angle of the second position, the display control unit begins displaying associated content pre-associated with the specific content before the movement of the viewing angle to the second position is complete. If the associated content displayed before the start of movement based on the perspective of the switching mechanism is set as the first associated content, then The display control unit displays second associated content as the viewing angle moves based on the switching mechanism. The second associated content is associated content in a different form than the first associated content. The pre-establishment of association between the associated content and the specific content means that the associated content attracts attention to the specific content, or the associated content is assimilated with the specific content, or a part of the specific content is displayed as the associated content.

17. A display system, comprising: The virtual image display device as described in any one of claims 1 to 16; as well as The display device changes the display of the screen in cooperation with the switching of the position of the viewpoint based on the switching mechanism.

18. The display system according to claim 17, wherein, While the viewing angle is at the first position, the display device displays detailed information associated with the specific content on the display screen. If the movement of the viewing angle to the second position is completed, the display device reduces the visual recognizability of the detailed information compared to the period when the viewing angle was in the first position, or makes the detailed information not displayed.

19. The display system according to claim 18, wherein, The display device performs morphological changes that reduce the visual recognizability of the detailed information during the movement of the viewing angle from the first position to the second position.

Images