Display control device, head-up display device, and display control method

By moving the content between different display areas in the vehicle display system and adjusting the pitch angle, the problem of difficult content recognition and insufficient tilt performance in the prior art is solved, and the clear recognition and visual recognition effect of the content between the display areas is achieved.

CN119053470APending Publication Date: 2024-11-29NIPPON SEIKI CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202380034481.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-27
Filing Date
2023-04-26
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

In the prior art, the distances of multiple display areas from the observer are different and separated, making it difficult for content representing the same information to be identified by the observer as the same information, and the spatially tilted performance differences of the content are not sufficient to leave an impression.

Method used

By displaying an overhead viewing image in the first display area and displaying an image with a larger angle than the first display image in the second display area, the processor performs a display that moves the prescribed content between the two display areas by displaying a viewing image in the second display area, and displaying an image with a larger pitch angle than the first display image in the second display area, the processor performs a display that moves the prescribed content between the two display areas. Position change processing emphasizes changes in the spatial layout of the content and differences in the dip angle.

Benefits of technology

It makes the content easy to be recognized as relevant information when switching between different display areas, and emphasizes the difference in the displayed distance and the changes in the spatial arrangement of the content through the tilt angle, leaving an impression.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119053470A_ABST
    Figure CN119053470A_ABST
Patent Text Reader

Abstract

Even when the display position of the content is changed in different separate display areas, the content can be easily recognized as relevant information. A first display unit (110) displays a first display image (IM10) in a first display area (101), a second display unit (120) displays a second display image (IM20) in a second display area (102) disposed closer to the first display area (101), and a processor executes a display position change process for moving predetermined content between the first display area (101) and the second display area (102). A first display unit (110) displays a first display image (IM10), which is a bird's-eye view image obtained by obliquely looking down content, and a second display unit (120) displays a second display image (IM20) having a depression angle (theta) larger than that of the first display image (IM10).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a display control device, a head-up display device and a display control method for a vehicle, which enable an image to be visually recognized by overlapping it on the foreground of the vehicle. Background Art

[0002] Patent document 1 discloses a display device that sets a guide path image V1a displayed in a distant display area E1 that is far from an observer to non-display, and displays an auxiliary virtual image V3 related to the guide path image V1a in a near display area E2. That is, related information is switched between different separate display areas as content in different forms. In this way, the display position of the content of the related information is switched between different separate display areas based on the driving environment of the vehicle, the state of the driver, for example, to reduce annoyance, to make it eye-catching, to visually recognize information at an appropriate time, and / or to reduce the driving load, etc. (for example,

[0014] ,

[0015] ,

[0036] , Figure 3 , Figure 4 ).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2014-213763 Summary of the invention

[0006] Problems to be solved by the invention

[0007] In Patent Document 1, the multiple display areas are separated at different distances from the observer, so even if the content representing the same information is switched and displayed, it is difficult for the observer to recognize it as the same information. In addition, especially when the content is displayed in different forms in the first display area (distant display area E1) and the second display area (near display area E2) as in Patent Document 1, it is difficult to further recognize it as the same information, so there is room for improvement.

[0008] In addition, in Patent Document 1, the content (guiding path image V1a) displayed in the first display area (distant display area E1) is tilted relative to the line of sight of the observer facing forward and is displayed along the road surface. In contrast, the content (auxiliary virtual image V3) displayed in the second display area (near display area E2) is directly opposite to the line of sight of the observer facing forward. Therefore, when the display area changes, the spatial tilt expression of the content changes. However, in Patent Document 1, such a difference in the spatial tilt expression of the content does not leave an impression on the observer. Therefore, the impression of the change in the spatial tilt expression of the content, the spatial tilt expression of the content before the display area changes, and the spatial tilt expression of the content after the display area changes is less, and there is room for improvement.

[0009] Means for solving problems

[0010] The following are the main points of the specific embodiments disclosed in this specification. It should be understood that these schemes are only for providing the reader with a summary of these specific embodiments and are not intended to limit the scope of the present invention. In fact, the present invention may include various schemes not described below.

[0011] The present invention relates to making it easy to recognize as related information even when the display position of content is changed in different separate display areas. More specifically, it relates to making it easy to recognize as related information even when switching to different forms of content in different separate display areas and changing the display position. In addition, it relates to making the difference in spatial arrangement of content leave an impression on the observer.

[0012] Therefore, the display control device, head-up display device, display control method, etc. described in this specification adopt the following means to solve the above-mentioned problems. In this embodiment, the gist is that: the first display unit displays a first display image in a first display area, and the second display unit displays a second display image in a second display area arranged closer to the first display area, and the processor performs a display position change process of moving a specified content between the first display area and the second display area, so that the first display unit displays a bird's-eye view image obtained by obliquely looking down at the content, that is, a first display image, and the second display unit displays a second display image with a larger depression angle than the first display image.

[0013] Therefore, in a display control device of a first embodiment described in this specification, the display control device controls a vehicle display system, the vehicle display system having a first display unit that displays an image in a first display area and a second display area that displays an image in a second display area that is arranged closer to the first display area, wherein a processor performs a display position change process that moves a predetermined content between the first display area and the second display area, the first display unit displays a first display image that is a bird's-eye view image obtained by obliquely looking down on the content, and the second display unit displays a second display image that has a larger depression angle than the first display image. Thus, the depression angle of the content is made different along with the display position change process that moves the content, so the following advantage can be conceived: the impression of the change in the spatial arrangement of the content can be left. In the display control device of the first embodiment, the first display image with a smaller depression angle is displayed on the first display unit that is farther from the observer, and the second display image with the same content as the first display image and a larger depression angle is displayed in the second display area that is closer to the observer. The difference in the display distance (image distance) can be emphasized by such a change in the depression angle to leave an impression. In addition, conversely, the difference in the depression angle of the content can also be emphasized by such a change in the image distance to leave an impression.

[0014] In a display control device of a second embodiment that can be subordinate to the first embodiment, in a display position change process, a processor performs at least one of the following processes: gradually increasing the depression angle when moving the content from the first display area to the second display area; and gradually decreasing the depression angle when moving the content from the second display area to the first display area. In the display control device of the second embodiment, the content displayed in the first display area gradually increases the depression angle and moves toward a second display position specified in the second display area with a shorter image distance, so the following advantage can also be imagined: the content can be emphasized in a manner that approaches the near side and leaves an impression. In addition, in the display control device of the second embodiment, the content displayed in the second display area gradually decreases the depression angle and moves toward a first display position specified in the first display area with a longer image distance, so the following advantage can also be imagined: the content can be emphasized in a manner that moves away from the far side and leaves an impression.

[0015] In the display control device of the third embodiment which can be subordinate to the first or second embodiment, in the display position changing process, the processor gradually changes the depression angle at the movement source.

[0016] In a display control device of a fourth embodiment that can be subordinate to the first to third embodiments, in a display position change process, a processor moves the content at the moving source toward the moving destination side and gradually changes the depression angle. In the display control device of the fourth embodiment, the content displayed in the first display area gradually increases the depression angle and moves toward the second display area with a shorter image distance, and is finally displayed at a specified second display position in the second display area with a shorter image distance, so the following advantage can also be imagined: from the middle of the movement of the content in the first display area, the content can be emphasized in a manner that the content approaches the near side and leaves an impression. In addition, in the display control device of the fourth embodiment, the content displayed in the second display area gradually decreases the depression angle and moves toward the first display area with a longer image distance, and is finally displayed at a specified first display position in the first display area with a longer image distance, so the following advantage can also be imagined: from the middle of the movement of the content in the second display area, the content can be emphasized in a manner that the content moves away from the far side and leaves an impression.

[0017] In the display control device of the fifth embodiment that can be subordinate to the third or fourth embodiment, in the display position change processing, the processor moves the content from the moving source side at the moving destination without changing the depression angle. In the display device of the third or fourth embodiment, by changing the depression angle of the content at the moving source and moving the display position, it is possible to emphasize and leave an impression in a manner that the image distance of the content changes, or it is possible to emphasize the change in the depression angle of the content and leave an impression, so the change in the depression angle of the content at the moving destination is not necessary. Therefore, in the display control device of the fifth embodiment, the following advantages can also be envisioned: the change in the depression angle at the moving destination that may become a redundant expression at the moving source can be reduced, thereby reducing the control load.

[0018] In a display control device of a sixth embodiment that can be subordinate to the first or fifth embodiment, in a display position change process, a processor performs at least one of the following processes: when the size of the content at the moving destination is smaller than the size of the content at the moving source, the content is reduced at the moving source; and when the size of the content at the moving destination is larger than the size of the content at the moving source, the content is enlarged at the moving source. In a case where the size of the content is greatly different at the moving source and the moving destination, it can be imagined that when the display unit displaying the content is switched, the size of the visually recognizable content is greatly different, and it is difficult to recognize it as the same content. In the display control device of the sixth embodiment, by scaling the content at the moving source in a manner that makes the size of the content close to the size of the content at the moving destination, it can be imagined that the difference in the size of the visually recognizable content that is expected to be when the display unit displaying the content is switched is eliminated (or reduced).

[0019] In the display control device of the seventh embodiment that can be subordinate to the first or sixth embodiment, in the display position change processing, the processor causes the content to gradually change from the end of the content's destination side to a form that cannot be visually recognized at the moving source. In the display control device of the seventh embodiment, by gradually changing the content from the end of the content's destination side to a form that cannot be visually recognized when the content is stopped (not moved), the following advantage can also be envisioned: even if the content is not moved, the observer can perceive that it has moved to the destination. In addition, in the display control device of the seventh embodiment, by moving the content to the destination and gradually changing the content from the end of the content's destination side to a form that cannot be visually recognized, the following advantage can also be envisioned: the observer can perceive that the content is moving by emphasizing that the content is moving.

[0020] In the display control device of the eighth embodiment which can be subordinate to the first or seventh embodiment, the content included in the first display image is a part of the content included in the second display image. When the display position of the content is switched between the first display area and the second display area, the display control device of the eighth embodiment increases or decreases the amount of information of the content, so that it is conceivable that the amount of information and the conspicuousness of the image can be adjusted to improve convenience.

[0021] In the display control device of the ninth embodiment which can be subordinate to the first or eighth embodiment, the first display image is a 3D representation and the second display image is a 2D representation. The display control device of the ninth embodiment can further emphasize the change of the depression angle relative to the content by switching the representation method between the 3D representation and the 2D representation. By emphasizing the change of the depression angle, the difference in the displayed distance (image distance) can be emphasized to leave an impression.

[0022] In the display control device of the tenth embodiment which can be subordinate to the first or ninth embodiment, the first display image has a predetermined first depth expression, and the second display image does not have the first depth expression. The display control device of the tenth embodiment can further emphasize the change of the depression angle relative to the content by switching the expression method between the image with the first depth expression and the image without the first depth expression. By emphasizing the change of the depression angle in this way, the difference in the displayed distance (image distance) can be emphasized to leave an impression. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 The diagram shows display forms of the first display image and the second display image visually recognized by an observer (typically, the driver of the vehicle) when looking forward from the driver's seat of the vehicle.

[0024] Figure 2 : is a diagram showing an example of the configuration of the first display area and the second display area.

[0025] Figure 3 It is a diagram showing an example of the configuration of the second display portion.

[0026] Figure 4 FIG. 1 is a diagram showing one embodiment of the configuration of the first display area and the second display area.

[0027] Figure 5A 2 is a diagram showing a state where a first display image is displayed in a first display area.

[0028] Figure 5B : is a figure which shows the case where the second display image is displayed in the second display area.

[0029] Figure 6 is a block diagram of a display system for a vehicle in accordance with some embodiments.

[0030] Figure 7 The figure shows an area of ​​a map image around a host vehicle displayed as an overhead navigation image.

[0031] Figure 8 The diagrams are for explaining virtual viewpoints having different depression angles with respect to a predetermined virtual object (content).

[0032] Fig.9A It is shown from Figure 8 FIG. 8 is a diagram showing a virtual object (content) 800 (right diagram) and a navigation image IM31 (left diagram) observed from a virtual viewpoint MM1 (depression angle θ1).

[0033] Fig. 9B It is shown from Figure 8 FIG. 8 is a diagram showing a virtual object (content) 800 (right diagram) and a navigation image IM32 (left diagram) observed from a virtual viewpoint MM2 (depression angle θ2).

[0034] Fig. 9C It is shown from Figure 8 FIG. 8 is a diagram showing a virtual object (content) 800 (right diagram) and a navigation image IM33 (left diagram) observed from a virtual viewpoint MM3 (depression angle θ3 ).

[0035] Fig.10 This is a diagram showing one embodiment of transition of a display image in a display position change process executed by a display control device.

[0036] Fig.11 This is a diagram showing one embodiment of transition of a display image in a display position change process executed by a display control device.

[0037] Fig.12 This is a diagram for explaining the display transition of content.

[0038] Fig.13The figures are for explaining the display modes of the first display image (upper figure) and the second display image (lower figure).

[0039] Fig.14 FIG. 1 is a diagram showing one embodiment of transition of a display image in a display position change process executed by the display control device 130 .

[0040] Fig.15 It is a diagram showing an example of the configuration of the second display portion.

[0041] Fig.16 It is a diagram showing an example of the configuration of the second display portion. DETAILED DESCRIPTION

[0042] the following, Figures 1 to 14 A description of the structure of an exemplary vehicle display system is provided. In addition, the present invention is not limited by the following embodiments (including the contents of the accompanying drawings). Of course, the following embodiments can be changed (including the deletion of constituent elements). In addition, in the following description, in order to facilitate the understanding of the present invention, the description of known technical matters is appropriately omitted.

[0043] Figure 1 1 is a diagram showing the display form of the first display image IM10 and the second display image IM20 visually recognized by the observer (typically, the driver of the vehicle) 4 when facing forward from the driver's seat of the vehicle 1. In the description of this embodiment, the left-right direction when the observer 4 sitting in the driver's seat of the vehicle 1 faces forward of the vehicle 1 is the X-axis (the left direction is the positive direction of the X-axis), the up-down direction is the Y-axis (the up direction is the positive direction of the Y-axis), and the front-back direction is the Z-axis (the front direction is the positive direction of the Z-axis). The vehicle display system 10 of this embodiment displays the first display image IM10 in the first display area 101 in the foreground overlapping area 600 that overlaps with the foreground 300 of the vehicle 1 and is visually recognized, and displays the second display image IM20 in the second display area 102 in the foreground non-overlapping area 700 that does not overlap with the foreground 300 of the vehicle 1 and is not visually recognized.

[0044] The first display unit 110 displays a first display image IM10 in a first display area 101. When viewed from the observer 4, the first display area 101 is provided in an area overlapping with the front windshield 2 of the vehicle 1 (an example of a foreground overlapping area 600). The first display unit 110 of one embodiment of the vehicle display system 10 is a head-up display (HUD: Head-Up Display) device 110A provided in the instrument panel 5 of the vehicle 1. The HUD device 110A emits display light 11A toward the front windshield 2 (an example of a projected component) so that the first display image IM10 is visually recognized in the first display area 101 on the front side (Z-axis positive direction) of the front windshield 2 (an example of a projected component). As a result, the observer 4 can visually recognize an image that overlaps with the foreground 300, which is a real space that is visually recognized across the front windshield 2.

[0045] Figure 2 1 is a diagram showing an example of the configuration of the first display area 101 and the second display area 102. The first display area 101 is a plane, a curved surface, or a part of a curved surface where an image generated inside the HUD device 110A is formed as a virtual image, and is also called an imaging surface. The visibility of the first display area 101 itself is so low that the observer 4 cannot visually recognize it or it is difficult to visually recognize it.

[0046] The HUD device 110A includes a display 12A having a display surface for displaying an image and a relay optical system 13A. The display 12A may be a transmissive display that transmits light from a backlight source such as an LCD, or a projection display that projects an image onto a screen. In this case, the display surface is the display surface in the transmissive display, and is the screen in the projection display.

[0047] The relay optical system 13A is disposed on the optical path of the light of the image from the display 12A between the display 12A and the front windshield 2, and is composed of one or more optical components that project the light of the image from the display 12A onto the front windshield 2 outside the first display unit 110. The relay optical system 13A includes at least one concave mirror, but in addition, it may also include, for example, one or more refractive optical components such as lenses, diffractive optical components such as holograms, reflective optical components, or a combination thereof.

[0048] In addition, the first display unit 110 may also be a head mounted display (hereinafter, HMD) device 110B. The observer 4 wears the HMD device 110B on the head and sits on the seat of the vehicle 1, so that the displayed image is overlapped on the foreground 300 across the front windshield 2 of the vehicle 1 for visual recognition. The first display area 101 of the vehicle display system 10 for displaying a prescribed image is fixed (adjustably arranged) at a specific position based on the coordinate system of the vehicle 1, and when the observer 4 faces in this direction, the image displayed in the first display area 101 fixed at the specific position can be visually recognized.

[0049] The first display unit 110 can also display an image near an actual object (an example of a specific positional relationship between an image and an actual object), a position overlapping with an actual object (an example of a specific positional relationship between an image and an actual object), or a position set based on an actual object (an example of a specific positional relationship between an image and an actual object) under the control of the display control device 30, so that an observer (typically, an observer 4 sitting in the driver's seat of the vehicle 1) perceives visual augmented reality (AR). The first display unit 110 can display images including AR images whose display position is changed according to the position of the actual object and / or non-AR images whose display position is not changed according to the position of the actual object.

[0050] like Figure 2 As shown, the first display area 101 is arranged at a position away from the first image distance ID1 from a predetermined position of the vehicle 1 (for example, a predetermined position of the eye movement range EB). The second display area 102 is arranged at a position away from the second image distance ID2 which is shorter than the first image distance ID1. That is, the second display image IM20 displayed by the second display unit 120 is visually recognized by the observer 4 on the near front side of the first display image IM10 displayed by the first display unit 110. The first image distance ID1 is, for example, 7 [meter], and the second image distance ID2 is, for example, 2 [meter]. However, these are examples and can be changed.

[0051] In addition, when the upper end of the first display area 101 viewed from the observer 4 is arranged farther than the lower end and arranged along the road surface 310 ( Figure 2The first display area 101 shown by the dotted line in the middle), the distance (image distance) ID1 from the specified position of the vehicle 1 to the first display area 101 may also be 3 to 20 [meters]. That is, the image distance ID1 to the near end (lower end) of the first display area 101 may be 3 [meters], and the image distance ID1 to the far end (upper end) of the first display area 101 may be 20 [meters].

[0052] Figure 3 1 is a diagram showing an example of the configuration of the second display unit 120. The second display unit 120 of one embodiment of the vehicle display system 10 is a near head-up display (HUD: Head-Up Display) device 120A provided in the instrument panel 5 of the vehicle 1. The near HUD device 120A emits display light 11A toward the W / S shading portion 2C (an example of the shading portion 700) of the front windshield 2 (an example of the projected component), so that the second display image IM20 is visually recognized in the second display area 102 which is further forward (in the positive direction of the Z axis) than the front windshield 2 (an example of the projected component). As a result, the observer 4 can visually recognize an image that does not overlap with the real space, that is, the foreground 300.

[0053] The near HUD device 120A includes a display 22A having a display surface for displaying an image. The optical path length of the display light 21A from the display 22A of the near HUD device 120A to the projected portion (W / S shading portion 2C) is set to be shorter than the optical path length of the display light 11A from the display 12A of the HUD device 110A to the projected portion (W / S shading portion 2C). That is, the second display image IM20 displayed by the near HUD device 120A is perceived by the observer 3 closer than the first display image IM10 displayed by the HUD device 110A. In other words, the second display area 102 is configured at a position closer to the driver's seat of the vehicle 1 than the first display area 101. In addition, the near HUD device 120A may also have a relay optical system (not shown).

[0054] Figure 41 is a diagram showing an embodiment of the configuration of the first display area 101 and the second display area 102. The first display area 101 is an area (foreground overlapping area) 600 in the front windshield 2 that allows visible light to pass through and enables visual recognition of the foreground (real scene) 300, for example, within the display area of ​​the HUD device 110A (first display unit 110). On the other hand, the second display area 102 is an area (foreground non-overlapping area) 700 that does not overlap with the foreground (real scene) 300 across the front windshield 2, for example, an area in the front windshield 2 that overlaps with the W / S shading portion 2C (an example of the shading portion 700) and the instrument panel 5 (an example of the shading portion 700). In addition, in a broad sense, the second display area 102 only needs to be within the area that does not overlap with the real scene across the front windshield 2 for the most part, and may also include a portion (for example, less than 30% of the second display area 102) outside the area that does not overlap with the real scene across the front windshield 2 (within the area that overlaps with the real scene across the front windshield 2).

[0055] Figure 5A 1 is a diagram showing a state where a first display image IM10 is displayed in the first display area 101 . The first display image IM10 is a bird's-eye view image obtained by obliquely looking down on the content, and is displayed at a predetermined first fixed position 106 in the first display area 101 .

[0056] Figure 5B 2 is a diagram showing a state where the second display image IM20 is displayed in the second display area 102. The second display image IM20 is an image having a larger depression angle than the first display image IM10, and is displayed at a predetermined second fixed position 107 in the second display area 102.

[0057] The vehicle display system 10 (display control device 130 ) of the present embodiment executes a display position change process of moving content between the first display area 101 (first fixed position 106 ) and the second display area 102 (second fixed position 107 ).

[0058] Figure 6 1 is a block diagram of a vehicle display system 10 according to some embodiments. The display control device 130 includes one or more I / O interfaces 131 , one or more processors 133 , one or more image processing circuits 135 , and one or more memories 137 . Figure 6 The various functional blocks described in the specification may be constituted by hardware, software, or a combination of both. Figure 6 This is only one embodiment, and the components shown in the figure may be combined into a smaller number of components or may have additional components. For example, the image processing circuit 135 (eg, a graphics processing unit) may also be included in one or more processors 133.

[0059] As shown, the processor 133 and the image processing circuit 135 are operably connected to the memory 137. More specifically, the processor 133 and the image processing circuit 135 can perform operations of the vehicle display system 10, such as generating and / or sending image data, by executing the program stored in the memory 137. The processor 133 and / or the image processing circuit 135 may include at least one general-purpose microprocessor (e.g., a central processing unit (CPU)), at least one application-specific integrated circuit (ASIC), at least one field programmable gate array (FPGA), or any combination thereof. The memory 137 includes any type of magnetic media such as a hard disk, any type of optical media such as a CD and a DVD, any type of semiconductor memory such as a volatile memory, and a non-volatile memory. The volatile memory may include DRAM and SRAM, and the non-volatile memory may include ROM and NVROM.

[0060] As shown in the figure, the processor 133 is operably connected to the I / O interface 131. The I / O interface 131 communicates with the vehicle ECU described later and other electronic devices (hereinafter referred to as reference numerals 401 to 420) installed in the vehicle according to the CAN (Controller Area Network) standard (also referred to as CAN communication). In addition, the communication standard adopted by the I / O interface 131 is not limited to CAN, and includes, for example, CAN FD (CAN with Flexible Data Rate), LIN (Local Interconnect Network), Ethernet (registered trademark), MOST (Media Oriented Systems Transport: MOST is a registered trademark), UART or USB and other wired communication interfaces, or short-range wireless communication interfaces within tens of meters such as personal area networks (PAN) such as Bluetooth (registered trademark) networks, local area networks (LAN) such as 802.11x Wi-Fi (registered trademark) networks, i.e., in-vehicle communication (internal communication) interfaces. In addition, the I / O interface 131 may also include an off-vehicle communication (external communication) interface such as a wireless wide area network (WWN0, IEEE802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e-based (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, 5G, and other wide area communication networks based on cellular communication standards (for example, the Internet communication network).

[0061] As shown in the figure, the processor 133 is interactively connected to the I / O interface 131, so that information can be exchanged with various other electronic devices connected to the vehicle display system 10 (I / O interface 131). For example, a navigation device, a vehicle ECU, and an external communication device provided on the vehicle 1 are operably connected to the I / O interface 131. The first image generating unit 12 and the second image generating unit 22 are operably connected to the processor 133 and the image processing circuit 135. Therefore, the first display image IM1 displayed by the first display unit 110 and the second display image IM2 displayed by the second display unit 120 can also be based on the image data received from the processor 133 and / or the image processing circuit 135. The processor 133 and the image processing circuit 135 control the first display image IM10 displayed by the first display unit 110 and the second display image IM20 displayed by the second display unit 120 based on the information obtained from the I / O interface 131. Furthermore, the I / O interface 131 may include a function of processing (converting, calculating, analyzing) information received from other electronic devices or the like connected to the vehicle display system 10 .

[0062] Figure 6 The positioner 410 shown is a structure including a microcomputer having a processor, a RAM, a storage unit, an input / output interface, and a bus connecting them as a main body. The positioner 410 combines the positioning data received by the GNSS device 411, the measurement results of the IMU 412, and the vehicle speed information output to the I / O interface 131, and sequentially locates the vehicle position and the direction of travel of the vehicle 1. The positioner 410 provides the position information and azimuth information of the vehicle 1 based on the positioning result to the display control device 130 and the like.

[0063] Figure 6 The GNSS device 411 shown receives positioning signals transmitted from artificial satellites (positioning satellites), detects the current position of the vehicle, and outputs the detected position data to the locator 410. The GNSS device 411 can receive positioning signals from each positioning satellite of at least one satellite positioning system such as GPS, GLONASS, Galileo, IRNSS, QZSS, Beidou, etc.

[0064] IMU 412 is an Inertial Measurement Unit, which has, for example, a gyro sensor and an acceleration sensor, detects angular velocity in each direction of yaw, pitch, and roll, and outputs the detected angular velocity data to the localizer 410. The localizer 410 detects changes in the posture of the vehicle by detecting the angular velocity in each direction of yaw, pitch, and roll.

[0065] The map information storage device 420 is a storage medium for storing map data including the surroundings of the vehicle, and outputs the map data of the surroundings of the current position of the vehicle to the display control device 130 based on the position information and azimuth information of the vehicle 1 determined by the locator 410. In addition, the map information storage device 420 outputs the relative position (distance, azimuth) of a specific object (a building, a feature point such as a fork in the road) to the display control device 130 based on the position information and azimuth information of the vehicle 1 determined by the locator 410. Figure 6 Although the example in which the map information storage device 420 is externally mounted on the display control device 130 is shown, the map information storage device 420 may be built in the display control device 130. In addition, the map information storage device 420 may be a server that distributes map information from outside the vehicle to the display control device 130 through communication. The map information storage device 420 can obtain the latest map data from a server installed in the cloud.

[0066] The navigation device 430 is a vehicle-mounted device that implements route guidance to a destination set by a driver or the like. The navigation device 430 is provided with a navigation map database (not shown). The navigation map database is mainly composed of a non-volatile memory, and stores map data used for route guidance (hereinafter referred to as navigation map data). Link data and node data about roads are recorded in the navigation map data. The navigation device 430 provides navigation information indicating the content of the route guidance to the display control device 130. The navigation information includes, for example, location information and road shape information about an intersection or a fork and merging point, and direction information indicating the direction in which the vehicle should travel at the intersection or the fork and merging point.

[0067] The perimeter monitoring sensor 440 detects specific objects existing around the vehicle 1 (in front, on the side, and behind). The specific objects detected by the perimeter monitoring sensor 440 may also include obstacles (pedestrians, bicycles, two-wheeled motor vehicles, other vehicles, etc.), the road surface of the driving lane described later, dividing lines, roadside objects, and / or ground objects (buildings, etc.). As an off-vehicle sensor, for example, it is composed of a detection unit including a radar sensor such as a millimeter wave radar, an ultrasonic radar, a lidar, a camera, or any combination thereof, and a processing device that processes the detection data from the one or more detection units (data fusion). Regarding object detection using these radar sensors and camera sensors, conventionally known methods are applied. By using the object detection of these sensors, the presence or absence of a specific object in a three-dimensional space can also be detected. If a specific object exists, the position (relative distance from the vehicle 1, the position in the left-right direction when the direction of travel of the vehicle 1 is the front-rear direction, the position in the up-down direction, etc.), size (size in the lateral direction (left-right direction), height direction (up-down direction), etc.), moving direction (lateral direction (left-right direction), depth direction (front-rear direction)), change speed (lateral direction (left-right direction), depth direction (front-rear direction)) and / or the type of the specific object, etc. of the specific object are detected. One or more surrounding monitoring sensors 440 can detect a specific object in front of the vehicle 1 in each detection cycle of each sensor, and output specific object information (the presence or absence of a specific object, the position, size, and / or type of each specific object when a specific object exists) as an example of specific object information to the processor 133. In addition, this specific object information can also be sent to the processor 133 via other devices (for example, vehicle ECU). In addition, when a camera is used as a sensor, an infrared camera or a near-infrared camera is preferably used so that a specific object can be detected even when the surrounding is dark at night. Furthermore, when a camera is used as a sensor, a stereo camera that can also acquire distance and the like through parallax is preferable.

[0068] The observer detection device 450 may include a camera such as an infrared camera that detects the eye position of the observer sitting in the driver's seat of the vehicle 1, and outputs the captured image to the processor 133. The processor 133 may acquire the captured image (an example of information that can estimate the eye position) from the observer detection device 450, analyze the captured image by a method such as pattern matching, thereby detecting the coordinates of the observer's eye position, and output a signal indicating the detected coordinates of the eye position to the processor 133.

[0069] In addition, the observer detection device 450 may also output the analysis result of analyzing the image captured by the camera (for example, a signal indicating where the observer's eye position belongs to the spatial region corresponding to the plurality of preset display parameters) to the processor 133. In addition, the method of obtaining the eye position of the observer of the vehicle 1 or the information capable of estimating the observer's eye position is not limited thereto, and may also be obtained using a known eye position detection (estimation) technology.

[0070] In addition, the observer detection device 450 may also detect the speed of change and / or the direction of movement of the observer's eye position, and output a signal indicating the speed of change and / or the direction of movement of the observer's eye position to the processor 133 .

[0071] The off-vehicle communication connection device 460 is a communication device for exchanging information with the vehicle 1, such as other vehicles connected to the vehicle 1 through vehicle-to-vehicle communication (V2V: Vehicle To Vehicle), pedestrians (mobile information terminals carried by pedestrians) connected through vehicle-to-pedestrian communication (V2P: Vehicle To Pedestrian), and network communication devices connected through vehicle-to-road infrastructure (V2I: Vehicle To Roadside Infrastructure), and in a broad sense, includes all objects connected through communication with the vehicle 1 (V2X: Vehicle To Everything). The off-vehicle communication connection device 460 can, for example, obtain the positions of pedestrians, bicycles, two-wheeled motor vehicles, other vehicles (such as the vehicle ahead), road surfaces, dividing lines, roadside objects, and / or ground objects (such as buildings), and send them to the processor 133. In addition, the vehicle-external communication connection device 460 may also have the same function as the above-mentioned locator 410, and send the position information and azimuth information of the vehicle 1 to the display control device 130, etc., and may also have the function of the above-mentioned road information database 403, obtain the road information (an example of surrounding vehicle related information), and send it to the processor 133. The information obtained from the vehicle-external communication connection device 460 is not limited to the above-mentioned information.

[0072] The software components stored in the memory 137 include a navigation image generation module 512 (an example of the bird's-eye view image generation module 510 ), a surrounding monitoring image generation module 514 (an example of the bird's-eye view image generation module 510 ), a determination module 520 , and an image switching module 530 .

[0073] The navigation image generation module 512 (an example of the bird's-eye view image generation module 510) performs the following processing: setting the position of the virtual viewpoint MM relative to the vehicle position icon PP on the map described later, and the bird's-eye view (depression angle) θ from the virtual viewpoint MM; changing the scale of the route guidance image 200; setting the virtual field of view E that determines the shape of the map that cuts out the area around the vehicle position icon PP; reading the map data around the vehicle from the map database 401, and generating an image observed from a specified position of the virtual viewpoint MM with a specified depression angle and a specified virtual field of view as a route guidance image.

[0074] The navigation image generation module 512 configures virtual objects for route guidance on a virtual road model around the vehicle 1 based on the map data and navigation information, and sets a virtual viewpoint position above the vehicle 1 based on the locator information (the position and angle of the vehicle 1). Then, the navigation image generation module 512 displays the virtual objects observed from the virtual viewpoint position as a bird's-eye view navigation image IM31 (an example of a bird's-eye view image IM30) described later. In addition, the navigation image generation module 512 can be omitted, and the display control device 130 can also obtain image data of the bird's-eye view navigation image IM31 (an example of a bird's-eye view image IM30) from the navigation device 430 or the like via the I / O interface 131.

[0075] Figure 7 This is a diagram showing the area of ​​the map image around the vehicle displayed as the bird's-eye navigation image IM31. Here, the map is assumed to be an αγ plane, and a virtual viewpoint position MM for displaying a bird's-eye view exists at a height Mβ on the β axis orthogonal to the αγ plane, that is, in the sky behind the vehicle position icon PP. Figure 7 In the example of , the virtual viewpoint position MM is set at a position away from Mγ1 to the rear (γ negative direction) of the vehicle position icon PP and away from Mβ1 to the top (β positive direction). Figure 7 As shown, the range of the map surrounded by the rectangular virtual field of view F1G1H1J1 with a top-down angle of θ from the virtual viewpoint position MM can be represented by the following trapezoid: surrounded by the reference numeral F2G2H2J2, the range in the left-right direction (α direction) is wider on the far side (γ positive direction), and the range in the left-right direction (α direction) is narrower on the near side (γ negative direction). In several display forms of the present embodiment, the virtual field of view E can be narrower in the left-right direction (α direction) of the area overlapping with the far side of the map than the rectangular virtual field of view FGHJ. That is, the area of ​​the map surrounded by the virtual field of view E (F1K1L1J1) observed from the virtual viewpoint position MM is surrounded by the reference numeral F2K2L2J2, and the range in the left-right direction (α direction) is narrower on the far side (γ positive direction) than the range surrounded by the reference numeral F2G2H2J2.

[0076] The navigation image generation module 512 sets the virtual viewpoint position MM at a position away from Mγ to the rear (γ negative direction) of the vehicle position icon PP and away from Mβ to the top (β positive direction). Therefore, when the vehicle is traveling straight on a straight road, if the vehicle position icon PP is observed from the virtual viewpoint position MM, a bird's-eye view navigation image IM31 of the vehicle position icon PP traveling forward is obtained. If the virtual viewpoint position MM is movable, the map image around the vehicle is displayed in a rotation (angle change). For example, when the vehicle position icon PP is turned and rotated 90 [degrees] counterclockwise when viewed from directly above, the virtual viewpoint position MM also rotates 90 [degrees] counterclockwise in conjunction with this.

[0077] The navigation image generation module 512 shortens the distance between the vehicle position icon PP and the virtual viewpoint position MM while increasing the scale of the bird's-eye view navigation image IM31. Specifically, at least one of the distance Mγ in the front-back direction (γ direction) and the height Mβ in the up-down direction (β direction) is shortened to shorten the distance between the vehicle position icon PP and the virtual viewpoint position MM. The navigation image generation module 512 may increase (gradually increase) the scale of the bird's-eye view navigation image IM31 as the distance to the route change location (e.g., a forked road) decreases.

[0078] The navigation image generation module 512 sets the position Mβ (Mγ) and angle θ of the virtual viewpoint position MM relative to the map image. The navigation image generation module 512 changes the angle (angle of depression) relative to the map image around the vehicle displayed as an overhead navigation image IM31 by changing the position Mβ (Mγ) of the virtual viewpoint and the angle θ. The navigation image generation module 512 typically sets the position of the "virtual viewpoint" around the vehicle (usually at an appropriate position behind the vehicle). In addition, the angle θ of the "virtual viewpoint" is the angle between the direction from the virtual viewpoint position MM through the longitudinal midpoint of the virtual field of view E1 described later and the αγ plane, hereinafter also referred to as the angle of depression.

[0079] Figure 8 This is a diagram for explaining virtual viewpoints MM having different depression angles θ relative to a predetermined virtual object (content) 800. Virtual viewpoint MM1 has depression angle θ1, which is, for example, 20 degrees. Virtual viewpoint MM2 has depression angle θ2 (>θ1), which is, for example, 60 degrees. Virtual viewpoint MM3 has depression angle θ3 (>θ2), which is 90 degrees. The virtual object (content) 800 is a navigation image IM30 and a surrounding monitoring image (not shown), but in order to facilitate understanding of the difference in depression angle θ, Figure 8 In the example above, the virtual object (content) 800 is set to "A".

[0080] Fig.9A It is shown from Figure 8 FIG. 8 is a diagram showing a virtual object (content) 800 (right diagram) and a navigation image IM31 (left diagram) observed from a virtual viewpoint MM1 (depression angle θ1). Fig. 9B It is shown from Figure 8 FIG. 8 is a diagram showing a virtual object (content) 800 (right diagram) and a navigation image IM32 (left diagram) observed from a virtual viewpoint MM2 (depression angle θ2). Fig. 9C It is shown from Figure 8 The virtual object (content) 800 (right figure) and the navigation image IM33 (left figure) observed from the virtual viewpoint MM3 (pitch angle θ3) are shown in FIG. Fig.9A When the navigation image IM31 is the first display image IM10, it can be said that the depression angle θ is greater than that of the first display image IM10. Fig. 9B Navigation image IM32 or Fig. 9C The navigation image IM33 is the second display image IM20. That is, the second display image IM20 may include a second display image IM21 having a depression angle θ greater than that of the first display image IM10 and less than 90 degrees, and a second display image IM22 having a depression angle θ greater than that of the first display image IM10 and 90 degrees. Fig.9A The first display image IM10 and Fig. 9B The second display image IM21 (IM20) shown is an image obtained by looking down at the content at an acute angle of depression θ, and can be said to be a 3D expression. Fig. 9C The second display image IM22 (IM20) shown is an image in which the depression angle θ is 90 degrees and the virtual viewpoint MM is arranged facing the content, and can be said to be a 2D expression.

[0081] In the display position change process, the display control device 130 (processor 133) performs at least one of the following processes: gradually increasing the depression angle θ when moving the content 800 from the first display unit 110 (first display area 101) to the second display unit 120 (second display area 102); and gradually decreasing the depression angle θ when moving the content from the second display unit 120 (second display area 102) to the first display unit 110 (first display area 101). In the display control device 130 of this embodiment, the content 800 displayed on the first display unit 110 gradually increases the depression angle θ and moves toward the second fixed position 107 of the second display unit 120 with a shorter image distance ID0, so the following advantage can also be imagined: the content 800 can be emphasized in a manner that it approaches the near side to leave an impression. In addition, in the display control device 130 of the present embodiment, the content 800 displayed on the second display unit 120 gradually reduces the depression angle θ and moves toward the specified first fixed position 106 of the first display unit 110 having a longer image distance ID0, so the following advantage can also be envisioned: the content 800 can be emphasized in a manner that moves away from the distant side to leave an impression.

[0082] Fig.10 FIG. 1 is a diagram showing an embodiment of transition of a display image in a display position change process executed by the display control device 130. The display control device 130 performs the display position change process according to FIG. Fig.10 The depression angle θ is gradually increased in the order of (a), (b), (c), and (d) and the virtual object (content) 800 is moved from the first display area 101 (first fixed position 106) to the second display area 102 (second fixed position 107). Fig.10 The sequence of (d), (c), (b) and (a) gradually reduces the depression angle θ and moves the virtual object (content) 800 from the second display area 102 (second fixed position 107) to the first display area 101 (first fixed position 106). Fig.10 In (a), the virtual object 800 is displayed as the first display image IM10 at the first fixed position 106. When the condition for performing the display position change process is satisfied, the display control device 130 moves the first display image IM10 displayed at the first fixed position 106 toward the second display area 102 (second fixed position 107). Fig.10 The first transition image IM15 (displaying the solid line part and not displaying the dotted line part) of (b) is moving from the first fixed position 106 to the second fixed position 107 in the first display area 101, and the depression angle θ is set to Fig.10 The first display image IM10 of (a) is larger. Fig.10The second transition image IM25 (displaying the solid line portion and not displaying the dotted line portion) of (c) is moving from the first fixed position 106 toward the second fixed position 107 in the second display area 102, and the depression angle θ is set to be greater than Fig.10 The first transition image IM15 of (b) is larger. Fig.10 The second display image IM20 of (d) has completed the movement from the first fixed position 106 to the second fixed position 107 and is positioned at the second fixed position 107, and is set to a depression angle θ of Fig.10 The first transition image IM15 of (b) is larger.

[0083] In the display control device 130 of some embodiments, in the display position change process, the processor 133 gradually changes the depression angle θ at the movement source. The observer 4 can predict the change of the display position of the content 800 and the next display position (movement destination) of the content 800 through the change of the depression angle θ. In this embodiment, when the display position change process starts, the change of the depression angle θ starts earlier in the display area of ​​the movement source, so the next display position (movement destination) of the content 800 can be predicted at an earlier timing.

[0084] In the display control device 130 of some embodiments, in the display position change process, the processor 133 moves the content 800 from the movement source to the movement destination side and gradually changes the depression angle θ. Fig.10 As shown, the content 800 displayed on the first display unit 110 gradually increases the depression angle θ and moves toward the second display unit 120 with a shorter image distance ID0, and is finally displayed at the specified second fixed position 107 of the second display unit 120 with a shorter image distance ID0. Therefore, the following advantage can be conceived: from the middle of the movement of the content 800 on the first display unit 110, the content 800 can be emphasized in a manner that it approaches the near side and leaves an impression. In addition, in the display control device 130 of the present embodiment, the content 800 displayed on the second display unit 120 gradually decreases the depression angle θ and moves toward the first display unit 110 with a longer image distance ID0, and is finally displayed at the specified first fixed position 106 of the first display unit 110 with a longer image distance ID0. Therefore, the following advantage can be conceived: from the middle of the movement of the content 800 on the second display unit 120, the content 800 can be emphasized in a manner that it moves away from the far side and leaves an impression. In addition, not limited to this, in the display position change process, the processor 133 of some embodiments may terminate the display of the content 800 at the moving source after gradually changing the depression angle θ of the content 800 at the moving source (for example, sliding out, fading out, or a combination thereof).

[0085] In the display control device 130 of some embodiments, in the display position change process, the processor 133 moves the content 800 from the moving source side at the moving destination without changing the depression angle θ. In the display device of this embodiment, by changing the depression angle θ of the content 800 at the moving source and moving the display position, it is possible to emphasize and leave an impression in a manner that the image distance ID0 of the content 800 changes, or it is possible to emphasize the change of the depression angle θ of the content 800 and leave an impression, so the change of the depression angle θ of the content at the moving destination is not necessary. Therefore, in the display control device, the following advantages can also be envisioned: the change of the depression angle θ at the moving destination that may become a redundant expression at the moving source can be reduced, and the control load can be reduced. In addition, it is not limited to this, and it is also possible that in the display position change process, the processor 133 of some embodiments also moves the content 800 from the moving source side and changes the depression angle θ at the moving destination.

[0086] In addition, in the display control device 130 of some embodiments, in the display position change process, when the size of the content 800 at the moving destination is smaller than the size of the content 800 at the moving source, the processor 133 shrinks the content at the moving source. In addition, when the size of the content 800 at the moving destination is larger than the size of the content 800 at the moving source, the processor 133 enlarges the content 800 at the moving source. In the case where the size of the content 800 is greatly different at the moving source and the moving destination, it can be imagined that when the display unit displaying the content 800 is switched, the size of the visually recognizable content 800 is greatly different, and it is difficult to recognize it as the same content. In the display control device 130 of this embodiment, by scaling the content 800 at the moving source in a manner that makes the size of the content 800 close to the size of the content at the moving destination, the following advantage can be imagined: eliminating (or reducing) the difference in the size of the visually recognizable content that is imagined when the display unit displaying the content 800 is switched.

[0087] Fig.11 FIG. 1 is a diagram showing an embodiment of transition of a display image in a display position change process executed by the display control device 130. The display control device 130 performs the display position change process according to FIG. Fig.11 The virtual object (content) 800 is enlarged and moved from the first display area 101 (first fixed position 106) to the second display area 102 (second fixed position 107) in the order of (a), (b), (c), and (d). Fig.11 The virtual object (content) 800 is reduced in size and moved from the second display area 102 (second fixed position 107) to the first display area 101 (first fixed position 106) in the order of (d), (c), (b), and (a). Fig.11In (a), the virtual object 800 is displayed as the first display image IM10 at the first fixed position 106. When the condition for performing the display position change process is satisfied, the display control device 130 moves the first display image IM10 displayed at the first fixed position 106 toward the second display area 102 (second fixed position 107). Fig.11 The first transition image IM15 (displaying the solid line part and not displaying the dotted line part) of (b) is moving from the first fixed position 106 to the second fixed position 107 in the first display area 101, and is set to Fig.11 Compared with the first display image IM10 of (a), the depression angle θ is larger and the size is also larger. Fig.11 The second transition image IM25 (displaying the solid line part and not displaying the dotted line part) of (c) is moving from the first fixed position 106 to the second fixed position 107 in the second display area 102, and is set to Fig.11 Compared with the first transition image IM15 of (b), the depression angle θ is larger and the size is also larger. Fig.11 The second display image IM20 of (d) has completed the movement from the first fixed position 106 to the second fixed position 107 and is positioned at the second fixed position 107, and is set to a depression angle θ of Fig.11 The first transition image IM15 of (b) is larger (approximately the same size).

[0088] In addition, in the display control device 130 of some embodiments, in the display position change process, the processor 133 causes the content 800 to gradually change from the end of the content 800 on the moving destination side to a form that cannot be visually recognized at the moving source. In the display control device of this embodiment, by gradually changing the content from the end of the moving destination side of the content to a form that cannot be visually recognized when the content is stopped (not moved), the following advantage can be envisioned: even if the content is not moved, the observer can perceive that it has moved to the moving destination. In addition, in the display control device of the seventh embodiment, by moving the content to the moving destination and gradually changing the content from the end of the moving destination side of the content to a form that cannot be visually recognized, the following advantage can be envisioned: the observer can perceive that the content is moving by emphasizing that the content is moving.

[0089] Fig.12 is a diagram illustrating the display transition of content. Fig.12In the first transition image IM15, if the destination (second display area 102) is assumed to be at the bottom, the state gradually changes to a state where the content 800 cannot be visually recognized (a state where the dotted line portion cannot be visually recognized) from the end (bottom end) of the first transition image IM15 close to the destination (second display area 102) to the end (top end) on the opposite side. In other words, the content 800 fades out from the end on the destination side. Although not shown, in the second transition image IM25, the destination (first display area 101) is at the top, so the area where the content 800 cannot be visually recognized gradually increases from the end (top end) of the second transition image IM25 close to the destination (first display area 101).

[0090] In addition, in the display control device 130 of some embodiments, the content included in the first display image IM10 is a part of the content included in the second display image IM20. When the display control device 130 of this embodiment switches the display position of the content 800 between the first display area 101 and the second display area 102, by adding or subtracting the amount of information of the content 800, it is conceivable that the amount of information and the conspicuousness of the image can be adjusted to improve convenience.

[0091] Fig.13 It is a figure explaining the display form of the first display image IM10 (upper figure) and the second display image IM20 (lower figure). When the content included in the second display image IM20 is "A to H", the display control device 130 can perform display control in a manner that the first display image IM10 includes a part of the content included in the second display image IM20 ("B, C, F, G") but does not include another part ("A, D, E, H").

[0092] In addition, in the display control device 130 of some embodiments, the first display image IM10 has a predetermined first depth expression, and the second display image IM20 does not have the first depth expression. The display control device 130 of this embodiment can further emphasize the change of the depression angle θ relative to the content 800 by switching the expression method between the first display image IM10 having the first depth expression and the second display image IM20 not having the first depth expression. By emphasizing the change of the depression angle θ, the difference in the displayed distance (image distance) ID0 can be emphasized to leave an impression. The first depth expression is an expression that reduces the clarity of the back side of the content.

[0093] As examples of the first depth expression, the following methods can be listed. (1) In the first depth expression, the back side is made lighter and the front side is made darker. (2) In the first depth expression, the contour line or shadow of the back side is made thinner and the front side is made thicker. (3) In the first depth expression, the saturation is lower toward the back side and higher toward the front side (however, the opposite may occur depending on the background color, etc.). (4) In the first depth expression, the brightness (brightness) of the back side is reduced and the brightness of the front side is increased (however, the opposite may occur depending on the brightness and lightness of the background). (5) In the first depth expression, the contrast with the background is reduced on the back side and increased on the front side (however, the opposite may occur depending on the background color, hue, etc.).

[0094] The display control device 130 (processor 133) determines whether the first condition for switching the display position of the content 800 from the first display unit 110 (first display area 101) to the second display unit 120 (second display area 102) (moving the display position) is met, and whether the second condition for switching the display position of the content 800 from the second display unit 120 (second display area 102) to the first display unit 110 (first display area 101) (moving the display position) is met.

[0095] As examples of the above-mentioned first condition, the following conditions can be listed. (1) The first display image IM10 is a menu content selected by the operation of the observer 4, and a specific operation is detected by the observer 4 on the above-mentioned menu content. (2) A reduction in the display priority of the first display image IM10 is detected. (3) A situation in which the observer 4's line of sight is intended to be guided to the second display area 102 is detected. (4) It is determined that the information of the first display image IM10 does not match the foreground 300. (5) Information displayed separately is detected in the first display area 101. (6) The condition for ending the display of the first display unit 110 is met. In addition, the above-mentioned first condition is not limited to this.

[0096] As examples of the second condition, the following conditions can be cited. (1) An increase in the display priority of content 800 is detected. (2) A situation in which the viewer 4's line of sight is directed to first display area 101 is detected. (3) A situation in which content 800 is determined to be displayed in a manner matching foreground 300. (4) A situation in which the viewer 4's attention should be called is determined. The second condition is not limited to this.

[0097] Fig.14 FIG. 1 is a diagram showing an embodiment of transition of a display image in a display position change process executed by the display control device 130. The display control device 130 performs the display position change process according to FIG. Fig.14The virtual object (content) 800 is moved from the first display area 101 (first fixed position 106) to the second display area 102 (second fixed position 107) in the order of (a), (b), (c), (d), and (e). Fig.14 The sequence of (e), (d), (c), (b), and (a) causes the virtual object (content) 800 to move from the second display area 102 (second fixed position 107) to the first display area 101 (first fixed position 106). Fig.14 In (a), the virtual object 800 is displayed as the first display image IM10 at the first fixed position 106. When the condition for performing the display position change process is satisfied, the display control device 130 moves the first display image IM10 displayed at the first fixed position 106 toward the second display area 102 (second fixed position 107). Fig.14 The first transition image IM15 (displaying the solid line part and not displaying the dotted line part) of (b) is moving from the first fixed position 106 to the second fixed position 107 in the first display area 101, and the depression angle θ is set to Fig.14 The first display image IM10 of (a) is larger. Fig.14 In (c), the second display image IM20 is displayed in the second display area 102 (second fixed position 107). Fig.14 The second transition image IM25 (displaying the solid line portion and not displaying the dotted line portion) of (d) is moving from the first fixed position 106 toward the second fixed position 107 in the second display area 102, and the depression angle θ is set to be greater than Fig.14 The first transition image IM15 of (b) is larger. Fig.14 The second transition image IM25 of (d) gradually approaches the second display image IM20 and fades out. Fig.14 The second transition image IM25 of (d) may also gradually approach the second display image IM20, gradually approach the depression angle θ of the second display image IM20, and then fade out. Fig.14 The second display image IM20 of (e) is Fig.14 (d) When the second transition image IM25 fades out, Fig.14 The image shown in (c) is displayed as is.

[0098] In addition, in some vehicle display systems 10 , the second display unit 120 may be a display panel provided between the instrument panel 5 and the front windshield 2 . Fig.15 The second display unit 120B is a display panel which is provided on the instrument panel 5 on the driver 4 side relative to the light-transmitting unit 26 of the head-up display device 120A and whose back surface is held by the light-shielding unit 125 . Fig.15The second display area 102 of the second display unit 120D displaying the second display image IM20 is arranged in an area (foreground non-overlapping area) 700 that does not overlap with the real scene across the front windshield 2 when viewed from the center of the eye range EB of the head-up display device 20A.

[0099] In addition, if Fig.16 As shown, the second display unit 120 is a display panel provided on the instrument panel 5 further back (away from the driver 4 ) than the light-transmitting unit 26 of the head-up display device 20A, and the back surface of the display panel is held by the light-shielding unit 125 . Fig.16 The second display area 102 of the second display unit 120C displaying the second display image IM20 is arranged in an area (foreground non-overlapping area) 700 that does not overlap with the real scene across the front windshield 2 when viewed from the center of the eye range EB of the head-up display device 20A.

[0100] The actions of the above processing process can be implemented by executing one or more functional modules of an information processing device such as a general-purpose processor or a dedicated chip. These modules, combinations of these modules and / or combinations of known hardware that can replace their functions are all included in the protection scope of the present invention.

[0101] In order to implement the principles of the various embodiments described, the functional blocks of the vehicle display system 10 can be optionally implemented by hardware, software, or a combination of hardware and software. Figure 2 The functional blocks described in the specification may be optionally combined or one functional block may be separated into two or more sub-blocks. Therefore, the description in this specification optionally supports any possible combination or splitting of the functional blocks described in this specification.

[0102] Explanation of symbols

[0103] 1: vehicle; 2: front windshield; 2C: W / S shading unit; 3: observer; 4: observer; 5: instrument panel; 6: road surface; 10: vehicle display system; 11A: display light; 12: first image generating unit; 12A: display; 13A: relay optical system; 21A: display light; 22: second image generating unit; 22A: display; 30: display control device; 101: first display area; 102: second display area; 106: first fixed position; 107: second Two fixed positions; 110A: HUD device (first display unit); 110B: HMD device (first display unit); 120A: Nearby HUD device (second display unit); 130: Display control device; 131: I / O interface; 133: Processor; 135: Image processing circuit; 137: Memory; 200: Travel route guidance image; 300: Foreground; 310: Road surface; 401: Map database; 403: Road information database; 410: Positioner; 411: GNSS device; 420: map information storage device; 430: navigation device; 440: perimeter monitoring sensor; 450: observer detection device; 460: off-vehicle communication connection device; 510: bird's-eye view image generation module; 512: navigation image generation module; 514: perimeter monitoring image generation module; 520: determination module; 530: image switching module; 600: foreground overlapping area; 700: foreground non-overlapping area (shading part); 800: virtual object (content); E: virtual Virtual field of view; ID0: image distance; ID1: image distance; ID1: first image distance; IM10: first display image; IM15: first transition image; IM20: second display image; IM25: second transition image; IM30: navigation image (bird's-eye view image); MM: virtual viewpoint; MM1: virtual viewpoint; MM2: virtual viewpoint; MM3: virtual viewpoint; Mβ: height; Mγ: distance; PP: vehicle position icon; θ: depression angle; θ1: depression angle; θ2: depression angle; θ3: depression angle.

Claims

1. A display control device for controlling a vehicle display system, the vehicle display system comprising a first display unit displaying an image in a first display area and a second display unit displaying an image in a second display area arranged closer to the first display area, the display control device being characterized in that: The processor executes a display position change process of moving predetermined content between the first display area and the second display area. The first display unit displays a first display image that is a bird's-eye view of the content obliquely viewed from above. The second display unit displays a second display image having a larger depression angle than the first display image.

2. The display control device according to claim 1, characterized in that: In the display position change process, the processor performs at least one of the following processes: When the content is moved from the first display area to the second display area, gradually increasing the depression angle; and When the content is moved from the second display area to the first display area, the depression angle is gradually reduced.

3. (You can also change the depression angle without moving before moving) The display control device according to claim 2, characterized in that: In the display position changing process, the processor gradually changes the depression angle at the movement source.

4. (Limited to moving at the moving source and changing the pitch angle) The display control device according to claim 3 is characterized in that: In the display position change process, the processor moves the content at a movement source toward a movement destination and gradually changes the depression angle.

5. (Limited to the situation where the pitch angle changes at the moving source and does not change at the moving destination) The display control device according to claim 3 is characterized in that: In the display position changing process, the processor moves the content from a movement source side at the movement destination without changing the depression angle.

6. (If the content size is different on each display, scale it before moving it) The display control device according to claim 1, characterized in that: In the display position change process, the processor performs at least one of the following processes: When the size of the content at the movement destination is smaller than the size of the content at the movement source, reducing the content at the movement source; as well as When the size of the content at the movement destination is larger than the size of the content at the movement source, the content is enlarged at the movement source.

7. (Emphasis on the limitation of the method of eliminating image movement) The display control device according to claim 1, characterized in that: In the display position change process, the processor causes the content to gradually change from an end of the content on the movement destination side to a form that is not visually recognizable at the movement source.

8. The display control device according to claim 1, characterized in that: The content included in the first display image is a part of the content included in the second display image.

9. The display control device according to claim 1, characterized in that: The first displayed image is a 3D representation, The second display image is a 2D representation.

10. The display control device according to claim 1, characterized in that: The first display image has a predetermined first depth representation, The second display image does not have the first depth representation.

11. A head-up display device, The first display unit comprises: The display control device according to claim 1; a display that emits display light; and a relay optical system for directing the display light from the display toward a projection portion, The first display unit displays a virtual image in the first display area, wherein: The first display area has an upper end disposed farther than a lower end when viewed from an observer.

12. A display control method, which is a display control method for a vehicle display system, the vehicle display system comprising a first display unit that displays an image in a first display area and a second display unit that displays an image in a second display area that is arranged closer to the first display area, the display control method comprising: executing a display position change process of moving a predetermined content between the first display area and the second display area; causing the first display unit to display a first display image that is a bird's-eye view image obtained by obliquely looking down on the content; as well as The second display unit is caused to display a second display image having a larger depression angle than the first display image.

Citation Information

Cited By

  • Head-up display system

    CN120742556A