Display control device, display control method, and display control program

The display control device dynamically adjusts background images and viewpoints based on vehicle conditions and user preferences, improving the presentation of vehicle surroundings.

JP2025136614APending Publication Date: 2025-09-19TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024035309
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-07
Publication Date
2025-09-19

AI Technical Summary

Technical Problem

Existing vehicle display systems do not adequately switch background images to suit changing surrounding conditions, lacking flexibility and user customization.

Method used

A display control device that changes background images and virtual viewpoints based on vehicle location, state, and user preferences, using sensors and cameras to provide multiple formats of road and target images.

Benefits of technology

Enables dynamic presentation of vehicle surroundings in various formats, enhancing user engagement and safety by adapting to conditions and preferences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025136614000001_ABST
    Figure 2025136614000001_ABST
Patent Text Reader

Abstract

To present a background image indicating a peripheral situation of an own vehicle to an occupant in a plurality of modes.SOLUTION: A display control device includes a control part that causes an image indicating an own vehicle and a peripheral situation when viewed from a virtual viewpoint to be displayed in a display part on the basis of peripheral information related to the peripheral situation of the own vehicle, and changes a background image displayed as an image indicating the peripheral situation in response to establishment of a predetermined condition.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a display control device, a display control method, and a display control program. [Background technology]

[0002] Patent Document 1 discloses a vehicle control device that can perform automatic driving that gives a sense of security to the occupants. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7048398 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology disclosed in Patent Document 1, an image showing the surrounding conditions of the vehicle is displayed on a display unit (see FIG. 8 of Patent Document 1). Here, it is desirable that the background image displayed together with the image showing the vehicle, among the images showing the surrounding conditions, be appropriately switched to a more suitable image in accordance with changes in the surrounding conditions. However, Patent Document 1 does not disclose how to switch the background image, and there is room for improvement.

[0005] Therefore, an object of the present disclosure is to provide a display control device, a display control method, and a display control program that can present background images showing the surrounding conditions of the vehicle to the occupants in multiple formats. [Means for solving the problem]

[0006] The display control device of claim 1 has a control unit that displays an image showing the vehicle and the surrounding situation as seen from a virtual viewpoint on a display unit based on surrounding information regarding the surrounding situation of the vehicle, and changes the background image displayed as the image showing the surrounding situation when a predetermined condition is met.

[0007] In the display control device according to claim 1, the control unit causes the display unit to display an image showing the host vehicle and the surrounding situation as seen from a virtual viewpoint, based on surrounding information relating to the surrounding situation of the host vehicle. The control unit then changes the background image displayed as the image showing the surrounding situation when a predetermined condition is met. As a result, according to the display control device, by changing the background image showing the surrounding situation of the host vehicle when a predetermined condition is met, the background image can be presented to the occupant in multiple forms before and after the change.

[0008] The display control device of claim 2 is the same as claim 1, wherein the control unit changes the background image displayed on the display unit when the predetermined condition based on at least one of the driving location and state of the vehicle is met, and changes the virtual viewpoint to match the changed background image.

[0009] In the display control device according to claim 2, the control unit changes the background image displayed on the display unit when a predetermined condition based on at least one of the location and state of the vehicle is met.The control unit then changes the virtual viewpoint to match the changed background image.As a result, the display control device can present to the occupant a road image seen from a virtual viewpoint that is assumed to be suitable depending on at least one of the location and state of the vehicle.

[0010] The display control device of claim 3 is in claim 1 or 2, wherein the control unit changes the background image displayed on the display unit when the predetermined condition based on the selection of the occupant of the vehicle is met, and switches between displaying and hiding images of individual targets displayed as images showing the surrounding conditions.

[0011] In the display control device according to claim 3, the control unit changes the background image displayed on the display unit when a predetermined condition based on a selection by an occupant of the vehicle is met. Then, the control unit switches between displaying and hiding images of individual targets displayed as images showing the surrounding conditions when the predetermined condition is met. In this way, the display control device can present the occupant with backgrounds and targets that suit the occupant's preferences.

[0012] The display control device of claim 4 is in claim 3, wherein when the control unit switches the image of a specific target to hidden, the control unit displays warning information on the display unit indicating that the image of the specific target will not be displayed as an image showing the surrounding conditions.

[0013] In the display control device according to claim 4, when the control unit switches the image of the specific target to non-display, the control unit displays, on the display unit, warning information indicating that the image of the specific target will not be displayed as an image showing the surrounding situation. As a result, according to the display control device, even if the image of the specific target is not displayed on the display unit, it is possible to make the user pay attention to the specific target existing in real space.

[0014] The display control device of claim 5 is in claim 3 or 4, wherein when multiple targets of the same type are detected within a predetermined range, the control unit displays on the display unit only images of targets among the multiple targets that pose a risk to the vehicle that exceeds a predetermined standard.

[0015] In the display control device according to claim 5, when a plurality of targets of the same type existing within a predetermined range are detected, the control unit displays on the display unit only images of targets among the plurality of targets that pose a danger to the vehicle that exceeds a predetermined standard. This allows the display control device to increase attention to targets existing in real space that pose a danger to the vehicle that exceeds the predetermined standard.

[0016] A display control device according to claim 6 is the display control device according to any one of claims 1 to 5, wherein the display unit is a meter display provided in front of a driver's seat of the host vehicle.

[0017] In the display control device according to claim 6, the display unit is a meter display provided in front of the driver's seat of the host vehicle. As a result, the display control device can present information indicating the meters of the measurement devices of the host vehicle and an image showing the host vehicle and its surrounding conditions to the occupant on a single screen.

[0018] The display control method according to claim 7 is a method in which a computer executes a process to display an image showing the host vehicle and the surrounding situation as seen from a virtual viewpoint on a display unit based on surrounding information relating to the surrounding situation of the host vehicle, and to change a background image displayed as the image showing the surrounding situation when a predetermined condition is met.

[0019] The display control program according to claim 8 causes a computer to execute a process of displaying on a display unit an image showing the host vehicle and the surrounding situation as seen from a virtual viewpoint, based on surrounding information relating to the surrounding situation of the host vehicle, and changing the background image displayed as the image showing the surrounding situation when a predetermined condition is met. [Effects of the Invention]

[0020] As described above, the display control device, display control method, and display control program according to the present disclosure can present a background image showing the surrounding conditions of the vehicle to the occupant in a plurality of formats. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a block diagram showing a schematic configuration of a vehicle. [Figure 2] 1 is a schematic view of a front portion of a vehicle interior as viewed from the rear side of the vehicle. [Figure 3] FIG. 2 is an explanatory diagram illustrating a display area of ​​a first display unit. [Figure 4] FIG. 1 is a block diagram showing a schematic configuration of a display control device. [Figure 5] FIG. 2 is a block diagram illustrating an example of a functional configuration of a display control device. [Figure 6]10 is a flowchart showing the flow of a specification process. [Figure 7] FIG. 10 is a first explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 8] FIG. 2 is a second explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 9] FIG. 10 is a third explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 10] FIG. 4 is a fourth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 11] FIG. 5 is a fifth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 12] FIG. 6 is a sixth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 13] FIG. 7 is a seventh explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 14] FIG. 8 is an eighth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 15] FIG. 9 is a ninth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 16] FIG. 10 is a tenth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 17] FIG. 11 is an explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 18] FIG. 12 is a twelfth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. [Figure 19] FIG. 13 is a thirteenth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit. DETAILED DESCRIPTION OF THE INVENTION

[0022] The vehicle 10 according to this embodiment will be described below. (First embodiment) First, a first embodiment of a vehicle 10 according to the present embodiment will be described.

[0023] FIG. 1 is a block diagram showing a schematic configuration of a vehicle 10. As shown in FIG. 1, vehicle 10 includes a display device 21, a sensor group 30, a camera 40, and a display control device 50. Display device 21, sensor group 30, camera 40, and display control device 50 are connected to each other via an external bus (communication bus) 15. Vehicle 10 is an example of a "host vehicle."

[0024] The display device 21 displays operation suggestions related to functions of the vehicle 10, images related to explanations of the functions, etc. In this embodiment, a first display unit 24 and a second display unit 25 are provided as the display device 21. The first display unit 24 is an example of a "display unit." Details of the first display unit 24 and the second display unit 25 will be described later.

[0025] The sensor group 30 includes sensors for detecting the state and surrounding conditions of the vehicle 10, such as a 3D-LiDAR, a millimeter wave sensor, an infrared sensor, a blinker sensor, an accelerator position sensor, a shift position sensor, an illuminance sensor, a vehicle speed sensor, a steering angle sensor, an angular velocity sensor, a GPS (Global Positioning System) sensor, a gyro sensor, and an acceleration sensor. The sensor group 30 outputs the detection results of each sensor to the display control device 50.

[0026] The camera 40 is an imaging device that captures images using an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The cameras 40 are provided on the front, rear, left side, and right side of the vehicle 10, and capture images of the surroundings of the vehicle 10. For example, images captured by the camera 40 provided on the front of the vehicle 10 are used to recognize other vehicles traveling in front of the vehicle, the distance between the other vehicles, lanes, traffic lights, etc. The images captured by the camera 40 are output to the display control device 50. The camera 40 may also be configured as an imaging device for other purposes, such as a drive recorder and an ADAS (Advanced Driver Assistance System).

[0027] The display control device 50 is, for example, an ECU (Electrical Control Unit) that performs various controls.

[0028] 2 is a schematic diagram of the front of the passenger compartment 12 of the vehicle 10 as seen from the rear of the vehicle. The arrow UP in FIG. 2 indicates the upper side in the vertical direction of the vehicle, and the arrow RH indicates the right side in the width direction of the vehicle. In the following description, the vertical direction and the left-right direction refer to the up and down in the vertical direction of the vehicle and the left and right in the width direction of the vehicle, respectively.

[0029] As shown in Fig. 2, an instrument panel 14 is provided in the front of a passenger compartment 12 of a vehicle 10. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, as an example, the vehicle 10 is a right-hand drive vehicle in which the steering wheel 16 is provided on the right side, and the driver's seat is provided on the right side of the vehicle. However, the present invention is not limited to this, and the vehicle 10 may also be a left-hand drive vehicle in which the driver's seat is provided on the left side of the vehicle.

[0030] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 extends in the vertical direction and the width direction of the vehicle, and separates the interior of the vehicle compartment 12 from the exterior of the vehicle compartment 12.

[0031] The right end of the windshield glass 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. In addition, the front ends of front side windows 22 are fixed to the outer end of the front pillar 20 in the vehicle width direction. The left end of the windshield glass 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0032] Here, the instrument panel 14 is provided with a first display unit 24 having an image display area V. The first display unit 24 is configured as a meter display provided on the right side of the instrument panel 14, in front of the driver's seat. The first display unit 24 is connected to various meter devices mounted on the vehicle 10, and is provided in a position that is within the field of view of the driver when he or she is looking forward toward the front of the vehicle. The driver is an example of an "occupant."

[0033] The instrument panel 14 is also provided with a second display unit 25. The second display unit 25 is configured by a center display disposed in the center of the instrument panel 14 in the vehicle width direction.

[0034] FIG. 3 is an explanatory diagram illustrating the display area of ​​the meter display as the display area V of the first display unit 24.

[0035] 3 shows a display area V of the first display unit 24. In this embodiment, a host vehicle image 10A (see FIG. 7, etc.) that is an image showing the vehicle 10 and a surrounding situation image that is an image showing the surrounding situation of the vehicle 10 are displayed in a display area X that is a part of the display area V. Specific examples of these images will be described later.

[0036] The display area X is an area that can be seen by a driver seated in the driver's seat through an opening 17 (see FIG. 2) of the steering wheel 16. Specifically, as shown in FIG. 3, the center of the area that can be seen between an upper ridge line L1 and a lower ridge line L2 of the opening 17 is the display area X. On the left and right sides of the display area X in the display area V, meter displays M1 and M2 that indicate meters of measuring instruments of the vehicle 10 are displayed.

[0037] FIG. 4 is a block diagram showing a schematic configuration of the display control device 50. As shown in FIG. 4, the display control device 50 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a storage 54, a communication I / F (Interface) 55, and an input / output I / F 56. The CPU 51, the ROM 52, the RAM 53, the storage 54, the communication I / F 55, and the input / output I / F 56 are connected via an internal bus 57 so as to be able to communicate with each other.

[0038] The CPU 51 is a central processing unit that executes various programs and controls various components. That is, the CPU 51 reads programs from the ROM 52 and executes the programs using the RAM 53 as a work area. In this embodiment, a display control program 52A is stored in the ROM 52.

[0039] The ROM 52 stores various programs and various data. The RAM 53 serves as a working area for temporarily storing programs or data.

[0040] The storage 54 is a NAND memory configured by an eMMC (embedded multi media card) or a UFS (universal flash storage), etc. The storage 54 and the CPU 51 are connected via an eMMC or UFS interface.

[0041] Furthermore, each component included in the display control device 50, such as the ROM 52 and the storage 54, is preferably a tamper-resistant medium such as an HSM (Hardware Security Module).

[0042] The communication I / F 55 is an interface for connecting with other ECUs, and uses the Ethernet (registered trademark) communication standard.

[0043] The input / output I / F 56 is an interface for communicating with on-board devices such as the display device 21, the sensor group 30, and the camera 40 mounted on the vehicle 10.

[0044] Next, the functional configuration of the display control device 50 will be described. FIG. 5 is a block diagram showing an example of the functional configuration of the display control device 50. As shown in FIG.

[0045] 5, the CPU 51 of the display control device 50 has, as functional components, an acquisition unit 51A and a control unit 51B. Each functional component is realized by the CPU 51 reading and executing a display control program 52A stored in the ROM 52.

[0046] The acquisition unit 51A acquires various types of information. For example, the acquisition unit 51A acquires, as the various types of information, surrounding information related to the surrounding conditions of the vehicle 10. The surrounding information includes detection results by the sensors constituting the sensor group 30, images captured by the camera 40, etc.

[0047] The control unit 51B performs display control related to the display of the display device 21. For example, as the display control, the control unit 51B causes the first display unit 24 to display the host vehicle image 10A and the surrounding situation image as viewed from a virtual viewpoint based on the surrounding information acquired by the acquisition unit 51A. The virtual viewpoint is set in a three-dimensional virtual space with the position of the host vehicle image 10A as the origin, and is defined by viewpoint coordinates and a viewpoint angle (orientation) in the virtual space. As an example, the virtual viewpoint is a viewpoint seen at a specific viewpoint angle from specific viewpoint coordinates above the host vehicle image 10A in the virtual space.

[0048] The surrounding situation image also includes a road image showing the road including the roadway and sidewalk on which the vehicle 10 is traveling, and a target image showing targets other than the vehicle 10, such as other vehicles and pedestrians. The roads shown in the road image include public roads, private roads, vacant lots, squares, parking lots, etc. The road image is an example of a "background image."

[0049] Based on the surrounding information, the control unit 51B generates an image showing the vehicle 10, the road, and the target object to be displayed on the first display unit 24, and displays the vehicle image 10A and the target object image on the road image in a position that takes into account their actual positional relationship, and from a perspective that views the vehicle 10 from a specific virtual viewpoint.

[0050] As part of the display control, the control unit 51B also changes the road image displayed as the surrounding situation image when a predetermined condition is met. The predetermined condition is a variety of conditions for changing the road image displayed on the first display unit 24. In the first embodiment, the control unit 51B determines whether the predetermined condition is met based on the location and state of the vehicle 10. For example, the control unit 51B determines that the predetermined condition is met when the location of the vehicle 10 changes from an ordinary road to an expressway, or from an expressway to an ordinary road. The control unit 51B also determines that the predetermined condition is met when the shift position of the vehicle 10 is switched to the R range.

[0051] Here, three types of road images are provided: a first road image 60A, a second road image 60B, and a third road image 60C (see FIGS. 7 to 9). The first road image 60A is an illustration image in which roads around the vehicle 10 are depicted as straight roads or curved roads. The second road image 60B is an illustration image in which roads around the vehicle 10 shown in map data stored in an external server or storage 54 or the like are depicted as 3D models. The third road image 60C is an image of the roads around the vehicle 10 captured in real time by the camera 40.

[0052] Furthermore, the control unit 51B changes the virtual viewpoint in accordance with the changed road image. Here, changing the virtual viewpoint means changing at least one of the viewpoint coordinates and the viewpoint angle in the virtual space. Note that examples of changing the road image and the virtual viewpoint will be described later.

[0053] 6 is a flowchart showing the flow of the specific processing executed by the display control device 50. The specific processing is performed by the CPU 51 reading the display control program 52A from the ROM 52, expanding it in the RAM 53, and executing it. As an example, the specific processing is automatically and repeatedly performed at regular intervals.

[0054] 6, the CPU 51 acquires surrounding information relating to the surrounding conditions of the vehicle 10. Then, the CPU 51 proceeds to step S11.

[0055] In step S11, the CPU 51 updates the display content of the first display unit 24 based on the surrounding information acquired in step S10. For example, the CPU 51 changes the numerical value indicated in vehicle speed information 72 (see FIGS. 7 to 9) described below that is displayed on the first display unit 24 when the speed of the vehicle 10 increases or decreases, or when the vehicle 10 approaches another vehicle ahead, reduces the inter-vehicle distance between the host vehicle image 10A and the image showing the other vehicle on the first display unit 24. Then, the CPU 51 proceeds to step S12.

[0056] In step S12, the CPU 51 determines whether or not a predetermined condition is met. If the CPU 51 determines that the predetermined condition is met (step S12: YES), the CPU 51 proceeds to step S13. On the other hand, if the CPU 51 determines that the predetermined condition is not met (step S12: NO), the CPU 51 returns to step S10.

[0057] In step S13, the CPU 51 changes the road image displayed as the surroundings image, and changes the virtual viewpoint in accordance with the changed road image, and then ends the specification process.

[0058] Next, examples of changes to the road image and the virtual viewpoint based on the establishment of a predetermined condition will be described with reference to FIGS.

[0059] Fig. 7 is a first explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 7 shows an example of the display content of the display area X when the vehicle 10 is traveling on a highway.

[0060] Shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in FIG.

[0061] The shift information 70 indicates the shift position of the vehicle 10. In Fig. 7, "D" is displayed as the shift information 70, indicating that the shift position is in the D range.

[0062] The vehicle speed information 72 indicates the speed of the vehicle 10. In Fig. 7, "54 km / h" is displayed as the vehicle speed information 72, indicating that the vehicle speed is 54 km / h.

[0063] 7, a host vehicle image 10A, another vehicle image 10B, and a first road image 60A are displayed below the shift information 70 and vehicle speed information 72. The host vehicle image 10A is an illustrative image in which the vehicle 10 is depicted with a predetermined design. The other vehicle image 10B is an illustrative image in which another vehicle located ahead in the traveling direction of the vehicle 10 in the same lane as the vehicle 10 is depicted with a predetermined design. The first road image 60A shown in FIG. 7 is an illustrative image in which the expressway on which the vehicle 10 is traveling is depicted as a straight road. The CPU 51 of the display control device 50 generates the host vehicle image 10A, the other vehicle image 10B, and the first road image 60A based on the acquired surrounding information.

[0064] Furthermore, the CPU 51 displays the host vehicle image 10A and the other vehicle image 10B on the first road image 60A in an arrangement that takes into account their actual positional relationship. For example, as shown in Fig. 7, the CPU 51 displays the host vehicle image 10A and the other vehicle image 10B in the same lane on the first road image 60A.

[0065] 7, the CPU 51 displays the host vehicle image 10A, the other vehicle image 10B, and the first road image 60A in the display area X from a viewpoint seen from a first virtual viewpoint set for the first road image 60A. The first virtual viewpoint is a viewpoint looking down obliquely on the host vehicle image 10A from a high position on the rear side in the traveling direction.

[0066] Fig. 8 is a second explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 8 shows a first example of the display content of the display area X when the vehicle 10 is traveling on an open road.

[0067] Shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in Fig. 8. In Fig. 8, "D" is displayed as the shift information 70, indicating that the shift position is in the D range. Also in Fig. 8, "20 km / h" is displayed as the vehicle speed information 72, indicating that the vehicle speed is 20 km / h.

[0068] 8, a host vehicle image 10A, another vehicle image 10C, and a second road image 60B are displayed below the shift information 70 and vehicle speed information 72. The other vehicle image 10C is an illustration image in which another vehicle located ahead in the traveling direction of the vehicle 10 is drawn in a predetermined design. The second road image 60B shown in FIG. 8 is an illustration image drawn by 3D modeling an ordinary road around the vehicle 10 shown in the map data. The CPU 51 of the display control device 50 generates the host vehicle image 10A, the other vehicle image 10C, and the second road image 60B using the surrounding information and map data based on the fact that the traveling location of the vehicle 10 has changed from an expressway to an ordinary road and a predetermined condition has been met.

[0069] The second road image 60B shown in Fig. 8 is divided into a roadway Y, which is an area indicating the roadway, and sidewalks Z1 and Z2, which are areas indicating sidewalks. Route information 74, which indicates the route to the destination of the vehicle 10 set in the car navigation system using two line segments, is displayed ahead of the host vehicle image 10A on the roadway Y in the traveling direction. A stop line image 76 indicating a stop line and a crosswalk image 78 indicating a crosswalk are displayed in a portion of the roadway Y that overlaps with the host vehicle image 10A. A crosswalk image 80 indicating the crosswalk for crossing between sidewalks Z1 and Z2 is displayed in a portion of the roadway Y that overlaps with the other vehicle image 10C.

[0070] Similarly to the above, the CPU 51 displays the host vehicle image 10A and the other vehicle image 10C on the second road image 60B in an arrangement that takes into account their actual positional relationship. For example, as shown in Fig. 8, the CPU 51 displays the other vehicle image 10C on the roadway Y ahead of the host vehicle image 10A in the traveling direction.

[0071] 8, the CPU 51 displays the host vehicle image 10A, the other vehicle image 10C, and the second road image 60B in the display area X from a viewpoint seen from a second virtual viewpoint set for the second road image 60B. The second virtual viewpoint is a viewpoint that looks down diagonally on the host vehicle image 10A from a higher position than the first virtual viewpoint. As such, because FIG. 8 is displayed from a viewpoint seen from the second virtual viewpoint, a wider range of the road is displayed in the display area X compared to the viewpoint seen from the first virtual viewpoint shown in FIG.

[0072] Fig. 9 is a third explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 9 shows an example of the display content of the display area X when the shift position of the vehicle 10 is switched to the R range.

[0073] Shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in Fig. 9. In Fig. 9, "R" is displayed as the shift information 70, indicating that the shift position is in the R range. Also in Fig. 9, "0 km / h" is displayed as the vehicle speed information 72, indicating that the vehicle speed is 0 km / h.

[0074] In the display area X shown in FIG. 9, below the shift information 70 and the vehicle speed information 72, an own vehicle image 10A, another vehicle image 10D, another vehicle image 10E, and a third road image 60C are displayed.

[0075] Here, the other vehicle image 10D and the other vehicle image 10E are captured images showing other vehicles around the vehicle 10, captured in real time by the camera 40. The third road image 60C is a captured image showing a parking lot around the vehicle 10, captured in real time by the camera 40. Specifically, the other vehicle image 10D, the other vehicle image 10E, and the third road image 60C are captured images captured in real time by the camera 40, converted into images viewed from a perspective similar to a skyward perspective. The host vehicle image 10A is an illustrated image in which the vehicle 10 is drawn with a predetermined design, as described above. In this way, in the display area X shown in FIG. 9, the host vehicle image 10A is displayed as an illustrated image, and the other vehicle image 10D, the other vehicle image 10E, and the third road image 60C are displayed as captured images. The CPU 51 of the display control device 50 generates the above-mentioned subject vehicle image 10A, other vehicle image 10D, other vehicle image 10E, and third road image 60C based on surrounding information when the shift position of the vehicle 10 is switched to R range and a predetermined condition is met.

[0076] The third road image 60C shown in Fig. 9 is divided into a parking space P, which is an area showing a parking space in the parking lot, and a driving space D, which is an area showing a driving space in the parking lot. As described above, the CPU 51 displays the subject vehicle image 10A, the other vehicle image 10D, and the other vehicle image 10E on the third road image 60C in an arrangement that takes into account their actual positional relationships. For example, as shown in Fig. 9, the CPU 51 displays the subject vehicle image 10A in the driving space D, the other vehicle image 10D in the parking frame of the parking space P1 on the left side of the figure, and the other vehicle image 10E in the parking frame of the parking space P2 on the right side of the figure.

[0077] 9, the CPU 51 displays the host vehicle image 10A, the other vehicle image 10D, the other vehicle image 10E, and the third road image 60C in the display area X from a viewpoint seen from a third virtual viewpoint set for the third road image 60C. The third virtual viewpoint is a viewpoint looking directly down on the host vehicle image 10A from a high position.

[0078] As described above, in the display control device 50, the CPU 51 displays the host vehicle image 10A and the surrounding situation image as seen from a virtual viewpoint on the first display unit 24 based on surrounding information relating to the surrounding situation of the vehicle 10. Then, the CPU 51 changes the road image displayed as the surrounding situation image when a predetermined condition is met. As a result, the display control device 50 can present the road image to the driver in multiple forms before and after the change by changing the road image displayed as the surrounding situation image when a predetermined condition is met.

[0079] Furthermore, in the display control device 50, the CPU 51 changes the road image displayed on the first display unit 24 when a predetermined condition based on the location and state of the vehicle 10 is met. Then, the CPU 51 changes the virtual viewpoint in accordance with the changed road image. As a result, the display control device 50 can present to the driver a road image seen from a virtual viewpoint that is assumed to be suitable depending on the location and state of the vehicle 10.

[0080] In the display control device 50, the first display unit 24 is a meter display provided in front of the driver's seat of the vehicle 10. As a result, the display control device 50 can present the driver with information indicating the meters of the measuring instruments of the vehicle 10, the vehicle image 10A, and the surrounding situation image on a single screen.

[0081] (Second embodiment) Next, a second embodiment of the vehicle 10 according to the present invention will be described while omitting or simplifying parts that overlap with the above embodiment.

[0082] In the second embodiment, the CPU 51 of the display control device 50 determines whether a predetermined condition based on a driver's selection is met, in addition to the cases described in the above embodiments. For example, the CPU 51 determines that the predetermined condition is met when the driver performs a predetermined setting operation on the vehicle 10.

[0083] Fig. 10 is a fourth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 10 shows a setting screen on which it is possible to set whether to display or hide the road image and individual target images to be displayed as the surrounding situation image.

[0084] On the setting screen shown in FIG. 10, a first setting item 82, a second setting item 84, a third setting item 86, and a fourth setting item 88 are displayed.

[0085] The first setting item 82 is a section for setting the road image to be displayed on the first display unit 24. As an example, the first setting item 82 is set to one of "first road image," "second road image," and "third road image." The driver operates an operation switch, which is an in-vehicle device not shown, to select one of three options in a pull-down menu. As an example, the setting box 82A of the first setting item 82 displays "second road image," indicating that the second road image 60B is to be displayed as the road image.

[0086] The second setting item 84 is a section for setting whether to display or not display images showing other vehicles as individual target images.

[0087] The third setting item 86 is a section for setting whether to display or not display an image showing a pedestrian as an individual target image.

[0088] The fourth setting item 88 is a section for setting whether to display or not display the route information 74 (see FIG. 8) on the road image.

[0089] As an example, the second setting item 84, the third setting item 86, and the fourth setting item 88 are set to either "display" or "hide." The driver operates the operation switch to select one of two options in the pull-down menu. As an example, the setting box 84A of the second setting item 84 displays "display," indicating that an image showing another vehicle is displayed. Furthermore, the setting box 86A of the third setting item 86 displays "hide," indicating that an image showing a pedestrian is not displayed. Furthermore, the setting box 88A of the fourth setting item 88 displays "display," indicating that the route information 74 is displayed.

[0090] After selecting the setting contents for all the setting items on the setting screen, the driver operates the operation switch to perform a predetermined setting operation for the vehicle 10. As a result, the CPU 51 determines that a predetermined condition based on the driver's selection is met, and changes the road image displayed on the first display unit 24 to the setting contents of the first setting item 82. In addition, the CPU 51 switches between displaying and hiding each of the target images and route information 74 displayed on the first display unit 24, based on the setting contents of the second setting item 84, the third setting item 86, and the fourth setting item 88.

[0091] Fig. 11 is a fifth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 11 shows an example of the display contents of the host vehicle image 10A and the surrounding situation image based on the settings made on the setting screen shown in Fig. 10.

[0092] As in the above embodiment, shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in Fig. 11. Here, to the right of the vehicle speed information 72 shown in Fig. 11, warning information 90 is displayed, indicating that an image showing a pedestrian will not be displayed as a surrounding situation image. As one example, the warning information 90 is designed with an icon showing a pedestrian with a diagonal line drawn downward to the right.

[0093] 11, below the shift information 70, vehicle speed information 72, and warning information 90, a second road image 60B is displayed as a road image based on the settings configured on the setting screen shown in FIG. 10. As an example, the second road image 60B shown in FIG. 11 is an illustrated image that is a 3D model of a public road around the vehicle 10 shown in the map data, similar to the above embodiment. The second road image 60B is divided into a roadway Y and sidewalks Z1 and Z2, similar to FIG. 8, and route information 74 is displayed on the roadway Y based on the settings configured on the setting screen shown in FIG. 10. Furthermore, because the setting box 86A on the setting screen shown in FIG. 10 is set to "hide," even if a pedestrian is detected around the vehicle 10 based on the surrounding information, an image of the pedestrian is not displayed on the second road image 60B.

[0094] As described above, in the second embodiment, the CPU 51 of the display control device 50 displays a road image, individual target object images, and route information 74 on the first display unit 24 based on the settings configured on the setting screen shown in Fig. 10. Therefore, for example, even if the traveling location of the vehicle 10 changes from an ordinary road to an expressway, the CPU 51 does not change the road image to the first road image 60A as in the above embodiment, but displays the second road image 60B, which is a 3D model of the expressway based on map data, on the first display unit 24.

[0095] Furthermore, in the second embodiment, the CPU 51 of the display control device 50, as a function of the control unit 51B, changes the road image displayed on the first display unit 24 when a predetermined condition based on a selection by the driver of the vehicle 10 is met. Then, the CPU 51 switches between displaying and hiding individual target images displayed as the surrounding situation image when the predetermined condition is met. In this way, the display control device 50 can present the driver with road images and target images that suit the driver's preferences.

[0096] Furthermore, in the second embodiment, when the CPU 51 of the display control device 50 switches an image showing a pedestrian to non-display, the CPU 51, as a function of the control unit 51B, displays, on the first display unit 24, warning information 90 indicating that the image showing the pedestrian will not be displayed as a surrounding situation image. In this way, the display control device 50 can make the user pay attention to a pedestrian existing in real space even if the image showing the pedestrian is not displayed on the first display unit 24. The image showing a pedestrian is an example of an "image of a specific target."

[0097] (Third embodiment) Next, a third embodiment of the vehicle 10 according to the present invention will be described while omitting or simplifying parts that overlap with the above-described embodiment.

[0098] Fig. 12 is a sixth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 12 shows a second example of the display content of the display area X when the vehicle 10 is traveling on an open road.

[0099] As in the above embodiment, shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in FIG.

[0100] 12, the host vehicle image 10A, a pedestrian image 92, and a second road image 60B are displayed below the shift information 70 and the vehicle speed information 72. The pedestrian image 92 is an illustrated image in which a pedestrian crossing a crosswalk near the vehicle 10 is depicted in a predetermined design. At this time, the CPU 51 displays the host vehicle image 10A and the pedestrian image 92 on the second road image 60B in an arrangement that takes into account their actual positional relationship. For example, as shown in FIG. 12, the CPU 51 displays the pedestrian image 92 on the roadway Y, within two line segments indicated in the route information 74, ahead of the host vehicle image 10A in the traveling direction.

[0101] Here, in the third embodiment, when a plurality of targets of the same type existing within a predetermined range are detected, the CPU 51 of the display control device 50, as a function of the control unit 51B, displays on the first display unit 24 only images of targets among the plurality of targets whose degree of danger to the vehicle 10 exceeds a predetermined standard. The predetermined range can be set appropriately, for example, within a radius of 2 meters, within a radius of 5 meters, or within a radius of 10 meters. The degree of danger to the vehicle 10 is a degree indicating the possibility of contact with the vehicle 10. In the third embodiment, a target whose degree of danger exceeds the predetermined standard is, for example, a target existing on the driving route of the vehicle 10.

[0102] 12 shows an example of the display content when three pedestrians are present within a predetermined range, one of which is present on the travel route of vehicle 10. In this case, CPU 51 displays an image showing one pedestrian present on the travel route as pedestrian image 92 on first display unit 24, and does not display images showing the other two pedestrians on first display unit 24. CPU 51 also displays an ellipse surrounding pedestrian image 92 on first display unit 24, thereby emphasizing the presence of the pedestrian on the travel route to the driver.

[0103] As described above, according to the display control device 50 of the third embodiment, the above configuration makes it possible to increase attention to targets that exist in real space and pose a risk to the vehicle 10 that exceeds a predetermined standard.

[0104] (others) In the above embodiment, the predetermined condition is based on the location and state of the vehicle 10 and the predetermined condition is based on the driver's selection, but the predetermined condition is not limited to this. The predetermined condition may be established based on the surrounding conditions of the vehicle 10. For example, the CPU 51 may determine that the predetermined condition is established when the amount of light received by an illuminance sensor included in the sensor group 30 becomes less than a predetermined amount, in other words, when it becomes dark around the vehicle 10.

[0105] Fig. 13 is a seventh explanatory diagram showing a display example displayed in the display area X of the first display unit 24. Specifically, Fig. 13 shows the display content after a predetermined time has elapsed since the example shown in Fig. 7 was displayed on the first display unit 24.

[0106] As in the above embodiment, shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in FIG.

[0107] 13, the subject vehicle image 10A, the other vehicle image 10B, the other vehicle image 10F, and the first road image 60A are displayed below the shift information 70 and the vehicle speed information 72. The other vehicle image 10F is an illustrated image in which another vehicle located ahead of the vehicle 10 in the right lane in the traveling direction is drawn in a predetermined design.

[0108] In the example shown in FIG. 13, the CPU 51 determines that the amount of light received by the illuminance sensor is less than a predetermined amount, thereby satisfying a predetermined condition, and changes the road image displayed as the surrounding situation image. In this case, the CPU 51, for example, changes the display color of the entire display area X including the road image. In FIG. 13, the entire display area X including the first road image 60A is hatched with dots, indicating that the display color has become darker than before the change. In this way, the change of the road image is not limited to changing the image itself, such as changing from the first road image 60A to the second road image 60B, but may also involve changing the display content, such as the color, shape, and dimensions of the road image currently being displayed. In this way, the display control device 50 can change the road image displayed as the surrounding situation image depending on the brightness around the vehicle 10, for example, between daytime and nighttime.

[0109] In the above embodiment, a road image showing a road is used as an example of a "background image," but the "background image" is not limited to this. For example, the "background image" may include, in addition to a road image, a landscape image showing the scenery around the vehicle 10, such as the sea and mountains. When a road image and a landscape image are examples of a "background image," a change to the background image may be a change to at least one of the road image and the landscape image. Furthermore, the "background image" is not limited to including a road image, and may be an image displayed in an area of ​​the display area X other than the area displaying the host vehicle image 10A, the road image, and the target image. This example will be described below with reference to FIGS. 14 to 19.

[0110] Fig. 14 is an eighth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 14 shows an example of the display content of the display area X when the shift position of the vehicle 10 is in the R range.

[0111] Shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in Fig. 14. In Fig. 14, "R" is displayed as the shift information 70, indicating that the shift position is in the R range. Also in Fig. 14, "4 km / h" is displayed as the vehicle speed information 72, indicating that the vehicle is reversing at a speed of 4 km / h.

[0112] A host vehicle image 10A and another vehicle image 10D as a target image are displayed in the lower part of the display area X shown in Fig. 14. The host vehicle image 10A shown in Fig. 14 is an illustration image in which the vehicle 10 is depicted with a predetermined design. Similarly, the other vehicle image 10D shown in Fig. 14 is an illustration image in which another vehicle parked in the parking space to the left of the parking space in which the vehicle 10 is parked is depicted with a predetermined design. Note that the host vehicle image 10A shown in Figs. 15 to 19 described below is also an illustration image similar to that in Fig. 14.

[0113] Here, in the display area X shown in Figure 14, a background image 100, which is an example of the above-mentioned "background image," is displayed in the area near the center between the shift information 70 and vehicle speed information 72 and the subject vehicle image 10A and other vehicle image 10D.

[0114] The background image 100 is a panoramic view image obtained by converting an image of the area around the vehicle 10 captured in real time by the camera 40 into a pseudo image viewed directly down from the sky. For example, an image 100A showing the vehicle 10 corresponding to the host vehicle image 10A and an image 100B showing another vehicle corresponding to the other vehicle image 10D are displayed in the background image 100. The CPU 51 of the display control device 50 generates and displays the background image 100 based on surrounding information when a predetermined condition is met due to the shift position of the vehicle 10 being switched to the R range. When the shift position of the vehicle 10 is in a position other than the R range, such as the P range or the D range, the CPU 51 displays an image different from the background image 100 or no image at all in the area where the background image 100 is displayed.

[0115] Fig. 15 is a ninth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 15 shows an example of the display content of the display area X when the vehicle 10 leaves the parking space shown in Fig. 14 and is traveling on an open road.

[0116] In the lower part of the display area X shown in FIG. 15, a vehicle image 10A and a first road image 60A as a road image are displayed.

[0117] In the display area X shown in FIG. 15, a background image 110, which is an example of the above-mentioned "background image", is displayed in an area other than the area displaying the host vehicle image 10A and the first road image 60A.

[0118] The background image 110 is an illustrated image drawn using 3D models of roads, buildings, and the like around the vehicle 10 shown in the map data. The CPU 51 of the display control device 50 generates and displays the background image 110 using surrounding information and map data, for example, when the driving location of the vehicle 10 changes from a parking lot to a public road and a predetermined condition is met. The CPU 51 also changes the display content of the background image 110 according to the current location of the vehicle 10. For example, when the vehicle 10 turns right at an intersection, the CPU 51 changes the background image 110 to a scene that the driver will see after turning right at the intersection.

[0119] Fig. 16 is a tenth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Fig. 16 shows an example of the display content of the display area X when the traveling location of the vehicle 10 changes to a seaside road.

[0120] In the lower part of the display area X shown in FIG. 16, a vehicle image 10A and a first road image 60A as a road image are displayed.

[0121] In the display area X shown in FIG. 16, a background image 120, which is an example of the above-mentioned "background image", is displayed in an area other than the area displaying the host vehicle image 10A and the first road image 60A.

[0122] The background image 120 is an illustration image depicting a predetermined seaside road landscape. The background image 120 is stored in, for example, the storage 54. The CPU 51 of the display control device 50 acquires and displays the background image 120 from the storage 54, for example, when the vehicle 10's traveling location changes to a seaside road and a predetermined condition is met. It should be noted that which part of the roads shown in the map data corresponds to the seaside road is predetermined, and the CPU 51 determines whether the vehicle 10's traveling location has changed to a seaside road based on the surrounding information and the map data. In this way, an image serving as an example of the above-mentioned "background image" may be a prepared illustration image. Below, other examples in which the "background image" is a prepared illustration image will be described with reference to FIGS. 17 to 19.

[0123] Fig. 17 is an eleventh explanatory diagram showing a display example displayed in the display area X of the first display unit 24. Specifically, Fig. 17 shows an example of the display content of the display area X when the traveling location of the vehicle 10 changes to a mountain road.

[0124] In the lower part of the display area X shown in FIG. 17, a vehicle image 10A and a first road image 60A as a road image are displayed.

[0125] In the display area X shown in FIG. 17, a background image 130, which is an example of the above-mentioned "background image", is displayed in an area other than the area displaying the host vehicle image 10A and the first road image 60A.

[0126] The background image 130 is an illustrated image depicting a landscape of a predetermined mountain road. The background image 130 is stored in, for example, the storage 54. The CPU 51 of the display control device 50 acquires and displays the background image 130 from the storage 54, for example, when the location where the vehicle 10 is traveling has changed to a mountain road and a predetermined condition has been met. It should be noted that which parts of the roads shown in the map data correspond to mountain roads is determined in advance, and the CPU 51 determines whether the location where the vehicle 10 is traveling has changed to a mountain road based on the surrounding information and the map data.

[0127] Fig. 18 is a twelfth explanatory diagram showing a display example displayed in the display area X of the first display unit 24. Specifically, Fig. 18 shows an example of the display content of the display area X when the traveling location of the vehicle 10 changes to a road in an urban area.

[0128] In the lower part of the display area X shown in FIG. 18, a vehicle image 10A and a first road image 60A as a road image are displayed.

[0129] In the display area X shown in FIG. 18, a background image 140, which is an example of the above-mentioned "background image", is displayed in an area other than the area displaying the host vehicle image 10A and the first road image 60A.

[0130] The background image 140 is an illustrated image depicting a road scene in a predetermined urban area. The background image 140 is stored in, for example, the storage 54. The CPU 51 of the display control device 50 acquires and displays the background image 140 from the storage 54, for example, when the location where the vehicle 10 is traveling has changed to an urban road and a predetermined condition has been met. It should be noted that which parts of the roads shown in the map data correspond to urban roads is determined in advance, and the CPU 51 determines whether the location where the vehicle 10 is traveling has changed to an urban road based on the surrounding information and the map data.

[0131] Fig. 19 is a thirteenth explanatory diagram showing a display example displayed in the display area X of the first display unit 24. Specifically, Fig. 19 shows an example of the display content of the display area X when the traveling time zone in which the vehicle 10 is traveling has changed to nighttime.

[0132] In the lower part of the display area X shown in FIG. 19, a vehicle image 10A and a first road image 60A as a road image are displayed.

[0133] In the display area X shown in FIG. 19, a background image 150, which is an example of the above-mentioned "background image", is displayed in an area other than the area displaying the host vehicle image 10A and the first road image 60A.

[0134] The background image 150 is an illustrated image depicting a predetermined nighttime scene. The background image 150 is stored in, for example, the storage 54. The CPU 51 of the display control device 50 acquires and displays the background image 150 from the storage 54 based on, for example, determining that a predetermined condition based on the surrounding circumstances of the vehicle 10 is met. In this case, the CPU 51 may determine that the predetermined condition is met when the amount of light received by the illuminance sensor becomes less than a predetermined amount, indicating that the driving time zone has changed to nighttime.

[0135] In the above embodiment, the CPU 51 determines whether or not a predetermined condition is met based on both the location and state of the vehicle 10. However, this is not limited to this, and the CPU 51 may determine only whether or not a predetermined condition is met based on the location of the vehicle 10, or may determine only whether or not a predetermined condition is met based on the state of the vehicle 10.

[0136] In the above embodiment, the CPU 51 determines that the predetermined condition is met when the traveling location of the vehicle 10 changes from an ordinary road to an expressway or from an expressway to an ordinary road. However, this is not limiting, and for example, the CPU 51 may determine that the predetermined condition is met when the traveling location of the vehicle 10 enters a traveling area registered by the driver.

[0137] In the above embodiment, the CPU 51 determines that the predetermined condition is met when the shift position of the vehicle 10 is switched to the R range. However, this is not limiting, and the CPU 51 may determine that the predetermined condition is met when, for example, the vehicle 10 changes from a manual driving state to an automatic driving state or from an automatic driving state to a manual driving state.

[0138] In the above embodiment, the types of individual targets for which the display or non-display of the image displayed as the surrounding situation image can be switched are not limited to those shown in Fig. 10. For example, the targets may include other types such as obstacles, road signs, and animals in addition to those shown in Fig. 10. Furthermore, in the above embodiment, all types of target images are subject to switching between display and non-display, but there may be types of targets that cannot be switched to non-display. For example, other vehicles may be types of targets that cannot be switched to non-display and whose target images are always displayed.

[0139] In the above embodiment, an image showing a pedestrian is used as an example of an "image of a specific target," but the "image of a specific target" is not limited to this. The "image of a specific target" may also be an image showing other types of targets, such as other vehicles and animals. Also, in the above embodiment, the warning information 90 is configured with an image of a predetermined design, but the display content of the warning information 90 is not limited to this. The warning information 90 may indicate in text, or in text and image, that the "image of a specific target" will not be displayed as a surrounding situation image.

[0140] In the above embodiment, an example of the same type of target is a plurality of pedestrians, but the same type of target is not limited to this. For example, if a passenger car and a motorcycle are present within a predetermined range, the example of the same type of target is not limited to the same target, and the passenger car and the motorcycle may be regarded as the same type of target as the "other vehicle."

[0141] In the above embodiment, the target whose danger level exceeds a predetermined standard (hereinafter referred to as a "hazardous target") is a target located on the travel route of the vehicle 10. However, the hazardous target is not limited to this. For example, the hazardous target may be a target whose distance from the vehicle 10 is equal to or less than a predetermined value, or whose distance from the vehicle 10 is the shortest. Furthermore, while the above embodiment illustrates a case in which one hazardous target is detected, if multiple hazardous targets are detected, images representing the multiple hazardous targets are displayed on the first display unit 24. Furthermore, in the above embodiment, targets of the same type present within a predetermined range other than the hazardous target are not displayed on the first display unit 24. However, this is not limited to this, and the target may also be displayed. In this case, it is desirable for the CPU 51 to display images representing the hazardous target and the target with different display content. This allows the display control device 50 to allow the driver looking at the first display unit 24 to understand the danger level of each target to the vehicle 10 based on the difference in display content.

[0142] In the above embodiment, the first display unit 24, which is a meter display, is an example of a "display unit." However, the "display unit" is not limited to a meter display. For example, the "display unit" may be another display such as a center display or a head-up display (HUD). Furthermore, the "display unit" may be a combination of multiple displays such as a meter display and a center display.

[0143] In the above embodiment, the display control device 50 executes the specific processing shown in Fig. 6. However, the present invention is not limited to this, and the specific processing may be executed by the display control device 50 in cooperation with another ECU. For example, consider a case where the first display unit 24 of the display device 21 is controlled by the display control device 50 and the second display unit 25 is controlled by another ECU, and the results of the specific processing are displayed on the first display unit 24 and the second display unit 25. In this case, the specific processing may be executed by a plurality of ECUs, including the display control device 50 and the other ECUs, in cooperation with each other, or may be executed by either the display control device 50 or one of the other ECUs on behalf of the other ECUs.

[0144] In the above embodiment, the specific process executed by the CPU 51 after reading the software (program) may be executed by various processors other than a CPU. Examples of such processors include programmable logic devices (PLDs) (such as field-programmable gate arrays (FPGAs)) whose circuit configuration can be changed after fabrication, and dedicated electrical circuits such as application-specific integrated circuits (ASICs) that are processors with circuit configurations specifically designed to execute specific processes. The specific process may be executed by one of these processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0145] In the above embodiment, the display control program 52A is pre-stored (installed) in the ROM 52, but the present invention is not limited to this. The display control program 52A may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The display control program 52A may also be downloaded from an external device via a network. [Explanation of symbols]

[0146] 10 Vehicle (own vehicle) 24 1st display section (display section) 50 Display control device 51B Control section 52A Display control program 90 Caution Information

Claims

1. a control unit that displays, on a display unit, an image showing the host vehicle and the surrounding situation as seen from a virtual viewpoint based on surrounding information relating to the surrounding situation of the host vehicle, and that changes a background image displayed as the image showing the surrounding situation when a predetermined condition is met; Display control device.

2. the control unit changes the background image displayed on the display unit when the predetermined condition based on at least one of a traveling location and a state of the host vehicle is satisfied, and changes the virtual viewpoint in accordance with the changed background image. The display control device according to claim 1 .

3. the control unit changes the background image displayed on the display unit when the predetermined condition based on a selection by an occupant of the host vehicle is satisfied, and switches between displaying and hiding images of individual targets displayed as images indicating the surrounding situation. The display control device according to claim 1 .

4. when the control unit switches to hide the image of the specific target, it displays, on the display unit, warning information indicating that the image of the specific target will not be displayed as the image showing the surrounding situation. The display control device according to claim 3 .

5. When a plurality of targets of the same type existing within a predetermined range are detected, the control unit displays on the display unit only an image of a target among the plurality of targets whose degree of danger to the host vehicle exceeds a predetermined standard. The display control device according to claim 3 .

6. The display unit is a meter display provided in front of the driver's seat of the host vehicle. The display control device according to claim 1 .

7. displaying an image showing the host vehicle and the surrounding situation as seen from a virtual viewpoint on a display unit based on surrounding information relating to the surrounding situation of the host vehicle, and changing a background image displayed as the image showing the surrounding situation when a predetermined condition is met; A display control method in which processing is performed by a computer.

8. displaying an image showing the host vehicle and the surrounding situation as seen from a virtual viewpoint on a display unit based on surrounding information relating to the surrounding situation of the host vehicle, and changing a background image displayed as the image showing the surrounding situation when a predetermined condition is met; A display control program that causes a computer to execute processing.

Citation Information

Patent Citations

  • Vehicle control device, vehicle control method, and program

    JP7048398B2