Display control device, display control method, and computer readable medium

The display control device dynamically adjusts the background image and object display of the vehicle's surrounding conditions, solving the problem of inflexible background image switching in the existing technology and improving the driving experience and safety of the passengers.

CN120606677APending Publication Date: 2025-09-09TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510194933.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-03-07
Filing Date
2025-02-21
Publication Date
2025-09-09

AI Technical Summary

Technical Problem

In the existing technology, the background image switching of the vehicle's surrounding conditions is not flexible enough and cannot be properly adjusted according to different conditions and passenger preferences, resulting in a poor passenger experience.

Method used

Through the display control device, the background image is dynamically adjusted based on the vehicle's surrounding information and predetermined conditions, and the display or hiding of object markers is switched according to the occupants' selection, thereby improving the adaptability and safety of the image.

Benefits of technology

It realizes the diversified display of background images and object marks, improves the driving experience and safety of passengers, and especially provides key prompts when dangerous objects are detected.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120606677A_ABST
    Figure CN120606677A_ABST
Patent Text Reader

Abstract

The invention provides a display control apparatus, a display control method, and a computer readable medium. A display control device is provided with a control unit that displays, on a display unit, an image indicating a host vehicle and a surrounding situation when viewed from a virtual viewpoint, on the basis of surrounding information relating to the surrounding situation of the host vehicle. And changes an image of a background displayed as an image indicating the surrounding situation in accordance with the establishment of a predetermined condition.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display control device, a display control method, and a computer-readable medium having a display control program recorded thereon. Background Art

[0002] Japanese Patent No. 7048398 discloses a vehicle control device capable of implementing automatic driving to provide passengers with a sense of security.

[0003] However, in the technology disclosed in Japanese Patent No. 7048398, an image showing the surrounding conditions of the vehicle is displayed on the display unit (see Patent Document 1). Figure 8 Here, it is desirable to appropriately switch the background image displayed along with the image representing the vehicle in the image representing the surrounding conditions to an appropriate image, for example, in response to changes in the surrounding conditions. However, Japanese Patent No. 7048398 does not disclose switching the background image, so there is still room for improvement. Summary of the Invention

[0004] The present disclosure provides a display control device, a display control method, and a computer-readable medium having a display control program recorded thereon, which are capable of presenting an image representing a background of a surrounding condition of a vehicle to a passenger in a plurality of ways.

[0005] A first embodiment of the present disclosure is a display control device comprising a control unit that displays an image representing the vehicle and the surrounding conditions when viewed from an imaginary viewpoint on a display unit based on surrounding information related to the surrounding conditions of the vehicle, and changes an image displayed as a background of the image representing the surrounding conditions in accordance with the establishment of a predetermined condition.

[0006] In a display control device according to a first aspect of the present disclosure, a control unit causes a display unit to display an image representing the vehicle and its surroundings as viewed from a virtual viewpoint based on surrounding information related to the vehicle's surroundings. Furthermore, the control unit changes the background image displayed as the image representing the surroundings in response to the satisfaction of a predetermined condition. Thus, according to this display control device, by changing the background image representing the vehicle's surroundings in response to the satisfaction of a predetermined condition, the background image can be presented to the occupant in multiple ways, before and after the change.

[0007] The second aspect of the present disclosure is that, in the first aspect, the control unit changes the background image displayed on the display unit according to the satisfaction of the predetermined condition based on at least one of the driving location and state of the vehicle, and changes the virtual viewpoint according to the changed background image.

[0008] In a display control device according to a second aspect of the present disclosure, a control unit changes the background image displayed on the display unit in response to the satisfaction of a predetermined condition based on at least one of the vehicle's driving location and state. Furthermore, the control unit changes the virtual viewpoint based on the changed background image. Thus, this display control device can present a road image to a passenger, viewed from a virtual viewpoint that is assumed to be appropriate based on at least one of the vehicle's driving location and state.

[0009] The third mode of the present disclosure is that, in the first or second mode, the control unit changes the background image displayed on the display unit according to the satisfaction of the predetermined condition based on the selection of the occupant of the vehicle, and switches the display or non-display of the image of each object mark displayed as an image representing the surrounding conditions.

[0010] In a display control device according to a third aspect of the present disclosure, a control unit changes the background image displayed on the display unit in response to the satisfaction of a predetermined condition based on a selection by a vehicle occupant. Furthermore, the control unit switches the display or non-display of images of individual object markers displayed as images representing surrounding conditions in response to the satisfaction of the predetermined condition. Thus, this display control device can present the occupant with a background and object markers that suit the occupant's preferences.

[0011] A fourth aspect of the present disclosure is that, in the third aspect, when the control unit switches the image of the specific object marker to non-display, the control unit displays a warning message on the display unit indicating that the image of the specific object marker is not to be displayed as the image representing the surrounding situation.

[0012] In the display control device according to the fourth aspect of the present disclosure, when the control unit switches the image of a specific object to non-display, the control unit displays on the display unit a warning message indicating that the image of the specific object is not to be displayed as an image representing the surrounding situation. Thus, according to this display control device, even when the image of the specific object is not displayed on the display unit, attention can be paid to the specific object in real space.

[0013] A fifth aspect of the present disclosure is that in the third or fourth aspect, when the control unit detects a plurality of object markers of the same type within a predetermined range, the control unit displays on the display unit only images of object markers whose risk level to the host vehicle exceeds a predetermined reference.

[0014] In a display control device according to a fifth aspect of the present disclosure, upon detecting multiple objects of the same type within a predetermined range, the control unit displays on the display unit images of only those objects whose hazard level relative to the vehicle exceeds a predetermined threshold. This display control device can thus enhance attention to objects in real space whose hazard level relative to the vehicle exceeds a predetermined threshold.

[0015] A sixth aspect of the present disclosure is that, in the above aspect, the display unit is a meter display provided in front of a driver's seat of the host vehicle.

[0016] In the display control device according to the sixth aspect of the present disclosure, the display unit is an instrument display located in front of the driver's seat of the vehicle. Thus, this display control device can present information representing the instrumentation of the vehicle's measuring equipment and an image representing the vehicle and its surrounding conditions to the occupants on a single screen.

[0017] The seventh embodiment of the present disclosure is a display control method, in which a computer performs the following processing, namely: based on peripheral information related to the peripheral conditions of the vehicle, an image representing the vehicle and the peripheral conditions when observed from an imaginary viewpoint is displayed on a display unit, and an image displayed as a background of the image representing the peripheral conditions is changed according to the establishment of predetermined conditions.

[0018] The eighth embodiment of the present disclosure is a computer-readable medium having a display control program recorded thereon, wherein the display control program is used to cause a computer to perform the following processing, namely: based on surrounding information related to the surrounding conditions of the vehicle, an image representing the vehicle and the surrounding conditions when observed from an imaginary viewpoint is displayed on a display unit, and an image displayed as a background of the image representing the surrounding conditions is changed according to the establishment of predetermined conditions.

[0019] According to the above aspects, the display control device, the display control method, and the computer-readable medium recording the display control program of the present disclosure can present an image representing the background of the surrounding conditions of the host vehicle to the occupant in a plurality of ways. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Exemplary embodiments will be described in detail with reference to the following drawings, in which:

[0021] Figure 1 A block diagram showing a schematic structure of a vehicle;

[0022] Figure 2 is a schematic diagram of the front portion of the vehicle cabin as viewed from the rear side of the vehicle;

[0023] Figure 3An explanatory diagram illustrating a display area of ​​a first display unit;

[0024] Figure 4 is a block diagram showing a schematic structure of a display control device;

[0025] Figure 5 is a block diagram showing an example of a functional structure of a display control device;

[0026] Figure 6 A flowchart showing the flow of a specific process;

[0027] Figure 7 A first explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0028] Figure 8 A second explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0029] Figure 9 A third explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0030] Figure 10 A fourth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0031] Figure 11 A fifth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0032] Figure 12 A sixth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0033] Figure 13 A seventh explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0034] Figure 14 An eighth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0035] Figure 15 A ninth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0036] Figure 16 A tenth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0037] Figure 17 An eleventh explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0038] Figure 18 A twelfth explanatory diagram showing an example of a display displayed in the display area of ​​the first display unit;

[0039] Figure 19 This is a thirteenth explanatory diagram showing a display example displayed in the display area of ​​the first display unit. DETAILED DESCRIPTION

[0040] Hereinafter, the vehicle 10 according to the present embodiment will be described.

[0041] (First embodiment)

[0042] First, a first embodiment of the vehicle 10 according to the present embodiment will be described.

[0043] Figure 1 1 is a block diagram showing a schematic structure of the vehicle 10 .

[0044] like Figure 1 As shown, vehicle 10 includes display device 21, sensor group 30, camera 40, and display control device 50. Display device 21, sensor group 30, camera 40, and display control device 50 are connected via external bus (communication bus) 15. Vehicle 10 is an example of a "host vehicle."

[0045] The display device 21 displays, for example, suggestions for operations related to functions of the vehicle 10 and images explaining the functions. In this embodiment, the display device 21 includes a first display unit 24 and a second display unit 25. The first display unit 24 is an example of a "display unit." Details of the first and second display units 24, 25 will be described later.

[0046] Sensor group 30 includes sensors for detecting the state of vehicle 10 and surrounding conditions, such as a 3D-LiDAR, a millimeter-wave sensor, an infrared sensor, a turn indicator sensor, an accelerator position sensor, a gear position sensor, an illuminance sensor, a vehicle speed sensor, a steering angle sensor, an angular velocity sensor, a GPS (Global Positioning System) sensor, a gyro sensor, and an acceleration sensor. Sensor group 30 outputs detection results from each sensor to display control device 50.

[0047] The camera 40 is a camera device that uses a camera element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor to shoot. The camera 40 is set in front of the vehicle 10, on the left side, and on the right side, and shoots the surroundings of the vehicle 10. For example, the camera image captured by the camera 40 set in front of the vehicle 10 is used to identify other vehicles traveling in front of the vehicle, the distance to other vehicles, lanes, and traffic lights. In addition, the camera image captured by the camera 40 is output to the display control device 50. In addition, the camera 40 can also be configured as a camera device for other purposes such as a driving recorder and an ADAS (Advanced Driver Assistance System).

[0048] The display control device 50 is, for example, an ECU (Electrical Control Unit) that performs various controls.

[0049] Figure 2 It is a schematic diagram of the front portion of the interior of the vehicle cabin 12 of the vehicle 10 as viewed from the rear side of the vehicle. Figure 2 The arrow mark UP in the vehicle vertical direction indicates the upper side, and the arrow mark RH indicates the right side in the vehicle width direction. The up-down direction and the left-right direction in the following description refer to the up-down direction and the left-right direction, respectively.

[0050] like Figure 2 As shown, a dashboard 14 is provided at the front portion of a vehicle interior 12 of a vehicle 10. The dashboard 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the dashboard 14. Specifically, as an example, the vehicle 10 is a right-hand drive vehicle with the steering wheel 16 provided on the right side, and the driver's seat is provided on the right side of the vehicle. However, the present invention is not limited thereto, and the vehicle 10 may also be a left-hand drive vehicle with the driver's seat provided on the left side of the vehicle.

[0051] A windshield 18 is provided at the front end portion of the instrument panel 14. The windshield 18 extends in the vehicle vertical direction and the vehicle width direction and divides the interior of the vehicle cabin 12 from the exterior of the vehicle cabin 12.

[0052] The right-side end of the windshield 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. Furthermore, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. Furthermore, the left-side end of the windshield 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0053] The instrument panel 14 is provided with a first display unit 24 having a display area V for displaying images. The first display unit 24 comprises an instrument display located on the right side of the instrument panel 14, in front of the driver's seat. The first display unit 24 is connected to various instruments and devices mounted on the vehicle 12 and is positioned so that it is within the driver's field of view when the driver is looking forward. The driver is an example of a "passenger."

[0054] Furthermore, a second display unit 25 is provided on the instrument panel 14. The second display unit 25 is composed of a central display arranged at the center of the instrument panel 14 in the vehicle width direction.

[0055] Figure 3 It is an explanatory diagram for explaining the display area of ​​the meter display as the display area V of the first display unit 24 .

[0056] exist Figure 3 24. In the embodiment, the display area X, which is a part of the display area V, displays an image representing the vehicle 10, that is, the vehicle image 10A (see FIG. 1 ). Figure 7 etc.) and a surrounding situation image which is an image showing the surrounding situation of the vehicle 10. Specific examples of these images will be described later.

[0057] The display area X is a region in which a driver sitting on the driver's seat can see through the opening 17 of the steering wheel 16 (see FIG. Figure 2 ) and visually confirmed areas. Specifically, Figure 3 As shown, the center of the area visible between the upper edge ridgeline L1 and the lower edge ridgeline L2 of the opening 17 is the display area X. Instrument displays M1 and M2 representing instruments of the vehicle 10 are displayed to the left and right of the display area X in the display area V.

[0058] Figure 4 2 is a block diagram showing a schematic configuration of the display control device 50 .

[0059] like Figure 4As shown, the display control device 50 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a memory 54, a communication I / F (Interface) 55, and an input / output I / F 56. The CPU 51, ROM 52, RAM 53, the memory 54, the communication I / F 55, and the input / output I / F 56 are interconnected via an internal bus 57 so as to be able to communicate with each other.

[0060] The CPU 51 is a central processing unit that executes various programs or controls various components. Specifically, the CPU 51 reads programs from the ROM 52 and executes the programs using the RAM 53 as a work area. In this embodiment, the ROM 52 stores a display control program 52A.

[0061] The ROM 52 stores various programs and various data. The RAM 53 temporarily stores the programs and data as a work area.

[0062] The memory 54 is a NAND memory formed of an eMMC (embedded Multi Media Card) or a UFS (Universal Flash Storage), etc. The memory 54 and the CPU 51 are connected via an eMMC or UFS interface.

[0063] Furthermore, it is preferable that each component included in the display control device 50 , such as the ROM 52 and the memory 54 , is a tamper-resistant medium such as an HSM (Hardware Security Module).

[0064] The communication I / F 55 is an interface for connecting to other ECUs and uses a communication standard based on Ethernet (registered trademark).

[0065] The input / output I / F 56 is an interface for communicating with vehicle-mounted devices such as the display device 21 , the sensor group 30 , and the camera 40 mounted on the vehicle 10 .

[0066] Next, the functional configuration of the display control device 50 will be described.

[0067] Figure 5 3 is a block diagram showing an example of the functional structure of the display control device 50 .

[0068] like Figure 5As shown, the CPU 51 of the display control device 50 includes an acquisition unit 51A and a control unit 51B as functional components. Each functional component is realized by the CPU 51 reading and executing a display control program 52A stored in the ROM 52 .

[0069] The acquisition unit 51A acquires various information. For example, the acquisition unit 51A acquires surrounding information related to the surrounding conditions of the vehicle 10. The surrounding information includes detection results of each sensor constituting the sensor group 30 and images captured by the camera 40.

[0070] The control unit 51B implements display control related to the display on the display device 21. For example, as part of this display control, the control unit 51B causes the first display unit 24 to display the host vehicle image 10A and the surrounding situation image as viewed from a virtual viewpoint based on the surrounding information acquired by the acquisition unit 51A. This virtual viewpoint is set in a three-dimensional virtual space with the position of the host vehicle image 10A as the origin and is defined by viewpoint coordinates and a viewpoint angle (orientation) in the virtual space. As an example, this virtual viewpoint is a viewpoint viewed from specific viewpoint coordinates above the host vehicle image 10A in the virtual space at a specific viewpoint angle.

[0071] The surrounding situation image also includes a road image showing the roadway including the roadway and sidewalk on which vehicle 10 is traveling, and object images showing objects other than vehicle 10, such as other vehicles and pedestrians. The roads shown in the road image include highways, private roads, open spaces, plazas, and parking lots. The road image is an example of a "background image."

[0072] The control unit 51B generates an image representing the vehicle 10, the road, and the object marker to be displayed on the first display unit 24 based on the surrounding information, and displays the vehicle image 10A and the object marker image on the road image in a configuration based on the actual positional relationship and from a viewpoint of observing the vehicle 10 from a specific virtual viewpoint.

[0073] Furthermore, as part of the aforementioned display control, the control unit 51B changes the road image displayed as the surrounding situation image based on the satisfaction of predetermined conditions. Predetermined conditions are various conditions for changing the road image displayed on the first display unit 24. In the first embodiment, the control unit 51B determines whether a predetermined condition has been satisfied based on the vehicle 10's driving location and state. For example, the control unit 51B determines that a predetermined condition has been satisfied when the vehicle 10's driving location changes from a regular road to a highway, or vice versa. Furthermore, the control unit 51B determines that a predetermined condition has been satisfied when the vehicle 10's gear position is switched to R.

[0074] Here, there are three types of road image settings (see Figures 7 to 9 ), namely, a first road image 60A, a second road image 60B, and a third road image 60C. The first road image 60A is an illustration image showing the road around the vehicle 10 as a straight or curved road. The second road image 60B is an illustration image created by modeling the road around the vehicle 10 in 3D form, as shown in map data stored in an external server or storage 54. The third road image 60C is a camera image of the road around the vehicle 10 captured in real time by the camera 40.

[0075] Furthermore, the control unit 51B changes the virtual viewpoint based on the changed road image. Here, changing the virtual viewpoint means changing at least one of the viewpoint coordinates and the viewpoint angle in the virtual space. Examples of changing the road image and the virtual viewpoint will be described later.

[0076] Figure 6 Flowchart 50 is a flowchart showing the flow of a specific process executed by the display control device 50. The CPU 51 reads the display control program 52A from the ROM 52, expands it in the RAM 53, and executes the specific process. As an example, the specific process is automatically and repeatedly executed every fixed time.

[0077] exist Figure 6 In step S10 shown, the CPU 51 acquires surrounding information related to the surrounding conditions of the vehicle 10. Then, the CPU 51 proceeds to step S11.

[0078] In step S11, the CPU 51 updates the display content of the first display unit 24 based on the surrounding information acquired in step S10. For example, if the speed of the vehicle 10 increases or decreases, the CPU 51 changes the vehicle speed information 72 (see FIG. 1 ) displayed on the first display unit 24. Figures 7 to 9 ), and when the vehicle 10 approaches another vehicle ahead, the distance between the own vehicle image 10A on the first display unit 24 and the image representing the other vehicle is narrowed. Then, the CPU 51 proceeds to step S12.

[0079] In step S12, the CPU 51 determines whether the predetermined condition is satisfied. If the CPU 51 determines that the predetermined condition is satisfied (step S12: Yes), the process proceeds to step S13. On the other hand, if the CPU 51 determines that the predetermined condition is not satisfied (step S12: No), the process returns to step S10.

[0080] In step S13 , the CPU 51 changes the road image displayed as the surrounding situation image, and changes the virtual viewpoint based on the changed road image. The CPU 51 then ends the specific processing.

[0081] Next, use Figures 7 to 9 An example of changing the road image and the virtual viewpoint based on the satisfaction of a predetermined condition will be described.

[0082] Figure 7 : is a first explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 7 An example of display content of the display area X when the vehicle 10 is traveling on a highway is shown.

[0083] exist Figure 7 The upper portion of the display area X shown displays gear position information 70 and vehicle speed information 72 .

[0084] The gear position information 70 indicates the gear position of the vehicle 10. Figure 7 In FIG, “D” is displayed as the shift position information 70 , indicating that the shift position is the D range.

[0085] The vehicle speed information 72 indicates the vehicle speed of the vehicle 10. Figure 7 In FIG. 7 , “54 km / h” is displayed as the vehicle speed information 72 , indicating that the vehicle speed is 54 km / h.

[0086] In addition, Figure 7 In the display area X shown, a vehicle image 10A, another vehicle image 10B, and a first road image 60A are displayed below the gear information 70 and the vehicle speed information 72. The vehicle image 10A is an illustration image drawn with a predetermined design for the vehicle 10. The other vehicle image 10B is an illustration image drawn with a predetermined design for another vehicle located in the same lane as the vehicle 10 and ahead in the direction of travel. Figure 7 The first road image 60A shown is an illustration image depicting a straight road on the highway on which the vehicle 10 is traveling. The CPU 51 of the display control device 50 generates the aforementioned own vehicle image 10A, other vehicle images 10B, and the first road image 60A based on the acquired surrounding information.

[0087] Furthermore, the CPU 51 displays the own vehicle image 10A and the other vehicle images 10B on the first road image 60A in an arrangement based on the actual positional relationship. Figure 7 As shown, the CPU 51 displays the own vehicle image 10A and the other vehicle images 10B on the same lane on the first road image 60A.

[0088] Here, in Figure 7In the embodiment of the present invention, the CPU 51 displays the host vehicle image 10A, the other vehicle images 10B, and the first road image 60A in the display area X from a first virtual viewpoint set for the first road image 60A. The first virtual viewpoint is a viewpoint from which the host vehicle image 10A is viewed obliquely downward from a high position on the rear side in the traveling direction.

[0089] Figure 8 2 is a second explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 8 A first example of the display content of the display area X is shown when the vehicle 10 is traveling on a general road.

[0090] exist Figure 8 The upper portion of the display area X shown in FIG. 1 displays gear information 70 and vehicle speed information 72. Figure 8 In the figure, "D" is displayed as the gear position information 70, indicating that the gear position is D. Figure 8 In FIG. 7 , “20 km / h” is displayed as the vehicle speed information 72 , indicating that the vehicle speed is 20 km / h.

[0091] In addition, Figure 8 In the display area X shown, the vehicle image 10A, the other vehicle image 10C, and the second road image 60B are displayed below the gear information 70 and the vehicle speed information 72. The other vehicle image 10C is an illustration image drawn with a predetermined design for another vehicle located in front of the vehicle 10 in the direction of travel. Figure 8 The second road image 60B shown is an illustration image that is a 3D model of a typical road surrounding the vehicle 10 as shown in the map data. When the vehicle 10 changes from a highway to a typical road, thus satisfying a predetermined condition, the CPU 51 of the display control device 50 generates the aforementioned vehicle image 10A, another vehicle image 10C, and the second road image 60B using the surrounding information and the map data.

[0092] Figure 8 The second road image 60B shown is divided into a roadway area, namely roadway Y, and sidewalk areas, namely sidewalks Z1 and Z2. Route information 74, representing the route to the destination of vehicle 10 set in the car navigation system, is displayed on the front side of the vehicle image 10A on roadway Y, using two line segments. Furthermore, a stop line image 76 showing a stop line and a crosswalk image 78 showing a crosswalk are displayed in the portion of roadway Y that overlaps with the vehicle image 10A. Furthermore, a crosswalk image 80 showing a crosswalk between sidewalks Z1 and Z2 is displayed in the portion of roadway Y that overlaps with the other vehicle image 10C.

[0093] Then, similarly to the above, the CPU 51 displays the own vehicle image 10A and the other vehicle images 10C on the second road image 60B in an arrangement based on the actual positional relationship. Figure 8 As shown, the CPU 51 displays the other vehicle image 10C on the roadway Y in the forward direction of the own vehicle image 10A.

[0094] Here, in Figure 8 In the example, the CPU 51 displays the vehicle image 10A, the other vehicle images 10C, and the second road image 60B in the display area X from the second virtual viewpoint set for the second road image 60B. The second virtual viewpoint is a viewpoint from which the vehicle image 10A is viewed obliquely downward from a position higher than the first virtual viewpoint. Figure 8 The display is performed from the second imaginary viewpoint, so compared to Figure 7 The viewpoint shown is viewed from a first imaginary viewpoint, while a larger area of ​​the road is displayed within the display area X.

[0095] Figure 9 3 is a third explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 9 An example of display content of the display area X when the shift position of the vehicle 10 is switched to the R range is shown.

[0096] exist Figure 9 The upper portion of the display area X shown in FIG. 1 displays gear information 70 and vehicle speed information 72. Figure 9 In the figure, "R" is displayed as the gear position information 70, indicating that the gear position is the R gear. Figure 9 In FIG. 7 , “0 km / h” is displayed as the vehicle speed information 72 , indicating that the vehicle speed is 0 km / h.

[0097] In addition, Figure 9 In the display area X shown, below the shift position information 70 and the vehicle speed information 72 , a host vehicle image 10A, another vehicle image 10D, another vehicle image 10E, and a third road image 60C are displayed.

[0098] Here, the other vehicle image 10D and the other vehicle image 10E are camera images taken in real time by the camera 40 showing other vehicles in the vicinity of the vehicle 10. In addition, the third road image 60C is a camera image taken in real time by the camera 40 showing the parking lot around the vehicle 10. In detail, the other vehicle image 10D, the other vehicle image 10E and the third road image 60C are images obtained by converting the camera image taken in real time by the camera 40 into an image that simulates a viewpoint looking down from above. In addition, the present vehicle image 10A is an illustration image drawn with a predetermined design for the vehicle 10, similarly to the above. In this way, in Figure 9 In the display area X shown, the host vehicle image 10A is displayed as an illustration image, and the other vehicle images 10D and 10E, as well as the third road image 60C, are displayed as camera images. When the gear position of the vehicle 10 is switched to the R range, thus satisfying a predetermined condition, the CPU 51 of the display control device 50 generates the host vehicle image 10A, the other vehicle images 10D and 10E, and the third road image 60C based on the surrounding information.

[0099] Figure 9 The third road image 60C shown is divided into a parking space P, which represents a parking space in the parking lot, and a driving space D, which represents a driving space in the parking lot. Similarly to the above, the CPU 51 displays the own vehicle image 10A, the other vehicle images 10D, and the other vehicle images 10E on the third road image 60C in an arrangement based on the actual positional relationship. For example, Figure 9 As shown, the CPU 51 displays the own vehicle image 10A in the driving space D, displays the other vehicle image 10D in the parking frame of the parking space P1 on the left side of the figure, and displays the other vehicle image 10E in the parking frame of the parking space P2 on the right side of the figure.

[0100] Here, in Figure 9 In the display area X, the CPU 51 displays the host vehicle image 10A, the other vehicle images 10D and 10E, and the third road image 60C from a third virtual viewpoint set for the third road image 60C. The third virtual viewpoint is a viewpoint from which the host vehicle image 10A is viewed from a higher position directly below.

[0101] As described above, in the display control device 50, the CPU 51 displays the vehicle image 10A and the surrounding situation image as viewed from a virtual viewpoint on the first display unit 24 based on surrounding information related to the surrounding situation of the vehicle 10. Furthermore, the CPU 51 changes the road image displayed as the surrounding situation image in response to the satisfaction of predetermined conditions. Thus, the display control device 50 changes the road image displayed as the surrounding situation image in response to the satisfaction of predetermined conditions, allowing the driver to be presented with the road image in multiple different configurations, both before and after the change.

[0102] Furthermore, in the display control device 50, the CPU 51 changes the road image displayed on the first display unit 24 in response to the satisfaction of predetermined conditions based on the driving location and state of the vehicle 10. Furthermore, the CPU 51 changes the virtual viewpoint based on the changed road image. Thus, the display control device 50 can present the driver with a road image viewed from a virtual viewpoint that is appropriate based on the driving location and state of the vehicle 10.

[0103] Furthermore, in the display control device 50, the first display unit 24 is an instrument display provided in front of the driver's seat of the vehicle 10. Thus, the display control device 50 can present information representing instruments of measuring equipment of the vehicle 10, along with the vehicle image 10A and an image of surrounding conditions, to the driver on a single screen.

[0104] (Second embodiment)

[0105] Next, a second embodiment of the vehicle 10 according to the present embodiment will be described, with portions overlapping with the above-described embodiment being omitted or simplified.

[0106] In the second embodiment, in addition to the above-described embodiments, the CPU 51 of the display control device 50 further determines whether a predetermined condition based on the driver's selection is satisfied. For example, if the driver performs a predetermined setting operation on the vehicle 10, the CPU 51 determines that the predetermined condition is satisfied.

[0107] Figure 10 4 is a fourth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 10 A setting screen is shown on which settings can be made for display or non-display of a road image and individual landmark images displayed as a surrounding situation image.

[0108] exist Figure 10 The illustrated setting screen displays a first setting item 82 , a second setting item 84 , a third setting item 86 , and a fourth setting item 88 .

[0109] The first setting item 82 is used to set the road image displayed on the first display unit 24. As an example, the first setting item 82 is set to one of "first road image," "second road image," and "third road image." The driver operates an operating switch (not shown) in an onboard device to select one of the three options in a pull-down menu. As an example, if "Second Road Image" is displayed in the setting field 82A of the first setting item 82, it indicates that the second road image 60B is displayed as the road image.

[0110] The second setting item 84 is a portion for setting whether to display or not to display images showing other vehicles as respective object marker images.

[0111] The third setting item 86 is a portion for setting whether to display or not to display an image showing a pedestrian as each object marker image.

[0112] The fourth setting item 88 is to determine whether to display the route information 74 (see Figure 8 ) section for setting.

[0113] As an example, the second setting item 84, the third setting item 86, and the fourth setting item 88 are set to either "display" or "non-display." The driver operates the operation switch to select one of the two options from the pull-down menu. As an example, the setting field 84A of the second setting item 84 displays "display," indicating that images of other vehicles are displayed. Furthermore, the setting field 86A of the third setting item 86 displays "non-display," indicating that images of pedestrians are not displayed. Furthermore, the setting field 88A of the fourth setting item 88 displays "display," indicating that route information 74 is displayed.

[0114] After the driver selects all the settings for the settings on the settings screen, they operate the operating switch to perform the predetermined settings for the vehicle 10. The CPU 51 then determines that the predetermined conditions based on the driver's selections have been met and changes the road image displayed on the first display unit 24 to the settings for the first setting item 82. Furthermore, the CPU 51 switches the display of the various landmark images and route information 74 on the first display unit 24 based on the settings for the second setting item 84, the third setting item 86, and the fourth setting item 88.

[0115] Figure 11 : is a fifth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 11 Indicates that based on Figure 10The setting contents set on the setting screen shown are an example of the display contents of the host vehicle image 10A and the surrounding situation image.

[0116] As in the above embodiment, Figure 11 The upper portion of the display area X shown in FIG. 1 displays gear information 70 and vehicle speed information 72. Figure 11 A caution message 90 is displayed to the right of the vehicle speed information 72. The caution message 90 indicates that an image representing a pedestrian should not be displayed as the surrounding situation image. As an example, the caution message 90 is a design in which an icon representing a pedestrian is underlined downward.

[0117] In addition, Figure 11 In the display area X shown, the gear information 70, the vehicle speed information 72 and the caution information 90 are displayed below. Figure 10 The setting contents set in the setting screen shown in FIG. 6A are displayed as a road image with a second road image 60B. As an example, similarly to the above embodiment, Figure 11 The second road image 60B shown is an illustration image drawn by 3D modeling a general road around the vehicle 10 shown in the map data. Figure 8 Likewise, the second road image 60B is divided into a roadway Y and sidewalks Z1 and Z2, and based on the Figure 10 The route information 74 is displayed on the roadway Y according to the setting contents set in the setting screen shown. Figure 10 In the setting screen shown, the setting field 86A is set to “non-display”. Therefore, even if a pedestrian is detected around the vehicle 10 based on the surrounding information, an image showing the pedestrian is not displayed on the second road image 60B.

[0118] As described above, in the second embodiment, the CPU 51 of the display control device 50 is based on Figure 10 The road image, each landmark image, and route information 74 are displayed on the first display unit 24 according to the settings set in the setting screen shown. Therefore, for example, even if the vehicle 10 changes from a regular road to a highway, the CPU 51 does not change the road image to the first road image 60A as in the above embodiment, but instead displays the second road image 60B, which is a 3D model of the highway based on map data, on the first display unit 24.

[0119] Furthermore, in the second embodiment, as a function of the control unit 51B, the CPU 51 of the display control device 50 changes the road image displayed on the first display unit 24 in response to the satisfaction of a predetermined condition selected by the driver of the vehicle 10. Furthermore, the CPU 51 switches the display or non-display of each object marker image displayed as the surrounding situation image in response to the satisfaction of this predetermined condition. Thus, the display control device 50 can present the driver with a road image and object marker images that suit the driver's preferences.

[0120] Furthermore, in the second embodiment, as a function of the control unit 51B, the CPU 51 of the display control device 50 displays, on the first display unit 24, a warning message 90 indicating that the image representing the pedestrian will not be displayed as a surrounding situation image when the image representing the pedestrian is switched off. Thus, the display control device 50 allows attention to be paid to pedestrians in real space even when the image representing the pedestrian is not displayed on the first display unit 24. The image representing the pedestrian is an example of an "image of a specific landmark."

[0121] (Third embodiment)

[0122] Next, a third embodiment of the vehicle 10 according to the present embodiment will be described, with portions overlapping with the above-described embodiments being omitted or simplified.

[0123] Figure 12 : is a sixth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 12 A second example of the display content of the display area X is shown when the vehicle 10 is traveling on a general road.

[0124] As in the above embodiment, Figure 12 The upper portion of the display area X shown displays gear position information 70 and vehicle speed information 72 .

[0125] In addition, Figure 12 In the display area X shown, the vehicle image 10A, the pedestrian image 92, and the second road image 60B are displayed below the gear information 70 and the vehicle speed information 72. The pedestrian image 92 is an illustration image drawn with a predetermined design of a pedestrian crossing the crosswalk around the vehicle 10. At this time, the CPU 51 displays the vehicle image 10A and the pedestrian image 92 on the second road image 60B in an arrangement based on the actual positional relationship. For example, Figure 12 As shown, the CPU 51 displays the pedestrian image 92 within the two line segments indicated by the route information 74 on the roadway Y in the forward direction of the host vehicle image 10A.

[0126] In the third embodiment, as a function of the control unit 51B, the CPU 51 of the display control device 50, upon detecting multiple objects of the same type within a predetermined range, displays on the first display unit 24 only images of objects whose risk level relative to the vehicle 10 exceeds a predetermined threshold. The predetermined range can be appropriately set to, for example, within a radius of 2 meters, 5 meters, or 10 meters. The risk level relative to the vehicle 10 indicates the likelihood of contact with the vehicle 10. For example, in the third embodiment, objects with risk levels exceeding the predetermined threshold are those located on the vehicle 10's travel path.

[0127] Figure 12 The example shown shows the display content when there are three pedestrians within a predetermined range, one of whom is on the travel route of vehicle 10. In this case, CPU 51 displays an image representing the one pedestrian on the travel route as pedestrian image 92 on first display unit 24, and does not display the images representing the other two pedestrians on first display unit 24. Furthermore, CPU 51 emphasizes the presence of the pedestrian on the travel route to the driver by displaying an ellipse surrounding pedestrian image 92 on first display unit 24.

[0128] As described above, according to the display control device 50 according to the third embodiment, the above-described configuration can increase attention to an object in real space whose degree of danger to the vehicle 10 exceeds a predetermined standard.

[0129] (other)

[0130] In the above embodiment, predetermined conditions based on the driving location and state of the vehicle 10 and predetermined conditions based on the driver's selection are exemplified, but the predetermined conditions are not limited to these. The predetermined conditions may also be conditions established based on the surrounding conditions of the vehicle 10. For example, the CPU 51 may determine that the predetermined condition is established when the amount of light received by the illuminance sensor included in the sensor group 30 is less than a predetermined amount, in other words, when the area around the vehicle 10 becomes dark.

[0131] Figure 13 : is a seventh explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 13 Indicates that the display on the first display unit 24 shows Figure 7 The display content will be displayed after a predetermined time has passed from the example shown.

[0132] As in the above embodiment, Figure 13 The upper portion of the display area X shown displays gear position information 70 and vehicle speed information 72 .

[0133] In addition, Figure 13 In the display area X shown, a vehicle image 10A, another vehicle image 10B, another vehicle image 10F, and a first road image 60A are displayed below the gear position information 70 and vehicle speed information 72. The other vehicle image 10F is an illustration image drawn with a predetermined design of another vehicle located ahead of the vehicle 10 in the right lane in the direction of travel.

[0134] Here, in Figure 13 In the example shown, the CPU 51 determines that the amount of light received by the illuminance sensor is less than a predetermined amount, thus satisfying a predetermined condition, and changes the road image displayed as the surrounding condition image. In this case, as an example, the CPU 51 changes the display color of the entire display area X including the road image. Figure 13 The figure shows a case where the entire display area X, including the first road image 60A, is shaded with dots, making the display color darker than before the change. In this way, changing the road image is not limited to changing the image itself, such as changing from the first road image 60A to the second road image 60B. It can also involve changing the displayed road image's color, shape, and size, among other display contents. Thus, the display control device 50 can also vary the road image displayed as the surrounding condition image, depending on the brightness of the vehicle 10's surroundings, for example, during daytime and nighttime hours.

[0135] Although the road image representing the road is used as an example of the "background image" in the above embodiment, the "background image" is not limited to this. For example, in addition to the road image, the "background image" may also include a landscape image such as the sea and the mountains representing the scenery around the vehicle 10. In the case where the road image and the landscape image are an example of the "background image", the change of the background image only requires changing at least one of the road image and the landscape image. In addition, the "background image" is not limited to including the road image, but may also be an image displayed in an area other than the area where the vehicle image 10A, the road image, and the object image are displayed in the display area X. In the following, using Figures 14 to 19 This example is described.

[0136] Figure 14 : is an eighth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 14 An example of display content of the display area X when the shift position of the vehicle 10 is the R range is shown.

[0137] exist Figure 14 The upper portion of the display area X shown in FIG. 1 displays gear information 70 and vehicle speed information 72. Figure 14In the figure, "R" is displayed as the gear position information 70, indicating that the gear position is the R gear. Figure 14 In FIG. 7 , “4 km / h” is displayed as the vehicle speed information 72 , indicating that the vehicle is reversing at a speed of 4 km / h.

[0138] exist Figure 14 The lower portion of the display area X shown in FIG. 1 displays a host vehicle image 10A and another vehicle image 10D serving as a target object image. Figure 14 The vehicle image 10A shown is an illustration image of the vehicle 10 drawn in a predetermined design. Figure 14 The other vehicle image 10D shown is an illustration image drawn with a predetermined design of another vehicle parked in a parking space adjacent to the left of the parking space where the vehicle 10 is parked. Figures 15 to 19 The vehicle image 10A shown is also Figure 14 Same illustration image.

[0139] Here, in Figure 14 In the display area X shown, a background image 100 serving as an example of the aforementioned “background image” is displayed in an area near the center between the shift position information 70 and vehicle speed information 72 and the own vehicle image 10A and the other vehicle images 10D.

[0140] The background image 100 is a panoramic view image obtained by converting the camera image of the surroundings of the vehicle 10 captured in real time by the camera 40 into an image that simulates a viewpoint looking down from above. The background image 100 displays, for example, an image 100A representing the vehicle 10 corresponding to the vehicle image 10A and an image 100B representing other vehicles corresponding to other vehicle images 10D. When the gear position of the vehicle 10 is switched to the R gear, thereby satisfying a predetermined condition, the CPU 51 of the display control device 50 generates and displays the above-mentioned background image 100 based on the surrounding information. Furthermore, when the gear position of the vehicle 10 is other than the R gear, such as the P gear or the D gear, the CPU 51 displays an image different from the background image 100 in the area where the above-mentioned background image 100 is displayed, or displays no image at all.

[0141] Figure 15 : is a ninth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 15 Indicates that the vehicle 10 is Figure 14 The figure shows an example of display content in the display area X when the vehicle leaves the parking space and travels on a general road.

[0142] exist Figure 15 The host vehicle image 10A and a first road image 60A as a road image are displayed at the lower portion of the display region X shown.

[0143] Here, in Figure 15 In the display area X shown, a background image 110 serving as an example of the aforementioned “background image” is displayed in an area other than the area where the host vehicle image 10A and the first road image 60A are displayed.

[0144] Background image 110 is an illustration image rendered by 3D modeling the roads and buildings surrounding vehicle 10 as shown in map data. The CPU 51 of display control device 50 generates and displays background image 110 using surrounding information and map data, for example, when a predetermined condition is satisfied, such as when vehicle 10 changes from a parking lot to a regular road. Furthermore, CPU 51 changes the display content of background image 110 based on the current location of vehicle 10. For example, if vehicle 10 turns right at an intersection, CPU 51 changes background image 110 to the scenery the driver would have viewed after turning right at the intersection.

[0145] Figure 16 10 is a tenth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 16 An example of display content of the display area X when the vehicle 10 is traveling on a road near the sea is shown.

[0146] exist Figure 16 The host vehicle image 10A and a first road image 60A as a road image are displayed at the lower portion of the display region X shown.

[0147] Here, in Figure 16 In the display area X shown, a background image 120 serving as an example of the aforementioned “background image” is displayed in an area other than the area where the host vehicle image 10A and the first road image 60A are displayed.

[0148] The background image 120 is an illustration image of a landscape depicting a predetermined seaside road. The background image 120 is stored in, for example, the memory 54. The CPU 51 of the display control device 50 obtains the background image 120 from the memory 54 and displays it, for example, based on the fact that the driving place of the vehicle 10 becomes a road by the sea and a predetermined condition is satisfied. In addition, which part of the road shown in the map data belongs to the road by the sea is predetermined, and the CPU 51 determines whether the driving place of the vehicle 10 has become a road by the sea based on the surrounding information and the map data. In this way, an image that serves as an example of the above-mentioned "background image" can be an illustration image prepared in advance. In the following, using Figures 17 to 19 Another example in which the “background image” is a pre-prepared illustration image will be described.

[0149] Figure 17 11th explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 17 An example of display content of the display area X when the vehicle 10 is traveling on a mountain road is shown.

[0150] exist Figure 17 The host vehicle image 10A and a first road image 60A as a road image are displayed at the lower portion of the display region X shown.

[0151] Here, in Figure 17 In the display area X shown, a background image 130 serving as an example of the aforementioned “background image” is displayed in an area other than the area where the host vehicle image 10A and the first road image 60A are displayed.

[0152] Background image 130 is an illustration depicting the scenery of a predetermined mountain road. Background image 130 is stored, for example, in memory 54. When, for example, a predetermined condition is satisfied, the vehicle 10's driving path becomes a mountain road, CPU 51 of display control device 50 retrieves background image 130 from memory 54 and displays it. Furthermore, which portion of the road shown in the map data constitutes a mountain road is predetermined, and CPU 51 determines whether the vehicle 10's driving path has become a mountain road based on surrounding information and the map data.

[0153] Figure 18 12 is a twelfth explanatory diagram showing an example of a display displayed in the display area X of the first display unit 24. Specifically, Figure 18 An example of display content of the display area X when the vehicle 10 is traveling on a road in an urban area is shown.

[0154] exist Figure 18 The host vehicle image 10A and a first road image 60A as a road image are displayed at the lower portion of the display region X shown.

[0155] Here, in Figure 18 In the display area X shown, a background image 140 serving as an example of the aforementioned “background image” is displayed in an area other than the area where the host vehicle image 10A and the first road image 60A are displayed.

[0156] Background image 140 is an illustration depicting a landscape of a road in a predetermined urban area. Background image 140 is stored, for example, in memory 54. When, for example, a predetermined condition is satisfied, the vehicle 10 is traveling on a road in the urban area, the CPU 51 of the display control device 50 retrieves background image 140 from memory 54 and displays it. Furthermore, the portion of the road shown in the map data that falls within the urban area is predetermined, and the CPU 51 determines whether the vehicle 10 is traveling on a road in the urban area based on the surrounding information and the map data.

[0157] Figure 19 13th explanatory diagram showing an example of display displayed in the display area X of the first display unit 24. Specifically, Figure 19 An example of display content of the display area X when the travel time period of the vehicle 10 becomes nighttime is shown.

[0158] exist Figure 19 The host vehicle image 10A and a first road image 60A as a road image are displayed at the lower portion of the display region X shown.

[0159] Here, in Figure 19 In the display area X shown, a background image 150 serving as an example of the aforementioned “background image” is displayed in an area other than the area where the host vehicle image 10A and the first road image 60A are displayed.

[0160] Background image 150 is an illustration depicting a predetermined nighttime landscape. Background image 150 is stored, for example, in memory 54. The CPU 51 of the display control device 50 retrieves and displays background image 150 from memory 54, for example, upon determining that a predetermined condition based on the surrounding conditions of the vehicle 10 has been met. In this case, the CPU 51 may also determine that the predetermined condition has been met if the amount of light received by the illuminance sensor is less than a predetermined amount, thus assuming that the driving time period is nighttime.

[0161] In the above embodiment, the CPU 51 determines whether the predetermined condition is satisfied based on both the driving location and the state of the vehicle 10. However, the present invention is not limited thereto, and the CPU 51 may determine whether the predetermined condition is satisfied based only on the driving location of the vehicle 10 or only on the state of the vehicle 10.

[0162] In the above embodiment, the CPU 51 determines that the predetermined condition is satisfied when the vehicle 10 changes from a regular road to a highway, or vice versa. However, the present invention is not limited thereto. For example, the CPU 51 may determine that the predetermined condition is satisfied when the vehicle 10 enters a driving area registered by the driver.

[0163] In the above embodiment, the CPU 51 determines that the predetermined condition is satisfied when the gear position of the vehicle 10 is switched to the R position. However, the present invention is not limited thereto. For example, the CPU 51 may determine that the predetermined condition is satisfied when the vehicle 10 changes from a manual driving state to an automatic driving state, or vice versa.

[0164] In the above-mentioned embodiment, the types of objects whose display or non-display can be switched as the surrounding situation image are not limited to Figure 10 For example, the object is Figure 10 In addition to the categories shown, other categories may also be included, such as obstacles, road signs, and animals. Furthermore, in the above embodiment, all types of object images are subject to switching between display and non-display. However, there may be types of object images that cannot be switched to non-display. For example, other vehicles may be a type of object image that cannot be switched to non-display and is always displayed.

[0165] In the above embodiment, an image depicting a pedestrian is used as an example of a "specific object image," but the "specific object image" is not limited to this. A "specific object image" may also be an image depicting another type of object, such as another vehicle or an animal. Furthermore, in the above embodiment, caution information 90 is composed of a predetermined image, but the display content of caution information 90 is not limited to this. In cases where the "specific object image" is not displayed as a surrounding condition image, caution information 90 may be displayed using text or a combination of text and images.

[0166] In the above embodiment, an example of a same-type object is a plurality of pedestrians, but the same-type object is not limited to this. For example, if a car and a two-wheeled vehicle are present within a predetermined range, the same-type object may not be limited to the same object, but the car and the two-wheeled vehicle may be considered the same-type object as "other vehicles."

[0167] In the above embodiment, objects whose danger level exceeds a predetermined threshold (hereinafter referred to as "dangerous objects") are located on the vehicle 10's travel path. However, dangerous objects are not limited to this. For example, a dangerous object may be one whose distance from the vehicle 10 is less than a predetermined value, or one whose distance from the vehicle 10 is the shortest. Furthermore, the above embodiment illustrates the case where a single dangerous object is detected. However, if multiple dangerous objects are detected, images representing the multiple dangerous objects are displayed on the first display unit 24. Furthermore, in the above embodiment, objects other than the dangerous object among the same type of objects within a predetermined range are not displayed on the first display unit 24. However, this is not limiting and such objects may also be displayed. In this case, the CPU 51 preferably displays the dangerous object and the image of the object using different display contents. Thus, the display control device 50 enables the driver viewing the first display unit 24 to understand the danger level of each object relative to the vehicle 10 based on the difference in display content.

[0168] In the above embodiment, the first display unit 24, which serves as an instrument display, is used as an example of a "display unit." However, an example of a "display unit" is not limited to an instrument display. For example, an example of a "display unit" may also include a center display, a head-up display (HUD), or other displays. Furthermore, an example of a "display unit" may also include a combination of multiple displays, such as an instrument display and a center display.

[0169] In the above embodiment, it is assumed that the display control device 50 executes Figure 6 The specific processing shown. However, the present invention is not limited to this, and the specific processing can also be performed by the display control device 50 in collaboration with other ECUs. For example, in the display device 21, the first display unit 24 is controlled by the display control device 50, the second display unit 25 is controlled by other ECUs, and the results of the specific processing are displayed on the first display unit 24 and the second display unit 25. In this case, the specific processing can be performed by the display control device 50 and multiple ECUs such as other ECUs in collaboration, or it can be performed by the display control device 50 or any of the other ECUs as a representative.

[0170] In addition, the specific processing that is read and executed by the CPU 51 in the above embodiment by various processors other than the CPU can also be executed. As processors in this case, FPGA (Field-Programmable Gate Array) and other PLD (Programmable Logic Device) whose circuit structure can be changed after manufacturing, and ASIC (Application Specific Integrated Circuit) and other processors with circuit structures specially designed for executing specific processing, i.e., dedicated circuits, can be exemplified. In addition, the specific processing can be executed by one of these various processors, or by a combination of two or more processors of the same type or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA, etc.). In addition, more specifically, the hardware structure of these various processors is a circuit that combines circuit elements such as semiconductor elements.

[0171] Furthermore, while the above embodiment describes a method in which the display control program 52A is pre-stored (installed) in the ROM 52, the present invention is not limited thereto. The display control program 52A may also be provided by being recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory device. Furthermore, the display control program 52A may be downloaded from an external device via a network.

Claims

1. A display control device comprising a control unit, The control unit displays an image representing the vehicle and the surrounding conditions when viewed from a virtual viewpoint on the display unit based on surrounding information related to the surrounding conditions of the vehicle, and changes an image displayed as a background of the image representing the surrounding conditions in response to the satisfaction of a predetermined condition.

2. The display control device according to claim 1, wherein: The control unit changes the background image displayed on the display unit in response to the satisfaction of the predetermined condition based on at least one of a traveling location and a state of the host vehicle, and changes the virtual viewpoint based on the changed background image.

3. The display control device according to claim 1, wherein: The control unit changes the background image displayed on the display unit and switches display or non-display of images of respective object markers displayed as images representing the surrounding conditions, in response to satisfaction of the predetermined condition based on a selection by an occupant of the host vehicle.

4. The display control device according to claim 3, wherein: When the control unit switches the image of a specific object marker to non-display, the control unit displays, on the display unit, caution information indicating that the image of the specific object marker is not to be displayed as the image representing the surrounding situation.

5. The display control device according to claim 3, wherein: When the control unit detects a plurality of object markers of the same type within a predetermined range, the control unit displays on the display unit only images of object markers having a risk level exceeding a predetermined reference level with respect to the host vehicle among the plurality of object markers. The display control device according to claim 1 , wherein: The display unit is a meter display provided in front of a driver's seat of the host vehicle.

7. A display control method, wherein: The computer performs the following processing, namely: An image showing the host vehicle and the surrounding situation as viewed from a virtual viewpoint is displayed on a display unit based on surrounding information related to the surrounding situation of the host vehicle, and an image displayed as a background of the image showing the surrounding situation is changed when a predetermined condition is satisfied.

8. A computer-readable medium having a display control program recorded thereon, the display control program being configured to cause a computer to execute the following processing: An image showing the host vehicle and the surrounding situation as viewed from a virtual viewpoint is displayed on a display unit based on surrounding information related to the surrounding situation of the host vehicle, and an image displayed as a background of the image showing the surrounding situation is changed when a predetermined condition is satisfied.