Display control device

The display control device enhances situational awareness by dynamically adjusting vehicle images based on sensor data, addressing the limitations of static display technologies.

JP2026019693APending Publication Date: 2026-02-05TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024121432
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2026-02-05

AI Technical Summary

Technical Problem

Existing display technologies do not effectively utilize detection information from vehicle sensors to dynamically change vehicle images, making it difficult for occupants to understand the vehicle's situation accurately.

Method used

A display control device that displays a surrounding image and a vehicle image from a virtual viewpoint, adjusting the vehicle image based on detection information to reflect changes such as detection accuracy, damage, and dangerous driving, thereby enhancing situational awareness.

Benefits of technology

Facilitates easier understanding of the vehicle's situation by occupants through dynamic image adjustments, indicating malfunctioning sensors, damage, and potential risks, improving safety and awareness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026019693000001_ABST
    Figure 2026019693000001_ABST
Patent Text Reader

Abstract

An object of the present disclosure is to make it easy for an occupant of a vehicle to grasp a situation of the vehicle based on a vehicle image.SOLUTION: A display control device includes a control unit that causes a display unit to display a peripheral image indicating a peripheral situation of a vehicle when viewed from a virtual viewpoint and a vehicle image indicating the vehicle on the basis of detection information that can be detected by the vehicle, and changes a mode of the vehicle image according to the acquired detection information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a display control device. [Background technology]

[0002] Patent Document 1 discloses a vehicle control device that can perform automatic driving that gives a sense of security to the occupants. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7048398 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, in the technology disclosed in Patent Document 1, an image showing the vehicle itself and an image showing the surroundings of the vehicle are displayed on a display unit (see FIG. 8 of Patent Document 1). However, this technology does not take into consideration changing the appearance of the image showing the vehicle itself in accordance with detection information from a sensor or the like of the vehicle itself, and there is still room for improvement in the method of displaying the image showing the vehicle itself on a display unit.

[0005] Therefore, an object of the present disclosure is to provide a display control device that can make it easier for vehicle occupants to understand the situation of the vehicle based on vehicle images. [Means for solving the problem]

[0006] The display control device of claim 1 displays, on a display unit, a surrounding image showing the surrounding situation of the vehicle as seen from a virtual viewpoint and a vehicle image showing the vehicle based on detection information that can be detected by the vehicle, and includes a control unit that changes the appearance of the vehicle image according to the acquired detection information.

[0007] In the display control device according to claim 1, the control unit causes the display unit to display a surrounding image and a vehicle image as seen from a virtual viewpoint based on the detection information. The control unit then changes the appearance of the vehicle image according to the acquired detection information. This allows the display control device to make it easier for vehicle occupants to understand the vehicle situation based on the vehicle image.

[0008] The display control device of claim 2 is in claim 1, wherein when a decrease in the detection accuracy of a detection unit is identified from the detection information, the control unit changes the appearance of the part of the vehicle image corresponding to the detection unit whose detection accuracy has decreased.

[0009] In the display control device according to claim 2, when a decrease in the detection accuracy of a detection unit is identified from the detection information, the control unit changes the state of the part of the vehicle image corresponding to the detection unit whose detection accuracy has decreased. This allows the display control device to allow the occupant to understand which detection unit is malfunctioning and the cause of the malfunction, based on the vehicle image.

[0010] The display control device of claim 3 is in claim 1 or 2, wherein the control unit reflects the open / closed state of the opening / closing part of the vehicle identified from the detection information in the part of the vehicle image corresponding to the opening / closing part.

[0011] In the display control device according to claim 3, the control unit reflects the open / closed state of the vehicle door / gate identified from the detection information in the portion of the vehicle image corresponding to the door / gate, thereby allowing the occupant to grasp the open / closed state of the door / gate from the display content of the display unit.

[0012] The display control device of claim 4 is any one of claims 1 to 3, wherein when damage to a part of the vehicle is identified from the detection information, the control unit damages a part of the vehicle image corresponding to the damaged part of the vehicle.

[0013] In the display control device according to claim 4, when damage to a vehicle part is identified from the detection information, the control unit damages a part of the vehicle image corresponding to the damaged vehicle part, thereby allowing the display control device to allow the occupant to grasp the location or state of the damaged part from the display content of the display unit.

[0014] The display control device of claim 5 is any one of claims 1 to 4, wherein the control unit adds damage information indicating that the vehicle may be damaged to the vehicle image when it is determined from the detection information that a specific dangerous driving behavior has been engaged in by an occupant of the vehicle.

[0015] In the display control device according to claim 5, when the control unit determines from the detection information that a vehicle occupant has engaged in specific dangerous driving, the control unit adds damage information indicating that the vehicle may be damaged to the vehicle image. This allows the display control device to make the occupant understand from the content displayed on the display unit that the vehicle may be damaged by their own driving operation. [Effects of the Invention]

[0016] As described above, the display control device according to the present disclosure makes it easy for a vehicle occupant to understand the situation of the vehicle based on a vehicle image. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 2 is a block diagram showing the hardware configuration of a vehicle. [Figure 2] 10 is a flowchart showing the flow of a specification process. [Figure 3] 10 is a first display example displayed on the monitor. [Figure 4] 10 is a second display example displayed on the monitor. [Figure 5] 10 is a third example of a display displayed on the monitor. [Figure 6] 10 is a fourth example of a display displayed on the monitor. DETAILED DESCRIPTION OF THE INVENTION

[0018] The vehicle 10 according to this embodiment will be described below. Fig. 1 is a block diagram showing the hardware configuration of a vehicle 10. As shown in Fig. 1, the vehicle 10 includes a meter ECU (Electronic Control Unit) 20. The vehicle 10 is an example of a "vehicle" in the present disclosure, and the meter ECU 20 is an example of a "display control device" in the present disclosure.

[0019] The meter ECU 20 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage 24, an in-vehicle communication I / F (Interface) 25, an input / output I / F 26, and a wireless communication I / F 27. The CPU 21, the ROM 22, the RAM 23, the storage 24, the in-vehicle communication I / F 25, the input / output I / F 26, and the wireless communication I / F 27 are connected to each other via an internal bus 28 so as to be able to communicate with each other.

[0020] The CPU 21 is a central processing unit that executes various programs and controls each part. That is, the CPU 21 reads programs from the ROM 22 or the storage 24 and executes the programs using the RAM 23 as a work area. The CPU 21 controls each of the above components and performs various arithmetic processing in accordance with the programs recorded in the ROM 22 or the storage 24.

[0021] The ROM 22 stores various programs and various data. The RAM 23 serves as a working area for temporarily storing programs or data.

[0022] The storage 24 is configured with a storage device such as an eMMC (embedded multi media card) or a UFS (universal flash storage), and stores various programs and various data. A display control program 24A is stored in the storage 24. The display control program 24A is a program for causing the CPU 21 to execute specific processing (see FIG. 2), which will be described later.

[0023] The in-vehicle communication I / F 25 is an interface for connecting to other ECUs 30. The interface uses a communication standard based on the CAN protocol. The in-vehicle communication I / F 25 is connected to an external bus 29. Although not shown, in addition to the ECU 30, multiple ECUs are provided for each function of the vehicle 10.

[0024] The input / output I / F 26 is an interface for communicating with an in-vehicle device 40 mounted on the vehicle 10 .

[0025] The on-vehicle devices 40 are various devices mounted on the vehicle 10. The vehicle 10 includes a sensor group 42 and a monitor 44 as examples of the on-vehicle devices 40.

[0026] The sensor group 42 includes sensors for detecting the state of the vehicle 10 and the surrounding conditions of the vehicle 10, such as a 3D-LiDAR, a millimeter wave sensor, an infrared sensor, a turn signal sensor, an accelerator position sensor, a vehicle speed sensor, a steering angle sensor, an angular velocity sensor, a GPS (Global Positioning System) sensor, an illuminance sensor, a gyro sensor, a steering angle sensor, and an acceleration sensor, as well as a plurality of cameras for capturing images of the surroundings of the vehicle 10. The sensor group 42 outputs the detection results of each sensor and the captured images by each camera to the meter ECU 20, the ECU 30, etc.

[0027] The monitor 44 is provided on a meter panel located in front of the driver's seat of the vehicle 10, and is a meter display for displaying operation suggestions related to functions of the vehicle 10 and images explaining the functions, etc. The monitor 44 is an example of a "display unit" in the present disclosure.

[0028] The wireless communication I / F 27 is a wireless communication module for communicating with external devices, and uses communication standards such as 5G, LTE, Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0029] The CPU 21 of the meter ECU 20 has, as functional components, an acquisition unit 21A, an identification unit 21B, and a control unit 21C. Each functional component is realized by the CPU 21 reading and executing a display control program 24A stored in the storage 24.

[0030] The acquisition unit 21A acquires various types of information. For example, the acquisition unit 21A acquires, as the various types of information, detection information that can be detected by the vehicle 10. The detection information includes the detection results of each sensor constituting the sensor group 42, captured images by each camera, and the like.

[0031] The identification unit 21B identifies the state of the vehicle 10 based on the detection information acquired by the acquisition unit 21A. For example, the identification unit 21B identifies, as the state of the vehicle 10, the detection accuracy of a rear sensor included in the sensor group 42 for detecting detection information on the rear side of the vehicle 10, the detection accuracy of a front camera included in the sensor group 42 for capturing an image in front of the vehicle 10, the open / closed states of the left and right door mirrors, whether or not the left and right door mirrors are damaged, and whether or not specific dangerous driving has occurred. The rear sensor and the front camera are examples of a "detection unit" in the present disclosure, and the door mirrors are examples of an "opening / closing unit" and a "component" in the present disclosure.

[0032] The control unit 21C performs display control related to the display on the monitor 44. For example, as the display control, the control unit 21C causes the monitor 44 to display a vehicle image 10A (see FIG. 3, etc.) showing the vehicle 10 as seen from a virtual viewpoint, based on the detection information acquired by the acquisition unit 21A. The virtual viewpoint is set in a three-dimensional virtual space with the position of the vehicle image 10A as the origin, and is defined by viewpoint coordinates and a viewpoint angle (orientation) in the virtual space. As an example, the virtual viewpoint is a viewpoint seen at a specific viewpoint angle from specific viewpoint coordinates above the vehicle image 10A in the virtual space. The control unit 21C is an example of a "control unit" in the present disclosure.

[0033] 2 is a flowchart showing the flow of the identification process executed by the meter ECU 20. The CPU 21 reads the display control program 24A from the storage 24, loads it into the RAM 23, and executes it, thereby performing the identification process. As an example, the identification process is automatically and repeatedly performed at regular intervals.

[0034] 2, the CPU 21 acquires detection information that can be detected by the vehicle 10. Then, the CPU 21 proceeds to step S11.

[0035] In step S11, the CPU 21 displays various images on the monitor 44 based on the detection information acquired in step S10. The various images include a vehicle image 10A, an other vehicle image 10B (see FIG. 3, etc.) showing another vehicle preceding the vehicle 10, and a road image 74 (see FIG. 3, etc.) showing the road on which the vehicle 10 and the other vehicle are traveling. Specific examples of the various images will be described later. Then, the CPU 21 proceeds to step S12. The other vehicle image 10B and the road image 74 are examples of the "periphery image" of the present disclosure.

[0036] In step S12, the CPU 21 determines whether a change condition for changing the state of the vehicle image 10A is met. If the CPU 21 determines that the change condition is met (step S12: YES), the process proceeds to step S13. On the other hand, if the CPU 21 determines that the change condition is not met (step S12: NO), the process proceeds to step S14. As an example, the change condition is met when a decrease in the detection accuracy of the rear sensor is identified, when a decrease in the detection accuracy of the front camera is identified, when damage to the door mirror is identified, or when specific dangerous driving is identified.

[0037] In step S13, the CPU 21 changes the appearance of the vehicle image 10A based on the change condition established in step S12. Specific examples of how the appearance of the vehicle image 10A changes will be described later. The CPU 21 then proceeds to step S14.

[0038] In step S14, the CPU 21 updates the display content of the monitor 44 based on the detection information acquired in step S10. For example, if the speed of the vehicle 10 increases or decreases, the CPU 21 changes the numerical value indicated in vehicle speed information 72 (see FIG. 3, etc.) described later that is displayed on the monitor 44, or if the vehicle 10 approaches another vehicle, the CPU 21 narrows the inter-vehicle distance between the vehicle image 10A and the other vehicle image 10B on the monitor 44. Then, the CPU 21 proceeds to step S15.

[0039] In step S15, the CPU 21 determines whether a predetermined termination condition is met. If the CPU 21 determines that the termination condition is met (step S15: YES), the CPU 21 terminates the specific processing. On the other hand, if the CPU 21 determines that the termination condition is not met (step S15: NO), the CPU 21 returns to step S10. As an example, the CPU 21 determines that the termination condition is met when the ignition switch of the vehicle 10 is turned off.

[0040] Next, examples of displays on the monitor 44 will be described with reference to FIGS. 3 is a first explanatory diagram showing an example of a display displayed in the display area X of the monitor 44. The display area X is a partial area of ​​the monitor 44, and is visible to the driver seated in the driver's seat through the opening of the steering wheel. As an example, FIG. 3 shows the display content when the change condition is not satisfied.

[0041] Shift information 70 and vehicle speed information 72 are displayed in the upper part of the display area X shown in FIG.

[0042] The shift information 70 indicates the shift position of the vehicle 10. In Fig. 3, the shift information 70 is displayed as "D", indicating that the shift position is in the D range.

[0043] The vehicle speed information 72 indicates the speed of the vehicle 10. In Fig. 3, "54 km / h" is displayed as the vehicle speed information 72, indicating that the vehicle speed is 54 km / h.

[0044] 3, a road image 74 is displayed below the shift information 70 and the vehicle speed information 72. The road image 74 is an image showing the roads around the vehicle 10 shown in map data stored in an external server, the storage 24, or the like.

[0045] 3, a vehicle image 10A and another vehicle image 10B are displayed on a road image 74. In FIG.

[0046] Vehicle image 10A is an image generated based on an illustration design of vehicle 10 shown in illustration data stored in storage 24. As an example, vehicle 10 is traveling in the center lane of a road with three lanes in each direction. Therefore, in FIG. 3, vehicle image 10A is displayed in the center lane of the road shown in road image 74 from the viewpoint seen from the virtual viewpoint.

[0047] In vehicle image 10A, the open / closed states of the door mirrors identified from the detection information are reflected in mirror portions 15 that represent the door mirrors. As an example, CPU 21 identifies whether each door mirror is open or closed based on images captured by side cameras mounted on the left and right door mirrors. Here, it is assumed that the left and right door mirrors are open. Therefore, in vehicle image 10A, left mirror portion 15A representing the left door mirror and right mirror portion 15B representing the right door mirror are both displayed in an open state.

[0048] The other vehicle image 10B is an image generated based on an illustration design of the other vehicle shown in the illustration data stored in the storage 24. As an example, the other vehicle is a preceding vehicle traveling ahead of the vehicle 10 in the center lane of a road with three lanes in each direction. Therefore, in FIG. 3, the other vehicle image 10B is displayed above the vehicle image 10A in the drawing, from a viewpoint seen from the virtual viewpoint, in the center lane of the road shown in the road image 74.

[0049] Fig. 4 is a second explanatory diagram showing an example of a display displayed in the display area X of the monitor 44. As an example, Fig. 4 shows a first specific example in which the state of the vehicle image 10A changes.

[0050] 4 displays a vehicle image 10A, shift information 70, vehicle speed information 72, a road image 74, and an unknown target image 84. Of the above information, the display manner of the vehicle image 10A, excluding the unknown target image 84, is the same as in FIG. 3, and therefore description thereof will be omitted. The unknown target image 84 will be described later.

[0051] FIG. 4 shows a case where the change condition is met based on the CPU 21 identifying a decrease in the detection accuracy of the rear sensor and the front camera. The rear sensors are assumed to be provided on the left and right sides of the rear bumper. The front camera is assumed to be attached to the license plate, front grille, front bumper, or the like. The CPU 21 identifies a decrease in the detection accuracy of the rear sensor or the front camera when it detects, using a known method, that mud, water droplets, snow, ice, or the like has adhered to the rear sensor or the front camera. Here, it is assumed that a decrease in the detection accuracy of the rear sensor provided on the right side of the rear bumper (hereinafter referred to as the "right rear sensor") and the front camera has been identified.

[0052] In the above case, the CPU 21 changes the appearance of the portions of the vehicle image 10A corresponding to the right rear sensor and the front camera with reduced detection accuracy. For example, in the vehicle image 10A shown in Fig. 4, a dirt mark 80 indicating dirt is added to a certain area indicating the right side of the rear bumper in the vehicle image 10A, which corresponds to the right rear sensor. In addition, in the vehicle image 10A shown in Fig. 4, a fogging mark 82 indicating fogging of the lens is added to the front end of the vehicle body shown in the vehicle image 10A, which corresponds to the front camera.

[0053] Here, the unknown target image 84 is an image displayed when the CPU 21 is unable to identify the type of target (e.g., vehicle type, such as a motorcycle, a passenger car, or a cargo vehicle) based on the detection information. As an example, the CPU 21 identifies the type of target present in front of the vehicle 10 based on an image captured by the front camera included in the detection information. At this time, if the lens of the front camera becomes foggy, the detection accuracy of the front camera decreases, and as a result, the image captured by the front camera becomes unclear. If the image captured by the front camera becomes unclear, the CPU 21 may not be able to identify the type of target present in front of the vehicle 10. In this case, the CPU 21 displays an unknown target image 84 as shown in FIG. 4 above the vehicle image 10A in place of the other vehicle image 10B shown in FIG. 3.

[0054] Fig. 5 is a third explanatory diagram showing a display example displayed in the display area X of the monitor 44. As an example, Fig. 5 shows a second specific example in which the state of the vehicle image 10A changes.

[0055] 5 displays a vehicle image 10A, another vehicle image 10B, shift information 70, vehicle speed information 72, and a road image 74. Of the above information, the display modes other than the vehicle image 10A are the same as those in FIG. 3, and therefore will not be described.

[0056] FIG. 5 shows a case where the change condition is established based on the CPU 21 identifying damage to the left door mirror from the detection information. As an example, when the CPU 21 is unable to acquire an image captured by the side camera mounted on each door mirror, the CPU 21 identifies the door mirror from which the image cannot be acquired as damaged. Here, it is assumed that the left door mirror is detached, and the loss of the left door mirror is identified as damage to the door mirror. Also, FIG. 5 shows that the right door mirror is closed by the operation of the driver, who is an occupant of the vehicle 10.

[0057] Due to the above-mentioned state, the vehicle image 10A shown in FIG. 5 differs from the vehicle image 10A shown in FIG. 3 in that the left mirror portion 15A is erased and the right mirror portion 15B is closed.

[0058] Fig. 6 is a fourth explanatory diagram showing a display example displayed in the display area X of the monitor 44. As an example, Fig. 6 shows a third specific example in which the state of the vehicle image 10A changes.

[0059] 6 displays a vehicle image 10A, another vehicle image 10B, shift information 70, vehicle speed information 72, and a road image 74. Of the above information, the display modes other than the vehicle image 10A are the same as those in FIG. 3, and therefore will not be described.

[0060] 6 shows a case where the change condition is established based on the CPU 21 identifying that specific dangerous driving has been performed. The specific dangerous driving is sudden acceleration, sudden braking, sudden steering, etc. As an example, the CPU 21 identifies whether specific dangerous driving has been performed based on the detection results of the vehicle speed sensor, acceleration sensor, and steering angle sensor included in the sensor group 42. Here, it is assumed that sudden steering has been performed.

[0061] In the above case, CPU 21 adds damage information 90 to vehicle image 10A, which indicates that vehicle 10 may be damaged by a particular dangerous driving. For example, vehicle image 10A shown in Fig. 6 has damage information 90 with a design resembling a bandage added to a portion of vehicle image 10A that indicates the roof.

[0062] As described above, in the meter ECU 20, the CPU 21, as a function of the control unit 21C, causes the monitor 44 to display the vehicle image 10A and the other vehicle image 10B and the road image 74 as seen from a virtual viewpoint based on the detection information. Then, the CPU 21, as a function of the control unit 21C, changes the appearance of the vehicle image 10A in accordance with the acquired detection information. This allows the meter ECU 20 to easily allow the driver to grasp the situation of the vehicle 10 based on the vehicle image 10A.

[0063] Furthermore, in the meter ECU 20, the CPU 21, as a function of the control unit 21C, when a decrease in the detection accuracy of the rear sensor and the front camera is identified from the detection information, changes the state of the portion of the vehicle image 10A corresponding to the rear sensor and the front camera whose detection accuracy has decreased. This allows the meter ECU 20 to let the driver know which sensor or which camera included in the sensor group 42 is malfunctioning and the cause of the malfunction, based on the vehicle image 10A.

[0064] Furthermore, in the meter ECU 20, the CPU 21, as a function of the control unit 21C, reflects the open / closed states of the door mirrors of the vehicle 10 identified from the detection information in the portions (left mirror portion 15A and right mirror portion 15B) corresponding to the door mirrors in the vehicle image 10A. This allows the meter ECU 20 to allow the driver to know the open / closed states of the door mirrors from the display contents of the monitor 44.

[0065] Furthermore, in the meter ECU 20, the CPU 21, as a function of the control unit 21C, when damage to the door mirrors of the vehicle 10 is identified from the detection information, damages the portions (left mirror portion 15A and right mirror portion 15B) corresponding to the damaged door mirrors in the vehicle image 10A. This allows the meter ECU 20 to allow the driver to understand the damage status of the door mirrors from the display content of the monitor 44.

[0066] Furthermore, in the meter ECU 20, the CPU 21, as a function of the control unit 21C, adds damage information 90 indicating that the vehicle 10 may be damaged to the vehicle image 10A when it is determined from the detection information that the driver of the vehicle 10 has engaged in specific dangerous driving. This allows the meter ECU 20 to make the driver understand from the display content on the monitor 44 that the vehicle 10 may be damaged by his or her own driving operation.

[0067] (others) Although the embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modifications or alterations within the scope of the technical idea described in the claims, and it is understood that these modifications or alterations also naturally fall within the technical scope of the present disclosure.

[0068] Furthermore, the effects described in the above embodiments are explanatory or exemplary and are not limited to those described in the above embodiments. In other words, the technology according to the present disclosure may achieve other effects that are obvious to a person skilled in the art of the present disclosure from the description in the above embodiments, in addition to or instead of the effects described in the above embodiments.

[0069] The processes described in the above embodiments can also be realized by dedicated hardware circuits, in which case they may be executed by a single piece of hardware or by multiple pieces of hardware.

[0070] In the above embodiment, the display control program 24A is stored in the storage 24. However, this is not limitative, and the display control program 24A may be stored in the ROM 22.

[0071] In the above embodiment, the rear sensor and the front camera are examples of the "detection unit" of the present disclosure, but the example of the "detection unit" is not limited to this. Each of the sensors included in the sensor group 42 for detecting the state of the vehicle 10 and the surrounding conditions of the vehicle 10, and each of the cameras for capturing images of the surroundings of the vehicle 10 can also be an example of the "detection unit."

[0072] In the above embodiment, the door mirror is an example of the "opening / closing part" of the present disclosure, but the example of the "opening / closing part" is not limited to this as long as the open / closed state can be identified from the detection information. For example, the door and rear gate of the vehicle 10 may be an example of the "opening / closing part."

[0073] In the above embodiment, a door mirror is an example of a "part" in the present disclosure, but the example of the "part" is not limited to this, as long as damage can be identified from the detection information. For example, a tire of the vehicle 10 may be an example of a "part." In addition, in the above embodiment, a missing part is identified as "damage to the part," but the damage is not limited to this. The damage includes not only missing parts but also scratches on the part. If scratches on the part are identified as "damage to the part" from the detection information, an image (mark) indicating the damage may be added to a portion of the vehicle image 10A corresponding to the damaged part. In this case, multiple marks indicating damage may be prepared, and the CPU 21 may add a mark to the vehicle image 10A according to the type of damage identified from the detection information.

[0074] In the above embodiment, the appearance of the dirt mark 80 is not limited to that shown in FIG. 4 . For example, dirt marks 80 of various appearances corresponding to a plurality of dirt states may be prepared in advance, and the CPU 21 may add, to the vehicle image 10A, a dirt mark 80 of a appearance corresponding to the dirt state estimated from the detection information. For example, when the weather around the vehicle 10 is rainy, the CPU 21 may add, to the vehicle image 10A, a dirt mark 80 with a design showing water droplets. When the weather around the vehicle 10 is snowy, the CPU 21 may add, to the vehicle image 10A, a dirt mark 80 with a design showing snowflakes. When the outside air temperature around the vehicle 10 is equal to or lower than a predetermined value, the CPU 21 may add, to the vehicle image 10A, a dirt mark 80 with a design showing ice. As described above, adding, to the vehicle image 10A, a dirt mark 80 of a appearance corresponding to the dirt state estimated from the detection information allows the driver to understand the dirt state of the detection unit whose detection accuracy has decreased and to take appropriate measures according to the dirt state.

[0075] In the above embodiment, the form of the damage information 90 is not limited to that shown in Fig. 6. For example, damage information 90 in forms corresponding to a plurality of specific dangerous driving situations may be prepared in advance, and the CPU 21 may add the damage information 90 in a form corresponding to the specific dangerous driving situation identified from the detection information to the vehicle image 10A.

[0076] In the above embodiment, sudden acceleration, sudden braking, and sudden steering are examples of "specific dangerous driving" in the present disclosure, but examples of "specific dangerous driving" are not limited to these as long as they can be identified from detection information. For example, the CPU 21 may identify that specific dangerous driving has been performed when a specific driving assistance function such as an Emergency Driving Stop System (EDSS) and a Lane Departure Alert (LDA) is executed.

[0077] In the above embodiment, the monitor 44, which is a meter display, is an example of a "display unit" of the present disclosure, but the "display unit" is not limited to a meter display. For example, the "display unit" may be another display such as a center display or a head-up display (HUD). Furthermore, the "display unit" may be a combination of multiple displays such as a meter display and a center display.

[0078] In the above embodiment, the meter ECU 20 executes the specific processing shown in Fig. 2. However, the present invention is not limited to this, and the specific processing may be executed by the meter ECU 20 in cooperation with another ECU.

[0079] In the above embodiment, the specific process executed by the CPU 21 after reading the software (program) may be executed by various processors other than a CPU. Examples of such processors include programmable logic devices (PLDs) (such as field-programmable gate arrays (FPGAs)) whose circuit configuration can be changed after fabrication, and dedicated electrical circuits such as application-specific integrated circuits (ASICs) that are processors with circuit configurations specifically designed to execute specific processes. The specific process may be executed by one of these processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0080] In the above embodiment, the display control program 24A is pre-stored (installed) in the storage 24, but this is not limiting. The display control program 24A may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The display control program 24A may also be downloaded from an external device via a network. The technology disclosed herein may also be applied to programs and program products. [Explanation of symbols]

[0081] 10 vehicles 10A vehicle image 10B Other vehicle images (surrounding images) 20 Meter ECU (display control unit) 21C Control Unit 44 Monitor (display) 74 Road images (surrounding images) 90 Injury Information

Claims

1. a control unit that displays, on a display unit, a surrounding image showing the surrounding conditions of the vehicle as seen from a virtual viewpoint and a vehicle image showing the vehicle based on detection information that can be detected by the vehicle, and changes the appearance of the vehicle image in accordance with the acquired detection information; Display control device.

2. When a decrease in detection accuracy of a detection unit is identified from the detection information, the control unit changes a state of a portion of the vehicle image corresponding to the detection unit whose detection accuracy has decreased. The display control device according to claim 1 .

3. the control unit reflects the open / closed state of the opening / closing part of the vehicle identified from the detection information in a portion of the vehicle image corresponding to the opening / closing part. The display control device according to claim 1 .

4. when damage to a part of the vehicle is identified from the detection information, the control unit damages a part of the vehicle image corresponding to the damaged part of the vehicle. The display control device according to claim 1 .

5. When it is determined from the detection information that a specific dangerous driving has been performed by an occupant of the vehicle, the control unit adds damage information indicating that the vehicle may be damaged to the vehicle image. The display control device according to claim 1 .

Citation Information

Patent Citations

  • Vehicle control device, vehicle control method, and program

    JP7048398B2