Display control device

The display control device shows the vehicle's image and emergency vehicle information on the display unit, and determines the recommended action based on road conditions. This solves the problem of drivers being unsure of what to do when an emergency vehicle approaches, and provides a reminder for safe driving.

CN121404005APending Publication Date: 2026-01-27TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510805908.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-07-24
Filing Date
2025-06-17
Publication Date
2026-01-27

AI Technical Summary

Technical Problem

Existing technologies fail to effectively prompt drivers to take action when an emergency vehicle approaches.

Method used

The display control device displays an image mimicking the vehicle itself and relevant information about emergency vehicles on the display unit, and determines the recommended action based on road conditions, prompting the driver to take the appropriate action.

Benefits of technology

It effectively prompts drivers with recommended actions for emergency vehicles, ensuring safe driving.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121404005A_ABST
    Figure CN121404005A_ABST
Patent Text Reader

Abstract

A display control device according to the present disclosure enables a driver of a host vehicle to grasp an action that should be taken for an emergency vehicle. A display control device is provided with a display control unit that causes a display unit provided in the vicinity of a driver's seat of a host vehicle to display a host vehicle image obtained by simulating the host vehicle. And displays an instruction image indicating a recommended action of the host vehicle determined on the basis of information relating to an emergency vehicle approaching the host vehicle and a road condition around the host vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a display control device. BACKGROUND

[0002] A vehicle control device capable of automatic driving that gives a passenger a sense of safety (peace of mind) is disclosed in Patent Literature 1.

[0003] PRIOR ART DOCUMENTS

[0004] Patent Literature 1: Japanese Patent No. 7048398 SUMMARY

[0005] PROBLEMS TO BE SOLVED BY THE INVENTION

[0006] In the technology related to Patent Literature 1, an image representing the host vehicle and an image representing the surrounding situation of the host vehicle, and the like are displayed on a display section (see Fig. 8 of Patent Literature 1). However, in the past, it has not been possible to give a good prompt as to how to drive in the case where an emergency vehicle (rescue vehicle) approaches.

[0007] An object of the present disclosure is to provide a display control device capable of enabling a driver of a host vehicle to grasp an action that should be taken against an emergency vehicle.

[0008] TECHNICAL SOLUTION TO THE PROBLEM

[0009] The display control device of the first aspect includes a display control section that causes a display section provided in the vicinity of a driver's seat of a host vehicle to display a host vehicle image obtained by imitating the host vehicle, and display an instruction image representing a recommended action of the host vehicle determined based on information related to an emergency vehicle approaching the host vehicle and a road situation around the host vehicle.

[0010] The display control device of the first aspect enables a driver of a host vehicle to grasp an action that should be taken against an emergency vehicle.

[0011] The display control device of the second aspect is the display control device of the first aspect, wherein the instruction image representing the recommended action determined based on at least any one of information of a position, a travel path, and an alarm of the detected emergency vehicle is displayed. According to the display control device of the second aspect, it is possible to prompt a recommended action determined according to the situation of the emergency vehicle, and enable a driver of a host vehicle to grasp an action that should be taken.

[0012] The display control device of the third aspect is the display control device of the first aspect, wherein the road situation is information of at least one of position information of a vehicle around the host vehicle and lane information related to a lane in which the host vehicle can travel. According to the display control device of the third aspect, a safe recommended action can be determined by using information related to a vehicle around the host vehicle and a lane, and a driver of the host vehicle can be informed of an action to be taken.

[0013] The display control device of the fourth aspect is the display control device of the first aspect, wherein the display control unit controls the display such that the indication image indicating at least one of a recommended path of the host vehicle and a recommended stop position of the host vehicle is displayed. According to the display control device of the fourth aspect, a recommended action can be depicted, and a driver of the host vehicle can be informed of an action to be taken.

[0014] Effects of Invention

[0015] According to the technology of the present disclosure, a recommended action of a host vehicle with respect to an emergency vehicle can be prompted. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 is a block diagram showing a hardware configuration of a vehicle.

[0017] Figure 2 is a first display example displayed on a monitor.

[0018] Figure 3 is a second display example displayed on a monitor.

[0019] Figure 4 is a third display example displayed on a monitor.

[0020] Figure 5 is a flowchart showing a flow of determination (specification) processing.

[0021] BRIEF DESCRIPTION OF DRAWINGS

[0022] 10: vehicle

[0023] 10A: host vehicle image

[0024] 11A: emergency vehicle image

[0025] 20: meter ECU (display control device)

[0026] 21B: display control unit

[0027] 44: monitor (display unit) DETAILED DESCRIPTION

[0028] Hereinafter, a vehicle 10 related to the present embodiment will be described.

[0029] Figure 1 is a block diagram showing a hardware configuration of the vehicle 10. As shown in Figure 1 , the vehicle 10 is provided with an instrument ECU (Electronic Control Unit) 20. The vehicle 10 is an example of the "vehicle" of the present disclosure, and the instrument ECU 20 is an example of the "display control device" of the present disclosure.

[0030] The instrument ECU 20 is configured to include a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage 24, an in-vehicle communication I / F (InterFace) 25, an input / output I / F 26, and a wireless communication I / F 27. The CPU 21, the ROM 22, the RAM 23, the storage 24, the in-vehicle communication I / F 25, the input / output I / F 26, and the wireless communication I / F 27 are connected via an internal bus 28 in a manner that enables them to communicate with each other.

[0031] The CPU 21 is a central arithmetic processing unit that executes various programs and controls each section. That is, the CPU 21 reads out a program from the ROM 22 or the storage 24 and executes the program using the RAM 23 as a work area. The CPU 21 performs the control of each configuration described above and various arithmetic processing in accordance with the program recorded in the ROM 22 or the storage 24.

[0032] The ROM 22 stores various programs and various data. The RAM 23 temporarily stores a program or data as a work area.

[0033] The storage 24 is configured by a storage device such as an eMMC (embedded Multi Media Card) or a UFS (Universal Flash Storage), and stores various programs and various data. The display control program 24A is stored in the storage 24. The display control program 24A is a program for causing the CPU 21 to execute the determination processing (see Figure 2 ) described later.

[0034] The in-vehicle communication I / F 25 is an interface for connecting with other ECUs 30. This interface uses a communication standard based on the CAN protocol. The in-vehicle communication I / F 25 is connected with an external bus 29. Furthermore, although not shown in the figure, a plurality of ECUs are provided for each function of the vehicle 10 in addition to the ECU 30.

[0035] The input / output I / F 26 is an interface for communicating with the in-vehicle device 40 mounted on the vehicle 10.

[0036] The in-vehicle device 40 is various devices mounted on the vehicle 10. As an example of the in-vehicle device 40, the vehicle 10 is provided with a sensor group 42 and a monitor 44.

[0037] The sensor group 42 includes, for example, a 3D-LiDAR, a millimeter wave sensor, an infrared sensor, a turn signal sensor, an accelerator (gas pedal) position sensor, a vehicle speed sensor, a steering angle sensor, an angular velocity sensor, a GPS (Global Positioning System) sensor, an illuminance (ambient light) sensor, a gyroscope sensor, an acceleration sensor, and the like for detecting the state of the vehicle 10 and the situation around the vehicle 10, and a plurality of cameras for photographing the surroundings of the vehicle 10, and the like. The sensor group 42 outputs the detection results of the respective sensors and the photographed images of the respective cameras to the instrument ECU 20, the ECU 30, and the like.

[0038] The monitor 44 is provided to an instrument panel disposed in front of the driver's seat of the vehicle 10, and is an instrument display for displaying a suggestion of work related to a function of the vehicle 10 and an image related to an explanation of the function, and the like. The monitor 44 is an example of the "display portion" of the present disclosure. Furthermore, the monitor 44 is not limited to the instrument panel disposed in front of the driver's seat, but can be in the vicinity of the driver's seat.

[0039] The wireless communication I / F 27 is a wireless communication module for communicating with an external device. The wireless communication module uses, for example, a communication standard such as 5G, LTE, Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0040] In addition, the CPU 21 of the instrument ECU 20 has a function structure of an acquisition portion 21A and a display control portion 21B. Each function structure is realized by the CPU 21 reading out and executing a display control program 24A stored in the storage 24.

[0041] The acquisition portion 21A acquires various information. For example, the acquisition portion 21A acquires, as the various information, surrounding information around the vehicle 10 that the vehicle 10 can detect. The surrounding information includes the detection results of the respective sensors constituting the sensor group 42 and the photographed images of the respective cameras, and the like.

[0042] The display control portion 21B performs display control related to the display of the monitor 44. For example, as the display control, the display control portion 21B causes, on the basis of the surrounding information acquired by the acquisition portion 21A, a self-vehicle image 10A (refer to FIG. 1) representing the vehicle 10 as viewed from a virtual viewpoint to be displayed on the monitor 44. Figure 2The virtual viewpoint is set on a three-dimensional virtual space with the position of the host vehicle image 10A as the origin, and is defined by a viewpoint coordinate on the virtual space and a viewpoint angle (orientation). As an example, the virtual viewpoint is a viewpoint observed from a specific viewpoint coordinate on the virtual space above the host vehicle image 10A at a specific viewpoint angle.

[0043] In addition, the ECU 30 decides a recommended action of the vehicle 10 based on information related to the emergency vehicle and a road condition around the host vehicle. The road condition around the host vehicle is position information of a vehicle around the host vehicle and lane information related to a lane in which the host vehicle can travel.

[0044] The display control section 21B causes the monitor 44 to display an instruction image (details will be described later) indicating the recommended action decided by the ECU 30.

[0045] Figure 2 is a view showing a first display example displayed on the monitor. As shown in Figure 2 , a host vehicle image 10A indicating the vehicle 10 is displayed. In addition, in the area X, as a surrounding image indicating a surrounding condition, a lane image 62 indicating a travel lane of the vehicle 10 and a white line image 63 indicating a white line dividing the travel lane are displayed. In addition, above the lane image 62, an image 64 indicating speed information of the vehicle 10 and an image 65 indicating a gear position of the vehicle 12 are displayed.

[0046] Here, in Figure 2 , an emergency vehicle approaching from a right lane behind the vehicle 10 moving toward the travel lane of the vehicle 10 is detected by the sensor group 42. Upon detection of the emergency vehicle, as information related to the emergency vehicle, the display control section 21B controls so that the emergency vehicle image 11A and an alarm information 70 are displayed. In addition, as information related to the emergency vehicle, a moving direction 11B of the emergency vehicle is displayed. The sensor group 42 detects an evacuation area 71 indicating a shoulder on which evacuation (avoidance of danger) is possible in a direction different from the position of the approaching emergency vehicle and the direction of a travel path of the emergency vehicle. The display control section 21B controls so that an instruction image 72 indicating a recommended action in such a manner as to evacuate to the evacuation area 71 is displayed. In Figure 2 , a recommended path indicating an evacuation route to the evacuation area 71 is displayed as the instruction image 72. Thereby, a travel route for evacuation against the emergency vehicle can be navigated. Further, not limited to the approach from behind, in the case of an approach from the front, the side, a recommended action in which collision can be avoided to evacuate is similarly prompted.

[0047] Furthermore, the instruction image 72 is not limited to indicating a recommended path for retreat to retreat area 71, as long as it contains information indicating recommended actions. Figure 3 This is a diagram showing a second display example on the monitor. For example, it can be displayed along with an alarm message indicating an emergency vehicle, such as "An emergency vehicle is approaching! Please move to a safe area to give way!" Alternatively, the retreat zone 71 can be flashed to indicate the presence of a retreat zone. Additionally, an indicator image 72 showing the recommended stopping position of the retreat zone 71 is displayed. Thus, navigation to the recommended stopping position is possible.

[0048] In addition, the example given is the recommended path or recommended stopping position for the retreat zone 71, but it is not limited to this. Figure 4 This diagram illustrates a third display example shown on a monitor. For instance, suppose the result of detecting the position information of vehicles around vehicle 10 is that other vehicles are stopped in the avoidance zone 71 and cannot avoid the obstacle. In this case, an image 12A of other vehicles is displayed in the avoidance zone 71. The ECU 30 detects the left lane adjacent to the driving lane of vehicle 10 as a lane where no other vehicles are present and the vehicle can drive. Therefore, the display control unit 21B controls the display to show an instruction image 72 indicating a recommended path to the left lane. Thus, navigation is possible for avoiding emergency vehicles.

[0049] (Control process)

[0050] Figure 5 This is a flowchart illustrating the process of determining parameters executed by the instrument ECU 20. The CPU 21 reads the display control program 24A from the memory 24, expands it in the RAM 23, and executes it, thereby performing the determination process. As an example, the determination process is performed automatically and repeatedly at regular intervals.

[0051] In step S10, CPU 21 acquires the surrounding information that vehicle 10 can detect. Then, CPU 51 proceeds to step S12.

[0052] In step S12, the CPU 21, based on the surrounding information obtained in step S10, causes the monitor 44 to display various images. These various images include the vehicle image 10A, the lane image 62 representing the road on which the vehicle 10 is traveling, etc.

[0053] In step S14, CPU21 determines whether an emergency vehicle has been detected. If it is determined that an emergency vehicle has been detected, the process proceeds to step S16. If it is determined that no emergency vehicle has been detected, this step is repeated.

[0054] In step S16, CPU21 controls the display of information related to the detected emergency vehicle.

[0055] In step S18, the ECU30 determines the recommended action of the vehicle 10 based on information related to the emergency vehicle and the road conditions around the vehicle.

[0056] In step S20, CPU 21 causes monitor 44 to display an instruction image representing the determined recommended action.

[0057] As explained above, in the instrument cluster ECU 20 (display control unit), the CPU 21 controls the display of information related to the detected emergency vehicle. Additionally, the CPU 21 causes the monitor 44 to display an instruction image indicating the determined recommended action. Thus, the instrument cluster ECU 20 enables the driver of the vehicle to understand the actions to be taken in response to an emergency vehicle.

[0058] Alternatively, the recommended action can be adjusted based on the type of emergency vehicle and the vehicle's location. For example, if the emergency vehicle is a police motorcycle, the recommended route is to avoid it without changing lanes; if the vehicle is within an intersection, the recommended route is to accelerate and leave the intersection. In this way, the recommended action can be appropriately set to correspond to the road conditions.

[0059] In the above embodiments, the monitor 44, which serves as an instrument display, is described as an example of the "display unit" of this disclosure, but the "display unit" is not limited to an instrument display. For example, an example of a "display unit" could also be a central display and other displays such as a head-up display (HUD). In addition, an example of a "display unit" could also be a combination of multiple displays such as an instrument display and a central display.

[0060] In the above embodiment, the instrument ECU20 is configured to execute. Figure 5 The determination process is shown. However, it is not limited to this; the determination process can also be performed by the instrument ECU20 in cooperation with other ECUs.

[0061] Furthermore, the determination process executed by the CPU 21 reading the software (program) in the above embodiment can also be performed by various processors other than the CPU. Examples of processors in this case include FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices) whose circuit structure can be changed after manufacturing, and ASICs (Application Specific Integrated Circuits) and other processors with circuit structures specifically designed for performing specific processes, i.e., dedicated circuits. In addition, the determination process can be performed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is a circuit composed of circuit elements such as semiconductor elements.

[0062] Furthermore, while the above embodiment describes the display control program 24A being pre-stored (installed) in the storage device 24, it is not a limitation. The display control program 24A may also be provided as a recording medium such as a CD-ROM (Compact Disk Read Only Memory), DVD-ROM (Disk Read Only Memory), or USB (Universal Serial Bus) memory. Alternatively, the display control program 24A may be downloaded from an external device via a network. Furthermore, the technology of this invention can also be applied to programs and program products.

Claims

1. A display control device, The vehicle is equipped with a display control unit that causes a display unit located around the driver's seat of the vehicle to display an image of the vehicle that mimics the vehicle, and to display an instruction image indicating the recommended actions of the vehicle based on information related to emergency vehicles approaching the vehicle and road conditions around the vehicle.

2. The display control device according to claim 1, The display control unit controls the display to show the instruction image representing the recommended action determined based on at least one of the detected emergency vehicle's location, driving path, and alarm.

3. The display control device according to claim 1, The road conditions are information from at least one of the location information of vehicles around the vehicle and lane information related to the lanes in which the vehicle can travel.

4. The display control device according to claim 1, The display control unit controls the display to show the indication image representing at least one of the recommended route and the recommended stopping position of the vehicle.