Display control device and display control program product

Abstract

The present application relates to a display control device and a display control program product. The display control device of the present application performs control to display an image indicating a surrounding situation of a first vehicle on a display section, and performs control to display a first vehicle image simulating the first vehicle and a second vehicle image simulating a second vehicle located in the surroundings of the first vehicle on the display section in an orientation corresponding to a first direction in which a travel lane on which the first vehicle travels extends, and sets the second vehicle image to be non-displayed when the speed of the second vehicle in a second direction intersecting the first direction is equal to or greater than a threshold value.

Description

Technical Field

[0001] This invention relates to a display control device and a display control program product. Background Technology

[0002] Japanese Patent Application Publication No. 2022-066952 discloses a display device that displays the vehicle and other vehicles traveling in the driving lane together with the driving lane on an information display screen. Summary of the Invention

[0003] Sometimes, images of other vehicles detected by this vehicle are simulated and displayed on the display unit in an orientation corresponding to the direction of the vehicle's driving lane. This is to reduce computational costs, for example, by omitting the processing of calculating the orientation of other vehicles. In this case, the direction of travel of the other vehicle images displayed on the display unit may be significantly different from the orientation of the other vehicle images. In such cases, the vehicle occupants may experience discomfort.

[0004] The present invention was made in view of the above circumstances, and its object is to provide a display control device and display control program product that can suppress discomfort of vehicle occupants.

[0005] The first type of display control device controls the display of an image representing the surrounding conditions of a first vehicle on a display unit. The display control device includes a display control unit, which controls the display of a first vehicle image simulating the first vehicle and a second vehicle image simulating a second vehicle located around the first vehicle on the display unit in an orientation corresponding to a first direction extending from the driving lane in which the first vehicle is traveling. Furthermore, the display control unit sets the second vehicle image to not be displayed when the speed of the second vehicle in a second direction intersecting the first direction is above a threshold.

[0006] According to the display control device of the first method, the simulated image of a second vehicle, which is a second vehicle whose speed in a second direction intersecting the first direction is above a threshold, is set to not be displayed. This suppresses the display of vehicles whose direction of travel differs from the orientation of the display, thereby reducing discomfort for vehicle occupants.

[0007] Regarding the second type of display control device, in the first type of display control device, when the first vehicle is stopped at a position within a predetermined distance from the intersection, and within a predetermined range in front of the first vehicle, the speed of the second vehicle along the second direction is above a threshold, the display control unit sets the image of the second vehicle to not be displayed.

[0008] According to the display control device of the second method, when the first vehicle stops at a position within a predetermined distance from the intersection, the image of a second vehicle simulating a second vehicle whose speed in the second direction within a predetermined range in front of the first vehicle is above a threshold is set to not be displayed. Thus, it is possible to set the image of a vehicle simulating a vehicle crossing the intersection to not be displayed.

[0009] The third type of display control program product contains a display control program that enables a computer to perform a process of controlling the display of an image representing the surrounding conditions of a first vehicle on a display unit. The display control program controls the display of a first vehicle image simulating the first vehicle and a second vehicle image simulating a second vehicle located around the first vehicle on the display unit in an orientation corresponding to a first direction extending from the lane in which the first vehicle is traveling. Furthermore, the display control program sets the second vehicle image to not be displayed if the speed of the second vehicle in a second direction intersecting the first direction is above a threshold.

[0010] According to the present invention, it is possible to suppress discomfort among vehicle occupants. Attached Figure Description

[0011] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, in which the same reference numerals denote the same elements, and wherein:

[0012] Figure 1 This is a block diagram illustrating an example of a vehicle's structure.

[0013] Figure 2 This is a block diagram illustrating an example of the functional structure of an instrument ECU.

[0014] Figure 3 This is an example of a display screen.

[0015] Figure 4 This is a diagram used to illustrate other vehicles that are not displayed.

[0016] Figure 5 This is a flowchart illustrating an example of display control processing. Detailed Implementation

[0017] Hereinafter, with reference to the accompanying drawings, examples of embodiments for carrying out the present invention will be described in detail.

[0018] First, refer to Figure 1 The vehicle 10 involved in this embodiment will be described. Figure 1 This is a block diagram representing the hardware structure of vehicle 10. For example... Figure 1As shown, vehicle 10 includes an Electronic Control Unit (ECU) 20. Vehicle 10 is an example of a "first vehicle" in this invention, and the ECU 20 is an example of a "display control device" in this invention. Furthermore, the ECU 20 is an example of a "computer" in this invention.

[0019] The instrument cluster ECU 20 comprises a central processing unit (CPU) 21, a read-only memory (ROM) 22, a random access memory (RAM) 23, a storage device 24, an in-vehicle communication interface (I / F) 25, an input / output interface (I / F) 26, and a wireless communication interface (I / F) 27. These components are communicatively connected to each other via an internal bus 28.

[0020] CPU 21 is the central processing unit, executing various programs or controlling various parts. That is, CPU 21 reads the program from ROM 22 or storage device 24 and uses RAM 23 as the working area to execute the program. CPU 21 performs control and various arithmetic operations of the above-mentioned structures according to the program recorded in ROM 22 or storage device 24.

[0021] ROM22 stores various programs and data. RAM23 serves as a temporary storage area for programs or data.

[0022] Storage device 24 is composed of storage media such as embedded Multi Media Card (eMMC) or Universal Flash Storage (UFS) to store various programs and data. Storage device 24 stores display control program 24A. Display control program 24A is used to cause CPU 21 to execute the display control processing described later (see reference). Figure 5 (The program).

[0023] The in-vehicle communication I / F25 is an interface for connecting with other ECUs 30, using a communication standard based on the Controller Area Network (CAN) protocol. The in-vehicle communication I / F25 connects to the external bus 29. Furthermore, although not illustrated, the ECU is not limited to ECU 30; multiple ECUs may be present depending on the various functions within the vehicle 10.

[0024] The input / output I / F26 is an interface used to communicate with the on-board equipment 40 mounted on the vehicle 10.

[0025] The vehicle-mounted equipment 40 refers to various devices mounted on the vehicle 10. As an example of the vehicle-mounted equipment 40, the vehicle 10 includes a sensor group 42 and a display 44.

[0026] The sensor group 42 is configured to include various sensors and camera devices for detecting the state of the vehicle 10 and the surrounding conditions of the vehicle 10. Specifically, the sensor group 42 includes, for example, various sensors such as 3D-LiDAR sensors, millimeter-wave sensors, infrared sensors, turn signal sensors, accelerator pedal position sensors, vehicle speed sensors, steering angle sensors, angular velocity sensors, Global Positioning System (GPS) sensors, illuminance sensors, gyroscope sensors, and acceleration sensors, as well as multiple cameras for capturing images of the surroundings of the vehicle 10. The sensor group 42 outputs the detection results of each sensor and the video images captured by each camera to the designated electronic control units such as the instrument cluster ECU 20 and ECU 30.

[0027] Display 44 is disposed on the dashboard located in front of the driver's seat of vehicle 10, and is an instrument display screen for displaying suggestions on actions related to the functions of vehicle 10 and images related to explanations of those functions. Display 44 is an example of a "display unit" in this invention.

[0028] The I / F27 wireless communication module is used for communicating with external devices. This wireless communication module uses communication standards such as 5G, LTE, Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0029] refer to Figure 2 The functional structure of the instrument ECU20 involved in this embodiment will be described. For example... Figure 2 As shown, the instrument ECU 20 includes an acquisition unit 60 and a display control unit 62. The CPU 21 executes a display control program 24A, which functions as both the acquisition unit 60 and the display control unit 62. The display control program 24A is an example of a display control program recorded in the "Display Control Program Product" of this invention.

[0030] The acquisition unit 60 acquires various types of information available in the vehicle 10. Specifically, as various types of information, the acquisition unit 60 acquires detection information such as detection results detected by various sensors constituting the sensor group 42 and video images captured by each camera.

[0031] The display control unit 62 performs display control related to the display on the monitor 44. For example, as part of this display control, the display control unit 62 controls the display of an image showing the surrounding conditions of the vehicle 10 as viewed from a virtual viewpoint on the monitor 44 based on the detection information acquired by the acquisition unit 60. Here, "virtual viewpoint" refers to a viewpoint set in a three-dimensional virtual space with the position of the vehicle 10 as the origin. This virtual viewpoint is defined by specified viewpoint coordinates and viewpoint angle (orientation) in the virtual space. As an example, this virtual viewpoint is a viewpoint that overlooks the vehicle 10 and its surroundings from a specific viewpoint coordinate located above and behind the vehicle 10 in the virtual space at a specific viewpoint angle.

[0032] Specifically, as an example, such as Figure 3 As shown, the display control unit 62 performs the following control: based on the detection information acquired by the acquisition unit 60, it displays on the display 44 a vehicle image A1 simulating the vehicle 10 (which is the vehicle itself), a vehicle image A2 simulating other vehicles located around the vehicle 10, a road surface image A4 simulating the road surface of the lane in which the vehicle 10 travels, and a dividing line image A5 simulating the dividing lines that divide the driving lane. The vehicle image A1 is an example of the "first vehicle image" in this invention. Figure 3 This diagram illustrates a display example of a defined display area shown on the display 44. This defined display area is a portion of the display 44 and is configured so that the driver, seated in the driver's seat, can visually identify it through the opening in the steering wheel. Other vehicles located around the vehicle 10 (e.g., within the detection range of the various sensors constituting the sensor group 42 or within a predetermined distance centered on the vehicle 10) and detected by the various sensors constituting the sensor group 42 are examples of "second vehicles" in this invention, and the vehicle image A2 simulating other vehicles is an example of "second vehicle image" in this invention. Vehicle image A2, road surface image A4, and dividing line image A5 are examples of images representing the surrounding conditions of the vehicle 10. Figure 3 The image shows an example of a vehicle image A2 that simulates other vehicles located to the left front of vehicle 10 and other vehicles located to the front front of vehicle 10.

[0033] The display control unit 62 controls the display of vehicle image A1 and vehicle image A2 on the display 44 in an orientation corresponding to the first direction of the driving lane. Specifically, the display control unit 62 controls the display of vehicle image A1 and vehicle image A2 on the display 44 in an orientation where the front-rear direction of vehicle image A1 and vehicle image A2 is the same as the first direction. The first direction can also be referred to as the direction of travel of vehicle 10.

[0034] Here, as an example, such as Figure 4 As shown, the example is when vehicle 10 is stopped within a specified distance from the intersection and other vehicles 11 cross the intersection. Figure 4 The top side represents the actual scene, and the bottom side represents the display on monitor 44. Figure 4 For ease of explanation, both the actual scene and the display on monitor 44 are shown in a top-down view from above the vehicle 10. Furthermore, Figure 4 Vehicle image A2 is an image simulating other vehicles 11. Furthermore, in Figure 4 In the display, the "t", "t+1", and "t+2" marked inside the images of other vehicles 11 and vehicle image A2 indicate the displayed frame and, in real-world scenarios, the driving position. Specifically, other vehicles 11 marked with "t" are displayed on the display 44 as vehicle image A2 marked with "t" inside the t-th frame. Similarly, other vehicles 11 marked with "t+1" are displayed on the display 44 as vehicle image A2 marked with "t+1" inside the t+1-th frame. Furthermore, other vehicles 11 marked with "t+2" are displayed on the display 44 as vehicle image A2 marked with "t+2" inside the t+2-th frame.

[0035] In this situation, the orientation of the vehicle image A2 displayed on the display 44 is significantly different from the direction of travel, causing discomfort to the vehicle occupants. Therefore, if the speed of another vehicle 11 in the second direction, which intersects the first direction, exceeds a threshold, the display control unit 62 sets the vehicle image A2 simulating that other vehicle 11 to not be displayed. Here, "intersection" refers to orthogonality within a permissible error range. Furthermore, the threshold in this case is preset through experiments, etc. In this embodiment, if the vehicle 10 is stopped within a predetermined distance from the intersection, and within a predetermined range in front of the vehicle 10, the speed of another vehicle 11 in the second direction exceeds the threshold, the display control unit 62 sets the vehicle image A2 to not be displayed. The predetermined range in this case is set to at least include the area of ​​the intersection.

[0036] refer to Figure 5 The function of the instrument ECU 20 in this embodiment will be explained. It is executed by the CPU 21 executing the display control program 24A. Figure 5 The display control process is shown below. As an example, the display control process is executed repeatedly at time intervals corresponding to the frame rate.

[0037] exist Figure 5In step S10, the acquisition unit 60 acquires detection information such as detection results detected by various sensors constituting the sensor group 42 and video images captured by each camera. In step S12, the display control unit 62 controls the display of the vehicle image A1, the road surface image A4, and the dividing line image A5 on the display 44 based on the detection information acquired in step S10.

[0038] In step S14, the display control unit 62 determines whether vehicle 10 is stopped within a specified distance from the intersection. If the determination is positive, the process proceeds to step S16. Each of the other vehicles 11 is treated as a processing target, and the processing in steps S16 and S18 is performed.

[0039] In step S16, the display control unit 62 determines whether the speed of other vehicles 11 along the second direction is above a threshold based on the detection information obtained in step S10. If the determination is negative, the process proceeds to step S18. For example, the speed of other vehicles 11 can be calculated by calculating the distance traveled by other vehicles 11 along the second direction based on the detection information obtained in step S10 of the current frame and the detection information obtained in step S10 of the previous frame, and then dividing that distance by a time interval equivalent to one frame.

[0040] In step S18, the display control unit 62 controls the display of the simulated vehicle image A2 of other vehicles 11 on the display 44. If the processing of step S18 ends, the processing returns to step S10. If the determination in step S16 is positive, the processing of step S18 is not executed, and the processing returns to step S10. That is, in this case, the display control unit 62 sets the simulated vehicle image A2 of other vehicles 11 with a speed of more than a threshold along the second direction to not be displayed.

[0041] If the determination in step S14 is negative, the process proceeds to step S20. In step S20, the display control unit 62 controls the display of the simulated vehicle image A2 of other vehicles 11 on the display 44. If the process in step S20 ends, the process returns to step S10.

[0042] As explained above, according to this embodiment, the vehicle image A2 simulating other vehicles 11 with speeds exceeding a threshold along the second direction is set to not be displayed. This suppresses the display of vehicle images A2 whose direction of travel differs from the displayed orientation, thereby reducing discomfort for the occupants of vehicle 10. Furthermore, the vehicle image A2 simulating other vehicles 11 crossing the intersection can be set to not be displayed.

[0043] Furthermore, in the above embodiment, regardless of whether vehicle 10 is stopped within a predetermined distance from the intersection, if the speed of other vehicles 11 along the second direction is above a threshold, the display control unit 62 can set the vehicle image A2 to not be displayed. In this case, this step can be omitted. Figure 5 Steps S14 and S20 in the process.

[0044] Furthermore, the specific processing described above, which is executed by the CPU 21 reading the software (program), can also be performed by various processors other than the CPU. Examples of processors in this case include field-programmable gate arrays (FPGAs) and programmable logic devices (PLDs) whose circuit structure can be changed after manufacturing, and application-specific integrated circuits (ASICs) and other processors with circuit structures specifically designed for performing specific processing, i.e., dedicated circuits. Furthermore, the specific processing can be performed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is a circuit composed of circuit elements such as semiconductor elements.

[0045] Furthermore, while the above embodiment describes the display control program 24A being pre-stored (installed) in the storage device 24, it is not a limitation. The display control program 24A can be provided on recording media such as a compact disk read-only memory (CD-ROM), a digital universal read-only memory (DVD-ROM), or a universal serial bus (USB) memory. The display control program 24A can also be downloaded from an external device via a network. Additionally, the technology of this invention can also be applied to programs and program products.

[0046] The vehicle 10 described above is an example of the embodiments. Of course, it can be implemented in various ways without departing from the spirit of the present invention.

Claims

1. A display control device that controls the display of an image showing the surrounding conditions of a first vehicle on a display unit, characterized in that, Including the display control unit, The display control unit performs the following control: displays a first vehicle image simulating the first vehicle and a second vehicle image simulating a second vehicle located around the first vehicle on the display unit in an orientation corresponding to a first direction extending from the driving lane of the first vehicle, and When the speed of the second vehicle in the second direction, which intersects the first direction, is above a threshold, the display control unit sets the image of the second vehicle to not be displayed.

2. The display control device according to claim 1, characterized in that, If the first vehicle is stopped at a position within a specified distance from the intersection, and within a specified range in front of the first vehicle, the speed of the second vehicle in the second direction is above a threshold, the display control unit sets the image of the second vehicle to not be displayed.

3. A display control program product, wherein a display control program is recorded, the display control program being used to cause a computer to perform a control process for displaying an image representing the surrounding conditions of a first vehicle on a display unit, the display control program product being characterized in that... The control is performed as follows: a first vehicle image simulating the first vehicle and a second vehicle image simulating a second vehicle located around the first vehicle are displayed on the display unit in an orientation corresponding to a first direction extending from the driving lane of the first vehicle. If the speed of the second vehicle along the second direction intersecting the first direction is above a threshold, the image of the second vehicle is set to not be displayed.

Images