Display control device for vehicle, display method, and storage medium

Abstract

The present application relates to a display control device for a vehicle, a display method, and a storage medium, the display control device for a vehicle causing a display area that exhibits a foreground of the vehicle to display a prescribed image, including: a memory; and a processor connected to the memory, the processor acquiring a running state of the vehicle, in a case where the acquired running state is a first mode in which an object in front of the vehicle is detected to control running of the vehicle, the processor causing a first image that indicates that the running state is the first mode to be displayed in the display area at a position on a front side of the vehicle and not to overlap the object.

Description

Technical Field

[0001] This disclosure relates to display control devices, display methods, and storage media for vehicles. Background Technology

[0002] International Publication No. WO2017 / 046937 discloses a display device for a vehicle having a display area configured to overlap with the position of the vehicle's windshield.

[0003] In this vehicle display device, when the vehicle detects and follows a vehicle ahead, a display mark used to emphasize the vehicle ahead is superimposed on the vehicle ahead. Thus, occupants observing the display mark know that the vehicle is following the vehicle ahead.

[0004] However, if the display markings indicating that a vehicle is following are superimposed on the vehicle ahead, as described in International Publication No. WO2017 / 046937, it may be difficult to distinguish the vehicle ahead from the image for identification, which may cause annoyance to passengers. Summary of the Invention

[0005] This disclosure is made in view of the foregoing points, and its object is to provide a vehicle display control device, display method, and storage medium that improves the visual confirmation for occupants when controlling the vehicle's movement by notifying occupants of an object being detected in front of the vehicle in the observation display area.

[0006] The vehicle display control device according to the first aspect of this disclosure is a vehicle display control device that displays a predetermined image in a display area showing the foreground of a vehicle. It includes: an acquisition unit that acquires the driving state of the vehicle; and a display unit that, when the acquired driving state is a first mode of controlling the driving of the vehicle by detecting an object in front of the vehicle, displays a first image representing the first mode of driving state in the display area at a position in front of the vehicle that does not overlap with the object.

[0007] According to the first method, the vehicle display control device displays a predetermined image in a display area showing the foreground of the vehicle. Furthermore, the vehicle display control device acquires the vehicle's driving status, and in the case of a first mode where the acquired driving status is such that the vehicle is controlled to move by detecting an object in front of it, the display area displays a first image. This allows the occupant observing the display area to be notified that the vehicle is being controlled to move by detecting an object in front of it. Here, the first image is displayed in the display area at a position in front of the vehicle that does not overlap with any object. Therefore, since the occupant observing the display area can clearly distinguish between the object in front of the vehicle and the first image, the visual confirmation for the occupant is improved.

[0008] The vehicle display control device according to the second aspect of this disclosure is based on the structure described in the first aspect. When the obtained driving state is the second mode, the image displayed on the display area by the display unit is switched to a second image indicating that the driving state is the second mode. The second mode is a mode that can switch back to the first mode when an object is detected in front of the vehicle.

[0009] In the vehicle display control device according to the second method, when the obtained driving state is a second mode that allows switching to the first mode when an object is detected in front of the vehicle, the image displayed in the display area is switched to the second image. Thus, by notifying the occupant observing the display area that a switch to the first mode is possible when an object is detected in front of the vehicle, even when no object is present in front of the vehicle, the occupant can feel reassured.

[0010] The vehicle display control device according to the third aspect of this disclosure is based on the structure described in the first or second aspect. When the change in the vehicle's driving state is above a predetermined threshold, the display unit switches the image displayed in the display area.

[0011] In the vehicle display control device according to the third method, the image displayed in the display area is switched when the change in the vehicle's driving state exceeds a predetermined threshold. That is, image switching does not occur until the change in the driving state exceeds the predetermined threshold, and image switching occurs after the predetermined driving state has been maintained for a certain period. Therefore, since the so-called oscillation caused by frequent image switching can be prevented when the vehicle's driving state changes frequently, the visual confirmation for the occupant is improved.

[0012] The vehicle display control device according to the fourth aspect of this disclosure is based on the structure described in any one of the first to third aspects. When the vehicle is driving in a designated driving area, the display unit can switch the image displayed in the display area to the first image.

[0013] In the vehicle display control device according to the fourth method, when the vehicle is traveling in a designated driving area, the image displayed in the display area can be switched to a first image. Thus, for example, when the vehicle is traveling in a driving area where it can continuously travel based on the first mode for an extended period, switching to the first image can be achieved. Therefore, when traveling in a driving area where driving states frequently change, by not switching to the first image even when traveling in the first mode, the visual confirmation for the occupants can be improved.

[0014] The vehicle display control device according to the fifth aspect of this disclosure is based on the structure described in any one of the first to fourth aspects. When the vehicle is traveling in the first mode, if the relative speed difference between the vehicle and the object is above a predetermined threshold, the display unit does not display the first image in the display area.

[0015] In the vehicle display control device described in Method 5, when the vehicle is traveling in Mode 1, if the relative speed difference between the vehicle and the object exceeds a predetermined threshold, the first image is not displayed in the display area. Therefore, the first image is not displayed when the imagined object moves away from the vehicle within a short period and ceases to be a detection target, or when the imagined object suddenly approaches the vehicle within a short period and it becomes difficult to display an image between the object and the vehicle. As a result, since the first image is only displayed when it can be stably displayed for a certain period of time, the annoyance caused by frequent image switching is reduced, and the visual confirmation for the occupant is improved.

[0016] The vehicle display control device according to the sixth aspect of this disclosure is based on the structure described in any one of the first to fifth aspects. The first aspect is to detect a moving object in front of the vehicle and control the driving state of the vehicle in a way that follows the moving object. The display unit displays a first image in the display area between the vehicle and the moving object.

[0017] In the vehicle display control device according to the sixth method, when the vehicle is in a driving state where it is controlling the vehicle's movement by detecting a moving object in front of it and following that moving object, a first image can be displayed in the display area. Therefore, when notifying the occupant observing the display area that the vehicle is following a moving object in front of it, the visual confirmation of the occupant can be improved.

[0018] The vehicle display control device according to the seventh aspect of this disclosure is based on the structure described in any one of the first to fifth aspects. The display area is a projection surface projected by a head-up display device in front of the vehicle in the driver's seat. The display unit displays the first image between the vehicle and an object in the foreground of the vehicle that can be visually confirmed through the display area.

[0019] In the vehicle display control device according to the seventh method, the display area for showing the foreground of the vehicle is a projection surface projected by a head-up display device in front of the vehicle from the driver's seat. Furthermore, the first image is displayed between the vehicle and an object within the foreground of the vehicle, which can be visually confirmed through the display area. Therefore, since the first image is displayed in a manner consistent with the foreground observable from the driver's seat through the projection surface, the occupant in the driver's seat can observe the first image without significantly shifting their gaze.

[0020] The display method involved in the eighth aspect of this disclosure is a display method for displaying a predetermined image in a display area displaying the foreground of a vehicle, wherein the driving state of the vehicle is obtained, and if the obtained driving state is a first mode for controlling the driving of the vehicle by detecting an object in front of the vehicle, a first image representing the first mode of driving state is displayed in the display area between the vehicle and the object.

[0021] In the display method involved in the eighth method, as described above, when notifying the occupant of the observation display area that an object in front of the vehicle is being detected to control the vehicle's movement, the visual confirmation of the occupant can be improved.

[0022] The program involved in the ninth aspect of this disclosure is a program that displays a predetermined image in a display area showing the foreground of a vehicle, wherein the computer performs the following processing: obtaining the driving state of the vehicle, and if the obtained driving state is a first mode of controlling the driving of the vehicle by detecting an object in front of the vehicle, displaying a first image representing the first mode of driving state in the display area between the vehicle and the object.

[0023] According to the procedure involved in the 9th method, as described above, when the occupant in the observation display area is notified that an object is being detected in front of the vehicle to control the vehicle's movement, the visual confirmation of the occupant can be improved.

[0024] According to this disclosure, when notifying the occupants of the observation display area that an object in front of the vehicle is being detected to control the vehicle's movement, the visual confirmation of the occupants can be improved. Attached Figure Description

[0025] Exemplary embodiments of the present invention are described in detail below with reference to the accompanying drawings, wherein:

[0026] Figure 1 This is a simplified diagram of the front of the passenger compartment in a vehicle that uses the vehicle display control device according to this embodiment, viewed from the rear side of the vehicle.

[0027] Figure 2 This is a block diagram illustrating the hardware structure of the vehicle display control device according to this embodiment.

[0028] Figure 3 This is a block diagram illustrating the functional structure of the vehicle display control device according to this embodiment.

[0029] Figure 4 This is a flowchart illustrating an example of the display processing flow in this embodiment.

[0030] Figure 5 This is a diagram showing an example of the display of the first image in this embodiment.

[0031] Figure 6 This is a diagram showing an example of the display of the second image in this embodiment.

[0032] Figure 7A This is a diagram showing a display example of the first image involved in a variation of this embodiment. It is a display example of the moment when a vehicle detects a vehicle at a location where the distance L between the vehicles is a first distance L1 or more.

[0033] Figure 7B This is a diagram showing an example of a first image related to a variation of this embodiment, showing the moment when a vehicle approaches a vehicle at a location where the distance L between the two vehicles is a first distance L1 or more.

[0034] Figure 7C This is a diagram showing an example of a first image related to a variation of this embodiment, showing an example of the time when the distance L between the preceding vehicles is a first distance L1.

[0035] Figure 8 This is a simplified diagram illustrating a vehicle display device according to a variation of this embodiment. Detailed Implementation

[0036] The vehicle 12, which utilizes the vehicle display control device 10 according to the embodiment, will be described with reference to the accompanying drawings. As an example, the vehicle 12 of this embodiment is configured to switch between automatic and manual driving.

[0037] Autonomous driving refers to a vehicle's driving mode in which some or all of the operations of the accelerator, brakes, direction indicators, steering wheel, etc., are performed automatically. This includes vehicle driving assistance systems such as ACC (Adaptive Cruise Control), radar cruise control, automatic braking, and LTA (Lane Tracing Assist). Manual driving, on the other hand, is a vehicle's driving mode in which the driver performs all driving operations (operation of the accelerator, brakes, direction indicators, steering wheel, etc.).

[0038] like Figure 1 As shown, an instrument panel 14 is provided at the front of the passenger compartment in vehicle 12. The instrument panel 14 extends along the width of the vehicle, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, it is a right-hand drive vehicle with the steering wheel 16 provided on the right side, and the driver's seat is located on the right side of the vehicle.

[0039] A windshield 18 is provided at the front end of the dashboard 14. The windshield 18 is positioned on the front side of the vehicle in front of the driver's seat and extends along the vertical and width directions of the vehicle to divide the interior and exterior of the passenger compartment.

[0040] The right-side end of the windshield 18 is fixed to the right-side front pillar 20 of the vehicle. The front pillar 20 extends vertically along the vehicle, and the windshield 18 is fixed to its inner end in the vehicle width direction. Additionally, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. The left-side end of the windshield 18 is fixed to the left-side front pillar (not shown).

[0041] Here, a first display unit 24 with a display area capable of displaying a specified image is provided on the instrument panel 14. The first display unit 24 consists of an instrument display located on the right side of the instrument panel 14 in the vehicle width direction, in front of the driver's seat. The instrument display is part of an instrument display device (not shown) that is connected to various instrument devices mounted on the vehicle 12. The first display unit 24 is positioned to enter the driver's field of vision when the driver's gaze is directed forward towards the vehicle.

[0042] A second display unit 25 is provided in the windshield 18, which has a display area capable of displaying a specified image. The second display unit 25 is composed of a display that is located in the center of the instrument panel 14 in the vehicle width direction and is positioned on the front side of the vehicle in front of the driver's seat.

[0043] A third display unit 26 with a display area capable of displaying a specified image is provided on the windshield 18. The third display unit 26 is located on the vehicle-top side of the first display unit 24 and is connected to the head-up display device 44 (see reference). Figure 2 The projection surface is formed by the head-up display device 44. Specifically, a head-up display device 44 is provided on the front side of the vehicle, which is closer to the instrument panel 14, and the head-up display device 44 is configured to project images onto the third display section 26 of the front window glass 18. That is, the third display section 26 is formed by the front window glass 18, which serves as the projection surface of the head-up display device 44.

[0044] (Hardware structure of vehicle display control device 10)

[0045] The vehicle 12 is equipped with an ECU (Electronic Control Unit) 28 as a control unit. Figure 2 This is a block diagram showing the hardware structure of the vehicle display control device 10. (As shown...) Figure 2As shown, the ECU28 of the vehicle display control device 10 is configured to include a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a memory 36, a communication interface 38, and an input / output interface 40. These components are connected via a bus 42 to communicate with each other. The CPU 30 is an example of a processor, and the RAM 34 is an example of a memory.

[0046] CPU 30 is the central processing unit, which executes various programs and controls other components. Specifically, CPU 30 reads programs from ROM 32 or memory 36 and uses RAM 34 as its working area to execute the programs. CPU 30 performs control of the aforementioned structures and various arithmetic operations based on the programs recorded in ROM 32 or memory 36.

[0047] ROM 32 stores various programs and data. RAM 34 serves as a working area to temporarily store programs or data. Storage 36 is composed of HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs, including the operating system, and various data. In this embodiment, ROM 32 or storage 36 stores programs and various data used for display processing.

[0048] Communication interface 38 is an interface for the vehicle display control device 10 to communicate with a server and other devices not shown, such as Ethernet (registered trademark), LTE, FDDI, Wi-Fi (registered trademark) and other standards.

[0049] The input / output interface 40 is connected to a first display unit 24, a second display unit 25, a head-up display device 44 that projects a predetermined image onto a third display unit 26, an actuator 46, and an external sensor 48. The actuator 46 is configured to include a steering wheel actuator, an accelerator actuator, and a brake actuator. The steering wheel actuator controls the steering of the vehicle 12. The accelerator actuator accelerates the vehicle 12. The brake actuator decelerates the vehicle 12 by controlling the brakes. In addition, the input / output interface 40 is also connected to a camera (not shown) that captures images inside the vehicle 12, sensors for enabling the vehicle 12 to drive automatically, and a GPS (Global Positioning System) device for obtaining the vehicle 12's location information.

[0050] (Functional structure of vehicle display control device 10)

[0051] The vehicle display control device 10 uses the aforementioned hardware resources to implement various functions. (Refer to...) Figure 3 The functional structure of the vehicle display control device 10 is explained.

[0052] like Figure 3 As shown, the vehicle display control device 10 is configured with a functional structure including a communication unit 50, an acquisition unit 51, an automatic driving control unit 52, and a display unit 54. Each functional structure is implemented by the CPU 30 reading and executing a program stored in the ROM 32 or the memory 36.

[0053] The communication unit 50 transmits and receives data with external servers and other devices via the communication interface 38. For example, it transmits and receives map data and traffic information stored on the server. Furthermore, the communication unit 50 can be configured to perform vehicle-to-vehicle communication with surrounding vehicles.

[0054] The acquisition unit 51 acquires the driving environment of the vehicle 12 as surrounding information from the external sensor 48 via the input / output interface 40. The external sensor 48 is configured to include at least one of a camera that captures a defined range around the vehicle 12, a millimeter-wave radar that emits detection waves into the defined range, and an optical radar (Light Detection and Ranging / Laser Imaging Detection and Ranging) that scans the defined range. The "surrounding information" includes information about objects present within the defined range around the vehicle 12 as detected by the external sensor 48. Additionally, weather information and traffic information about the vehicle's surroundings received via the communication interface 38 are also included in the "surrounding information."

[0055] In this embodiment, the vehicle's driving state is specifically acquired by the acquisition unit 51. The vehicle's driving state includes the driving state of detecting objects in front of the vehicle to control the vehicle's driving, such as the first mode and the second mode when the ACC (Adaptive Cruise Control) function is working.

[0056] Here, the ACC (Adaptive Cruise Control) function detects a vehicle ahead and maintains a constant distance while following it. The first mode of this ACC function detects an object ahead and controls the vehicle's movement accordingly; specifically, it detects a vehicle ahead and maintains a constant distance while following it. The second mode of the ACC function allows switching back to the first mode when an object is detected ahead; specifically, it switches back to the first mode when an external sensor 48 detects a vehicle ahead. In this second mode, the vehicle 12 travels at a preset speed.

[0057] The automatic driving control unit 52 controls the switching between manual and automatic driving of the vehicle 12. For example, when the ACC function is working in the vehicle 12, the automatic driving control unit 52 switches to automatic driving, taking into account location information and surrounding information to enable the vehicle 12 to drive automatically in either mode 1 or mode 2. Specifically, the vehicle 12 is driven automatically by controlling the actuator 46. In addition, the automatic driving control unit 52 can also control the actuator 46 to drive the vehicle 12 automatically based on control commands received from external devices via the communication interface 38.

[0058] The display unit 54 generates an image for display on the projection surface of the head-up display device 44, i.e., the third display unit 26, based on the driving state of the vehicle 12 obtained by the acquisition unit 51, and displays the generated image on the display area of ​​the third display unit 26. The generated image includes, for example, various images such as the vehicle 12's speedometer, for the purpose of assisting manual driving and automatic driving.

[0059] In this embodiment, especially when the vehicle 12 is in the first driving mode, the display unit 54 generates and displays a first image 70 indicating that the vehicle 12 is in the first driving mode. Furthermore, when the vehicle 12 is in the second driving mode, the display unit 54 generates and displays a second image 80 indicating that the vehicle 12 is in the second driving mode.

[0060] Here, the display control unit 60 displays the first image 70 and the second image 80 on the third display unit 26 in a manner that merges with the foreground of the vehicle 12, which can be visually confirmed through the third display unit 26 (windshield 18). As an example, the display control unit 60 detects a vehicle in front of the vehicle 12 from the foreground by referring to images from a camera capturing the foreground of the vehicle 12 and map data. The first image 70 and the second image 80 are displayed in the space between the vehicle in front and the vehicle itself, which are visually confirmed by the driver in the driver's seat through the real image of the vehicle in front of the third display unit 26. The specific manner and display method of the first image 70 and the second image 80 will be described later.

[0061] (effect)

[0062] Next, the function of this embodiment will be explained.

[0063] (Display processing)

[0064] Reference Figure 4 An example of display processing for displaying the first image 70 and the second image 80 in the display area of ​​vehicle 12 will be described. CPU 30 reads the display program from ROM 32 or memory 36 and executes the display processing in RAM 34.

[0065] like Figure 4 As shown, in step S100, CPU30 determines whether the ACC function is working.

[0066] If it is determined in step S100 that the ACC function is ON, the CPU 30 proceeds to step S101. Conversely, if it is determined in step S100 that the ACC function is OFF, the CPU 30 terminates the display process.

[0067] In step S101, CPU 30 obtains the driving status of vehicle 12. Specifically, CPU 30 obtains the driving status of vehicle 12 through the function of acquisition unit 51.

[0068] In step S102, CPU30 determines whether the driving state of vehicle 12 is in mode 1. If the driving state of vehicle 12 is determined to be in mode 1, CPU30 moves to step S103. If the driving state of vehicle 12 is determined to be in mode 2, CPU30 moves to step S107.

[0069] In step S103, CPU 30 determines whether the change amount related to the driving state of vehicle 12 is above a predetermined threshold. In this case, the change amount related to the driving state refers to the change amount related to the first mode. The change amount is the change amount of the continuous state of the known driving state. In this embodiment, as an example, it is the time elapsed after the driving state of vehicle 12 is switched to the first mode. CPU 30 determines whether the time elapsed after vehicle 12 is switched to the first mode is above a predetermined threshold. Moreover, if it is determined that the elapsed time is above the predetermined threshold, CPU 30 moves to the processing of step S104. If it is determined that the elapsed time is less than the predetermined threshold, CPU 30 returns to step S101 and repeats the processing.

[0070] Furthermore, the changes related to the driving state are not limited to the elapsed time mentioned above. The time or distance that the vehicle 12 travels at a constant speed can also be used as the change to set the threshold. Alternatively, the distance between the vehicle 12 and the vehicle in front can also be used as the change to set the threshold.

[0071] In step S104, CPU 30 determines whether the current position of vehicle 12 is within a designated driving area. A designated driving area can be defined as an area where specific modes of traffic are permitted, restricted, or specified according to road traffic regulations regarding vehicle 12's movement, or at least one of these areas. Furthermore, the designated driving area can also be defined based on, for example, the congestion conditions of the road on which vehicle 12 is traveling. In this embodiment, as an example, a highway is designated as the designated driving area. When vehicle 12's driving area is a highway, it can be inferred that driving based on a constant driving state can continue for a long time. Additionally, on a highway, it can be inferred that a sufficient distance can be ensured between the vehicle and the preceding vehicle V.

[0072] Furthermore, if it is determined in step S104 that the driving area is a highway, the CPU30 moves to step S105; if it is determined that the driving area is not a highway, the CPU30 moves to step S108.

[0073] In step S106, CPU 30 determines whether the relative speed difference between vehicle 12 and the preceding vehicle is above a predetermined threshold. For example, CPU 30 calculates the relative speed difference between vehicle 12 and the preceding vehicle based on information detected by external sensor 48. If it is determined that the relative speed difference between vehicle 12 and the preceding vehicle is above the predetermined threshold, it can be inferred that the preceding vehicle has moved away from the vehicle in a short period of time and is no longer the detection object, or that the preceding vehicle has suddenly approached the vehicle in a short period of time, causing the space between the object and the vehicle to become narrow.

[0074] Furthermore, if the relative speed difference is determined to be above a predetermined threshold, the CPU 30 proceeds to step S106 to display the first image 70 on the third display unit 26 (switching). On the other hand, if the relative speed difference is determined to be above a predetermined threshold, the process proceeds to step S108 to display the second image 80 on the third display unit 26 (switching).

[0075] Here, refer to Figure 5 An example of the first image 70 displayed on the third display unit 26 will be described. As shown in the figure, the first image 70 includes a small first object M1 displayed at the bottom of the display area and a large second object M2 emphasized in the center of the display area. As an example, the first object M1 is an image simulating a driving lane, indicating that the ACC function of vehicle 12 is working. The second object M2 is an image of three signs extending along the road width direction (vehicle width direction) arranged in the direction of travel of vehicle 12, indicating that vehicle 12 is detecting and following the preceding vehicle V.

[0076] A first image 70, including the first object M1 and the second object M2, is displayed in front of the vehicle 12 at a position that does not overlap with the preceding vehicle V (a real image in this embodiment) shown in the display area. Therefore, the occupant observing the third display unit 26 can clearly distinguish the preceding vehicle V from the first image 70 for identification. In addition, by observing the first image 70, the occupant will know that the vehicle 12 is following the preceding vehicle V using the vehicle 12's ACC function.

[0077] Additionally, refer to Figure 6 Let's illustrate an example of the second image 80 displayed on the third display unit 26. As shown in the figure, the second image 80 only includes a small first object M1 displayed in the lower part of the display area. By observing the second image 80, the occupants will know that the ACC function is working. In addition, when a vehicle that should be followed is detected even when there is no vehicle ahead, the driving state of vehicle 12 can be identified as a state that can be switched to the first mode.

[0078] Thus, through steps S103 to S105 described above, the CPU 30 determines the possibility of frequent switching or the inability to reliably maintain the vehicle-to-vehicle distance even when the vehicle 12 is in the first driving mode. Furthermore, if such a possibility is high, the CPU 30 prevents the display of the second object M2, which is emphasized for following the vehicle, by not switching to the first image. This suppresses flickering of the third display unit 26 caused by frequent switching between the first and second images, and prevents the image (object) from being displayed at a position overlapping with the preceding vehicle.

[0079] On the other hand, if it is determined in step S102 that the driving state of vehicle 12 is in mode 2, then CPU 30 moves to step S107 to determine whether the change amount related to mode 2 is above a predetermined threshold. Regarding the change amount related to mode 2, since the threshold determination for the change amount related to mode 1 in step S103 is the same as that in the above step, detailed explanation is omitted.

[0080] Furthermore, if in step S107 it is determined that the change amount is above a predetermined threshold, that is, if it is determined that the time elapsed after switching to the second mode exceeds the predetermined threshold, the CPU 30 moves to the processing in step S108. On the other hand, if in step S107 it is determined that the change amount is less than the predetermined threshold, the process returns to step S101 and repeats the processing.

[0081] In step S108, CPU30 causes the third display unit 26 to display the second image 80 (switch). By observing the second image 80, the occupant confirms that the ACC function of the vehicle 12 is working, and when a vehicle that should be followed is detected, the occupant knows that the driving state of the vehicle 12 has been switched to the first mode.

[0082] In step S109, CPU 30 determines whether the ACC function is not working. If the ACC function is determined to be not working, CPU 30 ends the display processing. On the other hand, if the ACC function is determined to be working, it returns to step S101 and repeats the processing.

[0083] As explained above, in the vehicle display control device 10 of this embodiment, a predetermined image is displayed on the display area of ​​the third display unit 26 that displays the foreground of the vehicle 12. Furthermore, according to... Figure 4 The display processing shown involves displaying a first image 70 on the display area of ​​the third display unit 26 when the driving status of the vehicle 12 is obtained and the obtained driving status is in the first mode. This allows occupants observing the third display unit 26 to be notified that the vehicle 12 is detecting a vehicle ahead and to control the driving of the vehicle 12.

[0084] Here, as Figure 5 As shown, the first image 70 is displayed in the display area of ​​the third display unit 26 between the vehicle 12 and the preceding vehicle V. Therefore, since the occupant observing the third display unit 26 can clearly distinguish between the preceding vehicle V and the first image 70, the visual confirmation of the occupant is improved.

[0085] Furthermore, according to the display processing, when the obtained driving state is in mode 2, the image displayed on the third display unit 26 is switched to the second image 80. Thus, by notifying that the ACC function is working even when there is no preceding vehicle V, and switching back to mode 1 when a preceding vehicle V is detected, passengers can feel more at ease.

[0086] Furthermore, according to the display processing, the image displayed on the third display unit 26 is switched when the change in the driving state of the vehicle 12 is above a predetermined threshold. That is, the image is not switched until the change in the driving state exceeds the predetermined threshold, and the image is switched after the predetermined driving state has been maintained for a certain period of time. Specifically, in this embodiment, the image is switched when the time elapsed after the driving state of the vehicle 12 has switched to the first mode or the second mode is above a predetermined threshold. As a result, for example, when the driving state of the vehicle switches frequently due to road congestion, the visual confirmation for the occupants is improved because the so-called hunting caused by the frequent switching of the displayed image on the third display unit 26 in conjunction with the switching can be prevented.

[0087] Furthermore, according to the display processing, when the vehicle 12 is traveling within a designated driving area, the image displayed on the third display unit 26 can be switched to the first image 70. Specifically, in this embodiment, the switch to the first image is possible when the vehicle 12 is traveling on a highway. That is, by switching to the first image 70 only when the vehicle 12 is traveling in a driving area where the first mode of travel can be maintained for a long time, such as a highway, and by not switching to the first image even when traveling in the first mode in areas where the vehicle 12's driving state frequently changes, the visual confirmation for the occupants can be improved.

[0088] Furthermore, according to the display processing, when vehicle 12 is traveling in the first mode, if the relative speed difference between vehicle 12 and the preceding vehicle is above a predetermined threshold, the first image 70 is not displayed on the third display unit 26. Therefore, the first image 70 is not displayed when it is assumed that the preceding vehicle will move away from vehicle 12 in a short period of time and become no longer a detection target, or when it is assumed that the preceding vehicle will suddenly approach vehicle 12 in a short period of time, making it difficult to display images of both vehicles. Thus, since the first image 70 is only displayed when it can be stably displayed for a certain period of time, the annoyance caused by frequent image switching is reduced, and the visual confirmation for occupants is improved.

[0089] Furthermore, in the vehicle display control device 10 according to this embodiment, the display area showing the foreground of the vehicle 12 becomes a projection surface projected by the head-up display device 44 in front of the vehicle in the driver's seat. Moreover, the first image 70 is displayed between the vehicle 12 and the real image of the vehicle in front, in the foreground of the vehicle 12 that can be visually confirmed through the display area. Therefore, since the foreground that can be observed from the driver's seat through the windshield 18 and the first image 70 are displayed in a coordinated manner, the occupant in the driver's seat can observe the first image 70 without significantly shifting their gaze.

[0090] [Additional Explanation]

[0091] Furthermore, in the above embodiment, when the third display unit 26 displays the first image, the display mode of the first image 90 can also be changed according to the distance between the vehicle 12 and the preceding vehicle V, as shown in the modified example of FIG7.

[0092] Figure 7A This is a display example of the moment when vehicle 12 detects the preceding vehicle at a location where the distance between vehicle 12 and the preceding vehicle V is more than a predetermined first distance. Figure 7B It is a location where the distance between vehicle 12 and the preceding vehicle V is more than or equal to the first specified distance, and more than... Figure 7A The example shown is of the time when the location is close to the vehicle in front. Figure 7C This is an example of a display showing the moment when the distance between the preceding vehicle V and vehicle 12 reaches a predetermined first distance. Here, the predetermined first distance refers to the inter-vehicle distance ensured when vehicle 12 is following the preceding vehicle V.

[0093] like Figures 7A to 7C As shown, the first image 90 includes a first object M1 and a second object M200. The second object M200 consists of signs M201 extending along the road width direction (vehicle width direction), and the number of signs M201 changes as the distance between vehicle 12 and the preceding vehicle V decreases. In this embodiment, three signs M201 are arranged along the travel direction of vehicle 12 at the location where the distance between vehicle 12 and the preceding vehicle V is furthest. As the distance from vehicle 12 to the preceding vehicle V decreases, the number of signs M201 decreases, and at the location where the distance from vehicle 12 to the preceding vehicle V is the first distance, the number of signs M201 becomes one. Thus, occupants observing the first image 70 can identify the preceding vehicle to be followed in advance before the ACC-based follow-up driving begins, gaining a sense of security.

[0094] In the above embodiment, the display area for the foreground of the displayed vehicle is described as being formed by the projection surface of the head-up display device 44, but this disclosure is not limited thereto. Alternatively, as... Figure 8 As with the vehicle display control device 100 shown in the modified example, the first image 70 or the second image 80 is displayed in the display area of ​​the display provided on the instrument panel 14, i.e., the second display unit 25. Figure 8 In the second display unit 25 shown, a map image N indicating the current position of the vehicle 12 is displayed in the lower part of the display area, and a foreground image F showing the foreground of the vehicle is displayed in the upper part of the display area. The foreground image F is composed, for example, an image obtained from a camera that captures the front of the vehicle 12 or a foreground image based on animation.

[0095] Similarly, in the instrument panel 14, the first image 70 or the second image 80 can be displayed in the display area of ​​the instrument display, i.e., the first display unit 24, located in front of the driver's seat.

[0096] Furthermore, the display methods of the first and second images described in the above embodiments and variations are merely examples and can be appropriately modified without departing from the spirit of this disclosure.

[0097] Furthermore, in the above embodiments and variations, the first mode for controlling vehicle movement by detecting objects in front of the vehicle describes following movement based on the ACC function, but it is not limited to this. For example, the structure of this disclosure can also be applied when controlling the movement of vehicle 12 through radar cruise control, automatic braking, or the like. In this case, in the above embodiments, the "forward vehicle" as a moving body is described as the object in front of the vehicle, but it is not limited to this; stationary objects, drones, and other flying objects can also be detected as objects.

[0098] Furthermore, in the display processing of the above embodiment, the "designated driving area" involved in step S104 is a highway, but it is not limited to this. For example, a region other than a region where specific traffic methods are restricted or designated according to road traffic regulations may also be designated as a designated driving area. That is, in a region where specific traffic methods are restricted or designated according to road traffic regulations, road markings for vehicle drivers are usually implemented. Therefore, in such a region, by not displaying the first image 70, the visual visibility of the road markings can be prevented from being reduced, and the visual visibility for occupants can be improved.

[0099] Furthermore, in the above embodiment, the image is displayed in a display area located inside the vehicle compartment, but this disclosure is not limited to this. For example, when remotely operating the vehicle 12 by receiving an operation signal from a remote device located outside the vehicle 12, if the operator of the remote device is understood as an occupant of the vehicle 12, the display area is not limited to being located inside the vehicle compartment, and may also be located outside the vehicle 12. Moreover, the first image 70 and the second image 80 may be displayed in a display area located outside the vehicle 12.

[0100] Furthermore, the display processing executed by the CPU reading the software (program) in the above embodiments can be performed by various processors other than the CPU. Examples of processors in this case include FPGAs (Field-Programmable Gate Arrays) and processors with dedicated circuit structures designed for specific processing, such as PLDs (Programmable Logic Devices) and ASICs (Application Specific Integrated Circuits). Additionally, the display processing can be performed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). More specifically, the hardware of these various processors is a circuit that incorporates circuit elements such as semiconductor components.

[0101] Furthermore, in the above embodiments, the methods for display processing and lane change display processing are described as being pre-stored (installed) in ROM or memory, but this is not a limitation. The program may also be provided as a recording medium such as CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disk Read Only Memory), or USB (Universal Serial Bus) memory. Alternatively, the program may be downloaded from an external device via a network.

Claims

1. A display control device for a vehicle, wherein a predetermined image is displayed in a display area showing the foreground of a vehicle, wherein, The vehicle display control device includes: Memory; and The processor is connected to the memory. The processor obtains the vehicle's driving status. In the case where the obtained driving state is a first mode in which the vehicle controls its driving in a manner that detects an object in front of it and follows the object, the processor causes a first image representing the first driving state to be displayed in the display area near the position corresponding to the object. When the obtained driving state is mode 2, the processor displays a second image representing the driving state as mode 2 near the first image in the display area. This second mode is a different mode from mode 1, which can be switched to when an object is detected in front of the vehicle. The first image includes a first object representing the execution function of the first mode in operation, and a second object consisting of multiple signs arranged in the direction of vehicle travel, the display size of which is set to be larger than the first object and extending along the road width direction. The second image is composed of the first object from the first image with the second object removed.

2. The vehicle display control device according to claim 1, wherein, When the amount of change related to the vehicle's driving state exceeds a predetermined threshold, the processor switches the image displayed in the display area.

3. The vehicle display control device according to claim 1 or 2, wherein, When the vehicle is driving in a designated driving area, the processor can switch the image displayed in the display area to the first image.

4. The vehicle display control device according to claim 1 or 2, wherein, When the vehicle is traveling in mode 1, if the relative speed difference between the vehicle and the object is above a predetermined threshold, the processor will not display the first image in the display area.

5. The vehicle display control device according to claim 1 or 2, wherein, The display area is a projection surface shown by a head-up display device in front of the driver's seat of the vehicle. The processor causes the first image to be displayed between the vehicle and the object in the foreground of the vehicle, which can be visually confirmed through the display area.

6. A display method in which a predetermined image is displayed in a display area of ​​the foreground of a displayed vehicle, wherein, Obtain the vehicle's driving status. In the case where the obtained driving state is a first mode in which the vehicle controls its driving in a manner that detects an object in front of the vehicle and follows the object, a first image representing the first driving state is displayed near the position corresponding to the object in the display area. When the obtained driving state is mode 2, a second image representing the driving state as mode 2 is displayed near the first image in the display area. This second mode is a different mode from mode 1, which can be switched to when an object is detected in front of the vehicle. The first image includes a first object representing the execution function of the first mode in operation, and a second object consisting of multiple signs arranged in the direction of vehicle travel, the display size of which is set to be larger than the first object and extending along the road width direction. The second image is composed of the first object from the first image with the second object removed.

7. A storage medium that stores a program for displaying a predetermined image in a display area of ​​a foreground of a displayed vehicle, and is a non-temporary storage medium readable by a computer, wherein... When the program is executed by the processor, the following processing is performed: Obtain the vehicle's driving status. In the case where the obtained driving state is a first mode in which the vehicle controls its driving in a manner that detects an object in front of the vehicle and follows the object, a first image representing the first driving state is displayed near the position corresponding to the object in the display area. When the obtained driving state is mode 2, a second image representing the driving state as mode 2 is displayed near the first image in the display area. This second mode is a different mode from mode 1, which can be switched to when an object is detected in front of the vehicle. The first image includes a first object representing the execution function of the first mode in operation, and a second object consisting of multiple signs arranged in the direction of vehicle travel, the display size of which is set to be larger than the first object and extending along the road width direction. The second image is composed of the first object from the first image with the second object removed.

Images