Display control device for vehicle, display device for vehicle, display control method

Abstract

The present application obtains a vehicle display control device, a vehicle display device, a display control method, and a display control program that can suppress annoyance to an occupant. The vehicle display control device displays an image in a display region that overlaps with a portion of a foreground viewed from a vehicle. The vehicle display control device detects a position of a preceding vehicle traveling ahead of the vehicle, and detects whether the preceding vehicle as a whole is out of the display region based on the position of the preceding vehicle. The vehicle display control device causes a captured image corresponding to the position of the preceding vehicle to be displayed in the display region in a manner that overlaps or adjoins the preceding vehicle, and causes the captured image to be flicker-displayed at an end portion of the display region on a side from which the preceding vehicle as a whole is out of the display region when it is detected that the preceding vehicle as a whole is out of the display region. Thus, the vehicle display control device can suppress annoyance to an occupant.

Description

Technical Field

[0001] This disclosure relates to a display control device for vehicles, a display device for vehicles, a display control method, and a non-transitory storage medium. Background Technology

[0002] For example, Japanese Patent No. 6536855 discloses a technique for displaying a marker image, etc., overlaid with a foreground observed by a vehicle occupant through the windshield using a head-up display device. In this patent document, the marker image is displayed in conjunction with a moving vehicle, which is represented by capturing the moving vehicle. As the moving vehicle moves outward from the side edge in the vehicle width direction of the display area of ​​the head-up display device, the time frequency of the marker image is changed.

[0003] However, in the technology described in the aforementioned Patent Document 1, the marker image flickers even if the vehicle in front moves slightly outward from the display area, which may cause annoyance to the occupants. Summary of the Invention

[0004] This disclosure provides a vehicle display control device, a vehicle display device, a display control method, and a display control program capable of suppressing annoyances to occupants.

[0005] The vehicle display control device of the first embodiment controls a vehicle display device that displays an image in a display area that overlaps with a portion of the foreground viewed from the vehicle. The vehicle display control device includes: a forward vehicle detection unit that detects the position of a forward vehicle traveling in front of the vehicle; a departure detection unit that detects whether the entire forward vehicle has left the display area based on its position; and a display control unit that displays a captured image corresponding to the position of the forward vehicle in the display area in a manner that overlaps with or is adjacent to the forward vehicle. When the departure detection unit detects that the entire forward vehicle has left the display area, the captured image flashes at the end of the display area on the side where the entire forward vehicle has left.

[0006] In the vehicle display control device of the first embodiment, the display control unit displays a captured image corresponding to the position of the preceding vehicle in a display area in a manner that overlaps with or is adjacent to the preceding vehicle, and when the departure detection unit detects that the preceding vehicle has completely left the display area, the captured image is flashed at the end of the side of the display area where the preceding vehicle has completely left.

[0007] Therefore, since the captured image flashes when the entire preceding vehicle has left the display area, and does not flash when only a part of the preceding vehicle has left the display area, it is possible to suppress any annoyance to the occupants. Here, "overlapping display" is not limited to a structure that overlaps images of preceding vehicles seen through the windshield, but broadly includes structures that overlap images of preceding vehicles displayed on monitors or other displays inside the passenger compartment.

[0008] The vehicle display control device of the second embodiment is based on the first embodiment. When the departure detection unit detects that the entire forward vehicle has left the display area, the display control unit causes the captured image to flash after a certain period of time from the detection.

[0009] In the vehicle display control device of the second embodiment, since the display control unit causes the captured image to flash after a certain period of time has elapsed since the detection when the preceding vehicle is detected to have completely left the display area, the oscillation that occurs when the preceding vehicle moves from the inside to the outside of the display area can be prevented by elapsed time since the detection.

[0010] The vehicle display control device of the third embodiment is based on the first embodiment or the second embodiment. When the departure detection unit detects that at least a part of the forward vehicle has returned from the outside to the inside of the display area, the display control unit causes the captured image to be displayed without flickering after a certain period of time has elapsed since the detection.

[0011] In the vehicle display control device of the third embodiment, since when at least a part of the preceding vehicle is detected to return from the outside to the inside of the display area, the display control unit enables the captured image to be displayed without flickering after a certain period of time has elapsed since the detection, it is possible to prevent oscillations that occur when the preceding vehicle returns from the outside to the inside of the display area by elapsed for a certain period of time since the detection.

[0012] The vehicle display control device of the fourth embodiment is completed based on any one of the first to third embodiments. As the moving vehicle moves away from the display area, the display control unit increases the flashing speed of the flashing display.

[0013] In the vehicle display control device of the fourth embodiment, since the display control unit speeds up the flashing speed of the flashing display as the vehicle ahead moves away from the display area, the occupant can visually judge the distance from the display area to the vehicle ahead based on the flashing display with different flashing speeds.

[0014] The vehicle display control device of the fifth embodiment is based on the fourth embodiment, and the display control part gradually increases the flashing speed.

[0015] In the vehicle display control device of the fifth embodiment, since the display control section gradually increases the flashing speed, it is possible to correct the error in calculating the distance from the display area to the vehicle in front for display purposes.

[0016] The vehicle display control device of the sixth embodiment is completed based on any one of the first to fifth embodiments, wherein the display area is a projection surface projected by a head-up display device in front of the vehicle in the driver's seat.

[0017] In the vehicle display control device of the sixth embodiment, since the display area is a projection surface projected by the head-up display device in front of the vehicle in the driver's seat, the captured image is displayed in a manner that overlaps with the foreground viewed from the driver's seat. Therefore, the occupant in the driver's seat can visually confirm the position of the vehicle in front without moving their eyes too much.

[0018] The vehicle display device according to the seventh embodiment includes: a display unit disposed in the passenger compartment of the vehicle and having the display area; and a vehicle display control device according to any one of the first to sixth embodiments.

[0019] In the vehicle display device of the seventh embodiment, the vehicle display device includes a display unit provided in the passenger compartment of a vehicle and having a display area, and a vehicle display control device. Since this vehicle display control device is the vehicle display control device of any one of the first to sixth embodiments, the above-described functions and effects can be obtained.

[0020] The display control method of the eighth embodiment displays an image in a display area that overlaps with a portion of the foreground viewed from the vehicle. The display method detects the position of a preceding vehicle traveling in front of the vehicle, detects whether the entire preceding vehicle has left the display area based on the position of the preceding vehicle, displays a captured image corresponding to the position of the preceding vehicle in the display area in a manner that overlaps with or is adjacent to the preceding vehicle, and when it is detected that the entire preceding vehicle has left the display area, the captured image is flashed at the end of the side of the display area where the entire preceding vehicle has left.

[0021] In the display control method of the eighth embodiment, a captured image corresponding to the position of the preceding vehicle is displayed in the display area in a manner that overlaps with or is adjacent to the preceding vehicle. When it is detected that the preceding vehicle has completely left the display area, the captured image is flashed at the end of the display area on the side where the preceding vehicle has completely left the display area. Therefore, for the occupants of the vehicle, since the captured image flashes when the preceding vehicle has completely left the display area, and does not flash when only a part of the preceding vehicle has left the display area, it is possible to suppress any annoyance to the occupants.

[0022] The display control program of the ninth embodiment displays an image in a display area that overlaps with a portion of the foreground viewed from the vehicle. The program causes the computer to perform the following processing: detect the position of a vehicle traveling in front of the vehicle; detect whether the entire vehicle has left the display area based on the position of the vehicle; display a captured image corresponding to the position of the vehicle in the display area in a manner that overlaps with or is adjacent to the vehicle; and when it is detected that the entire vehicle has left the display area, cause the captured image to flash at the end of the side in the display area where the entire vehicle has left the display area.

[0023] In the display control program of the ninth embodiment, the computer performs the following process: a captured image corresponding to the position of the preceding vehicle is displayed in the display area in a manner overlapping or adjacent to the preceding vehicle; and when it is detected that the preceding vehicle has completely left the display area, the captured image flashes at the end of the display area on the side where the preceding vehicle has completely left. Therefore, for the occupants of the vehicle, since the captured image flashes when the preceding vehicle has completely left the display area, and does not flash when only a part of the preceding vehicle has left the display area, it is possible to suppress any annoyance to the occupants.

[0024] As explained above, the vehicle display control device, vehicle display device, display control method, and display control program disclosed herein have the excellent effect of suppressing annoyance to occupants. Attached Figure Description

[0025] An exemplary embodiment of the present invention will be described in detail based on the following figures, wherein:

[0026] Figure 1 This is a simplified diagram of the front of the passenger compartment of a vehicle equipped with the vehicle display device described in this embodiment, viewed from the rear of the vehicle.

[0027] Figure 2 This is a block diagram illustrating the hardware structure of the vehicle display device according to this embodiment.

[0028] Figure 3 This is a block diagram illustrating the functional structure of the vehicle display device according to this embodiment.

[0029] Figure 4 This is an example illustration representing a photograph taken by a front camera.

[0030] Figure 5 This is a diagram showing an example of a windshield as seen from the driver's seat.

[0031] Figure 6 This is a diagram showing an example of a windshield as seen from the driver's seat.

[0032] Figure 7 This is a flowchart illustrating an example of the display processing flow in this embodiment.

[0033] Figure 8 This is a simplified diagram illustrating a vehicle display device according to a variation of this embodiment. Detailed Implementation

[0034] Referring to the accompanying drawings, a vehicle 12 employing a vehicle display device 10 according to one embodiment of this disclosure will be described. Figure 1 The arrow UP in the description indicates the upper side in the vertical direction of the vehicle, and the arrow RH indicates the right side in the width direction of the vehicle. In the following explanation, the vertical and horizontal directions refer to the vertical direction of the vehicle and the width direction of the vehicle, respectively.

[0035] like Figure 1 As shown, an instrument panel 14 is provided at the front of the passenger compartment 13 of the vehicle 12. The instrument panel 14 extends along the width direction of the vehicle, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, it is a so-called right-hand drive vehicle with the steering wheel 16 provided on the right side, and the driver's seat is set on the right side of the vehicle. In addition, a windshield 18 is provided at the front end of the instrument panel 14.

[0036] The windshield 18 extends from the front end of the dashboard 14 towards the upper side of the vehicle, dividing the outer side of the vehicle compartment 12 and the inner side of the vehicle compartment 13. The right end of the windshield 18 is fixed to the right front pillar 20 of the vehicle. The front pillar 20 extends vertically along the vehicle, and the windshield 18 is fixed to its inner end in the vehicle width direction. The front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. The left end of the windshield 18 is fixed to the left front pillar (not shown).

[0037] Here, a first display unit 24 with an image display area 24A is provided in the instrument panel 14. The first display unit 24 is composed of an instrument display located on the right side of the instrument panel 14 in front of the driver's seat. The first display unit 24 is connected to various instrument devices mounted in the vehicle 12 and is positioned to enter the driver's field of vision when the driver's gaze is directed forward.

[0038] The instrument panel 14 is provided with a second display unit 25 having an image display area 25A. The second display unit 25 is composed of a central display located in the center of the instrument panel 14 in the vehicle width direction.

[0039] A third display unit 26 with an image display area 26A is provided on the windshield 18. The third display unit 26 is located on the vehicle-top side of the first display unit 24, and the display area 26A is provided by the head-up display device 44 (see reference). Figure 2 The projection surface obtained by projection is formed. Specifically, a head-up display device 44 is provided on the front side of the instrument panel 14, and it is configured to project images from the head-up display device 44 onto the display area 26A of the third display unit 26 of the windshield 18. That is, the third display unit 26 is part of the windshield 18 that becomes the projection surface of the head-up display device 44.

[0040] (Hardware structure of vehicle display device 10)

[0041] The vehicle 12 is equipped with a control unit for a vehicle display device 10, namely an ECU (Electronic Control Unit) 28 that serves as a vehicle display control device. Figure 2 This is a block diagram showing the hardware structure of the vehicle display device 10.

[0042] Such as Figure 2 As shown, the ECU28 of the vehicle display device 10 is configured to include a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage device 36, a communication interface (communication I / F) 38, and an input / output interface (input / output I / F) 40. All components are interconnected via a bus 42 to enable communication.

[0043] CPU 30 is the central processing unit, which executes various programs and controls various components. Specifically, as a processor, CPU 30 reads programs from ROM 32 (which serves as memory) or memory 36 (which serves as storage), and uses RAM 34 as its working area to execute the programs. CPU 30 performs control of the aforementioned structures and various arithmetic operations based on the programs stored in ROM 32 or memory 36.

[0044] ROM 32 stores various programs and data. RAM 34 serves as a working area to temporarily store programs or data. Storage 36 is composed of HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs, including the operating system, and various data. In this embodiment, ROM 32 or storage 36 stores programs for display processing, as well as various data.

[0045] The communication I / F38 is an interface for communication between the vehicle display device 10 and a server (not shown) and other devices, such as Ethernet (registered trademark), LTE, FDDI, Wi-Fi (registered trademark), etc.

[0046] The input / output (I / F) 40 is connected to a first display unit 24, a second display unit 25, a head-up display (HUD) device 44, and a sensor unit 46. Furthermore, images are projected onto the third display unit 26 via the head-up display device 44.

[0047] The sensor unit 46 includes multiple sensors among various sensors such as a camera, radar, optical radar (LIDAR; Light Detection and Ranging or Laser Imaging Detection and Ranging), and GPS (global positioning system) sensors. The camera captures images of the surroundings of the vehicle 12. In this embodiment, the camera is configured to include at least a front camera that captures images of the front of the vehicle.

[0048] The radar uses radio waves to detect the distance and direction of the vehicle 12 relative to surrounding objects. The optical radar uses lasers to detect the distance and direction of the vehicle 12 relative to surrounding objects. The GPS sensor detects the current position of the vehicle 12. Furthermore, in this embodiment, both the radar and the optical radar include a signal processing unit (not shown), which processes the detection results of surrounding objects. The signal processing unit removes noise and obstructs movement such as roadside objects (like guide rails) based on recent detection results, including changes in relative position and relative speed with each object, and tracks and monitors moving objects such as pedestrians and other vehicles. Additionally, the sensor unit 46 is configured to include sensors for detecting the occupant's line of sight.

[0049] (Functional structure of vehicle display control device 28)

[0050] The vehicle display control device 28 uses the aforementioned hardware resources to implement various functions. (See reference...) Figure 3The functional structure of the vehicle display control device 28 is explained.

[0051] like Figure 3 As shown, the vehicle display control device 28 is configured with a functional structure including a forward vehicle detection unit 52, a separation detection unit 54, an image generation unit 56, and a display control unit 58. Each functional structure is implemented by the CPU 30 reading and executing a program stored in the ROM 32 or the memory 36.

[0052] The forward vehicle detection unit 52 acquires information related to the position of the forward vehicle 60 traveling in front of the vehicle 12. Specifically, the forward vehicle detection unit 52 acquires information about the forward vehicle 60 detected by the sensor unit 46. For example, the forward vehicle detection unit 52 acquires image data of the front of the vehicle captured by the front camera, and detects the coordinate data of the forward vehicle 60 in the yz direction based on the acquired image data of the forward vehicle 60. Here, the y direction is the left-right direction of the vehicle 12, and the z direction is the up-down direction of the vehicle 12. Furthermore, the x direction is the front-back direction of the vehicle 12.

[0053] Figure 4 This is an example diagram representing image 70, which is an image captured by a front camera showing the view in front of the vehicle. For example... Figure 4 As shown, the forward vehicle detection unit 52 sets the coordinate axes in the captured image 70 with the horizontal direction as the y-axis and the vertical direction as the z-axis. Furthermore, in this embodiment, the front camera is positioned at the center of the interior side of the front of the vehicle 12 in the vehicle width direction, and in this embodiment, the center of the captured image 70 is used as the origin.

[0054] The forward vehicle detection unit 52 detects a forward vehicle 60 located in front of the vehicle 12 by analyzing the captured image 70, and detects the position and shape of the forward vehicle 60 relative to the vehicle 12. For example, in Figure 4 In the process, the forward vehicle detection unit 52 detects the forward vehicle 60 from the captured image 70, and sets a rectangular outer frame 60A including the forward vehicle 60 within the forward vehicle 60. Figure 4 In the middle (represented by double-dotted lines), the width S in the x-axis direction and the height H in the y-axis direction of the outer frame 60A are detected as the size information of the forward vehicle 60.

[0055] Additionally, as an example, the forward vehicle detection unit 52 detects the coordinates of the lower left vertex of the outer frame 60A, namely FL1(y1, z1), the lower right vertex of the outer frame 60A, namely FR1(y2, z2), the upper left vertex of the outer frame 60A, namely FL2(y3, z3), and the upper right vertex of the outer frame 60A, namely FR2(y4, z4), as the coordinate data of the forward vehicle 60.

[0056] The separation detection unit 54 detects whether the preceding vehicle 60 has completely separated from the display area 26A of the third display unit 26 based on the position of the preceding vehicle 60. Specifically, as an example, the separation detection unit 54 pre-sets position coordinates corresponding to the display area 26A. Furthermore, it determines whether the four coordinate data indicating the position of the preceding vehicle 60 detected by the preceding vehicle detection unit 52—FL1(y1, z1), FR1(y2, z2), FL2(y3, z3), and FR2(y4, z4)—are located inside or outside the display area 26A. If they are located outside, the separation detection unit 54 detects that the preceding vehicle 60 has completely separated from the display area 26A of the third display unit 26.

[0057] The image generation unit 56 generates an image for display on the projection surface of the head-up display device 44, i.e., the third display unit 26. Figure 5 as well as Figure 6 These are figures illustrating an example of the windshield 18 as seen from the driver's seat. Among them, in... Figure 5 as well as Figure 6 In the image, the windshield 18 is shown as a rectangle, but it is not actually a strict rectangle.

[0058] like Figure 5 as well as Figure 6 As shown, the images generated by the image generation unit 56 include, for example, an instrument image 82 that displays the speed of the vehicle 12, and various images intended for manual driving and automatic driving assistance.

[0059] In this embodiment, particularly when the separation detection unit 54 determines that the preceding vehicle 60 has completely separated from the display area 26A of the third display unit 26, the image generation unit 56 generates a first capture image 80A and a second capture image 80B as capture images 80 representing the preceding vehicle 60 being captured. In this embodiment, as an example, the first capture image 80A and the second capture image 80B are configured with the same shape, and the first capture image 80A is configured with a more emphasized color and brightness than the second capture image 80B. In this embodiment, as an example, such as... Figure 5 as well as Figure 6 As shown, the captured image 80 is composed of double arrows.

[0060] Furthermore, when multiple vehicles 60 are detected ahead, the image generation unit 56 generates a capture image 80 for each detected vehicle 60. In this case, as an example, the color of the first capture image 80A is different for each vehicle 60. The generation of the capture images 80 by the image generation unit 56 is performed in advance, and as an example, stored in the memory 36.

[0061] The display control unit 58 has the function of displaying an image generated by the image generation unit 56 in the display area 26A of the third display unit 26 and the function of deleting the image to be displayed in the display area 26A.

[0062] The display control unit 58, for example, displays various images in the display area 26A of the third display unit 26 to blend them with the foreground of the vehicle 12 as seen by the occupant in the driver's seat through the third display unit 26 (windshield 18). In this embodiment, the display control unit 58 specifically displays a captured image 80 corresponding to the position of the preceding vehicle 60 in the display area 26A of the third display unit 26, overlapping or adjacent to the preceding vehicle 60. When the separation detection unit 54 detects that the preceding vehicle 60 has completely separated from the display area 26A, the captured image 80 flashes at the end of the side of the preceding vehicle 60 that has completely separated from the display area 26A. Furthermore, in this embodiment, as an example, the display control unit 58 displays the captured image 80 adjacent to the lower end of the preceding vehicle 60.

[0063] In this embodiment, as an example, when the disengagement detection unit 54 detects that the preceding vehicle 60 has completely disengaged from the left end of the display area 26A, the display control unit 58 displays a captured image 80 at the left end of the display area 26A. Specifically, the first captured image 80A and the second captured image 80B are displayed alternately at a certain interval. At this time, the display control unit 58 causes the captured images 80, i.e., the first captured image 80A and the second captured image 80B, to be displayed at a reduced or enlarged size so that the width of the double arrows in the captured image 80 corresponds to the width S detected as size information by the preceding vehicle detection unit 52. Furthermore, as an example, the display control unit 58 rotates the captured images 80, i.e., the first captured image 80A and the second captured image 80B, so that the slope of the double arrows corresponds to the width S detected as size information by the preceding vehicle detection unit 52. Figure 4 The slope of the lower end line of the outer frame 60A shown is consistent.

[0064] Similarly, when the detachment detection unit 54 detects that the entire forward vehicle 60 has detached from the right end of the display area 26A, the display control unit 58 displays the captured image 80 at the right end of the display area 26A. When it detects that the vehicle has detached from the top end, the display control unit 58 displays the captured image 80 at the top end of the display area 26A.

[0065] In addition, such as Figure 6As shown, when the entire preceding vehicle 60 has not left the display area 26A, that is, when only a part of the preceding vehicle 60 has left the display area 26A or when the entire preceding vehicle 60 is within the display area 26A, the display control unit 58 displays the first captured image 80A according to the position of the preceding vehicle 60, thereby making the captured image illuminate instead of flickering.

[0066] Furthermore, in this embodiment, as an example, when the disengagement detection unit 54 detects that the preceding vehicle 60 has completely disengaged from the display area 26A, the display control unit 58 causes the captured image 80 to flash after a certain period of time has elapsed since the detection. Additionally, when the disengagement detection unit 54 detects that at least a portion of the preceding vehicle 60 has returned from the outside to the inside of the display area 26A, the display control unit 58 causes the captured image 80 to illuminate instead of flashing after a certain period of time has elapsed since the detection.

[0067] (effect)

[0068] Next, the function of this embodiment will be explained.

[0069] (Display processing)

[0070] use Figure 7 The flowchart shown illustrates an example of the display processing for displaying the captured image 80 on the projection surface of the head-up display device 44, i.e., the third display unit 26. This display processing is performed by the CPU 30 reading the display control program from the ROM 32 or the memory 36 and expanding it into the RAM 34 for execution.

[0071] like Figure 7 As shown, in step S11, the CPU 30 determines whether a vehicle 60 is detected. Specifically, the CPU 30 determines whether a vehicle 60 is present in the captured image 70 by the front camera included in the sensor unit 46 using the function of the vehicle detection unit 52.

[0072] If no preceding vehicle 60 is detected, step S11 is a negative determination, and CPU 30 terminates the display control process. On the other hand, if the preceding vehicle 60 is detected, step S11 is a positive determination, and CPU 30 moves the process to step 12.

[0073] In step 12, the CPU 30 detects the position of the preceding vehicle 60. Specifically, the CPU 30 obtains information about the preceding vehicle 60 detected by the sensor unit 46 through the function of the preceding vehicle detection unit 52, and detects the coordinates of the lower right vertex of the outer frame 60A of the preceding vehicle 60, namely FR1(y2, z2), the coordinates of the upper left vertex of the outer frame 60A, namely FL2(y3, z3), and the coordinates of the upper right vertex of the outer frame 60A, namely FR2(y4, z4), as described above, as the coordinate data of the preceding vehicle 60.

[0074] In step S13, CPU 30 determines whether the preceding vehicle 60 has completely left the display area 26A. Specifically, CPU 30 uses the function of the departure detection unit 54 to determine whether the coordinate data FL1(y1, z1), FR1(y2, z2), FL2(y3, z3), and FR2(y4, z4) are located inside or outside the display area 26A in the captured image 70. If they are located outside, since CPU 30 detects that the preceding vehicle 60 has completely left the display area 26A, step S13 is a positive determination, and CPU 30 moves the processing to step S14.

[0075] In step S14, the CPU 30 uses a timer (not shown) mounted on the vehicle display control device 28 to determine whether a certain amount of time has elapsed. If the certain amount of time has not elapsed, step S14 is a negative determination, and the CPU 30 repeats the process of step S14 until the certain amount of time has elapsed. On the other hand, if the certain amount of time has elapsed, step S14 is a positive determination, and the CPU 30 moves the process to step S15.

[0076] In step S15, the CPU 30 causes the captured image 80 to flash. Specifically, the CPU 30 uses the function of the display control unit 58 to cause the first captured image 80A and the second captured image 80B generated by the function of the image generation unit 56 to be displayed alternately in the display area 26A of the third display unit 26, thereby causing the captured image 80 to flash at the end of the display area 26A where the forward vehicle 60 has completely detached (see reference). Figure 5 ).

[0077] On the other hand, for the CPU30, when at least one coordinate data is located inside the display area 26A in the captured image 70 in step S13, since the CPU30 detects that the entire forward vehicle 60 has not left the display area 26A, that is, at least a part of the forward vehicle 60 is located in the display area 26A, step S13 is a negative determination, and the CPU30 moves the processing to step S16.

[0078] In step S16, the CPU 30 uses the function of the departure detection unit 54 to determine whether the preceding vehicle 60 has returned from the outside to the inside. If it has not returned from the outside to the inside, since the preceding vehicle 60 remains inside the display area 26A, step S16 is a negative determination, and the CPU 30 moves the processing to step S18. On the other hand, if it has returned from the outside to the inside of the display area 26A, step S16 is a positive determination, and the CPU 30 moves the processing to step S17.

[0079] In step S17, the CPU 30 uses a timer (not shown) mounted on the vehicle display control device 28 to determine whether a certain amount of time has elapsed. If the certain amount of time has not elapsed, step S17 is a negative determination, and the CPU 30 repeats the process of step S17 until the certain amount of time has elapsed. On the other hand, if the certain amount of time has elapsed, step S17 is a positive determination, and the CPU 30 moves the process to step S18.

[0080] In step S18, the CPU 30 displays the captured image 80 adjacent to the preceding vehicle 60 instead of flashing. Specifically, the CPU 30, through the function of the display control unit 58, causes the display area 26A of the third display unit 26 to display the first captured image 80A generated by the image generation unit 56, thereby displaying the captured image 80 adjacent to the lower end of the preceding vehicle 60 instead of flashing (see reference). Figure 6 ).

[0081] Furthermore, while continuing with either step S15 or step S18, the CPU 30 moves to step S11, using the function of the forward vehicle detection unit 52 to determine whether the currently captured forward vehicle 60 has been detected. If the forward vehicle 60 is detected, step S11 is a positive determination, and the CPU 30 continues with the processing from step S12 onwards. On the other hand, if the forward vehicle 60 is not detected, step S11 is a negative determination, and the CPU 30 terminates the display control processing.

[0082] As explained above, in the vehicle display device 10 and vehicle display control device 28 according to this embodiment, the display control unit 58 displays the captured image 80 corresponding to the position of the preceding vehicle 60 and the preceding vehicle 60 overlapping or adjacent to each other in the display area. When the separation detection unit 54 detects that the preceding vehicle 60 has completely separated from the display area 26A, the captured image 80 flashes at the end of the side of the display area 26A where the preceding vehicle 60 has completely separated. Thus, when the preceding vehicle 60 is detected to have completely separated from the display area 26A, the captured image 80 flashes; when only a part of the preceding vehicle 60 has separated from the display area 26A, the captured image 80 does not flash, thereby suppressing any annoyance to the occupants.

[0083] Furthermore, in this embodiment, since the display control unit 58 causes the captured image 80 to flash after a certain period of time has elapsed since the detection when the forward vehicle 60 is detected to have completely moved out of the display area 26A, it is possible to prevent oscillation (hunting) that occurs during the switching when the forward vehicle 60 moves from the inside to the outside of the display area 26A by elapsed for a certain period of time since the detection.

[0084] Furthermore, in this embodiment, since the display control unit 58 enables the captured image 80 to be displayed without flickering after a certain period of time has elapsed since the detection when at least a portion of the preceding vehicle 60 is detected to return from the outside to the inside of the display area 26A, the oscillation that occurs during the switching when the preceding vehicle 60 returns from the outside to the inside of the display area 26A can be prevented by allowing a certain period of time from the detection.

[0085] In addition, in this embodiment, since the display area 26A is a projection surface projected by the head-up display device 44 in front of the vehicle in the driver's seat, the captured image 80 is displayed in a manner that overlaps with the foreground viewed from the driver's seat, so that the occupant in the driver's seat can visually confirm the position of the vehicle 60 in front without moving their eyes too much.

[0086] Furthermore, in the above embodiments, such as Figure 5 As shown, when the captured image 80 is flashed, the display control unit 58 causes the first captured image 80A and the second captured image 80B to be displayed alternately at a certain interval, but this disclosure is not limited to this.

[0087] (First variation)

[0088] In the first variation, as the preceding vehicle 60 moves away from the display area 26A, the display control unit 58 increases the flashing speed of the flashing display. Specifically, the display control unit 58 makes the timing of the display switching between the first captured image 80A and the second captured image 80B different. As an example, the separation detection unit 54 obtains the coordinates of the position of the vehicle 12 detected by the GPS sensor of the sensor unit 46. In addition, the separation detection unit 54 obtains the coordinates of the position of the preceding vehicle 60 in the y-direction (left-right direction) and z-direction (up-down direction) detected by the preceding vehicle detection unit 52, and obtains information about the size of the preceding vehicle 60 detected by the preceding vehicle detection unit 52 to derive the displacement in the x-direction (front-back direction).

[0089] The separation detection unit 54 calculates the distances in the x, y, and z directions from vehicle 12 to the preceding vehicle 60 based on this information. The greater the distance calculated by the separation detection unit 54, the further away the preceding vehicle 60 is considered to be from the display area 26A. The display control unit 58 speeds up the flickering speed of the flashing display by increasing the switching speed between the first captured image 80A and the second captured image 80B.

[0090] Thus, in Modification 1, as the forward vehicle 60 moves away from the display area 26A, the display control unit 58 speeds up the flashing speed of the flashing display, so the occupant can visually judge the distance from the display area 26A to the forward vehicle 60 based on the flashing display with different flashing speeds.

[0091] Furthermore, in the above-described variation 1, the displacement in the x-direction is calculated based on information about the size of the preceding vehicle 60 obtained from the captured image 70, but this disclosure is not limited to this. For example, it can also be calculated based on the distance between the vehicle 12 and the preceding vehicle 60 detected by the radar or optical radar of the sensor unit 46.

[0092] (Second variation)

[0093] The second variation is based on the first variation. For example, a certain threshold value is preset to divide the distance into three stages, and the distance calculated by the separation detection unit 54 is compared with the threshold value of the three stages. Based on the comparison result, the display control unit 58 causes the flashing speed to change according to the three stages.

[0094] Thus, in the second variation, since the display control unit 58 increases the flashing speed in stages, it is possible to correct the error in calculating the distance from the display area 26A to the preceding vehicle 60 for display purposes.

[0095] [Additional Explanation]

[0096] In the above embodiment, the case where the display area representing the foreground of the vehicle is constituted by the projection surface of the head-up display device 44 has been described, but this disclosure is not limited thereto. Alternatively, as... Figure 8 As shown in the modified example, the captured image 80 is displayed in the display area of ​​the display provided on the instrument panel 14, that is, the second display unit 25.

[0097] like Figure 8 As shown, in this modified example, the display area 25A of the second display unit 25 is divided vertically. Figure 8 In the second display unit 25 shown, a map image N indicating the current position of vehicle 12 is displayed at the lower part of the display area, and a foreground image F indicating the foreground of the vehicle is displayed at the upper part of the display area. The foreground image F is, for example, composed of a captured image 70 taken by the front camera constituting sensor unit 46. Unlike the above embodiment, in variation 2, when the preceding vehicle 60 has left the display area 25A, that is, when the preceding vehicle 60 is not present in the captured image 70, the captured image is flashed at the end of the side of the preceding vehicle 60 that has left the display area 25A.

[0098] Thus, in this modified example, when the captured image 80 is displayed on the second display unit 25 provided on the dashboard 14, and the preceding vehicle 60 has left the display area 25A, the captured image flashes at the end of the display area 25A on the side where the preceding vehicle 60 has left. Therefore, regardless of seating position, occupants who have visually confirmed the second display unit 25 can suppress the annoyance caused by the flickering display, just as in the above-described embodiment.

[0099] Similarly, in the instrument panel 14, the captured image 80 can also be displayed in the display area 24A of the instrument display, i.e., the first display unit 24, which is located in front of the driver's seat. Since the first display unit 24 is located in front of the driver's seat, the occupant in the driver's seat can visually confirm the first display unit 24 with almost no shift of their gaze from the foreground of the vehicle.

[0100] Furthermore, while the above embodiment describes a structure where one captured image 80 is displayed in the display area, this disclosure is not limited thereto. When multiple forward vehicles 60 are detected, a structure where multiple captured images 80 are displayed in the display area may also be used. Additionally, the captured image 80 is not limited to a double-arrow shape and can be varied in shape. For example, it can be a straight line composed of solid lines, dashed lines, etc., or it can be a circle, etc.

[0101] Furthermore, in the above embodiment, an outer frame 60A of the forward vehicle 60 is defined in the captured image 70, and the position coordinates of each vertex of the outer frame 60A are detected as the position coordinates of the forward vehicle 60. However, this disclosure is not limited to this. For example, the shape of the forward vehicle 60 can also be extracted, and the position coordinates of the outermost point in the up, down, left, and right directions can be detected.

[0102] In addition, in the above embodiment, the captured image 80 is displayed adjacent to the lower end of the preceding vehicle 60, but it is also possible to display the captured image 80 adjacent to the upper end, left end, or right end of the preceding vehicle 60. Alternatively, the captured image 80 may be displayed overlapping with the preceding vehicle 60.

[0103] Furthermore, in the above embodiment, as a method for causing the captured image 80 to flash, the display control unit 58 alternately displays the first captured image 80A and the second captured image 80B, but this disclosure is not limited to this. For example, the display and non-display of the first captured image 80A may also be performed alternately.

[0104] Furthermore, in the above embodiments, by Figure 2 The processes executed by the CPU22 reading the software (program) shown can also be executed by various processors other than the CPU. Examples of processors in this case include FPGAs (Field-Programmable Gate Arrays) and processors with dedicated circuit structures designed for specific processes, such as PLDs (Programmable Logic Devices) whose circuit structure can be modified after manufacturing, and ASICs (Application Specific Integrated Circuits). Furthermore, each process can be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is a circuit that incorporates circuit elements such as semiconductor components.

[0105] Furthermore, the programs described in this embodiment can be provided as non-transitory storage media such as CD-ROM (Compact Disc Read-Only Memory), DVD-ROM (Digital Versatile Disc Read-Only Memory), and USB (Universal Serial Bus) memory. Alternatively, the programs can be downloaded from an external device via a network.

[0106] The above describes one embodiment of the present disclosure, but the present disclosure is not limited to the above description. Various modifications can be made in addition to the above method without departing from its spirit.

Claims

1. A display control device for a vehicle, comprising controlling a vehicle display device that displays an image in a display area that overlaps with a portion of a foreground as viewed from the vehicle, wherein, The vehicle display control device includes: The forward vehicle detection unit detects the position of a forward vehicle traveling in front of the vehicle described. The detection unit detects whether the entire preceding vehicle has left the display area based on the position of the preceding vehicle. as well as The display control unit displays a captured image corresponding to the position of the preceding vehicle in the display area in a manner that overlaps with or is adjacent to the preceding vehicle. When the departure detection unit detects that the preceding vehicle has completely left the display area, the captured image flashes at the end of the side in the display area where the preceding vehicle has completely left. On the other hand, if only a part of the preceding vehicle has left the display area, the captured image does not flash.

2. The vehicle display control device according to claim 1, wherein, When the departure detection unit detects that the entire forward vehicle has left the display area, the display control unit causes the captured image to flash after a certain period of time has elapsed since the detection.

3. The vehicle display control device according to claim 1 or 2, wherein, When the departure detection unit detects that at least a portion of the forward vehicle has returned from the outside to the inside of the display area, the display control unit causes the captured image to be displayed without flickering after a certain period of time has elapsed since the detection.

4. The vehicle display control device according to claim 1 or 2, wherein, As the moving vehicle moves away from the display area, the display control unit increases the flashing speed of the flashing display.

5. The vehicle display control device according to claim 4, wherein, The display control section gradually increases the flickering speed.

6. The vehicle display control device according to claim 1 or 2, wherein, The display area is a projection surface shown by a head-up display device in front of the driver's seat of the vehicle.

7. A display device for a vehicle, wherein, have: A display unit, located inside the vehicle's passenger compartment, has a display area; and The vehicle display control device according to any one of claims 1 to 6.

8. A display control method, wherein a processor causes a display area that repeats a portion of a foreground viewed from a vehicle to display an image, wherein, The processor detects the position of a vehicle traveling in front of the vehicle. The system detects whether the preceding vehicle has moved out of the display area based on its position. The captured image corresponding to the position of the preceding vehicle is displayed in the display area in a manner that overlaps with or is adjacent to the preceding vehicle. When it is detected that the preceding vehicle has completely left the display area, the captured image is made to flash at the end of the side of the preceding vehicle that has completely left the display area. On the other hand, if only a part of the preceding vehicle has left the display area, the captured image is not made to flash.

9. The display control method according to claim 8, wherein, When it is detected that the preceding vehicle has completely left the display area, after a certain period of time has elapsed since the detection, the processor causes the captured image to flash.

10. The display control method according to claim 8 or 9, wherein, When at least a portion of the preceding vehicle is detected to have returned from the outside to the inside of the display area, the processor illuminates the captured image without flickering after a certain period of time has elapsed since the detection.

11. The display control method according to claim 8, wherein, As the moving vehicle moves away from the display area, the processor accelerates the flashing speed of the flashing display.

12. The display control method according to claim 11, wherein, The flashing speed is accelerated in stages using the processor.

13. A non-transitory storage medium storing a program for causing a processor to execute display control processing, the display control processing causing an image to be displayed in a display area that repeats a portion of a foreground viewed from a vehicle, wherein, The display control process includes: Detect the position of the vehicle traveling in front of the vehicle. The system detects whether the preceding vehicle has moved out of the display area based on its position. The captured image corresponding to the position of the preceding vehicle is displayed in the display area in a manner that overlaps with or is adjacent to the preceding vehicle. When it is detected that the preceding vehicle has completely left the display area, the captured image is made to flash at the end of the side of the preceding vehicle that has completely left the display area. On the other hand, if only a part of the preceding vehicle has left the display area, the captured image is not made to flash.

14. The non-transitory storage medium according to claim 13, wherein, The display control process includes the following process: when it is detected that the entire forward vehicle has left the display area, the captured image is made to flash after a certain period of time from the time of detection.

15. The non-transitory storage medium according to claim 13 or 14, wherein, The display control process includes the following process: when at least a portion of the preceding vehicle is detected to return from the outside to the inside of the display area, the captured image is made to be displayed without flickering after a certain period of time has elapsed since the detection.

16. The non-transitory storage medium according to claim 13, wherein, The display control process includes the following process: as the moving vehicle moves away from the display area, the flashing speed of the flashing display is increased.

17. The non-transitory storage medium according to claim 16, wherein, The display control process includes a process of increasing the flashing speed in stages.

Images