Display control device for vehicle, display control method for vehicle, and program product

Abstract

The invention provides a display control device for a vehicle, a display control method for a vehicle, and a program product. This display control device for a vehicle is provided with a display control unit that displays, in a display region provided in the periphery of a driver's seat of the vehicle, a first image indicating the peripheral situation of the vehicle assumed to be observed from a virtual viewpoint, and that displays, when a driving assistance function is activated, a first image indicating the peripheral situation of the vehicle when the driver assistance function is activated. A second image indicating a condition of a location of a driving assistance object is displayed at a position of the display region corresponding to the location.

Description

Technical Field

[0001] The present disclosure relates to a vehicle display control device, a vehicle display control method, and a vehicle display control program product. Background Art

[0002] Japanese Patent Gazette No. 6825709 discloses that information about the surroundings of a vehicle is obtained, and that a hypothetical image showing the surroundings of the vehicle as if the vehicle were viewed from above is generated using the obtained information about the surroundings of the vehicle. Furthermore, if a study on whether to implement automatic lane changes is started before the implementation of automatic lane changes, the display area of ​​the surroundings of the vehicle on the hypothetical image is widened compared to before the start of the study. Summary of the Invention

[0003] Problems to be solved by the invention

[0004] The technology described in Japanese Patent No. 6825709 generates a virtual image representing the surroundings of the vehicle and displays it on a display area located near the driver's seat. Meanwhile, while vehicles are known to include driving assistance features such as lane departure warnings, when these driving assistance features are in operation, information about the location of the driver's assistance target is not reflected in the virtual image. Therefore, even if a passenger observes the virtual image when these driving assistance features are in operation, it can be difficult to understand the current state of the driver's assistance target location.

[0005] The present disclosure aims to provide a vehicle display control device, a vehicle display control method, and a vehicle display control program product that can display the status of a location targeted for driving assistance in a manner that is easy for a passenger to understand when a driving assistance function is in operation.

[0006] Methods for solving problems

[0007] The first embodiment involves a display control device for a vehicle, which includes a display control unit that displays a first image representing the surrounding conditions of the vehicle, as assumed to be observed from an imaginary viewpoint, in a display area arranged around the driver's seat of the vehicle. When a driving assistance function is working, the display control unit displays a second image representing the conditions of the location at a position in the display area corresponding to the location of the driving assistance object.

[0008] In the vehicle display control device according to the first aspect, when the driving assistance function is in operation, the situation of the location to be assisted by driving can be displayed in a manner that is easy for the occupant to understand.

[0009] A vehicle display control device according to a second aspect is configured such that, in the first aspect, the second image is a captured image of the situation at the location or a schematic image schematically showing the situation at the location.

[0010] In the vehicle display control device according to the second aspect, the situation of the location where driving assistance is targeted can be grasped more specifically.

[0011] A vehicle display control device according to a third aspect is configured such that, in the first aspect or the second aspect, a layer for displaying the second image is different from a layer for displaying the first image.

[0012] In the vehicle display control device according to the third aspect, the second image can be displayed independently of the first image.

[0013] The vehicle display control device involved in the fourth embodiment is that in any one of the first to third embodiments, the driving assistance function is a lane departure warning function, and the display control unit gradually changes the display mode of the second image as the degree of departure of the vehicle from the driving lane increases.

[0014] In the vehicle display control device according to the fourth aspect, the degree of deviation from the driving lane can be more easily understood.

[0015] A vehicle display control device according to a fifth aspect is configured such that, in the fourth aspect, the display mode of the second image is changed by gradually increasing the size of the second image.

[0016] In the vehicle display control device according to the fifth aspect, the degree of deviation from the driving lane can be grasped at a glance.

[0017] A vehicle display control device according to a sixth aspect is the display control device according to the fifth aspect, wherein the display control unit performs a warning display when the size of the second image becomes equal to or larger than a threshold value.

[0018] In the vehicle display control device according to the sixth aspect, it is possible to warn the occupant of the vehicle leaving the driving lane.

[0019] The vehicle display control device involved in the seventh embodiment is that in any one of the first to third embodiments, the driving assistance function includes at least one of a lane departure warning function, a road sign recognition function, a lane change assistance function, a blind spot area monitoring function, an exit assistance function, a vehicle approach warning function, and an obstacle approach detection function.

[0020] The vehicle display control device involved in the seventh method is not limited to the lane departure warning function, but can also be applied to the road sign recognition function, lane change assistance function, blind spot area monitoring function, exit assistance function, vehicle approach warning function, and obstacle approach detection function.

[0021] The eighth embodiment involves a display control method for a vehicle, wherein a computer performs the following processing, namely: displaying a first image representing the surrounding conditions of the vehicle, as assumed to be observed from an imaginary viewpoint, in a display area arranged around the driver's seat of the vehicle; and when a driving assistance function is working, displaying a second image representing the conditions of the place at a position in the display area corresponding to the place of the driving assistance object.

[0022] The vehicle display control program product involved in the ninth embodiment causes a computer to perform the following processing, namely: displaying a first image representing the surrounding conditions of the vehicle, as assumed to be observed from a virtual viewpoint, in a display area arranged around the driver's seat of the vehicle; and when a driving assistance function is working, displaying a second image representing the conditions of the place at a position in the display area corresponding to the place of the driving assistance object.

[0023] Effects of the Invention

[0024] As described above, according to the present disclosure, when the driving assistance function is in operation, the situation of the location to be assisted by driving can be displayed in a manner that is easy for the occupant to understand. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is a schematic diagram showing a portion of the interior of a vehicle including the vehicle display control device according to the embodiment.

[0026] Figure 2 A diagram showing an example of a display area of ​​the first display unit according to the embodiment.

[0027] Figure 3 This is a block diagram showing an example of the hardware configuration of the vehicle display control device according to the embodiment.

[0028] Figure 4 This is a block diagram showing an example of the functional configuration of a vehicle display control device according to an embodiment.

[0029] Figure 5 A diagram showing an example of first to third virtual viewpoints according to the embodiment.

[0030] Figure 6 A diagram showing an example of a first image of the surrounding conditions of the vehicle displayed in the display area.

[0031] Figure 7 A diagram showing an example of a first image and a second image displayed in a display area.

[0032] Figure 8A This is a diagram showing an example of a display method in which the size of the second image is gradually increased according to the degree of separation, and shows a case where the degree of separation is small.

[0033] Figure 8B This figure shows a case where the degree of separation is medium, among the figures showing an example of a display method in which the size of the second image is gradually increased according to the degree of separation.

[0034] Figure 8C This is a diagram showing an example of a display method in which the size of the second image is gradually increased according to the degree of separation, and shows a case where the degree of separation is large.

[0035] Figure 9A for Figure 8A A magnification of the second image is shown.

[0036] Figure 9B for Figure 8B A magnification of the second image is shown.

[0037] Figure 9C for Figure 8C A magnification of the second image is shown.

[0038] Figure 10 This is a flowchart showing an example of the flow of processing by the vehicle display control program according to the embodiment. DETAILED DESCRIPTION

[0039] Hereinafter, a vehicle display control system 10 including a vehicle display control device 28 according to an embodiment will be described with reference to the accompanying drawings. Figure 1 The arrow UP in FIG. 1 indicates the upper side in the vehicle vertical direction, and the arrow RH indicates the right side in the vehicle width direction. In the following description, the up-down direction and the left-right direction refer to the up-down direction and the left-right direction, respectively.

[0040] Figure 1 1 is a schematic diagram showing a portion of the interior of the vehicle 12 including the vehicle display control device 28 according to the present embodiment. Figure 1 In the example of FIG, a state in which the front portion of the cabin of the vehicle 12 is viewed from the rear side of the vehicle is shown.

[0041] like Figure 1As shown, a dashboard 14 is provided at the front of the interior of a vehicle 12. The dashboard 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the vehicle right side of the dashboard 14. Specifically, in this embodiment, as an example, a right-hand drive vehicle is assumed, with the steering wheel 16 provided on the right side and the driver's seat located on the right side of the vehicle. However, the present invention is not limited to this embodiment and is also applicable to vehicles in which the driver's seat is located on the left side of the vehicle.

[0042] A windshield 18 is provided at the front end portion of the instrument panel 14. The windshield 18 extends in the vehicle vertical direction and the vehicle width direction and divides the vehicle cabin interior from the vehicle cabin exterior.

[0043] The right-side end of the windshield 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vehicle vertical direction, and the windshield 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. Furthermore, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. Furthermore, the left-side end of the windshield 18 is fixed to the front pillar on the left side of the vehicle.

[0044] The instrument panel 14 is provided with a first display unit 24 having a display area V1 for images. The first display unit 24 is located on the right side of the instrument panel 14 and comprises an instrument display positioned in front of the driver's seat. The first display unit 24 is connected to various instrumentation devices mounted on the vehicle 12 and is positioned so that it is within the field of view of the occupant (hereinafter referred to as the "driver") when they are looking forward. The display area V1 is visible to the driver in the driver's seat through the opening 17 of the steering wheel 16.

[0045] A second display unit 25 having an image display area V2 is provided on the instrument panel 14. The second display unit 25 is composed of a central display arranged at the center of the instrument panel 14 in the vehicle width direction.

[0046] A third display unit 26 having an image display area V3 is provided on the windshield 18. The third display unit 26 is located above the first display unit 24 in the vehicle and comprises a projection surface projected by a head-up display device. Specifically, a head-up display device capable of projecting images is provided on the vehicle front side of the instrument panel 14, and the image is projected from the head-up display device onto the third display unit 26 on the windshield 18. In other words, the third display unit 26 is provided as a portion of the windshield 18, serving as the projection surface of the head-up display device.

[0047] A sight line detection sensor 44 is provided on the steering wheel 16. The sight line detection sensor 44 is arranged so as to face the face of the driver sitting on the driver's seat.

[0048] The vehicle 12 is provided with a vehicle display control device 28 that constitutes the vehicle display control system 10. The vehicle display control device 28 of this embodiment is, for example, an ECU (Electronic Control Unit) that performs various controls. Furthermore, the vehicle display control device 28 of this embodiment is configured to display a first image representing the surrounding conditions of the vehicle, as viewed from a virtual viewpoint, in at least one of the display areas V1, V2, and V3 located around the driver's seat.

[0049] Hereinafter, as an example, a case where the first image and the second image (described later) according to the present embodiment are displayed on the first display unit 24 of the vehicle 12 will be described. Furthermore, the first image and the second image according to the present embodiment are not limited to being displayed on the first display unit 24, but may also be displayed on the second display unit 25 or the third display unit 26.

[0050] Figure 2 2 is a diagram showing an example of the display area V1 of the first display unit 24 according to the present embodiment.

[0051] like Figure 2 As shown, the vehicle display control device 28 displays an image showing the surrounding conditions of the vehicle 12 in the area X that is a part of the display area V1. As described above, the area X is an area that the driver in the driver's seat can visually check through the opening 17 of the steering wheel 16. Specifically, Figure 2 As shown, the center of the area visible between the upper edge ridgeline L1 and the lower edge ridgeline L2 of the opening 17 of the steering wheel 16 is area X. On the left and right of area X, meter displays M1 and M2 representing meters of the vehicle 12 are displayed.

[0052] Figure 3 2 is a block diagram showing an example of the hardware configuration of the vehicle display control device 28 according to the present embodiment.

[0053] like Figure 3As shown, the vehicle display control device 28 is configured to include a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32 as a memory, a RAM (Random Access Memory) 34, a storage 36, a communication interface (communication I / F) 38, and an input / output interface (input / output I / F) 40. These components are connected to each other via an internal bus 42 so as to be able to communicate with each other.

[0054] The CPU 30, an example of a hardware processor, executes various programs, controls various components, and functions as a peripheral information acquisition unit, a functional information acquisition unit, and a display control unit, described later. Specifically, the CPU 30 loads programs from the ROM 32 or storage 36 and executes them using the RAM 34 as a work area. Furthermore, the CPU 30 controls the various components described above and performs various computations according to the programs stored in the ROM 32 or storage 36.

[0055] ROM 32, an example of a memory, stores various programs and data. RAM 34, an example of a memory, temporarily stores programs and data as a work area. Storage 36, an example of a memory, is a non-transitory storage medium composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various programs and data, including an operating system. ROM 32 or storage 36 stores a vehicle display control program for implementing the vehicle display control process according to this embodiment.

[0056] The communication interface 38 is an interface for communicating between the vehicle display control device 28 and servers and other devices. For example, standards such as CAN (Controller Area Network), Ethernet (registered trademark), LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), and Wi-Fi (registered trademark) can be used.

[0057] The input / output interface 40 is connected to a sight line detection sensor 44, a first display unit 24, a second display unit 25, and a head-up display device 46. An image is projected onto the third display unit 26 via the head-up display device 46.

[0058] The gaze detection sensor 44 is mounted on the steering wheel 16 and is positioned so as to face the driver's face while seated. Furthermore, the gaze detection sensor 44 detects the occupant's gaze direction by identifying the occupant's eyes using principles such as corneal reflection and scleral reflection. Alternatively, the gaze detection sensor 44 may be mounted on the instrument panel 14.

[0059] The vehicle display control device 28 uses the above hardware resources to realize various functions. Figure 4 To explain.

[0060] Figure 4 2 is a block diagram showing an example of the functional configuration of the vehicle display control device 28 according to the present embodiment.

[0061] like Figure 4 As shown, the vehicle display control device 28 is configured to include, as functional components, a peripheral information acquisition unit 52, a functional information acquisition unit 54, and a display control unit 56. Each functional component is implemented by the CPU 30 reading and executing a vehicle display control program stored in the ROM 32 or the memory 36.

[0062] The surrounding information acquisition unit 52 acquires surrounding information indicating the surrounding conditions of the vehicle 12 (host vehicle). Specifically, the vehicle 12 is provided with a plurality of sensors capable of detecting the surrounding conditions, and the vehicle 12 acquires information detected by these sensors as the surrounding information.

[0063] The surrounding information also includes map information of the surroundings of the vehicle 12. The vehicle 12 is equipped with a GPS receiver for detecting the current location, and the surrounding information acquisition unit 52 obtains map information of the surroundings of the vehicle 12 by referring to the vehicle's location information and map data stored in an external server or storage 36.

[0064] Function information acquisition unit 54 acquires information related to the currently active driving assistance functions. Vehicle 12 is equipped with driving assistance functions. The "driving assistance functions" herein include, for example, at least one of a lane departure warning function, a road sign recognition function, a lane change assistance function, a blind spot monitoring function, a vehicle exit assistance function, a vehicle approach warning function, and an obstacle approach detection function.

[0065] The lane departure warning function is also known as the Lane Departure Alert (hereinafter referred to as "LDA"), for example. If the LDA determines that the vehicle 12 is likely to leave its lane, it issues a warning through a buzzer alarm, display, or other means to encourage the driver to take maneuvers to avoid the departure. LDA uses cameras, radar, and other devices installed on the vehicle 12 to monitor the vehicle's driving state and determine whether the vehicle 12 is likely to leave its lane.

[0066] The road sign recognition function is, for example, also called Road Sign Assist (hereinafter referred to as "RSA"). RSA displays road signs such as "maximum speed", "no exceeding", and "temporary stop" in the display area around the driver's seat. For example, when RSA determines that the vehicle 12 does not follow road signs such as "maximum speed", "no entry", or "red light", it will notify the driver of the situation of not following the road signs or red lights through a buzzer alarm, display, etc. In RSA, a camera or the like provided on the vehicle 12 is used to recognize the road signs or red lights, and to determine whether the vehicle 12 has followed the road signs or red lights.

[0067] The lane change assist function is also known as Lane Change Assist (hereinafter referred to as "LCA"), for example. LCA operates based on the driver's turn signal operation, monitoring surrounding vehicles during lane changes and providing steering assistance to avoid collisions. LCA uses cameras, radar, and other devices installed on vehicle 12 to monitor the area surrounding vehicle 12 and identify vehicles traveling in the lane of the lane being changed.

[0068] The blind spot monitoring function is also known as a Blind Spot Monitor (hereinafter referred to as "BSM"), for example. When BSM detects another vehicle (including a two-wheeled motor vehicle, bicycle, etc.) in a blind spot area, such as behind or to the side of vehicle 12, it notifies the driver by lighting or flashing the door mirror indicator lights of vehicle 12 or sounding a buzzer. BSM uses sensors installed on vehicle 12 to monitor the blind spot area of ​​vehicle 12 and identify other vehicles in the blind spot area.

[0069] The exit assist function is also known as Safe Exit Assist (hereinafter referred to as "SEA"), for example. When SEA identifies a bicycle or pedestrian approaching from behind the vehicle 12 while exiting the vehicle, it notifies the driver by lighting or flashing the door mirror indicators of the vehicle 12 or emitting a buzzer alarm. SEA uses sensors installed on the vehicle 12 to monitor the rear of the vehicle 12 and identify bicycles or pedestrians approaching from behind.

[0070] The vehicle approach warning function is, for example, also called a Pre-Collision System (hereinafter referred to as "PCS"). The PCS identifies the preceding vehicle of the vehicle 12, and when it is determined that the vehicles are too close, that is, the possibility of a collision is high, it notifies the driver through a buzzer alarm, a display, etc. In addition, the PCS is not limited to vehicles, and can also target motorized two-wheeled vehicles, bicycles, pedestrians, etc. In the PCS, a camera, a radar, etc. provided on the vehicle 12 is used to measure the vehicle-to-vehicle distance with the preceding vehicle, and based on the measured vehicle-to-vehicle distance, it is determined whether the possibility of a collision is high.

[0071] The obstacle approach detection function is, for example, also known as the Intelligent Clearance Sonar (hereinafter referred to as "ICS"). When the ICS determines that the distance between the vehicle 12 and an obstacle is close, that is, the possibility of a collision is high, such as when the vehicle is parked, the driver is notified by a buzzer alarm, display, etc. The ICS uses a sonar (also called a sensor) provided on the vehicle 12 to measure the distance to the obstacle, and based on the measured distance, determines whether the possibility of a collision is high. Furthermore, the obstacle approach detection function may also be, for example, a function for detecting the passing of a two-wheeled motor vehicle.

[0072] The display control unit 56 displays a first image representing the surrounding conditions of the host vehicle in a display area located around the driver's seat of the host vehicle. Here, the "first image representing the surrounding conditions of the host vehicle" is assumed to be an image viewed from a hypothetical viewpoint. As described above, the "display area located around the driver's seat of the host vehicle" is at least one of the display areas V1, V2, and V3.

[0073] A virtual viewpoint is a viewpoint set in a virtual space. In one example of this embodiment, the virtual viewpoint is set in a three-dimensional virtual space with the position of vehicle 12 (host vehicle) as the origin O. The virtual viewpoint can be defined by viewpoint coordinates and viewpoint angle (direction) in the virtual space.

[0074] Figure 5 3 is a diagram showing an example of the first virtual viewpoint C1 to the third virtual viewpoint C3 according to the present embodiment.

[0075] like Figure 5 As shown, the virtual coordinates of virtual viewpoints C1 to C3 are three-dimensional coordinates, with the vehicle 12's front-to-rear direction (travel direction) as the X-axis, the vehicle's width as the Y-axis, and the vehicle's vertical direction as the Z-axis. The viewpoint angle can be represented by a set of rotation angles (roll, pitch, and yaw) centered around each axis. Therefore, the display control unit 56 assumes that the surroundings of the vehicle 12 are viewed at a specific viewpoint angle based on specific viewpoint coordinates in virtual space, generates an image representing the surrounding conditions of the vehicle 12, and displays it in the display area.

[0076] The first virtual viewpoint C1 is the viewpoint from which the vehicle 12 is viewed from a higher position obliquely behind. For example, the viewpoint angle of the first virtual viewpoint C1 coincides with the direction of a line segment S1 passing through the viewpoint coordinates of the first virtual viewpoint C1 and the origin O, and the rotation angle (pitch angle) θ1 about the Y-axis is maximized. The display control unit 56 generates an image of a range R1 visible from the first virtual viewpoint C1 at a predetermined viewing angle φ, and displays the image in the display area as an image representing the surrounding conditions of the vehicle 12.

[0077] The second virtual viewpoint C2 is viewed from a position farther rearward than the first virtual viewpoint C1 and from a lower position than the first virtual viewpoint C1. As an example, the viewpoint angle of the second virtual viewpoint C2 coincides with the direction of a line segment S2 passing through the viewpoint coordinates of the second virtual viewpoint C2 and the origin O, and the rotation angle (pitch angle) θ2 about the Y-axis is smaller than the rotation angle θ1 of the first virtual viewpoint C1. Therefore, the second virtual viewpoint C2 is positioned further upward than the first virtual viewpoint C1. The display control unit 56 generates an image of a range R2 visible from the second virtual viewpoint C2 at a predetermined viewing angle φ and displays it in the display area as an image representing the surrounding conditions of the vehicle 12.

[0078] The third virtual viewpoint C3 is viewed from a position further rearward than the first and second virtual viewpoints C1 and C2, and is located lower than the first and second virtual viewpoints C1 and higher than the second virtual viewpoint C2. For example, the viewpoint angle of the third virtual viewpoint C3 matches that of the second virtual viewpoint C2. The display control unit 56 generates an image of a range R3 visible from the third virtual viewpoint C3 at a predetermined viewing angle φ, and displays the image in the display area as an image representing the surrounding conditions of the vehicle 12.

[0079] The display control unit 56 according to this embodiment sets any one of the first virtual viewpoint C1 to the third virtual viewpoint C3. For example, Figure 6 As shown, a first image 60 showing the surrounding conditions of the vehicle 12 is displayed in an area X which is a part of the display area V1 .

[0080] Figure 6 1 is a diagram showing an example of a first image 60 displayed in the area X and indicating the surrounding conditions of the vehicle 12 .

[0081] like Figure 6 As shown, the display control unit 56 displays a lane image 62 indicating the lane in which the vehicle 12 is traveling and a white line image 63 indicating the white lines dividing the lane as a first image 60, surrounding a vehicle image 61 indicating the vehicle 12. Furthermore, an image 64 indicating the traveling speed of the vehicle 12 and an image 65 indicating the gear position of the vehicle 12 are displayed above the lane image 62.

[0082] When the driving assistance function is activated, the display control unit 56 of this embodiment displays a second image representing the conditions of the location at a position in the display area corresponding to the location being assisted. In other words, the driving assistance function and the display in the display area are linked, allowing the driver to understand the conditions of the location being assisted simply by glancing at the display in the display area.

[0083] Here, the second image can be either a captured image or a schematic image. A captured image is an image obtained by a camera installed in vehicle 12 capturing the conditions of the location where driving assistance is provided. A schematic image, unlike a captured image, schematically depicts the conditions of the location where driving assistance is provided. Furthermore, a layer for displaying the second image is added to area X, and this layer is separate from the layer displaying the first image 60. This allows the driver to gain a more detailed understanding of the conditions of the location where driving assistance is provided.

[0084] In the following, reference is made to Figure 7The second image 66 displayed in area X of the display area V1, which is an example of a driving assistance function, when LDA is in operation will be specifically described. In the case of LDA, the driving assistance target location is the white lines on both sides or one side of the moving vehicle 12.

[0085] Figure 7 is a diagram showing an example of the first image 60 and the second image 66 displayed in the area X.

[0086] like Figure 7 As shown, when the LDA is in operation, the display control unit 56 displays a second image 66 at a position in the area X corresponding to the location containing the white line set as the target of the LDA. The second image 66 is an image showing the condition of the location containing the white line as the target. The second image 66 shows a state where a portion of the tire of the vehicle 12 has passed the white line and left the driving lane. By observing the second image 66 of the area X, the driver can understand the extent to which the vehicle has left the driving lane. In addition, although Figure 7 In the example of FIG, the second image 66 is shown as a schematic image, but an image obtained by actually photographing the white line and the tire condition may be displayed.

[0087] Furthermore, the display control unit 56 may be configured to gradually change the display mode of the second image 66 as the degree of deviation of the vehicle 12 from the driving lane increases. The degree of deviation can be represented, for example, by the distance the vehicle 12 has deviated from the driving lane (hereinafter referred to as the "departure distance"). The departure distance can be derived, for example, by identifying the driving lane of the vehicle 12 and specifying the position of the vehicle 12, based on the correspondence between the driving lane and the position of the vehicle 12. A threshold value can be applied to the departure distance to determine the degree of deviation.

[0088] In addition, as for the change of the display mode of the second image 66, as an example, it is also possible to Figures 8A to 8C as well as Figures 9A to 9C The size of the second image 66 is gradually increased as shown. At this time, the display control unit 56 may be configured to display a warning when the size of the second image 66 exceeds a threshold. The "threshold" mentioned here is set to an appropriate value based on past knowledge or experimental results.

[0089] Figures 8A to 8C , which is a diagram showing an example of a display method in which the size of the second image 66 is gradually increased according to the degree of separation. Figures 9A to 9C for, Figure 8A ~ to Figure 8C An enlarged view of the second image 66 is shown.

[0090] like Figure 8A as well as Figure 9A As shown, the display control unit 56 displays the second image 66 of the reference size when the degree of separation is small. Figure 8B as well as Figure 9B As shown, when the degree of separation is medium, the display control unit 56 displays the second image 66 of a larger size than the second image 66 displayed when the degree of separation is small. Figure 8C as well as Figure 9C As shown, when the degree of separation is large, the display control unit 56 displays the second image 66 of a larger size than the size of the second image 66 displayed when the degree of separation is medium. Figures 8A to 8C as well as Figures 9A to 9C In the example of , the image size is changed in three stages, but the size can be changed in two or more stages and is not particularly limited.

[0091] Here, it is preferable that the display control unit 56 performs a warning display when the size of the second image 66 becomes equal to or larger than the threshold value as described above. Figure 8C as well as Figure 9C In the example of , since the size of the second image 66 becomes greater than the threshold value when the degree of separation is large, a warning text is displayed. As the warning text, as an example, Figure 9C As shown, the message "Leaving the lane. Please return to the original lane." is displayed.

[0092] Furthermore, while the above description shows a display method in which the size of second image 66 gradually increases according to the degree of separation, the present invention is not limited to this. The display method of second image 66 may be changed, for example, by gradually changing the color of the image (e.g., gradually becoming darker or brighter) or by gradually changing the shape of the image (e.g., from a rectangle to an ellipse or vice versa). The display method of second image 66 may be changed in any manner as long as the driver can recognize the change in display method.

[0093] Furthermore, while the lane departure alert (LDA) function has been cited as an example of a driver assistance function in the above description, the present invention is not limited thereto. Other driver assistance functions, such as the road sign recognition function (RSA), lane change assist function (LCA), blind spot monitoring function (BSM), exit assist function (SEA), vehicle proximity warning function (PCS), and obstacle detection function (ICS), can also be similarly applied.

[0094] In the case of the Road Sign Recognition function (RSA), the second image 66 is an image showing the condition of a location including the target road sign. In the case of the Lane Change Assist function (LCA), the second image 66 is an image showing the condition of a location including the lane to which the driver is changing lanes. In the case of the Blind Spot Monitoring function (BSM), the second image 66 is an image showing the condition of a location that is a blind spot. In the case of the Exit Assist function (SEA), the second image 66 is an image showing the condition of a location that is a blind spot. In the case of the Proximity Warning function (PCS), the second image 66 is an image showing the condition of a location including an approaching vehicle. In the case of the Obstacle Proximity Detection function (ICS), the second image 66 is an image showing the condition of a location including an approaching obstacle.

[0095] Next, refer to Figure 10 , the function of the vehicle display control device 28 involved in this embodiment is described.

[0096] Figure 10 1 is a flowchart showing an example of the flow of processing performed by the vehicle display control program according to the present embodiment.

[0097] First, when the vehicle display control device 28 is instructed to execute the vehicle display control process, the CPU 30 starts up the vehicle display control program and executes the following steps.

[0098] exist Figure 10 In step S101, the CPU 30 obtains surrounding information indicating the surrounding conditions of the vehicle 12. Specifically, as described above, the vehicle 12 is provided with a plurality of sensors capable of detecting surrounding conditions, and information detected by these plurality of sensors is obtained as the surrounding information.

[0099] In step S102, as an example, the CPU 30 performs the Figure 6 As shown, a first image 60 representing the surrounding conditions of the vehicle 12 is generated based on the surrounding information acquired in step S101 , and the generated first image 60 is displayed in the area X.

[0100] In step S103, CPU 30 determines whether the driving assistance function is operating. If it is determined that the driving assistance function is operating (affirmative determination), the process proceeds to step S104. If it is determined that the driving assistance function is not operating (negative determination), the process returns to step S101 and repeats. As described above, the driving assistance function includes, for example, at least one of the following: lane departure alert (LDA), road sign recognition (RSA), lane change assist (LCA), blind spot monitoring (BSM), exit assist (SEA), proximity warning (PCS), and obstacle detection (ICS).

[0101] In step S104, as an example, the CPU 30 performs the Figure 7 As shown, a second image 66 representing the situation at the location where the driving assistance is targeted (e.g., a location including a white line as a target) is displayed, and the process returns to step S101 and repeats. Furthermore, in the case of the lane departure warning (LDA) function, the second image 66 is displayed in a manner that is consistent with the degree of lane departure.

[0102] In this way, according to this embodiment, when a driving assistance function is in operation, the status of the location where the driving assistance is being provided can be displayed in a manner that is easy for the occupant to understand. For example, when the Lane Departure Alert (LDA) function is in operation, the driver can clearly understand the extent to which the vehicle has deviated from its lane. By making it easy for the occupant to understand the status of the location where the driving assistance is being provided, the occupant can reduce driving errors and improve the driving experience.

[0103] In addition, the vehicle display control processing that is loaded with software (program) and executed by the CPU 30 in the above-mentioned embodiment may also be executed by various processors other than the CPU. As the processor in this case, FPGA (Field-Programmable Gate Array) and other PLD (Programmable Logic Device) whose circuit structure can be changed after manufacturing, and ASIC (Application Specific Integrated Circuit) and other processors with circuit structures specially designed for executing specific processing, i.e., dedicated circuits, etc. can be exemplified. In addition, the vehicle display control processing may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, a plurality of FPGAs, and a combination of a CPU and an FPGA, etc.). In addition, more specifically, the hardware structure of these various processors is a circuit that combines circuit elements such as semiconductor elements.

[0104] Furthermore, while the above embodiment describes a method in which the vehicle display control program is pre-stored (installed) in ROM 32 or storage 36 , the present invention is not limited thereto. The vehicle display control program may also be provided by being stored on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory device. Furthermore, the vehicle display control program may be downloaded from an external device via a network. The vehicle display control program may also be a program product.

[0105] Furthermore, the configuration of the vehicle display control device described in the above embodiment is merely an example and may be modified according to circumstances without departing from the spirit of the present invention.

[0106] Furthermore, the process flow of the program described in the above embodiment is merely an example, and unnecessary steps may be deleted, new steps may be added, or the process order may be changed without departing from the spirit of the invention.

Claims

1. A vehicle display control device comprising a display control unit configured to display a first image representing a surrounding situation of a host vehicle, as viewed from a virtual viewpoint, in a display area provided around a driver's seat of the host vehicle, The display control unit displays a second image indicating a situation of a location targeted for driving assistance at a position in the display area corresponding to the location targeted for driving assistance when the driving assistance function is activated.

2. The vehicle display control device according to claim 1, wherein: The second image is a captured image of the situation at the location, or a schematic image schematically showing the situation at the location.

3. The vehicle display control device according to claim 1, wherein: The layer displaying the second image is different from the layer displaying the first image.

4. The vehicle display control device according to claim 1, wherein: The driving assistance function is a lane departure warning function, The display control unit gradually changes the display mode of the second image as the degree to which the host vehicle deviates from the driving lane increases.

5. The vehicle display control device according to claim 4, wherein: The display mode of the second image is changed by gradually increasing the size of the second image.

6. The vehicle display control device according to claim 5, wherein: The display control unit performs a warning display when the size of the second image becomes equal to or larger than a threshold value.

7. The vehicle display control device according to claim 1, wherein: The driving assistance function includes at least one of a lane departure warning function, a road sign recognition function, a lane change assistance function, a blind spot monitoring function, a vehicle exit assistance function, a vehicle approach warning function, and an obstacle approach detection function.

8. A vehicle display control method, wherein a computer performs the following processing, namely: Displaying a first image representing a surrounding situation of the host vehicle, which is assumed to be viewed from a virtual viewpoint, in a display area provided around a driver's seat of the host vehicle, When the driving assistance function is in operation, a second image showing the situation of the location is displayed at a position in the display area corresponding to the location of the driving assistance target.

9. A vehicle display control program product, the program product being configured to cause a computer to execute the following processing, namely: Displaying a first image representing a surrounding situation of the host vehicle, which is assumed to be viewed from a virtual viewpoint, in a display area provided around a driver's seat of the host vehicle, When the driving assistance function is in operation, a second image showing the situation of the location is displayed at a position in the display area corresponding to the location of the driving assistance target.

Images