Vehicle display control device, vehicle display control method and vehicle display control program

Abstract

To display a situation of a location which is a target of operation support in an easily understandable manner when an operation support function is active.SOLUTION: A vehicle display control device comprises a display control section which displays a first image of a surrounding situation of an own vehicle viewed from a virtual view point on a display region installed around an operation seat. The display control section displays a second image of a situation of a location at a position on a display region corresponding to the location of a target of operation support when an operation support function is active.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present disclosure relates to a vehicle display control device, a vehicle display control method, and a vehicle display control program. [Background technology]

[0002] Patent document 1 discloses that information about the surroundings of the vehicle is acquired, and using the acquired information about the surroundings of the vehicle, a virtual image is generated that shows the surroundings of the vehicle as if viewed from above, and when consideration of whether or not to perform an automatic lane change begins before the automatic lane change, the display area of ​​the surroundings of the vehicle on the virtual image is made wider than before consideration began. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6825709 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the technology described in Patent Document 1, a virtual image showing the surroundings of a vehicle can be generated and displayed in a display area provided around the driver's seat. Meanwhile, vehicles equipped with driving assistance functions such as a lane departure warning function are known, but when this type of driving assistance function is activated, information about the location of the driving assistance target is not reflected in the virtual image. Therefore, even if an occupant views the virtual image when this type of driving assistance function is activated, it may be difficult for the occupant to understand the situation at the location of the driving assistance target.

[0005] The present disclosure aims to provide a vehicle display control device, a vehicle display control method, and a vehicle display control program that can display the situation of a location where driving assistance is required in a manner that makes it easy for occupants to understand when a driving assistance function is activated. [Means for solving the problem]

[0006] The vehicle display control device of claim 1 includes a display control unit that displays a first image showing the surrounding situation of the vehicle as seen from a virtual viewpoint in a display area provided around the driver's seat of the vehicle, and when a driving assistance function is activated, the display control unit displays a second image showing the situation of the location at a position in the display area corresponding to the location of the driving assistance target.

[0007] In the vehicle display control device according to claim 1, when the driving assistance function is activated, the situation of the location where the driving assistance is performed can be displayed in a manner that makes it easy for the occupant to understand.

[0008] A second aspect of the present invention provides the vehicle display control device according to the first aspect, wherein the second image is a captured image of the situation at the location, or a schematic image that schematically represents the situation at the location.

[0009] In the display control device for a vehicle according to claim 2, the situation of the location where driving assistance is required can be grasped more specifically.

[0010] A vehicular display control device according to claim 3 is in claim 1 or claim 2, wherein a layer that displays the second image is different from a layer that displays the first image.

[0011] In the vehicle display control device according to claim 3, the second image can be displayed independently of the first image.

[0012] The vehicle display control device of claim 4 is any one of claims 1 to 3, wherein the driving assistance function is a lane departure warning function, and the display control unit gradually changes the display form of the second image as the degree to which the vehicle deviates from the driving lane increases.

[0013] In the display control device for a vehicle according to claim 4, the degree of deviation from the driving lane can be more easily grasped.

[0014] A vehicular display control device according to claim 5 is the device of claim 4, wherein the change in the display form of the second image is a gradual increase in size of the second image.

[0015] In the display control device for a vehicle according to claim 5, it is possible to grasp at a glance the degree of deviation from the driving lane.

[0016] A sixth aspect of the present invention provides the vehicle display control device according to the fifth aspect, wherein the display control unit displays a warning when the size of the second image is equal to or larger than a threshold value.

[0017] The display control device for a vehicle according to claim 6 can warn the occupants that the vehicle is deviating from the driving lane.

[0018] The vehicle display control device of claim 7 is any one of claims 1 to 3, wherein the driving assistance function includes at least one of a lane departure warning function, a road sign recognition function, a lane change assistance function, a blind spot monitoring function, a disembarkation assistance function, a vehicle approach warning function, and an obstacle approach detection function.

[0019] The vehicle display control device according to claim 7 can be similarly applied not only to the lane departure warning function, but also to the road sign recognition function, lane change assistance function, blind spot monitoring function, disembarkation assistance function, vehicle approach warning function, and obstacle approach detection function.

[0020] The vehicle display control method of claim 8 is a method in which a computer executes a process to display a first image showing the surrounding situation of the vehicle as seen from a virtual viewpoint in a display area provided around the driver's seat of the vehicle, and when a driving assistance function is activated, to display a second image showing the situation of the location at a position in the display area corresponding to the location of the driving assistance target.

[0021] The display control program for a vehicle according to claim 9 causes a computer to execute a process of displaying a first image showing the surrounding situation of the vehicle as seen from a virtual viewpoint in a display area provided around the driver's seat of the vehicle, and when a driving assistance function is activated, displaying a second image showing the situation of the location at a position in the display area corresponding to the location of the driving assistance target. [Effects of the Invention]

[0022] As described above, according to the present disclosure, when a driving assistance function is activated, the situation of the location where driving assistance is to be performed can be displayed in a manner that makes it easy for the occupant to understand. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a schematic diagram showing a part of a vehicle interior including a vehicular display control device according to an embodiment; [Figure 2] FIG. 3 is a diagram illustrating an example of a display area of ​​a first display unit according to the embodiment. [Figure 3] 1 is a block diagram illustrating an example of a hardware configuration of a vehicle display control device according to an embodiment. [Figure 4] 1 is a block diagram illustrating an example of a functional configuration of a vehicle display control device according to an embodiment. [Figure 5] 3 is a diagram showing an example of first to third virtual viewpoints according to the embodiment. FIG. [Figure 6] FIG. 2 is a diagram showing an example of a first image showing the surroundings of a vehicle displayed in a display area. [Figure 7] 10A and 10B are diagrams illustrating an example of a first image and a second image displayed in a display area. [Figure 8] 10(A) to 10(C) are diagrams showing an example of a display form in which the size of the second image is gradually increased according to the degree of deviation. [Figure 9] 8(A) to 8(C) are enlarged views of the second images shown in FIG. 8(A) to 8(C). [Figure 10] 5 is a flowchart illustrating an example of a processing flow by a vehicle display control program according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0024] A vehicle display control system 10 including a vehicle display control device 28 according to an embodiment will be described below with reference to the drawings. Note that the arrow UP in Fig. 1 indicates the upper side in the vehicle vertical direction, and the arrow RH indicates the right side in the vehicle width direction. In the following description, the vertical direction and the left-right direction refer to the up and down in the vehicle vertical direction and the left and right in the vehicle width direction, respectively.

[0025] 1 is a schematic diagram showing a part of the interior of a vehicle 12 including a vehicle display control device 28 according to this embodiment. The example of FIG. 1 shows the front part of the interior of the vehicle 12 as seen from the rear side of the vehicle.

[0026] As shown in Fig. 1, an instrument panel 14 is provided in the front of the passenger compartment of a vehicle 12. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, the vehicle is a right-hand drive vehicle in which the steering wheel 16 is provided on the right side, and the driver's seat is located on the right side of the vehicle. However, the present invention is not limited to this, and may also be applied to a vehicle in which the driver's seat is located on the left side of the vehicle.

[0027] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 extends in the vertical direction and the width direction of the vehicle, and separates the interior of the vehicle from the exterior of the vehicle.

[0028] The right end of the windshield glass 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. In addition, the front ends of front side windows 22 are fixed to the outer end of the front pillar 20 in the vehicle width direction. The left end of the windshield glass 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0029] Here, the instrument panel 14 is provided with a first display unit 24 having an image display area V1. The first display unit 24 is configured as a meter display provided on the right side of the instrument panel 14, in front of the driver's seat. The first display unit 24 is connected to various meter devices mounted on the vehicle 12, and is provided in a position within the field of view of an occupant (hereinafter also referred to as the "driver") when the driver is looking ahead of the vehicle. The display area V1 is an area visible to the driver in the driver's seat through the opening 17 of the steering wheel 16.

[0030] The instrument panel 14 is provided with a second display unit 25 having an image display area V2. The second display unit 25 is configured by a center display disposed in the center of the instrument panel 14 in the vehicle width direction.

[0031] The windshield glass 18 is provided with a third display unit 26 having an image display area V3. The third display unit 26 is set above the first display unit 24 and is configured as a projection surface onto which an image is projected by a head-up display device (not shown) serving as a display device. Specifically, a head-up display device capable of projecting an image is provided on the vehicle front side of the instrument panel 14, and an image is projected from this head-up display device onto the third display unit 26 of the windshield glass 18. In other words, the third display unit 26 is configured as part of the windshield glass 18 that serves as the projection surface for the head-up display device.

[0032] The steering wheel 16 is provided with a gaze detection sensor 44. The gaze detection sensor 44 is disposed so as to face the face of the driver seated in the driver's seat.

[0033] Here, the vehicle 12 is provided with a vehicle display control device 28 that constitutes the vehicle display control system 10. The vehicle display control device 28 of this embodiment is, for example, an ECU (Electronic Control Unit) that performs various controls. The vehicle display control device 28 of this embodiment is configured to display a first image that shows the surrounding situation of the vehicle as seen from a virtual viewpoint in at least one of display areas V1, V2, and V3 around the driver's seat.

[0034] The following describes, as an example, a case where a first image and a second image (described later) according to this embodiment are displayed on the first display unit 24 of the vehicle 12. Note that the first image and the second image according to this embodiment may be displayed not only on the first display unit 24 but also on the second display unit 25 or the third display unit 26.

[0035] FIG. 2 is a diagram showing an example of the display region V1 of the first display unit 24 according to the present embodiment.

[0036] As shown in Fig. 2, the vehicle display control device 28 displays an image showing the surrounding conditions of the vehicle 12 in area X, which is a portion of the display area V1. As described above, area X is the area that can be seen by the driver in the driver's seat through the opening 17 of the steering wheel 16. Specifically, as shown in Fig. 2, area X is the center of the area that can be seen between the ridge line L1 at the upper edge and the ridge line L2 at the lower edge of the opening 17 of the steering wheel 16. Meter displays M1 and M2 that show the meters of the measuring instruments of the vehicle 12 are displayed on the left and right of area X.

[0037] FIG. 3 is a block diagram showing an example of the hardware configuration of the vehicular display control device 28 according to this embodiment.

[0038] 3, the vehicle display control device 28 includes a CPU (Central Processing Unit: processor) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, a communication interface (communication I / F) 38, and an input / output interface (input / output I / F) 40. Each component is connected to each other via an internal bus 42 so as to be able to communicate with each other.

[0039] The CPU 30 is a central processing unit that executes various programs and controls each part. That is, the CPU 30 reads programs from the ROM 32 or storage 36 and executes the programs using the RAM 34 as a work area. The CPU 30 also controls the above-mentioned components and performs various arithmetic processing in accordance with the programs recorded in the ROM 32 or storage 36.

[0040] The ROM 32 stores various programs and various data. The RAM 34 temporarily stores programs or data as a working area. The storage 36 is configured by an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and is a non-transitory storage medium that stores various programs including an operating system and various data. The ROM 32 or the storage 36 stores a vehicle display control program for performing the vehicle display control process according to this embodiment.

[0041] The communication interface 38 is an interface that allows the vehicle display control device 28 to communicate with a server and other devices, and uses standards such as CAN (Controller Area Network), Ethernet (registered trademark), LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), and Wi-Fi (registered trademark).

[0042] The input / output interface 40 is connected to a gaze detection sensor 44, the first display unit 24, the second display unit 25, and a head-up display device 46. An image is projected onto the third display unit 26 by the head-up display device 46.

[0043] The gaze detection sensor 44 is provided on the steering wheel 16 and is positioned facing the face of the driver seated in the driver's seat. The gaze detection sensor 44 detects the gaze direction of the occupant by recognizing the eyes of the occupant using principles such as the corneal reflex method and the scleral reflex method. The gaze detection sensor 44 may also be provided on the instrument panel 14.

[0044] The vehicular display control device 28 uses the above hardware resources to realize various functions. The functional configuration realized by the vehicular display control device 28 will be described with reference to FIG.

[0045] FIG. 4 is a block diagram showing an example of the functional configuration of the vehicular display control device 28 according to this embodiment.

[0046] 4, the vehicular display control device 28 is configured to include, as functional components, a peripheral information acquisition unit 52, a function information acquisition unit 54, and a display control unit 56. Note that each functional component is realized by the CPU 30 reading and executing a vehicular display control program stored in the ROM 32 or the storage 36.

[0047] The surrounding information acquisition unit 52 acquires surrounding information indicating the surrounding conditions of the vehicle 12 (host vehicle). Specifically, the vehicle 12 is provided with a plurality of sensors capable of detecting the surrounding conditions, and information detected by these sensors is acquired as the surrounding information.

[0048] The surrounding information also includes map information of the surroundings of the vehicle 12. The vehicle 12 is provided with a GPS receiver for determining the current location, and the surrounding information acquisition unit 52 acquires map information of the surroundings of the vehicle 12 by referring to the vehicle's location information and map data stored in an external server or storage 36.

[0049] The function information acquisition unit 54 acquires information about the driving assistance functions that are in operation. The vehicle 12 is equipped with driving assistance functions. The "driving assistance functions" referred to here include, for example, at least one of a lane departure warning function, a road sign recognition function, a lane change assistance function, a blind spot monitoring function, a vehicle exit assistance function, a vehicle approach warning function, and an obstacle approach detection function.

[0050] The lane departure warning function is also known as a Lane Departure Alert (hereinafter referred to as "LDA"). When the LDA determines that there is a possibility that the vehicle 12 will depart from its lane, it issues a warning to the driver by means of a buzzer, a display, etc., to urge the driver to take action to avoid the departure. The LDA monitors the driving state of the vehicle 12 using a camera, radar, etc., provided on the vehicle 12, and determines whether there is a possibility that the vehicle 12 will depart from its lane.

[0051] The road sign recognition function is also known as Road Sign Assist (hereinafter referred to as "RSA"). RSA displays road signs such as "Maximum Speed," "No Crossing," and "Stop" in a display area around the driver's seat. If RSA determines that the vehicle 12 is not obeying a road sign such as "Maximum Speed," "No Entry," or a "Red Light," it notifies the driver by sounding a buzzer, displaying a display, or the like that the vehicle 12 is not obeying the road sign or red light. RSA recognizes road signs or red lights using a camera or the like installed on the vehicle 12 and determines whether the vehicle 12 is obeying the road sign or red light.

[0052] The lane change assist function is also known as Lane Change Assist (hereinafter referred to as "LCA"). LCA is activated in response to the driver's turn signal operation, monitors surrounding vehicles while changing lanes, and provides steering assistance to prevent collisions. LCA uses cameras, radar, etc. installed on the vehicle 12 to monitor the area around the vehicle 12 and recognizes vehicles traveling in the lane to which the vehicle is changing.

[0053] The blind spot monitoring function is also known as a blind spot monitor (hereinafter referred to as "BSM"), for example. When the BSM detects another vehicle (including a motorcycle, bicycle, etc.) in a blind spot, such as behind or to the side of the vehicle 12, it notifies the driver by turning on or flashing the door mirror indicator of the vehicle 12, or by sounding a buzzer. The BSM monitors the blind spot of the vehicle 12 using sensors and the like provided on the vehicle 12, and detects other vehicles in the blind spot.

[0054] The disembarking assistance function is also known as Safe Exit Assist (hereinafter referred to as "SEA"), for example. When SEA detects a bicycle, pedestrian, etc. approaching from behind the vehicle 12 when disembarking, it notifies the driver by turning on or flashing the door mirror indicator of the vehicle 12, or by sounding a buzzer alarm. SEA uses sensors and the like provided in the vehicle 12 to monitor the rear of the vehicle 12 and detects bicycles, pedestrians, etc. approaching from behind.

[0055] The vehicle approach warning function is also known as a Pre-Collision System (hereinafter referred to as "PCS"). The PCS recognizes the vehicle ahead of the vehicle 12, and if it determines that the vehicle is too close, that is, that there is a high possibility of a collision, it notifies the driver by a buzzer alarm, display, etc. Note that the PCS is not limited to vehicles, but also targets motorcycles, bicycles, pedestrians, etc. The PCS measures the distance between the vehicle and the leading vehicle using a camera, radar, etc. provided on the vehicle 12, and determines whether there is a high possibility of a collision based on the measured distance.

[0056] The obstacle approach detection function is a function also called, for example, Intelligent Clearance Sonar (hereinafter referred to as "ICS"). For example, when traveling at low speed, such as during parking, if the ICS determines that the distance between the vehicle 12 and an obstacle is close, i.e., that there is a high possibility of a collision, it notifies the driver by means of a buzzer alarm, a display, or the like. The ICS measures the distance to the obstacle using a sonar (also referred to as a sensor) provided in the vehicle 12, and determines whether there is a high possibility of a collision based on the measured distance. The obstacle approach detection function may also be, for example, a function to detect a motorcycle passing by.

[0057] The display control unit 56 displays a first image showing the surrounding conditions of the host vehicle in a display area provided around the driver's seat of the host vehicle. Here, the "first image showing the surrounding conditions of the host vehicle" is an image assumed to be viewed from a virtual viewpoint. As described above, the "display area provided around the driver's seat of the host vehicle" is at least one of the display areas V1, V2, and V3.

[0058] The virtual viewpoint is a viewpoint set in a virtual space. In one example of this embodiment, the virtual viewpoint is set in a three-dimensional virtual space with the position of the vehicle 12 (host vehicle) as the origin O. This virtual viewpoint can be defined by viewpoint coordinates and a viewpoint angle (orientation) in the virtual space.

[0059] FIG. 5 is a diagram showing an example of the first to third virtual viewpoints C1 to C3 according to this embodiment.

[0060] As shown in Figure 5, the virtual coordinates of the virtual viewpoints C1 to C3 are three-dimensional coordinates with the fore-and-aft direction (travel direction) of the vehicle 12 as the X axis, the vehicle width direction as the Y axis, and the vehicle up-and-down direction as the Z axis. The viewpoint angle can be expressed as a set of rotation angles (roll, pitch, and yaw angles) around each axis. Therefore, the display control unit 56 generates an image showing the surroundings of the vehicle 12, assuming that the surroundings of the vehicle 12 are viewed at a specific viewpoint angle from specific viewpoint coordinates in the virtual space, and displays the image in the display area.

[0061] The first virtual viewpoint C1 is a viewpoint from which the vehicle 12 is viewed from a high position diagonally rearward. As an example, the viewpoint angle of the first virtual viewpoint C1 coincides with the direction of a line segment S1 passing through the viewpoint coordinates of the first virtual viewpoint C1 and the origin O, and the rotation angle (pitch angle) θ1 around the Y axis is greatest. The display control unit 56 generates an image of the range R1 visible from the first virtual viewpoint C1 at a predetermined angle of view φ, and displays it in the display area as an image showing the surrounding conditions of the vehicle 12.

[0062] The second virtual viewpoint C2 is a viewpoint seen from a position further rearward than the first virtual viewpoint C1 and lower than the first virtual viewpoint C1. As an example, the viewpoint angle of the second virtual viewpoint C2 coincides with the direction of a line segment S2 passing through the viewpoint coordinates of the second virtual viewpoint C2 and the origin O, and the rotation angle (pitch angle) θ2 around the Y axis is smaller than the rotation angle θ1 of the first virtual viewpoint C1. Therefore, the second virtual viewpoint C2 is a viewpoint facing upward than the first virtual viewpoint C1. The display control unit 56 generates an image of the range R2 visible from the second virtual viewpoint C2 at a predetermined angle of view φ and displays it in the display area as an image showing the surrounding conditions of the vehicle 12.

[0063] The third virtual viewpoint C3 is a viewpoint seen from a position further rearward than the first virtual viewpoint C1 and the second virtual viewpoint C2, and is a viewpoint seen from a position lower than the first virtual viewpoint C1 and higher than the second virtual viewpoint C2. As an example, the viewpoint angle of the third virtual viewpoint C3 matches that of the second virtual viewpoint C2. The display control unit 56 generates an image of the range R3 visible from the third virtual viewpoint C3 at a predetermined angle of view φ, and displays it in the display area as an image showing the surrounding conditions of the vehicle 12.

[0064] The display control unit 56 in this embodiment sets one of the first virtual viewpoint C1 to the third virtual viewpoint C3, and, as an example, displays a first image 60 showing the surrounding situation of the vehicle 12 in an area X, which is a part of the display area V1, as shown in FIG. 6.

[0065] FIG. 6 is a diagram showing an example of a first image 60 displayed in the area X, which shows the surroundings of the vehicle 12. As shown in FIG.

[0066] 6, the display control unit 56 displays, as a first image 60, a lane image 62 indicating the lane in which the vehicle 12 is traveling and a white line image 63 indicating the white lines dividing the lane, around a host vehicle image 61 indicating the vehicle 12. In addition, above the lane image 62, an image 64 indicating the traveling speed of the vehicle 12 and an image 65 indicating the gearshift position of the vehicle 12 are displayed.

[0067] When the driving assistance function is operating, the display control unit 56 according to this embodiment displays a second image representing the situation of the location where the driving assistance is to be performed at a position in the display area corresponding to the location. In other words, the driving assistance function and the display in the display area are linked, and the driver can grasp the situation of the location where the driving assistance is to be performed at a glance at the display in the display area.

[0068] Here, the second image may be a photographed image or a schematic image. The photographed image is an image captured by a camera installed in the vehicle 12, depicting the situation at the location where driving assistance is to be performed. Unlike the photographed image, the schematic image is an image that schematically depicts the situation at the location where driving assistance is to be performed. Furthermore, a layer for displaying the second image is added to the area X, and the layer displaying the second image is different from the layer displaying the first image 60. This allows the driver to specifically grasp the situation at the location where driving assistance is to be performed.

[0069] 7, a second image 66 that is displayed in area X of display area V1, which is an example of a display area, when LDA, an example of a driving assistance function, is operating will be specifically described. In the case of LDA, the location of the driving assistance target is a white line located on either side or both sides of the vehicle 12 while it is moving.

[0070] FIG. 7 is a diagram showing an example of the first image 60 and the second image 66 displayed in the area X. As shown in FIG.

[0071] As shown in FIG. 7, when LDA is operating, the display control unit 56 displays a second image 66 at a position in an area X corresponding to a location including a white line targeted by LDA. The second image 66 is an image that shows the situation at the location including the targeted white line. The second image 66 shows a state in which a portion of the tire of the vehicle 12 crosses the white line and deviates from the driving lane. By looking at the second image 66 in the area X, the driver can understand the extent to which the vehicle has deviated from the driving lane. Note that, although the example in FIG. 7 shows the second image 66 as a schematic image, an actual photograph of the white line and the tire situation may also be displayed.

[0072] Furthermore, the display control unit 56 may gradually change the display mode of the second image 66 as the degree to which the vehicle 12 deviates from the driving lane increases. Here, the degree of deviation can be represented, for example, by the distance by which the vehicle 12 deviates from the driving lane (hereinafter referred to as "deviation distance"). For example, the deviation distance can be derived by recognizing the driving lane of the vehicle 12 and identifying the position of the vehicle 12, and then deriving the deviation distance from the correspondence relationship between the driving lane and the position of the vehicle 12. The degree of deviation can be determined by determining the deviation distance against a threshold value.

[0073] As an example of the change in the display mode of the second image 66, the size of the second image 66 may be gradually increased as shown in Figures 8(A) to 8(C) and 9(A) to 9(C). In this case, the display control unit 56 may display a warning when the size of the second image 66 becomes equal to or larger than a threshold value. The "threshold value" here is set to an appropriate value based on past knowledge or experimental results.

[0074] Figures 8(A) to 8(C) are diagrams showing an example of a display form in which the size of the second image 66 is gradually increased according to the degree of deviation. Also, Figures 9(A) to 9(C) are enlarged views of the second image 66 shown in Figures 8(A) to 8(C).

[0075] As shown in FIGS. 8(A) and 9(A), when the degree of deviation is small, the display control unit 56 displays a second image 66 of a standard size. Next, as shown in FIGS. 8(B) and 9(B), when the degree of deviation is medium, the display control unit 56 displays a second image 66 of a size larger than the size of the second image 66 displayed when the degree of deviation is small. Next, as shown in FIGS. 8(C) and 9(C), when the degree of deviation is large, the display control unit 56 displays a second image 66 of a size larger than the size of the second image 66 displayed when the degree of deviation is medium. Note that, although the image size is changed in three stages in the examples of FIGS. 8(A) to 8(C) and 9(A) to 9(C), it is not particularly limited as long as it is changed in two or more stages.

[0076] Here, as described above, it is desirable that the display control unit 56 displays a warning when the size of the second image 66 exceeds a threshold value. In the examples of Fig. 8(C) and Fig. 9(C), when the degree of deviation is large, the size of the second image 66 exceeds the threshold value, and therefore a warning message is displayed. As an example of this warning message, as shown in Fig. 9(C), "You have departed from your lane. Please return to your original lane." is displayed.

[0077] Although the above describes a display mode in which the size of the second image 66 gradually increases depending on the degree of deviation, the present invention is not limited to this. The change in the display mode of the second image 66 may be, for example, a gradual change in the color of the image or a gradual change in the shape of the image (for example, from a rectangle to an ellipse). The change in the display mode of the second image 66 may be any change that allows the driver to recognize the change in display mode.

[0078] Although the above description has been given with reference to the Lane Departure Warning (LDA) function as an example of a driving assistance function, the present invention is not limited to this. As described above, other driving assistance functions may be applied in the same manner, such as the Road Sign Recognition (RSA), Lane Change Assist (LCA), Blind Spot Monitoring (BSM), Exit Assist (SEA), Pre-Carriage Control System (PCS), and Intrusion Detection System (ICS).

[0079] In the case of the road sign recognition function (RSA), the second image 66 is an image that represents the situation of a location including a target road sign. In the case of the lane change assist function (LCA), the second image 66 is an image that represents the situation of a location including the lane to which the vehicle is to be changed. In the case of the blind spot monitoring function (BSM), the second image 66 is an image that represents the situation of a location that will become a blind spot. In the case of the disembarkation assist function (SEA), the second image 66 is an image that represents the situation of a location that will become a blind spot. In the case of the vehicle proximity warning function (PCS), the second image 66 is an image that represents the situation of a location that will include an approaching vehicle. In the case of the obstacle proximity detection function (ICS), the second image 66 is an image that represents the situation of a location that will include an approaching obstacle.

[0080] Next, the operation of the vehicle display control device 28 according to this embodiment will be described with reference to FIG.

[0081] FIG. 10 is a flowchart showing an example of a processing flow of the vehicle display control program according to this embodiment.

[0082] First, when the vehicular display control device 28 is instructed to execute the vehicular display control process, the CPU 30 starts up the vehicular display control program and executes the following steps.

[0083] 10, the CPU 30 acquires surrounding information indicating the surrounding conditions of the vehicle 12. Specifically, as described above, the vehicle 12 is provided with a plurality of sensors capable of detecting the surrounding conditions, and information detected by these sensors is acquired as the surrounding information.

[0084] In step S102, the CPU 30 generates a first image 60 showing the surrounding conditions of the vehicle 12 from the surrounding information acquired in step S101, as shown in FIG. 6 above, for example, and displays the generated first image 60 in area X.

[0085] In step S103, the CPU 30 determines whether or not a driving assistance function is operating. If it is determined that the driving assistance function is operating (in the case of a positive determination), the process proceeds to step S104, and if it is determined that the driving assistance function is not operating (in the case of a negative determination), the process returns to step S101 and repeats the process. As described above, the driving assistance function includes at least one of, for example, a lane departure warning function (LDA), a road sign recognition function (RSA), a lane change assist function (LCA), a blind spot monitoring function (BSM), a vehicle exit assist function (SEA), a proximity control system (PCS), and an obstacle detection system (ICS).

[0086] In step S104, the CPU 30 displays the second image 66 representing the situation of the location where the driving assistance is to be performed (for example, a location including the target white line) in the position of the area X corresponding to the location, as shown in Fig. 7 described above, and then returns to step S101 to repeat the process. Note that in the case of the lane departure warning function (LDA), the second image 66 is displayed in a manner according to the degree of departure.

[0087] In this way, according to this embodiment, when the driving assistance function is activated, the situation of the location where the driving assistance is performed can be displayed in a manner that makes it easy for the occupants to understand. For example, when the lane departure warning function (LDA) is activated, the driver can grasp at a glance how far the vehicle has deviated from the driving lane.

[0088] In the above embodiment, the vehicular display control process executed by the CPU 30 by reading software (programs) may be executed by various processors other than a CPU. Examples of such processors include a programmable logic device (PLD) (such as a field-programmable gate array (FPGA)) whose circuit configuration can be changed after manufacture, and a dedicated electrical circuit such as an application-specific integrated circuit (ASIC) that is a processor having a circuit configuration specifically designed to execute a specific process. The vehicular display control process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor elements.

[0089] In the above embodiment, the vehicle display control program is pre-stored (installed) in the ROM 32 or the storage 36, but the present invention is not limited to this. The vehicle display control program may be provided in a form stored in a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The vehicle display control program may also be downloaded from an external device via a network.

[0090] Furthermore, the configuration of the vehicular display control device described in the above embodiment is merely an example, and may be changed depending on the situation without departing from the spirit of the invention.

[0091] Furthermore, the processing flow of the program described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged within the scope of the main idea. [Explanation of symbols]

[0092] 28 Vehicle display control device 56 Display control unit 60 First Image 66 Second image C1~C3 Virtual viewpoint V1~V3 display area

Claims

1. a display control unit that displays a first image showing a surrounding situation of the host vehicle as seen from a virtual viewpoint in a display area provided around a driver's seat of the host vehicle; the display control unit, when the driving assistance function is activated, displays a second image representing a situation of the location at a position in the display area corresponding to a location that is a driving assistance target. Vehicle display control device.

2. The second image is a photographed image of the situation of the location, or a schematic image that schematically represents the situation of the location. The vehicle display control device according to claim 1 .

3. the layer displaying the second image is different from the layer displaying the first image; The vehicle display control device according to claim 1 .

4. the driving assistance function is a lane departure warning function, the display control unit gradually changes the display form of the second image as the degree to which the host vehicle deviates from a driving lane increases. The vehicle display control device according to claim 1 .

5. the change in the display form of the second image is a gradual increase in the size of the second image; The vehicle display control device according to claim 4.

6. the display control unit displays a warning when the size of the second image is equal to or larger than a threshold value. The vehicle display control device according to claim 5 .

7. The driving assistance function includes at least one of a lane departure warning function, a road sign recognition function, a lane change assistance function, a blind spot monitoring function, a vehicle exit assistance function, a vehicle approach warning function, and an obstacle approach detection function. The vehicle display control device according to claim 1 .

8. a first image showing a surrounding situation of the host vehicle as seen from a virtual viewpoint is displayed in a display area provided around a driver's seat of the host vehicle; When the driving assistance function is activated, a second image representing a situation of the location is displayed at a position in the display area corresponding to the location of the driving assistance target. A vehicle display control method in which processing is executed by a computer.

9. a first image showing a surrounding situation of the host vehicle as seen from a virtual viewpoint is displayed in a display area provided around a driver's seat of the host vehicle; When the driving assistance function is activated, a second image representing a situation of the location is displayed at a position in the display area corresponding to the location of the driving assistance target. A vehicle display control program for causing a computer to execute processing.

Images