Vehicular display control device, vehicular display system, vehicular display control method, and program

Abstract

To provide a vehicular display control device, a vehicular display system, a vehicular display control method, and a program which can achieve an early recognition of a new obstacle.SOLUTION: A vehicular display control device has an obstacle information acquisition part which acquires information related to an obstacle around a vehicle, an information display part which displays the information with respect to an image of the obstacle displayed on an indoor display device, and an information erase part which erases the display of the information when the acceleration of the vehicle is reduced more than a predetermined threshold in a state where the information is displayed.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a vehicle display control device, a vehicle display system, a vehicle display control method, and a program. [Background technology]

[0002] Patent Document 1 discloses a vehicle display device that detects an obstacle ahead of the vehicle and displays it on a display unit. In the vehicle display device described in Patent Document 1, the image display update cycle is made shorter for obstacles that require caution than for obstacles that do not require caution. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-24573 Summary of the Invention [Problem to be solved by the invention]

[0004] In a configuration in which obstacle information is displayed in front of the occupant, such as the device described in Patent Document 1, the occupant can quickly recognize the obstacle. On the other hand, if another obstacle that requires attention appears, the occupant may be late in recognizing the obstacle.

[0005] An object of the present invention is to provide a vehicle display control device, a vehicle display system, a vehicle display control method, and a program that enable a new obstacle to be recognized early. [Means for solving the problem]

[0006] The vehicle display control device of claim 1 includes an obstacle information acquisition unit that acquires information about obstacles around the vehicle, an information display unit that superimposes the information on an image of the obstacle displayed on a display inside the vehicle cabin, and an information erasure unit that erases the display of the information when the vehicle's acceleration decelerates by more than a predetermined amount while the information is displayed.

[0007] In the vehicle display control device according to claim 1, information about the obstacle is superimposed on an image of the obstacle displayed on a display inside the vehicle, thereby enabling the occupants to quickly recognize the obstacle around the vehicle.

[0008] Furthermore, when the vehicle decelerates by a predetermined amount or more while the information is displayed, the display of the information is erased. As a result, when a new obstacle appears around the vehicle, the information is superimposed only on the new obstacle, allowing the occupant to quickly become aware of the new obstacle.

[0009] The vehicle display control device according to claim 2 is the device of claim 1, which erases the display of information when the absolute value of the deceleration is greater than a predetermined value, or when the deceleration per unit time is equal to or greater than a predetermined value.

[0010] In the vehicle display control device according to claim 2, the occupant can erase the display by simply operating the brake pedal.

[0011] A third aspect of the present invention provides a display control device for a vehicle according to the first or second aspect of the present invention, wherein the information is image information that alerts the driver of the vehicle to the obstacle.

[0012] The vehicle display control method of claim 4 obtains information about obstacles around the vehicle by a computer, superimposes the information on the position of the obstacle as seen by the occupant in a display area inside the vehicle, and erases the display of the information when the vehicle's acceleration decelerates by a predetermined amount or more while the information is displayed.

[0013] The program according to claim 5 causes a computer to execute the following process: acquire information about obstacles in both surrounding areas, superimpose the information on the position of the obstacle as seen by the occupant in a display area inside the vehicle cabin, and erase the display of the information when the vehicle's acceleration decreases by more than a predetermined amount while the information is displayed. [Effects of the Invention]

[0014] As described above, the vehicle display control device, vehicle display system, vehicle display control method, and program according to the present invention enable a new obstacle to be recognized at an early stage. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a schematic diagram of a front portion of a vehicle interior of a vehicle to which a vehicular display system according to an embodiment is applied, viewed from the rear side of the vehicle. [Figure 2] 1 is a block diagram showing a hardware configuration of a vehicle display control device according to an embodiment; [Figure 3] 1 is a block diagram showing a functional configuration of a vehicle display control device according to an embodiment; [Figure 4] FIG. 10 is a diagram showing a display example of a display area in the embodiment, showing an example in which information about a first obstacle is displayed. [Figure 5] FIG. 10 is a diagram showing a display example of a display area in the embodiment, showing an example in which information about a first obstacle is erased. [Figure 6] FIG. 10 is a diagram showing a display example of a display area in the embodiment, showing an example in which information about a second obstacle is displayed. [Figure 7] 10 is a flowchart illustrating an example of the flow of a display control process according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0016] A vehicular display system 10 according to an embodiment will be described with reference to the drawings. The arrow UP in Fig. 1 indicates the upper side in the vertical direction of the vehicle, and the arrow RH indicates the right side in the width direction of the vehicle. The vertical and left-right directions in the following description refer to the up and down directions in the vertical direction of the vehicle and the left and right directions in the width direction of the vehicle, respectively.

[0017] 1, an instrument panel 14 is provided in the front portion of the cabin of a vehicle 12. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, the vehicle is a right-hand drive vehicle in which the steering wheel 16 is provided on the right side, and the driver's seat is located on the right side of the vehicle.

[0018] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 extends in the vertical direction and the width direction of the vehicle, and separates the interior of the vehicle from the exterior of the vehicle.

[0019] The right end of the windshield glass 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. In addition, the front ends of front side windows 22 are fixed to the outer end of the front pillar 20 in the vehicle width direction. The left end of the windshield glass 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0020] Here, a first display unit 24 having an image display area V1 is provided on the instrument panel 14. The first display unit 24 is configured as a meter display provided in front of the driver's seat on the vehicle right side of the instrument panel 14. The first display unit 24 is connected to various meter devices mounted on the vehicle 12, and is provided in a position within the driver's field of view when the driver is looking forward.

[0021] The instrument panel 14 is provided with a second display unit 25 having an image display area V2. The second display unit 25 is configured by a center display disposed in the center of the instrument panel 14 in the vehicle width direction.

[0022] The windshield glass 18 is provided with a third display unit 26 having an image display area V3. The third display unit 26 is set above the first display unit 24 and is configured as a projection surface onto which an image is projected by a head-up display device 52 (see FIG. 2 ). Specifically, the head-up display device 52 capable of projecting an image is provided on the vehicle front side of the instrument panel 14, and an image is projected from the head-up display device 52 onto the third display unit 26 of the windshield glass 18. In other words, the third display unit 26 is configured as part of the windshield glass 18 that serves as the projection surface for the head-up display device 52.

[0023] Here, the vehicle 12 is provided with a vehicle display control device 28 that constitutes the vehicle display system 10. The vehicle display control device 28 of this embodiment is, for example, an ECU (Electronic Control Unit) that performs various controls.

[0024] (Hardware configuration of the vehicle display control device 28) 2, the vehicle display control device 28 includes a CPU (Central Processing Unit: processor) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, a communication interface (communication I / F) 38, and an input / output interface (input / output I / F) 40. Each component is connected to each other via an internal bus 42 so as to be able to communicate with each other.

[0025] The CPU 30 is a central processing unit that executes various programs and controls each part. That is, the CPU 30 reads programs from the ROM 32 or storage 36 and executes the programs using the RAM 34 as a work area. The CPU 30 also controls the above-mentioned components and performs various arithmetic processing in accordance with the programs recorded in the ROM 32 or storage 36.

[0026] The ROM 32 stores various programs and various data. The RAM 34 temporarily stores programs or data as a working area. The storage 36 is configured by an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is a non-temporary recording medium that stores various programs including an operating system and various data. In this embodiment, the ROM 32 or the storage 36 stores a display program for performing display processing, etc. Furthermore, various input / output devices are connected to the input / output interface 38.

[0027] The input / output interface 38 is connected to a line-of-sight detection sensor 44, a steering angle sensor 46, an acceleration sensor 48, a surroundings detection sensor 50, the first display unit 24, the second display unit 25, and a head-up display device 52. An image is projected onto the third display unit 26 by the head-up display device 52.

[0028] The gaze detection sensor 44 is provided, for example, on the instrument panel 14, and is arranged facing the face of the occupant (driver) seated in the driver's seat. The gaze detection sensor 44 detects the gaze direction of the occupant by recognizing the eyes of the occupant using principles such as the corneal reflex method and the scleral reflex method.

[0029] The steering angle sensor 46 is a sensor that acquires the steering direction of the vehicle 12, and acquires the steering direction of the vehicle by detecting, for example, the steering angle of the steering wheel 16. The acceleration sensor 48 detects the acceleration of the vehicle 12.

[0030] The surroundings detection sensor 50 is a sensor that detects the surrounding conditions of the vehicle 12. The surroundings detection sensor 50 is, for example, at least one sensor selected from various sensors such as a camera, a radar, and a LIDAR (Light Detection and Ranging or Laser Imaging Detection and Ranging). This includes the sansa.

[0031] The cameras include a front camera that captures images in front of the vehicle and a rear camera that captures images behind the vehicle. The radar uses radio waves to detect the distance and direction to objects around the vehicle 12. The lidar uses laser light to detect the distance and direction to objects around the vehicle 12.

[0032] (Functional configuration of the vehicle display control device 28) The vehicular display control device 28 uses the above hardware resources to realize various functions. The functional configuration realized by the vehicular display control device 28 will be described with reference to FIG.

[0033] 3, the vehicle display control device 28 is configured to include, as functional components, an obstacle information acquisition unit 54, an information display unit 56, a line of sight direction acquisition unit 58, a steering direction acquisition unit 60, an acceleration acquisition unit 62, and an information deletion unit 64. Each functional component is realized by the CPU 30 reading and executing a program stored in the ROM 32 or the storage 36.

[0034] The obstacle information acquisition unit 54 acquires information about a plurality of obstacles around the vehicle. Specifically, the obstacle information acquisition unit 54 acquires information about obstacles around the vehicle 12 detected by the periphery detection sensor 50. For example, the obstacle information acquisition unit 54 acquires image data of the area in front of the vehicle captured by a front camera. The obstacle information acquisition unit 54 also acquires data about the positions of obstacles detected by radar, lidar, or the like.

[0035] The information display unit 56 displays information superimposed on a display area provided in front of the occupant at the position of the obstacle as seen from the occupant. In the present embodiment, as an example, the information display unit 56 displays information about the obstacle in the display area V3 of the third display unit 26. Furthermore, for example, the information display unit 56 may calculate the position of the superimposed display based on the line-of-sight direction of the occupant acquired from the line-of-sight detection sensor 44 in order to display an image ahead of the line of sight of the occupant.

[0036] Fig. 4 is a diagram showing an example of a display in which information about an obstacle is displayed in display area V3. As shown in Fig. 4, display area V3 shows the view ahead of the vehicle through windshield glass 18. For ease of explanation, only the view visible in display area V3 is shown, but in reality, the view ahead of the vehicle is not separated by the boundary of third display section 26.

[0037] In the display region V3, the head-up display device 52 displays a mark M1 and a mark M2. The mark M1 is displayed superimposed on the feet of the pedestrian P1 who has been determined to be an obstacle based on the information acquired by the obstacle information acquisition unit 54, and in this embodiment, the mark M1 is displayed in a substantially circular shape, for example. The color of the mark M1 is set to change depending on the distance from the vehicle 12. For example, if the pedestrian P is located further away from the vehicle 12 than a predetermined distance, the mark M1 is displayed in green, and if the pedestrian P is located within the predetermined distance from the vehicle 12, the mark M1 is displayed in red. In this way, the mark M1 alerts the driver to individual obstacles.

[0038] In addition to the mark M1, information about the obstacle may be displayed. For example, the information display unit 56 may display the distance to the obstacle near the mark M1. The information display unit 56 may also display the type of obstacle near the mark M1.

[0039] The mark M2 displays the current speed of the vehicle 12 detected by a vehicle speed sensor (not shown). Note that the mark M2 does not necessarily have to be displayed.

[0040] 3 acquires the gaze direction of the occupant. Specifically, the gaze direction acquisition unit 58 acquires information relating to the gaze direction of the occupant detected by the gaze detection sensor 44.

[0041] The steering direction acquisition unit 60 acquires the steering direction of the vehicle 12. Specifically, the steering direction acquisition unit 60 acquires information related to the steering angle detected by the steering angle sensor 46.

[0042] The acceleration acquisition unit 62 acquires the acceleration of the vehicle 12. Specifically, the acceleration acquisition unit 62 acquires information related to the acceleration of the vehicle 12 detected by the acceleration sensor 48.

[0043] When a predetermined condition is satisfied while information about an obstacle is displayed in the display area, the information erasing unit 64 determines that the occupant has recognized the obstacle and erases the display of the information. Specifically, as an example in the present embodiment, the information erasing unit 64 erases the display of the information when the occupant's line of sight acquired by the line of sight direction acquiring unit 58 is directed toward the obstacle for a predetermined period of time. At this time, the color, shape, etc. of the mark M1 may be changed while the occupant's line of sight is directed toward the pedestrian P1.

[0044] Furthermore, the information erasing unit 64 erases the display of the information when the steering direction of the vehicle 12 acquired by the steering direction acquisition unit 60 is a direction away from the obstacle. Note that if the steering angle has not changed significantly before and after the detection of the pedestrian P1, which is an obstacle, the display may continue even if the traveling direction of the vehicle 12 is a direction away from the obstacle. In other words, the display of the information may be erased only when, after the mark M1 is displayed, the steering angle has changed by a predetermined threshold or more and the steering direction of the vehicle 12 is a direction away from the obstacle.

[0045] Furthermore, the information erasing unit 64 erases the display of information when the acceleration of the vehicle 12 acquired by the acceleration acquiring unit 62 decelerates by a predetermined value or more. Note that the display of information may be erased when the absolute value of the deceleration is greater than a predetermined value, or when the deceleration per unit time is greater than a predetermined value, such as during sudden braking.

[0046] Fig. 5 is a diagram showing an example of a display when it is determined that the occupant has recognized a pedestrian P1 as an obstacle from the state shown in Fig. 4. As shown in Fig. 5, the mark M1 displayed by the head-up display device 52 has been erased by the information erasing unit 64. If the distance to the obstacle and the type of obstacle are simultaneously displayed, the information erasing unit 64 also erases the display of the distance and type together with the mark M1.

[0047] Fig. 6 is a diagram showing a display example when a pedestrian P2 appears as a new obstacle in the state shown in Fig. 5. As shown in Fig. 6, a mark M3 is displayed in the display area V3 by the head-up display device 52. The mark M3 is displayed superimposed on the feet of the pedestrian P2 who has been determined to be an obstacle from the information acquired by the obstacle information acquisition unit 54, and the mark M3 in this embodiment is displayed, for example, in a substantially circular shape similar to the mark M1.

[0048] (action) Next, the operation of this embodiment will be described.

[0049] (Display control processing) An example of a display control process for displaying and erasing the mark M1 on the third display unit 26, which is the projection screen of the head-up display device 52, will be described with reference to the flowchart shown in Fig. 7. This display process is executed by the CPU 30 reading a display program from the ROM 32 or storage 36, and expanding and executing the program in the RAM 34. The display process is also executed repeatedly at predetermined time intervals.

[0050] In step S102, the CPU 30 acquires information about the obstacle. Specifically, the CPU 30 acquires information about the position and type of the obstacle detected by the perimeter detection sensor 50 using the function of the obstacle information acquisition unit 54.

[0051] In step S104, the CPU 30 determines whether or not an obstacle is present. Here, if an obstacle that should be displayed in the display area V3 is detected, the CPU 30 determines that an obstacle is present and proceeds to processing in step S106. Since the pedestrian P1 walking in front of the right of the vehicle 12 is an obstacle that should be displayed in the display area V3, the CPU 30 determines that an obstacle is present and proceeds to processing in step S106.

[0052] On the other hand, if no obstacle to be displayed in the display area V3 is detected in step S104, the CPU 30 determines that there is no obstacle and terminates the display control process. For example, even if there is no pedestrian P1 and an obstacle is detected behind the vehicle 12 by the rear camera, if the obstacle is not to be displayed in the display area V3, the CPU 30 terminates the display control process.

[0053] In step S106, the CPU 30 displays a mark M1 superimposed on the pedestrian P1, who is an obstacle. Specifically, the CPU 30 displays information by projecting a predetermined image onto the display area V3 of the third display unit 26 using the function of the information display unit 56 on the head-up display device 52. The information display unit 56 also displays the information superimposed on the position of the obstacle as seen by the occupant.

[0054] In step S108, the CPU 30 determines whether the occupant has recognized an obstacle. Specifically, the CPU 30 determines that the occupant has recognized an obstacle when the occupant's line of sight, acquired by the function of the line of sight direction acquisition unit 58, is directed toward the pedestrian P1 for a predetermined period of time.

[0055] Furthermore, when the steering direction of the vehicle 12 acquired by the function of the steering direction acquisition unit 60 is a direction away from the pedestrian P1, the CPU 30 determines that the occupant has recognized an obstacle.

[0056] Furthermore, the CPU 30 determines that the occupant has recognized an obstacle when the acceleration of the vehicle 12 acquired by the function of the acceleration acquisition unit 62 has decreased by a predetermined value or more.

[0057] If the CPU 30 determines in step S108 that the occupant has recognized the obstacle, it proceeds to processing in step S110. If the CPU 30 determines in step S108 that the occupant has not recognized the obstacle, it proceeds to processing in step S106, and continues to display the mark M1. Note that if the obstacle for which information is being displayed moves out of the display area, the mark M1 is erased because there is no longer an object for which information is to be displayed.

[0058] The CPU 30 erases the mark M1 in step S110. Specifically, the CPU 30 stops the projection of an image from the head-up display device 52 onto the display region V3 by using the function of the information erasure unit 64. Then, the CPU 30 ends the display control process. Note that since the display control process is repeatedly executed at predetermined time intervals, if another pedestrian P2 appears after the mark M1 is erased in step S110, the display control process is executed again and the process proceeds from step S102 to step S106, whereby the mark M2 is superimposed on the pedestrian P2.

[0059] As described above, in the vehicular display system 10 and the vehicular display control device 28 according to this embodiment, information about obstacles is superimposed on the display area V3 provided in front of the occupant, thereby enabling the occupant to quickly recognize obstacles around the vehicle.

[0060] Furthermore, when the occupant recognizes an obstacle while information is displayed in the display area V3, the information display is cleared. As a result, when a new obstacle appears around the vehicle, information is superimposed only on the new obstacle, allowing the occupant to recognize the new obstacle early.

[0061] In this embodiment, if the occupant looks at the obstacle for a predetermined period of time, the information display is erased. This eliminates the need for the occupant to perform any special operation to erase the display. For example, the occupant does not need to move their hand to erase the display.

[0062] Furthermore, in this embodiment, when the occupant steers the vehicle 12 in a direction away from the obstacle, the information display is erased as it indicates that an obstacle has been recognized. This allows the occupant to erase the display simply by operating the steering wheel 16. In other words, the occupant can erase the display simply by performing normal driving.

[0063] Furthermore, in this embodiment, when the occupant decelerates the vehicle 12, the display of the information is erased as it indicates that an obstacle has been recognized. This allows the occupant to erase the display simply by operating the brake pedal.

[0064] In this embodiment, information about the obstacle is displayed in a display area V3 that is a part of the windshield glass 18. This allows the occupant to recognize the obstacle information without significantly moving their line of sight ahead of the vehicle. In particular, in this embodiment, the information display unit 56 functions to cause the head-up display device 52 to project an image onto the windshield glass 18, thereby displaying the obstacle information. In addition, the information erasing unit 64 functions to stop the projection of the image from the head-up display device 52 onto the windshield glass 18, thereby making it possible to hide the obstacle information.

[0065] The above describes the vehicular display system 10 and the vehicular display control device 28 according to the embodiment. However, it goes without saying that the present invention can be embodied in various forms without departing from the spirit and scope of the present invention. For example, in the above embodiment, the information erasure unit 64 erases the mark M1 when at least one of the following conditions is met: when the occupant's line of sight is directed toward an obstacle for a predetermined period of time, when the vehicle 12 is steered away from the obstacle, and when the acceleration of the vehicle 12 is decelerated by a predetermined amount or more. However, this is not limiting. The mark M1 may be erased when two of the above three conditions are met. Alternatively, the mark M1 may be erased only when all three of the above conditions are met.

[0066] In the above embodiment, the mark M1 is displayed in a substantially circular shape as shown in Fig. 4, but is not limited to this. For example, a mark resembling an arrow may be displayed above the head of the pedestrian P. Furthermore, different individual marks may be displayed for pedestrians and motorcycles.

[0067] Furthermore, in the above embodiment, a configuration in which information is superimposed on the display area V3 of the third display unit 26 has been described, but the present invention is not limited to this. For example, a configuration in which information is superimposed on the display area V1 of the first display unit 24 or the display area V2 of the second display unit 25 may be adopted. In this case, the information is superimposed on an image of the surroundings of the vehicle 12 captured by a front camera or the like. [Explanation of symbols]

[0068] 10. Vehicle display system 12 vehicles 18 Windshield glass 28 Vehicle display control device 52 Head-up display device 54 Obstacle information acquisition unit 56 Information display section 58 Gaze direction acquisition unit 60 Steering direction acquisition unit 62 Acceleration acquisition section 64 Information Erasure Unit V1 display area V2 represents the domain. V3 indicates the domain

Claims

1. An obstacle information acquisition unit that acquires information about obstacles around the vehicle, An information display unit that superimposes the information on the image of the obstacle displayed on the in-vehicle display, at least in the height direction, When the vehicle decelerates while the aforementioned information is displayed, an information erasure unit erases the display of the aforementioned information. A vehicle display control device having the following features.

2. The vehicle display control device according to claim 1, wherein the information erasure unit erases the display of information when the absolute value of the vehicle's deceleration is greater than a predetermined value, or when the deceleration per unit time exceeds a predetermined value.

3. The vehicle display control device according to claim 1 or 2, wherein the information is image information that prompts the driver of the vehicle to pay attention to the obstacle.

4. By computer, Obtain information about obstacles around the vehicle, The information is superimposed on the image of the obstacle displayed on the in-vehicle display, at least in the height direction. When the vehicle decelerates while the aforementioned information is displayed, the display of the aforementioned information is cleared. A method for controlling vehicle displays.

5. Obtain information about obstacles around the vehicle, The information is superimposed on the image of the obstacle displayed on the in-vehicle display, at least in the height direction. When the vehicle decelerates while the aforementioned information is displayed, the display of the aforementioned information is cleared. A program that instructs a computer to perform a process.

Images