Vehicle display device, vehicle display system, vehicle display method, and non-transitory storage medium storing program

Through vehicle display devices and systems, and by utilizing obstacle information acquisition and display switching technology, the problem of drivers having difficulty identifying obstacles when there are many of them is solved, and effective reminders and identification of key obstacles during driving are achieved, thereby improving driving safety.

CN115503745BActive Publication Date: 2025-09-19TOYOTA JIDOSHA KK
View PDF 3 Cites -1 Cited by

Patent Information

Application Number
CN202210426505.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-06-04
Filing Date
2022-04-22
Publication Date
2025-09-19
Estimated Expiration
2042-04-22

AI Technical Summary

Technical Problem

When there are many obstacles, existing technologies make it difficult for the driver to effectively identify obstacles around the vehicle. Especially when the driver's vision is obstructed, existing display technology may lead to the risk of difficulty in observing obstacles.

Method used

Through the vehicle display device and system, the obstacle information acquisition unit obtains obstacle information around the vehicle and displays individual and group signs in the vehicle cabin. The display mode is switched according to the characteristics and number of obstacles to ensure that the driver can identify key obstacles.

Benefits of technology

Even when there are many obstacles, by switching between displaying individual signs and group signs, the driver can be effectively reminded of key obstacles, reducing visual obstruction, improving obstacle recognition efficiency, and ensuring driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115503745B_ABST
    Figure CN115503745B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a vehicle display device, a vehicle display system, a vehicle display method, and a non-transitory storage medium storing a program. The vehicle display device of the present invention acquires information about multiple obstacles on both sides via an obstacle information acquisition unit. A sign display unit displays a predetermined individual sign (M1) that draws attention to each obstacle in an overlapping manner on a display area within the vehicle cabin. Furthermore, if specified conditions are met, the sign display unit displays a predetermined group sign (M3) that draws attention to each obstacle in an overlapping manner for each of the multiple obstacles.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a vehicle display device, a vehicle display system, a vehicle display method, and a non-transitory storage medium storing a program. Background Art

[0002] Japanese Patent Application Laid-Open No. 2009-248721 discloses a technology for displaying a virtual image superimposed on the driver's field of view using a head-up display device. In Japanese Patent Application Laid-Open No. 2009-248721, when the visibility of an obstacle from the driver is high, a frame-shaped display image is displayed, and when the visibility of the obstacle is low, a display image simulating the obstacle is displayed at the location of the obstacle.

[0003] However, if display images (marks) are displayed for all obstacles when there are many obstacles, there is a risk that the driver may find it difficult to see the obstacles. Summary of the Invention

[0004] The present disclosure aims to provide a vehicle display device, a vehicle display system, a vehicle display method, and a non-transitory storage medium storing a program that enable a driver to appropriately recognize obstacles even when there are many obstacles.

[0005] The first form of the vehicle display device includes: an obstacle information acquisition unit for acquiring information about multiple obstacles around the vehicle; and a sign display unit for causing the display area within the vehicle to overlap and display a prescribed individual sign for individually drawing attention to the above-mentioned obstacles, and when prescribed conditions are met, causing a prescribed group sign for drawing attention to multiple of the above-mentioned obstacles to be overlapped and displayed.

[0006] In the first embodiment of the vehicle display device, an obstacle information acquisition unit acquires information regarding multiple obstacles surrounding the vehicle. Furthermore, the sign display unit displays a predetermined individual sign superimposed on the display area within the vehicle cabin. Furthermore, when predetermined conditions are met, the sign display unit displays a predetermined group sign superimposed on the display. Here, an individual sign is used to call attention to a single obstacle, while a group sign is used to call attention to multiple obstacles. Furthermore, these individual and group signs can serve as a warning to the driver, directing their attention to obstacles surrounding the vehicle.

[0007] Furthermore, by switching the display from a single sign to a group sign when specified conditions are met, even when there are many obstacles, it is possible to prevent the driver from seeing the obstacles. Furthermore, the term "overlay display" is not limited to a configuration in which obstacles visible through the windshield are overlaid, but is a broad concept encompassing configurations in which images of obstacles are overlaid on displays within the vehicle cabin, for example.

[0008] A second aspect of the vehicle display device is configured such that, in addition to the first aspect, the sign display unit displays the group sign based on the information acquired by the obstacle information acquisition unit when a plurality of obstacles approach.

[0009] In the vehicle display device of the second aspect, by displaying the group mark for a plurality of approaching obstacles, the driver can collectively recognize the plurality of obstacles approaching the driver as a group of obstacles.

[0010] A vehicle display device according to a third aspect is configured such that, in addition to the first aspect or the second aspect, the sign display unit displays the individual sign for the obstacle having a distance from the vehicle of a predetermined value or less.

[0011] The vehicle display device of the third aspect displays individual marks for obstacles that are closer to the vehicle, thereby allowing the driver to recognize obstacles that require more attention even when there are a large number of obstacles.

[0012] A fourth aspect of the vehicle display device is configured as follows: in addition to any one of the first to third aspects, the sign display unit displays the individual sign for the obstacle when a person is walking or traveling toward the vehicle.

[0013] The fourth aspect of the vehicle display device displays separate signs for obstacles such as pedestrians walking toward the vehicle and bicycles traveling toward the vehicle, thereby allowing the driver to identify obstacles that require more attention even when there are a large number of obstacles.

[0014] A fifth aspect of the vehicle display device is configured such that, in addition to any one of the first to fourth aspects, the sign display unit displays the group sign when the number of obstacles is equal to or greater than a predetermined value.

[0015] In the vehicle display device of the fifth aspect, the group mark is displayed when the number of obstacles is equal to or greater than a predetermined value, and thus the driver can quickly recognize that the number of obstacles is large.

[0016] A sixth aspect of a vehicle display system includes the vehicle display device according to any one of the first to fifth aspects, and a display unit provided in a vehicle cabin and having the display area for displaying at least one of the individual sign and the group sign via the sign display unit.

[0017] In the sixth aspect of the vehicle display system, the sign display unit of the vehicle display device displays at least one of the individual sign and the group sign in the display area within the vehicle cabin.

[0018] The seventh form of the vehicle display system is constructed as follows: on the basis of the sixth form, the above-mentioned display area is constructed to include an area that projects an image in front of the driver's line of sight through a head-up display device, and the above-mentioned sign display unit displays the above-mentioned individual sign and at least one of the above-mentioned group sign overlapping with the above-mentioned obstacle.

[0019] In the vehicle display system of the seventh aspect, when the driver directs his or her line of sight forward, at least one of the individual mark and the group mark is displayed superimposed on the obstacle ahead. This allows the driver to recognize information about the obstacle without changing his or her line of sight.

[0020] The eighth form of the vehicle display system is constructed as follows: on the basis of the sixth form, the display area is constructed to include a display arranged on the instrument panel, and the sign display unit displays the individual sign and at least one of the group sign together with the image of the obstacle on the display.

[0021] In the eighth aspect of the vehicle display system, at least one of an individual sign and a group sign is displayed on a display mounted on the instrument panel. This reduces the inconvenience caused by the individual sign and the group sign when the driver is looking forward, compared to a configuration where the individual sign and the group sign are displayed superimposed on the actual obstacle.

[0022] The ninth form of the vehicle display method is configured to obtain information about a plurality of obstacles around the vehicle, and for each of the plurality of obstacles, display at least one of a prescribed individual mark for drawing attention to a single obstacle and a prescribed group mark for drawing attention to a plurality of obstacles in a display area within the vehicle.

[0023] The 10th form of a non-temporary storage medium storing a program causes a computer to perform the following processing: obtaining information about multiple obstacles around the vehicle, and for each of the multiple obstacles, displaying at least one of a prescribed individual sign for drawing attention to a single obstacle and a prescribed group sign for drawing attention to multiple obstacles in a display area within the vehicle.

[0024] As described above, according to the vehicle display device, vehicle display system, vehicle display method, and non-transitory storage medium storing a program according to the present disclosure, it is possible to enable a driver to appropriately recognize an obstacle.

[0025] Exemplary embodiments of the present disclosure will be described in detail based on the following drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 This is a schematic diagram showing the front portion of a vehicle cabin in a vehicle to which the vehicle display system according to the embodiment is applied, as viewed from the rear side of the vehicle.

[0027] Figure 2 This is a block diagram showing the hardware configuration of a vehicle display device according to an embodiment.

[0028] Figure 3 This is a block diagram showing the functional configuration of a vehicle display device according to an embodiment.

[0029] Figure 4 1 is a diagram showing a display example of a display area in the embodiment, and is a diagram showing an example of displaying a separate mark.

[0030] Figure 5 1 is a diagram showing a display example of a display area in the embodiment, and is a diagram showing an example of displaying a group mark.

[0031] Figure 6 This is a flowchart showing an example of the flow of display processing in the embodiment.

[0032] Figure 7 It is a diagram showing a display example of the vehicle display device according to the first modification.

[0033] Figure 8 It is a diagram showing a display example of the vehicle display device according to the second modification. DETAILED DESCRIPTION

[0034] The vehicle display system 10 according to the embodiment will be described with reference to the accompanying drawings. Figure 1 The arrow UP indicates the upper side in the vehicle vertical direction, and the arrow RH indicates the right side in the vehicle width direction. The vertical direction and the left-right direction in the following description refer to the up-down direction and the left-right direction, respectively.

[0035] like Figure 1As shown, a dashboard 14 is provided at the front portion of the interior of a vehicle 12. The dashboard 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the vehicle right side of the dashboard 14. That is, in this embodiment, as an example, a right-hand drive vehicle is provided with the steering wheel 16 on the right side, and the driver's seat is set on the right side of the vehicle.

[0036] A windshield 18 is provided at the front end portion of the instrument panel 14. The windshield 18 extends in the vehicle vertical direction and the vehicle width direction to partition the vehicle cabin interior from the vehicle cabin exterior.

[0037] The right-side end of the windshield 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. Furthermore, the front end of the front side window 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. Furthermore, the left-side end of the windshield 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0038] Here, the instrument panel 14 is provided with a first display unit 24 having an image display area V1. The first display unit 24 is composed of an instrument display that is provided in front of the driver's seat on the right side of the instrument panel 14. The first display unit 24 is connected to various instrument devices installed in the vehicle 12 and is provided in a position that is within the driver's field of view when the driver is looking toward the front of the vehicle.

[0039] The instrument panel 14 is provided with a second display unit 25 having an image display area V2. The second display unit 25 is composed of a central display arranged in the center of the instrument panel 14 in the vehicle width direction.

[0040] The third display unit 26 having an image display area V3 is provided on the windshield 18. The third display unit 26 is set on the upper side of the vehicle with respect to the first display unit 24 and is displayed by the head-up display device 44 (see FIG. Figure 2 ) projection surface. Specifically, a head-up display device 44 is provided on the vehicle front side of the instrument panel 14, and an image is projected from the head-up display device 44 onto the third display unit 26 of the windshield 18. In other words, the third display unit 26 is a portion of the windshield 18 that serves as the projection surface for the head-up display device 44.

[0041] Here, a vehicle display device 28 constituting the vehicle display system 10 is provided in the vehicle 12. The vehicle display device 28 of the present embodiment is, for example, an ECU (Electronic Control Unit) that performs various controls.

[0042] (Hardware Configuration of Vehicle Display Device 28)

[0043] like Figure 2 As shown, the vehicle display device 28 includes a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage device 36, a communication interface (communication I / F) 38, and an input / output interface (input / output I / F) 40. These components are interconnected for communication via an internal bus 42.

[0044] The CPU 30 is a central processing unit that executes various programs and controls various components. Specifically, the CPU 30 reads programs from the ROM 32 or storage device 36 and executes them using the RAM 34 as a work area. Furthermore, the CPU 30 controls the various components described above and performs various calculations based on the programs stored in the ROM 32 or storage device 36.

[0045] ROM 32 stores various programs and data. RAM 34 temporarily stores programs and data as a work area. Storage device 36, comprised of an HDD (Hard Disk Drive) or SSD (Solid State Drive), is a non-temporary recording medium that stores various programs and data, including the operating system. In this embodiment, display programs for display processing, etc., are stored in ROM 32 or storage device 36. Furthermore, various input and output devices are connected to input and output interface 38.

[0046] The first display unit 24, the second display unit 25, the head-up display device 44, and the sensors 46 are connected to the input / output interface 38. The head-up display device 44 projects an image onto the third display unit 26.

[0047] Sensors 46 include a plurality of sensors selected from various categories, such as cameras, radars, LIDAR (Light Detection and Ranging or Laser Imaging Detection and Ranging), and GPS (Global Positioning System) sensors. The cameras capture images of the surroundings of vehicle 12. The cameras in this embodiment include at least a front camera that captures images of the vehicle's forward direction.

[0048] Radar uses radio waves to detect the distance and direction to objects around vehicle 12. LiDAR uses laser light to detect the distance and direction to objects around vehicle 12. A GPS sensor detects the current location of vehicle 12. Sensors 46 also include sensors that detect the position of a passenger's line of sight.

[0049] (Functional Structure of Vehicle Display Device 28)

[0050] The vehicle display device 28 realizes various functions using the above-mentioned hardware resources. Figure 3 The functional configuration implemented by the vehicle display device 28 will be described.

[0051] like Figure 3 As shown, the vehicle display device 28 includes an obstacle information acquisition unit 52, a display mark determination unit 54, a mark display unit 56, and a display target setting unit 58 as functional components. Each functional component is implemented by the CPU 30 reading and executing a program stored in the ROM 32 or the storage device 36.

[0052] The obstacle information acquisition unit 52 acquires information about multiple obstacles around the vehicle. Specifically, the obstacle information acquisition unit 52 acquires information about obstacles detected by the sensors 46. For example, the obstacle information acquisition unit 52 acquires image data of the area in front of the vehicle captured by a front camera. Furthermore, the obstacle information acquisition unit 52 acquires data about the positions of obstacles detected by radar, lidar, and other sensors.

[0053] The sign display determination unit 54 determines whether to display a sign based on the obstacle data acquired by the obstacle information acquisition unit 52. If a sign is displayed, the unit determines whether to display a single sign to warn of a single obstacle or a group sign to warn of multiple obstacles. Details of single and group signs will be described later.

[0054] In this embodiment, as an example, the display mark determination unit 54 displays a mark when the obstacle is of a specific type and the distance between the obstacle and the vehicle 12 is closer than a predetermined distance. For example, the display mark determination unit 54 may also determine to display a mark when the obstacle is a pedestrian or a two-wheeled vehicle. Furthermore, as an example, the display mark determination unit 54 of this embodiment determines whether a mark is displayed only for obstacles in front of the vehicle.

[0055] Here, based on the information acquired by the obstacle information acquisition unit 52, the display mark determination unit 54 determines to display the group mark if the number of obstacles is greater than a predetermined value. For example, the display mark determination unit 54 may determine to display the group mark if the number of obstacles in each area after the display area is divided into three equal parts is five or more.

[0056] Furthermore, the display indicator determination unit 54 is configured to determine to display the group indicator when multiple obstacles are close together, even when the number of obstacles is less than a predetermined value. For example, if the obstacles appear to overlap as viewed from the driver in front of the vehicle, the display indicator determination unit 54 determines to display the group indicator. Specifically, if the boundaries between the obstacles cannot be identified through image analysis of the image data captured by the front camera, the group indicator is determined to be displayed because the obstacles appear to overlap as viewed from the driver in front of the vehicle.

[0057] On the other hand, the display mark determination unit 54 determines to display a separate mark for obstacles where the distance between the vehicle 12 and the obstacle, as detected by radar, laser radar, or the like, is less than a predetermined value. Furthermore, the display mark determination unit 54 determines to display a separate mark for obstacles approaching the vehicle 12 while walking or driving. Specifically, the display mark determination unit 54 calculates the relative speed between the vehicle 12 and the obstacle based on the speed of the vehicle 12 and the distance between the vehicle 12 and the obstacle. Based on this relative speed, the display mark determination unit 54 determines to display a separate mark when the obstacle approaches the vehicle 12.

[0058] The sign display unit 56 displays the display sign determined by the display sign determination unit 54. Specifically, the sign display unit 56 displays a predetermined individual sign for an obstacle determined by the display sign determination unit 54 to display an individual sign. Furthermore, the sign display unit 56 displays a predetermined group sign for an obstacle determined by the display sign determination unit 54 to display a group sign.

[0059] Furthermore, in this embodiment, as an example, when the individual mark and the group mark are displayed in the display area V3 (see Figure 1 ), the sign display unit 56 changes the display form of the sign based on the driver's line of sight, so that the obstacle outside the vehicle overlaps with the sign. For example, the indoor camera constituting the sensor group 46 detects the driver's line of sight, such as the height of the driver's eyes. Then, when the display area V3 is viewed from the detected position of the driver's eyes, the sign display unit 56 adjusts the display positions of the individual and group signs so that the position of the obstacle does not deviate from the positions of the individual and group signs. Furthermore, the sign display unit 56 appropriately changes the shape of the individual and group signs so that they appear as natural three-dimensional images when viewed from the driver.

[0060] The display target setting unit 58 sets the display targets for displaying the individual mark and the group mark. Figure 1 Display targets for displaying individual symbols and group symbols are set in the first display unit 24 and the second display unit 25 provided in the instrument panel 14 and the third display unit 26 provided in the windshield 18 .

[0061] The display target setting unit 58 may also set the display targets for displaying individual symbols and group symbols, for example, through the driver's operation. Furthermore, for example, the display target setting unit 58 may be configured to automatically change the display target of the symbol in accordance with the driving conditions of the vehicle 12, such as by displaying the symbol on the first display unit 24 or the second display unit 25 when the vehicle 12 is traveling on a dedicated road for automobiles, and by displaying the symbol on the third display unit 26 when the vehicle 12 is traveling in an urban area.

[0062] (Display example)

[0063] Next, refer to Figure 4 and Figure 5 A display example displayed in the display area V3 of the third display unit 26 will be described.

[0064] like Figure 4 As shown, in the display area V3, the scene in front of the vehicle is seen through the windshield 18. In addition, for ease of explanation, only the scene seen in the display area V3 is shown, but in fact, the scene in front of the vehicle is not divided by the boundary of the third display unit 26.

[0065] The head-up display device 44 displays an individual marker M1 and a vehicle speed marker M2 in the display area V3. The individual marker M1 is displayed superimposed at the feet of the pedestrian P, acting as an obstacle. In this embodiment, the individual marker M1 is displayed as a substantially circular shape, as an example. Furthermore, the individual marker M1 is configured to change color depending on the distance from the vehicle 12. For example, if the pedestrian P is farther from the vehicle 12 than a predetermined distance, the individual marker M1 is displayed in green. If the pedestrian P is within the predetermined distance, the individual marker M1 is displayed in red. In this manner, the individual marker M1 alerts the driver to the individual obstacle.

[0066] The vehicle speed mark M2 indicates the current speed of the vehicle 12 detected by a vehicle speed sensor (not shown).

[0067] On the other hand, Figure 5 In FIG, a group mark M3 is displayed in a superimposed manner instead of the individual mark M1. The group mark M3 is displayed as a substantially straight line extending in the front-rear direction of the vehicle at a position closer to the vehicle 12 than the plurality of pedestrians P. Figure 5In the figure, there are multiple pedestrians P on the right and left sides relative to the direction of travel of the vehicle 12, so a group mark M3 is displayed on both sides, taking the pedestrian P closest to the vehicle 12 as the reference, extending from the feet of the pedestrian P along the road surface in the front and rear direction of the vehicle.

[0068] The right group marker M3 is displayed superimposed on the pedestrian P's feet, slightly offset to the vehicle's left side. The marker is displayed in a manner that flows from the vehicle's rear to the vehicle's front. Separately, the left group marker M3 is displayed superimposed on the pedestrian P's feet, slightly offset to the vehicle's right side. The marker is displayed in a manner that flows from the vehicle's rear to the vehicle's front. In other words, by superimposing the left and right group markers M3, the driver can recognize the presence of multiple obstacles outside the left and right group markers M3. Thus, the group marker M3 warns the driver of multiple obstacles.

[0069] (effect)

[0070] Next, the operation of this embodiment will be described.

[0071] (Display Processing)

[0072] use Figure 6 The flowchart shown in FIG. 1 illustrates an example of a display process for displaying at least one of the individual mark M1 and the group mark M3 on the third display unit 26, which serves as the projection surface of the head-up display device 44. This display process is executed by the CPU 30 reading a display program from the ROM 32 or storage device 36, expanding it in the RAM 34, and executing it. The display process is repeated at predetermined intervals.

[0073] The CPU 30 acquires information about the obstacle in step S102 . Specifically, the CPU 30 acquires information such as the position, type, and movement direction of the obstacle detected by the sensors 46 through the function of the obstacle information acquisition unit 52 .

[0074] In step S104, the CPU 30 determines whether the number of obstacles is greater than a predetermined value. In this embodiment, as an example, if the number of obstacles within the display area V3 divided into three equal parts is greater than a predetermined value, the CPU 30 makes a positive determination in step S104 and proceeds to step S108. The processing in step S108 will be described later.

[0075] If the number of obstacles within the display area V3 divided into three equal parts is less than a predetermined value, the CPU 30 determines a negative decision in step S104 and proceeds to step S106. In step S106, the CPU 30 determines whether an obstacle is approaching. In this embodiment, as an example, if a portion of an obstacle in front of the vehicle appears to overlap, the CPU 30 determines that an obstacle is approaching and proceeds to step S108.

[0076] If the obstacles do not overlap in step S106, the CPU 30 proceeds to step S114 and displays the separate mark M1. Specifically, the CPU 30 displays the separate mark M1 (see FIG. 1 ) on the obstacle in the display area V3 by the function of the mark display unit 56. Figure 4 ) In addition, the CPU 30 ends the display processing without displaying the group mark M3.

[0077] On the other hand, if the determination in step S104 or step S106 is affirmative, the CPU 30 proceeds to step S108 to determine whether there is an obstacle facing the vehicle 12. If there is an obstacle facing the vehicle 12, the CPU 30 proceeds to step S110.

[0078] In step S110, the CPU 30 displays the individual mark M1 and the group mark M3. Specifically, the CPU 30 displays the group mark M3 by overlapping the plurality of obstacles in the display area V3 using the function of the mark display unit 56 (see FIG. Figure 5 ) In addition, the CPU 30 displays the individual mark M1 for obstacles that are approaching the vehicle 12. Therefore, in step S110, the individual mark M1 and the group mark M3 are mixedly displayed in the display area V3.

[0079] When it is determined in step S108 that there is no obstacle to the vehicle 12, the CPU 30 proceeds to step S112 and displays the group mark. Specifically, the CPU 30 displays the individual mark M1 (see FIG. 1 ) on the obstacle in the display area V3 by the function of the mark display unit 56. Figure 5 ) In addition, the CPU 30 ends the display processing without displaying the individual mark M1.

[0080] As described above, in the vehicle display system 10 and vehicle display device 28 according to this embodiment, the sign display unit 56 displays at least one of a predetermined individual sign M1 and a predetermined group sign M3 for a plurality of obstacles, superimposed on the obstacles, in a display area within the vehicle cabin. This can alert the driver to obstacles around the vehicle.

[0081] In the present embodiment, by switching and displaying the individual mark M1 and the group mark M3 according to obstacle information such as the type and number of obstacles, it is possible to prevent the driver from having difficulty in seeing the obstacles even when there are many obstacles.

[0082] Furthermore, in this embodiment, the group marker M3 is displayed when the number of obstacles exceeds a predetermined value, allowing the driver to quickly recognize that there are a large number of obstacles. Furthermore, by displaying the group marker M3 for multiple approaching obstacles, the driver can collectively identify the multiple obstacles approaching the driver as a group of obstacles. In particular, in this embodiment, the group marker M3 is displayed in a flowing pattern, allowing the driver to focus their attention on the obstacles.

[0083] Furthermore, in the present embodiment, by displaying the individual mark M1 for obstacles that are closer to the vehicle, the driver can recognize obstacles that require more attention even when there are many obstacles.

[0084] Furthermore, by displaying the individual marks M1 for obstacles such as pedestrians walking toward the vehicle 12 and bicycles traveling toward the vehicle, the driver can recognize obstacles requiring more attention even if the obstacles are relatively far from the vehicle 12 .

[0085] Furthermore, in this embodiment, by displaying the individual mark M1 and the group mark M3 in the display area V3 of the third display unit 26 projected by the head-up display device 44 , the driver can recognize obstacle information without changing his or her line of sight.

[0086] In addition, in the above embodiment, if Figure 5 As shown in FIG. 1 , the group mark M3 is displayed in a manner flowing from the rear side of the vehicle to the front side of the vehicle, but it is not limited to this. Figure 7 The group marker M4 of the first modified example is shown.

[0087] (First Modification)

[0088] like Figure 7 As shown, the group mark M4 is a long strip-shaped mark extending in the vehicle front-rear direction. In addition, the group mark M4 is displayed by overlapping with the road surface and displayed in a predetermined color.

[0089] Here, the group marker M4 is similar to the group marker M3 of the above embodiment, and is based on the pedestrian P closest to the vehicle 12 and extends from the feet of the pedestrian P along the road surface in the vehicle front-rear direction.

[0090] Thus, in this modified example, the group marker M4 is displayed as a long strip, making it easier for the driver to recognize the area where the group marker M4 is displayed as a prohibited driving area. Furthermore, similar to the above-described embodiment, when a pedestrian P approaches the vehicle 12 closer than the group marker M4, the individual marker M1 is displayed for the pedestrian P to alert the driver.

[0091] (Second Modification)

[0092] As a second modification, refer to Figure 8 An example of a case where display is performed in the display area V2 of the second display unit 25 will be described.

[0093] like Figure 8 As shown, in this modification, the display area V2 of the second display unit 25 is divided into upper and lower parts. In addition, a navigation system screen is displayed on the lower side of the display area V2. The navigation system screen displays, for example, the current position of the vehicle 12 and the roads around the vehicle.

[0094] An image in front of the vehicle is displayed above the display area V2. Specifically, the image captured by the front camera constituting the sensor group 46 is displayed in the display area V2. Furthermore, a group indicator M3 is displayed in the display area V2 along with an image of a pedestrian P. Specifically, similar to the above-described embodiment, a substantially straight line extending in the vehicle's longitudinal direction is displayed closer to the vehicle 12 than the multiple pedestrians P. Furthermore, a vehicle speed indicator M2 is displayed in the display area V2.

[0095] Thus, in this modified example, at least one of the individual mark M1 and the group mark M3 is displayed on the second display unit 25 provided on the instrument panel 14. This can reduce the inconvenience caused by the individual mark M1 and the group mark M3 when the driver is looking forward, compared to a configuration in which the individual mark M1 and the group mark M3 are displayed superimposed on the actual obstacle.

[0096] While the vehicle display system 10 and vehicle display device 28 according to the embodiment have been described above, they can, of course, be implemented in various forms without departing from the spirit of the present disclosure. For example, in the above embodiment, the configuration in which individual and group symbols are displayed on the second display unit 25 and the third display unit 26 is described, the present invention is not limited thereto. Individual and group symbols may also be displayed on the first display unit 24.

[0097] In addition, in the above embodiment, if Figure 4 As shown, the individual mark M1 is displayed in a substantially circular shape, but the present invention is not limited thereto. For example, a mark simulating an arrow may be displayed above the head of the pedestrian P. Furthermore, different individual marks may be displayed for pedestrians and two-wheeled vehicles.

[0098] Furthermore, in the above embodiment, if Figure 5 and Figure 7 As shown, the group marks M3 and M4 are displayed as substantially straight lines, but the present invention is not limited thereto and group marks of other shapes may be used as long as they can be identified as a group. For example, a group mark may be displayed so as to surround a plurality of pedestrians P.

Claims

1. A vehicle display device, wherein: The vehicle display device includes: an obstacle information acquisition unit that acquires information about a plurality of obstacles around the vehicle; and The sign display unit displays a predetermined individual sign for drawing attention to the obstacle individually on a display area within the vehicle cabin, and displays a predetermined group sign for drawing attention to a plurality of obstacles on a display area within the vehicle cabin. The sign display unit displays the group signs in a superimposed manner, with the obstacle closest to the vehicle among the plurality of obstacles as a reference, so as to extend from the obstacle along the road surface in the front-rear direction of the vehicle.

2. The vehicle display device according to claim 1, wherein Based on the information acquired by the obstacle information acquisition unit, the sign display unit displays the group sign when a plurality of obstacles approach.

3. The vehicle display device according to claim 1, wherein The sign display unit displays the individual sign for the obstacle whose distance from the vehicle is equal to or less than a predetermined value.

4. The vehicle display device according to claim 1, wherein The sign display unit displays the individual sign for the obstacle when walking or driving toward the vehicle.

5. The vehicle display device according to any one of claims 1 to 4, wherein: The mark display unit displays the group mark when the number of obstacles is equal to or greater than a predetermined value.

6. A vehicle display system, wherein: The vehicle display system includes: The vehicle display device according to any one of claims 1 to 5; and The display unit is provided in the vehicle interior and includes the display area for displaying at least one of the individual sign and the group sign via the sign display unit.

7. The vehicle display system according to claim 6, wherein: The display area is configured to include an area where an image is projected in front of the driver's sight line by the head-up display device. The sign display unit displays at least one of the individual sign and the group sign by overlapping the obstacle.

8. The vehicle display system according to claim 6, wherein: The display area is configured to include a display provided on the instrument panel. The sign display unit displays at least one of the individual sign and the group sign on the display together with an image of the obstacle.

9. A vehicle display method, wherein: The vehicle display method is composed of: Get information about multiple obstacles around the vehicle, For the plurality of obstacles, at least one of a predetermined individual mark for calling attention to an individual obstacle and a predetermined group mark for calling attention to a plurality of obstacles is displayed in a display area within the vehicle cabin; The group markers are displayed in a superimposed manner, with the obstacle closest to the vehicle among the plurality of obstacles as a reference, extending from the obstacle along the road surface in the front-rear direction of the vehicle.

10. A non-transitory recording medium storing a program executable by a computer in a manner of executing a process, wherein: The processing includes: Get information about multiple obstacles around the vehicle, For the plurality of obstacles, at least one of a predetermined individual mark for calling attention to an individual obstacle and a predetermined group mark for calling attention to a plurality of obstacles is displayed in a display area within the vehicle cabin; The group markers are displayed in a superimposed manner, with the obstacle closest to the vehicle among the plurality of obstacles as a reference, extending from the obstacle along the road surface in the front-rear direction of the vehicle.

Citation Information

Patent Citations

  • Information display device for vehicle

    JP2009248721A

  • Surrounding area monitoring device for vehicle

    CN102782741A

  • Head-up display device

    JP2019113809A