Information display method, information processor, and program

Abstract

To properly present object information, which indicates existence of an object, to a driver.SOLUTION: An information processing method in accordance with the present disclosure is such that: a position of an object existing outside a vehicle is detected; a visual field range that is a space where a driver can recognize existence of an object by sighting it, on the basis of an eye-point of the driver who drives the vehicle, is calculated; a display range that is a space where the driver can see via a range in a windshield in which information is displayed by a head-up display device is calculated on the basis of the eye-point; when the position of the object is outside the visual field range and inside the display range, the head-up display device is caused to display object information at a position associated with the object; and when the position of the object is inside the visual field range, the head-up display device is caused not to display the object information.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to an information display method, an information processing device, and a program. [Background technology]

[0002] A head-up display device that projects information onto the windshield of a vehicle is known. For example, Patent Document 1 describes a head-up display device that displays a warning message to alert the driver to the presence of a pedestrian or the like. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-049968 Summary of the Invention [Problem to be solved by the invention]

[0004] However, if attention-calling content is displayed superimposed on an object that is already in the driver's field of view, the driver will feel annoyed because additional information is displayed even though the driver has already recognized the object. On the other hand, if attention-calling content is hidden for an object that the driver has already recognized, the attention-calling content will not be displayed superimposed on the object even if the field of view changes due to, for example, the vehicle speed and the like, and the object moves out of the field of view.

[0005] The present disclosure aims to provide an information display method, an information processing device, and a program that can appropriately present object information indicating the presence of an object to a driver using a head-up display device. [Means for solving the problem]

[0006] An information processing method according to the present disclosure is an information display method using a head-up display device that displays information on a windshield of a vehicle. The information processing method includes: detecting a position of an object present outside the vehicle; calculating a field of view that is a space in which the driver can visually recognize the presence of the object based on an eye point of a driver driving the vehicle; calculating a display range that is a space that the driver can see through a range on the windshield in which information is displayed by the head-up display device based on the eye point; and, if the object is located outside the field of view but inside the display range, causing the head-up display device to display object information at a position corresponding to the object; and, if the object is located inside the field of view range, causing the head-up display device to hide the object information. [Effects of the Invention]

[0007] According to the information display method, information processing device, and program of the present disclosure, object information indicating the presence of an object can be appropriately presented to the driver by a head-up display device. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a vehicle according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a schematic representation of the field of view range and the display range. [Figure 3] FIG. 3 is a diagram showing an example of the relationship between the vehicle speed and the viewing angle in the horizontal direction. [Figure 4] FIG. 4 is a diagram illustrating a functional configuration of the information processing device. [Figure 5] FIG. 5 is a flowchart showing the flow of processing by the information processing device when the target object is a person. [Figure 6] FIG. 6 is a diagram showing an example of an image displayed when the object is a person and the object is located inside the field of view and inside the display range. [Figure 7] FIG. 7 is a diagram showing an example of an image displayed when the object is a person and the object is located inside the field of view range but outside the display range. [Figure 8] FIG. 8 is a diagram showing an example of an image displayed when the object is a person and the object is located outside the field of view range but inside the display range. [Figure 9] FIG. 9 is a diagram showing an example of an image displayed when the objects are people and the positions of the multiple objects are outside the field of view range but inside the display range. [Figure 10] FIG. 10 is an example of an image displayed when the object is a person, the object is located outside the field of view and outside the display range, and the vehicle speed is faster than a predetermined speed. [Figure 11] FIG. 11 is an example of an image displayed when the object is a person, the object is located outside the field of view and outside the display range, and the vehicle speed is equal to or lower than a predetermined speed. [Figure 12] FIG. 12 is a diagram showing an example of an image in which warning information is displayed in both the left and right spaces. [Figure 13] FIG. 13 is a diagram showing an example of an image in which attention-calling information is displayed in the left space and warning information is displayed in the right space. [Figure 14] FIG. 14 is a diagram showing an example of an image in which attention-calling information is displayed in both the left and right spaces. [Figure 15] FIG. 15 is a diagram showing an example of attention-calling information when the distance from the object to the vehicle is equal to or greater than a predetermined distance. [Figure 16] FIG. 16 is a diagram showing an example of attention-calling information when the distance from the object to the vehicle is less than a predetermined distance. [Figure 17] FIG. 17 is a diagram showing an example of warning information whose display position and shape change over time. [Figure 18]FIG. 18 is a flowchart showing the flow of processing by the information processing device when the object is a preset facility or destination. [Figure 19] FIG. 19 shows an example of an image displayed when the object is a gas station, which is an example of a pre-set facility, and the object is located inside the field of view and inside the display range. [Figure 20] FIG. 20 is a diagram showing an example of an image displayed when the object is a gas station and the object is located inside the field of view range but outside the display range. [Figure 21] FIG. 21 is a diagram showing an example of an image displayed when the object is a gas station and the object is located outside the field of view but inside the display range. [Figure 22] FIG. 22 is a diagram showing an example of an image in which a gas station is located ahead on the left side of the vehicle. [Figure 23] FIG. 23 is a diagram showing an example of an image in which a gas station is located ahead of the vehicle. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings as appropriate. However, more detailed description than necessary may be omitted. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0010] FIG. 1 is a diagram showing a vehicle 10 according to an embodiment.

[0011] The vehicle 10 according to the embodiment includes a head-up display device 20, a navigation device 22, a sensor device 24, a vehicle control device 26, a driver monitoring device 28, and an information processing device 30.

[0012] The head-up display device 20 displays information on the windshield 12 in the field of view of the driver of the vehicle 10. The head-up display device 20 projects information onto, for example, the windshield 12. This allows the driver to visually check the information displayed by the head-up display device 20 while visually checking the road, traffic lights, people, or facilities outside the vehicle 10.

[0013] The navigation device 22 navigates the driving route of the vehicle 10 based on map information. For example, the navigation device 22 displays image data on a monitor in which the driving route from the current position of the vehicle 10 to the destination is superimposed on a map, and provides audio guidance on the driving route.

[0014] The sensor device 24 includes an imaging device that captures images of the surroundings of the vehicle 10 and a group of sensors for detecting the positions of objects around the vehicle 10, such as a LIDAR (Light Detection and Ranging) sensor.

[0015] The vehicle control device 26 includes, for example, an ECU (Electronic Control Unit), and controls the running of the vehicle 10, etc.

[0016] The driver monitoring device 28 takes an image of the driver, and detects the driver's viewpoint, facial direction, line of sight, and state of the driver based on the image data of the driver and pre-stored driver information about the driver.

[0017] The information processing device 30 generates image data to be displayed on the head-up display device 20 and displays the generated image data on the head-up display device 20. The information processing device 30 acquires information and signals from the navigation device 22, the sensor device 24, the vehicle control device 26, the driver monitoring device 28, etc., and generates image data to be displayed on the head-up display device 20. The information processing device 30 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. For example, the CPU executes a program stored in the ROM to perform information processing, thereby realizing each function of the information processing device 30.

[0018] FIG. 2 is a diagram showing an example of a schematic representation of the field of view range and the display range.

[0019] In this embodiment, the field of view is the space in which the driver can visually recognize the presence of an object. Also, in this embodiment, the display range represents the space that the driver can see through the range in which information is displayed by the head-up display device 20 on the windshield 12. This field of view varies depending on the driver's eye point and line of sight. When the range in which information is displayed by the head-up display device 20 on the windshield 12 is fixed, the display range varies depending on the driver's eye point and line of sight.

[0020] FIG. 3 is a diagram showing an example of the relationship between the speed of the vehicle 10 and the viewing angle in the horizontal direction.

[0021] Generally, the human field of view narrows as the speed of the vehicle 10 increases. For example, as shown in Fig. 3, when the speed of the vehicle 10 is 0, i.e., when the vehicle is stopped, the horizontal field of view is approximately 200°, whereas when the speed increases to approximately 100 km / h, the horizontal field of view narrows to approximately 40°. Therefore, the field of view varies depending on the driver's eye point and line of sight, as well as the speed of the vehicle 10.

[0022] FIG. 4 is a diagram showing the functional configuration of the information processing device 30. As shown in FIG.

[0023] The information processing device 30 includes an object detection unit 42 , a speed detection unit 44 , a driver state detection unit 46 , a field of view calculation unit 48 , a display range calculation unit 50 , and an image generation unit 52 .

[0024] The object detection unit 42 detects the position of the object based on the data detected by the navigation device 22 and the sensor device 24. Specifically, the object detection unit 42 detects the relative position of the object with respect to the position of the vehicle 10.

[0025] For example, the object is a person. In this case, the object detection unit 42 detects the person included in the image data by performing image analysis of the image data detected by the sensor device 24. Then, the object detection unit 42 detects the three-dimensional position of the detected person.

[0026] For example, the object may be a predetermined facility or destination. The facility may be a building or store specified by the driver. The destination may be a facility, address, or latitude and longitude specified by the driver. In this case, the object detection unit 42 detects the position of the object based on the coordinates of the vehicle 10 obtained from the navigation device 22 and the coordinates of the object obtained from map information.

[0027] The speed detection unit 44 detects the speed of the vehicle 10. For example, the speed detection unit 44 may acquire speed data detected by the vehicle control device 26.

[0028] The driver state detection unit 46 detects the eye point and line of sight of the driver based on the information detected by the driver monitoring device 28 .

[0029] The visual field range calculation unit 48 calculates the visual field range based on the eye point and line of sight direction detected by the driver state detection unit 46 and the speed detected by the speed detection unit 44. For example, the visual field range calculation unit 48 calculates a standard visual field range based on the eye point and line of sight direction, and then changes the visual field range according to the speed. For example, the visual field range calculation unit 48 stores in advance a table or the like that indicates the correspondence between the speed of the vehicle 10 and the visual field angle, and changes the visual field range according to the speed based on the table. For example, the visual field range calculation unit 48 changes the visual field range so that the visual field range becomes narrower as the speed increases.

[0030] The display range calculation unit 50 calculates the display range based on the eye point and line of sight direction detected by the driver state detection unit 46, as well as information such as the display settings of the head-up display device 20, etc.

[0031] The image generation unit 52 acquires the position of the object detected by the object detection unit 42, the speed of the vehicle 10 detected by the speed detection unit 44, the field of view range calculated by the field of view range calculation unit 48, and the display range calculated by the display range calculation unit 50. The image generation unit 52 generates object information to be displayed on the head-up display device 20 based on the position, speed, field of view range, and display range of the object. The image generation unit 52 then generates image data including the object information. The image generation unit 52 provides the generated image data to the head-up display device 20, which projects the image data onto the windshield 12.

[0032] The object information is warning information that warns the driver of the presence of a person when the object is a person, or attention information that calls the driver's attention to the presence of a person when the object is a facility or a destination when the object information is notification information that notifies the driver of the presence of the object.

[0033] Here, when the position of the object is outside the field of view range but inside the display range, the image generation unit 52 causes the head-up display device 20 to display object information at a position corresponding to the object on the windshield 12. Furthermore, when the position of the object is inside the field of view range, the image generation unit 52 causes the head-up display device 20 to not display the object information.

[0034] FIG. 5 is a flowchart showing the flow of processing by the information processing device 30 when the target object is a person.

[0035] When the target object is a person, the information processing device 30 executes the process according to the flow shown in FIG. 5, for example, at regular time intervals.

[0036] First, in S11, the information processing device 30 detects the position of an object. Then, in S12, the information processing device 30 detects the speed of the vehicle 10. Then, in S13, the information processing device 30 detects the driver's eye point and line of sight. Then, in S14, the information processing device 30 calculates the field of view range. Then, in S15, the information processing device 30 calculates the display range.

[0037] Subsequently, in S16, the information processing device 30 determines whether the position of the target object is inside the field of view range.

[0038] If the object position is inside the field of view range (Yes in S16), the information processing device 30 ends this flow without displaying anything about the object. That is, if the object position is inside the field of view range (Yes in S16), the information processing device 30 does not display object information. As a result, the information processing device 30 does not display object information for objects that are inside the field of view and that the driver has already recognized, thereby eliminating the annoyance felt by the driver.

[0039] If the position of the object is not inside the field of view, that is, if the position of the object is outside the field of view (No in S16), the information processing device 30 proceeds to the process of S17.

[0040] In S17, the information processing device 30 determines whether the position of the object is inside the display range. If the position of the object is inside the display range (Yes in S17), the information processing device 30 proceeds to S18. If the position of the object is not inside the display range, that is, if the position of the object is outside the display range (No in S17), the information processing device 30 proceeds to S19.

[0041] In S18, the information processing device 30 causes the head-up display device 20 to display, as object information, warning information that warns the driver of the presence of the object at a position corresponding to the object. In this embodiment, the information processing device 30 causes the warning information to be displayed at a position superimposed on the object.

[0042] By executing the process of S18, the information processing device 30 can display warning information at a position superimposed on the object when the object is located outside the field of view range but inside the display range. This allows the information processing device 30 to warn the driver that a person that the driver does not visually recognize is present inside the display range. After completing the process of S18, the information processing device 30 ends this flow.

[0043] In S19, the information processing device 30 causes the head-up display device 20 to display, as object information, attention alert information to alert the driver to the presence of an object at a position closest to the object inside the display range.

[0044] By executing the process of S19, when the position of the object is outside the field of view range and outside the display range, the information processing device 30 can display attention-calling information at a position closest to the object inside the display range. This allows the information processing device 30 to alert the driver that a person whom the driver does not visually recognize is outside the display range.

[0045] In S19, the information processing device 30 may change the display format of the attention-calling information depending on the speed of the vehicle 10. For example, the information processing device 30 may hide the attention-calling information when the speed of the vehicle 10 is 0, that is, when the vehicle 10 is stopped. This allows the information processing device 30 not to issue an attention-calling message when the vehicle 10 is stopped and is not about to collide with an object, thereby eliminating the annoyance felt by the driver.

[0046] Furthermore, for example, the information processing device 30 may display the attention-calling information in a format that emphasizes the attention-calling information more as the speed of the vehicle 10 increases. This allows the information processing device 30 to more strongly alert the driver to the presence of an object as the speed of the vehicle 10 increases.

[0047] Furthermore, in S19, the information processing device 30 may change the display format of the attention-calling information depending on the distance from the object to the vehicle 10. For example, the information processing device 30 may not display the attention-calling information when the distance from the object to the vehicle 10 is equal to or greater than a preset distance. This allows the information processing device 30 not to issue an attention-calling notice for objects that are sufficiently far away from the vehicle 10, thereby eliminating the annoyance felt by the driver.

[0048] Furthermore, for example, the information processing device 30 may display the attention-calling information in a format that emphasizes the closer the object is to the vehicle 10. This allows the information processing device 30 to more strongly alert the driver to the presence of the object the closer the object is to the vehicle 10.

[0049] FIG. 6 is a diagram showing an example of an image displayed when the object is a person and the object is located inside the field of view and inside the display range.

[0050] When the object is a person and the object is located inside the field of view and inside the display range, the information processing device 30 hides the warning information and attention-calling information as shown in Fig. 6. As a result, the information processing device 30 does not display the warning information and attention-calling information for an object that the driver has already recognized, thereby eliminating the annoyance felt by the driver.

[0051] FIG. 7 is a diagram showing an example of an image displayed when the object is a person and the object is located inside the field of view range but outside the display range.

[0052] If the object is a person and the object is located inside the field of view but outside the display range, the information processing device 30 hides the warning information and attention-calling information as shown in Fig. 7. This prevents the information processing device 30 from displaying warning information and attention-calling information for an object that the driver has already recognized, thereby eliminating the annoyance felt by the driver.

[0053] FIG. 8 is a diagram showing an example of an image displayed when the object is a person and the object is located outside the field of view range but inside the display range.

[0054] When the object is a person and the position of the object is outside the field of view range but inside the display range, the information processing device 30 displays warning information in a position superimposed on the object, as shown in Fig. 8. For example, in the example of Fig. 8, the information processing device 30 displays first warning information 62, which is oval warning information, so as to be superimposed on a part below the person. This allows the information processing device 30 to notify the driver that a person that the driver does not visually recognize is present inside the display range.

[0055] FIG. 9 is a diagram showing an example of an image displayed when the objects are people and the positions of the multiple objects are outside the field of view range but inside the display range.

[0056] When the objects are people and the positions of the multiple objects are outside the field of view range but inside the display range, the information processing device 30 displays warning information at a position superimposed on the object closest to the vehicle 10 among the multiple objects, as shown in Fig. 9. For example, in the example of Fig. 9, the information processing device 30 displays first warning information 62 so as to be superimposed on a part of the lower side of the person closest to the vehicle 10 among the two people. This allows the information processing device 30 to notify the driver of the position of the person who the driver needs to be most careful of among people not visually recognized by the driver, within the display range.

[0057] 10 and 11 are diagrams showing examples of images displayed when the object is a person and the object is located outside the field of view and outside the display range.

[0058] 10 is an example of an image displayed when the speed of the vehicle 10 is higher than a predetermined speed or when the distance from the object to the vehicle 10 is shorter than a predetermined distance. FIG. 11 is an example of an image displayed when the speed of the vehicle 10 is equal to or lower than a predetermined speed or when the distance from the object to the vehicle 10 is equal to or greater than a predetermined distance.

[0059] When the object is a person and the object is located outside the field of view and outside the display range, the information processing device 30 displays attention alert information at a position closest to the object inside the display range, i.e., at a position inside the display range near the outer boundary of the display range and in the direction of the object, as shown in FIGS. 10 and 11 . For example, in the examples of FIGS. 10 and 11 , the information processing device 30 displays first attention alert information 64, which is a person-shaped icon. This allows the information processing device 30 to notify the driver that there is a person outside the display range that the driver does not visually recognize. Furthermore, because the information processing device 30 displays attention alert information at a position closest to the object inside the display range, the information processing device 30 can also notify the driver of the direction of the object.

[0060] Furthermore, the information processing device 30 may change the display format of the attention alert information depending on the speed of the vehicle 10. For example, the information processing device 30 may display the attention alert information in a format that emphasizes the attention alert information as the speed of the vehicle 10 increases. For example, as shown in FIG. 10 , the information processing device 30 may increase the density of the attention alert information or display the attention alert information in a warm color such as red as the speed of the vehicle 10 increases. Furthermore, for example, the information processing device 30 may decrease the density of the attention alert information or increase the component of a cool color such as blue as the speed of the vehicle 10 decreases. In this way, the information processing device 30 can more strongly alert the driver to the presence of an object as the speed of the vehicle 10 increases.

[0061] Furthermore, the information processing device 30 may change the display format of the attention alert information depending on the distance from the object to the vehicle 10. For example, the information processing device 30 may display the attention alert information in a format that emphasizes the closer the object is to the vehicle 10. For example, the closer the object is to the vehicle 10, the more intense the density of the attention alert information may be, as shown in FIG. 10 , or the information processing device 30 may display the attention alert information in a warm color such as red. Furthermore, for example, the information processing device 30 may decrease the density of the attention alert information or increase the amount of cool color components such as blue in the attention alert information as shown in FIG. 11 , as the object becomes farther away from the vehicle 10. In this way, the information processing device 30 can more strongly alert the driver to the presence of an object, the closer the object is to the vehicle 10.

[0062] 12, 13, and 14 are diagrams showing examples of images displayed when the image is separated into a left space and a right space. Fig. 12 is a diagram showing an example of an image in which warning information is displayed in each of the left space and the right space. Fig. 13 is a diagram showing an example of an image in which attention-calling information is displayed in the left space and warning information is displayed in the right space. Fig. 14 is a diagram showing an example of an image in which attention-calling information is displayed in each of the left space and the right space.

[0063] The information processing device 30 may divide the space into a left space and a right space with respect to the traveling direction of the vehicle 10, and display warning information or attention-calling information about the object closest to the vehicle 10 in the left space, and warning information or attention-calling information about the object closest to the vehicle 10 in the right space. In this way, the information processing device 30 can inform the driver of the object that requires the driver's most attention in each of the left space and the right space.

[0064] For example, when the positions of the objects closest to the vehicle 10 in both the left-side space and the right-side space are outside the field of view but inside the display range, the information processing device 30 displays warning information superimposed on each object. In the example of Fig. 12, the information processing device 30 displays first warning information 62 so as to be superimposed on a part below the person closest to the vehicle 10 in the left-side space, and displays second warning information 66, which is oval warning information, so as to be superimposed on a part below the person closest to the vehicle 10 in the right-side space.

[0065] Furthermore, for example, when the position of an object closest to the vehicle 10 in a first space, which is one of the left space and the right space, is outside the field of view but inside the display range, the information processing device 30 displays warning information superimposed on the object. Furthermore, when the position of an object closest to the vehicle 10 in a second space, which is the other of the left space and the right space and is different from the first space, is outside the field of view but outside the display range, the information processing device 30 displays attention calling information at a position closest to the object inside the display range. In the example of FIG. 13 , the information processing device 30 displays first attention calling information 64 at a position closest to the person closest to the vehicle 10 in the left space inside the display range. Furthermore, the information processing device 30 displays first warning information 62 at a position inside the display range superimposed on the person closest to the vehicle 10 in the right space.

[0066] Furthermore, for example, when the positions of the objects closest to the vehicle 10 in both the left space and the right space are outside the field of view and the display range, the information processing device 30 displays attention calling information for each object at the closest position inside the display range. In the example of Fig. 14, the information processing device 30 displays first attention calling information 64 at a position inside the display range closest to the person in the left space who is closest to the vehicle 10. Furthermore, the information processing device 30 displays second attention calling information 68, which is attention calling information in the form of a person icon, at a position inside the display range closest to the person in the right space who is closest to the vehicle 10.

[0067] Fig. 15 is a diagram showing an example of attention calling information when the distance from the object to the vehicle 10 is equal to or greater than a predetermined distance. Fig. 16 is a diagram showing an example of attention calling information when the distance from the object to the vehicle 10 is less than the predetermined distance.

[0068] The information processing device 30 may calculate the direction from the vehicle 10 to the object and include direction information indicating the direction in the attention alert information. This allows the information processing device 30 to inform the driver in which direction the object that requires attention is located.

[0069] 15 and 16 includes a human-shaped icon 72 and a direction icon 74. When displaying such third attention warning information 70, the information processing device 30 generates the direction indicated by the direction icon 74 so that it coincides with the direction from the vehicle 10 toward the object. This allows the information processing device 30 to clearly inform the driver of the direction in which the object to which attention should be paid is located.

[0070] FIG. 17 is a diagram showing an example of warning information whose display position and shape change over time.

[0071] For example, the information processing device 30 may change the position of the warning information over time. For example, at a first time (t1), the information processing device 30 displays the warning information at a position closest to the object inside the display range. Subsequently, the information processing device 30 moves the display position of the warning information toward the object over time. Then, at a second time (t2), the information processing device 30 displays the warning information superimposed on the object.

[0072] Furthermore, the information processing device 30 displays the warning information in the smallest shape at a first time (t1), and while increasing the shape of the warning information over time, displays the warning information in the largest shape at a second time (t2).

[0073] By displaying the warning information in this manner, the information processing device 30 can guide the driver's line of sight from inside to outside the field of view. This allows the information processing device 30 to make the driver more reliably aware of the warning information. Furthermore, the information processing device 30 may repeatedly execute a process of changing the position of the warning information over time.

[0074] FIG. 18 is a flowchart showing the flow of processing by the information processing device 30 when the object is a preset facility or destination.

[0075] If the object is a facility or a destination, the information processing device 30 executes the process according to the flow shown in Fig. 18, for example, at regular time intervals. Note that the process in Fig. 18 is the same as the process in Fig. 5 from S11 to S17, but differs from the process in Fig. 5 in the process after S17. Therefore, for the flowchart in Fig. 18, the description of the process from S11 to S16 will be omitted, and the process after S17 will be described.

[0076] In S17, the information processing device 30 determines whether the position of the object is inside the display range. If the position of the object is inside the display range (Yes in S17), the information processing device 30 proceeds to S21. If the position of the object is not inside the display range, that is, if the position of the object is outside the display range (No in S17), the information processing device 30 proceeds to S22.

[0077] In S21, the information processing device 30 causes the head-up display device 20 to display notification information, which notifies the driver of the presence of an object, as object information at a position corresponding to the object. In this embodiment, the information processing device 30 causes the notification information to be displayed at a position superimposed on the object.

[0078] By executing the process of S21, the information processing device 30 can display notification information at a position superimposed on the object when the object is located outside the field of view but inside the display range. This allows the information processing device 30 to notify the driver that a facility or destination that the driver does not visually recognize is located inside the display range. After completing the process of S21, the information processing device 30 ends this flow.

[0079] In S22, the information processing device 30 causes the head-up display device 20 to display the notification information as object information at a position closest to the object inside the display range.

[0080] By executing the process of S22, when the position of the object is outside the field of view range and outside the display range, the information processing device 30 can display the notification information at a position closest to the object inside the display range. This allows the information processing device 30 to notify the driver that a facility or destination that the driver does not visually recognize is outside the display range.

[0081] FIG. 19 shows an example of an image displayed when the object is a gas station, which is an example of a pre-set facility, and the object is located inside the field of view and inside the display range.

[0082] When the object is a gas station and the position of the object is inside the field of view and inside the display range, the information processing device 30 hides the notification information as shown in Fig. 19. As a result, the information processing device 30 does not display notification information for an object that the driver has already recognized, thereby eliminating the annoyance felt by the driver.

[0083] FIG. 20 is a diagram showing an example of an image displayed when the object is a gas station and the object is located inside the field of view range but outside the display range.

[0084] When the object is a gas station and the object is located inside the field of view but outside the display range, the information processing device 30 hides the notification information as shown in Fig. 20. This prevents the information processing device 30 from displaying notification information about an object that the driver has already recognized, thereby eliminating the annoyance felt by the driver.

[0085] FIG. 21 is a diagram showing an example of an image displayed when the object is a gas station and the object is located outside the field of view but inside the display range.

[0086] When the object is a gas station and the object is located outside the field of view but inside the display range, the information processing device 30 displays notification information at a position superimposed on the object, as shown in Fig. 21. For example, in the example of Fig. 21, the information processing device 30 displays first notification information 82, which is an icon representing the gas station, so as to be superimposed on a part of the gas station. This allows the information processing device 30 to notify the driver that a gas station that the driver does not visually recognize is located inside the display range.

[0087] 22 and 23 are diagrams showing an example of an image displayed when the object is a gas station and the object is located outside the field of view and outside the display range.

[0088] 22 is a diagram showing an example of an image in which a gas station is located on the left front side of the vehicle 10. FIG. 23 is a diagram showing an example of an image in which a gas station is located on the right front side of the vehicle 10.

[0089] When the object is a gas station and the object is located outside the field of view and outside the display range, the information processing device 30 displays notification information at a position closest to the object inside the display range, i.e., at a position inside the display range near the outer boundary of the display range and in the direction of the object, as shown in FIGS. 22 and 23 . For example, in the examples of FIGS. 22 and 23 , the information processing device 30 displays first notification information 82. This allows the information processing device 30 to notify the driver that there is a gas station outside the display range that the driver has not visually recognized. Furthermore, because the information processing device 30 displays notification information at a position closest to the object inside the display range, the information processing device 30 can also notify the driver of the direction of the object.

[0090] As described above, the information processing device 30 according to this embodiment displays object information at a position corresponding to an object when the object is located outside the field of view but inside the display range, and hides the object information when the object is located inside the field of view. The information processing device 30 does not display object information for objects already visually recognized by the driver, and can display object information for objects not already visually recognized by the driver. This eliminates annoyance felt by the driver and ensures that the driver is aware of the presence of objects that require warnings, cautions, and notifications. Therefore, the information processing device 30 according to this embodiment can appropriately present object information indicating the presence of an object to the driver via the head-up display device 20.

[0091] In the embodiment, an example has been described in which the driver state detection unit 46 detects the driver's eye point and gaze direction based on information detected by the driver monitoring device 28, but this is not limiting. The field of view range calculation unit 48 and the display range calculation unit 50 may have information on the driver's eye point and gaze direction in advance, and calculate the field of view range and display range based on that information. As an example, the field of view range calculation unit 48 and the display range calculation unit 50 may have information on the average driver's eye point and gaze direction calculated in advance as the information on the driver's eye point and gaze direction. In this case, the vehicle 10 may not be equipped with the driver monitoring device 28. In this case, the information processing device 30 may not be equipped with the driver state detection unit 46.

[0092] The program for executing the processes executed by the information processing device 30 may be stored in an installable or executable file format on a computer-readable storage medium such as a CD-ROM, CD-R, memory card, DVD (Digital Versatile Disk), or flexible disk (FD) and provided as a computer program product. The program for executing the information processing executed by the information processing device 30 may be stored on a computer connected to a network such as the Internet and provided by downloading it via the network. The program for executing the information processing executed by the information processing device 30 may be provided or distributed via a network such as the Internet.

[0093] Although the embodiments have been described above, they are presented as examples and are not intended to limit the scope of the invention. This novel embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0094] 10 vehicle, 12 windshield, 20 head-up display device, 22 navigation device, 24 sensor device, 26 vehicle control device, 28 driver monitoring device, 30 information processing device, 42 object detection unit, 44 speed detection unit, 46 driver state detection unit, 48 field of view calculation unit, 50 display range calculation unit, 52 image generation unit

Claims

1. An information display method using a head-up display device that displays information on a windshield of a vehicle, comprising: Detecting the position of an object present outside the vehicle; calculating a visual field range, which is a space in which the driver can visually recognize the presence of the object, based on the eye point of the driver who drives the vehicle; a display range, which is a space that the driver can see through a range in which information is displayed by the head-up display device on the windshield, based on the eye point; When the position of the object is outside the field of view range and inside the display range, displaying object information on the head-up display device at a position corresponding to the object; When the position of the object is within the field of view, the object information is not displayed on the head-up display device. Information display method.

2. Detecting the eye point of the driver who drives the vehicle The information display method according to claim 1 .

3. The visual field range is calculated based on the eye point and the speed of the vehicle. The information display method according to claim 1 .

4. When the position of the object is outside the field of view range and inside the display range, warning information that warns the driver of the presence of the object is displayed on the head-up display device at a position superimposed on the object as the object information. The information display method according to claim 1 .

5. When the position of the object is outside the field of view and outside the display range, the head-up display device displays, as the object information, attention-calling information that alerts the driver to the presence of the object at a position closest to the object inside the display range. The information display method according to claim 1 .

6. The display format of the attention-calling information is changed depending on the distance from the object to the vehicle. The information display method according to claim 5.

7. The display format of the attention-calling information is changed according to the speed of the vehicle. The information display method according to claim 5.

8. Direction information indicating the direction from the vehicle to the object is included in the attention-calling information. The information display method according to claim 5.

9. The vehicle is divided into a left space and a right space with respect to the traveling direction of the vehicle, and the object information about the object closest to the vehicle in the left space and the object information about the object closest to the vehicle in the right space are displayed on the head-up display device. The information display method according to claim 1 .

10. The position of the object is detected based on information detected by a sensor device that detects the position of the object present around the vehicle. The information display method according to claim 1 .

11. The object is a person. The information display method according to any one of claims 1 to 10.

12. When the position of the object is outside the field of view range and inside the display range, notification information that notifies the driver of the presence of the object is displayed on the head-up display device at a position superimposed on the object, as the object information. The information display method according to claim 1 .

13. When the position of the object is outside the field of view range and outside the display range, the head-up display device displays the notification information at a position closest to the object inside the display range. The information display method according to claim 12.

14. A position of the object to be displayed by the head-up display device is calculated based on coordinates of the object detected by a navigation device that navigates a travel route of the vehicle based on map information. The information display method according to claim 12.

15. The object is a predetermined facility or destination.

15. The information display method according to any one of claims 12 to 14.

16. An information processing device that generates information to be displayed by a head-up display device that displays information on a windshield of a vehicle, an object detection unit that detects the position of an object present outside the vehicle; a visual field range calculation unit that calculates a visual field range, which is a space in which the driver can visually recognize the presence of the object, based on an eye point of the driver who drives the vehicle; and a display range calculation unit that calculates a display range, which is a space that the driver can see through a range in which information is displayed by the head-up display device on the windshield, based on the eye point; and an image generation unit that causes the head-up display device to display object information at a position corresponding to the object when the position of the object is outside the field of view range and inside the display range, and causes the head-up display device to not display the object information when the position of the object is inside the field of view range; An information processing device comprising:

17. A program for causing a computer to generate information to be displayed by a head-up display device that displays information on a windshield of a vehicle, The computer, Detecting the position of an object present outside the vehicle; calculating a visual field range, which is a space in which the driver can visually recognize the presence of the object, based on the eye point of the driver who drives the vehicle; a display range, which is a space that the driver can see through a range in which information is displayed by the head-up display device on the windshield, based on the eye point; When the position of the object is outside the field of view range and inside the display range, displaying object information on the head-up display device at a position corresponding to the object; When the position of the object is within the field of view, the object information is not displayed on the head-up display device. program.

Images