Display device, display method and program
The display device addresses the misalignment issue in head-up displays by using a control unit to adjust the correction amount for content arrangement positions based on specific content, ensuring accurate superimposition of virtual images over real-world objects.
Patent Information
- Application Number
- JP2023170156
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-29
- Publication Date
- 2025-04-10
AI Technical Summary
Existing head-up display systems with narrow angles of view struggle to adequately correct misalignment of content arrangement positions, leading to suboptimal display performance.
A display device with a control unit that determines content to be displayed and adjusts the correction amount for the content arrangement position based on the specific content, ensuring accurate alignment with objects in the vehicle's field of view.
The solution allows for precise adjustment of content placement, ensuring that virtual images are accurately superimposed over real-world objects even in vehicles experiencing posture changes during driving.
Smart Images

Figure 2025059826000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a display device, a display method, and a program. [Background technology]
[0002] Conventionally, a head-up display (HUD) mounted on a vehicle has been known as a display device. Among head-up displays, a display capable of superimposing a virtual image on a real scene is called an augmented reality head-up display (AR-HUD). In an augmented reality head-up display, a deviation occurs between the virtual image displayed by the augmented reality head-up display and the real scene due to a change in the attitude angle of the vehicle while driving.
[0003] For example, Patent Document 1 discloses a display control device that includes a correction amount preparation unit that prepares a correction amount to correct a misalignment of the display position of superimposed content relative to an overlay target in the foreground of the vehicle, and a display control unit that superimposes and displays the superimposed content on the superimposed target and reduces the misalignment of the superimposed content relative to the superimposed target by performing a correction process using the correction amount. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2021 / 044741 Summary of the Invention [Problem to be solved by the invention]
[0005] However, in the display control device of Patent Document 1, in a head-up display with a narrow angle of view, there are cases in which correction for misalignment of the content's position is reduced depending on the content, resulting in an issue that misalignment of the content's position cannot be sufficiently corrected.
[0006] Therefore, the present disclosure provides a display device and the like that can adjust the amount of correction to an appropriate level depending on each content. [Means for solving the problem]
[0007] A display device according to one embodiment of the present disclosure includes a control unit that determines one or more pieces of content to be displayed in association with an object present in the background of the vehicle, and a display unit that projects light indicating the content determined by the control unit onto a display medium provided in the vehicle, thereby displaying the content as a virtual image through the display medium, and the control unit adjusts a correction amount for the position of the content depending on each piece of content. Effect of the Invention
[0008] A display device or the like according to an embodiment of the present disclosure can adjust the amount of correction to an appropriate level depending on each content. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing a vehicle interior in which a display device according to an embodiment is arranged. [Diagram 2] FIG. 2 is a block diagram showing a vehicle. [Diagram 3] FIG. 3 is a diagram showing content projected onto a display area and the amount of correction that can be made to the content. [Figure 4] FIG. 4 is a diagram showing a first content projected onto a display area and a possible correction amount according to the arrangement position of the first content. [Diagram 5]FIG. 5 is a diagram showing the second content projected onto the display area and the amount of correction that can be performed according to the arrangement position of the second content. [Figure 6] FIG. 6 is a diagram showing the third content projected onto the display area and the amount of correction that can be made according to the arrangement position of the third content. [Figure 7A] FIG. 7A is a diagram showing a fourth content projected onto a display area and a possible correction amount according to the arrangement position of the fourth content. [Figure 7B] FIG. 7B is a diagram showing the fourth content projected onto the display area and the amount of correction that can be made depending on the arrangement position of the fourth content when the vehicle is traveling at a low speed and when the vehicle is traveling at a high speed. [Figure 8] FIG. 8 is a diagram showing how the attitude of the content projected onto the display area is changed. [Figure 9] FIG. 9 is a diagram showing the content and supplemental information projected onto the display area. [Figure 10] FIG. 10 is a flowchart showing a first operation example of the display device according to the embodiment. [Figure 11] FIG. 11 is a flowchart showing a second operation example of the display device according to the embodiment. [Figure 12] FIG. 12 is a flowchart showing a third operation example of the display device according to the embodiment. [Figure 13] FIG. 13 is a flowchart showing a fourth operation example of the display device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the embodiments will be described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components that are not described in the independent claims will be described as optional components.
[0011] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In each drawing, the same reference numerals are used for substantially the same configurations, and duplicated explanations may be omitted or simplified.
[0012] (Embodiment) First, a display device 1, a display method, and a program according to the present embodiment will be described with reference to FIGS.
[0013] Fig. 1 is a diagram showing a cabin of a vehicle 2 in which a display device 1 according to an embodiment is arranged. Fig. 2 is a block diagram showing the vehicle 2. Fig. 3 is a diagram showing content projected on a display area and the amount of correction that can be made to the content.
[0014] <Functional configuration> As shown in FIG. 1 and FIG. 2, the display device 1 is, for example, a HUD mounted on a vehicle 2. The display device 1 emits display light, which is light showing a content, toward a display area of a translucent display medium 3, and reflects the display light at the display area of the display medium 3, so that the display light can be incident on the user's eyes. For example, when the display device 1 is used in the vehicle 2, the display device 1 can reflect the display light emitted to the display area of the display medium 3, such as a translucent front windshield or a translucent combiner, so that the display light can be incident on the user's eyes. This allows the user to view the display light three-dimensionally as a virtual image while recognizing a real image through the display area of the display medium 3.
[0015] The display light is light that stereoscopically displays a virtual image, which is an image, on the display medium 3. The image is a still image or a moving image, and is an image showing numbers, letters, figures, and the like.
[0016] The display device 1 determines the display mode of the display light to be projected onto the display area of the display medium 3 based on information from each of a plurality of devices mounted on the vehicle 2.
[0017] The multiple devices include, for example, a navigation device 21, a vehicle control device 22, a sensor 23, and the like.
[0018] The navigation device 21 is a navigation system mounted on the vehicle 2. The navigation device 21 can set a planned route, which is an optimal route along which the vehicle 2 is scheduled to travel from the current location to the destination, by using map data. The navigation device 21 can also provide surrounding road traffic information and the like to the user, and set a planned route that the user has changed in response to surrounding road traffic information. The navigation device 21 outputs vehicle-related information including the set planned route to the display device 1. The planned route is a route along which the vehicle 2 is scheduled to travel, and is displayed as a virtual image (content to be described later) superimposed on an object visible through the display area of the display medium 3. The object is a road, an intersection, a road marking, a road sign, other installations installed on the road, and the like.
[0019] The vehicle control device 22 is a device that performs various controls related to the traveling of the vehicle 2. The vehicle control device 22 controls the engine speed, and controls the transmission, engine speed, brake system, etc. according to the driver's operation and the traveling conditions. The vehicle control device 22 outputs vehicle-related information including various controls related to the traveling of the vehicle 2 to the display device 1.
[0020] The sensor 23 is mounted on the vehicle 2. The sensor 23 is an in-vehicle sensor such as a camera sensor that detects the presence or absence of an object around the vehicle 2 and the surrounding environment such as the shape of the road, a distance sensor that detects the distance from the vehicle 2 to the object, a speed sensor that detects the traveling speed of the vehicle 2, an acceleration sensor that detects the acceleration of the vehicle 2, a steering angle sensor that detects the steering angle, etc. The sensor 23 outputs vehicle-related information to the display device 1, including the surrounding environment, the distance from the vehicle 2 to the object, the traveling speed, the acceleration of the vehicle 2, the steering angle, etc.
[0021] The display device 1 includes an input unit 11, a control unit 12, a drawing unit 13, and a display unit .
[0022] The input unit 11 is an input interface that acquires vehicle-related information output from each of a plurality of devices. The input unit 11 outputs the acquired vehicle-related information to the control unit 12. The input unit 11 may also be capable of outputting the vehicle-related information to the correction value calculation unit 12a.
[0023] 2, the control unit 12 can determine one or more pieces of content to be displayed in association with an object existing in the foreground of the vehicle 2. The control unit 12 adjusts a correction amount for the layout position of the content according to each of the determined one or more pieces of content. The control unit 12 can further adjust the correction amount according to the relationship between the layout position of the content displayed in the display area of the display medium 3 and the position of the object existing beyond the display area.
[0024] Specifically, the control unit 12 includes a correction value calculation unit 12a, an indication generation unit 12b, and a correction amount adjustment unit 12c.
[0025] The correction value calculation unit 12a may be able to acquire the vehicle-related information via the input unit 11, or may be able to acquire the vehicle-related information directly from the sensor 23. FIG. 2 illustrates an example in which the correction value calculation unit 12a acquires the vehicle-related information directly from the sensor 23.
[0026] The correction value calculation unit 12a calculates the amount of deviation between an object present in front of the vehicle 2 and the content, based on the acquired vehicle-related information.
[0027] For example, when the vehicle 2 travels on a road, the position of the content projected onto the display area of the display medium 3 may deviate from the object present in the foreground of the vehicle 2 due to the shaking of the vehicle 2. Even if the vehicle 2 shakes, it is desired to arrange the content so that it shows (points) the target object. For this reason, in order to correct the deviation caused by the shaking of the vehicle 2, the correction value calculation unit 12a calculates a deviation correction value based on the amount of deviation. For example, when the content deviates from the object due to a change in the attitude angle caused by the shaking of the vehicle 2 while the vehicle 2 is traveling, the correction value calculation unit 12a obtains the attitude angle of the vehicle 2 from the vehicle-related information of the sensor 23, and calculates a correction value according to the angle of deviation, that is, the deviation correction value. In other words, the deviation correction value is a correction value for interpolating the amount of deviation of the content from the object. The deviation correction value is calculated for each content. The correction value calculation unit 12a outputs the calculated deviation correction value for each content to the display generation unit 12b and / or the correction amount adjustment unit 12c. In this embodiment, the correction value calculation unit 12a outputs the calculated deviation correction value to the display generation unit 12b.
[0028] The display generation unit 12b generates content based on the vehicle-related information acquired by the input unit 11, and determines the display mode of the generated content. Specifically, the display generation unit 12b generates content according to an object existing in the foreground of the vehicle 2 based on the vehicle-related information, determines the content to be displayed on the display unit 14, and determines the display mode of the generated content.
[0029] The content is an image (display object) that is displayed in association with an object existing in the foreground of the vehicle 2 and is displayed as a virtual image on the display medium 3 by display light. For example, the content includes a first content, a second content, a third content, and a fourth content. In the present embodiment, the first content, the second content, the third content, and the fourth content may be collectively referred to simply as the content.
[0030] The first content is content for indicating a traveling direction based on a planned route of the vehicle 2. For example, the first content is content for navigation guidance capable of guiding the driver along the planned route. The first content is in the shape of an arrow, a pointing finger, or the like. In other words, the shape of the first content may be any other known shape as long as it is a shape capable of guiding the driver.
[0031] The second content is content for showing a preceding vehicle present in the foreground of the vehicle 2 as an object. For example, the second content is content related to adaptive cruise control (ACC), which is a function for assisting in following a preceding vehicle traveling in front of the vehicle 2. For example, the second content is in a circular or polygonal shape. In other words, the shape of the second content may be any other known shape as long as it shows an object.
[0032] The third content is content for indicating a moving object existing in the foreground of the vehicle 2. For example, the third content is content related to a Pedestrian Collision Warning (PCW) function that warns of a high possibility of contact or collision with a moving object, such as a pedestrian or the vehicle 2, depending on the distance between the moving object and the vehicle. For example, the third content is in the form of a balloon, sign, or the like indicating the presence of a moving object. In other words, the shape of the third content may be any other known shape as long as it indicates a moving object.
[0033] The fourth content is content for indicating lanes on the road on which the vehicle 2 is traveling. For example, the fourth content is content related to LDW (Lane Departure Warning), which is a function for alerting the driver by a warning display, warning sound, vibration, etc., when the vehicle 2 deviates from the lane due to drowsy driving, inattentive driving, etc., or is about to deviate from the lane. For example, the fourth content shows road markings including regulatory markings such as side strips and vehicle lanes on the road on which the vehicle 2 is traveling, and directional markings such as center lines, pedestrian crossings, stop lines, and lane boundary lines. The shape of the fourth content may be any other known shape as long as it indicates a lane.
[0034] When the display generation unit 12b determines the display mode of the generated content, the display generation unit 12b outputs the determined display mode of the content to the correction amount adjustment unit 12c. For example, the display generation unit 12b generates one or more contents according to a planned route indicated in the vehicle-related information, and determines the display mode of each of the one or more generated contents.
[0035] The display mode of the content is determined according to, for example, the guide route, objects existing around the vehicle 2, the distance between the objects and the vehicle 2, and the traveling speed of the vehicle 2. The display mode of the content includes the type of object, the position of the content, the number of pieces of content, the size of the content, the speed at which the content is changed, and the like.
[0036] In response to this, the display generation unit 12b outputs the determined one or more pieces of content and the display modes of each of the one or more pieces of content to the correction amount adjustment unit 12c.
[0037] The correction amount adjuster 12c acquires at least the determined one or more pieces of content and the display modes of each of the one or more pieces of content from the display generator 12b.
[0038] The correction amount adjustment unit 12c calculates a correction amount from the arrangement position of the content displayed in the display area according to the content determined by the display generation unit 12b. Also, the correction amount adjustment unit 12c adjusts the calculated correction amount from the relationship between the arrangement position of the content displayed in the display area and the position of the object present over the display area according to the content determined by the display generation unit 12b. The correction amount capable of correcting the arrangement position of the content is calculated and adjusted by the correction amount adjustment unit 12c for each content. Note that the correction amount may be adjusted for each content, or may be adjusted for each type of content. In other words, the correction amount may be adjusted for each type of content. For this reason, in this embodiment, "for each content" may be read as "for each type of content". Also, the type of content may be the types from the first content to the fourth content, or may be the type for each function indicated by the content.
[0039] For example, as shown in (a) of FIG. 3, when the vehicle 2 is traveling normally and an arrow content indicating the traveling direction on the road is displayed in the display area, the correction amount adjustment unit 12c sets the upper correction amount that can be corrected to the upper limit value between the dashed line that touches the upper end of the content and the upper edge of the display area, and adjusts it according to the amount of deviation. In the same manner, the correction amount adjustment unit 12c sets the lower correction amount that can be corrected to the lower limit value between the dashed line that touches the lower end of the content and the lower edge of the display area, and adjusts it according to the amount of deviation. Note that the dashed lines in (a) and (b) of FIG. 3 are used to explain this embodiment and are not displayed in the display area. The same applies to the dashed lines in (a) to (c) of FIG. 4, (a) to (c) of FIG. 5, and (a) to (c) of FIG. 6.
[0040] 3B, when the vehicle 2 is near an intersection and there is a preceding vehicle, a first content of an arrow indicating a traveling direction on a road for turning near the intersection and a second content indicating the preceding vehicle as an object are displayed. At this time, the correction amount adjustment unit 12c may adjust the correction amount for each of the first content and the second content. For example, the correction amount for the upper side that can be corrected may be adjusted according to the first content, with the upper limit being the distance between the dashed line touching the upper end of the first content and the upper edge of the display area, and the correction amount for the lower side that can be corrected may be adjusted according to the second content, with the upper limit being the distance between the dashed line touching the lower end of the second content and the lower edge of the display area.
[0041] Furthermore, the correction amount adjustment unit 12c may extract the smallest correction amount from among the correction amounts by which the first content and the second content can be corrected, and may adjust the extracted correction amount. For example, when the correction amount between the dashed line touching the upper end of the first content and the upper edge of the display area is small, the correction amount on the lower side that can be corrected may be adjusted so that the correction amount is equivalent to the smallest correction amount, with the upper limit being the amount between the dashed line touching the lower end of the second content and the lower edge of the display area.
[0042] A detailed example of adjusting the content based on the correction amount will be described later.
[0043] The correction amount adjustment unit 12c outputs the amount of correction adjusted for each content to the drawing unit 13.
[0044] The drawing unit 13 acquires the content determined by the control unit 12, the display mode of the content, and the correction amount adjusted according to the content, and draws the content according to the adjusted correction amount. Specifically, the drawing unit 13 draws the content according to the display mode of the content, based on the content and the display mode of the content acquired from the display generation unit 12b via the correction amount adjustment unit 12c, and the correction amount according to the content acquired from the correction amount adjustment unit 12c, in order to project the content from the display unit 14 onto the display medium 3.
[0045] For example, the drawing unit 13 adjusts the size, shape, color, brightness, etc. of the content according to the determined display mode of the content. Furthermore, the drawing unit 13 adds a correction amount according to each content and draws the content with the correction amount according to each content. The drawing unit 13 outputs the drawing result to the display unit 14.
[0046] The display unit 14 is a projection unit that projects light indicating the content determined by the control unit 12 onto the display medium 3 provided in the vehicle 2. Specifically, the display unit 14 projects light (display light) indicating the content in the display mode determined by the control unit 12 onto the display medium 3 provided in the vehicle 2 based on the drawing result acquired from the drawing unit 13. Since the display light projected onto the display medium 3 is reflected by the display medium 3 toward the user inside the vehicle 2, the display unit 14 displays the content, which is the display light, as a virtual image through the display medium 3. This allows the user to view the content displayed through the display medium 3 as a virtual image.
[0047] Here, the display generation unit 12b may determine the display mode for each piece of content so as to correct the layout position of each piece of content based on the deviation correction value calculated by the correction value calculation unit 12a.
[0048] In this case, the display generation unit 12b generates supplemental information for each piece of content. The supplemental information can be added to each piece of content determined by the display generation unit 12b.
[0049] When supplementary information is added to the content, the display generation unit 12b can also output the determined multiple contents, the multiple pieces of supplementary information, and the display modes of each of the multiple contents to which the multiple pieces of supplementary information have been added to the correction amount adjustment unit 12c.
[0050] When supplementary information is added to content, the correction amount adjustment unit 12c can acquire the determined multiple contents, the multiple pieces of supplementary information, and the display modes of each of the multiple pieces of content to which the multiple pieces of supplementary information have been added via the display generation unit 12b, or can acquire them directly from the correction value calculation unit 12a.
[0051] The correction amount adjustment unit 12c calculates a correction amount from the layout position of the content displayed in the display area, according to the content determined by the display generation unit 12b.
[0052] Based on the multiple contents, the multiple pieces of supplementary information, the display modes of the multiple contents to which the multiple pieces of supplementary information have been added, and the correction amount corresponding to the contents acquired from the correction amount adjustment unit 12c, the drawing unit 13 draws the contents according to the display modes of the contents in order to project the contents from the display unit 14 onto the display medium 3. The drawing unit 13 outputs the drawing result in which the supplementary information has been added to the contents to the display unit 14.
[0053] <Content Adjustment> Next, adjustment of contents based on the correction amount in the display device 1, the display method, and the program according to the present embodiment will be described with reference to FIGS.
[0054] FIG. 4 is a diagram showing a first content projected on the display area and a correction amount that can be corrected according to the arrangement position of the first content. FIG. 5 is a diagram showing a second content projected on the display area and a correction amount that can be corrected according to the arrangement position of the second content. FIG. 6 is a diagram showing a third content projected on the display area and a correction amount that can be corrected according to the arrangement position of the third content. FIG. 7A is a diagram showing a fourth content projected on the display area and a correction amount that can be corrected according to the arrangement position of the fourth content. FIG. 7B is a diagram showing a fourth content projected on the display area and a correction amount that can be corrected according to the arrangement position of the fourth content when the vehicle 2 is traveling at a low speed and at a high speed. FIG. 8 is a diagram showing a state in which the attitude of the content projected on the display area is changed. FIG. 9 is a diagram showing the content projected on the display area and supplementary information.
[0055] First, the control unit 12 can adjust the amount of correction according to the distance from the vehicle 2 to the object. Specifically, the control unit 12 can adjust the correction sensitivity or the upper limit of the correction amount so that the correction range between the upper side of the display area and the upper end of the content becomes narrower as the distance from the vehicle 2 to the object becomes longer. In addition, the control unit 12 can adjust the correction sensitivity or the upper limit of the correction amount so that the correction range between the lower side of the display area and the lower end of the content becomes narrower as the distance from the vehicle 2 to the object becomes closer.
[0056] For example, in (a) of Fig. 4, it is assumed that an intersection is located about 100 m away from the vehicle 2. In this case, the first content is disposed at the top of the display area, there is no gap (vertical width) between the top end of the first content and the top edge of the display area, and there is substantially no amount of correction that can be made above the first content. However, there is a gap (vertical width) between the bottom end of the first content and the bottom edge of the display area, and there is an amount of correction that can be made below the first content.
[0057] In (b) of Fig. 4, it is assumed that an intersection is located about 80 m away from the vehicle 2. In this case, the first content is disposed at the upper side of the display area, a small gap is formed between the upper end of the first content and the upper edge of the display area, and a small amount of correction that can be made exists above the first content. A gap is formed between the lower end of the first content and the lower edge of the display area, and a small amount of correction that can be made exists below the first content.
[0058] In (c) of Fig. 4, it is assumed that the vehicle 2 is approaching an intersection. In this case, the first content is largely arranged in the center of the display area, a gap is formed between the upper end of the first content and the upper edge of the display area, and a small gap is formed between the lower end of the first content and the lower edge of the display area. Therefore, there is a correction amount that can be corrected above the first content, and a small correction amount that can be corrected below it.
[0059] In this way, the display generation unit 12b determines the display mode of the first content according to the distance from the vehicle 2 to the intersection (object) based on the vehicle-related information. The correction amount adjustment unit 12c adjusts the correction amount as a correction sensitivity for the arrangement position of the first content whose display mode has been determined.
[0060] As a result, even if the vehicle 2 shakes, the entire first content is displayed in the display area so as to follow the target object.
[0061] In this way, adjusting the amount of correction includes adjusting the correction sensitivity of the content so that the entire content is displayed in the display area.
[0062] In addition, when the content is a first content for displaying the direction of travel on a road, the control unit 12 can further adjust the upper limit value of the correction amount according to the distance from the vehicle 2 to the object so that at least the tip indicated by the first content is displayed within the display area of the display medium 3.
[0063] FIG. 4(d) shows the first content before it is cut off, and FIG. 4(e) shows the first content after it is cut off. FIG. 4(d) and (e) assume that an intersection is located about 100 m away from vehicle 2. In this embodiment, even if vehicle 2 sways, it is possible to allow a portion of the first content to be cut off. If cut-off is not allowed, when vehicle 2 sways, the entire first content will remain positioned at the upper edge of the display area, and the first content will no longer properly display the object.
[0064] Therefore, in this embodiment, as shown in (d) of FIG. 4, the correction amount adjustment unit 12c sets the tip portion of the first content indicating the traveling direction to be smaller than the vertical width of the first content so that the tip portion is displayed at least in the display area. The correction amount adjustment unit 12c adjusts the upper limit value of the correction amount on the upper side of the display area to form a small gap between the upper broken line and the upper edge of the display area. The correction amount adjustment unit 12c adjusts the correction amount for the arrangement position of the first content whose upper limit value between the upper broken line and the upper edge of the display area has been changed. Note that the upper broken line and the lower broken line shown in (d) and (e) of FIG. 4 for adjusting the upper limit value of the correction amount so as to reduce the vertical width of the first content are only for explaining this embodiment and are not displayed in the display area. The same applies to (d) and (e) of FIG. 5, (d) and (e) of FIG. 6, FIG. 7A, FIG. 7B, and FIG. 8.
[0065] The correction amount in which the upper limit value is changed to allow for cut-off in the content may be set in advance and stored in a memory unit installed in the display device 1, or may be calculated at any time by the correction amount adjustment unit 12c depending on the content placement position, the content, etc.
[0066] As a result, even if the vehicle 2 shakes, as shown in FIG. 4(e), at least a part of the first content is displayed in the display area so as to follow the target object.
[0067] In this way, adjusting the correction amount further includes changing the upper limit of the correction amount so as to allow some of the content to be cut off in the display area. Note that allowing some of the content to be cut off means that some of the content is displayed to an extent that the content can be recognized, and does not mean that it is sufficient if only some of the content is displayed. The same applies to the following explanation.
[0068] In (d) and (e) of Figure 4, the upper limit of the correction amount for the upper side of the display area is changed so as to leave a small gap between the upper dashed line and the upper edge of the display area, but the same applies when the upper limit of the correction amount for the lower side of the display area is changed so as to leave a small gap between the lower dashed line and the lower edge of the display area.
[0069] Next, the control unit 12 can adjust the amount of correction according to the distance from the vehicle 2 to the object. Specifically, the control unit 12 can further adjust the correction sensitivity or adjust the upper limit of the amount of correction according to the distance between the leading vehicle indicated by the second content and the vehicle 2. The control unit 12 can also adjust the correction sensitivity or adjust the upper limit of the amount of correction according to the distance between the leading vehicle indicated by the second content and the vehicle 2 so that at least a part of the second content is displayed within the display area of the display medium 3.
[0070] For example, in (a) of Fig. 5, it is assumed that a leading vehicle (object) is located at a long distance of about 100m to 60m from vehicle 2. In this case, the second content is disposed on the upper side of the display area, and a small gap is formed between the upper end of the second content and the upper edge of the display area, and the amount of correction that can be made above the second content is small. However, a large gap is formed between the lower end of the second content and the lower edge of the display area, and the amount of correction that can be made below the second content exists.
[0071] In (b) of Fig. 5, it is assumed that the preceding vehicle is located at a medium distance of about 60m to 30m from vehicle 2. In this case, the second content is placed in the center of the display area, a gap is formed between the upper end of the second content and the upper edge of the display area, and a correction amount that can be corrected exists above the second content. A gap is formed between the lower end of the second content and the lower edge of the display area, and a correction amount that can be corrected exists below the second content.
[0072] In (c) of Fig. 5, it is assumed that the preceding vehicle is located at a short distance of about 30m to 0m from vehicle 2. In this case, the second content is largely arranged in the center of the display area, a gap is formed between the upper end of the second content and the upper edge of the display area, and a correction amount that can be corrected exists above the second content. A small gap is formed between the lower end of the second content and the lower edge of the display area, and a small correction amount that can be corrected exists below the second content.
[0073] In this way, the display generation unit 12b determines the display mode of the second content according to the distance from the vehicle 2 to the leading vehicle based on the vehicle-related information. The correction amount adjustment unit 12c adjusts the amount of correction related to the arrangement position of the second content whose display mode has been determined.
[0074] As a result, even if the vehicle 2 shakes, the entire second content is displayed in the display area so as to follow the target object.
[0075] In addition, when the content is a second content for displaying a leading vehicle, the control unit 12 can further adjust the amount of correction according to the distance from the vehicle 2 to the object so that at least a portion of the second content is displayed within the display area of the display medium 3.
[0076] FIG. 5(d) shows the second content before it is cut off, and FIG. 5(e) shows the second content after it is cut off. FIG. 5(d) and (e) assume that a leading vehicle is located close to vehicle 2. In this embodiment, even if vehicle 2 sways, it is possible to allow a portion of the second content to be cut off. If the cut-off is not allowed, when vehicle 2 sways, the entire second content will remain positioned at the bottom edge of the display area, and the second content will no longer properly display the object.
[0077] Therefore, in this embodiment, as shown in (d) of Fig. 5, the correction amount adjustment unit 12c sets the width to be smaller than the vertical width of the second content in order to display the second content indicating the leading vehicle at least in the display area. The correction amount adjustment unit 12c can form a larger gap between the lower dashed line and the lower edge of the display area by adjusting, for example, the upper limit value of the correction amount on the lower side of the display area. The correction amount adjustment unit 12c adjusts the correction amount for the arrangement position of the second content in which the upper limit value between the lower dashed line and the lower edge of the display area has been changed.
[0078] As a result, even if the vehicle 2 shakes, at least a part of the second content is displayed in the display area so as to follow the target object, as shown in FIG. 5(e).
[0079] In (d) and (e) of Figure 5, the upper limit of the correction amount for the lower side of the display area is changed so as to leave a small gap between the lower dashed line and the lower edge of the display area, but the same applies when the upper limit of the correction amount for the upper side of the display area is changed so as to leave a small gap between the upper dashed line and the upper edge of the display area.
[0080] Next, the control unit 12 can adjust the correction amount, that is, the correction sensitivity, according to the distance between the moving object indicated by the third content and the vehicle 2. Furthermore, the control unit 12 can adjust the upper limit value of the correction amount according to the distance between the moving object indicated by the third content and the vehicle 2 so that at least a part of the third content is displayed within the display area of the display medium 3.
[0081] For example, in (a) of Fig. 6, it is assumed that a moving object (target object) that is a pedestrian is present at a long distance from the vehicle 2. In this case, the third content is disposed at the upper side of the display area, and a small gap is formed between the upper end of the third content and the upper edge of the display area, and the amount of correction that can be made above the third content is small. However, a large gap is formed between the lower end of the third content and the lower edge of the display area, and the amount of correction that can be made below the third content exists.
[0082] In (b) of FIG. 6, it is assumed that the moving object is located at a medium distance from the vehicle 2. In this case, since the third content is disposed in the center of the display area, a gap is formed between the upper end of the third content and the upper edge of the display area, and a gap is formed between the lower end of the third content and the lower edge of the display area. As shown in (b) of FIG. 6, the amount of correction that can be corrected may not be set, and the amount of correction may not be limited. For example, as long as the amount of correction that can be corrected is equal to or greater than a predetermined value, the amount of correction that can be corrected may not be limited. This is also true in the other figures. Also, the amount of correction that can be corrected may be set above the third content, and the amount of correction that can be corrected below the third content.
[0083] In (c) of Fig. 6, it is assumed that the moving object is located close to the vehicle 2. In this case, the third content is largely arranged in the center of the display area, a gap is formed between the upper end of the third content and the upper edge of the display area, and a correction amount that can be corrected exists above the third content. A small gap is formed between the lower end of the third content and the lower edge of the display area, and a small correction amount that can be corrected exists below the third content.
[0084] In this way, the display generation unit 12b determines the display mode of the third content according to the distance from the vehicle 2 to the moving object based on the vehicle-related information. The correction amount adjustment unit 12c adjusts the amount of correction related to the arrangement position of the third content whose display mode has been determined.
[0085] As a result, even if the vehicle 2 shakes, the entire third content is displayed in the display area so as to follow the moving object.
[0086] In addition, when the content is a third content for indicating a moving object existing in the foreground, the control unit 12 can further adjust the amount of correction according to the distance from the vehicle 2 to the moving object so that at least a portion of the third content is displayed within the display area of the display medium 3.
[0087] FIG. 6(d) shows the third content before it is cut off, and FIG. 6(e) shows the third content after it is cut off. FIG. 6(d) and (e) assume that a moving object is present at a long distance from vehicle 2. In this embodiment, it is possible to allow a portion of the third content to be cut off even when vehicle 2 shakes. If the cut-off is not allowed, when vehicle 2 shakes, the entire third content will remain positioned at the upper side of the display area, and the third content will no longer properly display the moving object.
[0088] Therefore, in this embodiment, as shown in (d) of Fig. 6, the correction amount adjustment unit 12c sets the width of the third content in the vertical direction to be smaller than that of the third content in order to display the third content showing a moving object at least in the display area. The correction amount adjustment unit 12c can form a larger gap between the upper dashed line and the upper edge of the display area by adjusting, for example, the upper limit value of the correction amount on the upper side of the display area. The correction amount adjustment unit 12c adjusts the correction amount for the arrangement position of the third content in which the upper limit value between the upper dashed line and the upper edge of the display area has been changed.
[0089] As a result, even if the vehicle 2 shakes, as shown in FIG. 6(e), at least a part of the third content is displayed in the display area so as to follow the moving object.
[0090] In (d) and (e) of Figure 6, the upper limit of the correction amount for the upper side of the display area is changed so as to leave a small gap between the upper dashed line and the upper edge of the display area, but the same applies when the upper limit of the correction amount for the lower side of the display area is changed so as to leave a small gap between the lower dashed line and the lower edge of the display area.
[0091] Next, when the content is a fourth content for indicating a lane marking on a road surface, the control unit 12 can adjust the upper limit value of the correction amount according to the distance between the object indicated by the fourth content and the vehicle 2 so that at least a portion of the fourth content is displayed within the display area of the display medium 3.
[0092] FIG. 7A (a) shows the fourth content before cutting off, and FIG. 7A (b) shows the fourth content after cutting off. FIG. 7A (a) and (b) assume a case where lanes exist from a long distance to a short distance of the vehicle 2. In this embodiment, even if the vehicle 2 sways, cutting off of a part of the fourth content can be tolerated. If cutting off is not permitted, when the vehicle 2 sways, the entire fourth content will be positioned out of place in the display area, and the fourth content will no longer properly show the lanes.
[0093] Therefore, in this embodiment, as shown in (a) of FIG. 7A, the correction amount adjustment unit 12c sets the width of the fourth content in the vertical direction to be smaller than the width of the fourth content in order to display the fourth content indicating the lane at least in the display area. For example, the correction amount adjustment unit 12c adjusts the upper limit value of the correction amount on the upper side of the display area, thereby making it possible to form a larger gap between the upper dashed line and the upper edge of the display area. The correction amount adjustment unit 12c adjusts the correction amount for the arrangement position of the fourth content in which the upper limit value between the upper dashed line and the upper edge of the display area has been changed.
[0094] As a result, even if the vehicle 2 sways as shown in FIG. 7A(b), at least a part of the fourth content is displayed in the display area so as to follow the lane.
[0095] In FIG. 7A, the upper limit of the correction amount for the upper side of the display area is changed so as to leave a small gap between the upper dashed line and the upper edge of the display area, but the same applies when the upper limit of the correction amount for the lower side of the display area is changed so as to leave a small gap between the lower dashed line and the lower edge of the display area.
[0096] Next, the control unit 12 can further adjust the correction amount in accordance with the traveling speed of the vehicle 2. The control unit 12 can further adjust the correction amount so that the correction amount becomes smaller as the traveling speed of the vehicle 2 becomes faster.
[0097] As shown in (a) and (b) of Figure 7B, the amount of correction that can be made may be adjusted so that the faster the traveling speed of the vehicle 2, the smaller the gap between the upper dashed line and the upper edge of the display area becomes, and the smaller the gap between the lower dashed line and the lower edge of the display area becomes. For example, (a) of Figure 7B shows the vehicle 2 traveling at low speed on an ordinary road, and (b) of Figure 7B shows the vehicle 2 traveling at high speed on an expressway.
[0098] This is because the faster the traveling speed of the vehicle 2, the less likely the shaking of the vehicle 2 will increase, and therefore the control unit 12 adjusts the possible correction amount to be smaller.
[0099] Next, the control unit 12 can further adjust the correction amount according to the type of road on which the vehicle 2 travels. The roads on which the vehicle 2 travels include expressways and general roads. When the vehicle 2 travels on an expressway, the control unit 12 can further adjust the correction amount to be smaller than when the vehicle 2 travels on a general road.
[0100] This is because, compared to ordinary roads, on expressways, the misalignment of the content superimposed on objects such as road forks indicated in navigation guidance is less likely to occur, and there are many types of such content. Since events in which third content such as PCW, which is a function that warns of a high possibility of contact or collision with a moving object, are displayed are less likely to occur, there is little impact even if the amount of correction that can be corrected is adjusted to be smaller.
[0101] Next, the control unit 12 can adjust the attitude of the content so that the content to be displayed in association with the object is displayed within the display area of the display medium 3 as the distance from the vehicle 2 to the object increases.
[0102] For example, when content is superimposed on an object far from the vehicle 2, depending on the orientation of the content, it may not be acceptable for the leading edge of the content to be cut off when the leading edge of the content is near the upper edge or lower edge of the display area. For this reason, it is desirable to change the position of the content so that the content is not cut off while still showing the object far away.
[0103] For example, in (a) of FIG. 8, it is assumed that the first content indicates a distant object. When the object is a branch point such as an acute intersection or a Y-shaped intersection, the first content is originally intended to indicate the upper side. When the first content cannot be cut off, as shown in (b) of FIG. 8, the correction amount adjustment unit 12c moves the first content to a position indicated by a correctable broken line so as to secure a correctable correction amount between the first content and the upper edge of the display area. That is, in order to display the entire first content in the display area, the correction amount adjustment unit 12c moves the first content to a position where the attitude of the first content can be changed. Then, the correction amount adjustment unit 12c adjusts the attitude of the first content so that the first content becomes the first content indicated by the solid line and correctly points to the intersection or branch point. The attitude includes the arrangement position of the content and the orientation of the content.
[0104] In another example, in (c) of FIG. 8, it is assumed that the third content indicates a moving object such as a pedestrian in the distance. In this case, the third content is originally intended to indicate the upper side. When the cut-off of the third content is not acceptable, as shown in (d) of FIG. 8, the correction amount adjustment unit 12c moves the third content to a position indicated by a correctable broken line so as to secure a correctable correction amount between the third content and the upper edge of the display area. In other words, the correction amount adjustment unit 12c moves the attitude of the third content to a position where it can be changed in order to display the entire third content in the display area. Then, the correction amount adjustment unit 12c adjusts the attitude of the third content so that the third content becomes the third content indicated by the solid line and correctly points to the moving object.
[0105] Next, when the control unit 12 corrects the placement position of the content based on the correction amount, it can output an instruction to the display unit 14 to display supplementary information together with the content. The supplementary information also includes the direction from the vehicle 2 to the object and the distance from the vehicle 2 to the object. The direction from the vehicle 2 to the object is indicated by an arrow, and the distance from the vehicle 2 to the object is indicated by the color of the content, the shape of the content, or a numerical value.
[0106] For example, when a misalignment correction value for correcting the misalignment amount of the arrangement position of the second content is calculated from a state in which the second content is displayed as shown in (a) of FIG. 9 to a state in which the display generation unit 12b adds supplementary information together with the second content based on the misalignment correction value of the arrangement position of the content. The correction amount adjustment unit 12c also adjusts the amount of correction that can be made for the supplementary information, and the correction value calculation unit 12a calculates the misalignment correction value. The drawing unit 13 draws the supplementary information, and the display unit 14 displays it together with the second content in the display area. The supplementary information in (b) of FIG. 9 indicates the direction from the vehicle 2 to the target object with an arrow.
[0107] For example, when the position of the first content is corrected from the state shown in Fig. 9(c) to the state shown in Fig. 9(d), the display generation unit 12b adds supplementary information together with the first content. The supplementary information in Fig. 9(d) is indicated by the direction from the vehicle 2 to the object (upward arrow) and the distance from the vehicle 2 to the object, "30 m."
[0108] When the distance from the vehicle 2 to the target object is represented by the color of the content, for example, the closer the distance from the vehicle 2, the redder the content is displayed, and the farther the distance from the vehicle 2, the bluer the content is displayed. The shape of the content may be displayed as a shape that extends laterally as the distance from the vehicle 2 is closer, and a shape that extends vertically and thinner as the distance from the vehicle 2 is farther.
[0109] 9 are merely examples and are not limited to the present embodiment. Therefore, known numerical values, colors, shapes, etc. may be used.
[0110] <Example 1> Next, an example of the operation of the display device 1, the display method, and the program in this embodiment will be described with reference to Fig. 10. In Fig. 10, an example of the operation when the correction amount is adjusted according to each content, as shown in (a), (b), and (c) of Fig. 4, (a), (b), and (c) of Fig. 5, and (a), (b), and (c) of Fig. 6, will be described.
[0111] FIG. 10 is a flowchart showing a first operation example of the display device 1 according to the embodiment.
[0112] First, the input unit 11 acquires the vehicle-related information output from each of the multiple devices (S11). The input unit 11 outputs the acquired vehicle-related information to the display device 1.
[0113] Next, the display generation unit 12b acquires the vehicle-related information acquired by the input unit 11 of the display device 1, generates content based on the vehicle-related information, and determines the display mode of the generated content (S12). After determining the display mode of the generated content, the display generation unit 12b outputs the generated content and the determined display mode of the content to the correction amount adjustment unit 12c.
[0114] Next, the correction amount adjustment unit 12c calculates the amount of correction that can be used to correct the content. That is, the correction amount adjustment unit 12c calculates the amount of correction that can be used for each content from the content determined by the display generation unit 12b and the display mode of the content (S13). In addition, the correction amount adjustment unit 12c repeatedly executes step S13 for each content according to each content determined by the display generation unit 12b.
[0115] Next, the correction amount adjustment unit 12c adjusts the correction amount based on the relationship between the arrangement position according to each content displayed in the display area and the position of the object present across the display area.
[0116] Specifically, the correction amount adjustment unit 12c extracts the smallest correction amount from among one or more correction amounts calculated for each acquired content. Then, the correction amount adjustment unit 12c adjusts the extracted smallest correction amount for each content determined by the display generation unit 12b (S14). The correction amount adjustment unit 12c outputs to the drawing unit 13 the one or more contents determined by the display generation unit 12b, the display modes of the one or more contents, and the correction amount adjusted for each of the one or more contents.
[0117] 10, the correction amount adjustment unit 12c extracts the smallest correction amount from among the multiple correction amounts, and adjusts the correction amounts for all the contents to match the extracted smallest correction amount, but is not limited to this. As described above, the correction amount adjustment unit 12c may adjust the correction amount for each content.
[0118] Next, the drawing unit 13 draws each content according to the display mode of each content, based on the content and the display mode of the content acquired from the display generation unit 12b via the correction amount adjustment unit 12c, and the correction amount corresponding to each content acquired from the correction amount adjustment unit 12c, in order to project each content from the display unit 14 onto the display medium 3. That is, the drawing unit 13 draws each content according to the determined display mode and the adjusted correction amount (S15). The display unit 14 projects light (display light) indicating each content onto the display medium 3 based on the drawing result of the drawing unit 13, thereby displaying each content, which is the display light, as a virtual image through the display medium 3. This allows the user to view each content displayed through the display medium 3 as a virtual image.
[0119] Then, the operation example of FIG. 10 ends.
[0120] <Example 2> Next, an example of the operation of the display device 1, the display method, and the program in this embodiment will be described with reference to Fig. 11. In Fig. 11, an example of the operation when content cut-off is permitted will be described, as shown in (d) and (e) of Fig. 4, (d) and (e) of Fig. 5, (d) and (e) of Fig. 6, and (a) and (b) of Fig. 7A.
[0121] FIG. 11 is a flowchart showing a second operation example of the display device 1 according to the embodiment.
[0122] In this operation example, operations similar to those in operation example 1 are denoted by the same reference numerals and descriptions thereof will be omitted as appropriate.
[0123] First, after steps S11 and S12, the correction amount adjustment unit 12c acquires a correction amount for allowing cutoff in the content (S13a). That is, the correction amount adjustment unit 12c acquires a correction amount with a changed upper limit.
[0124] The correction value calculation unit 12a repeatedly executes steps S13a and S13 for each content, depending on the content determined by the display generation unit 12b.
[0125] Thereafter, in this operation example, the operation goes through steps S14 and S15, and the operation example of FIG. 11 ends.
[0126] <Example 3> Next, an example of the operation of the display device 1, the display method, and the program in this embodiment will be described with reference to Fig. 12. In Fig. 12, an example of the operation in the case where the cut-off of the content is not permitted, as shown in Fig. 8, will be described.
[0127] FIG. 12 is a flowchart showing a third operation example of the display device 1 according to the embodiment.
[0128] In this operation example, operations similar to those in operation example 1 are denoted by the same reference numerals and descriptions thereof will be omitted as appropriate.
[0129] First, through steps S11 to S13, the correction amount adjustment unit 12c judges whether the calculated correction amount of the content is equal to or less than a first threshold (S13b). In other words, if the correction amount of the content is equal to or less than the first threshold, the content will be cut off, so it is judged whether the correction amount has been adjusted to a value that will not cause cuts in the content.
[0130] When the correction amount adjustment unit 12c determines that the calculated correction amount of the content is equal to or less than the first threshold value (YES in S13b), the correction value calculation unit 12a moves the content to a position where the content can be corrected, and adjusts the correction amount so that the content is positioned forward (S16). This makes it possible to increase the correction amount for the content position.
[0131] Next, the correction amount adjustment unit 12c adjusts the attitude of the content so that the content changes from the dashed line content in (b) and (d) of Figure 8 to the solid line content and correctly points to the target object (S17). Then, in the operation example of the display device 1, the process proceeds to step S13.
[0132] Furthermore, the correction value calculation unit 12a repeatedly executes steps S13, S13b, S16, and S17 for each content, depending on the content determined by the display generation unit 12b.
[0133] On the other hand, if the correction amount adjuster 12c determines that the calculated correction amount of the content is less than the first threshold value (NO in S13b), in this operation example, the operation example of FIG. 12 ends after steps S14 and S15.
[0134] <Example 4> Next, an example of the operation of the display device 1, the display method, and the program in this embodiment will be described with reference to Fig. 13. In Fig. 13, an example of the operation when correcting the amount of deviation in the layout position of the content shown in Fig. 9 will be described.
[0135] FIG. 13 is a flowchart showing a fourth operation example of the display device 1 according to the embodiment.
[0136] In this operation example, operations similar to those in operation example 1 are denoted by the same reference numerals and descriptions thereof will be omitted as appropriate.
[0137] First, through steps S11 and S12, the correction amount adjustment unit 12c acquires the deviation correction value of the content calculated by the correction value calculation unit 12a (S12a).
[0138] After step S13, the correction amount adjuster 12c determines whether the calculated deviation correction value of the content is equal to or greater than the second threshold value (S13c).
[0139] When the correction amount adjuster 12c determines that the calculated content misalignment correction value is equal to or greater than the second threshold value (YES in S13c), the correction value calculator 12a calculates a misalignment correction value, which is the amount of misalignment of the content placement position (S16a). The correction value calculator 12a outputs the calculated misalignment correction value to the display generator 12b.
[0140] Next, the display generation unit 12b generates supplemental information based on the deviation correction value of the content placement position. The display generation unit 12b adds the supplemental information generated according to the content (S17a). The display generation unit 12b adds the supplemental information for each content, and outputs the content, the supplemental information, and the display mode of the content to which the supplemental information has been added to the correction amount adjustment unit 12c. Then, in the operation example of the display device 1, the process proceeds to step S13.
[0141] Furthermore, steps S13, S13c, S16a, and S17a are repeatedly executed for each content according to the content determined by the display generation unit 12b.
[0142] On the other hand, if the correction amount adjustment unit 12c determines that the calculated content deviation correction value is less than the second threshold value (NO in S13c), in this operation example, the operation example of FIG. 13 is terminated via steps S14 and S15.
[0143] <Action and effect> Next, the effects of the display device 1, the display method, and the program according to the present embodiment will be described.
[0144] As described above, the display device 1 of the first aspect according to the present embodiment includes the control unit 12 that determines one or more pieces of content to be displayed in association with an object existing in the foreground of the vehicle 2, and the display unit 14 that projects light indicating the content determined by the control unit 12 onto the display medium 3 provided in the vehicle 2, thereby displaying the content as a virtual image through the display medium 3. The control unit 12 then adjusts the amount of correction related to the position of the content depending on the content.
[0145] According to this, since the correction amount for the position of the content displayed on the display medium 3 can be adjusted, the object shown by the content can be displayed even if the vehicle 2 shakes while traveling. Also, since the correction amount can be adjusted for each content, the object according to the content can be displayed.
[0146] Therefore, according to the present disclosure, it is possible to adjust the correction amount appropriately for each content.
[0147] The display device 1 of the second aspect according to the present embodiment is the display device 1 described in the first aspect. In this case, the control unit 12 further adjusts the correction amount according to the relationship between the arrangement position of the content displayed in the display area of the display medium 3 and the position of an object existing across the display area.
[0148] According to this, the amount of correction can be adjusted according to the relationship between the layout position of the content and the position of the object across the display area, so that the content can be laid out so as to show the object.
[0149] Moreover, the display device 1 of the third aspect according to the present embodiment is the display device 1 described in the second aspect. In this case, the control unit 12 adjusts the correction amount so that the correction range between the upper side (upper edge) of the display area and the upper end of the content becomes narrower as the distance from the vehicle 2 to the object becomes longer.
[0150] This allows the content to be positioned close to the upper edge of the display area even if the object is located far away from the vehicle 2. Therefore, even if the vehicle 2 shakes while traveling, the content can be positioned so as to show the object reflected through the display medium 3.
[0151] Moreover, the display device 1 of the fourth aspect according to the present embodiment is the display device 1 described in the second or third aspect. In this case, the control unit 12 adjusts the correction amount so that the correction range between the bottom side of the display area and the bottom end of the content becomes narrower as the distance from the vehicle 2 to the target object becomes closer.
[0152] This allows the content to be positioned close to the bottom edge of the display area even if the object is located near the vehicle 2. Therefore, even if the vehicle 2 shakes while traveling, the content can be positioned so as to show the object reflected through the display medium 3.
[0153] The display device 1 of a fifth aspect according to the present embodiment is the display device 1 according to any one of the first to third aspects. In this case, the control unit 12 further adjusts the correction amount according to the distance from the vehicle 2 to the object.
[0154] This makes it possible to adjust the amount of correction that can be made so as to suit the distance from the vehicle 2 to the object. In other words, if the distance from the vehicle 2 to the object is far, the content can be displayed small on the upper side of the display area, and if the distance from the vehicle 2 to the object is close, the content can be displayed large in the center of the display area. This makes it possible to appropriately arrange the content in the display area according to the distance from the vehicle 2 to the object.
[0155] Moreover, the display device 1 of a sixth aspect according to the present embodiment is the display device 1 according to any one of the first to fifth aspects. In this case, when the content is a first content for indicating a traveling direction on a road, the control unit 12 further adjusts the correction amount according to the distance from the vehicle 2 to the object so that at least the tip indicated by the first content is displayed within the display area of the display medium 3.
[0156] According to this, even if a part of the first content is cut off, the tip of the first content is displayed in the display area, so that the user can recognize the object indicated by the first content.
[0157] Furthermore, even if the vehicle 2 shakes while traveling, by cutting off part of the first content, it is possible to continue to properly display the object shown by the first content.
[0158] The display device 1 of a seventh aspect according to the present embodiment is the display device 1 according to any one of the first to sixth aspects. In this case, the content includes a second content for indicating the preceding vehicle as an object. The object includes the preceding vehicle. The control unit 12 further adjusts the correction amount according to the distance between the preceding vehicle indicated by the second content and the vehicle 2.
[0159] This makes it possible to adjust the amount of correction that can be made so as to suit the distance from the vehicle 2 to the preceding vehicle. In other words, if the distance from the vehicle 2 to the preceding vehicle is far, the second content can be displayed small on the upper side of the display area, and if the distance from the vehicle 2 to the preceding vehicle is close, the second content can be displayed large on the lower side of the display area. This makes it possible to appropriately arrange the second content in the display area according to the distance from the vehicle 2 to the preceding vehicle.
[0160] The display device 1 of an eighth aspect according to the present embodiment is the display device 1 described in the seventh aspect. In this case, the control unit 12 adjusts the correction amount according to the distance between the leading vehicle and the vehicle 2 indicated by the second content so that at least a part of the second content is displayed within the display area of the display medium 3.
[0161] According to this, even if a part of the second content is cut off, the remaining part of the second content is displayed in the display area, so that the user can recognize the object indicated by the second content.
[0162] Furthermore, even if the vehicle 2 shakes while traveling, by cutting off part of the second content, it is possible to continue to properly display the object shown by the second content.
[0163] The display device 1 of a ninth aspect according to the present embodiment is the display device 1 according to any one of the first to eighth aspects. In this case, the content includes a third content for showing a moving object existing in the foreground. The control unit 12 adjusts the correction amount according to the distance between the moving object shown by the third content and the vehicle 2.
[0164] This makes it possible to adjust the amount of correction that can be performed so as to suit the distance from the vehicle 2 to the moving object. In other words, if the distance from the vehicle 2 to the moving object is far, the third content can be displayed small on the upper side of the display area, and if the distance from the vehicle 2 to the moving object is close, the third content can be displayed large on the lower side of the display area. This makes it possible to appropriately arrange the third content in the display area according to the distance from the vehicle 2 to the moving object.
[0165] The display device 1 of a tenth aspect according to the present embodiment is the display device 1 described in the ninth aspect. In this case, the control unit 12 adjusts the correction amount according to the distance between the moving object indicated by the third content and the vehicle 2 so that at least a part of the third content is displayed within the display area of the display medium 3.
[0166] According to this, even if a part of the third content is cut off, the remaining part of the third content is displayed in the display area, so that the user can recognize the moving object indicated by the third content.
[0167] Furthermore, even if the vehicle 2 shakes while traveling, by cutting off part of the third content, it is possible to continue to properly display the moving object shown by the third content.
[0168] The display device 1 of an eleventh aspect according to the present embodiment is the display device 1 according to any one of the first to tenth aspects. In this case, the content includes a fourth content for indicating lanes. The control unit 12 adjusts the correction amount according to the distance between the vehicle 2 and an object indicated by the fourth content, so that at least a part of the fourth content is displayed within the display area of the display medium 3.
[0169] According to this, even if a part of the fourth content is cut off, the remaining part of the fourth content is displayed in the display area, so that the user can recognize the lane indicated by the fourth content.
[0170] Furthermore, even if the vehicle 2 shakes while traveling, by cutting off part of the fourth content, it is possible to continue to properly display the lane indicated by the fourth content.
[0171] The display device 1 according to a twelfth aspect of the present embodiment is the display device 1 according to any one of the first to eleventh aspects. In this case, the control unit 12 further adjusts the correction amount according to the traveling speed of the vehicle 2.
[0172] According to this, the correction amount can be adjusted according to the traveling speed of the vehicle 2. Therefore, even if the vehicle 2 shakes while traveling, the content can be adjusted by the correction amount according to the speed, so that the object shown by the content can continue to be displayed appropriately.
[0173] The display device 1 of a thirteenth aspect according to the present embodiment is the display device 1 according to the twelfth aspect. In this case, the control unit 12 further adjusts the correction amount so that the correction amount decreases as the traveling speed of the vehicle 2 increases.
[0174] According to this, the control unit 12 can reduce the correction amount, which is within the range in which correction can be performed, because the sway of the vehicle 2 tends to be suppressed as the traveling speed of the vehicle 2 increases. Also, the control unit 12 can increase the correction amount, which is within the range in which correction can be performed, because the sway of the vehicle 2 tends to increase as the traveling speed of the vehicle 2 decreases.
[0175] Therefore, even if the vehicle 2 shakes while traveling, the content can be adjusted with a correction amount according to the speed, so that the object shown by the content can continue to be displayed appropriately.
[0176] The display device 1 of a fourteenth aspect according to the present embodiment is the display device 1 according to any one of the first to thirteenth aspects. In this case, the control unit 12 further adjusts the correction amount according to the type of road on which the vehicle 2 travels.
[0177] According to this, the correction amount can be adjusted according to the road on which the vehicle 2 is traveling. Therefore, even if the vehicle 2 shakes while traveling, the content can be adjusted by the correction amount according to the type of road, so that the object shown in the content can continue to be displayed appropriately.
[0178] The display device 1 of a fifteenth aspect according to the present embodiment is the display device 1 according to the fourteenth aspect. In this case, the roads on which the vehicle 2 travels include expressways and general roads. When the vehicle 2 travels on expressways, the control unit 12 further adjusts the correction amount to be smaller than when the vehicle 2 travels on general roads.
[0179] According to this, for example, when the vehicle 2 is traveling on an expressway, the control unit 12 can further adjust the correction amount to be smaller than when the vehicle 2 is traveling on an ordinary road. Also, the control unit 12 can further adjust the correction amount to be larger when traveling on an ordinary road than when traveling on an expressway.
[0180] The display device 1 of a 16th aspect according to the present embodiment is the display device 1 according to any one of the 1st to 15th aspects. In this case, the control unit 12 adjusts the attitude of the content so that the content to be displayed in association with the object is displayed within the display area of the display medium 3 as the distance from the vehicle 2 to the object increases.
[0181] According to this, when the object is located far away from the vehicle 2, even if the content cannot be cut off, the control unit 12 adjusts the attitude of the content, so that the content can continue to properly show the object.
[0182] The display device 1 of a 17th aspect according to the present embodiment is the display device 1 according to any one of the 1st to 16th aspects. In this case, the control unit 12 has a correction value calculation unit 12a that calculates a deviation correction value from an object existing in the foreground of the vehicle 2 to the content. When the control unit 12 corrects the placement position of the content based on the correction amount, the control unit 12 outputs an instruction to the display unit 14 to display supplementary information together with the content.
[0183] According to this, when the position of the content is corrected, the supplementary information can be displayed in the display area, so that the user can understand the change in the content, and therefore the user can understand the object represented by the content and can be given a sense of security regarding the change in the content.
[0184] The display device 1 of an 18th aspect according to the present embodiment is the display device 1 according to any one of the 1st to 17th aspects. In this case, the supplemental information includes the direction from the vehicle 2 to the object and the distance from the vehicle 2 to the object.
[0185] This makes it possible to display in the display area the direction from the vehicle 2 to the object and the distance from the vehicle 2 to the object. This allows the user to recognize the direction from the vehicle 2 to the object and the distance from the vehicle 2 to the object.
[0186] A display device 1 according to a 19th aspect of the present embodiment is the display device 1 according to the 18th aspect. In this case, the direction from the vehicle 2 to the object is indicated by an arrow. The distance from the vehicle 2 to the object is indicated by the color of the content, the shape of the content, or a numerical value.
[0187] This allows the display area to be displayed in a manner that makes it easy for the user to recognize the direction from the vehicle 2 to the object and the distance from the vehicle 2 to the object. This makes it easier for the user to recognize the direction from the vehicle 2 to the object and the distance from the vehicle 2 to the object.
[0188] The display device 1 of a twentieth aspect according to the present embodiment is the display device 1 according to any one of the first to nineteenth aspects. In this case, the control unit 12 extracts the smallest correction amount from among the correction amounts for each of a plurality of contents, and adjusts the other correction amounts to match the extracted smallest correction amount.
[0189] According to this, other correction amounts can be extracted so as to match the smallest correction amount among the multiple correction amounts. Therefore, the control unit 12 can collectively adjust the correction amounts of multiple contents and appropriately adjust the correction amounts of all contents.
[0190] In addition, the display method of the 21st aspect of this embodiment includes the control unit 12 determining one or more pieces of content to be displayed in association with an object present in the foreground of the vehicle 2, projecting light indicating the content determined by the control unit 12 onto the display medium 3 provided in the vehicle 2, thereby displaying the content as a virtual image through the display medium 3, and the control unit 12 adjusting the amount of correction related to the position of the content with a correction amount according to each piece of content.
[0191] This display method also provides the same effects as those described above.
[0192] A program according to a twenty-second aspect of the present embodiment is a program that enables a computer to execute the display method according to the twenty-first aspect. This program also provides the same effects as those described above.
[0193] (Other variations) The display device, the display method, and the program according to the present disclosure have been described above based on the above-mentioned embodiments, but the present disclosure is not limited to these embodiments. As long as the modifications do not deviate from the spirit of the present disclosure, modifications that a person skilled in the art may make to the embodiments may also be included in the scope of the present disclosure.
[0194] For example, the control unit, drawing unit, display unit, and the like included in the display device, display method, and program according to the above-mentioned embodiments are typically realized as an LSI, which is an integrated circuit. These may be individually integrated into one chip, or some or all of them may be integrated into one chip.
[0195] The integrated circuit is not limited to an LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may also be used.
[0196] In the above embodiment, each component may be realized by a dedicated hardware or by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
[0197] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, or some functions may be transferred to another functional block. Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.
[0198] In addition, the order in which each step is performed in the flowchart is merely for illustrative purposes and may be other than the above. In addition, some of the steps may be performed simultaneously (in parallel) with other steps.
[0199] In addition, the present disclosure also includes forms obtained by applying various modifications to the above-described embodiments that a person skilled in the art may conceive, and forms realized by arbitrarily combining the components and functions of the embodiments within the scope that does not deviate from the spirit of the present disclosure. [Industrial Applicability]
[0200] The present disclosure can be used for display devices and the like to be mounted on vehicles. [Explanation of symbols]
[0201] 1 Display device 2 Vehicles 3 Display media 12 Control section 12a Correction value calculation unit 14 Display section
Claims
1. a control unit that determines one or more pieces of content to be displayed in association with an object present in front of the vehicle; a display unit that projects light representing the content determined by the control unit onto a display medium provided in the vehicle, thereby displaying the content as a virtual image through the display medium; The control unit adjusts a correction amount for a layout position of the content for each of the content. Display device.
2. The control unit further adjusts the correction amount according to a relationship between a layout position of the content displayed in a display area of the display medium and a position of the object present across the display area. The display device according to claim 1 .
3. The control unit adjusts the correction amount such that a correction range between an upper side of the display area and an upper end of the content becomes narrower as a distance from the vehicle to the object becomes longer. The display device according to claim 2 .
4. The control unit adjusts the correction amount such that a correction range between a bottom side of the display area and a bottom end of the content becomes narrower as a distance from the vehicle to the object becomes closer. The display device according to claim 2 .
5. The control unit further adjusts the correction amount according to a distance from the vehicle to the object. The display device according to any one of claims 1 to 4.
6. When the content is a first content for indicating a traveling direction on a road, the control unit further adjusts the correction amount in accordance with a distance from the vehicle to the object so that at least a tip indicated by the first content is displayed within a display area of the display medium. The display device according to any one of claims 1 to 4.
7. the content includes second content for indicating a leading vehicle as the object; The object includes a preceding vehicle, The control unit further adjusts the correction amount according to a distance between the leading vehicle and the vehicle indicated by the second content. The display device according to any one of claims 1 to 4.
8. The control unit adjusts the correction amount in accordance with a distance between the leading vehicle and the vehicle indicated by the second content so that at least a part of the second content is displayed within a display area of the display medium. The display device according to claim 7.
9. the content includes third content for showing a moving object present in a foreground; The control unit adjusts the correction amount according to a distance between the moving object indicated by the third content and the vehicle. The display device according to any one of claims 1 to 4.
10. The control unit adjusts the correction amount according to a distance between the moving object indicated by the third content and the vehicle so that at least a part of the third content is displayed within a display area of the display medium. The display device according to claim 9.
11. the content includes fourth content for indicating a lane; The control unit adjusts the correction amount in accordance with a distance between the object indicated by the fourth content and the vehicle so that at least a part of the fourth content is displayed within a display area of the display medium. The display device according to any one of claims 1 to 4.
12. The control unit further adjusts the correction amount in accordance with a traveling speed of the vehicle. The display device according to any one of claims 1 to 4.
13. The control unit further adjusts the correction amount so that the correction amount becomes smaller as the traveling speed of the vehicle becomes faster. The display device according to claim 12.
14. The control unit further adjusts the correction amount depending on the type of road on which the vehicle is traveling. The display device according to any one of claims 1 to 4.
15. The roads on which the vehicle travels include expressways and general roads, When the vehicle is traveling on an expressway, the control unit further adjusts the correction amount to be smaller than when the vehicle is traveling on an ordinary road. The display device according to claim 14.
16. The control unit adjusts a posture of the content so that the content to be displayed in association with the object is displayed within a display area of the display medium as the distance from the vehicle to the object increases. The display device according to any one of claims 1 to 4.
17. the control unit includes a correction value calculation unit that calculates a deviation correction value from the object present in front of the vehicle to the content, When the control unit corrects the layout position of the content based on the deviation correction value, the control unit outputs an instruction to the display unit to display supplemental information together with the content. The display device according to any one of claims 1 to 4.
18. The supplemental information includes a direction from the vehicle to the object and a distance from the vehicle to the object. The display device according to claim 17.
19. The direction from the vehicle to the object is indicated by an arrow; The distance from the vehicle to the object is indicated by the color of the content, the shape of the content, or a numerical value. The display device according to claim 18.
20. The control unit extracts the smallest correction amount from among the correction amounts for the plurality of pieces of content, and adjusts other correction amounts so as to match the smallest correction amount extracted. The display device according to any one of claims 1 to 4.
21. A control unit determines one or more pieces of content to be displayed in association with an object present in front of the vehicle; projecting light indicating the content determined by the control unit onto a display medium provided in the vehicle, thereby displaying the content as a virtual image through the display medium; and adjusting a correction amount for a layout position of the content by the control unit according to the correction amount for each of the content. Display method.
22. A display method according to claim 21, program.
Citation Information
Patent Citations
Display control device, display control program, and heads-up display
WO2021044741A1