Display device, display method, and program

Abstract

To provide a display device and the like capable of displaying images more properly.SOLUTION: A display device 100 is a display device 100 capable of making a user 51 recognize visibly a virtual image 42 of an image 41 formed in a predetermined area A2 of the outside corresponding to a predetermined angle of view by projecting an image 41 within a predetermined angle of view (display area A1) of a display medium 34 through which the outside world can be seen. The display device includes: a projection unit 21 that projects light representing the image 41 onto the display medium 34; an acquisition unit (first acquisition unit 11) that acquires the overlap distance that is the distance from the user 51 to the position where the virtual image 42 of the image 41 is formed; and a control unit 13 that is configured so as to, when the original projection position of image 41 is outside the specified field of view, control the projection unit 21 to project while changing the projection position of the image 41 by the amount corresponding to the overlap distance.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a display device for displaying an image to a user, a display method, and a program for executing the display method.

Background Art

[0002] Conventionally, a display device that allows a user to visually recognize a virtual image that overlaps with the outside world by reflecting light for projecting an image onto a display medium that transmits light from the outside has been known. For example, in a vehicle, as one such display device, a head-up display (hereinafter also referred to as HUD) has been put into practical use. Further, it is possible to change the overlapping position according to the height of the viewpoint of the driver who is the user of the vehicle (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When the technology disclosed in Patent Document 1 above is applied, it may be difficult to display an appropriate image. Therefore, an object of the present disclosure is to provide a display device and the like that can display an image more appropriately.

Means for Solving the Problems

[0005] In order to solve the above problems, a display device according to an aspect of the present disclosure is a display device that forms a virtual image of an image in a predetermined region of the external world corresponding to a predetermined viewing angle by projecting the image within the predetermined viewing angle of a display medium through which the external world can be seen and allowing a user to visually recognize it, the display device including: a projection unit that projects light indicating the image onto the display medium; an acquisition unit that acquires a superimposition distance, which is the distance from the user to the position where the virtual image of the image is formed; and a control unit that, when the original projection position of the image is outside the predetermined viewing angle, changes the projection position of the image by an amount of change corresponding to the superimposition distance and causes the projection unit to project it.

[0006] Further, a display method according to an aspect of the present disclosure is a display method that is executed by a computer and forms a virtual image of an image in a predetermined region of the external world corresponding to a predetermined viewing angle by projecting the image within the predetermined viewing angle of a display medium through which the external world can be seen and allowing a user to visually recognize it, the display method including: a step of projecting light indicating the image onto the display medium; a step of acquiring a superimposition distance, which is the distance from the user to the position where the virtual image of the image is formed; and a step of changing the projection position of the image by an amount of change corresponding to the superimposition distance when the original projection position of the image is outside the predetermined viewing angle.

[0007] Further, a program according to an aspect of the present disclosure is a program for causing a computer to execute the display method described above.

Advantages of the Invention

[0008] According to the present disclosure, it becomes possible to display an image more appropriately.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0010] (Findings Leading to the Present Disclosure) A display device mounted on a vehicle such as a HUD is a device that displays all information related to the vehicle to a user such as a driver who operates the vehicle, using an image (for example, visual information including figures such as numbers, letters, and arrows).

[0011] Examples of the information displayed by the display device include information displayed on instruments such as the driving status of a power unit such as a motor or an internal combustion engine, traveling speed, temperature of each droplet, supply voltage to electrical components, supercharging pressure to a compressor, etc., warning information based on the relationship with the surroundings of the vehicle such as lane departure, speed overrun, and starting of the vehicle ahead, remaining travel time to the destination, direction, distance, and route information such as the traveling direction on the travel route (e.g., turn by turn), traffic sign information such as speed limits, parking prohibition, and lane regulations on the travel road, terminal information via an information terminal carried by the user such as phone calls, emails, and notifications from specific applications, and all kinds of information. Further, the image displayed by the display device does not have to be an image related to the vehicle. For example, the display device may be used to display a photo or a moving image according to the user's preference, or may be used to display information such as an Internet site.

[0012] In particular, the HUD projects an image onto a display medium such as a windshield (front glass) and a combiner installed in front of the vehicle cockpit, and reflects the image on the display medium, thereby forming a virtual image at a position farther from the display medium as seen by the user (in front of the vehicle or the like) for visual recognition. At this time, since the display medium has light transmissibility (also referred to as translucency), the light incident from the outside of the display medium is superimposed on the virtual image as the scenery outside and visually recognized by the user.

[0013] Here, by configuring the HUD using the technology disclosed in Patent Document 1, it is possible to appropriately set a predetermined viewing angle at which an image is displayed according to the seating conditions of the user (the user's seat height and the set seat surface height). On the other hand, when the seating conditions and such a predetermined viewing angle are set, a part of the image (especially a part in the vertical direction corresponding to the user's eye height) may be cut off. Therefore, in the present disclosure, an adjustment of the image is performed so that a part of the image that would otherwise be cut off is displayed within the predetermined viewing angle. However, if the adjustment is simply made to fit within the predetermined area, for example, it may not be possible to distinguish between an image that is cut off at a superimposed distance of 25 m and an image that is cut off at a superimposed distance of 40 m. That is, there is a possibility of making an adjustment that loses the information on the superimposed distance. In contrast, in the present disclosure, when adjusting the image, for a part of the image that is the object of the adjustment, the projection position is changed by an amount corresponding to the original superimposed distance. As a result, since the amount of change corresponds to the original superimposed distance, information on the superimposed distance can be read from the projection position. That is, it is possible to maintain the information that is lost due to the adjustment when displaying the image within the predetermined viewing angle. Therefore, it becomes possible to display the image more appropriately in terms of dealing with information loss.

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each of the embodiments described below shows a comprehensive or specific example of the present disclosure. Therefore, the numerical values, components, arrangement positions and connection forms of the components, and the steps and the order of the steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Therefore, among the components in the following embodiments, the components not described in the independent claims of the present disclosure are described as optional components.

[0015] Also, each figure is a schematic diagram and is not necessarily drawn precisely. Therefore, the scales etc. in each figure do not necessarily match. In each figure, the same reference numerals are given to substantially the same configurations, and duplicate explanations are omitted or simplified.

[0016] (Embodiment) [Display device] First, an overview of the display device in the embodiment will be described. FIG. 1 is a diagram showing an application example of the display device in the embodiment. In FIG. 1, the interior of a vehicle 50, which is an example of a moving body equipped with the display device 100, is shown. Further, the display device 100 is arranged to be built into the instrument panel of the vehicle 50 and is not visible from the user 51 (see FIG. 2 described later). As a result, the interior design of the vehicle 50 can be freely carried out, and the display device 100 can be mounted without impairing the design of the vehicle 50.

[0017] The display device 100 allows the user 51 to visually recognize a virtual image 42 by an image 41 (see FIG. 2 described later) that is reflected through the windshield, which is the display medium 34. Here, although the virtual image 42 is displayed in an arrangement assuming the driver of the vehicle 50 as the user 51, the user 51 may be any of the passengers in the vehicle 50, such as the front passenger seat and the rear seat. Therefore, the display medium 34 may also be realized by a side window, a rear window, a roof window, etc. according to the user 51.

[0018] Here, a state is shown in which the virtual image 42 formed through the display area A1 of the windshield in front of the driver, who is the user 51, is visually recognized. In the display device 100 shown in FIG. 1, the image 41 displayed as the virtual image 42 includes an arrow indicating the traveling direction of the vehicle 50. In FIG. 1, an enlarged view of the content of the display area A1 is shown for readability, and corresponding corners are connected by a dashed line.

[0019] Next, the relationship between each functional part constituting the display device 100 and the formed virtual image 42 and image 41 will be described. FIG. 2 is a block diagram showing the functional configuration of the display device in the embodiment. FIG. 2 is a plan view of a plane along the front-rear direction and the height direction of the vehicle 50, and an image of the user 51 passing through the vehicle interior is shown so that the user 51 can be seen.

[0020] As shown in FIG. 2, the display device 100 of the present embodiment includes a first acquisition unit 11, a second acquisition unit 12, a control unit 13, a projection unit 21, and a setting unit 32 that accepts input of various settings in the display of the adjusted image 41. Although details will be described later, the setting unit 32 is a configuration required when realizing additional functions of the display device 100, and when such functions are not necessary, the display device 100 can be realized without including the setting unit 32. That is, the setting unit 32 is not an essential component of the display device 100.

[0021] The first acquisition unit 11 is an example of an acquisition unit and is a functional unit that acquires the original image used for generating the adjusted image 41. Hereinafter, the original image may sometimes be simply referred to as the original image. The first acquisition unit 11 is, for example, a processing device that acquires the original image generated by a generating device (not shown) that generates the original image. The first acquisition unit 11 is realized by executing a program for acquiring the above original image by a circuit such as a processor and a storage device such as a memory. The first acquisition unit 11 can also be regarded as simply a communication module that acquires the original image via communication and transmits the acquired original image to the correction unit 13.

[0022] Note that the first acquisition unit 11 may directly generate the original image by assuming the functions of the above generating device. The original image is configured based on various information regarding the vehicle 50. Therefore, when the first acquisition unit 11 directly generates the original image, it is connected to an external device such as an ECU 33 or a navigation system (not shown), and acquires information from the external device to generate the original image.

[0023] The original image acquired by the first acquisition unit 11 includes information regarding the superimposition distance, which is the distance to the position where a virtual image is formed when the original image is projected as it is. That is, when the original image acquired by the first acquisition unit 11 is projected as it is, it is projected so that a virtual image is formed at the position of the superimposition distance included in the original image. Note that the original image and the superimposition distance may be acquired by different acquisition units.

[0024] The second acquisition unit 12 is a functional unit that acquires the driving status of the vehicle 50. The second acquisition unit 12 acquires, for example, the state of the vehicle 50 and the driving scene as the driving status. The state of the vehicle 50 is acquired from a control device used to control the running, operation, functions, etc. of the vehicle 50, such as the ECU 33. The second acquisition unit 12 is realized by executing a program for acquiring the above driving status by a circuit such as a processor and a storage device such as a memory. The second acquisition unit 12 can also be regarded simply as a communication module that acquires the driving status via communication and transmits the acquired driving status to the control unit 13.

[0025] Note that the driving scene of the vehicle 50 is acquired by being generated from information acquired from a navigation system, the imaging unit 31, the ECU 33, etc. The state and driving scene of the vehicle 50 may be acquired by being generated in the second acquisition unit 12, or may be generated by a generation device (not shown) provided separately from the second acquisition unit 12 and acquired by the second acquisition unit 12.

[0026] The control unit 13 is a functional unit that generates a corrected image 41 by correcting the original image acquired by the first acquisition unit 11 based on the superimposition distance acquired by the first acquisition unit 11. The control unit 13 is realized by executing a program for adjusting the above original image by a circuit such as a processor and a storage device such as a memory. Although the image processing by the control unit 13 will be described in detail later, the control unit 13 also uses the driving status acquired by the second acquisition unit 12 to adjust the image.

[0027] The above-mentioned first acquisition unit 11, second acquisition unit 12, and control unit 13 can be regarded as a display control device that generates an image 41 for performing appropriate display. As described above, the display control device is realized as a computer that substantially includes a circuit such as a processor and a storage device such as a memory. The first acquisition unit 11, second acquisition unit 12, and control unit 13 may be integrally configured like the display control device. Also, the circuits and storage devices that realize each functional unit in the display control device may be provided for each functional unit, may be shared by a plurality of functional units, or may be a single circuit and a single storage device that realize all the functional units.

[0028] The projection unit 21 is a projector that projects the generated image 41 onto the display medium 34 to form a virtual image 42 of the image 41 in a predetermined region A2 of the external world. The projection unit 21 includes a light source, and emits light corresponding to the image 41 from the light source. Also, the projection unit 21 is provided with an optical system that combines optical elements such as mirrors and lenses. The projection unit 21 emits the light of the image 41 along the optical path connecting the display region A1 on the display medium 34 and the eyes of the user 51 by reflecting the light on the display medium 34 through the optical system. The emitted light of the image 41 is reflected by the display medium 34 and enters the eyes of the user 51 as indicated by the solid arrows in the figure. From the user 51, the light of the image 41 appears to have a virtual image 42 of the image 41 deeper (i.e., on the external world side) than the display medium 34.

[0029] That is, a virtual image 42 of the image 41 is formed on the external world side of the display medium 34. The region where this virtual image 42 is formed is the above-mentioned predetermined region A2. The predetermined region A2 is the region with dot hatching in the figure corresponding to a predetermined viewing angle, and is the region formed by the straight line connecting the eyes of the user 51 and a point on the display region A1. Since the display region A1 has a range consisting of a plurality of points, the predetermined region A2 changes according to the design of the display medium 34 and the projection unit 21 as shown in the figure. In other words, the display region A1 can be arbitrarily set by the design of the display medium 34 and the projection unit 21.

[0030] Here, when the original image is projected as it is, for example, a situation as shown in FIG. 3 may occur. FIG. 3 is a schematic diagram for explaining image display control in the embodiment. In FIG. 3(a), the image displayed outside the predetermined region A2 (that is, outside the predetermined viewing angle) is shown by a broken line. Thus, when the image is projected so that a virtual image 42 is formed outside the predetermined region A2, the light does not enter the user's eyes and the virtual image 42 cannot be visually recognized. On the other hand, when the original image is adjusted to generate an image 41 so that it is simply projected within the predetermined region A2, it becomes an image shown by a solid line in the figure. At this time, since the two images with different overlapping distances overlap at the lower end of the predetermined region A2 as shown by the broken straight line, the sense of perspective is lost and the information on the overlapping distance is lost.

[0031] In this embodiment, as shown in FIG. 3(b), when generating the image 41 by adjusting the original image, the amount of change in the projection position during adjustment is made different between the one with a short overlapping distance (the left side among the solid-line images) and the one with a long overlapping distance (the right side among the solid-line images). Specifically, as shown in the figure, regarding at what position above in the vertical direction from the lower end of the predetermined region A2 to project, the one with a short overlapping distance is set to a position where the distance from the lower end is zero, and the one with a long overlapping distance is set to a position further above from the lower end as shown by the thick arrow from the lower end. As a result, the difference in the overlapping distance can be perceived by the user 51 based on the distance in the vertical direction from the lower end (the deviation distance described later).

[0032] The height (Hc) and the amount of change at which the virtual image 42 is displayed from the overlapping distance are calculated based on the following formula (1).

[0033] Hc = He - Lc×tan(θL) + Oc + K×Lc - C (1)

[0034] In the above formula (1), He represents the viewing height of the user 51, Lc represents the superimposition distance set for the original image, θL represents the depression angle of the lower end of the predetermined region A2 with respect to the horizontal direction, Oc represents the offset height, K represents the adjustment coefficient, and C represents the adjustment intercept. The offset height (Oc) is a numerical value for actually moving the projection position of the original image further upward from the lower end of the predetermined region A2 when considering the size of the original image and the like. The part of He - Lc×tan(θL)+Oc in the above formula (1) can be said to be the minimum virtual image display height when projecting the original image at the lower end of the predetermined region A2. And in the present embodiment, the projection position of the original image is changed in the height direction by an amount correlated with the superimposition distance (Lc) set for the original image by the part of K×Lc - C. In this way, the superimposition distance (Lc) set for the original image becomes visible to the user 51 as the height of the projection position. Note that appropriate values of each variable in the above formula (1) differ depending on various conditions such as the size of the original image and the size of the predetermined region A2. Therefore, it may be set empirically or experimentally by the user 51, the manufacturer or seller of the display device 100, or the like. Further, Oc + K×Lc - C, which is obtained by adding the offset height (Oc) to the part of K×Lc - C, may be expressed as a deviation distance indicating the degree of deviation from the lower end of the predetermined region A2. The deviation distance is a function proportional to the superimposition distance (Lc) as shown in the mathematical formula. That is, the deviation distance is a distance corresponding to the superimposition distance.

[0035] Hereinafter, an operation example of the display device 100 and other image processing in the present embodiment will be specifically described with reference to FIGS. 4 to 12. First, a display method corresponding to the operation example of the display device 100 described above will be described with reference to FIG. 4. FIG. 4 is a flowchart showing the display method in the embodiment.

[0036] As shown in FIG. 4, in the present embodiment, first, the first acquisition unit 11 acquires the original image and the superimposition distance associated therewith (first acquisition step S101). The first acquisition unit 11 transmits the acquired original image to the control unit 13. The first acquisition step S101 is continuously performed, and the original image is continuously transmitted to the control unit 13.

[0037] Also, the second acquisition unit 12 acquires the driving situation from an external device such as the ECU 33 (second acquisition step S102). The second acquisition unit 12 transmits the acquired driving situation to the control unit 13. Similarly, the second acquisition step S102 is continuously executed, and the driving situation is continuously transmitted to the control unit 13 in the same manner as the original image.

[0038] Here, the control unit 13 generates the image 41 based on the continuously transmitted original image and driving situation. At this time, when it is determined that the original image needs to be adjusted based on the accompanying superimposition distance, the original image is adjusted and the image 41 is generated. Specifically, the control unit 13 determines whether the projection position is outside the predetermined viewing angle when the original image is projected, that is, whether the formed virtual image is outside the predetermined region A2 (step S103). When the projection position is not outside the predetermined viewing angle when the original image is projected, that is, when the projection position is within the predetermined viewing angle (No in step S103), the original image is projected as it is and the virtual image 42 is formed (step S104), and the process ends. Note that the end of the process here is the end of the process for one original image. Actually, since the original images are continuously transmitted, continuous projection is continuously executed.

[0039] When the projection position is outside the predetermined viewing angle when the original image is projected (Yes in step S103), based on the above formula (1), an adjustment is made to change the projection position by an amount corresponding to the superimposition distance, and the changed image 41 is generated (step S105). Then, the process proceeds to step S104, and for the changed image 41, the image 41 is projected and the virtual image 42 is formed, and the process ends.

[0040] Depending on the image, as shown in FIG. 5, there may be a plurality of partial images that form a plurality of partial virtual images 42a. For the original image including such partial images, the determination in step S103 is performed for each partial image. That is, it is determined whether the projection position is outside the predetermined angular field for each partial image, and adjustment to change the projection position in step S105 is performed only for the partial images outside the predetermined angular field. When a single original image includes a plurality of partial images, in particular, as shown in FIG. 3(a), the difference in distance between the partial images becomes imperceptible, so the effect of suppressing the loss of the overlapping distance information according to the present embodiment is likely to appear.

[0041] Also, as shown in the above formula (1), the formula indicating the change amount is calculated as a linear function proportional to the overlapping distance. However, for example, it may be as shown in FIG. 6. Specifically, FIG. 6(a) shows a figure similar to FIG. 3(b), and FIG. 6(b) shows a figure of a different modification example thereof. As shown in FIG. 6(b), the formula indicating the change amount does not have to be a linear function, and may be a conditional formula in which the overlapping distance is divided according to a predetermined distance, or a function of the second order or higher. By doing so, there is an advantage that an image forming a distant virtual image 42 where the information of the overlapping distance is particularly likely to be lost can be more appropriately displayed.

[0042] The control unit 13 can further adjust the image based on the driving situation as shown in FIGS. 7 to 12 below. In FIGS. 7 to 10, the lengths of the deviation distances are shown in the second to fourth columns, and the road conditions of the overlapping destination estimated according to the driving situation are shown in the second to fourth rows. The road conditions of the overlapping destination from the driving situation are selected from any of "going straight", "curve", and "right / left turn". For example, if the driving situation is an image captured by an in-vehicle camera, it is possible to estimate whether the overlapping destination of the virtual image 42 is "going straight", "curve", or "right / left turn" by analyzing the image. Alternatively, if the driving situation is the route to the destination acquired from a car navigation system or the like and the position of the own vehicle, it is possible to estimate whether the overlapping destination on the route from the position of the own vehicle is "going straight", "curve", or "right / left turn".

[0043] Then, the image can be adjusted according to whether the superimposition destination is "straight", "curve", or "turn", and whether the deviation distance is "none", "short", or "long". Note that for whether the deviation distance is "none", "short", or "long", preset threshold values (for example, "none" at 0 m, "short" at 0.3 - 0.7 m, "long" at 0.7 m and above, etc.) are used. Alternatively, regardless of the threshold values, the image may be continuously changed and adjusted according to a function of the length of the deviation distance. Note that when the superimposition destination is "curve" or "turn", the superimposition position of the image may shift in the left - right direction. In such cases, the superimposition position in the left - right direction may be adjusted based on the road conditions.

[0044] For example, various adjustments such as on - off and settings for the degree of adjustment in the following description can be set using the setting unit 32. That is, the setting unit 32 has a function of accepting the on - off adjustment of the original image and the setting of parameters using the driving situation.

[0045] As shown in FIG. 7, for example, based on the driving situation and the deviation distance, the display angle of the image can be rotated by any of the yaw angle, roll angle, and pitch angle. At this time, the rotation angle may be changed so as to be correlated with the deviation distance corresponding to the superimposition distance associated with the original image. Specifically, if the driving situation is "straight", the pitch angle rotates by the rotation angle corresponding to the deviation distance, if it is "curve", the yaw angle rotates by the rotation angle corresponding to the deviation distance, and if it is "turn", the roll angle rotates by the rotation angle corresponding to the deviation distance.

[0046] Also, as shown in FIG. 8, for example, based on the driving situation and the deviation distance, the number of images can be changed. At this time, the number of replications may be changed so as to be correlated with the deviation distance corresponding to the superimposition distance associated with the original image, and the image may be replicated by that number of replications. Note that the number of replications shown in FIG. 8 is an example, and whether to increase or decrease the number of replications as the deviation distance increases can be set as appropriate.

[0047] Also, as shown in FIG. 9, for example, the shape of the image can be changed based on the driving situation and the deviation distance. For example, in the figure, each image can be regarded as a substantially triangular shape that fits within a range sandwiched between a first direction and a second direction different from the first direction from a predetermined point. Then, so as to correlate with the deviation distance corresponding to the superimposition distance associated with the original image, the angle formed by the first direction and the second direction can be changed to give a shape change that expands or contracts the substantially triangular shape from the perspective of the spread from the apex. Note that the angle change shown in FIG. 9 is an example, and whether to increase or decrease the angle formed by the first direction and the second direction as the deviation distance becomes longer can be set as appropriate.

[0048] Also, as shown in FIG. 10, for example, the size of the image can be changed based on the driving situation and the deviation distance. At this time, the magnification that correlates with the deviation distance corresponding to the superimposition distance associated with the original image can be changed, and the image can be enlarged or reduced by that magnification. Note that the magnification change shown in FIG. 10 is an example, and whether to increase or decrease the magnification as the deviation distance becomes longer can be set as appropriate.

[0049] Also, FIGS. 11 and 12 show changes in the display color and brightness with respect to the deviation distance.

[0050] As shown in FIG. 11, it can be adjusted so that the color density, which is an example of the display color, decreases as the deviation distance becomes longer. Conversely, the color density may be increased as the deviation distance becomes longer. Also, the hue may be changed as an adjustment of the display color according to the deviation distance.

[0051] Also, as shown in FIG. 12, it can be adjusted so that the brightness decreases as the deviation distance becomes longer. Conversely, the brightness may be increased as the deviation distance becomes longer.

[0052] As described above, the generated image 41, which is adjusted based on the driving situation and the overlapping distance (particularly, the deviation distance corresponding to the overlapping distance), is projected by the projection unit 21, and an appropriate virtual image 42 is formed. Thus, in the present embodiment, based on the driving situation and the overlapping distance (particularly, the deviation distance corresponding to the overlapping distance), the display of the image 41 can be appropriately performed so that the corresponding information is less likely to be lost. Note that only one of the adjustments of the image based on the driving situation and the overlapping distance described above may be implemented, two or more may be implemented in combination, or none of them may be implemented.

[0053] [Effects, etc.] As described above, the display device 100 according to the first aspect projects the image 41 within a predetermined viewing angle (display area A1) of the display medium 34 through which the outside world can be seen, so as to form a virtual image 42 of the image 41 in a predetermined area A2 of the outside world corresponding to the predetermined viewing angle and allow the user 51 to visually recognize it. The display device 100 includes a projection unit 21 that projects light indicating the image 41 onto the display medium 34, an acquisition unit (first acquisition unit 11) that acquires the overlapping distance, which is the distance from the user 51 to the position where the virtual image 42 of the image 41 is formed, and a control unit 13 that changes the projection position of the image 41 by an amount of change corresponding to the overlapping distance and projects it onto the projection unit 21 when the original projection position of the image 41 is outside the predetermined viewing angle.

[0054] Such a display device 100 can perform an adjustment to change the projection position so that the image 41 fits within the predetermined viewing angle. In changing the projection position, since the projection position of the image 41 is changed by an amount of change corresponding to the overlapping distance, the information on the overlapping distance can be read from the amount of change. That is, the information lost during the adjustment can be maintained so as not to be lost. Thus, it becomes possible to more appropriately display the image in terms of dealing with information loss.

[0055] Further, for example, the display device 100 according to the second aspect is the display device 100 described in the first aspect, wherein the image 41 includes a plurality of partial images, the overlapping distance includes the respective partial overlapping distances of the plurality of partial images, and the control unit 13 changes the projection positions of the partial images whose original projection positions are outside a predetermined viewing angle by an amount corresponding to each partial overlapping distance, and causes the projection unit 21 to project the changed positions.

[0056] According to this, in the image 41 including a plurality of partial images, it is possible to perform an adjustment to partially change the projection position for the partial images whose original projection positions are outside the predetermined viewing angle.

[0057] Further, for example, the display device 100 according to the third aspect is the display device 100 described in the first or second aspect, wherein the control unit 13 further changes the display angle of the image 41 by an angle corresponding to the overlapping distance, and causes the projection unit 21 to project the changed image.

[0058] According to this, it is possible to change the display angle of the image 41 by an angle corresponding to the overlapping distance and cause the projection unit 21 to project the changed image.

[0059] Further, for example, the display device 100 according to the fourth aspect is the display device 100 described in any one of the first to third aspects, wherein the control unit 13 further duplicates the image 41 by a number of duplicates corresponding to the overlapping distance, and causes the projection unit 21 to project the duplicated images.

[0060] According to this, it is possible to duplicate the image 41 by a number of duplicates corresponding to the overlapping distance and cause the projection unit 21 to project the duplicated images.

[0061] Further, for example, the display device 100 according to the fifth aspect is the display device 100 described in any one of the first to fourth aspects, wherein the image 41 is within a range sandwiched between a first direction and a second direction different from the first direction from a predetermined point, and the control unit 13 further changes the angle formed by the first direction and the second direction by an angle corresponding to the overlapping distance, and causes the projection unit 21 to project the changed image.

[0062] According to this, it is possible to change the angle formed by the first direction and the second direction by only the angle corresponding to the overlapping distance and project it onto the projection unit 21.

[0063] Further, for example, the display device 100 according to the sixth aspect is the display device 100 described in any one of the first to fifth aspects, and the control unit 13 further enlarges or reduces the image 41 by a magnification corresponding to the overlapping distance and projects it onto the projection unit 21.

[0064] According to this, it is possible to enlarge or reduce the image 41 by a magnification corresponding to the overlapping distance and project it onto the projection unit 21.

[0065] Further, for example, the display device 100 according to the seventh aspect is the display device 100 described in any one of the first to sixth aspects, and the control unit 13 further changes the display color of the image 41 by an amount of change corresponding to the overlapping distance and projects it onto the projection unit 21.

[0066] According to this, it is possible to change the display color of the image 41 by an amount of change corresponding to the overlapping distance and project it onto the projection unit 21.

[0067] Further, for example, the display device 100 according to the eighth aspect is the display device 100 described in any one of the first to seventh aspects, and the control unit 13 further changes the luminance of the image 41 by an amount of change corresponding to the overlapping distance and projects it onto the projection unit 21.

[0068] According to this, it is possible to change the luminance of the image 41 by an amount of change corresponding to the overlapping distance and project it onto the projection unit 21.

[0069] Also, the display method according to the ninth aspect is a display method that is executed by a computer and forms a virtual image 42 of the image 41 in a predetermined region A2 of the external world corresponding to a predetermined viewing angle (display region A1) by projecting the image 41 within a predetermined viewing angle of the display medium 34 through which the external world can be seen and allowing the user 51 to visually recognize it. The method includes a step of projecting light indicating the image 41 onto the display medium 34, a step of obtaining a superimposition distance, which is the distance from the user 51 to the position where the virtual image 42 of the image 41 is formed (first acquisition step S101), and a step of changing the projection position of the image 41 by an amount of change corresponding to the superimposition distance when the original projection position of the image 41 is outside the predetermined viewing angle (step S105).

[0070] According to this, the same effects as those of the display device 100 described above are achieved.

[0071] Also, the program according to the tenth aspect is a program for causing a computer to execute the display method according to the ninth aspect.

[0072] According to this, by using a computer, the same effects as those of the display device 100 described above are achieved.

[0073] (Other Embodiments) As described above, the display device and the like according to the present disclosure have been described based on the above embodiments. However, the present disclosure is not limited to the above embodiments.

[0074] In addition, in the above embodiment, an example in which the display device is used in combination with a plurality of external devices has been described, but it may be realized as a single device including these plurality of external devices. For example, a display device in which the above display device and the display medium are integrated may be realized, a display device in which the above display device and the imaging unit are integrated may be realized, a display device in which the above display device and the ECU are integrated may be realized, or a display device in which the above display device and other functional units are integrated may be realized. Further, a plurality of components constituting the display device in the above embodiment may be realized by respective individual devices. When the display device is realized by a plurality of devices, the components included in the display device may be distributed among the plurality of devices in any manner.

[0075] Also, in the above embodiment, a process executed by a specific processing unit may be executed by another processing unit. Further, the order of a plurality of processes may be changed, or a plurality of processes may be executed in parallel. Also, in the above embodiment, each operation example may be arbitrarily combined. In the above embodiment, correction examples of a plurality of original images have been described. For example, a correction example combining these plurality of correction examples is also included in the present disclosure.

[0076] In the above embodiment, an example in which the windshield of a vehicle is applied as the display medium has been described, but the display medium may be realized by a member provided specifically for a display device such as a combiner. Further, as the display medium, the lens portion of a glasses-type user-worn device may be applied. Also, the vehicle described in the above embodiment has been described as being a four-wheeled vehicle having a passenger compartment or the like, but the vehicle may be a two-wheeled vehicle without a passenger compartment. In this case, a meter visor or a windshield provided on a helmet or the like can be used as the display medium. Further, the above vehicle is a concept including a simulator for pseudo-experiencing the operation of the vehicle by a display device or the like.

[0077] In addition, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0078] Alternatively, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form one circuit as a whole or may be separate circuits respectively. Further, these circuits may be general-purpose circuits or dedicated circuits respectively.

[0079] Furthermore, the general or specific aspects of the present disclosure may be realized by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM. Also, it may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0080] For example, the present disclosure may be realized as a display method executed by a computer or as a program for causing a computer to execute such a display method. Also, the present disclosure may be realized as a computer-readable non-transitory recording medium on which such a program is recorded.

[0081] In addition, forms obtained by applying various modifications conceivable by those skilled in the art to each embodiment, or forms realized by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present disclosure are also included in the present disclosure.

Industrial Applicability

[0082] The present disclosure can be used as a display device that allows a user such as a driver to visually recognize an image indicating various types of information as a virtual image superimposed on the external scenery.

Explanation of Signs

[0083] 11 First acquisition unit 12 Second acquisition unit 13 Control unit 21 Projection unit 31 Imaging unit 32 Setting unit 33 ECU 34 Display medium 41 Image 42 Virtual image 42a Partial virtual image 50 Vehicle 51 User 100 Display device A1 Display area A2 Predetermined area

Claims

1. A display device that forms a virtual image of an image in a predetermined area of the external world corresponding to a predetermined viewing angle by projecting the image within the predetermined viewing angle of a display medium through which the external world can be seen and allowing a user to visually recognize the virtual image, comprising: a projection unit that projects light representing the image onto the display medium; an acquisition unit that acquires a superimposition distance, which is the distance from the user to the position where the virtual image of the image is formed; a control unit that, when the original projection position of the image is outside the predetermined viewing angle, changes the projection position of the image by an amount corresponding to the superimposition distance and causes the projection unit to project the image. The display device.

2. The image includes a plurality of partial images, the superimposition distance includes respective partial superimposition distances of the plurality of partial images, and the control unit changes the projection positions of the partial images whose original projection positions are outside the predetermined viewing angle among the plurality of partial images by amounts corresponding to the respective partial superimposition distances and causes the projection unit to project the partial images. The display device according to claim 1.

3. The control unit further changes the display angle of the image by an angle corresponding to the superimposition distance and causes the projection unit to project the image. The display device according to claim 1 or 2.

4. The control unit further duplicates the image by a number of duplicates corresponding to the superimposition distance and causes the projection unit to project the duplicated image. The display device according to claim 1 or 2.

5. The image is within a range sandwiched between a first direction and a second direction different from the first direction from a predetermined point, and the control unit further changes the angle formed by the first direction and the second direction by an angle corresponding to the superimposition distance and causes the projection unit to project the image. The display device according to claim 1 or 2.

6. The control unit further enlarges or reduces the image by a magnification corresponding to the superimposition distance and causes the projection unit to project the image. The display device according to claim 1 or 2.

7. The control unit further changes the display color of the image by an amount corresponding to the superimposition distance and causes the projection unit to project the image. The display device according to claim 1 or 2.

8. The control unit further changes the brightness of the image by an amount corresponding to the superimposition distance and causes the projection unit to project the image. The display device according to claim 1 or 2.

9. A display method executed by a computer, which forms a virtual image of an image in a predetermined area of the external world corresponding to a predetermined viewing angle by projecting the image within the predetermined viewing angle of a display medium through which the external world can be seen and allows a user to visually recognize the virtual image, the method comprising: Projecting light showing the image onto the display medium; Obtaining a superimposition distance, which is the distance from the user to the position where a virtual image of the image is formed; Changing the projection position of the image by an amount of change corresponding to the superimposition distance when the original projection position of the image is outside the predetermined angular field of view. A display method.

10. A program for causing the computer to execute the display method according to Claim 9. A program.

Images