Image projection device and image projection method

The image projection device addresses the issue of image fluctuations due to vehicle pitching by using acceleration and driving state information to adjust the image position, enhancing visibility and stability for the driver.

WO2024247798A1PCT designated stage expired Publication Date: 2024-12-05KOITO MFG CO LTD
View PDF 15 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/018582
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-30
Filing Date
2024-05-21
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Conventional image projection devices for vehicles suffer from image position fluctuations due to pitching, which affects the driver's ability to maintain a clear view of projected information, leading to a vibrating image effect.

Method used

An image projection device that includes an image irradiation section, an acceleration acquisition section, a vehicle information acquisition section, and an image position correction section, which adjusts the display position of the image based on vehicle acceleration and driving state information, such as vehicle speed and steering angle, to stabilize the image projection.

Benefits of technology

The solution effectively suppresses image position fluctuations caused by vehicle pitching, enhancing visibility and reducing the need for the driver to change their line of sight, thereby improving the clarity and stability of projected information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024018582_05122024_PF_FP_ABST
    Figure JP2024018582_05122024_PF_FP_ABST
Patent Text Reader

Abstract

Provided is an image projection device and an image projection method capable of improving the visibility of an image by minimizing the fluctuation of an image formation position of the image which is caused by the pitching of a vehicle. An image projection device (100) that projects a virtual image via a display unit comprises: an image radiation unit (140) that radiates an image for forming a virtual image as image display light; an acceleration acquisition unit (110) that acquires acceleration applied to the vehicle; a vehicle-information acquisition unit (120) that acquires driving state information of the vehicle; and an image-position correction unit (130) that corrects the display position of the image on the basis of the acceleration and the driving state information.
Need to check novelty before this filing date? Find Prior Art

Description

Image projection device and image projection method

[0001] The present invention relates to an image projection device and an image projection method, and more particularly to an image projection device and an image projection method for projecting a projection image onto a display unit for displaying a virtual image.

[0002] Conventionally, dashboards that illuminate icons have been used to display various types of information inside vehicles. As the amount of information to be displayed increases, it has been proposed to embed an image display device in the dashboard or to configure the entire dashboard with an image display device.

[0003] However, since the instrument panel is located below the windshield of the vehicle, the driver has to move his or her eyes downward while driving in order to see the information displayed on the instrument panel, which is undesirable. Therefore, a head-up display (hereinafter referred to as HUD) has been proposed, which projects an image onto the windshield so that the driver can read the information when looking ahead of the vehicle (see, for example, Patent Documents 1 and 2).

[0004] JP 2019-119248 A JP 2019-119262 A

[0005] In such a conventional image projection device, an image projection unit projects image light onto the vehicle's windshield (display unit), allowing the driver to visually recognize the image light reflected by the windshield superimposed on the background ahead of the vehicle. Figure 9 is a schematic diagram illustrating the projection of a virtual image by the image projection device and the shaking of the virtual image due to vehicle pitching. As shown by the solid line in Figure 9, when vehicle C is traveling on a road surface, the image projection device projects a virtual image P ahead of vehicle C via the windshield. When vehicle C pitches, the projection direction of virtual image P' also changes with the tilt of vehicle C, as shown by the dashed line in Figure 9.

[0006] As shown in Figure 9, the image projection device mounted on vehicle C does not change the relative position of the windshield, so if the vehicle's longitudinal tilt angle fluctuates due to cargo or unevenness in the road surface, causing it to pitch, the display position of the virtual image on the background also fluctuates. Generally, the driver's line of sight does not change significantly even when vehicle C pitches, and they tend to continue to view a specific position on the background. This has caused a problem in that the driver feels as if the virtual image P is vibrating in the P' direction.

[0007] Therefore, the present invention has been made in consideration of the above-mentioned conventional problems, and aims to provide an image projection device and an image projection method that can suppress fluctuations in the image imaging position due to vehicle pitching and improve image visibility.

[0008] In order to solve the above problem, the image projection device of the present invention is an image projection device that projects a virtual image via a display unit, and is characterized by comprising an image irradiation unit that irradiates an image to form the virtual image as image display light, an acceleration acquisition unit that acquires acceleration applied to the vehicle, a vehicle information acquisition unit that acquires driving state information of the vehicle, and an image position correction unit that corrects the display position of the image based on the acceleration and the driving state information.

[0009] In the image projection device of the present invention, the image position correction unit corrects the display position of the image based on acceleration and driving state information, thereby suppressing fluctuations in the image imaging position due to vehicle pitching and improving image visibility.

[0010] In one aspect of the present invention, the driving state information includes vehicle speed information of the vehicle, and the image position correction unit corrects the display position based on driving-related acceleration calculated from the vehicle speed information.

[0011] In one aspect of the present invention, the driving state information includes steering angle information of the vehicle, and the image position correction unit corrects the display position based on centrifugal force calculated from the vehicle speed information and the steering angle information.

[0012] In addition, in one aspect of the present invention, the image position correction unit calculates the amount of change in the imaging position of the virtual image based on the acceleration and the driving state information, and corrects the display position of the image in a direction that offsets the amount of change.

[0013] In one aspect of the present invention, the image includes a near image formed at a predetermined distance from the display unit and a far image formed at a farther distance from the display unit than the near image, and the image position correction unit corrects the display position of at least the far image.

[0014] In one aspect of the present invention, the display position of the near image is corrected.

[0015] In one aspect of the present invention, the correction amount of the display position in the far image is larger than the correction amount of the display position in the near image.

[0016] In order to solve the above problem, the image projection method of the present invention is an image projection method for projecting a virtual image via a display unit, and is characterized by comprising an image irradiation process for irradiating an image for forming the virtual image as image display light, an acceleration acquisition process for acquiring acceleration applied to the vehicle, a vehicle information acquisition process for acquiring driving state information of the vehicle, and an image position correction process for correcting the display position of the image based on the acceleration and the driving state information.

[0017] The present invention can provide an image projection device and an image projection method that can improve the visibility of an image by suppressing fluctuations in the image formation position due to pitching of a vehicle.

[0018] FIG. 3 is a schematic diagram illustrating the projection of a far image and a near image using an image projection device according to a first embodiment. FIG. 4 is a block diagram illustrating the configuration of an image projection device 100 according to a first embodiment. FIG. 5 is a graph illustrating the relationship between acceleration measurement by an acceleration sensor and driving state information, where FIG. 3( a) shows a stationary state of a vehicle C on a flat surface, FIG. 3( b) shows a state in which the vehicle C is tilted while stationary, and FIG. 3( c) shows a state in which the vehicle C is tilted while accelerating or decelerating. FIG. 6 is a flowchart illustrating steps of an image projection method according to a first embodiment. FIG. 7 is a schematic diagram illustrating an image display area and correction according to a first embodiment, where FIG. 8( a) shows a stationary state on a flat surface, FIG. 8( b) shows a state in which the vehicle C is swaying upward, and FIG. 8( c) shows a state in which the vehicle C is swaying downward. FIG. 9 is a schematic diagram illustrating an image display area and correction according to a second embodiment, where FIG. 10( a) shows a stationary state on a flat surface, FIG. 10( b) shows a state in which the vehicle C is swaying upward, and FIG. 10( c) shows a state in which the vehicle C is swaying downward. 7(a) and 7(c) are schematic diagrams illustrating the display area and correction of an image in the third embodiment, where Fig. 7(a) shows a stationary state on a flat surface, Fig. 7(b) shows a state in which the vehicle C is swaying upward, and Fig. 7(c) shows a state in which the vehicle C is swaying downward. Fig. 7(c) is a flowchart illustrating the steps of an image projection method according to a fourth embodiment. Fig. 7(b) is a schematic diagram illustrating the projection of a virtual image by an image projection device and the swaying of the virtual image due to pitching of the vehicle.

[0019] (First Embodiment) Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. The same or equivalent components, members, and processes shown in each drawing will be assigned the same reference numerals, and redundant description will be omitted where appropriate. FIG. 1 is a schematic diagram illustrating the projection of a far image and a near image using an image projection device according to this embodiment. As shown in FIG. 1, the image projection device includes an image display unit 1, a reflecting mirror 2, a free-form surface mirror 3, an optical branching unit 4, a free-form surface mirror 5, and a windshield 6.

[0020] The image display unit 1 is a part that emits light containing an image based on image information from the control unit. The specific configuration of the image display unit 1 is not limited, and conventionally known devices such as a liquid crystal display device, an organic electroluminescence (EL) display device, or a combination of a laser light source and an optical modulation element can be used. In the example shown in FIG. 1 , a device that emits light from a light-emitting diode (LED) from the rear side of the liquid crystal display device is used. As will be described later, the image display unit 1 includes a far display area and a near display area that display a far image and a near image, respectively. Examples of far images displayed in the far display area include auxiliary information related to driving, such as caution images and emergency information. Examples of near images displayed in the near display area include a speed and volume indicator, a driving direction guide, etc.

[0021] The reflecting mirror 2 is an optical element onto which the second image light emitted from the image display unit 1 is incident and which reflects the first image light toward the free-form surface mirror 3. In the example shown in Fig. 1, a convex mirror is shown as the reflecting mirror 2, but any mirror with an optical design necessary to project the first image light as a virtual image can be used, and a concave mirror, a plane mirror, a free-form surface mirror, or the like can be used as needed. Furthermore, the reflecting mirror 2 may be omitted, and the first image light from the image display unit 1 may be directly incident on the free-form surface mirror 3.

[0022] The free-form surface mirror 3 is a concave mirror that receives the first image light reflected by the free-form surface mirror 5 and the second image light reflected by the reflecting mirror 2 and reflects the second image light toward the windshield 6. The reflective surface of the free-form surface mirror 3 is designed to expand the light diameter toward the driver's viewpoint in order to project the virtual images 7 and 8 through the windshield 6. Here, the expansion of the light diameter toward the viewpoint includes not only the case where the light diameter consistently expands after reflection, but also the case where the light diameter shrinks and expands after forming an image at an intermediate point.

[0023] The light branching unit 4 is an optical element that branches the light of an image irradiated from the image display unit 1, and branches at least a first image displayed in the far display region as a first image light and a second image displayed in the near display region as a second image light. The structure of the light branching unit 4 is not limited as long as it is an optical element that branches light, and it may be a prism or a method of changing the angle of incidence and the angle of reflection of light using a reflecting mirror. In the example shown in FIG. 1 , a prism is used as the light branching unit 4, and the prism is disposed over the far display region of the image display unit 1. Therefore, the first image light irradiated from the far display region is reflected by the light branching unit 4 on the free-form surface mirror 5 along a path different from that of the second image light, and reaches the free-form surface mirror 3. Meanwhile, the second image light irradiated from the near display region is reflected by the reflecting mirror 2 and reaches the free-form surface mirror 3.

[0024] Here, arranging the optical branching unit 4 so as to overlap the image display unit 1 means that the area in which the optical branching unit 4 is arranged overlaps the image display area of ​​the image display unit 1 in a planar view. The overlapping arrangement also includes cases where the optical branching unit 4 and the image display unit 1 are in contact with each other and cases where they are not in contact with each other. The overlapping arrangement also includes cases where an optical member that transmits light or a holding member that maintains the distance between the optical branching unit 4 and the image display unit 1 is interposed between the optical branching unit 4 and the image display unit 1.

[0025] The free-form surface mirror 5 is an optical member that receives the first image light via the optical branching unit 4 and reflects the first image light toward the free-form surface mirror 3. The reflective surface of the free-form surface mirror 5 is designed to expand the light diameter in the driver's line of sight in order to project the virtual image 8 through the windshield 6. Here, the expansion of the light diameter in the line of sight includes not only the case where the light diameter expands consistently after reflection, but also the case where the light diameter shrinks and expands after forming an image at an intermediate point.

[0026] The windshield 6 is a portion provided in front of the driver's seat of the vehicle C that transmits visible light. The windshield 6 corresponds to the display unit of the present invention because, on the inner surface of the vehicle C, it reflects the first image light and the second image light incident from the free-form surface mirror 3 toward the viewpoint and transmits light from outside the vehicle C toward the viewpoint. While an example has been shown in which the windshield 6 is used as the display unit, a combiner may be provided as a display unit separate from the windshield 6 and reflect light from the free-form surface mirror 3 toward the viewpoint. Furthermore, the display unit is not limited to being located at the front of the vehicle C, and may be located to the side or rear as long as it projects an image toward the viewpoint of the passenger.

[0027] The virtual images 7 and 8 are images that are displayed as if they were formed in space when the first image light and the second image light reflected by the windshield 6 reach the viewpoint (eyebox) of the driver or the like. The positions at which the virtual images 7 and 8 are formed are determined by the angle of spread of the light irradiated from the image display unit 1 as it travels toward the viewpoint after being reflected by the reflecting mirror 2, the free-form surface mirror 3, the free-form surface mirror 5, and the windshield 6.

[0028] In the image projection device shown in FIG. 1 , a portion of the light emitted from the image display unit 1 is split by the light splitter 4 and reflected by the free-form surface mirror 5, the free-form surface mirror 3, and the windshield 6 to reach the driver's viewpoint, forming a virtual image 8 in the distance. Another portion of the light emitted from the image display unit 1 is reflected by the reflector 2, the free-form surface mirror 3, and the windshield 6 to reach the driver's viewpoint, forming a virtual image 7 in the near distance. As a result, the image projection device projects the virtual image 8 in the far distance, several degrees below the horizontal (approximately 15 m from the driver in FIG. 1 ), thereby reducing the driver's line of sight movement required to view driving assistance information. Furthermore, the virtual image 7 is projected further downward and near (approximately 3 m from the driver in FIG. 1 ), allowing the driver to clearly view the vehicle speed display and other information by shifting their line of sight.

[0029] 1, the projection optical system of the image projection device includes a reflecting mirror 2, a free-form surface mirror 3, a light branching unit 4, and a free-form surface mirror 5, but other optical components such as reflecting mirrors and lenses may also be included. Also, while FIG. 1 shows an example in which a far image and a near image are projected at different positions as virtual images 7 and 8, respectively, a single image may also be projected.

[0030] FIG. 2 is a block diagram showing the configuration of an image projection device 100 according to this embodiment. As shown in FIG. 2, the image projection device 100 includes an acceleration acquisition unit 110, a vehicle information acquisition unit 120, an image position correction unit 130, and an image projection unit 140. The image projection device 100 is also capable of acquiring information from an acceleration sensor 200, a vehicle control unit 300, and an image generation unit 400. The image projection device 100 also includes a control unit (not shown) that is connected to each unit so as to communicate information with the units and control the units. The configuration of the control unit is not limited, but examples include a central processing unit (CPU) for performing information processing, a memory device, a recording medium, an information communication device, and the like. The control unit controls the operation of each unit according to a predetermined program.

[0031] The acceleration sensor 200 is a part that is mounted on the vehicle C and detects acceleration applied to the vehicle C. The acceleration detected by the acceleration sensor 200 is transmitted to the acceleration acquisition unit 110. The specific configuration of the acceleration sensor 200 is not limited, and a conventionally known nine-axis sensor device mounted on the vehicle C or the like can be used. Furthermore, although FIG. 2 shows an example in which the acceleration sensor 200 is provided outside the image projection device 100, it may also be provided inside the image projection device 100.

[0032] The vehicle control unit 300 is a part that acquires the operating state of each part constituting the vehicle C as driving state information. The driving state information acquired by the vehicle control unit 300 is transmitted to the vehicle information acquisition unit 120. Examples of the driving state information acquired by the vehicle control unit 300 include vehicle speed information, which is the moving speed of the vehicle C, and steering angle information speed, which is the angle of the steering. The specific configuration of the vehicle control unit 300 is not limited, and for example, an ECU (Electrical Control Unit) mounted on the vehicle C can be used.

[0033] The image generation unit 400 is a part that generates image information to be irradiated from the image projection unit 140. The image information generated by the image generation unit 400 is transmitted to the image position correction unit 130. The image generated by the image generation unit 400 may be a still image or a video. The content of the image generated by the image generation unit 400 is not limited, but as described above, examples include auxiliary information related to driving such as an image calling attention or emergency information, a speed and volume indicator, a driving direction guide, etc.

[0034] The acceleration acquisition unit 110 is a part that acquires acceleration from the acceleration sensor 200 and transmits acceleration information to the image position correction unit 130. The acceleration acquisition unit 110 is a function that is realized by a predetermined program being executed by a control unit provided in the image projection device 100. In the example shown in FIG. 2 , the acceleration acquisition unit 110 acquires acceleration from the acceleration sensor 200 provided outside the image projection device 100, but the acceleration sensor 200 and the acceleration acquisition unit 110 may be provided integrally in the image projection device 100.

[0035] The vehicle information acquisition unit 120 is a part that acquires driving state information from the vehicle control unit 300 and transmits the driving state information to the image position correction unit 130. The vehicle information acquisition unit 120 is a function that is realized by a predetermined program being executed by a control unit provided in the image projection device 100. In the example shown in FIG. 2 , the vehicle information acquisition unit 120 acquires driving state information from the vehicle control unit 300 provided outside the image projection device 100, but the vehicle control unit 300 and the vehicle information acquisition unit 120 may be provided integrally in the image projection device 100.

[0036] The image position correction unit 130 acquires image information from the image generation unit 400, acquires acceleration from the acceleration acquisition unit 110, acquires driving state information from the vehicle information acquisition unit 120, and corrects the image light irradiated from the image projection unit 140 based on the acceleration and driving state information. The image position correction unit 130 is a function realized by a predetermined program being executed by a control unit provided in the image projection device 100. In the example shown in FIG. 2 , the image position correction unit 130 acquires image information from the image generation unit 400 provided outside the image projection device 100. However, the image generation unit 400 and the image position correction unit 130 may be integrated and provided in the image projection device 100. Furthermore, the specific configuration of the image position correction unit 130 is not limited, and the image generated by the image generation unit 400 may be shifted by a predetermined amount or the angle of the projection optical system may be physically moved so that the display position on the image projection unit 140 changes.

[0037] The image projection unit 140 is a part that projects virtual images 7 and 8 based on image information through the windshield 6. In the example shown in FIG. 1 , the combination of the image display unit 1, the reflecting mirror 2, the free-form surface mirror 3, the light branching unit 4, and the free-form surface mirror 5 corresponds to the image projection unit 140.

[0038] FIG. 3 is a graph showing the relationship between acceleration measurements by an acceleration sensor and driving state information. FIG. 3(a) shows a stationary state of vehicle C on a flat surface, FIG. 3(b) shows a stationary state of vehicle C tilted, and FIG. 3(c) shows a tilted state of vehicle C during acceleration or deceleration. The X-axis in the figure indicates the horizontal direction of the ground surface, and is positive from right to left in the figure toward the front of vehicle C. The Z-axis in the figure indicates the direction of gravity on the ground surface, and is positive from bottom to top in the figure toward the top of vehicle C. Here, the acceleration applied to vehicle C in the fore-and-aft direction of acceleration sensor 200 is defined as ax, and the acceleration applied to vehicle C in the up-and-down direction is defined as az. The angle (inclination angle) formed between the X-axis, which is the coordinate system of the ground surface, and the ax-axis, which is the coordinate system of vehicle C, is defined as θ.

[0039] In FIG. 3A, since vehicle C is stationary on a flat surface, the acceleration acting on vehicle C is 1 G (9.8 m / s) in the direction of gravity in the negative direction of the Z axis. 2 ) Furthermore, since the object is stationary on a flat surface, the tilt angle θ between the X-axis and the ax-axis is 0, and accelerations of az = 1.0 and ax = 0 are detected.

[0040] In Figure 3(b), vehicle C is stationary on an inclined surface, so the acceleration applied to vehicle C is 1 G in the direction of gravity in the negative direction of the Z axis. Furthermore, because vehicle C is stationary on an inclined surface, accelerations detected are az = 1.0 x cos θ in the az-axis direction, which is perpendicular to the inclined surface, and ax = 1.0 x sin θ in the ax-axis direction, which is parallel to the inclined surface. Therefore, the relationship tan θ = (ax / az) holds, and θ = arctan(ax / az). Therefore, the inclination angle θ of the inclined surface can be calculated from the ax and az components of the acceleration detected by acceleration sensor 200.

[0041] In Figure 3(c), vehicle C is traveling along an inclined surface, so that 1 G in the direction of gravity is applied to vehicle C in the negative direction of the Z axis, and a traveling-related acceleration α is applied due to acceleration and deceleration along the inclined surface. Here, traveling-related acceleration α is acceleration applied in conjunction with acceleration and deceleration of vehicle C, and therefore can be calculated from the driving state information acquired by the vehicle information acquisition unit 120. As an example, the traveling-related acceleration α associated with acceleration and deceleration of vehicle C can be calculated by time-differentiating vehicle speed information included in the driving state information.

[0042] Furthermore, because the vehicle is traveling on an inclined surface, acceleration is detected in the az-axis direction, which is perpendicular to the inclined surface, of az = 1.0 × cos θ, and in the ax-axis direction, which is parallel to the inclined surface, of ax = α + 1.0 × sin θ. Therefore, the relationship tan θ = ((ax - α) / az) holds, and θ = arctan((ax - α) / az). Therefore, the inclination angle θ of the inclined surface can be calculated from the ax and az components of the acceleration detected by acceleration sensor 200 and the driving-related acceleration α.

[0043] 4 is a flowchart showing the steps of the image projection method according to this embodiment. As shown in FIG. 4, the image projection method according to this embodiment is realized by the image position correction unit 130 executing an acceleration acquisition step, a vehicle information acquisition step, and an image position correction step, and correcting the display position of the image in the image projection unit 140. The image position correction step further includes a vehicle speed determination step, a driving-related acceleration calculation step, an acceleration correction step, and an angle calculation step.

[0044] First, in the acceleration acquisition process of step S1, the image position correction unit 130 acquires acceleration data from the acceleration acquisition unit 110. Next, in the vehicle information acquisition process of step S2, the image position correction unit 130 acquires driving state information including vehicle speed information from the vehicle information acquisition unit 120. Here, an example has been shown in which the vehicle information acquisition process is executed after the acceleration acquisition process, but the order is not limited thereto and may be reversed, or both processes may be executed simultaneously.

[0045] Next, in the vehicle speed determination step of step S3, the image position correction unit 130 determines whether the vehicle speed included in the driving state information is zero, and if it is zero, proceeds to step S6, and if it is not zero, proceeds to step S4. Note that although an example in which the vehicle speed determination step is executed has been shown, the vehicle speed determination step may be omitted and the process may proceed to step S4 regardless of the vehicle speed.

[0046] Next, in the driving-related acceleration calculation step of step S4, the image position correction unit 130 calculates the driving-related acceleration α from the vehicle speed included in the driving state information. More specifically, for example, α = (v2 - v1) / (t2 - t1) is calculated from the vehicle speed v1 at time t1 and the vehicle speed v2 at time t2. If the driving state information includes not only the vehicle speed but also the driving-related acceleration α, the driving-related acceleration calculation step can be omitted. Also, if the driving-related acceleration calculation step is performed without performing the vehicle speed determination step, the vehicle speeds v1 and v2 are 0, so the driving-related acceleration α = 0.

[0047] Next, in the acceleration correction step of step S5, the image position correction unit 130 subtracts the driving-related acceleration α from the ax component of the acceleration on the coordinate axes of the vehicle C detected by the acceleration sensor 200, and corrects the acceleration caused by the tilt to (ax-α) and az. Next, in the angle calculation step of step S6, the image position correction unit 130 calculates the tilt angle θ from the corrected acceleration (ax-α) and az using the formula θ = arctan((ax-α) / az). Here, the acceleration correction step and the angle calculation step are described as separate steps, but both steps may be performed in a single step. Furthermore, if the vehicle speed is determined to be zero in the vehicle speed determination step, the driving-related acceleration α = 0, and the tilt angle θ is calculated using the formula θ = arctan(ax / az).

[0048] Next, in the image position correction step of step S7, the image position correction unit 130 corrects the display position of the image projected from the image projection unit 140 based on the tilt angle θ calculated in the angle calculation step. As described above, the tilt angle θ is calculated based on the acceleration acquired by the acceleration acquisition unit 110 and the driving state information acquired by the vehicle information acquisition unit 120, and therefore the correction of the image display position is based on the acceleration and driving state information. Furthermore, after the display position correction step, the image projection unit 140 executes the image projection step and projects the image display light so that the image is at the corrected display position. Specific details of the display position correction will be described later. When the display position correction step is completed, the process returns to step S1, where the image projection method is repeatedly executed.

[0049] FIG. 5 is a schematic diagram showing the image display area and correction in this embodiment, where FIG. 5( a) shows a stationary state on a flat surface, FIG. 5( b) shows a state in which the vehicle C is swaying upward, and FIG. 5( c) shows a state in which the vehicle C is swaying downward. The outer frame shown in the figure schematically shows the entire display area 10, which is the entire area in which an image can be displayed by the image projection unit 140. A portion of the entire display area 10 is a far display area 11, and another portion is a near display area 12. A first image (far image) is displayed in the far display area 11, and a second image (near image) is displayed in the near display area 12. The area shown by the dashed line in the figure is the reference position of the far display area 11.

[0050] 5A shows an example of a stationary state on a flat surface, with the far display area 11 and the near display area 12 set at reference positions in the entire display area 10. Here, the stationary state on a flat surface is used as the reference position, but if the tilt angle θ calculated in the angle calculation step is 0, the far display area 11 and the near display area 12 are set at the reference positions whether the vehicle C is traveling at a constant speed or accelerating or decelerating.

[0051] 5B shows an example in which vehicle C sways in the direction of the upward arrow, causing the entire display area 10 to move upward relative to the background. In this case, the far display area 11 is corrected and set in the direction of the downward arrow to offset the movement of the entire display area 10. Because the amount of change Δh in the entire display area 10 can be calculated from the tilt angle θ calculated in the angle calculation step, it is preferable to correct the far display area 11 so that it moves downward by Δh relative to the entire display area 10.

[0052] 5(c) shows an example in which vehicle C sways in the direction of the downward arrow, causing the entire display area 10 to move downward relative to the background. In this case, the distant display area 11 is corrected and set in the direction of the upward arrow to offset the movement of the entire display area 10. Because the amount of change Δh in the entire display area 10 can be calculated from the tilt angle θ calculated in the angle calculation step, it is preferable to correct the distant display area 11 so that it moves upward by Δh relative to the entire display area 10.

[0053] 5B and 5C, the far display area 11 is corrected by the same amount as the change Δh in the entire display area 10, but the correction may be greater or smaller than the change Δh as long as it is in a direction that cancels out Δh. Furthermore, when the change Δh occurs in the entire display area 10, the position of the far display area 11 may be corrected immediately, or the position may be corrected gradually over time by using a predetermined time constant.

[0054] As described above, in the image projection device 100 and image projection method of this embodiment, the image position correction unit 130 corrects the display position of the image based on the acceleration and driving state information, thereby suppressing fluctuations in the image formation position due to pitching of the vehicle C and improving image visibility. Furthermore, the virtual image 8 is located far from the driver's viewpoint, and vibrations can easily cause a large deviation from the background due to blurring of the image formation position. Therefore, correcting the position of the distant display area 11 can suppress the deviation from the position of the virtual image 8 and improve visibility.

[0055] Second Embodiment Next, a second embodiment of the present invention will be described with reference to FIG. 6. Description of content that overlaps with the first embodiment will be omitted. FIG. 6 is a schematic diagram showing the image display area and correction in this embodiment, where FIG. 6(a) shows a stationary state on a flat surface, FIG. 6(b) shows a state in which the vehicle C is swaying upward, and FIG. 6(c) shows a state in which the vehicle C is swaying downward. In the first embodiment, only the position of the far display area 11 was corrected, but in this embodiment, the positions of the far display area 11 and the near display area 12 are corrected in the same way.

[0056] The example shown in Figure 6(a) shows a stationary state on a flat surface, with the far display area 11 and the near display area 12 set at reference positions in the entire display area 10. The examples shown in Figures 6(b) and 6(c) show a case where the vehicle C is swaying in the direction of the arrow, causing the entire display area 10 to move upward or downward relative to the background. In this case, the far display area 11 and the near display area 12 are set by correcting the direction to offset the movement of the entire display area 10.

[0057] In the image projection device 100 and the image projection method of this embodiment, the image position correction unit 130 corrects the display position of the image based on the acceleration and driving state information, thereby making it possible to improve the visibility of the image by suppressing fluctuations in the imaging position of the image due to pitching of the vehicle C. Furthermore, by correcting the positions of the far display area 11 and the near display area 12, it is possible to suppress misalignment between the virtual images 7 and 8 and the background, thereby enhancing the effect of improving visibility.

[0058] Third Embodiment Next, a third embodiment of the present invention will be described with reference to FIG. 7. Description of content that overlaps with the first embodiment will be omitted. FIG. 7 is a schematic diagram showing the display area and correction of an image in this embodiment, where FIG. 7(a) shows a stationary state on a flat surface, FIG. 7(b) shows a state in which the vehicle C is swaying upward, and FIG. 7(c) shows a state in which the vehicle C is swaying downward. In the second embodiment, the positions of the far display area 11 and the near display area 12 were corrected in the same way, but in this embodiment, the correction amounts of the far display area 11 and the near display area 12 are made different.

[0059] The example shown in Figure 7(a) shows a stationary state on a flat surface, with the far display area 11 and the near display area 12 set at reference positions in the entire display area 10. The examples shown in Figures 7(b) and 7(c) show a case where the vehicle C is shaking in the direction of the arrow, causing the entire display area 10 to move upward or downward relative to the background. In this case, the far display area 11 and the near display area 12 are set by correcting them in directions that offset the movement of the entire display area 10. In this case, the distance from the driver's viewpoint to the image formation position of the virtual image 8 is long, and deviation from the background caused by shaking of the image formation position is likely to be large. Therefore, it is preferable to make the correction amount of the far display area 11 greater than the correction amount of the near display area 12.

[0060] (Fourth Embodiment) Next, a fourth embodiment of the present invention will be described with reference to Fig. 8. Description of content that overlaps with the first embodiment will be omitted. Fig. 8 is a flowchart showing the steps of an image projection method according to this embodiment. As shown in Fig. 8, the image projection method of this embodiment acquires a steering angle in a vehicle information acquisition step, and includes a steering angle determination step and a centrifugal force calculation step in an image position correction step.

[0061] First, in an acceleration acquisition step of step S11, acceleration data is acquired from acceleration acquisition unit 110. Next, in a vehicle information acquisition step of step S12, driving state information including vehicle speed information and steering angle information is acquired from vehicle information acquisition unit 120. Next, in a vehicle speed determination step of step S13, it is determined whether the vehicle speed included in the driving state information is zero. If it is zero, the process proceeds to step S18, and if it is not zero, the process proceeds to step S14. Next, in a driving-related acceleration calculation step of step S14, a driving-related acceleration α is calculated from the vehicle speed included in the driving state information.

[0062] Next, in a steering angle determination step of step S15, it is determined whether the steering angle included in the driving state information is zero. If it is zero, the process proceeds to step S17, and if it is not zero, the process proceeds to step S16. Next, in a centrifugal force calculation step of step S16, the centrifugal force acting on vehicle C is calculated from the steering angle and vehicle speed included in the driving state information. Next, in an acceleration correction step of step S17, the ax component of the acceleration on the coordinate axes of vehicle C detected by acceleration sensor 200 is corrected with the driving-related acceleration α and the acceleration β due to centrifugal force. Next, in an angle calculation step of step S18, the tilt angle θ is calculated from the corrected acceleration.

[0063] Next, in the image position correcting step of step S19, the image position correcting unit 130 corrects the display position of the image projected from the image projecting unit 140 based on the tilt angle θ calculated in the angle calculating step.

[0064] As described above, in the image projection device 100 and the image projection method of this embodiment, the image position correction unit 130 corrects the display position of the image based on the acceleration and driving state information, which makes it possible to improve the visibility of the image by suppressing fluctuations in the imaging position of the image due to pitching of the vehicle C. Furthermore, the driving state information includes vehicle speed information and steering angle information, and by calculating centrifugal force and correcting the influence of centrifugal force, it is possible to more accurately calculate the tilt angle θ and prevent shaking of the virtual images 7 and 8.

[0065] Fifth Embodiment Next, a fifth embodiment of the present invention will be described. Description of content that overlaps with the first embodiment will be omitted. In the first to third embodiments, the image position correction unit 130 corrects the positions of the far display area 11 and the near display area 12 in the entire display area 10 to correct the shaking of the virtual images 7 and 8 caused by the tilt angle θ. However, in this embodiment, the correction is performed by mechanically driving the projection optical system.

[0066] As an example, the tilt angles of the reflecting mirror 2, free-form surface mirror 3, light branching unit 4, or free-form surface mirror 5 that make up the projection optical system in Fig. 1 can be changed. Furthermore, the image position correction unit 130 drives a motor device or the like to change the orientation of the reflecting mirror 2, free-form surface mirror 3, light branching unit 4, or free-form surface mirror 5 in a direction that cancels out the tilt angle θ. When a motor device is used, it is preferable to use a stepping motor that can precisely control the rotation angle.

[0067] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

[0068] This international application claims priority based on Japanese Patent Application No. 2023-089286, filed on May 30, 2023, the entire contents of which are incorporated herein by reference.

[0069] The above descriptions of specific embodiments of the present invention have been presented for purposes of illustration. They are not intended to be exhaustive or to limit the invention to the precise forms described. Numerous modifications and variations will be apparent to those skilled in the art in light of the above description.

[0070] REFERENCE SIGNS LIST 100... Image projection device 110... Acceleration acquisition unit 120... Vehicle information acquisition unit 130... Image position correction unit 140... Image projection unit 200... Acceleration sensor 300... Vehicle control unit 400... Image generation unit 1... Image display unit 2... Reflecting mirror 3, 5... Free-form surface mirror 4... Light branching unit 6... Windshield 10... Total display area 11... Distant display area 12... Near display area

Claims

1. An image projection device that projects a virtual image via a display unit, comprising: an image projection unit that irradiates an image for forming the virtual image as image display light; an acceleration acquisition unit that acquires acceleration applied to a vehicle; a vehicle information acquisition unit that acquires driving state information of the vehicle; and an image position correction unit that corrects the display position of the image based on the acceleration and the driving state information.

2. An image projection device as described in claim 1, wherein the driving condition information includes vehicle speed information of the vehicle, and the image position correction unit corrects the display position based on driving-related acceleration calculated from the vehicle speed information.

3. An image projection device as described in claim 2, wherein the driving condition information includes steering angle information of the vehicle, and the image position correction unit corrects the display position based on centrifugal force calculated from the vehicle speed information and the steering angle information.

4. An image projection device as described in claim 1, characterized in that the image position correction unit calculates the amount of change in the imaging position of the virtual image based on the acceleration and the driving state information, and corrects the display position of the image in a direction that offsets the amount of change.

5. An image projection device as described in claim 1, wherein the image includes a near image formed at a predetermined distance from the display unit and a far image formed at a distance farther from the display unit than the near image, and the image position correction unit corrects the display position of at least the far image.

6. An image projection device according to claim 5, characterized in that the display position of the near image is corrected.

7. An image projection device according to claim 6, characterized in that the amount of correction of the display position in the distant image is greater than the amount of correction of the display position in the near image.

8. An image projection method for projecting a virtual image via a display unit, comprising: an image projection step of irradiating an image for forming the virtual image as image display light; an acceleration acquisition step of acquiring acceleration applied to the vehicle; a vehicle information acquisition step of acquiring driving state information of the vehicle; and an image position correction step of correcting the display position of the image based on the acceleration and the driving state information.

Citation Information

Patent Citations

  • Head-up display device

    JP2019119248A

  • Head-up display device

    JP2019119262A

  • Manufacturing method for metal nitride film and electronic element including metal nitride film

    JP2023089286A

  • Navigation device for vehicle and navigation method

    JP2011007562A

  • Vehicle information projection system and projection device

    JP2015080988A