Image projection device and image projection method
The image projection device addresses the lack of dynamic information display by using a vehicle information acquisition unit and projector, controlled by a light distribution ECU, to enhance safety through clear road surface projections.
Patent Information
- Application Number
- JP2024145391
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2015-08-05
- Filing Date
- 2024-08-27
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2035-12-11
AI Technical Summary
Conventional image projection devices for vehicles do not effectively display necessary information based on the driving state of the vehicle.
An image projection device that includes an acquisition unit to gather vehicle information and projects images such as a predicted traveling path onto the road surface using a projector, controlled by a light distribution control ECU that integrates various sensors and communication units.
Enables effective projection and display of vehicle information on road surfaces, enhancing safety by providing drivers and pedestrians with clear directions and warnings based on vehicle dynamics.
Smart Images

Figure 2024161126000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image projection device and an image projection method. [Background technology]
[0002] Image projection devices, typified by projectors, are already used in a wide range of fields as devices for enlarging and projecting a desired image, and in recent years have also come to be widely used as display devices for personal computers and mobile phones.
[0003] As for such image projection devices, the following are already known as prior art related to their use in vehicles. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 8-43781 [Patent Document 2] JP 2004-136838 A [Patent Document 3] JP 2010-26759 A [Patent Document 4] JP 2012-247369 A [Patent Document 5] JP 2014-153868 A Summary of the Invention [Problem to be solved by the invention]
[0005] That is, the above-mentioned Patent Document 1 discloses a projection display device that uses the headlights as an external light source by placing an LCD projector with no built-in light source and excellent portability in front of the vehicle headlights as an external light source. In order to solve the problem, Patent Document 2 shows an embodiment that realizes a first state in which the projector is installed in front of the headlights and inside the vehicle in advance, and a second state in which the projector or the headlights are moved to directly irradiate the light beam from the headlights to the outside of the vehicle, and further shows an embodiment in which an image is displayed on the road.
[0006] Furthermore, Patent Document 3 discloses a vehicle driving assistance device that, in order to effectively alert the occupants of the vehicle when it is determined that the vehicle is about to depart from its lane, displays information on the road in front of the vehicle to encourage the occupants to pay attention using an illumination means (laser) attached to the headlights in front of the vehicle.
[0007] Also, according to Patent Document 4, a vehicle driving assistance device is already known that is equipped with a projector as a projection means at the front of the vehicle, and projects a route guidance image that guides the driver to a branching direction based on route information searched by a navigation system, with a set projection angle, onto the road surface ahead of the vehicle. In addition, according to Patent Document 5, a driving assistance device for a vehicle is already known that enables the driver to recognize the destination of the vehicle by projecting a drawing pattern consisting of a target mark and a tracking line onto the road surface ahead of the vehicle based on the driving state of the vehicle, thereby enabling appropriate driving.
[0008] However, the above-mentioned conventional techniques do not necessarily effectively display necessary information based on the driving state of the vehicle.
[0009] Therefore, the present invention has been achieved in consideration of the problems in the conventional technology described above, and aims to provide a technology that makes it possible to project and display information onto the road surface, a wall surface, on the vehicle itself (hereinafter referred to as the road surface, etc.) based on information about the vehicle (a moving body represented by an automobile, etc.), such as the running state of the vehicle. [Means for solving the problem]
[0010] In order to solve the above problem, for example, the configuration described in the claims is adopted. The present application includes a plurality of means for solving the above problem, and as an example, an image projection device includes an acquisition unit capable of acquiring information about a vehicle, and an image projection unit capable of projecting an image based on the information acquired by the acquisition unit. When the vehicle travels on a roadway with multiple lanes, the image projection unit projects an image showing a predicted traveling path of the vehicle. Effect of the Invention
[0011] According to the present invention, it is possible to provide a technique that enables information to be projected and displayed on a road surface or the like based on information relating to a vehicle. [Brief description of the drawings]
[0012] [Figure 1] 1 is a perspective view of a vehicle mounted with an image projection device according to an embodiment of the present invention and projecting an image onto a road surface or the like, as viewed from the front. [Diagram 2] 1 is a perspective view of a vehicle mounted with an image projection device according to an embodiment of the present invention and projecting an image onto a road surface or the like, as seen from the rear. [Diagram 3] 2 is a diagram showing an overall configuration of a light distribution control ECU that constitutes the image projection device. FIG. [Figure 4] 2 is a block diagram showing a further detailed configuration example of the light distribution control ECU and its peripheral elements. FIG. [Diagram 5] 1 is a diagram showing an example of a configuration of a video projection device according to an embodiment of the present invention. [Figure 6] FIG. 1 is a ray diagram including the image plane of the projector. [Figure 7] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 8] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 9]5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 10] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 11] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 12] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 13] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 14] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 15] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 16] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 17] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 18] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 19] 5A to 5C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 20] 13A and 13B are diagrams showing specific examples of images projected from the projector onto the road surface in relation to vehicle information according to another embodiment. [Figure 21] 13A and 13B are diagrams showing specific examples of images projected from the projector onto the road surface in relation to vehicle information according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0014] <Image projection device placement> First, in Fig. 1(A) and (B), a passenger car 10 is shown as an example of a vehicle equipped with an image projection device according to an embodiment of the present invention. As shown in these figures, a pair of left and right headlights 11 are provided in front of the main body of the passenger car 10. In the example of Fig. 1(A), a lamp that is an illuminant is built inside the pair of headlights 11, which is not shown in detail here. In addition, in the example of Fig. 1(A), a pair of image projection devices, which will be described in detail below, are mounted on the left and right of the passenger car 10. Then, the image light from the image projection device is projected forward of the vehicle through, for example, a transparent window. In this example, the image projected on the road surface shows the current or future traveling direction to pedestrians walking near the vehicle, thereby ensuring higher safety.
[0015] FIG. 1(B) shows an example in which only one image projection device is mounted at the front end of the vehicle body. In this case, the image light from the image projection device is projected forward of the vehicle, for example, through a transparent window portion 12 provided at the front end of the vehicle body.
[0016] 2(A) and (B) show the rear of the passenger car 10 equipped with an image projection device according to an embodiment of the present invention, and as shown in these figures, red tail lamps 13, 13' are provided at the rear of the vehicle body. In the example of Fig. 2(A), lamps that are light-emitting bodies are built into the tail lamps 13, 13', although they are not shown in detail here. In the example of Fig. 2(A), a pair of image projection devices are mounted on the left and right, and image light from the image projection devices is projected to the rear of the vehicle through, for example, a transparent window.
[0017] Fig. 2(B) shows an example in which the image projection device is mounted, for example, near the roof of the vehicle body. In the example of Fig. 2(B), similar to Fig. 1(B) above, the image light is projected to the rear of the vehicle through a transparent window provided at the rear end of the vehicle body.
[0018] Although the above describes an example in which one or more (a pair of) image projection devices are mounted on the front and rear of the vehicle, the present invention is not limited to this, and for example, the image projection device may be mounted in a location other than the front and rear of the vehicle (for example, on the side mirror, on the roof, on the side or bottom of the vehicle body, etc.). The image projection device may also be integrated into the headlight or taillight. In other words, the present invention requires only that the image projection device be able to project a desired image onto the road surface, etc. When the image projection device is integrated into the headlight or taillight, the light source of the headlight or taillight can also be used as a light source for projection.
[0019] <Light distribution control ECU configuration> 3 shows an example of the configuration of an electronic control unit (light distribution control ECU) mounted in the passenger vehicle 10. As is clear from this figure, the light distribution control ECU 40 includes a CPU (central processing unit) 41, a RAM 42 and a ROM 43 as storage means, and an input / output device (I / O unit) 44. Information is input to the light distribution control ECU from the following various information acquisition units and communication units via the I / O unit 44, and the light distribution control ECU controls the driving of the headlights 11 and the image projection of the image projection device 500.
[0020] Here, the information from the various information acquisition units includes, for example, a speed signal indicating the vehicle's traveling speed, a signal indicating the engine state (ON / OFF), gear information indicating the gear position, a hazard signal that alerts surrounding drivers to the presence of danger, a steering wheel angle signal indicating the steering angle of the steering wheel, a turn signal signal indicating the presence or absence of a turn signal (or "blinker") and whether the left or right one is lit / flashing, and lamp lighting information indicating the lit / flashing state of the various lamps mentioned above.
[0021] In addition, the information from the various information acquisition units further includes, for example, information from an external light sensor that detects light outside the vehicle (illuminance signal, chromaticity signal, etc.), image information from a camera mounted on the vehicle, signals from distance sensors that detect the distance between the vehicle in front of it or other vehicles traveling in the vicinity or other objects, and even signals from infrared sensors that detect the conditions outside the vehicle at night.
[0022] Furthermore, the information from the communication unit includes, for example, a GPS (Global Positioning System) signal for determining the position of the vehicle, information from a navigation device that provides route guidance, etc., so-called navigation information, as well as information on vehicle-to-vehicle communication between other vehicles and road-to-vehicle communication between the road and the vehicle.
[0023] Fig. 4 shows a more detailed configuration of the above-mentioned light distribution control ECU 40 and its peripheral elements. That is, in Fig. 4, signals from a direction indicator sensor 51, a steering wheel steering angle sensor 52, a shift position sensor 53, a vehicle speed sensor 54, an accelerator operation sensor 55, a brake operation sensor 56, an illuminance sensor 57, a chromaticity sensor 58, an engine start sensor 59, and a hazard lamp sensor 60 are input to the above-mentioned light distribution control ECU 40. Furthermore, a signal from a camera 61 is input to the ECU 40 via an image processing unit 62, and signals from a GPS receiving unit 63 and a map information output unit 64 are input to the ECU 40 via a calculation unit 65.
[0024] In addition, a control signal from the light distribution control ECU 40 and a signal from the projection signal output unit 110 (an image signal to be projected onto a road surface, etc.) are input to the projector 100 constituting the image projection device via the control unit 120, thereby projecting an image onto the road surface, etc., as described below.
[0025] In addition, signals from a headlight sensor 66 and a high / low sensor 67 are further input to the light distribution control ECU 40 .
[0026] <Image projection device> Next, an example of a more detailed configuration of the image projection device 500 including the projector 100, the projection signal output unit 110, and the control unit 120 shown in FIG. 4 will be described in detail below with reference to FIG.
[0027] The projection optical system 501 is an optical system that projects an image onto a road surface or the like, and includes a lens and / or a mirror. The display element 502 is an element that generates an image by modulating transmitted or reflected light, and uses, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Micromirror Device: registered trademark) panel, or the like. The display element driving unit 503 sends a driving signal to the display element 502, causing the display element 502 to generate an image. The light source 505 generates light for image projection, and uses a high-pressure mercury lamp, a xenon lamp, an LED light source, a laser light source, or the like. The power source 506 supplies power to the light source 505. Furthermore, the power source 506 supplies the necessary power to each of the other units. The illumination optical system 504 collects the light generated by the light source 505, makes it more uniform, and irradiates it on the display element 502. The cooling unit 515 cools each part that becomes hot, such as the light source 505, the power source 506, or the display element 502, by air cooling or liquid cooling as necessary. The operation input unit 507 is a light receiving unit for an operation button or a remote control, and inputs an operation signal from the user.
[0028] The video signal input unit 531 connects to an external video output device and inputs video data. The audio signal input unit 533 connects to an external audio output device and inputs audio data. The audio output unit 540 can output audio based on the audio data input to the audio signal input unit 533. The audio output unit 540 may also output built-in operation sounds and error warning sounds. The communication unit 532 connects to, for example, an external information processing device and inputs and outputs various control signals.
[0029] The non-volatile memory 508 stores various data used in the projector function. The data stored in the non-volatile memory 508 includes image data and video data prepared in advance to be projected on the road. The memory 509 stores the video data to be projected and control parameters of each part of the device. The control unit 510 controls the operation of each part connected to it.
[0030] The image adjustment unit 560 performs image processing on the video data input by the video signal input unit 531, the image data stored in the non-volatile memory 508, and the video data. Examples of the image processing include scaling processing for enlarging, reducing, transforming, etc. an image, brightness adjustment processing for changing the brightness, contrast adjustment processing for changing the contrast curve of an image, and Retinex processing for decomposing an image into light components and changing the weighting of each component.
[0031] The storage unit 570 records video, images, audio, various data, etc. For example, video, images, audio, various data, etc. may be recorded in advance at the time of product shipment, or video, images, audio, various data, etc. acquired from an external device or an external server via the communication unit 532 may be recorded. The video, images, various data, etc. recorded in the storage unit 570 may be output as a projected video via the display element 502 and the projection optical system 501. The audio recorded in the storage unit 570 may be output as audio from the audio output unit 540.
[0032] As described above, various functions can be implemented in the image projection device 500. However, the image projection device 500 does not necessarily have to have all of the above-mentioned configurations. Any configuration may be used as long as it has the function of projecting an image.
[0033] Fig. 6 is a light ray diagram of the projector including the image surface. In the figure, the image light emitted from a light source such as an LED (not shown) and transmitted through an image display element passes through a filter, etc., is refracted by various lens systems, and is further reflected depending on the configuration before being projected onto the image surface 8 (road surface, etc.).
[0034] Thus, in the above-described image projection device 500, the length of the long side of the range of the projected image is 10061-542=9519≒9520 mm for a projection distance of 700 mm, and the throw ratio is 700 / 9520≒0.07, achieving an unprecedentedly wide angle.
[0035] Although one image projection device 500 and its projection optical system have been described above, as mentioned above, in the present invention, one or more (a pair of) projectors may be mounted on a vehicle (or integrated into a headlight or taillight) to project a desired image onto the road surface, etc. In this case, particularly in the case of using a plurality of (a pair of) image projection devices as shown in Fig. 1(A) and Fig. 2(A) above, the same image may be projected onto the road surface, etc. from each image projection device (in which case the same image is displayed on the display element 502 in Fig. 5), or different images may be projected from the left and right image projection devices and synthesized on the road surface, etc. (in which case the desired image divided into left and right images is displayed on the display element 502 in Fig. 5).
[0036] In the above, a configuration using a transmissive liquid crystal image display element has been described as an image projection device that projects an image onto a road surface or the like, but the present invention is not limited to this, and various other image projection devices can also be used as the image projection device, such as a reflective image projection device made of micromirrors such as a DLP (digital light processing) device, an image projection device that can project image light from a planar light-emitting diode that can be light-modulated via a projection optical system, etc. In other words, in the present invention, it is sufficient that the image projection device can project a desired image onto a road surface or the like.
[0037] <Projection of images onto road surfaces, etc.> Next, the image projection device described in detail above is mounted on the front and / or rear of the vehicle body as described above, and specific examples of various images that are projected onto the road surface, etc. in relation to vehicle information will be described in detail below with reference to Figures 7 to 19.
[0038] FIG. 7 shows a form in which an arrow is projected on the road surface in front of the vehicle when the direction indicator (also called a blinker or a turn signal) is turned on / flashed when turning right / left while driving the vehicle 10. In this case, based on a signal from the direction indicator sensor 51 shown in FIG. 4, the image projection device projects an arrow 200, which is an image indicating the traveling direction of the vehicle, on the road surface in front of the vehicle (FIG. 7(A)). At the same time, the image projection device further flashes the arrow 200 projected on the road surface in front of the vehicle based on the traveling speed of the vehicle input from the vehicle speed sensor 54 and the steering angle of the steering wheel input from the steering wheel steering angle sensor 52 (FIG. 7(B)). In this case, the arrow 200 may be linked (synchronized or alternately) to the flashing of the turn signal, or the period at which the arrow 200 flashes may be variable and set according to the input traveling speed and steering angle of the steering wheel.
[0039] According to such a projected image on the road surface, the display method (in this case, blinking and blinking period) is set based on the driving information of the vehicle (in this case, vehicle speed and steering angle) as well as the traveling direction of the vehicle, so that the surrounding drivers and pedestrians can be more reliably notified (warned) and high safety can be ensured. In this case, when a pair of image projection devices is incorporated as in the example of FIG. 1(A) and FIG. 2(A), the respective projected images can be combined to display a large image, thereby further improving safety, and it is also possible to display different projected images or information on different targets. Note that, although the embodiment uses an arrow, the present invention is not limited to this, and shapes indicating directions, text information, etc. may be used. Also, in the embodiment, an example in which the mark itself to be displayed is projected is shown, but the surrounding area excluding the mark may be projected and the inverted mark may be displayed.
[0040] Furthermore, as shown in Fig. 8, the curvature of the arrow may be changed according to the driver's steering wheel operation. That is, for example, before the driver actually operates the steering wheel, the arrow indicating the vehicle's traveling direction is a straight arrow 210 (Fig. 8(A)), and when the driver actually operates the steering wheel, the arrow is changed to a curved arrow 200 (Fig. 8(B)) according to the steering angle, thereby making it possible to more reliably present the vehicle's driving information to surrounding drivers and pedestrians.
[0041] Furthermore, in the above figures, the displayed contents can be, for example, a mark 230 (see FIG. 15(A) below) indicating danger or a curved approach trajectory 220 (see FIG. 12(B) below) instead of the arrow, and furthermore, the displayed position can be changed (for example, to a position away according to the traveling speed, or to a position moved in the steering direction). In addition, when turning on / flashing the turn signal for right / left turns, it is also possible to turn on / flash the arrow 200 of the same color as the turn signal, or to change the display position of the mark (arrow 200) for right / left turns (to the left or right). Furthermore, it is also possible to detect whether the turn signal is on / flashing, and to display the right / left turn with the arrow 200 when the turn signal is on / flashing in conjunction with the steering wheel.
[0042] 9 shows an example of the display when the steering wheel is operated to park in a garage, and displays an arrow 200 indicating the traveling direction behind the vehicle 10, as well as a rectangular frame 220 for indicating the traveling range of the vehicle 10. In this case, only the arrow 200 or only the rectangular frame 220 may be displayed, and further, a mark 230 (see FIG. 15(A) below) that warns of danger may be displayed instead of the arrow depending on the steering angle.
[0043] Such an image projected onto the road surface or the like can more reliably present (warn) surrounding drivers and pedestrians, particularly when parking in a garage, thereby ensuring a high level of safety.
[0044] 10 shows an example in which, similar to the above, when the turn signal is turned on / flashed when turning right / left, the distance to the position where the mark (arrow 200) is displayed is changed according to the distance from the vehicle to the intersection in conjunction with a GPS or navigation system. In this example, when the distance from the vehicle 10 to the intersection is far, the mark (arrow 200) is displayed far away, and as the vehicle approaches the intersection, the display position is moved closer to the vehicle 10, that is, the display position is set according to the distance from the vehicle to the intersection.
[0045] In the above example, it is also possible to change the color or shape of the mark (arrow 200) according to the distance to the intersection. For example, as shown in Fig. 11(A) to (C), the size of the mark (arrow 200) (more specifically, the "L"-shaped arrow 200 for turning right / left) can be gradually increased or the color of the mark (arrow 200) can be changed from blue to yellow to red, depending on the distance to the intersection. Also, the mark (arrow 200) can be displayed larger / blinking.
[0046] Such images projected onto the road surface, etc., make it easier for surrounding drivers and pedestrians to recognize the direction in which the vehicle is traveling, and also makes it easier for the driver of the vehicle to recognize the route that the vehicle should take at an intersection, thereby ensuring greater safety.
[0047] In particular, when multiple vehicles are traveling side by side on a relatively wide roadway, as shown in Fig. 12(A), a mark (straight arrow) 210 may be displayed so as to overlap the road surface of the adjacent lane, or, as shown in Fig. 12(B), an approach trajectory 220 consisting of multiple (two in this example) parallel straight lines that bend diagonally to indicate a trajectory or a curved line may be displayed instead of the arrow. In these cases, it is possible to more reliably make the driver of the following vehicle traveling in the adjacent lane recognize (warn) the traveling direction of the vehicle, particularly when changing lanes, and to ensure high safety. In this case, if the turn signal is turned on / flashed in conjunction with a lane change, the time the turn signal is turned on / flashed is shorter than when turning right or left, so it is assumed that the above-mentioned projection display may not be completed in time or the projection time may be too short, but in such a case, the time difference may be reduced by simplifying the processing method up to the projection display (e.g., reducing the number of steps, etc.) or by continuing the projection display for a predetermined time or more (the projection display is not turned off for a predetermined time even when the turn signal is turned off, etc.), thereby dealing with the short projection time. Alternatively, assuming a case where the turn signal is turned on / flashed incorrectly, the projection display may not be displayed if the turn signal is not turned on / flashed for a predetermined time or more.
[0048] Next, a description will be given below of an image projected onto the road surface or the like using a video signal captured by the camera 61 also shown in FIG. 4 and input to the light distribution control ECU 40 via the image processing unit 62.
[0049] As also shown in FIG. 13, on the vehicle 10, the camera 61 captures the side area that is in the driver's blind spot (in the figure, the area indicated by the diagonal line on the left side of the vehicle), and when another vehicle 10' traveling behind the vehicle in the adjacent lane that is in the blind spot area is detected, the ECU 40 of the vehicle 10 projects an image 300 of the other vehicle 10' traveling behind the vehicle onto the road surface or the like ahead in the direction of travel, instead of a mark such as the arrow described above.
[0050] By displaying such an image 300, the driver can reliably recognize (become aware of) another vehicle 10' traveling behind the vehicle, which would normally be difficult to notice, thereby contributing to safe driving, especially when changing lanes, etc.
[0051] Also, as shown in FIG. 14, when the parked vehicle 10 starts moving, an image 310 of the vehicle is projected onto the road surface or the like in the direction in which the vehicle is about to start, thereby more reliably presenting (warning) surrounding drivers and pedestrians, thereby ensuring high safety.
[0052] 15, when the vehicle 10 is backing up or when a hazard-linked warning is issued, a mark 230 informing of danger may be projected onto the road surface behind the vehicle (FIG. 15(A)), or the words "backing up" 240 may be projected onto the road surface in front of or behind the vehicle (FIG. 15(B)). By projecting such an image, it is possible to more reliably present (warn) surrounding drivers and pedestrians, particularly when parking, and ensure high safety.
[0053] Also, as shown in FIG. 16, when reversing (backing) the vehicle 10 in order to park, a mark 250 (e.g., a rectangular red surface) indicating a parking space can be projected and displayed at the position where the vehicle is to be parked, in response to the operation of the steering wheel.
[0054] In addition, it is possible to change the display contents when driving in a tunnel, on a highway, on a general road, etc. For example, as shown in Fig. 17, since the driver's gaze point changes depending on the driving speed, a straight arrow 210 is projected at a projection distance set according to the driving speed of the vehicle 10. For example, it is projected at a short distance when driving at a low speed (Fig. 17(A)), at a medium distance when driving at a medium speed (Fig. 17(B)), and at a long distance when driving at a high speed (Fig. 17(C)).
[0055] Furthermore, as shown in FIG. 18, since the driver's viewing angle changes depending on the driving speed (for example, 100 degrees at 40 km / h and 40 degrees at 100 km / h, becoming narrower as the speed increases), the viewing angle range becomes wide-angle at low speeds (shaded area 260 in FIG. 18(A)), so a wide-angle display can be set to correspond to this, and the viewing angle range becomes narrow-angle at high speeds (shaded area 270 in FIG. 18(B)), so the display can be set to correspond to this.
[0056] In addition, when driving in a tunnel, it is possible to display different contents than when driving on a highway or a general road. For example, as shown in Fig. 19, when in a tunnel, the display contents (in this example, the color of the straight arrow 210) may be changed (changed color) in synchronization with a sudden change in the brightness of the surrounding light or the lighting of the small lights, or it may be possible to intentionally illuminate the mark (arrow 210) in a color that is difficult to see by using the tunnel lighting.
[0057] In this case, the color of the straight arrow 210, which is the display content, may be appropriately set by the light distribution control ECU 40 described above using signals from the illuminance sensor 57 and chromaticity sensor 58 described above. Also, when the driver does not turn on the headlights while driving in a tunnel, the mode may be switched (specifically, the headlights may be switched on) by detecting a change in external light or the illumination light inside the tunnel. Furthermore, when driving in a tunnel on a highway, by also using a signal from the vehicle speed sensor 54, it is possible to detect the average driving speed over a certain period of time and project the display content optimal for the driving information of the vehicle while taking the average driving speed into consideration. More specifically, it is recognized that the vehicle is driving on the highway from the average driving speed over a certain period of time. The display method when driving in a tunnel may be the same as the display state in the evening / night, for example. Also, since the mode returns to the general road mode when the vehicle is driving on a highway and there is a traffic jam, it is possible to link the display with a navigation device or to provide a step for confirming whether the vehicle has left the highway.
[0058] Although various embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments and includes various modified examples. For example, the above-described embodiments are detailed descriptions of the entire system in order to easily explain the present invention, and are not necessarily limited to those having all of the configurations described. In addition, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.
[0059] In addition, the above-mentioned configurations, functions, processing units, processing means, etc. may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. In addition, the above-mentioned configurations, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as the program, table, file, etc. that realizes each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD.
[0060] In addition, the contents of the present invention including the various embodiments described above are summarized below.
[0061] (1) When turning right or left, the turn signal is turned on or flashes, and the flashing cycle is variable according to the speed and steering angle. (2) When the steering wheel is turned to turn right or left, the display content / position changes according to the steering angle (for example, when the turn signal is activated, a diagonal mark is displayed, and when the steering angle increases, it changes to an L-shaped mark). (3) When moving the steering wheel while parking or parking, the direction of travel will be displayed and the arrow will change according to the steering angle / gear. (4) When the turn signal is turned on / flashing when turning right / left, the projected image is linked (synchronized or alternating) to the lighting / flashing of the turn signal. (5) When turning right or left, the turn signal shall be turned on or flashing in the same color as the turn signal. (6) If the turn signal is turned on / flashing when turning right / left, the position of the mark will change depending on whether you turn right / left. (7) When the steering wheel is moved to turn right / left, the system detects whether the turn signal is on / flashing, and if the turn signal is on / flashing, displays an indication of right / left turn (i.e., linked with the turn signal and / or steering wheel). (8) When the turn signal is turned on / flashing when turning right / left, the system will link with the GPS or navigation system and change the display distance of the mark depending on the distance to the intersection (for example, if the distance to the intersection is far, the mark will be displayed farther away from the vehicle, and as the intersection gets closer, the mark will be displayed closer to the vehicle). (9) When turning right / left and turning the turn signal on / flashing, the color or shape of the mark will change depending on the distance to the intersection (for example, blue ⇒ yellow ⇒ red, or gradually increase in size). (10) When the turn signal is turned on / flashing when turning right / left, a large right / left turn arrow (e.g., an L-shape) will be displayed / flashing.
[0062] (11) When the turn signal is turned on / flashing to change lanes, the arrow shall be displayed as a straight diagonal arrow rather than an L-shape that suggests a right / left turn. (12) When turning on / flashing the turn signal to change lanes, marks will be displayed diagonally forward to the left and right so that following vehicles can see them. (13) When turning on / flashing the turn signal to change lanes, the vehicle’s trajectory will be displayed instead of an arrow to clarify where the vehicle will enter. (14) When the driver turns on or blinks the turn signal to change lanes, an image from a camera of the lane to which the driver is about to change is displayed (for example, an image of the side that is in the driver's blind spot). (15) When turning on / flashing the turn signal to change lanes, the turn signal lighting / flashing time is shorter than when turning right or left, so there is a possibility that the projection display may not be displayed in time or the projection time may be too short. Therefore, it is necessary to simplify the processing method leading up to the projection display to reduce the time difference or to continue the projection display for more than a specified period of time. (16) In anticipation of a case where the turn signal is operated incorrectly, for example, the projection display will not be performed unless the turn signal is turned on / flashed after a specified time. (17) When the steering wheel is operated to pull into a garage or park, the average driving speed over a given period of time is detected, and the L-shaped indication for right / left turns is not displayed depending on the detection results (i.e., it is distinguished from cases where the driver decelerates to turn right / left). (18) When moving the steering wheel while parking or pulling into a garage, an alert will be displayed (for example, forward, backward, left, right, or all three directions). (19) When the steering wheel is moved while parking or in a garage, a warning message is displayed in conjunction with the hazard lights.
[0063] (20) When moving the steering wheel while parking or parking in a garage, a warning message is displayed to alert pedestrians in the vicinity (mainly when backing up, etc.). (21) When the steering wheel is moved to park or enter a garage, the parking area will be illuminated / flashed in red or other colors (parking mode). (22) The display content is changed depending on whether the vehicle is traveling in a tunnel or on a highway or on a regular road. The projection distance of the mark is changed depending on the speed. (23) The display content is changed depending on whether the vehicle is traveling in a tunnel, on a highway, or on a normal road. Since the driver's viewing angle changes depending on the driving speed, the display is made wider at low speeds and narrower at high speeds. (24) The display content is changed depending on whether the vehicle is traveling through a tunnel, on a highway, or on a general road. In a tunnel, the display content is changed (color changed) in sync with the lighting of the parking lights. Also, if the driver does not turn on the lights, the system will recognize that the vehicle is traveling through a tunnel by detecting changes in the external light or the lighting inside the tunnel. The system will recognize that the vehicle is traveling on a highway from the average driving speed over a certain period of time. The display method for driving through a tunnel may be the same as the display state for evening / nighttime, for example. Also, since the system will revert to general road mode if there is congestion even when the vehicle is traveling on a highway, a step is provided to link with a navigation device or to confirm that the vehicle has left the highway. (25) When driving through a tunnel, the tunnel lighting should be intentionally set to a stronger color that is difficult to see, or a color that is easy to see.
[0064] Also, in relation to (5) above: (26) The timing of turning off the light source is changed between the display mode from the video source input and the display mode while driving, etc. (For example, in the display mode while driving, etc., the video projection device is switched ON / OFF according to the driving situation, and in the display mode from the video source input, the video projection device is always ON). In the display mode from the video source input, the headlights are turned OFF and the video projection device is turned ON. And in the display mode while driving, etc., both the headlights and the video projection device are turned ON. (27) Turn on the light source of the image projection device when necessary and turn it off at other times. (28) The light source can be turned on even when the engine is off, or the image projection device is not started when the engine is off. (29) Restrict functions when the engine is off (for example, security and warnings are turned on, and other functions (such as displaying from a video source input) are turned off). (30) When the engine is off, the light source power is set to energy saving mode.
[0065] <Projected image and car behavior> Furthermore, if the vehicle and the projected image move independently, the attention of people viewing the projected image (e.g., pedestrians, oncoming drivers, and other people) will be distracted, making it difficult for them to see the projected image.
[0066] More specifically, for example, when a vehicle is about to turn right or left at an intersection and is stopped because the traffic light is red, an image including, for example, an arrow indicating the direction in which the vehicle will proceed is projected onto the road surface in front of the vehicle (at the intersection). In addition, at that time, it is effective to display an arrow or the like, which is an image indicating the direction in which the vehicle will proceed, in order to attract the attention of others (e.g., pedestrians, drivers of the other vehicle, etc.) who are viewing the projected image.
[0067] However, in this case, when the projected image moves simultaneously with the start of the vehicle, that is, when both the vehicle and the projected image move, other people who are looking at the projected image may become confused and the original purpose may not be achieved. Therefore, in this other embodiment, the projection position of the projected image on the road surface is appropriately switched between static and dynamic in accordance with the behavior of the vehicle.
[0068] More specific examples are shown in Figs. 20 and 21. First, Fig. 20 shows a state where the vehicle 10 is stopped at an intersection. In this case, an image showing the direction in which the vehicle will proceed is projected on the road surface ahead of the vehicle. In this example, as is clear from Figs. 20(A) to (C), an arrow 200 showing the direction in which the vehicle will proceed (in this example, a right turn) is displayed in order to encourage pedestrians and drivers of oncoming vehicles to pay more attention to the direction in which the vehicle will proceed, and is displayed as a moving image (for example, the arrow 200 is blinking) in order to improve visibility from a distance or in a blind spot. In this case, since the vehicle is stopped just before the intersection, the projection position of the image on the road surface is stationary. In addition, it is preferable that the arrow 200 in this moving image is drawn in a color light (for example, red) that is easily identifiable even on the road surface.
[0069] FIG. 21 shows a state in which the vehicle 10 starts at an intersection, enters the intersection, and passes through the intersection. In this case, the position of the arrow 200 projected on the road surface in front of the vehicle remains stationary at the initial display position. That is, in this case, as is clear from FIG. 20(A)-(C), the vehicle 10 moves along the arrow 200 projected on the road surface, and the arrow 200 is displayed as if the vehicle 10 is running on the arrow 200. Note that in these FIG. 20 and FIG. 21, pedestrians, oncoming vehicles, and even crosswalks are omitted for the sake of simplicity.
[0070] In this embodiment, in the details of the light distribution control ECU 40 and its peripheral elements shown in Fig. 3 and Fig. 4, the light distribution control ECU 40, for example, takes in signals from the steering wheel steering angle sensor 52, the vehicle speed sensor 54, the accelerator operation sensor 55, etc., and grasps the behavior of the vehicle 10 based on these signals and calculates the current position of the vehicle 10. On the other hand, a calculation can be performed to correct the arrow 200 projected on the road surface in front of the vehicle so that the position is displayed as if it remains stationary. Then, by changing and projecting the image generated on the display element 502 shown in Fig. 5 via the display element driving unit 503, it is possible to realize a display in which the arrow 200 remains stationary and the vehicle 10 moves along the arrow.
[0071] That is, in particular, after the vehicle 10 stops at an intersection or the like and displays its traveling direction by the arrow 200 or the like, the display position of the arrow 200 is not linked to the movement of the vehicle 10, and the display position is grasped by the vehicle speed pulse, the steering angle of the steering wheel, etc., so that the display position does not change as much as possible, and by making necessary corrections to stay at the initial display position, it becomes possible to fix the display position of the image without linking it to the movement of the vehicle (that is, it becomes possible to fix / move the display position of the image on the road). Note that here, the trigger for fixation is when the vehicle 10 goes from a stopped state to a running state, when the steering wheel starts to be turned (when a predetermined steering angle is detected), or a combination of these. Also, when necessary corrections are not made to the image generated on the display element 502, the display position of the image is linked to the movement of the vehicle. In this way, the light distribution control ECU 40 grasps the behavior of the vehicle 10 by signals from various sensors, etc., and determines whether to fix / move the display position of the image on the road.
[0072] As described above, the image projected on the road surface is switched between still and moving in accordance with the behavior of the vehicle, more specifically, the projected image is moved (moving image indicated by arrow 200) when the vehicle is stopped to attract the attention of others (pedestrians, other drivers, etc.). Conversely, when the vehicle is moving (driving), the projected image is made still (the projection position on the road surface is also fixed) to shift attention to the vehicle, thereby avoiding distraction and improving safety.
[0073] In the above-described embodiment, the display of the moving direction of the vehicle when the vehicle is about to turn right or left at an intersection has been described in detail, but the present invention can also be implemented in other cases. As an example, the present invention can also be applied to the display when the steering wheel is operated when parking the vehicle in a garage, as shown in FIG. 9. In this case, an arrow 200 indicating the moving direction is displayed behind the vehicle 10, and a rectangular frame 220 for displaying the moving range of the vehicle 10 is displayed. However, by displaying the arrow 200 as a moving image as in the above embodiment, it is possible to more reliably present (warn) surrounding drivers and pedestrians and ensure higher safety. Even in this case, even if the vehicle moves backward, the position of the display including the arrow 200 projected on the road surface behind the vehicle remains stationary (fixed) at the initial position.
[0074] As a result, as in the above embodiment, by displaying the arrow 200 as a moving image, it is possible to more reliably alert surrounding drivers and pedestrians, and it is also possible to avoid confusion between the image and the vehicle itself when the vehicle actually reverses, thereby ensuring greater safety.
[0075] Furthermore, as shown in FIG. 15, for example, when the vehicle 10 is reversing or when a hazard-linked warning is issued, the mark 230 (FIG. 15(A)) that warns of danger projected on the road surface behind the vehicle, or the letters "reversing" 240 (FIG. 15(B)) that are projected on the road surface in front of and behind the vehicle can be displayed as moving images to more reliably warn surrounding drivers and pedestrians. However, in these cases, particularly in the case of FIG. 15(A), when the vehicle starts moving, the display of the mark 230 that warns of danger is no longer necessary, and the display is not performed. In addition, in the case of the letters "reversing" 240 shown in FIG. 15(B), the display of the letters 240 may be moved along with the movement of the vehicle during reversal, or, instead, the display position may be fixed as in the above embodiment. By displaying such an image, it is possible to more reliably present (warn) surrounding drivers and pedestrians, and ensure high safety, particularly when parking. That is, in the above embodiment, arrows are mainly used as the display indicating the traveling direction of the vehicle, but the present invention is not limited to this, and other shapes or text information indicating directions may also be used. [Explanation of symbols]
[0076] 10...own vehicle (passenger car), 10'...other vehicle, 11...headlight, 12...window, 13, 13'...tail lamp, 40...light distribution control ECU, 51...direction indicator sensor, 52...steering wheel steering angle sensor, 53...shift position sensor, 54...vehicle speed sensor, 55...accelerator operation sensor, 56...brake operation sensor, 57...illuminance sensor, 58...chromaticity sensor, 59...engine start sensor, 60...hazard lamp sensor sensor, 61...camera, 62...image processing unit, 63...GPS receiving unit, 64...map information output unit, 66...headlight sensor, 67...high / low sensor, 100...projector, 110...projection signal output unit, 120...control unit, 500...image projection device, 501...projection optical system, 502...display element, 503...display element driving unit, 504...illumination optical system, 505...light source, 531...image signal input unit, 533...audio signal input unit, 532...communication unit.
Claims
1. An image projection device for a vehicle, comprising: An acquisition unit capable of acquiring information regarding a vehicle; an image projection unit capable of projecting an image based on the information acquired by the acquisition unit, When the vehicle is traveling on a roadway having a plurality of lanes, the image projection unit projects an image showing a predicted traveling path of the vehicle. Image projection device.
2. 2. The image projection device according to claim 1, When the vehicle enters a lane adjacent to the lane in which the vehicle is traveling, the image projection unit projects the image onto a vehicle traveling in a lane adjacent to the lane in which the vehicle is traveling. Image projection device.
3. 3. The image projection device according to claim 2, The image is an image showing that the vehicle is traveling in another lane from the lane in which the vehicle is traveling. Image projection device.
4. 2. The image projection device according to claim 1, the image projection unit continues projection for a predetermined time or more when the vehicle enters a lane adjacent to the lane in which the vehicle is traveling, even if a turn signal of the vehicle is turned off; Image projection device.
5. 2. The image projection device according to claim 1, the image projection unit does not project the image when a turn signal of the vehicle is not turned on or flashed for a predetermined period of time or more. Image projection device.
6. 2. The image projection device according to claim 1, When the vehicle enters a lane adjacent to the lane on which the vehicle is traveling, the image projection unit projects an image of a straight line or a curved line representing a path of the vehicle on a road surface of the lane adjacent to the lane on which the vehicle is traveling. Image projection device.
7. 2. The image projection device according to claim 1, The image is a mark indicating a predicted driving route of the vehicle. Image projection device.
8. 1. A method for projecting an image, comprising: An acquisition step capable of acquiring information regarding the vehicle; and an image projection step capable of projecting an image based on the information acquired in the acquisition step, When the vehicle is traveling on a roadway having a plurality of lanes, the image projection step projects an image showing a predicted traveling path of the vehicle. Image projection method.
9. 9. The image projection method according to claim 8, further comprising the steps of: When the vehicle enters a lane adjacent to the lane in which the vehicle is traveling, the image projection step projects the image onto a vehicle traveling in a lane adjacent to the lane in which the vehicle is traveling. Image projection method.
10. 9. The image projection method according to claim 8, further comprising the steps of: the image projection step continues projection for a predetermined time or more even if a turn signal of the vehicle is turned off when the vehicle enters a lane adjacent to the lane in which the vehicle is traveling. Image projection method.
11. 9. The image projection method according to claim 8, further comprising the steps of: In the image projection step, when a turn signal of the vehicle is not turned on or blinked for a predetermined time or more, the image is not projected. Image projection method.
12. 9. The image projection method according to claim 8, further comprising the steps of: When the vehicle enters a lane adjacent to the lane on which the vehicle is traveling, the image projection step projects an image of a straight line or a curve representing a path of the vehicle on a road surface of the lane adjacent to the lane on which the vehicle is traveling. Image projection method.
Citation Information
Patent Citations
Safety device for movable body
JP2003231450A
Turn direction indicating device
JP2006117047A
Operation support device, automobile, and operation support method
JP2007283933A
Vehicle turn signaling apparatus that projects a low divergence line onto an adjacent driving lane
US20110128141A1
Method and control device for highlighting an expected movement path of a vehicle
US20130054089A1
Cited By
Vehicular road surface marking device and vehicular road surface marking method
WO2026191563A1
