Vehicle

Abstract

To provide a technique capable of projecting and displaying information on a road surface, a wall surface, an own vehicle or the like (hereinafter referred to as a road surface or the like) on the basis of information on a vehicle such as a traveling state of the own vehicle (a moving body represented by an automobile or the like).SOLUTION: A vehicle includes an acquisition unit configured to acquire information about the vehicle, and an image projection unit configured to project an image based on the information acquired by the acquisition unit. When the vehicle travels on a roadway having a plurality of lanes, the image projection unit projects an image indicating a predicted travel path of the vehicle.SELECTED DRAWING: Figure 12

Description

[Technical Field]

[0001] The present invention relates to a vehicle equipped with an image projection device. [Background technology]

[0002] Image projection devices, typified by projectors, are already used in a wide range of fields as devices for enlarging and projecting desired images, and in recent years have also come to be widely used as display devices for personal computers and mobile phones.

[0003] As for such image projection devices, the following are already known as prior art related to their use in vehicles in particular. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 8-43781 [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-136838 [Patent Document 3] Japanese Patent Application Laid-Open No. 2010-26759 [Patent Document 4] Japanese Patent Application Laid-Open No. 2012-247369 [Patent Document 5] Japanese Patent Application Laid-Open No. 2014-153868 Summary of the Invention [Problem to be solved by the invention]

[0005] That is, the above-mentioned Patent Document 1 discloses a projection display device that uses a headlight as an external light source by placing a highly portable LCD projector without a built-in light source in front of the vehicle's headlight as an external light source. In order to solve this problem, Patent Document 2 realizes a first state in which the projector is pre-installed in front of the headlight and inside the vehicle, and a second state in which the projector or the headlight is moved to directly irradiate the light beam from the headlight outside the vehicle, and further discloses an embodiment in which an image is displayed on the road.

[0006] Furthermore, Patent Document 3 discloses a vehicle driving assistance device that effectively alerts the occupants of the vehicle when it is determined that the vehicle is about to depart from its lane, by displaying information on the road ahead of the vehicle to encourage the occupants to pay attention using an illumination means (laser) attached to the headlights at the front of the vehicle.

[0007] Also, according to Patent Document 4, a device is already known in which a projector is attached to the front of a vehicle as a projection means, and a route guidance image that guides the driver to a branching direction based on route information searched by a navigation system is projected onto the road surface ahead of the vehicle with a set projection angle.In addition, according to Patent Document 5, a driving assistance device for a vehicle is also already known in which a drawing pattern consisting of target marks and tracking lines is projected onto the road surface ahead of the vehicle based on the driving state of the vehicle, thereby enabling the driver to recognize the destination of the vehicle and thereby enabling appropriate driving.

[0008] However, the above-mentioned conventional techniques do not necessarily effectively display necessary information based on the driving state of the vehicle.

[0009] Therefore, the present invention has been achieved in consideration of the problems in the conventional technology described above, and aims to provide a technology that makes it possible to project and display information onto the road surface, wall surface, on the vehicle itself (hereinafter referred to as the road surface, etc.) based on information about the vehicle (a moving object represented by an automobile, etc.), such as the running state of the vehicle itself. [Means for solving the problem]

[0010] In order to solve the above problem, for example, the configuration described in the claims is adopted. The present application includes a plurality of means for solving the above problem, and as an example, a vehicle includes an acquisition unit capable of acquiring information about the vehicle and an image projection unit capable of projecting an image based on the information acquired by the acquisition unit, and when the vehicle is traveling on a road with multiple lanes, the image projection unit projects an image showing a predicted traveling path of the vehicle, and when the vehicle changes path, there are a first state in which a path change image showing the path change of the vehicle is projected when a predetermined time has passed since the turn signal of the vehicle was turned on, and a second state in which the path change image is not projected when the predetermined time has passed since the turn signal of the vehicle was turned on. [Effects of the Invention]

[0011] According to the present invention, it is possible to provide a technique that enables information to be projected and displayed on the road surface or the like based on information relating to a vehicle. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a perspective view, seen from the front, of a vehicle that is equipped with an image projection device according to an embodiment of the present invention and projects an image onto a road surface or the like. [Figure 2] 1 is a perspective view, seen from the rear, of a vehicle that is equipped with an image projection device according to an embodiment of the present invention and projects an image onto a road surface or the like. [Figure 3] 2 is a diagram showing the overall configuration of a light distribution control ECU that constitutes the video projection device. FIG. [Figure 4] FIG. 2 is a block diagram showing a more detailed configuration example of the light distribution control ECU and its peripheral elements. [Figure 5] 1 is a diagram showing an example of a configuration of a video projection device according to an embodiment of the present invention. [Figure 6] This is a ray diagram including the image plane of the projector. [Figure 7]10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 8] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 9] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 10] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 11] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 12] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 13] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 14] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 15] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 16] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 17] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 18] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 19] 10A to 10C are diagrams showing specific examples of various images projected onto the road surface from the projector in relation to vehicle information. [Figure 20] 10A and 10B are diagrams showing specific examples of images projected onto the road surface from the projector in relation to vehicle information according to another embodiment. [Figure 21]10A and 10B are diagrams showing specific examples of images projected onto the road surface from the projector in relation to vehicle information according to another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0014] <Image projection device placement> 1(A) and 1(B) show a passenger car 10 as an example of a vehicle equipped with an image projection device according to an embodiment of the present invention. As shown in these figures, a pair of left and right headlights 11 are provided in front of the main body of the passenger car 10. In the example of FIG. 1(A), lamps serving as light emitters are incorporated inside the pair of headlights 11, although this is not shown in detail here. Also, in the example of FIG. 1(A), a pair of left and right image projection devices, which will be described in detail below, are mounted on the passenger car 10. Image light from the image projection devices is projected forward of the vehicle, for example, through a transparent window. In this example, the image projected onto the road surface or the like indicates the current or future direction of travel to pedestrians or the like walking near the vehicle, thereby ensuring greater safety.

[0015] Figure 1(B) shows an example in which only one image projection device is mounted at the front end of the vehicle body. In this case, the image light from the image projection device is projected forward of the vehicle through a transparent window 12 provided at the front end of the vehicle body.

[0016] 2(A) and 2(B) show the rear of the passenger vehicle 10 equipped with an image projection device according to one embodiment of the present invention. As shown in these figures, red tail lamps 13, 13' are provided at the rear of the vehicle body. In the example of FIG. 2(A), lamps that emit light are incorporated inside the tail lamps 13, 13', although this is not shown in detail here. In the example of FIG. 2(A), a pair of image projection devices are mounted on the left and right, and image light from the image projection devices is projected to the rear of the vehicle through, for example, a transparent window.

[0017] 2(B) shows an example in which the image projection device is mounted, for example, near the roof of a vehicle body. In the example of FIG. 2(B), similar to FIG. 1(B) above, image light is projected behind the vehicle through a transparent window provided at the rear end of the vehicle body.

[0018] Although the above describes an example in which one or more (a pair of) image projection devices are mounted on the front and rear of the vehicle, the present invention is not limited to this. For example, the image projection devices may be mounted in locations other than the front and rear of the vehicle (for example, on the side mirrors, on the roof, on the side or bottom of the vehicle body, etc.). The image projection devices may also be integrated into headlights or taillights. In other words, the present invention requires only that the image projection device be able to project a desired image onto the road surface, etc. When the image projection device is integrated into the headlights or taillights, the light source of the headlights or taillights can also be used as a light source for projection.

[0019] <Configuration of light distribution control ECU> 3 shows an example of the configuration of an electronic control unit (light distribution control ECU) mounted in the above-described passenger vehicle 10. As is clear from this diagram, the light distribution control ECU 40 includes a CPU (central processing unit) 41, storage means such as a RAM 42 and a ROM 43, and an input / output device (I / O unit) 44. Information is input to the light distribution control ECU from the various information acquisition units and communication units described below via the I / O unit 44, and the light distribution control ECU controls the driving of the headlights 11 and the image projection of the image projection device 500.

[0020] Here, the information from the various information acquisition units includes, for example, a speed signal indicating the vehicle's traveling speed, a signal indicating the engine status (ON / OFF), gear information indicating the gear position, a hazard signal that alerts surrounding drivers to the presence of danger, a steering angle signal that indicates the steering angle of the steering wheel, a turn signal signal that indicates whether a turn signal (also called a "winker") is present and whether the left or right one is lit / flashing, and lamp lighting information that indicates the lit / flashing status of the various lamps mentioned above.

[0021] In addition, the information from the various information acquisition units further includes, for example, information from an external light sensor that detects light outside the vehicle (illuminance signal, chromaticity signal, etc.), video information from a camera attached to the vehicle, signals from distance sensors that detect the distance between the vehicle and other objects traveling in the vicinity, such as in front of the vehicle, and even signals from infrared sensors that detect the situation outside the vehicle at night.

[0022] Furthermore, the information from the communication unit includes, for example, GPS (Global Positioning System) signals for determining the position of the vehicle, so-called navigation information, which is information from a navigation device that provides route guidance, etc., as well as information on vehicle-to-vehicle communications between other vehicles and road-to-vehicle communications between the road and the vehicle.

[0023] Fig. 4 shows a more detailed configuration of the above-mentioned light distribution control ECU 40 and its peripheral elements. That is, in Fig. 4, signals from a direction indicator sensor 51, a steering wheel steering angle sensor 52, a shift position sensor 53, a vehicle speed sensor 54, an accelerator operation sensor 55, a brake operation sensor 56, an illuminance sensor 57, a chromaticity sensor 58, an engine start sensor 59, and a hazard lamp sensor 60 are input to the above-mentioned light distribution control ECU 40. Furthermore, a signal from a camera 61 is input to the ECU 40 via an image processing unit 62, and signals from a GPS receiving unit 63 and a map information output unit 64 are input to the ECU 40 via a calculation unit 65.

[0024] In addition, a control signal from the light distribution control ECU 40 and a signal from the projection signal output unit 110 (a video signal to be projected onto a road surface, etc.) are input to the projector 100 constituting the video projection device via the control unit 120, thereby projecting the video onto a road surface, etc., as described below.

[0025] In addition, signals from a headlight sensor 66 and a high / low sensor 67 are input to the light distribution control ECU 40.

[0026] <Video Projection Device> Next, an example of a more detailed configuration of the video projection device 500 including the projector 100, projection signal output unit 110, and control unit 120 shown in FIG. 4 will be described in detail below with reference to FIG.

[0027] The projection optical system 501 is an optical system that projects an image onto a road surface or the like, and includes lenses and / or mirrors. The display element 502 is an element that generates an image by modulating transmitted or reflected light, and may be, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, or a DMD (Digital Micromirror Device: registered trademark) panel. The display element driver 503 sends a drive signal to the display element 502, causing the display element 502 to generate an image. The light source 505 generates light for image projection, and may be a high-pressure mercury lamp, a xenon lamp, an LED light source, a laser light source, or the like. The power supply 506 supplies power to the light source 505. The power supply 506 also supplies the necessary power to each of the other components. The illumination optical system 504 collects the light generated by the light source 505, makes it more uniform, and irradiates it onto the display element 502. The cooling unit 515 uses air or liquid cooling to cool down components that reach high temperatures, such as the light source 505, power supply 506, and display element 502, as needed. The operation input unit 507 is a light receiving unit for operation buttons or a remote control, and inputs operation signals from the user.

[0028] The video signal input unit 531 connects to an external video output device and inputs video data. The audio signal input unit 533 connects to an external audio output device and inputs audio data. The audio output unit 540 can output audio based on the audio data input to the audio signal input unit 533. The audio output unit 540 may also output built-in operation sounds and error warning sounds. The communication unit 532 connects to, for example, an external information processing device and inputs and outputs various control signals.

[0029] Nonvolatile memory 508 stores various data used in the projector function. The data stored in nonvolatile memory 508 includes image data and video data prepared in advance to be projected onto the road. Memory 509 stores the video data to be projected and control parameters for each part of the device. Control unit 510 controls the operation of each connected part.

[0030] The image adjustment unit 560 performs image processing on the video data input by the video signal input unit 531, the image data stored in the nonvolatile memory 508, and the video data. Examples of this image processing include scaling processing to enlarge, reduce, deform, etc. the image, brightness adjustment processing to change the brightness, contrast adjustment processing to change the contrast curve of the image, and Retinex processing to decompose the image into light components and change the weighting of each component.

[0031] The storage unit 570 records videos, images, audio, various data, etc. For example, videos, images, audio, various data, etc. may be recorded in advance at the time of product shipment, or videos, images, audio, various data, etc. obtained from an external device, an external server, etc. via the communication unit 532 may be recorded. The videos, images, various data, etc. recorded in the storage unit 570 may be output as projected videos via the display element 502 and the projection optical system 501. The audio recorded in the storage unit 570 may be output as audio from the audio output unit 540.

[0032] As described above, various functions can be implemented in the video projection device 500. However, the video projection device 500 does not necessarily have to have all of the above-described configurations. Any configuration is acceptable as long as it has the function of projecting an image.

[0033] Figure 6 shows a ray diagram of a projector, including an image plane. In the figure, image light emitted from a light source such as an LED (not shown) and transmitted through an image display element passes through a filter, undergoes refraction in various lens systems, and is further reflected depending on the configuration before being projected onto an image plane 8 (such as a road surface).

[0034] Thus, with the above-described video projection device 500, the projection distance is 700 mm, and the length of the long side of the range of the projected image is 10061-542=9519≒9520 mm, so the throw ratio is 700 / 9520≒0.07, achieving an unprecedentedly wide angle.

[0035] Although the above description concerns one image projection device 500 and its projection optical system, as mentioned above, the present invention may also be configured so that one or more (a pair of) projectors are mounted on a vehicle (or integrated into a headlight or taillight) to project a desired image onto the road surface, etc. In this case, particularly when multiple (a pair of) image projection devices are used, as shown in Figures 1(A) and 2(A) above, the same image may be projected onto the road surface, etc. from each image projection device (in which case the same image is displayed on the display element 502 in Figure 5), or different images may be projected from the left and right image projection devices and combined on the road surface, etc. (in which case the desired image is split into left and right images and displayed on the display element 502 in Figure 5).

[0036] Furthermore, although the above description has been given of a configuration using a transmissive liquid crystal image display element as an image projection device that projects an image onto a road surface or the like, the present invention is not limited to this, and various other image projection devices can also be used as the image projection device, such as a reflective image projection device consisting of micromirrors such as a DLP (Digital Light Processing) device, or an image projection device that can project image light from a light-modulating planar light-emitting diode via a projection optical system. In other words, the present invention requires only that the image projection device be capable of projecting a desired image onto a road surface or the like.

[0037] <Projection of images onto road surfaces, etc.> Next, the image projection device described in detail above is mounted on the front and / or rear of the vehicle body as described above, and specific examples of various images that are projected onto the road surface, etc. in relation to vehicle information will be described in detail below with reference to Figures 7 to 19.

[0038] FIG. 7 shows an example in which an arrow is projected onto the road surface in front of the vehicle when the direction indicator (also called a blinker or a turn signal) is turned on or flashed when turning right or left while driving the vehicle 10. In this case, based on a signal from the direction indicator sensor 51 shown in FIG. 4, the image projection device projects an arrow 200, which is an image indicating the traveling direction of the vehicle, onto the road surface in front of the vehicle (FIG. 7(A)). At the same time, the image projection device also flashes the arrow 200 projected onto the road surface in front of the vehicle based on the traveling speed of the vehicle input from the vehicle speed sensor 54 and the steering angle of the steering wheel input from the steering wheel angle sensor 52 (FIG. 7(B)). Note that, in this case, the arrow 200 may be linked (synchronized or alternately) with the flashing of the turn signal, or the flashing cycle of the arrow 200 may be variable and set according to the input traveling speed and steering angle of the steering wheel.

[0039] By projecting images onto the road surface, etc., the display method (in this case, flashing and flashing frequency) can be set based not only on the vehicle's direction of travel but also on the vehicle's driving information (in this case, vehicle speed and steering angle), thereby more reliably informing (warning) nearby drivers and pedestrians and ensuring high safety. In this case, when a pair of image projection devices is installed, as in the examples of FIGS. 1(A) and 2(A), the projected images can be combined to display a larger image, further enhancing safety. It is also possible for each device to display different projected images or information on different targets. While the embodiments use arrows, this is not limiting and other shapes indicating directions, text information, etc. may also be used. Furthermore, while the embodiments show an example in which the mark itself is projected, it is also possible to project the surrounding area excluding the mark and display an inverted mark.

[0040] Furthermore, as shown in Fig. 8, the curved state of the arrow may be changed in accordance with the steering operation of the driver. That is, for example, before the driver actually operates the steering wheel, the arrow indicating the vehicle's traveling direction may be a straight arrow 210 (Fig. 8(A)), and when the driver actually operates the steering wheel, the arrow may be a curved arrow 200 (Fig. 8(B)) that corresponds to the steering angle, thereby making it possible to more reliably present vehicle driving information to surrounding drivers and pedestrians.

[0041] Furthermore, in the above figures, the displayed content can be, for example, a danger mark 230 (see FIG. 15(A) below) or a curved approach path 220 (see FIG. 12(B) below) instead of the arrow, and the displayed position can be changed (for example, to a position away from the vehicle depending on the vehicle's speed, or to a position moved in the steering direction). In addition, when turning on / flashing a turn signal for a right / left turn, it is possible to turn on / flash an arrow 200 of the same color as the turn signal, or to change the display position of the mark (arrow 200) for a right / left turn (to the left or right). Furthermore, it is also possible to detect whether the turn signal is on / flashing and, in conjunction with the steering wheel, to display a right / left turn using the arrow 200 when the turn signal is on / flashing.

[0042] 9 shows an example of the display when the steering wheel is operated to park in a garage, in which an arrow 200 indicating the direction of travel is displayed behind the vehicle 10, and a rectangular frame 220 is displayed to indicate the travel range of the vehicle 10. In this case, only the arrow 200 or only the rectangular frame 220 may be displayed, and further, instead of the arrow, a mark 230 (see FIG. 15(A) below) that warns of danger may be displayed depending on the steering angle.

[0043] Such an image projected onto the road surface or the like can more reliably present (warn) surrounding drivers and pedestrians, particularly when parking, thereby ensuring a high level of safety.

[0044] 10 shows an example in which, similar to the above, when the turn signal is turned on / flashing when turning right / left, the distance to the position where the mark (arrow 200) is displayed is changed depending on the distance from the vehicle to the intersection in conjunction with a GPS or navigation system. In this example, if the distance from the vehicle 10 to the intersection is far, the mark (arrow 200) is displayed far away, and as the vehicle approaches the intersection, the display position is moved closer to the vehicle 10, i.e., the display position is set depending on the distance from the vehicle to the intersection.

[0045] In the above example, it is also possible to change the color or shape of the mark (arrow 200) according to the distance to the intersection. For example, as shown in Figures 11(A) to 11(C), the size of the mark (arrow 200) (more specifically, the "L"-shaped arrow 200 for turning right / left) can be gradually increased or the color of the mark (arrow 200) can be changed from blue to yellow to red according to the distance to the intersection. Also, the mark (arrow 200) can be displayed larger or flashed.

[0046] Such projected images onto the road surface, etc., make it easier for surrounding drivers and pedestrians to recognize the direction in which the vehicle is traveling, and also makes it easier for the driver of the vehicle to recognize the route the vehicle should take at an intersection, thereby ensuring greater safety.

[0047] Furthermore, particularly when multiple vehicles are traveling side by side on a relatively wide roadway, as shown in Fig. 12(A), a mark (straight arrow) 210 may be displayed so that it overlaps the road surface of the adjacent lane, or, instead of the arrow, an approach trajectory 220 consisting of multiple (two in this example) parallel diagonal straight lines or curves may be displayed, as shown in Fig. 12(B). In these cases, particularly when changing lanes, it is possible to more reliably make the driver of a following vehicle traveling in an adjacent lane aware of the traveling direction of the vehicle (to issue a warning), thereby ensuring high safety. In this case, if the turn signal is turned on / flashing in conjunction with a lane change, the turn signal's lighting / flashing time is shorter than when turning right or left, so it is expected that the above-mentioned projection display will not be completed in time or the projection time will be too short, but in such cases, the short projection time can be handled by simplifying the processing method up to the projection display (for example, reducing the number of steps) to reduce the time difference, or by continuing the projection display for more than a predetermined time (for example, by not turning off the turn signal). Alternatively, assuming a case where the turn signal command operation is incorrect, the projection display may not be displayed if the turn signal is not turned on / flashing for more than a predetermined time.

[0048] Next, a description will be given below of an image projected onto the road surface or the like using a video signal captured by the camera 61 also shown in FIG. 4 and input to the light distribution control ECU 40 via the image processing unit 62.

[0049] As shown in Figure 13, on the vehicle 10, the camera 61 captures the side area that is in the driver's blind spot (in the figure, the area indicated by the diagonal line on the left side of the vehicle), and when another vehicle 10' traveling behind the vehicle in the adjacent lane that is in the blind spot area is detected, the ECU 40 of the vehicle 10 projects an image 300 of the other vehicle 10' traveling behind the vehicle onto the road surface or the like ahead in the direction of travel, instead of a mark such as the arrow described above.

[0050] By displaying such image 300, the driver can reliably recognize (become aware of) another vehicle 10' traveling behind, which is normally difficult to notice, and this contributes to safe driving, especially when changing lanes.

[0051] Also, as shown in FIG. 14, when the vehicle 10 in a parked state starts moving, an image 310 of the vehicle is projected onto the road surface or the like in the direction in which the vehicle is about to start, thereby more reliably presenting (warning) the image to surrounding drivers and pedestrians, thereby ensuring high safety.

[0052] Furthermore, as shown in Fig. 15, when the vehicle 10 is backing up or when a hazard-linked warning is issued, a mark 230 informing of danger may be projected onto the road surface behind the vehicle (Fig. 15(A)), or the words "backing up" 240 may be projected onto the road surface in front of or behind the vehicle (Fig. 15(B)). By projecting such an image, it is possible to more reliably present (warn) surrounding drivers and pedestrians, particularly when parking, and ensure a high level of safety.

[0053] Also, as shown in FIG. 16, when reversing (backing up) the vehicle 10 to park, a mark 250 (for example, a rectangular red surface) indicating a parking space can be projected and displayed at the position where the vehicle is to be parked, depending on the operation of the steering wheel.

[0054] In addition, it is also possible to change the display content when traveling through a tunnel, on a highway, on an ordinary road, etc. For example, as shown in Fig. 17, since the driver's gaze point changes depending on the traveling speed, a straight arrow 210 is projected at a projection distance set according to the traveling speed of the vehicle 10. For example, at low speeds, it is projected at a short distance (Fig. 17(A)), at medium speeds it is projected at a medium distance (Fig. 17(B)), and at high speeds it is projected at a long distance (Fig. 17(C)).

[0055] Furthermore, as shown in Figure 18, the driver's field of view changes depending on the driving speed (for example, 100 degrees at 40 km / h, 40 degrees at 100 km / h, and becomes narrower as the speed increases), so at low speeds the field of view range becomes wide (shaded area 260 in Figure 18(A)), and so a wide-angle display can be set to match this, and at high speeds the field of view range becomes narrow (shaded area 270 in Figure 18(B)), so so the display can be set to match this.

[0056] Furthermore, when driving in a tunnel, it is possible to display different content than when driving on a highway or an ordinary road. For example, as shown in Fig. 19, the display content (in this example, the color of the straight arrow 210) may be changed (changed color) in synchronization with a sudden change in the brightness of the surrounding light or the lighting of the parking lights inside the tunnel, or it may be possible to intentionally use tunnel lighting to strongly illuminate the mark (arrow 210) in a color that makes it difficult to see inside the tunnel.

[0057] In this case, the light distribution control ECU 40 may appropriately set the color of the straight arrow 210, which is the display content, using signals from the illuminance sensor 57 and chromaticity sensor 58. Furthermore, if the driver does not turn on the headlights while driving through a tunnel, the mode may be switched (specifically, the headlights may be switched on) by detecting changes in external light or the illumination light inside the tunnel. Furthermore, by also using signals from the vehicle speed sensor 54 when driving through a tunnel on a highway, it is possible to detect the average driving speed over a certain period of time and project display content optimal for vehicle driving information while taking this average driving speed into consideration. More specifically, the vehicle is recognized as being on a highway based on the average driving speed over a certain period of time. The display method when driving through a tunnel may be the same as the evening / night display method, for example. Furthermore, since the display mode may return to normal road mode when traffic jams occur even while driving on a highway, it is possible to link with a navigation system or to include a step that confirms whether the vehicle has exited the highway.

[0058] Although various embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments are detailed descriptions of the entire system to clearly explain the present invention, and the present invention is not necessarily limited to a system including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with other configurations.

[0059] Furthermore, the above-described configurations, functions, processing units, processing means, etc. may be partially or entirely implemented in hardware, for example, by designing them as integrated circuits. The above-described configurations, functions, etc. may also be implemented in software, with a processor interpreting and executing a program that implements each function. Information such as the programs, tables, and files that implement each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD.

[0060] Furthermore, the contents of the present invention including the various embodiments described above are summarized below.

[0061] (1) When the turn signal is turned on / flashing when turning right / left, the flashing cycle is variable depending on the speed / steering angle. (2) When the steering wheel is turned to turn right or left, the display content / position changes depending on the steering angle (for example, when the turn signal is activated, a diagonal mark appears, and as the steering angle increases, it changes to an L-shaped mark). (3) When moving the steering wheel to enter a garage or park, the direction of travel will be displayed and the arrow will change according to the steering angle / gear. (4) When the turn signal is turned on / flashing when turning right / left, the projected image is linked (synchronized or alternating) to the lighting / flashing of the turn signal. (5) When turning right or left, the turn signal shall be lit or flashing in the same color as the turn signal. (6) If the turn signal is turned on / flashing when turning right / left, the display position of the mark will change depending on whether you turn right / left. (7) When the steering wheel is moved to turn right / left, the system detects whether the turn signal is on / flashing, and if the turn signal is on / flashing, displays a message indicating a right / left turn (i.e., linked to the turn signal and / or the steering wheel). (8) When the turn signal is turned on / flashing when turning right / left, the system will link with GPS or navigation and change the display distance of the mark depending on the distance to the intersection (for example, if the distance to the intersection is far, the mark will be displayed farther away from the vehicle, and as the intersection gets closer, the mark will be displayed closer to the vehicle). (9) When turning right or left and turning on / flashing the turn signal, the color or shape of the mark will change depending on the distance to the intersection (for example, blue ⇒ yellow ⇒ red, or gradually increase in size). (10) When the turn signal is turned on / flashing for a right / left turn, the right / left turn arrow (e.g., L-shaped) will be displayed large / flashing.

[0062] (11) When the turn signal is turned on / flashing to change lanes, the arrow will not be an L-shape that suggests a right / left turn, but will be a straight arrow displayed diagonally. (12) When the turn signal is turned on / flashing to change lanes, a mark will be displayed diagonally forward to the left and right so that it can be seen by following vehicles. (13) When turning on / flashing the turn signal to change lanes, the vehicle’s trajectory will be displayed instead of an arrow to clarify where the vehicle will enter. (14) When the turn signal is turned on / flashed to change lanes, an image from the camera of the lane to which the driver is about to change is displayed (for example, an image of the side of the lane that is in the driver's blind spot). (15) When the turn signal is turned on / flashing when changing lanes, the turn signal lighting / flashing time is shorter than when turning right or left, so there is a possibility that the projection display will not be completed in time or the projection time will be too short. Therefore, it is necessary to simplify the processing method for the projection display to reduce the time difference or to continue the projection display for more than a specified time. (16) In case of a mistake in the turn signal operation, for example, the projection display will not be performed unless the turn signal is turned on / flashed after a predetermined time. (17) When the steering wheel is moved to park or enter a garage, the average driving speed at a given time is detected, and the L-shaped display for right / left turns is not displayed depending on the detection result (i.e., it is distinguished from the case where the vehicle is decelerating to turn right / left). (18) When moving the steering wheel while parking or entering a garage, an alert will be displayed (for example, moving forward, backward, left, right, or all three directions). (19) When the steering wheel is moved to park or enter a garage, a warning message is displayed in conjunction with the hazard lights.

[0063] (20) When moving the steering wheel to park or put the vehicle into a garage, a warning message will be displayed to nearby pedestrians (mainly when backing up). (21) When the steering wheel is moved to park or enter a garage, the parking area will be illuminated / flashed in red or other colors (parking mode). (22) The display content changes depending on whether the vehicle is traveling through a tunnel, on a highway, or on a regular road. The projection distance of the mark changes depending on the vehicle's speed. (23) The display content changes depending on whether the vehicle is traveling through a tunnel, on a highway, or on a regular road. The driver's viewing angle changes depending on the vehicle's speed, so the display is wide-angle at low speeds and narrow-angle at high speeds. (24) The display content is changed depending on whether the vehicle is traveling through a tunnel, on a highway, or on a regular road. In a tunnel, the display content is changed (color changed) in sync with the lighting of the parking lights. If the driver does not turn on the lights, the system will recognize that the vehicle is traveling through a tunnel by detecting changes in external light or the lighting inside the tunnel. The system will recognize that the vehicle is traveling on a regular road from the average driving speed over a certain period of time. The display method when traveling through a tunnel can be the same as the display method used in the evening / nighttime, for example. Furthermore, since the system will revert to regular road mode if there is congestion even when traveling on a regular road, a step is provided to link with the navigation system or to confirm that the vehicle has exited the regular road. (25) When driving in a tunnel, the lighting in the tunnel should be intentionally set to a strong color that is difficult to see, or a color that is easy to see.

[0064] Also, in relation to (5) above: (26) The timing of turning off the light source is changed between the display mode from the video source input and the display mode while driving, etc. (For example, in the display mode while driving, etc., the video projection device is switched on / off depending on the driving situation, and in the display mode from the video source input, the video projection device is always on.) In the display mode from the video source input, the headlights are turned off and the video projection device is turned on. And in the display mode while driving, etc., both the headlights and the video projection device are turned on. (27) Turn on the light source of the video projection device when necessary and turn it off at other times. (28) The light source can be turned on even when the engine is off, or the image projection device is not activated when the engine is off. (29) When the engine is off, functions are restricted (for example, security and warnings are turned on, and other functions (such as displaying from a video source input) are not performed). (30) When the engine is off, the light source power is set to energy saving mode.

[0065] <Projected image and car behavior> Furthermore, if the vehicle and the projected image move independently, the attention of people viewing the projected image (e.g., pedestrians, other drivers, etc.) will be distracted, making it difficult for them to see the projected image.

[0066] More specifically, for example, when a vehicle is about to turn right or left at an intersection and has to stop temporarily because the traffic light is red, an image including, for example, an arrow indicating the direction in which the vehicle should proceed is projected onto the road surface ahead of the vehicle (at the intersection). At this time, it is effective to display an image such as an arrow indicating the direction in which the vehicle should proceed in order to attract the attention of others (for example, pedestrians, drivers of other vehicles, etc.) who are viewing the projected image.

[0067] However, in this case, if the projected image moves simultaneously as the vehicle starts moving, that is, if both the vehicle and the projected image move, other people viewing the projected image may become confused, and the original purpose may not be achieved. Therefore, in this other embodiment, the projection position of the projected image on the road surface is switched between static and dynamic as appropriate in accordance with the behavior of the vehicle.

[0068] More specific examples are shown in FIGS. 20 and 21. First, FIG. 20 shows a state in which a host vehicle 10 is stopped at an intersection. In this case, an image indicating the direction in which the host vehicle is traveling is projected onto the road surface ahead of the host vehicle. In this example, as is clear from FIGS. 20(A) to 20(C), an arrow 200 indicating the host vehicle's traveling direction (in this example, a right turn) is displayed to encourage pedestrians and drivers of oncoming vehicles to pay more attention to the host vehicle's traveling direction, and the arrow 200 is displayed as a moving image (for example, by flashing the arrow 200) to improve visibility from a distance or in a blind spot. In this case, since the host vehicle is stopped just before the intersection, the projection position of the image on the road surface is stationary. Furthermore, it is preferable that the moving image of the arrow 200 be drawn in a colored light (for example, red) that is easily distinguishable on the road surface.

[0069] FIG. 21 shows a state in which the host vehicle 10 starts at an intersection, enters the intersection, and passes through it. In this case, the position of the arrow 200 projected onto the road surface ahead of the host vehicle remains stationary at the initial display position. That is, in this case, as is clear from FIGS. 20(A) to 20(C), the vehicle 10 moves along the arrow 200 projected onto the road surface, and the arrow 200 is displayed as if the host vehicle 10 is running on the arrow 200. Note that, in these FIGS. 20 and 21, pedestrians, oncoming vehicles, and even crosswalks are omitted for the sake of simplicity.

[0070] 3 and 4, the light distribution control ECU 40 receives signals from, for example, a steering wheel angle sensor 52, a vehicle speed sensor 54, an accelerator operation sensor 55, and the like, and based on these signals, the light distribution control ECU 40 grasps the behavior of the vehicle 10 and calculates the current position of the vehicle 10. Meanwhile, a calculation can be performed to correct the arrow 200 projected onto the road surface ahead of the vehicle so that the arrow 200 remains stationary. By changing and projecting the image generated on the display element 502 shown in FIG. 5 via a display element driver 503, it is possible to realize a display in which the arrow 200 appears stationary and the vehicle 10 moves along the arrow.

[0071] That is, particularly after the host vehicle 10 stops at an intersection or the like and displays its traveling direction using the arrow 200 or the like, the display position of the arrow 200 is not linked to the movement of the host vehicle 10, but rather the position of the host vehicle 10 is grasped using the vehicle speed pulse, the steering angle of the steering wheel, etc., and corrections are made as necessary to keep the display position at the initial display position, thereby making it possible to fix the display position of the image without linking it to the movement of the vehicle (i.e., it becomes possible to fix / move the display position of the image on the road). Note that the fixation trigger may be when the host vehicle 10 changes from a stopped state to a moving state, when the steering wheel begins to be turned (when a predetermined steering angle is detected), or a combination thereof. Furthermore, if the necessary corrections are not made to the image generated on the display element 502, the display position of the image will be linked to the movement of the vehicle. In this way, the light distribution control ECU 40 grasps the behavior of the host vehicle 10 using signals from various sensors, etc., and determines whether to fix / move the display position of the image on the road.

[0072] As described above, the image projected onto the road surface is switched between still and moving in accordance with the behavior of the vehicle, more specifically, the projected image is moved (moving image indicated by arrow 200) when the vehicle is stopped to attract the attention of others (pedestrians, other drivers, etc.). Conversely, when the vehicle is moving (driving), the projected image is made still (the projection position on the road surface is also fixed) to shift attention to the vehicle, thereby avoiding distraction and improving safety.

[0073] In the above-described embodiment, the display of the direction of travel of the host vehicle when the host vehicle is about to turn right or left at an intersection has been described in detail. However, similar implementation is also possible in other cases. For example, as shown in FIG. 9, the present invention can be similarly applied to the display when the steering wheel is operated when parking in a garage. In this case, an arrow 200 indicating the direction of travel is displayed behind the host vehicle 10, and a rectangular frame 220 indicating the travel range of the host vehicle 10 is displayed. However, by displaying the arrow 200 as a moving image, as in the above-described embodiment, it is possible to more reliably present (warn) surrounding drivers and pedestrians and ensure greater safety. Even in this case, even if the host vehicle moves backward, the position of the display including the arrow 200 projected onto the road surface behind the host vehicle remains stationary (fixed) at its initial position.

[0074] As a result, as in the above embodiment, by displaying the arrow 200 as a moving image, it is possible to more reliably draw the attention of surrounding drivers and pedestrians, and it is possible to avoid confusion between the image and the vehicle when the vehicle actually reverses, thereby ensuring greater safety.

[0075] Furthermore, as shown in FIG. 15 above, when the host vehicle 10 is reversing or when a hazard-linked warning is issued, the danger warning mark 230 (FIG. 15(A)) projected onto the road surface behind the vehicle or the "reversing" text 240 (FIG. 15(B)) projected onto the road surface in front of and behind the vehicle can be displayed as a moving image to more reliably warn surrounding drivers and pedestrians. However, in these cases, particularly in the case of FIG. 15(A), the display of the danger warning mark 230 is no longer necessary when the vehicle starts moving, and so it is not displayed. Furthermore, in the case of the "reversing" text 240 shown in FIG. 15(B), the display of the text 240 may move along with the movement of the vehicle during reversing, or alternatively, the display position may be fixed as in the above embodiment. By displaying such an image, it is possible to more reliably present (warn) surrounding drivers and pedestrians, particularly when parking, and ensure high safety. That is, in the above embodiment, arrows are mainly used as the display indicating the vehicle's traveling direction, but the present invention is not limited to this, and other shapes or text information indicating directions may also be used. [Explanation of symbols]

[0076] 10...own vehicle (passenger car), 10'...other vehicle, 11...headlight, 12...window, 13, 13'...tail lamp, 40...light distribution control ECU, 51...turn signal sensor, 52...steering wheel steering angle sensor, 53...shift position sensor, 54...vehicle speed sensor, 55...accelerator operation sensor, 56...brake operation sensor, 57...illuminance sensor, 58...chromaticity sensor, 59...engine start sensor, 60...hazard lamp sensor sensor, 61...camera, 62...image processing unit, 63...GPS receiving unit, 64...map information output unit, 66...headlight sensor, 67...high / low sensor, 100...projector, 110...projection signal output unit, 120...control unit, 500...image projection device, 501...projection optical system, 502...display element, 503...display element driving unit, 504...illumination optical system, 505...light source, 531...video signal input unit, 533...audio signal input unit, 532...communication unit.

Claims

1. A vehicle, an acquisition unit capable of acquiring information about the vehicle; an image projection unit capable of projecting an image based on the information acquired by the acquisition unit, When the vehicle is traveling on a roadway having a plurality of lanes, the image projection unit projects an image showing a predicted traveling path of the vehicle, When the vehicle changes course, there are a first state in which a course change image showing the course change of the vehicle is projected when a predetermined time has elapsed since the turn signal of the vehicle was turned on, and a second state in which the course change image is not projected when a predetermined time has elapsed since the turn signal of the vehicle was turned on. vehicle.

2. 2. The vehicle according to claim 1, When the vehicle enters a lane adjacent to the lane on which the vehicle is traveling, the image projection unit projects the lane change image onto a vehicle traveling in a lane adjacent to the lane on which the vehicle is traveling. vehicle.

3. 3. The vehicle according to claim 2, The lane change image is an image showing that the vehicle is traveling from the lane in which the vehicle is traveling to another lane. vehicle.

4. 2. The vehicle according to claim 1, the image projection unit continues projection for a predetermined time or more when the vehicle enters a lane adjacent to the lane in which the vehicle is traveling, even if a turn signal of the vehicle is turned off; vehicle.

5. 2. The vehicle according to claim 1, the image projection unit does not project the lane change image when the direction indicator of the vehicle is not lit or flashing for a predetermined time or longer. vehicle.

6. 2. The vehicle according to claim 1, When the vehicle enters a lane adjacent to the lane on which the vehicle is traveling, the image projection unit projects an image of a straight line or a curve representing a path of travel of the vehicle onto a road surface of the lane adjacent to the lane on which the vehicle is traveling. vehicle.

7. 2. The vehicle according to claim 1, The image is a mark indicating a predicted driving route of the vehicle. vehicle.

Images