Road surface projection device

The road surface projection device adjusts projection based on road surface conditions to prevent dazzling and ensure safe driving, particularly on uneven surfaces, while maintaining information communication and achieving power savings.

JP2024156244APending Publication Date: 2024-11-06NIPPON SEIKI CO LTD

Patent Information

Application Number
JP2023070543
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-24
Publication Date
2024-11-06

AI Technical Summary

Technical Problem

Existing road surface projection devices fail to consider road surface conditions, leading to reduced visibility and safety hazards when projecting information on downhill slopes or downward steps, particularly when pedestrians are present.

Method used

A road surface projection device that adjusts the projection form based on the flatness of the road surface, stopping or reducing visibility of projections on uneven surfaces to prevent dazzling and ensure safe driving.

Benefits of technology

Enhances driving safety by avoiding direct projection onto pedestrians on downhill slopes or steps while maintaining necessary information communication, and achieves power savings by adapting projection to road conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024156244000001_ABST
    Figure 2024156244000001_ABST
Patent Text Reader

Abstract

To perform safe drive support by altering projection form of information by considering road surface situation.SOLUTION: In a road surface projection device which projects a picture image on road surface, it includes a projection part 17 which projects a picture image on projection surface of the road surface which exists within prescribed distance from a vehicle and a projection control part 16 which controls the projection of the picture image. The projection control part 17 controls so as to project the picture image on the projection surface in different aspect (for example, aspect that performs the projection by normal visibility and aspect that performs the projection by stopping the projection or deteriorating the visibility) by depending on whether not or the projection surface is flatness.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a road surface projection device mounted on a moving object such as a vehicle. [Background technology]

[0002] 2. Description of the Related Art Road surface projection devices are known that project information necessary for traffic on the road surface to clearly communicate it to the driver and encourage the driver to take action appropriate to the situation, such as lane guidance.

[0003] For example, Patent Document 1 describes an image projection device that projects and displays information about a vehicle, such as the vehicle's driving state, onto a road surface or a wall surface. Patent Document 2 describes a projection device for a moving body that, when automatically parking a vehicle in a parking space, projects a driving trajectory onto a road surface within a predetermined distance from the vehicle, thereby presenting an appropriate place to watch over the vehicle to the vehicle owner. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2021-167197 A [Patent Document 2] JP 2020-083301 A Summary of the Invention [Problem to be solved by the invention]

[0005] According to the technology described in the above-mentioned Patent Documents 1 and 2, it is possible to encourage drivers or pedestrians to take action according to the situation by projecting necessary information on the road surface, which is useful for smooth traffic flow and safety measures. However, since the projection of information continues regardless of the road surface conditions, visibility decreases when the projection surface has a downhill slope or a step.

[0006] Therefore, the inventors recognized that when there is a pedestrian on a downhill slope or in a place with a downward step, there is a problem in terms of driving safety, in that the driver may be dazzled by looking directly at the pedestrian, creating a danger.

[0007] Patent Documents 1 and 2 make no mention of this problem, nor do they suggest any countermeasures.

[0008] The present invention has been made to solve the above-mentioned problems, and aims to provide a road surface projection device that enables safer driving assistance by changing the form in which information is projected taking into account road surface conditions.

[0009] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings. [Means for solving the problem]

[0010] In order to facilitate an understanding of the outline of the present invention, embodiments according to the present invention will be exemplified below.

[0011] In a first aspect, a road surface projection device that projects an image onto a road surface has a projection unit that projects the image onto a projection surface of the road surface within a predetermined distance from a vehicle, and a projection control unit that controls the projection of the image, and the projection control unit controls the image to be projected onto the projection surface in different manners depending on whether the projection surface is flat or not.

[0012] In the first mode, the projection control unit controls so that the image is projected on the projection surface in different modes depending on whether the projection surface of the road surface within a predetermined distance from the vehicle is flat or not. Here, the "road surface within a predetermined distance" refers to the surface of the roadway located on the left and right sides of the vehicle, for example, within a lane width of 3.0 to 3.5 m from the side of the vehicle, and depends on the projection distance, resolution, and other performance of the projection unit (for example, projector) of the road surface projection device. The same applies to road surfaces located in front of and behind the vehicle.

[0013] Also, a "projection surface" refers to the surface on which a shadow is cast when projected light is shone from a certain direction. For example, if you think of an image (solid figure) as a set, you can take one point of it and look through it onto a plane (road surface) placed in front of you, and you can mark the corresponding point on the road surface. In the same way, if you project each point of the image one after another, you will obtain the corresponding image (solid figure) on the road surface. This type of operation is called projection, and the road surface (plane) is called the projection surface.

[0014] In addition, "flat" means that the road surface is flat, in other words, that there are no bumps or height differences on the projection surface of the road surface, which is the plane onto which the image is projected.Here, it is considered to be "not flat" when there is a predetermined amount of gradient or step (exceeding the gradient threshold or step threshold) on the projection surface, and it is considered to be "flat" when there is no predetermined amount of gradient or step.

[0015] Additionally, "projecting in different manners" refers to projecting in different projection forms depending on whether the projection surface is flat or not. For example, there is a projection form in which an image is projected with normal visibility or eye-catchingness, and a projection form in which image projection is stopped or the image is projected with reduced visibility or eye-catchingness compared to normal projection.

[0016] Here, visibility refers to the degree to which an image is easy to recognize when viewed with the eyes, and something that can be recognized with an instantaneous judgment is said to have high visibility, while something that is difficult to recognize is said to have low visibility. Also, conspicuousness refers to the degree to which an image attracts the attention of pedestrians who are not aware of their surroundings, or makes it easier for them to find it. For example, warm colors such as red, orange, and yellow are said to have high conspicuousness, while cool colors such as blue, green, and purple are said to have low conspicuousness.

[0017] According to the first aspect, the projection control unit controls the projection of the image on the projection surface in different ways depending on whether the projection surface is flat, thereby enabling the projection of information (images) taking into consideration the road surface conditions of the road surface that is the projection surface. This makes it possible to project information necessary for traffic onto the road surface and clearly communicate it to the driver or pedestrian, thereby encouraging them to take action according to the scene. In particular, it is possible to provide a road surface projection device that avoids driving dangers caused by the driver looking directly at pedestrians even when the pedestrians are on a downhill or step-down road surface.

[0018] In a second aspect dependent on the first aspect, when the projection surface is not flat, the projection control unit controls to stop projecting the image onto the projection surface or to project the image with reduced visibility compared to when the projection surface is flat.

[0019] In the second aspect, when the projection surface is not flat, the projection control unit stops projecting the image onto the projection surface or controls the projection with lower visibility than when the projection surface is flat. Visibility is the brightness (unit: lux) per unit area of ​​the projection surface of the light source, and the level of visibility can be controlled by, for example, illuminance.

[0020] According to the second aspect, it becomes possible to project information (images) taking into account the road surface conditions on the projection surface, which not only avoids the danger of driving caused by pedestrians looking directly at the projection surface, but also saves power by stopping the projection of the image onto the projection surface when the projection surface is not flat, or by projecting the image with reduced visibility compared to when the projection surface is flat, compared to continuously projecting images regardless of the road surface conditions.

[0021] In a third aspect dependent on the second aspect, the projection control unit performs control to stop the projection of the image when the vertical or horizontal width of the projected image exceeds the distance required for the projection light projected by the projection unit to reach the road surface, within the projection range determined by the vertical distance from the mounting position of the projection unit on the vehicle to the ground plane of the vehicle and the projection angle of the image, and the projection surface is not present at that location.

[0022] Here, the "projectable range" refers to the maximum reach of the light projected by the projection unit onto the road surface, in other words, the maximum image size that can be projected when an image is projected onto the road surface. Here, the size of the image refers to at least one of the width along an axis parallel to the X-axis and the width along an axis parallel to the Y-axis, and the projection control unit controls the projection unit to project the generated image onto at least a part of this projectable range.

[0023] According to the third aspect, the projection control unit stops the projection of the image when the vertical or horizontal width of the projected image exceeds the distance the projection light projected by the projection unit reaches the road surface. In other words, the projection control unit controls the projection of the image to stop when there is no projection surface in a location within the projectable range where the length of the base (the vertical or horizontal width of the projected image) exceeds the length of the oblique side (the distance the projection light reaches the road surface). This makes it possible to achieve a further power saving effect compared to a case where the projection is controlled to be performed with reduced visibility.

[0024] In a fourth aspect dependent on the second aspect, a road surface monitoring unit is provided which monitors changes in the gradient or shape of the projection surface, and when a change in the gradient or shape of the projection surface is predicted or detected to cause the projection surface to become a downward gradient or a downward step, the projection surface is determined to be not flat, and control is performed to stop projecting the image onto the projection surface or to project the image with reduced visibility compared to when the projection surface is flat.

[0025] Here, "gradient" refers to the degree of inclination at which the height of the road surface changes continuously, and "downward gradient" refers to a downward road gradient equal to or greater than a gradient threshold that affects a decrease in visibility. The gradient threshold is expressed, for example, as a gradient rate or angle. The gradient threshold is determined depending on the performance of the projection unit of the road surface projection device, such as the projection distance and resolution.

[0026] In addition, a "downward step" refers to a location where one road surface and the next road surface on the road surface are connected by a vertical surface of a predetermined height or more or a slope of a predetermined angle or more, and refers to a location that has a height difference of more than the step threshold with respect to the surrounding height. For example, when the difference in height between multiple measurement points on the road surface measured by a distance image sensor or the like is more than the step threshold, it can be determined that a height difference of more than the step threshold exists.

[0027] According to the fourth aspect, when the projection control unit predicts or detects that the projection surface is a downward slope or a step, it determines that the projection surface is not flat and stops projecting an image onto the projection surface, or controls the projection to be performed with lower visibility than when the projection surface is flat. This makes it possible to project information (images) that takes into account the road surface conditions of the projection surface, and even if there is a pedestrian or the like on a road surface that is a downward slope or a step, it is possible to avoid driving hazards caused by dazzling pedestrians who look directly at the pedestrian. In addition, when the projection surface is not flat, by stopping the projection of the image onto the projection surface or projecting the image with lower visibility than when the projection surface is flat, it is possible to save power compared to the case where the projection of the image is always continued regardless of the road surface conditions.

[0028] In a fifth aspect which is dependent on the second aspect, the vehicle has a road surface monitoring unit which monitors changes in the gradient or shape of the projection surface in front of or behind the vehicle, and when the projection control unit predicts that the projection surface will become a downhill slope or a downward step due to a change in gradient or shape of the projection surface, the projection control unit performs control to stop projection of the image onto the projection surface or to project the image with reduced visibility before the projection surface becomes the downhill slope or downward step.

[0029] Here, in order to predict that the projection surface will be a downhill slope or a step-down, the projection control unit can use, for example, gradient information of the road surface ahead of the vehicle on a map, road surface shape information ahead of the vehicle detected by a camera, a distance image sensor, etc. For example, by referring to a map and based on distance measurement data analyzed by a camera or a distance image sensor, it is possible to predict that there is a downhill slope or a step-down in the traveling direction of the vehicle, and based on this, it is possible to perform control to stop the projection of the image or to reduce visibility.

[0030] According to the fifth aspect, when it is predicted that the projection surface will be a downhill slope or a step, control is performed to stop the projection of the image onto the projection surface or to project the image with lower visibility than usual before the projection surface becomes a downhill slope or a step. Therefore, even if the road surface is a downhill slope or a step, control is performed to stop the projection or to lower the visibility of the projected image before passing the bending point, so that it is possible to prevent pedestrians walking on the downhill slope or step facing the vehicle from being dazzled by looking directly at the highly illuminating projected light. The same applies to occupants of vehicles traveling in the opposite direction.

[0031] A sixth aspect dependent on the second aspect is such that, when the projection control unit predicts or detects that the projection surface will become a downhill slope or a downward step due to a change in slope or shape of the projection surface, the projection control unit controls to stop projection of a portion of the images projected onto the projection surface that is projected at a location away from the vehicle or to project the images with reduced visibility.

[0032] According to the sixth aspect, when the projection control unit predicts or detects that the projection surface will be a downhill slope or a step, the projection control unit stops the projection of a part of the image projected at a location away from the vehicle or reduces the visibility and projects the image. In this way, by controlling the projection of a part of the image to be projected at a location away from the vehicle by stopping the projection or reducing the visibility, it is possible to prevent the projection light from directly entering the eyes of passengers of a following or oncoming vehicle, etc., from being dazzled, while still allowing the projection to continue at least in part, so that the projected image can be viewed, even if it is incomplete.

[0033] In a seventh aspect dependent on the fourth to sixth aspects, the projection unit includes a first projection unit that projects the image onto a first projection surface of the road surface located on the left side of the vehicle, and a second projection unit that projects the image onto a second projection surface of the road surface located on the right side of the vehicle, and when the projection control unit predicts or detects that either the first projection surface or the second projection surface will have a downward slope or a downward step, (1) stops the projection of the image onto one of the first projection surface or the second projection surface. In this case, the projection of the image onto the other projection surface is continued, (2) when the projection of the image onto the one projection surface is stopped, control is performed to project the image onto the other projection surface with reduced visibility, or (3) when the visibility of the image onto the one projection surface is reduced, control is performed to reduce the visibility of the image to be projected onto the other projection surface and, at this time, to project the image with the visibility of the image on the other projection surface higher than the visibility of the image on the one projection surface.

[0034] According to the seventh aspect, when the projection control unit is mounted on the right and left sides of the vehicle, even if the projection to one side is stopped depending on the road surface conditions on the right or left side of the vehicle, the projection control unit can maintain the projection to the other side. Therefore, even if there is a pedestrian on a downhill or descending road surface, the driver can avoid the driving danger caused by looking directly at the pedestrian, and the information necessary for traffic is projected and clearly communicated to the pedestrian, enabling the driver to take action according to the scene.

[0035] In an eighth aspect that is dependent on the fourth to sixth aspects, the projection unit includes a third projection unit that projects the image onto a third projection surface of the road surface located in front of the vehicle, and a fourth projection unit that projects the image onto a fourth projection surface of the road surface located behind the vehicle, and when the projection control unit predicts or detects that either the third projection surface or the fourth projection surface will have a downward slope or a downward step, it performs one of the following controls: (1) when the projection of the image onto one of the projection surfaces is stopped, the projection of the image onto the other projection surface is continued, (2) when the projection of the image onto one of the projection surfaces is stopped, the projection of the image onto the other projection surface is controlled to be reduced in visibility, or (3) when the visibility of the image onto one of the projection surfaces is reduced, the visibility of the image projected onto the other projection surface is reduced, and at this time, the visibility of the image onto the other projection surface is controlled to be higher than the visibility of the image onto the one projection surface to project the image.

[0036] According to the eighth aspect, when projection units are mounted on the front and rear of a vehicle, the projection control unit can maintain projection on one side even when stopping projection on the other side depending on the road surface conditions in front or rear of the vehicle. This makes it possible to project information necessary for traffic and clearly communicate it to vehicle occupants or pedestrians, etc., in a following or oncoming vehicle, while avoiding dazzlement caused by looking directly at the projected light, thereby enabling a call to action according to the scene.

[0037] Those skilled in the art will easily understand that the exemplified embodiments according to the present invention can be further modified without departing from the spirit of the present invention. [Brief description of the drawings]

[0038] [Figure 1] FIG. 1 is a block diagram showing the configuration of a road surface projection system using a road surface projection device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a flowchart showing the basic operation of the road surface projection device according to the embodiment of the present invention. [Diagram 3] FIG. 3 is a flowchart showing the operation of the road surface projection device according to the embodiment of the present invention when the vehicle has projection units on the left and right sides. [Figure 4] FIG. 4 is a diagram cited to explain the operation of a road surface projection device according to an embodiment of the present invention, in which FIG. 4(a) shows an example of a form in which an image is projected onto the left and right sides (left and right) of a vehicle, and FIG. 4(b) shows an example of a projection pattern of that image. [Diagram 5] Figure 5 is a diagram cited to explain the operation of a road surface projection device in an embodiment of the present invention, where Figure 5(a) shows a front view of the projection form when there are projection units on the left and right sides of a vehicle and there is a downward slope or a downward step on one side, Figure 5(b) shows the range that the projection light reaches on the road surface in that case, and Figure 5(c) is a top view of the projection form when there is a downward slope or a downward step on one side. [Figure 6] Figure 6 is a diagram cited to explain the operation of a road surface projection device in an embodiment of the present invention, where Figure 6(a) shows an example of the projection form on a flat road surface when the projection unit is located in front of the vehicle, Figure 6(b) shows an example of the projection form on a downward slope when the projection unit is located in front of the vehicle, and Figure 6(c) shows an example of the projection form when the projection unit is located both in front and behind the vehicle, where one side has a flat road surface and the other has a downward slope. [Figure 7] FIG. 7 is a diagram cited for explaining the operation of the road surface projection device according to the embodiment of the present invention, and is a diagram showing a graph of the projection possible range. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0039] The best mode described below is used to easily understand the present invention. Therefore, those skilled in the art should be aware that the present invention is not unduly limited by the mode described below (hereinafter, referred to as the present mode).

[0040] (Configuration of the embodiment) Please refer to Fig. 1. Fig. 1 is a block diagram showing the configuration of a road surface projection system 10 using a road surface projection device according to this embodiment.

[0041] As shown in FIG. 1, the road surface projection system 10 includes a vehicle control unit 15, a projection control unit 16, and a projection unit 17.

[0042] The vehicle control unit 15 analyzes information based on signals from sensors (such as the behavior sensor 14 described later) mounted in various parts of the vehicle, and mainly controls torque adjustment from the engine (drive system), brake operation (braking system), and steering operation (steering system) when the vehicle starts, stops, turns, etc.

[0043] The vehicle control unit 15 includes a main control unit 150 and a road surface monitoring unit 151.

[0044] The main control unit 150 acquires information from, for example, a map 11 (a database storing map information), a camera 12, a distance image sensor 13, a behavior sensor 14, etc., which are connected via a control communication bus 20 (CAN: Control Area Network), and controls the vehicle's drive system, braking system, and steering system. The main control unit 150 also communicates with the projection control unit 16.

[0045] The road surface monitoring unit 151 monitors changes in the gradient or shape of the road surface within a predetermined distance from the vehicle. Here, the "road surface within a predetermined distance from the vehicle" refers to the surface of the roadway within a lane width range of 3.0 to 3.5 m, for example, and can be determined by the projection distance, resolution, and other performance of the projection unit (projector) of the road surface projection device. Also, the "projection surface" is the road surface on which a shadow is projected when projection light is applied from a certain direction.

[0046] Furthermore, the term "gradient" refers to the degree of inclination at which the height of the road surface changes continuously, and "downward gradient" refers to a downward road gradient equal to or greater than a gradient threshold value that adversely affects visibility. The gradient threshold value is expressed, for example, as a gradient rate or angle. The gradient threshold value is also determined depending on the performance of the projection unit 17, which is a projector, such as the projection distance and resolution.

[0047] In addition, a "downward step" refers to a location where one road surface and the next road surface are connected by a vertical surface of a predetermined height or more or a slope of a predetermined angle or more, and refers to a location that has a height difference of more than the step threshold with respect to the surrounding height. For example, when the difference in height between multiple measurement points on the road surface measured by the distance image sensor 13 is more than the step threshold, it can be determined that a height difference of more than the step threshold exists.

[0048] The change in the gradient or shape of the road surface that becomes the projection surface can be detected by the road surface monitoring unit 151, for example, from a distance image acquired by the distance image sensor 13. Here, the distance image is an image configured by the distance to the road surface, and the distance image sensor 13 measures the distance to the road surface in a non-contact manner, for example, by using infrared rays. Specifically, the light of a built-in infrared LED (Light Emitting Diode) is irradiated onto the road surface, and the time it takes for the light to be reflected and returned is measured to obtain the distance, and specifically, LiDAR (Light Detection And Ranging), millimeter waves, ultrasonic waves, stereo cameras, etc. are used.

[0049] The road surface monitoring unit 151, for example, converts the input distance image into a corresponding three-dimensional data group, samples three or more points of three-dimensional data from the three-dimensional data group, calculates a plurality of plane parameters that indicate one plane determined by the three-dimensional data, weights the plane parameters in a voting space with weights according to the reliability of the three-dimensional data, and performs image processing to detect a plane (flat) based on the voting result. Furthermore, by using two cameras 12, road surface recognition using plane detection by the above-mentioned image processing becomes possible, and it becomes possible to detect a downward gradient or a downward step (see JP-A-2003-271975 and JP-A-2007-124866).

[0050] Changes in the gradient or shape of the road surface within a predetermined distance from the vehicle, which are monitored by the road surface monitoring unit 151, are transferred as road surface information to the projection control unit 16 via the main control unit 150 and the control communication bus 20.

[0051] The projection control unit 16 controls the projection of the image on the projection surface in a different manner depending on whether the projection surface is flat or not. For example, if the projection surface is not flat, the projection control unit 16 controls the projection of the image on the projection surface to be stopped or to project the image with reduced visibility or attention compared to when the projection surface is flat.

[0052] Here, "flat" means that the road surface is flat, in other words, that the projection surface on the road surface, which is the plane on which the image is projected, is free of unevenness or height differences. Here, the projection surface is considered to be non-flat when it has a certain amount of gradient or step, and is considered to be flat when it does not have a certain amount of gradient or step. Also, "projecting in different manners" means projecting in different projection forms when the projection surface is flat and when it is not flat. For example, there is a projection form that projects an image with normal visibility or attractiveness, and a projection form that stops image projection or projects with reduced visibility or attractiveness compared to normal projection.

[0053] Visibility refers to the degree to which an image is easy to recognize when viewed with the eyes. High visibility refers to something that can be recognized with an instantaneous judgment, while low visibility refers to something that is difficult to recognize. Conspicuousness refers to the degree to which an image attracts the attention of pedestrians who are not aware of their surroundings, making them pay attention to it or make it easier for them to find it. For example, warm colors such as red, orange, and yellow are considered to have high conspicuousness, while cool colors such as blue, green, and purple are considered to have low conspicuousness. For example, red and yellow are used on traffic signs to indicate danger because the colors attract attention without the conscious effort of the user.

[0054] For this reason, the projection control unit 16 includes a main control unit 160 , an image generation unit 161 , and an image recognition unit 162 .

[0055] If the main control unit 160 determines that the projection surface is not flat (for example, if the projection surface has a downward slope or a downward step) based on the road surface information of the projection surface monitored by the road surface monitoring unit 151 transferred from the vehicle control unit 15, the main control unit 160 controls the projection of the image onto the projection surface to be stopped or to be projected with reduced visibility, etc., compared to when the projection surface is flat.

[0056] For this reason, the image generating unit 161 is configured to be capable of generating, for example, an image (projected image 4) shown in FIG. 4(b) described later so that the image is projected onto a part of the projectable range. Here, the projectable range refers to the maximum reach of the projection light projected onto the road surface by the projection unit 17, in other words, the maximum image size that can be projected when an image is projected onto the road surface. Here, the image size refers to at least one of the width along an axis parallel to the X-axis and the width along an axis parallel to the Y-axis, and the projection control unit 16 controls the projection unit 17 so as to project the generated image (projected image 4) onto at least a part of this projectable range.

[0057] An example image (projected image 4) shown in Figure 4(b) detects that the vehicle is changing direction based on information from a navigation device, turn indicators, etc. (not shown), and accordingly notifies pedestrians outside the vehicle that the vehicle is changing direction, encouraging them to take action.

[0058] As another example of an image projected onto the road surface, for example, as shown in Figure 8 of Chinese Patent CN111237719, a carpet image may be displayed on the road surface between the entrance and the user by detecting the approach of a user carrying a key using keyless entry. Here, the carpet image expands and contracts depending on the distance from the user.

[0059] In addition, the projection control unit 16 may perform control to stop the projection of the image when the vertical or horizontal width of the projected image, within the projection range determined by the vertical distance from the mounting position of the projection unit 17 on the vehicle to the ground plane of the vehicle and the projection angle of the image, exceeds the distance required for the projection light projected by the projection unit 17 to reach the road surface and there is no projection surface at that location.

[0060] At this time, the projection control unit 16 recognizes the vertical or horizontal width of the projected image and the distance that the projection light projected by the projection unit 17 reaches the road surface by the image recognition unit 162 recognizing the image projected on the projection surface based on the distance image detected by the camera 12 or the distance image sensor 13. Then, when the vertical or horizontal width of the projected image recognized by the image recognition unit 162 exceeds the distance that the projection light reaches the road surface and there is no projection surface at that location, the main control unit 160 controls to stop the projection of the image. Details will be described later.

[0061] Furthermore, when the projection control unit 16 predicts or detects that the projection surface will become a downward slope or a step due to a change in slope or shape of the projection surface, it determines that the projection surface is not flat and performs control to stop the projection of an image onto the projection surface or to project with reduced visibility compared to when the projection surface is flat. Furthermore, when the projection control unit 16 predicts that the projection surface will become a downward slope or a step due to a change in slope or shape of the projection surface, it may perform control to stop the projection of an image onto the projection surface or to project with reduced visibility before the projection surface becomes the downward slope or step.

[0062] Here, in order to predict that the projection surface will be a downhill slope or a step-down, the projection control unit 16 can use road surface gradient information in the vehicle's traveling direction on the map 11, road surface shape information in the vehicle's traveling direction detected by the camera 12, the distance image sensor 13, etc. For example, by referring to the map 11 and positioning information by a GPS (Global Positioning System) (not shown), and based on data analyzed by the camera 12 and the distance image sensor 13, it can predict that there is a downhill slope or a step-down in the vehicle's traveling direction, and based on this, it can perform control to stop the projection of the image or reduce visibility.

[0063] Furthermore, when the projection control unit 16 predicts or detects that the projection surface will become a downhill slope or a downward step due to a change in slope or shape of the projection surface, the projection control unit 16 may perform control to stop the projection of some of the images projected onto the projection surface at a location away from the vehicle or to project them with reduced visibility.

[0064] The projection unit 17 is a projector that projects the image generated by the image generation unit 161 onto a projection surface on the road surface under the control of the projection control unit 16, and includes a light source unit 171, a light modulation unit 172, and a projection optical system 173.

[0065] The projection unit 17 is attached to a position where it can project an image onto a road surface within a predetermined distance from the vehicle. For example, by attaching it to the four corners of the roof of the vehicle, it is possible to project a desired image to the front, rear, left and right of the vehicle. In this case, four projection units 17 (F, R, Le, Ri) are attached to corresponding positions. Also, it is not limited to the roof, but may be attached to the four corners of the vehicle body or the bottom surface of the vehicle body. Also, by attaching it to the center of the front bumper and the center of the rear bumper, it is possible to project a desired image to the front and rear of the vehicle, and by attaching it near the door mirror or door, it is possible to project a desired image to the left or right side of the vehicle, or both.

[0066] The light source unit 171 includes a light source lamp such as a mercury lamp, or a solid-state light source such as an LED. The light source unit 171 is configured to be able to emit light including at least red light, green light, and blue light, and may include a light source lamp that emits white light, or a plurality of LEDs that emit light of various colors. The light emitted from the light source unit 171 is incident on the light modulation unit 172.

[0067] The light source unit 171 has a dimming function that can adjust the brightness of the projection light in stages, and the brightness is controlled by the projection control unit 16.

[0068] The light modulation unit 172 may be, for example, a digital mirror device (DMD) including a liquid crystal panel and a driving circuit for driving the liquid crystal panel, and including micromirrors arranged for each pixel. Such light modulation unit 172 can form an image to be projected based on image information.

[0069] The projection optical system 173 includes a projection lens that enlarges and projects the projection image formed by the light modulation unit 172 onto a projection surface. The projection optical system 173 includes a barrel and a lens group housed in the barrel. The projection image formed by the light modulation unit 172 is projected onto a projection surface of the road surface through the projection optical system 173.

[0070] (Operation of the embodiment) Please refer to Fig. 2. Fig. 2 is a flowchart showing the basic operation of the road surface projection device according to this embodiment. Below, the basic operation of the road surface projection device according to this embodiment shown in Fig. 2 will be explained with reference to Figs. 4 to 7.

[0071] Figures 4 to 7 are figures cited to explain the operation of the road surface projection device of this embodiment, where Figure 4(a) shows an example of a form in which an image is projected onto the left and right sides (left and right) of a vehicle, and Figure 4(b) shows an example of a projection pattern of that image (projected image 4).

[0072] Moreover, Figure 5(a) shows a front view of the projection shape when the vehicle has projection units on the left and right sides (left and right) and there is a downward gradient (downhill) or a downward step on one side, Figure 5(b) shows with symbols the range in which the projection light reaches the road surface in this case, and Figure 5(c) shows a top view of the projection shape when there is a downward gradient or a downward step on one side.

[0073] In addition, Figure 6(a) shows an example of the projection shape on a flat road surface when there is a projection unit at the front of the vehicle, Figure 6(b) shows an example of the road surface projection shape on a downward slope, and Figure 6(c) shows an example of the projection shape when there are projection units at both the front and rear of the vehicle, one of which is a flat road surface and the other has a predetermined amount of downward slope.

[0074] FIG. 7 is a graph showing the projection range, which is the maximum reachable range of light projected onto the road surface by projection unit 17.

[0075] 2, in the road surface projection device according to this embodiment, first, the projection control unit 16 (main control unit 160) acquires road surface information of the projection surface from the road surface monitoring unit 151 of the vehicle control unit 15 via the main control unit 150 and the control communication bus 20 (step S101). Here, the projection surface refers to the road surface 2 (projection surface 3) within a predetermined distance range (for example, one lane width) from the side of the vehicle 1, for example, as shown in FIG. 4(a), and the road surface information is information indicating changes in the gradient or shape of the projection surface 3 output from the road surface monitoring unit 151.

[0076] Next, the main control unit 160 of the projection control unit 16 judges whether the projection surface 3 is flat or not based on the road surface information of the projection surface 3 output from the road surface monitoring unit 151 (step S102). If it is judged to be flat (step S102 "YES"), the main control unit 160 outputs an image generated by the image generating unit 161, for example, an example of which is shown in FIG. 4(b), to the projection unit 17, and controls the generated image to be projected on the road surface 2, which becomes the projection surface 3, with normal illuminance set as default (step S103).

[0077] In the projection unit 17, when the projection light emitted from the light source unit 171 is incident on the light modulation unit 172, the light modulation unit 172 forms the projection image 4 to be projected based on the image generated and output by the image generation unit 161 of the projection control unit 16. Then, the projection optical system 173 enlarges and projects the projection image 4 formed by the light modulation unit 172 onto the projection surface 3.

[0078] On the other hand, if the main control unit 160 of the projection control unit 16 predicts or detects that the projection surface 3 is not flat (step S102 "NO") and that a change in the gradient or shape of the projection surface 3 will cause the projection surface 3 to have a downward gradient (downhill) exceeding the gradient threshold value, or a downward step exceeding the step threshold value (step S104 "YES"), it determines whether this is something predicted or detected on the side of the vehicle (step S105).

[0079] Here, for example, as shown in Figures 5(a), (b), and (c), when a downward gradient (downhill) exceeding the gradient threshold or a downward step exceeding the step threshold is predicted or detected (step S105 "YES") on one of the road surfaces that serves as the projection surface 3 (here, the triangular area shown by the dashed line on the left side 2a or 2b when facing the front of the vehicle 1), the main control unit 160 controls the projection unit 17 to stop projecting the image generated by the image generation unit 161 or to project it with a lower illuminance (reducing visibility) than usual (step S106).

[0080] Here, prediction or detection of a downhill slope or a step that exceeds the gradient threshold can use gradient information of the road surface ahead of the vehicle in the map 11, changes in the road surface shape detected by the camera 12, the distance image sensor 13, etc. For example, by referring to the map 11 and based on data analyzed by the camera 12 and the distance image sensor 13, it is possible to predict or detect the presence of a downhill slope or a step that exceeds the gradient threshold or step threshold. The projection control unit 16 can perform control to stop the projection of the image or to reduce visibility by illuminance when it predicts or detects a sudden change (exceeding the gradient threshold or step threshold) in the gradient or shape of the road surface.

[0081] When the projection control unit 16 performs control to reduce visibility, the projection unit 17 controls the light source unit 171 under the control of the projection control unit 16 to adjust the brightness of the projection light (reduce the illuminance), and causes the light emitted from the light source unit 171 to enter the light modulation unit 134. As a result, the light modulation unit 172 forms the projection image 4 to be projected based on the image generated and output by the image generation unit 161 of the projection control unit 16. Then, the projection optical system 173 enlarges and projects the projection image 4 formed by the light modulation unit 172 onto the projection surface 3.

[0082] In this way, the projection control unit 16 controls the projection of the image on the projection surface in different ways depending on whether the projection surface is flat or not, thereby making it possible to project information (images) taking into consideration the road surface conditions of the projection surface. This makes it possible to project information necessary for traffic onto the road surface 2 and clearly communicate it to the driver or pedestrian, thereby encouraging them to take action according to the situation. In particular, it is possible to provide a road surface projection device that avoids the danger of the driver looking directly at pedestrians even when the pedestrians are on a downhill or step-down road surface.

[0083] In addition, when the projection surface is not flat, the projection of the image onto the projection surface is stopped or projected with reduced visibility compared to when the projection surface is flat, thereby achieving power saving compared to the case where the image is constantly projected regardless of the road surface conditions.

[0084] In addition, when the projection control unit 16 predicts or detects that the projection surface will have a downward slope or a step downward based on the road surface information of the projection surface acquired from the road surface monitoring unit 151 that monitors changes in the slope or shape of the projection surface, it determines that the projection surface is not flat and stops projecting the image onto the projection surface, or controls the projection to be performed with lower visibility than when the projection surface is flat. This makes it possible to project information (images) that take into account the road surface conditions of the projection surface, and avoids the danger of pedestrians looking directly at the road surface that has a downward slope or a step downward. In addition, when the projection surface is not flat, by stopping the projection of the image onto the projection surface or projecting with lower visibility than when it is flat, it is possible to save power compared to the case where the projection of the image is always continued regardless of the road surface conditions.

[0085] In this embodiment, whether the projection surface is flat or not is determined based on road surface information acquired from the road surface monitoring unit 151 of the vehicle control unit 15. In this way, since the road surface information is acquired from the vehicle control unit 15 (road surface monitoring unit 151) used by the vehicle for driving control, there is no need to provide an independent road surface monitoring unit 151, and resources can be used effectively, so that the road surface projection device can be realized at low cost.

[0086] It is also possible to provide the road surface monitoring unit 151 independently within the projection control unit 16. In this case, however, it becomes unnecessary to use the control communication bus 20. Therefore, closed control becomes possible using only the projection control unit 16, and projection control can be speeded up.

[0087] Incidentally, the projection control unit 16 can stop the projection of an image by using the concept of a projectable range. The projectable range refers to the maximum reach of the projection light projected by the projection unit 17 onto the road surface 2, in other words, it indicates the maximum image size that can be projected when projecting the image 4 onto the road surface 2. Here, the size of the image indicates at least one of the width along an axis parallel to the X-axis and the width along an axis parallel to the Y-axis, and the projection control unit 16 controls the projection unit 17 to project the generated image (projected image 4) onto at least a part of this projectable range.

[0088] The projection control unit 16 (main control unit 160) can recognize the vertical or horizontal width of the image projected onto the projection surface 3 and the distance the projection light projected from the projection unit 17 travels to reach the road surface by the image recognition unit 162 recognizing the image projected onto the projection surface 3 based on the distance image measured by the camera 12 or the distance image sensor 13.

[0089] For example, as shown in FIG. 5(b), the projection possible range is determined by the vertical distance (installation height h) from the mounting position of the projection unit 17 on the vehicle 1 (here, the bottom surface of the vehicle 1) to the ground plane of the vehicle 1 and the projection angle a of the image. The projection control unit 16 performs control to stop the projection of the image when the vertical or horizontal width of the projection image 4 exceeds the distance until the projection light projected by the projection unit 17 reaches the road surface 2 and there is no projection surface there. In other words, the projection control unit 16 performs control to stop the projection of the image when the length of the base bo (the horizontal width bo of the projected image, here called the "projection image width") exceeds the length of the oblique side hy (the distance until the projection light projected from the projection unit 17 reaches the road surface 2, here called the "detection distance") within the range of the projection light and there is no projection surface there.

[0090] 7 is a graph showing the possible projection range, with the vertical axis indicating the projected image width (length of the base bo in FIG. 6(b)) and the horizontal axis indicating the detection distance (length of the oblique side hy in FIG. 6(b)), showing the relationship between the two that determines the possible capture range. In addition, in expressing the possible capture range in a graph, the relationship between the detection distance (oblique side hy), the projected image width (base side bo), and the projection angle a measured when the installation height of the projection unit 17 on the vehicle 1 is 30 cm is shown in Table 1 below.

[0091] [Table 1]

[0092] According to Table 1, for example, when the projection angle is 41°, the detection distance (diagonal line hy) is 40 [cm] and the projected picture width (base bo) is 26 [cm], when the projection angle is 60°, the detection distance (diagonal line hy) is 60 [cm] and the projected picture width (base bo) is 52 [cm], and when the projection angle is 77°, the detection distance (diagonal line hy) is 140 [cm] and the projected picture width (base bo) is 130 [cm]. In all cases, the projected picture width (length of base bo) is smaller than the detection distance (length of diagonal line hy), so it can be said to be within the projection possible range.

[0093] The projection control unit 16 can perform control to stop the projection when the width of the projected image (length of the base bo) exceeds the detection distance (length of the hypotenuse hy) and the projection surface 3 is not there, in other words, when it is not within the projection possible range.

[0094] In this way, the projection control unit 16 stops the projection of the image when the vertical or horizontal width (projection image width) of the projected image (projection image 4) exceeds the distance (detection distance) until the projection light projected by the projection unit 17 reaches the road surface. In other words, the projection control unit 16 controls to stop the projection of the image when the length of the base bo (the vertical or horizontal width of the projected image) exceeds the length of the oblique side hy (the distance until the projection light emitted from the projection unit reaches the road surface) and there is no intention to meet there (when it is not within the projection possible range), thereby achieving a further power saving effect compared to the case where the projection is controlled to be performed with reduced visibility.

[0095] Returning the explanation to the flowchart of Figure 2, in step S105, if it is determined that a downward gradient (downhill) exceeding the gradient threshold or a downward step exceeding the step threshold is not predicted or detected to the side of the vehicle (step S105 "NO") but is in front of the vehicle and predicted (step S107 "YES"), the projection control unit 16 (main control unit 160) stops the projection of the image generated by the image generation unit 161 before the downward gradient (downhill) exceeds the gradient threshold or the downward step exceeds the step threshold (in other words, before the vehicle 1 passes through the bend point), or controls the projection to be at an illuminance lower than the normal illuminance set by default (reducing visibility) (step S108).

[0096] In this way, when the projection control unit 16 predicts that the projection surface 3 will become a downhill slope or a step-down slope based on the road surface information of the projection surface acquired from the road surface monitoring unit 151 that monitors the change in the gradient or shape of the projection surface, it performs control to stop the projection of the image onto the projection surface or to project the image with lower visibility than usual before the projection surface 3 becomes a downhill slope or a step-down slope. Therefore, even if the road surface becomes a downhill slope or a step-down slope, by performing control to stop the projection or to lower the visibility of the projected image before passing the bending point, it is possible to prevent pedestrians walking on the downhill slope or step-down slope facing the vehicle from being dazzled by looking directly at the highly illuminating projected light. The same applies to the occupants of an oncoming vehicle.

[0097] At this time, the projection control unit 16 may perform control to stop the projection of a part of the projection image 4 projected on the projection surface 3 at a location away from the vehicle 1 or to project the part with reduced visibility. This prevents the driver of the oncoming vehicle from being dazzled by the projection light directly entering his / her eyes, while still allowing the projection to continue at least in part, so that the projected image can be viewed, even if it is incomplete.

[0098] 6(a), (b), and (c) show examples of projection forms in the front-rear direction of the vehicle 1. By visually recognizing the projected image, pedestrians can be encouraged to take action appropriate to the scene.

[0099] Fig. 6(a) shows a projection form on a flat road surface 2 when a projection unit 17 is mounted in front of a vehicle 1, and although there is a pedestrian in the traveling direction of the vehicle 1, the projected light 5 does not directly enter the eyes of the pedestrian. In contrast, Fig. 6(b) shows an example of a projection form when the vehicle 1 approaches a steep slope (a slope exceeding a gradient threshold). In this case, if the projected light is projected as is, the projected light 6 will enter the eyes of the pedestrian directly. Therefore, by stopping the projection or reducing the visibility (projected light 6 with reduced illuminance), it is possible to prevent the dazzle caused by looking directly at the projected light with high illuminance.

[0100] Although Fig. 6(b) illustrates an example in which an image is projected toward the front of the vehicle 1, the same applies when the image is projected toward the rear and a pedestrian or vehicle is approaching from behind. Fig. 6(c) will be described later.

[0101] Next, referring to the flowchart shown in FIG. 3, the operation of the road surface projection device according to this embodiment will be described in the case where projection units 17 (Le, Ri in FIG. 1) are mounted on the left and right sides (left and right) of a vehicle, and projection onto one side is stopped or projection onto the other side is reduced in visibility, but projection onto the other side is continued.

[0102] 3, the projection control unit 16 (main control unit 160) sequentially acquires road surface information of the projection plane 3 from the vehicle control unit 15 (road surface monitoring unit 151) via the main control unit 150 and the control communication bus 20 (step S201). Next, the main control unit 160 determines whether or not the projection plane 3 is flat based on the road surface information of the projection plane 3 acquired from the road surface monitoring unit 151 (step S202).

[0103] If it is determined that the surface is flat (step S202 "YES"), the main control unit 160 outputs the image generated by the image generation unit 161, for example, an example of which is shown in FIG. 5(b), to the projection unit 17, and controls the image to be projected on the left and right sides of the vehicle (the left and right sides) at normal illuminance set by default (step S203).

[0104] In the projection unit 17, when the projection light projected from the light source unit 171 is incident on the light modulation unit 172, the light modulation unit 172 forms the projection image 4 to be projected based on the image generated by the image generation unit 161 of the projection control unit 16. Then, the projection optical system 173 enlarges and projects the projection image 4 formed by the light modulation unit 172 onto the projection surface 3.

[0105] The determination of "whether the road surface is flat" in step S202 is performed by the projection control unit (main control unit 160) based on, for example, road surface information detected by the road surface monitoring unit 151 of the vehicle control unit 15 from the distance image acquired by the distance image sensor 13, or based on road surface information predicted by the road surface monitoring unit 151 from the map 11 or an image captured by a camera, etc.

[0106] On the other hand, if the projection surface 3 is not flat (step S202 "NO"), for example, if it is predicted or detected that the projection surface 3 on the left side will have a downward gradient (downhill) exceeding the gradient threshold or a downward step exceeding the step threshold (step S204 "YES"), and control is performed to stop the projection to the left (step S205 "YES"), the projection control unit 16 (main control unit 160) (1) continues the projection to the right, or (2) performs control to project with reduced illuminance to the right (reducing visibility) (step S206).

[0107] Furthermore, when the projection to the left side is not stopped (step S205 "NO") but the illuminance is lowered to the left side (visibility is reduced) (step S207 "YES"), the projection control unit 16 (main control unit 160) controls the projection to be made with a higher illuminance to the right side than to the left side (step S208). Note that the projection unit 17, since the light source unit 171 has a dimming function, can control the difference in illuminance between the right side and the left side by controlling the brightness in stages.

[0108] On the other hand, if it is predicted or detected that the projection surface on the right side will have a downward slope or step threshold exceeding the threshold (step S209 "YES") and control is performed to stop the projection to the right side (step S210 "YES"), the projection control unit 16 (main control unit 160) controls to continue the projection to the left side or to reduce the illuminance of the projection to the left side (step S211).

[0109] Furthermore, when projecting with lower illuminance to the right side (step S212) without stopping the projection to the right side (step S210 "NO"), the projection control unit 16 (main control unit 160) performs control to project with higher illuminance to the left side than to the right side (step S213). Since the light source unit 171 of the projection unit 17 has a dimming function, it is possible to control the difference in illuminance between the right side and the left side by controlling the brightness in stages.

[0110] In steps S201 to S213, even if the left side and the right side (left and right) are switched, the projection control unit 16 (main control unit 160) can perform the same operations.

[0111] In this way, when the projection control unit 16 (main control unit 160) performs control to stop the projection of an image onto one of the first projection surface or the second projection surface (the road surface located on the left and right sides of the vehicle), it either (1) continues the projection of an image onto the other projection surface, or (2) when the projection of an image onto one projection surface is stopped, it performs control to project the image onto the other projection surface with reduced visibility, or (3) when the visibility of the image onto one projection surface is reduced, it performs control to project the image onto the other projection surface with reduced visibility, and at this time with the visibility of the image onto the other projection surface being higher than the visibility of the image onto the one projection surface.

[0112] Therefore, when the projection units 17 (Le, Ri) are mounted on the left and right (right and left) of the vehicle, even if the projection to one side is stopped depending on the road surface conditions on the right or left side of the vehicle, the projection to the other side can be continued. Therefore, even if there is a pedestrian on a downhill or step-like road, the driver can avoid the danger of looking directly at the pedestrian, and the information necessary for traffic is projected and clearly communicated to the driver or pedestrian, enabling the driver or pedestrian to take action according to the situation.

[0113] Note that the flowchart in Figure 3 has been explained as an example of a case where the vehicle has projection units 17 (Le, Ri) on the left and right sides (left and right) of the vehicle, but similar control is possible when projection units 17 (F, R) are installed on the front and rear (front and rear) of the vehicle.

[0114] In this case, when the projection control unit 16 (main control unit 160) performs control to stop the projection of an image onto one of the third projection surface or the fourth projection surface (the road surface located in front and behind the vehicle), it either continues the projection of the image onto the other projection surface, (2) performs control to stop the projection of the image onto one projection surface and to project the image onto the other projection surface with reduced visibility, or (3) performs control to reduce the visibility of the image to be projected onto the other projection surface and at this time project the image with the visibility of the image onto the other projection surface being higher than the visibility of the image onto the one projection surface.

[0115] FIG. 6(c) shows the projection form when the projection units 17 (F, R) are mounted on the front and rear of the vehicle. As described above, even if one projection is stopped or the illuminance is lowered to reduce the visibility of the image, the projection on the other side can continue. Therefore, since the vehicle approaches a slope with a pedestrian coming from the opposite direction, only the projection on one side (here, the front) is stopped or the illuminance is lowered to reduce the visibility of the image (projection light 7), while the projection on the other side (rear) (projection light 8) continues. The same applies if the relationship between the front and rear is reversed.

[0116] In this way, even if the projection to one side is stopped depending on the road surface conditions in front or behind the vehicle, the projection to the other side can be maintained. Therefore, while avoiding the dazzling that occurs when pedestrians in front or behind the vehicle, or passengers in oncoming or following vehicles, look directly at the projected light, the information necessary for traffic is projected and clearly communicated to pedestrians or passengers, enabling them to take action according to the situation.

[0117] (Effects of the embodiment) As described above, according to the road surface projection device of this embodiment, the projection control unit 16 controls to project the image on the projection surface in different ways (S103, S106, S108) depending on whether the projection surface is flat or not (for example, step S102 in FIG. 2), thereby making it possible to project information (images) taking into consideration the road surface conditions of the road surface that is the projection surface. This makes it possible to project information necessary for traffic onto the road surface and clearly communicate it to the driver or pedestrian, thereby encouraging them to take action according to the scene. In particular, it is possible to provide a road surface projection device that avoids the danger of the driver looking directly at pedestrians even when there are pedestrians on a road surface that is a downhill slope or a step downwards.

[0118] Furthermore, if the projection surface is not flat (for example, "NO" in step S102 of FIG. 2), the projection of the image onto the projection surface is stopped or projected with reduced visibility compared to when the projection surface is flat (step S106), thereby achieving power saving compared to the case where the image projection is always continued regardless of the road surface conditions.

[0119] Furthermore, the projection control unit 16 stops the projection of the image when the vertical or horizontal width of the projected image (projection image width) exceeds the distance the projection light projected by the projection unit 17 takes to reach the road surface. In other words, by controlling to stop the projection of the image when the length of the base side (the vertical or horizontal width of the projected image) of the projectable range exceeds the length of the oblique side (the distance the projection light emitted from the projection unit takes to reach the road surface), it is possible to achieve a further power saving effect compared to the case where the projection is controlled to be performed with reduced visibility.

[0120] Furthermore, according to the road surface projection device of this embodiment, when the projection control unit 16 predicts or detects that the projection surface will have a downward slope or a step (for example, "YES" in step S104 of FIG. 2), it determines that the projection surface is not flat and stops projecting the image onto the projection surface, or controls the projection to be performed with lower visibility than when the surface is flat (step S106). This makes it possible to project information (images) that takes into account the road surface conditions of the projection surface, and avoids the danger of pedestrians looking directly at the road surface that has a downward slope or a step. Furthermore, when the projection surface is not flat, power saving can be achieved compared to when the projection of images is always continued regardless of the road surface conditions by stopping the projection of the image onto the projection surface or projecting with lower visibility than when the surface is flat.

[0121] Furthermore, when the projection control unit 16 predicts that the projection surface will be a downhill slope or a step-down slope, it performs control to stop the projection of the image onto the projection surface or to project the image with lower visibility than usual before the projection surface becomes a downhill slope or a step-down slope (for example, step S108 in FIG. 2). Therefore, even if the road surface is a downhill slope or a step-down slope, by performing control to stop the projection or to lower the visibility of the projected image before the vehicle passes through the bend, it is possible to prevent pedestrians facing the vehicle on the downhill slope or step-down slope from being dazzled by looking directly at the highly illuminating projected light. The same applies to the occupants of an oncoming vehicle.

[0122] Furthermore, when the projection control unit 16 predicts or detects that the projection surface will be a downhill slope or a step, it stops the projection of a part of the image projected at a location away from the vehicle or reduces the visibility and projects it. In this way, by controlling the projection of a part of the image to be projected at a location away from the vehicle by stopping the projection or reducing the visibility, it is possible to prevent the driver of a following or oncoming vehicle from being dazzled by the projection light directly entering their eyes, while still allowing the projection to continue at least in part, so that the projected image can be viewed, even if it is incomplete.

[0123] In this embodiment, the projection control unit 16 controls the illuminance to reduce visibility when it predicts or detects that the projection surface will be a downhill slope or a downward step, but it may also control to reduce visibility by using color.

[0124] Furthermore, according to the road surface projection device of this embodiment, when the projection units 17 (Le, Ri) are mounted on the right and left sides of the vehicle 1, the projection control unit 16 can maintain projection on one side even when the projection on the other side is stopped depending on the road surface conditions on the right or left side of the vehicle. Therefore, even if there is a pedestrian on a road surface that is a downhill slope or a downward step, the driver can avoid the danger of looking directly at the pedestrian, and the information necessary for traffic is projected and clearly communicated to the driver or pedestrian, making it possible to call for action according to the scene.

[0125] Furthermore, when projection units 17 (F, R) are mounted on the front and rear of the vehicle 1, the projection control unit 16 can maintain projection on one side even when stopping projection on the other side depending on the road surface conditions in front or rear of the vehicle. This makes it possible to project information necessary for traffic and clearly communicate it to vehicle occupants or pedestrians, while avoiding dazzlement caused by drivers of following or oncoming vehicles looking directly at the projected light, thereby encouraging them to take action according to the situation.

[0126] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art could easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims. [Explanation of symbols]

[0127] DESCRIPTION OF SYMBOLS 1···vehicle, 2···road surface (2a···downward slope, 2b···downward step), 3···projection surface, 4···projected image, 5,6,7,8···projected light, 10···road surface projection system, 11···map, 12···camera, 13···distance image sensor, 14···behavior sensor, 15···vehicle control unit, 16···projection control unit, 17···projection unit, 20···control communication bus, 150···main control unit, 151···road surface monitoring unit, 160···main control unit, 161···image generation unit, 162···image recognition unit, 171···light source unit, 172···light modulation unit, 173···projection optical system.

Claims

1. A road surface projection device that projects an image onto a road surface, a projection unit that projects the image onto a projection surface of the road surface located within a predetermined distance from the vehicle; A projection control unit that controls the projection of the image, The projection control unit includes: A road surface projection device, characterized in that it controls so as to project the image onto the projection surface in different modes depending on whether the projection surface is flat or not.

2. The projection control unit includes: The road surface projection device according to claim 1, characterized in that, when the projection surface is not flat, the projection of the image onto the projection surface is stopped or the projection is controlled to be made with reduced visibility compared to when the projection surface is flat.

3. The projection control unit includes: The road surface projection device according to claim 2, characterized in that, when the vertical or horizontal width of the projected image, within the projection range determined by the vertical distance from the mounting position of the projection unit on the vehicle to the ground plane of the vehicle and the projection angle of the image, exceeds the distance required for the projection light projected by the projection unit to reach the road surface and the projection surface is not present at that location, control is performed to stop the projection of the image.

4. a road surface monitoring unit that monitors changes in the gradient or shape of the projection surface; The projection control unit includes: The road surface projection device according to claim 2, characterized in that when it is predicted or detected that the projection surface will become a downward slope or a downward step due to a change in gradient or shape of the projection surface, it determines that the projection surface is not flat, and controls to stop projecting the image onto the projection surface or to project the image with reduced visibility compared to when the projection surface is flat.

5. A road surface monitoring unit monitors changes in the gradient or shape of a projection surface in front of or behind the vehicle, The projection control unit includes: The road surface projection device according to claim 2, characterized in that, when it is predicted that the projection surface will become a downhill slope or a downward step due to a change in gradient or shape of the projection surface, control is performed to stop projection of the image onto the projection surface or to project the image with reduced visibility before the projection surface becomes the downhill slope or the downward step.

6. The projection control unit includes: The road surface projection device according to claim 2, characterized in that when it is predicted or detected that the projection surface will become a downhill slope or a downward step due to a change in gradient or shape of the projection surface, control is performed to stop projection of some of the images projected on the projection surface to a location away from the vehicle or to project them with reduced visibility.

7. The projection unit is a first projection unit that projects the image onto a first projection surface of the road surface located on the left side of the vehicle, and a second projection unit that projects the image onto a second projection surface of the road surface located on the right side of the vehicle, The projection control unit includes:

5. The road surface projection device according to claim 4, characterized in that when it is predicted or detected that either the first projection surface or the second projection surface will have a downward slope or a downward step, the device performs one of the following: (1) when the projection of the image onto one of the first projection surface or the second projection surface is stopped, the projection of the image onto the other projection surface is continued; (2) when the projection of the image onto one of the projection surfaces is stopped, the device controls the projection onto the other projection surface with reduced visibility; or (3) when the visibility of the image onto one of the projection surfaces is reduced, the device controls the visibility of the image to be projected onto the other projection surface to be reduced, and at this time, the visibility of the image onto the other projection surface is made higher than the visibility of the image onto the one projection surface to project the image.

8. The projection unit includes a third projection unit that projects the image onto a third projection surface of the road surface located in front of the vehicle, and a fourth projection unit that projects the image onto a fourth projection surface of the road surface located behind the vehicle, and when the projection control unit predicts or detects that either the third projection surface or the fourth projection surface will have a downward slope or a downward step, it performs one of the following: (1) when the projection of the image onto one of the projection surfaces is stopped, the projection of the image onto the other projection surface is continued, (2) when the projection of the image onto one of the projection surfaces is stopped, the projection control unit performs control to reduce visibility onto the other projection surface, or (3) when the visibility of the image onto one of the projection surfaces is reduced, the visibility of the image projected onto the other projection surface is reduced, and at this time, the visibility of the image onto the other projection surface is increased to be higher than the visibility of the image onto the one projection surface, and the projection control unit performs control to project the image.

Citation Information

Patent Citations

  • Vehicle driving support device

    JP2016153258A

  • Projection type display device

    JP2019214373A

  • Information display device and information display method

    WO2017138150A1

  • Projection device for movable body, portable terminal and program

    JP2020083301A

  • Vehicle

    JP2021167197A

Cited By

  • Road surface projection device

    JP2026142619A