Information projection device

Abstract

Provided is technology that enables more appropriate display of images for a driver and for people in the vicinity of a vehicle. The present invention contributes to the sustainable development goal "3. Ensure healthy lives and promote well-being for all at all ages". This information projection device includes an acquisition unit that acquires vehicle information regarding a vehicle, and a projection unit that projects a plurality of basic element images onto the surroundings of the vehicle. The projection unit projects the plurality of basic element images at the projection timing of the plurality of basic element images on the basis of the vehicle information regarding the vehicle that is acquired by the acquisition unit.

Description

Information projection device

[0001] The present invention relates to an information projection device, an information projection system, and an information projection method.

[0002] As shown in Patent Document 1 and Patent Document 2, a technique for projecting information onto a road surface is known.

[0003] Patent Document 1 discloses a vehicle projection device that projects a route guidance image onto the road surface in front of the host vehicle. This vehicle projection device includes a route search means for searching for the current position of the host vehicle and the route from the current position to a set destination, and a projection means for projecting a route guidance image for guiding the host vehicle in the branch direction onto the road surface in front of the host vehicle based on the route information searched by the route search means when the host vehicle approaches a branch point on the route to such an extent that the occupant can visually recognize it.

[0004] Patent Document 2 discloses a technique capable of easily attracting the attention of a moving object such as a pedestrian, and discloses a road surface projection method as an example. This road surface projection method includes a step of pre-storing image data of an image to be projected onto the road surface, a step of monitoring the surrounding area of the host vehicle, a step of discriminating a moving object based on the monitoring result, a step of setting a discrimination area in the monitored surrounding area, and a step of reading out the pre-stored image data and projecting the image onto the road surface position near the moving object when the discriminated moving object exists in the discrimination area.

[0005] Japanese Unexamined Patent Application Publication No. 2012 - 247369, Japanese Unexamined Patent Application Publication No. 2008 - 7079

[0006] There is a problem of providing a technique that can more appropriately display a video for a driver and a video for vehicles and people around the host vehicle.

[0007] Further, according to an embodiment of the present invention, the following information projection device is provided. This information projection device includes an acquisition unit that acquires vehicle information related to a vehicle, and a projection unit that projects one or more basic element images to the periphery of the vehicle. The projection unit projects the basic element images based on the vehicle information related to the vehicle acquired by the acquisition unit at the projection timing of the one or more basic element images.

[0008] The present invention provides a technology that enables more appropriate display of images for the driver and images for surrounding vehicles and people. Other problems, configurations, and effects will be clarified by the following description of embodiments for carrying out the invention.

[0009] This figure shows an example of the overview of a vehicle equipped with an information projection device. This figure shows an example of the configuration installed in the vehicle. This figure shows an example of the image display when information is projected onto the road surface in front of the vehicle. This figure shows an example of the image display when information is projected onto the road surface behind the vehicle. This figure shows an example of the configuration of the projection device. This figure shows an example of the configuration of the projection device. This figure shows an example of the configuration of the projection device. This figure illustrates an example of the arrangement of optical components, etc. This figure illustrates an example of the arrangement of optical components, etc. This figure illustrates an example of the display area of ​​the image as seen from the driver. This figure illustrates an example of the display area onto which the image light is projected. This is a flowchart illustrating an example of information projection. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of the image display when information is projected around the vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle. This figure shows an example of image display when projecting information around a vehicle.This figure shows an example of image display when information is projected around a vehicle. This figure shows an example of image display when information is projected around a vehicle. This figure shows an example of image display when information is projected around a vehicle. This figure shows an example of image display when information is projected around a vehicle.

[0010] Embodiments of the present invention will be described below with reference to the drawings. The embodiments are illustrative examples for explaining the present invention, and have been omitted and simplified as appropriate for clarity of explanation. The present invention can also be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.

[0011] The positions, sizes, shapes, and ranges of the components shown in the drawings may not represent their actual positions, sizes, shapes, and ranges in order to facilitate understanding of the invention. Therefore, the present invention is not necessarily limited to the positions, sizes, shapes, and ranges disclosed in the drawings.

[0012] Examples of various types of information may be described using terms such as "table," "list," and "queue," but these types of information may also be represented by other data structures. For example, various types of information such as "XX table," "XX list," and "XX queue" may be referred to as "XX information." When describing identification information, terms such as "identification information," "identifier," "name," "ID," and "number" are used, but these terms are interchangeable.

[0013] When there are multiple components with the same or similar function, they may be described using the same symbol but with different subscripts. Furthermore, when it is not necessary to distinguish between these multiple components, the subscripts may be omitted in the description.

[0014] In embodiments, processing performed by executing a program may be described. Here, the computer executes the program using a processor (e.g., CPU, GPU) and performs processing defined by the program using memory resources (e.g., memory) and interface devices (e.g., communication ports). Therefore, the main entity performing the processing by executing the program may be the processor. Similarly, the main entity performing the processing by executing the program may be a controller, device, system, computer, or node having a processor. The main entity performing the processing by executing the program may be an arithmetic unit, and may include a dedicated circuit that performs a specific processing. Here, a dedicated circuit is, for example, an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), a CPLD (Complex Programmable Logic Device), etc.

[0015] The program may be installed on the computer from the program source. The program source may be, for example, a program distribution server or a storage medium readable by the computer. If the program source is a program distribution server, the program distribution server includes a processor and storage resources for storing the program to be distributed, and the processor of the program distribution server may distribute the program to other computers. In addition, in some embodiments, two or more programs may be implemented as a single program, or one program may be implemented as two or more programs.

[0016] In this embodiment, an example of a technology for displaying information on the road surface using a projection device mounted on a vehicle will be described. In this embodiment, with respect to the vehicle and driver, the horizontal direction is the left-right direction, the lateral direction of the vehicle, or the width direction of the vehicle; the vertical direction is the up-down direction of the vehicle, or the longitudinal direction; and the perpendicular direction, which is orthogonal to the lateral or longitudinal direction of the vehicle, is the longitudinal direction of the vehicle, or the direction of travel of the vehicle.

[0017] Figure 1 is a diagram illustrating the vehicle's layout. As shown in Figure 1, the vehicle 2 includes, for example, a projection device 11 (information projection device), an in-vehicle video display device 12, a car navigation system 150, a headlamp 13 (i.e., headlights 13), a taillight, a turn signal 14, and a controller 100. The vehicle 2 also includes an in-vehicle system 300 comprising these components. This in-vehicle system 300 implements an in-vehicle network, and the controller 100 can send and receive data or information with these components, and other components described later. The in-vehicle system 300 implements, for example, CAN (Controller Area Network), in-vehicle Ethernet, LIN (Local Interconnect Network), etc.

[0018] Furthermore, the in-vehicle system 300 can communicate with the outside of the vehicle via a communication device. Examples of communication with the outside of the vehicle include direct communication and indirect communication. In direct communication, the 760 MHz band, 5.9 GHz band, etc., are used internationally as ITS (Intelligent Transport System) communication bands, and direct communication is performed between vehicles, between vehicles and infrastructure, and between vehicles and pedestrians. In contrast, indirect communication uses mobile phone bands other than 5.9 GHz, and indirect communication is performed via a mobile carrier network. The in-vehicle system 300 can, for example, send and receive data or information with a server 24 connected to the network 21 via an access point 22 or relay station 23 on the network 21. The in-vehicle system 300 may also communicate with other vehicles, external devices 25, information terminals 26 carried by pedestrians, or infrastructure such as terminals installed on the road on which the vehicle is traveling. Examples of vehicle-to-infrastructure communication include the reception of traffic congestion and weather information using radio beacons and optical beacons.

[0019] Vehicle information 4, an example of data or information acquired by the in-vehicle system 300, includes, for example, in-vehicle sensor information such as speed information, gear information, steering angle information, lamp illumination information, ambient light information, distance information, infrared information, engine ON / OFF information, camera image information, acceleration gyro information, GPS information, navigation information, vehicle-to-vehicle communication information, vehicle-to-infrastructure communication information, pedestrian-to-vehicle communication information, Lidar (Light Detection and Ranging), road surface condition information, raindrop-related information, and wiper-related information. Camera image information includes in-vehicle camera image information and exterior camera image information. GPS information includes current time information, latitude and longitude information. This vehicle information can be acquired, for example, from sensors described later. Navigation information is map information that shows the route from the current location to the destination, generated by the car navigation system 150 based on GPS location information.

[0020] Furthermore, vehicle information 4 includes information entered by the driver. The driver can enter information using an appropriate device for inputting information. This device may be one that is pre-installed in the vehicle. Alternatively, this device may be an external device that can be connected to the in-vehicle system 300 by wire or wireless, such as an input device, tablet, smartphone, wearable device including AR (Augmented Reality) glasses or HMD (Head Mounted Display), or personal computer.

[0021] The in-vehicle system 300 can perform various types of control, such as driving control and display control, using the acquired data or information.

[0022] The projection device 11 projects video light for displaying information. A specific configuration example of the projection device 11 will be described later. The driver and people around the vehicle 2, that is, pedestrians walking near the vehicle, drivers and passengers of other vehicles traveling near the vehicle, etc., can see the video projected by the projection device 11.

[0023] The in-vehicle video display device 12 generates video light for displaying information and projects the video light toward a predetermined display area 5 on the windshield 3. In this way, the in-vehicle video display device 12 superimposes, for example, a virtual image corresponding to the displayed video onto the scenery, making it visible to the vehicle driver (from the driver's perspective). In this example, video light is projected toward the display area 5 of the windshield 3, but the projection unit that projects the video light may be a projection member such as a combiner. The in-vehicle video display device 12 can be a known HUD (Head-Up Display) comprising, for example, a light source, a display panel that forms the displayed video, a control unit, etc.

[0024] The Car Navi 150 is an electronic device called a car navigation system. For example, the Car Navi 150 uses map information and GPS location information to show the current location and the route to the destination. The Car Navi 150 can use traffic information such as VICS (Vehicle Information and Communication System, registered trademark) to present an efficient route to the destination.

[0025] In this example, the headlights 13 are provided in pairs on the left and right sides at the front of the vehicle. Inside the headlights 13 are lamps, which are light-emitting elements. The turn signals 14 are devices used to indicate the direction to the surroundings when turning right or left, changing lanes, etc., and like the headlights 13, they are provided in pairs on the left and right sides at the front of the vehicle.

[0026] The controller 100 is an electronic control unit (ECT) mounted in the vehicle 2, and as an example, comprises a processing unit (e.g., a central processing unit), a storage device, and an input / output device (I / O unit). The storage device can be configured using, for example, a main memory and an auxiliary storage device. The main memory is the work area of ​​the processing unit, and the processing unit stores data in the main memory and performs data processing. The main memory is, for example, RAM (Random Access Memory). The auxiliary storage device is a non-volatile storage device that stores data non-volatilely. The auxiliary storage device is, for example, ROM (Read Only Memory).

[0027] The controller 100 receives data or information via input / output devices and the in-vehicle network. Furthermore, the controller 100 can control various devices connected to the in-vehicle network via the input / output devices and the in-vehicle network.

[0028] The controller 100 receives, for example, vehicle information 4 and information obtained from the server 24 via an input / output device. Based on the acquired information, the controller 100 may then control the operation of the headlights 13, the turn signals 14, the projection device 11, the in-car video display device 12, the car navigation system 150, and so on.

[0029] The projection device 11 may be connected to various sensors mounted on the vehicle 2, devices mounted on the vehicle 2 (for example, a car navigation system 150), communication devices used for communication with the outside of the vehicle, etc., and may acquire data or information. The projection device 11 may then use the acquired data or information to generate video light for displaying the information and project the video light.

[0030] Furthermore, the projection device 11 can omit communication with the controller 100. Here, the projection device 11 can acquire data or information from a configuration different from the controller 100, for example, through communication based on CAN, in-vehicle Ethernet, etc. The same can be applied to the in-vehicle video display device 12.

[0031] Alternatively, the controller 100 may generate video data using the acquired data or information, transmit the generated video data to the projection device 11, and the projection device 11 may generate video light for displaying information based on the video data generated by the controller 100 and project the video light. On the other hand, the controller 100 may not generate video data, and the video generation unit 527 (described later) may generate the video data and transmit the generated video data to the projection device 11. Here, the controller 100 and the projection device 11 may communicate based on, for example, FPD-Link III, GMSL (Gigabit Multimedia Serial Link), and the projection device 11 may acquire video data from the controller 100. The projection device 11 may also perform video processing on the acquired video data, which includes processing related to image distortion correction, color correction, brightness correction, contrast correction, and conversion (e.g., decoding). Regarding video data, it may be stored in advance in the memory of the controller or projection device, or it may be processed in real time without being stored in memory. If the video data is stored in advance in the memory of the controller or projection device, the stored video data may be changed sequentially by system updates or user operations via wired or wireless methods. As described above, this projection device 11 may be connected to various sensors mounted on the vehicle, devices mounted on the vehicle 2 (e.g., car navigation system 150), communication devices used for communication with the outside of the vehicle, etc., and may acquire data or information through communication based on CAN, in-vehicle Ethernet, etc. Then, this projection device 11 may generate video light for displaying information based on the acquired information and project the video light. The same can be done for the in-vehicle video display device 12.

[0032] Furthermore, the controller 100 may control the headlights 13 and the projection device 11 in coordination. For example, the controller 100 may turn on the headlights 13 and cause the projection device 11 to project image light in front of the vehicle. Alternatively, the controller 100 may turn off the headlights 13 and cause the projection device 11 to generate an image of the information to be displayed and project the image light in front of the vehicle. In other words, the headlights 13 and the projection device 11 may operate in coordination via the controller 100.

[0033] On the other hand, the headlight 13 and projection device 11 may operate without the controller 100. For example, the headlight 13 and projection device 11 may be connected, and the operation of the headlight 13 may be controlled by the projection device 11 (more specifically, the control unit of the projection device 11). The projection device 11 may, for example, turn on the headlight 13, generate an image of the information to be displayed, and project the image light in front of the vehicle. Alternatively, the projection device 11 may, for example, turn off the headlight 13, generate an image of the information to be displayed, and project the image light in front of the vehicle.

[0034] For example, the projection device 11 may be mounted on the front of the vehicle body, and the image light from the projection device 11 may be projected onto the road surface in front of the vehicle. The projection device 11 may also be mounted, for example, near the roof of the vehicle body 2. Alternatively, the projection device 11 may be mounted, for example, on the side mirror area, on the roof, on the side or bottom of the vehicle body 2. However, the present invention is not limited to these examples.

[0035] The projection device 11 may be installed as a single unit or in multiple units. For example, a pair of projection devices 11 may be installed at the front of the vehicle 2. Alternatively, the projection device 11 may be integrated into the headlight 13, for example. If the projection device 11 is integrated into the headlight 13, the light source of the headlight 13 can also be used as the light source for projection.

[0036] For example, the projection device 11 may be mounted on the rear of the vehicle body, and the image light from the projection device 11 may be projected onto the road surface behind the vehicle. Alternatively, a pair of projection devices 11 may be mounted on the rear end of the vehicle 2. Furthermore, the projection device 11 may be integrated into the taillight, for example. When the projection device 11 is integrated into the taillight, the light source of the taillight can also be used as the light source for projection. The taillight described above may also be a stop lamp or a reverse lamp, and the following description of a taillight may be replaced with a stop lamp or a reverse lamp.

[0037] Furthermore, the controller 100 may control the taillights and the projection device 11 in coordination. For example, the controller 100 may turn on the taillights and cause the projection device 11 to generate an image of the information to be displayed, and project the image light to the rear of the vehicle. Alternatively, the controller 100 may turn off the taillights and cause the projection device 11 to generate an image of the information to be displayed, and project the image light to the rear of the vehicle. In other words, the taillights and the projection device 11 may operate in coordination via the controller 100.

[0038] On the other hand, the taillights and projection device 11 may operate without the controller 100. For example, the taillights and projection device 11 may be connected, and the operation of the taillights may be controlled by the projection device 11 (more specifically, the control unit of the projection device 11). The projection device 11 may, for example, turn on the taillights, generate an image of the information to be displayed, and project the image light to the rear of the vehicle. Alternatively, the projection device 11 may, for example, turn off the taillights, generate an image of the information to be displayed, and project the image light to the rear of the vehicle.

[0039] Furthermore, the controller 100 may control the turn signal 14 and the projection device 11 in coordination. For example, the controller 100 may turn on the turn signal 14, cause the projection device 11 to generate an image of the information to be displayed, and project the image light onto the front or rear of the side of the vehicle. Alternatively, the controller 100 may, for example, turn off the turn signal 14, cause the projection device 11 to generate an image of the information to be displayed, and project the image light onto the front or rear of the side of the vehicle. In other words, the turn signal 14 and the projection device 11 may operate in coordination via the controller 100. Furthermore, the turning on and off of the turn signal 14 may be controlled by the driver. As an example, the projection device may be provided to project the image light toward the road surface on the side of the vehicle 2.

[0040] Information such as vehicle information 4 is acquired using devices such as cameras and various sensors. Figure 2 shows an example of how the controller 100 is connected to various devices. Furthermore, control units such as the projection device 11, in-vehicle video display device 12, and car navigation system 150 are connected to the devices shown in Figure 2, making it possible to acquire information directly without going through the controller 100. The various devices in Figure 2 can be deleted, other types of devices added, or replaced with other types of devices as appropriate.

[0041] The vehicle speed sensor 501 detects the speed of the vehicle 2 and is used to generate speed information as a result of the detection. The shift position sensor 502 detects the current gear and is used to generate gear information as a result of the detection. The steering angle sensor 503 detects the current steering angle and is used to generate steering angle information as a result of the detection.

[0042] The headlight sensor 504 detects, for example, the ON / OFF of the headlight 13. Further, the headlight sensor 504 may detect the brightness of the headlight 13 when it is lit. The headlight sensor 504 is used to generate lamp lighting information as the detection result. Further, the vehicle 2 may be provided with a high / low sensor that detects the high beam or low beam state of the headlight 13, and the high / low sensor is used to generate information indicating the high beam or low beam. Further, the vehicle 2 may be provided with a tail lamp sensor (not shown). The tail lamp sensor detects, for example, the ON / OFF of the tail lamp. Further, the tail lamp sensor may detect the brightness of the tail lamp when it is lit. The tail lamp sensor is used to generate lamp lighting information as the detection result. Similarly, sensors for detecting the ON / OFF and lighting brightness of a stop lamp, a back lamp, a hazard lamp, and the direction indicator 14 (not shown) may be provided.

[0043] The illuminance sensor 505 and the chromaticity sensor 506 detect the external light of the vehicle 2 and are used to generate external light information as the detection result. Further, the chromaticity sensor 506 may detect the color of the road surface around the vehicle 2 and be used to generate projected surface color information as the detection result. The distance measurement sensor 507 detects the distance between the vehicle 2 and an external object or the distance between external objects, etc., and is used to generate distance information as the detection result. The infrared sensor 508 detects the presence or absence and distance of an object at a short distance from the vehicle, and is used to generate infrared information as the detection result. The engine start sensor 509 detects the ON / OFF of the engine and is used to generate ON / OFF information as the detection result.

[0044] The vehicle operation switch 510 is various switches operated by a driver or the like, and is used to generate operation information such as the ON / OFF of these switches. The vehicle operation switch 510 relates to a steering switch, a switch on the dashboard, a vehicle door switch, a switch on the armrest, a switch on the center console, and the like.

[0045] The communication unit 511 is a configuration used for communication, and includes, for example, a first communication unit 5111, a second communication unit 5112, a third communication unit 5113, an in-vehicle wireless communication unit 5114, and an out-vehicle wireless communication unit 5115.

[0046] The first communication unit 5111 is a configuration that performs communication by, for example, FPD-Link III, and includes a communication line and a communication device used for communication by FPD-Link III.

[0047] The second communication unit 5112 has a communication protocol (CAN communication protocol) implemented, and includes a communication line and a communication device used for communication by CAN.

[0048] The third communication unit 5113 is a configuration that performs communication by in-vehicle Ethernet, has an in-vehicle Ethernet communication protocol implemented, and includes a communication line and a communication device used for communication by in-vehicle Ethernet. Note that the third communication unit 5113 may include a USB (Universal Serial Bus) port, and a driver or the like may appropriately connect a device (for example, a USB memory, a device having a computer function) to the port. Then, the third communication unit 5113 may perform communication by in-vehicle Ethernet between the device connected to the port and the configuration of the connection destination.

[0049] The in-vehicle wireless communication unit 5114 is a configuration that communicates with information devices in the vehicle, has a communication protocol implemented, and includes a wireless device. The in-vehicle wireless communication unit 5114 performs wireless communication by, for example, Wifi (registered trademark), Bluetooth (registered trademark). Note that the in-vehicle wireless communication unit 5114 may perform short-range wireless communication such as NFC (Near Field Communication).

[0050] The out-vehicle wireless communication unit 5115 is a configuration that communicates with the outside of the vehicle 2, has a communication protocol implemented, and includes a wireless device. The out-vehicle wireless communication unit 5115 performs wireless communication by, for example, LTE (Long Term Evolution), 5G, Wifi.

[0051] The configuration of the communication unit 511 may be changed as appropriate. The communication unit 511 may be configured to perform communication via LIN, for example. Alternatively, the communication unit 511 may be configured to perform communication via GMSL, for example.

[0052] The acceleration sensor 512 and the gyro sensor 513 detect the acceleration and angular velocity of the vehicle 2 and are used to generate acceleration-gyro information that represents the attitude and behavior of the vehicle 2. The temperature sensor 514 detects the temperature inside and outside the vehicle and on the road surface, and is used to generate temperature information based on the detection results.

[0053] The vehicle-to-infrastructure wireless transceiver 515 generates vehicle-to-infrastructure communication information through vehicle-to-infrastructure communication between the vehicle 2 and roads, signs, signals, etc. The vehicle-to-vehicle wireless transceiver 516 generates vehicle-to-vehicle communication information through vehicle-to-vehicle communication between the vehicle 2 and other surrounding vehicles. The terminal vehicle-to-vehicle wired wireless communication unit 517 is a device that acquires information from devices connected to the LTE network (e.g., Wi-Fi devices) via wired or wireless communication. The controller 100 or control unit can acquire information transmitted and received over the LTE network via the terminal vehicle-to-vehicle wired wireless communication unit 517.

[0054] The GPS receiver 518 generates GPS information obtained by receiving GPS signals from GPS satellites. For example, the GPS receiver 518 can obtain the current time, latitude, and longitude. The VICS receiver 519 generates VICS information obtained by receiving VICS signals. Here, VICS signals include traffic congestion information and weather information from radio beacons and optical beacons. The GPS receiver 518 and the VICS receiver 519 may be provided as part of a navigation system.

[0055] The in-vehicle camera 520 and the exterior camera 521 capture images of the interior and exterior of the vehicle and are used to generate in-vehicle and exterior camera image information. Specifically, the in-vehicle camera 520 is, for example, a camera for a Driver Monitoring System (DMS) that captures the driver's posture, eye position, and movement. In this case, by analyzing the captured images, the driver's fatigue level and gaze position can be determined.

[0056] The voice input device 522 receives the driver's voice and is used to generate voice information. The driver can input operation details via the voice input device 522 by uttering sounds. The voice output device 523 is a device that outputs the voice processed by, for example, the controller 100 or the control unit.

[0057] The humidity sensor 524 detects humidity and is used to generate humidity information. The humidity sensor 524 may also detect humidity outside the vehicle 2 or on the road surface, and generate humidity information for the outside of the vehicle 2. Alternatively, the humidity sensor 524 may also detect humidity inside the vehicle 2, and generate humidity information for the inside of the vehicle.

[0058] The rain sensor 525 detects raindrops and is used to generate rainfall information. The wiper switch 526 detects the ON / OFF status of the wipers 6 and is used to generate ON / OFF information for the wipers 6. The turn signal switch (not shown) detects the operation of the turn signals 14 by the driver and is used to generate turn signal information.

[0059] The video generation unit 527 may generate video information based on information acquired from each sensor, or from external devices 25, or from a mobile terminal 26, or from the Internet, or it may generate video information based on information acquired by the controller 100. Information other than that of the vehicle includes information from external devices 25 or a mobile terminal 26, or from the Internet. On the other hand, the video generation unit 527 is not required, in which case the controller 100 may be configured to have the function of generating video.

[0060] The raindrop sensor 528 detects the amount and size of raindrops. The raindrop sensor 528 can measure the rainfall state because the amount of light incident on the detector decreases when raindrops are present. The amount of raindrops detected by the raindrop sensor 528 may be used to generate related information such as the operating time of the wiper 6. In addition, the operating state of the wiper 6 may be changed in conjunction with the driving speed of the vehicle 2 and the detection result of the raindrop sensor 528, or it may be used to correct related information such as the operating time of the wiper 6.

[0061] The road surface sensor 529 detects information regarding the road surface condition. The road surface sensor 529 may directly measure the wetness of the road surface, or it may detect friction with the road surface. Alternatively, it may detect acceleration based on the road surface condition, or it may classify the road surface condition into states such as dry, semi-wet, wet, slush, snow, compacted snow, and ice from the acceleration waveform.

[0062] The controller 100 or processor may, for example, send and receive data or information via wireless communication to acquire information necessary for driving. The controller 100 or processor may also acquire information necessary for autonomous driving. Furthermore, the controller 100 or processor may, for example, send and receive data or information via wireless communication to perform data or information update processing. As part of the update processing, the controller 100 or processor may, for example, update various types of data or information (map data, data used for image processing, software, etc.). Such technology is sometimes referred to as OTA (Over the Air) technology.

[0063] Next, an example of information projection by a projection device will be described with reference to Figure 3. As shown in Figure 3A, image light is projected from the projection device onto the road surface in front. The figure shows a projection area 14a projected from the projection device 11 through the front right window 13a of the vehicle 2, and a projection area 14b projected from the projection device 11 through the front left window 13b of the vehicle. The projection images of each projection area (14a, 14b) are combined to project an image (in this example, an arrow 16 indicating that the vehicle 2 is moving straight) onto the road surface in front of the vehicle 2. In this example, the projection areas (14a, 14b) are divided into left and right, but the projection areas may also be divided into areas near and far from the vehicle. Furthermore, the image light may be projected using only one of the projection devices 11 installed on the left and right sides of the vehicle. In this example, the projection device 11 is incorporated inside the headlight 13, and the light source of the headlight 13 is used as the light source for projection. However, as described above, the arrangement of the projection device 11 can be changed as appropriate. The projection device 11 may have a light-emitting configuration different from that of the headlight 13, and the light emitted from this configuration may be used to project image light.

[0064] As shown in Figure 3B, image light is projected from the projection device 11 onto the road surface behind the vehicle 2. The figure shows a projection area 17a projected from the projection device 11 on the rear right side of the vehicle 2 through the rear right window 15a of the vehicle 2, and a projection area 17b projected from the projection device 11 on the rear left side of the vehicle 2 through the rear left window 15b of the vehicle 2. The projection images of each projection area (17a, 17b) are combined to project an image (in this example, an arrow 18 related to a reverse indicator indicating that the vehicle is moving straight backward) onto the road surface behind the vehicle. In this example, the projection areas (17a, 17b) are divided into left and right, but the projection areas may also be divided into areas near and far from the vehicle. Alternatively, only one of the projection devices 11 installed on the left and right sides of the vehicle may be used to project image light. In this example, the projection devices 11 are installed so that the light source of the taillights can be used as the light source for projection. However, as mentioned above, the arrangement of the projection device 11 can be changed as appropriate. The projection device 11 may have a light-emitting configuration different from that of the taillights, and the light emitted from this configuration may be used to project the image light.

[0065] Referring to Figure 4, an example of the configuration of the projection device 11 will be described. The projection device 11 generates an image of the information to be displayed using data or information acquired via various sensors and a communication unit, and projects the image light. For example, the projection device 11 may receive data or information from the controller 100. The projection device 11 may receive signal data, video data, etc., from the controller 100. The projection device 11 may then perform processing using the input information. Alternatively, for example, the controller 100 may control the projection device 11 instead of the control unit of the projection device 11. Alternatively, the control unit of the projection device 11 and the controller 100 may share the processing duties. For example, the controller 100 may control the brightness of the headlights 13 and taillights, while the control unit of the projection device 11 controls the brightness of the projected image.

[0066] As shown in Figure 4, the projection device 11 includes a projection optical system 701 and a light source device 702. The projection device 11 also includes a power supply 703, a cooling unit 704, an operation input unit 705, a video signal input unit 706, an audio signal input unit 707, an audio output unit 708, a communication unit 709, a non-volatile memory 710, a memory 711, a storage unit 712, an adjustment unit 713, and a control unit 714. The control unit 714 may be configured as a processing unit. The control unit 714 can control the operation of the projection device 11. On the other hand, if there is no control unit, the controller 100 can also control the projection device 11.

[0067] The projection optical system 701 is a configuration used for projecting light. The projection optical system 701 includes, for example, optical components such as lenses and / or mirrors.

[0068] The light source device 702 is a device capable of generating image light. For example, the light source device can use a high-pressure mercury lamp, a xenon lamp, an LED light source, a laser light source, etc. The light source device may also be equipped with optical elements used for focusing and homogenizing light.

[0069] The power supply 703, for example, supplies power to the light source. Furthermore, the power supply 703 supplies the necessary power to each other component.

[0070] The cooling unit 704 cools each part that becomes hot, such as the light source, power supply 703, or light source device 702, using air cooling or liquid cooling as needed.

[0071] The operation input unit 705 is, for example, an operation button or a remote control receiver, and receives operation signals from the user. The input of an operation signal from the user switches the ON / OFF state of the switch (operation switch) that starts the projection device 11.

[0072] The video signal input unit 706 is an interface device for acquiring video data from an external source. The audio signal input unit 707 is an interface device for acquiring audio data from an external source. The audio output unit 708 can, for example, output audio based on audio data input to the audio signal input unit 707. The audio output unit 708 may output, for example, operation sounds or error warning sounds.

[0073] The communication unit 709 is an interface device used for communication with the outside world. The communication unit 709 is connected to, for example, an external information processing device (for example, a controller 100) and inputs and outputs various control signals. The communication unit 709 may also be connected to various sensors, communication devices provided on the vehicle 2, etc., and inputs and outputs various data or information.

[0074] The non-volatile memory 710 stores various data used in the projector function, for example. The data stored in the non-volatile memory 710 includes pre-prepared image data and video data for projecting images.

[0075] The memory 711 stores the projected video data and control parameters for each part of the device.

[0076] The storage unit 712 is a device that records video, images, audio, and various other data. For example, video, images, audio, and various other data may be pre-recorded at the time of product shipment, or video, images, audio, and various other data acquired from external devices or external servers via the communication unit 709 may be recorded. The control unit 714 may also acquire updated data or information from an external source via the communication unit 709 and update the recorded data or information with the new data or information. Furthermore, at the user's discretion, some or all of the recorded data or information may be updated with new data or information. Video, images, and various other data recorded in the storage unit 712 can be output as projected video. Audio recorded in the storage unit 712 can be output as audio from the audio output unit 708.

[0077] The adjustment unit 713 is capable of adjusting the video light and includes, for example, an image adjustment unit and a polarization adjustment unit. The image adjustment unit performs image processing on video data input by the video signal input unit, image data stored in the non-volatile memory 710, and video data. Examples of such image processing include image distortion correction, scaling processing such as enlarging, reducing, and transforming images, brightness adjustment processing to change the brightness of images, contrast adjustment processing to change the contrast curve of images (including adjustment of the gradation linearity characteristics of brightness), color correction processing to change the chromaticity of images, and retinex processing to decompose an image into light components (illumination light component, reflected light component, ambient light component) and change the weighting of each component. The image adjustment unit is realized when the control unit 714 stores data in the memory 711 and executes image processing.

[0078] The polarization adjustment unit adjusts the polarization degree of the projected image light. Here, polarization degree refers to the ratio of P-polarization component and S-polarization component, which are the polarized light components contained in the light (P-polarization and S-polarization are defined with respect to the projection surface). For example, the projection device 11 is provided with a configuration that can adjust the polarization degree of the emitted light, such as a polarization separation element and a polarization conversion element, which will be described later, and the control unit 714 adjusts the polarization degree of the image light by controlling this configuration. The polarization control unit is realized by the control unit 714 storing data (parameters used for control, etc.) in the memory 711 and controlling the said configuration. Alternatively, multiple projection devices 11 with different polarization degrees may be provided and switched between.

[0079] In the example shown in Figure 4B, the light source device 702a comprises a light source 7021, a display element 7022, an optical element 7023, a polarization separation element 7024, and a polarization conversion element 7025. The light source 7021 generates light for image projection. The optical element 7023 is used for focusing and homogenizing light. Note that explanations similar to those above may be omitted. The polarization separation element 7024 is an element that separates incident light into S-polarized and P-polarized light. For example, a polarizing beam splitter is used for the polarization separation element 7024, separating light by reflecting or transmitting light in a specific polarization state. The polarization conversion element 7025 is an element that converts the degree of polarization. For example, a waveplate is used for the polarization conversion element 7025, changing the polarization state by delaying the phase of light. Here, for example, the polarization conversion element 7025 may be connected to an actuator (e.g., a motor) used to control the angle of incidence of transmitted light, and the adjustment unit 713 or polarization adjustment unit 722 in Figure 4A may adjust the incident light to a polarization degree corresponding to the angle of incidence.

[0080] The projection device 11 also includes a display element 7022, a display element drive unit (not shown), and the like. The display element 7022 is an element that generates an image by modulating transmitted or reflected light, and uses, for example, a transmissive LCD (Liquid Crystal Display) panel, a reflective LCD panel, a DMD (Digital Micromirror Device) (registered trademark) panel, etc. The display element drive unit sends a drive signal to the display element 7022 and generates an image on the display element 7022. In addition to a configuration in which multiple images can be displayed by control signals such as DMD and LCD, the display element 7022 also includes a configuration that only displays a fixed image, such as a mask type.

[0081] In the example shown in Figure 4C, the light source device 702b does not have a light source that serves as a backlight for the display element. In this example, the display element itself emits light. Note that explanations similar to those above may be omitted in some cases.

[0082] The light source device 702b comprises a display light-emitting element 7026, an optical element 7023, a polarization separation element 7024, and a polarization conversion element 7025. The display light-emitting element 7026 is configured as a self-emissive display such as an LED array or an OLED (Organic Light Emitting Diode) display. The optical element 7023 is an optical system used for focusing and homogenizing light. The optical element 7023, the polarization separation element 7024, and the polarization conversion element 7025 are the same as those described in Figure 4B.

[0083] Next, an example of the arrangement of optical components will be described with reference to Figure 5. Figure 5A shows an example of projecting an image using a reflective display element in the DMD method. The first optical element 901 is an optical element that focuses the light generated by the light source 900, and is, for example, a collimator. The second optical element 902 is a mirror that projects the focused light onto the display element 907. In this example, the display element 907 is configured as a DMD type panel, and the projection of light is adjusted or controlled for each display pixel. The third optical element 903 is configured to project image light and is constructed using optical components such as lenses and mirrors. A reflective LCD panel may be used as the reflective display element.

[0084] Figure 5B shows an example in which the display light-emitting element 908 itself emits light and projects an image. The display light-emitting element 908 is configured as an LED array panel or an LED matrix panel, and an image is generated by the combination of the lighting position and lighting color of the LEDs on the panel. The fourth optical element 904 is configured to project image light and is constructed using optical components such as lenses and mirrors. In addition to the above panels, an OLED display may be used as the display light-emitting element.

[0085] Figure 5C shows an example of displaying an image by transmitting light through the display element 909. The fifth optical element 905 is the same as the first optical element 901 described above. The display element 909 is, for example, a transmissive LCD panel, and an image is generated on the display element 909. The sixth optical element 906 is configured to project image light and is constructed using optical components such as lenses and mirrors. The display element 909 may also be configured by placing a mask with a predetermined pattern on the light source side. In this case, a fixed image based on the pattern formed on the mask can be displayed by light that is not obstructed by the mask, but transmits through the mask. Alternatively, the display element 909 may be configured by placing a lens with a predetermined pattern on the light source side. In this case, the display element 909 can display a fixed image based on the pattern formed on the lens. The predetermined pattern formed on the lens is formed on the lens surface or inside the lens, and the formed pattern partially blocks or partially transmits light transmission. The lens used in the display element 909 may be a microlens array. In that case, the patterns formed on each lens will be different.

[0086] A modified example is described in which a light-shielding plate is provided instead of the display element in Figure 5C. As an example, the light-shielding plate has a window that transmits light rays from the light source 900. The shape of the window is not limited and may be a geometric shape such as a rectangle or chevron, or it may be an icon, a letter, or a number. The window may also be a shape that can be changed according to the image being projected. For example, based on the acquired information, a rectangular image may be changed to a chevron image and continuously projected. The sixth optical element 906 is configured to project light rays that have passed through the window of the light-shielding plate onto the road surface and is composed of optical components such as a lens, a mirror, and an aperture. The length, size, and brightness of the image projected onto the road surface are controlled by the sixth optical element 906. Furthermore, the length, size, and brightness of the image projected onto the road surface can also be controlled by changing the shape, size, transmittance, and aperture duty cycle of the window of the light-shielding plate. In addition, the image projected onto the road surface can be made to blink by repeatedly turning the light source 900 on and off.

[0087] Another modification involves providing multiple sets of light sources 900, first optical elements 901, light shields, and sixth optical elements 906. The sixth optical element 906 projects light rays that have passed through the windows of the multiple light shields onto the road surface in an overlapping manner, thereby enabling the projection of a rectangular image onto the road surface in a linear fashion. Furthermore, the sixth optical element 906 separates the light rays that have passed through the windows of the multiple light shields and projects them onto the road surface, enabling the projection of multiple rectangular images arranged in a linear fashion onto the road surface. In addition, by sequentially lighting up the multiple light sources 900, it becomes possible to project a rectangular image onto the road surface that lights up sequentially in a predetermined direction (for example, a direction away from vehicles).

[0088] The light sources shown in Figures 5A and 5C can be composed of the light source of the projection device 11, but they may also be the light sources of the headlights 13 or the taillights. In this case, the light source of the projection device 11 may be omitted. On the other hand, the light sources shown in Figures 5A and 5C may be a combination of the light source of the projection device 11 and the light sources of the headlights 13 or the taillights. Furthermore, the light source of the projection device 11 may consist of one or more light sources. Similarly, the display elements or light-shielding plates corresponding to the light sources may also consist of one or more.

[0089] Next, an example of the display area of ​​the image as seen by the driver will be explained with reference to Figure 6. Figure 6 shows the illumination area A1 of the high beam of the headlight 13, the illumination area A2 of the low beam of the headlight 13, and the image area A3 for the road surface image projected by the projection device 11. The high beam is projected onto the upper illumination area of ​​the high beam. That is, the high beam that brightly illuminates the distance can be projected onto this illumination area. The high beam is projected onto the lower illumination area of ​​the high beam, and since it overlaps with the projection area of ​​the low beam, the low beam may be formed by blocking a part of the illumination area of ​​the headlight 13 that can project the high beam. In addition, the image area A3 projected by the projection device 11 is included in the illumination area below the low beam illumination area A2 and the high beam illumination area A1. For this reason, the projection device 11 can project images using the low beam and high beam of the headlight 13, and the projection device 11 may be provided separately from the headlight 13.

[0090] An example of a projection area around a vehicle will be described with reference to Figure 7. Figure 7 shows a road surface display area A11 in front of the vehicle, a road surface display area A12 behind the vehicle, and road surface display areas A13 to the left and right of the vehicle. The road surface display area A11 in front of the vehicle is a display area formed on the road surface in front of the vehicle, with reference to the position of the vehicle. The projection device 11 may, for example, be configured to project image light into this area and display information. The road surface display area A12 behind the vehicle is a display area formed on the road surface behind the vehicle, with reference to the position of the vehicle. The projection device 11 may, for example, be configured to project image light into this area and display information. The road surface display areas A13 to the left and / or right of the vehicle are display areas formed on the road surface to the left and / or right of the vehicle, with reference to the position of the vehicle. The projection device 11 may, for example, be configured to project image light into this area and display information. This region A13 can be, for example, an area where information displayed by vehicles and people (such as pedestrians) around the vehicle can be seen.

[0091] An example of information projection will be described with reference to Figure 8. In the information projection of this embodiment, the processor controls the projection image and image projection. The processor may function as the vehicle's controller 100, the control unit of the projection device 11, or an external device. Specifically, the controller 100 may control the projection device 11, the control unit of the projection device 11 may control the projection image and image projection based on information from the vehicle or an external source, the controller 100 and the projection device 11 may share the processing, or an external device or mobile terminal may control the projection image and image projection. For example, when the controller 100 controls the projection device 11, the controller 100 sends image information based on information from sensors to the projection device 11, and if further image adjustment is necessary, it also sends information regarding image adjustment to the projection device 11, and the projection device 11 projects an image based on the image information and adjustment information. Alternatively, the controller 100 may perform image information generation processing, or image adjustment processing and generation processing of adjusted image information, send only the image information to the projection device 11, and the projection device 11 may perform only image projection.

[0092] Figure 8 shows an example of video projection processing. In the following embodiments, the control related to video projection processing is not particularly limited. As shown in Figure 8, step S1 is a projection start determination step, in which the start of projection is determined according to pre-set information of the projection device 11. For example, if it is determined that the switch of the projection device 11 is turned on, projection can be started. If it is determined that the switch of the projection device 11 is turned off, projection cannot be started.

[0093] Next, step S2 is a vehicle information acquisition step, in which vehicle information necessary for the projection control determination in step S3 is acquired. For example, turn signal illumination information and lamp illumination information may be acquired as vehicle information. Furthermore, speed information, gear information, GPS information, navigation information, steering angle information, infrared information, camera image information, etc. may also be acquired as vehicle information.

[0094] Next, step S3 is a projection control determination step, in which it is determined what kind of control to perform on the projected image (hereinafter also referred to as the "projected image") based on the vehicle information acquired in step S2. For example, in step S3, a projection image indicating a right or left turn is projected based on the turn signal illumination information. Based on the illumination timing of each lamp of the projection device 11, the number of basic element images 20 to be projected (hereinafter also referred to as the "number of projections") and the projection timing of each basic element image 20 are determined. Also, when the lamps of the turn signal 14 function as light sources for the projection device 11, the number of basic element images 20 to be projected (hereinafter also referred to as the "number of projections") and the projection timing of each basic element image 20 are determined based on the number of lamps that the turn signal 14 has and the illumination timing of each lamp. In the embodiment of the present invention, the turn signal 14 will be described using a chain-type turn signal. A chain-type turn signal has multiple lamps. Specifically, the number of basic element images 20 to be projected and the projection timing of each basic element image 20 are determined so that the illumination cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2 are synchronized. Similarly, the number of basic element images 20 to be projected and the projection timing of each basic element image 20 are determined based on the lamp illumination information and the illumination timing of the hazard lamps. In this embodiment, the projection cycle is the projection cycle of each individual basic element image 20. In this embodiment of the present invention, "the illumination cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 are synchronized" means that the timing of illumination and the timing of projection are approximately the same or the same, or that the start / end of illumination and the start / end of projection are approximately the same or the same, or that the start / end of lamp illumination and the start / end of projection of the basic element images are approximately the same or the same.

[0095] Next, step S4 is the projection start step, in which the projection of the image is started based on the determination result of step S3. For example, the number of basic element images 20 determined in step S3 are started to be projected onto the display area around the vehicle 2 at the projection timing determined in step S3.

[0096] Next, step S5 is a projection termination determination step, in which it is determined whether or not to terminate the image projection based on information regarding the image projection termination conditions, including vehicle information 4.

[0097] Next, step S6 is the projection termination step. If it is determined in step S5 that the image projection should be terminated, the image projection is terminated in step S6.

[0098] Furthermore, the processes from steps S2 to S4 may be repeated until it is determined in step S5 that the image projection has ended.

[0099] The information projection shown in Figure 8 is implemented by a configuration that allows for direct or indirect control of the projection device 11. That is, the information projection shown in Figure 8 may be implemented by a configuration based on a controller 100, a control unit 714 of the projection device 11, other processing devices installed inside the vehicle, or processing devices outside the vehicle. Here, one of these configurations may implement the method, or multiple configurations may share the implementation of each process of the method. In controlling the projection device 11, the controller 100 may transmit signals to the projection device 11 to control the projection device 11. In addition, the control unit 714 of the projection device 11 may control the display of the projection device 11 based on information acquired from the vehicle.

[0100] Figures 9A and 9B illustrate the projection of information onto the periphery of a vehicle. In this embodiment of the present invention, the projection unit of the projection device 11 projects multiple basic element images onto the periphery of the vehicle. The light source of the projection unit has multiple lamps arranged in a line, and the multiple lamps may be lit sequentially in a predetermined direction (for example, from the inside to the outside of the vehicle 2) periodically to project an image. The light source of the projection device 11 may be the light source of the headlights, or the light source of the turn signals 14, and is not particularly limited. One lamp may correspond to one basic element image, multiple lamps may correspond to one basic element image, or one lamp may correspond to multiple basic element images.

[0101] Specifically, multiple lamps for projecting images are illuminated sequentially in one lighting cycle, for example, from the inside to the outside of the vehicle 2. After all the lamps are illuminated, all the lamps turn off, and the projection of the image is repeated in this lighting cycle. In addition, as shown in Figures 9A and 9B, multiple chevron-shaped basic element images 20 arranged in a line are projected. More specifically, for example, among the multiple basic element images 20, the basic element images 20 closer to the vehicle 2 are projected to indicate the current direction of travel of the vehicle 2, and the basic element images 20 further away from the vehicle 2 are projected to indicate the direction in which the vehicle is about to travel. For example, when turning right or left, among the multiple basic element images 20, the chevrons of the basic element images 20 closer to the vehicle 2 face forward of the vehicle 2, and the chevrons of the basic element images 20 further away from the vehicle 2 face the direction of the right or left turn. The multiple basic element images 20 are projected sequentially in a predetermined direction (for example, away from the vehicle 2) periodically, corresponding to the illumination of the multiple lamps. Specifically, in one projection period (one projection cycle), the multiple basic element images 20 are projected sequentially, for example, in the direction away from the vehicle 2, and the projection of all basic element images 20 ends after all basic element images 20 have been projected. Alternatively, the multiple basic element images 20 may be projected so that the illumination period of the multiple lamps and the projection period of the multiple basic element images 20 are synchronized, or the illumination period of the multiple lamps and the projection period of the multiple basic element images 20 may be set based on predetermined conditions. This indicates the actions that the vehicle 2 will perform (movement and turning), and people or vehicles around the vehicle 2 who see this image will know the actions that the vehicle 2 will perform.

[0102] In the embodiments of the present invention, the basic element image 20 is a chevron shape. A chevron shape is a triangle or inverted triangle lacking parallel sides, such as "∧" or "∨". The shape of the basic element image 20 is not limited to a chevron shape as long as it indicates direction; for example, it may be a triangular arrow.

[0103] Referring to Figures 9A and 9B, an example of image display when information is projected onto the projection area 14b on the front left side of the vehicle 2 will be described. Specifically, Figures 9A and 9B show an example of an image projected onto the projection area 14b on the front left side of the vehicle 2 when the left turn signal 14 of the vehicle 2 is illuminated during a left turn.

[0104] In Figure 9A, when three of the five lamps in the left turn signal 14 of vehicle 2 are illuminated, five basic element images 20 are projected onto the front left side of vehicle 2. In other words, in Figure 9A, the number and timing of illumination of the lamps in the turn signal 14 do not match the number and timing of projection of the basic element images 20. If the number and timing of illumination of the lamps in the turn signal 14 do not match the number and timing of projection of the basic element images 20, it will give a sense of unease to people around vehicle 2, and the design of the projection of the basic element images 20 will also be poor.

[0105] In Figure 9B, when three of the five lamps in the left-side turn signal 14 of vehicle 2 are illuminated, three basic element images 20 are projected onto the front left side of vehicle 2. In other words, in Figure 9B, the number and timing of illumination of the lamps in the turn signal 14 match the number and timing of projection of the basic element images 20. By matching the number and timing of illumination of the lamps in the turn signal 14 with the number and timing of projection of the basic element images 20, it is possible to prevent causing discomfort to people in the vicinity of vehicle 2 and to improve the aesthetic design of the projection of the basic element images 20.

[0106] Next, with reference to Figures 10A to 10D, an example of image display when projecting information onto the road surface to the left of vehicle 2 during a left turn will be explained. Figures 10A to 10D show examples of images projected onto the road surface to the left of vehicle 2 when the left turn signal 14 of vehicle 2 is illuminated. As a general rule, the illuminated turn signal and the area projected onto the road surface are the same, but for example, if it is not possible to project onto the road surface to the left of vehicle 2 when the left turn signal is illuminated (due to a malfunction, road conditions, etc.), the image may be projected onto a different area.

[0107] As shown in Figure 10A, when the turn signal 14 is illuminated, projection of an image showing multiple basic element images 20 is initiated.

[0108] As shown in Figure 10B, when the turn signal 14 is turned off, the projection of the image showing the multiple basic element images 20 is completed. The projection of the image showing the multiple basic element images 20 may be completed simultaneously, or the projection of the image showing the basic element images 20 may be completed sequentially in a predetermined direction (for example, from the far side of the vehicle 2 to the near side). Alternatively, the projection of the image of the current travel path showing the multiple basic element images 20 may be completed, and the projection may be changed to an image showing the direction of travel from now. Furthermore, for example, the brightness of the basic element images 20 may be gradually decreased sequentially in a predetermined direction (for example, from the far side of the vehicle 2 to the near side). The start and end conditions for information projection onto the road surface are explained using the case when the turn signal 14 is illuminated as an example, but are not limited to this, and other conditions may be combined. For example, projection onto the road surface may be performed when the turn signal 14 is illuminated and a sufficient area for projecting information onto the road surface is secured; projection onto the road surface may be performed when the road surface conditions, weather, and brightness are suitable for projecting information; projection onto the road surface may be performed when other vehicles or people are detected around the vehicle 2; or projection onto the road surface may be performed when the vehicle 2 is moving, or when it is moving and its speed is below a predetermined level. Furthermore, projection onto the road surface may be terminated when these conditions are no longer met.

[0109] Furthermore, as shown in Figure 10C, when the taillights are illuminated, projection of images showing multiple basic element images 20 may begin on the rear of the vehicle 2 (in the illustrated example, the projection area 17b on the rear left). For example, when there is another vehicle 2 or a person behind the vehicle 2, images showing the basic element images 20 are projected on the rear of the vehicle 2. Also, if images showing multiple basic element images 20 are projected sequentially onto the road surface behind the vehicle 2, from the near side to the far side of the vehicle 2, other vehicles 2 or people may perceive the vehicle 2 as turning while reversing. For this reason, for example, a different projection may be performed than when the gear is in reverse (R) and the vehicle 2 is reversing. For example, when the gear is in drive (D) and not in reverse (R), and the taillights are illuminated, multiple basic element images 20 may be projected sequentially from the far side to the near side of the vehicle 2, that is, in the direction the car is moving. Alternatively, the multiple basic element images 20 may be projected all at once instead of sequentially. In addition, the projection during recession may be distinguished from the projection during receding by differences in the projection period, size, number, and shape of the basic element image 20.

[0110] Furthermore, as shown in Figure 10D, when the steering wheel is turned or the turn signal 14 is illuminated, projection of multiple basic element images 20 may be initiated onto the side of the vehicle 2 (in the illustrated example, the projection area 19b on the left side). In the example shown in Figure 10D, each basic element image 20 is projected to indicate the turning direction indicated by the turn signal 14. In other words, the chevron of each basic element image 20 faces the turning direction indicated by the turn signal 14. For example, if the vehicle 2 has a long body, such as a trailer, projection of only the basic element images 20 to the front or rear of the vehicle 2 may not be sufficient to present information to other vehicles 2 or people. Furthermore, as shown in Figure 10D, multiple basic element images 20 arranged in a line may be projected onto the side of the vehicle 2. This allows for more reliable presentation of information to other vehicles 2 or people in the vicinity of the vehicle 2, which has a long body.

[0111] Furthermore, in the example shown in Figure 10D, the multiple basic element images 20 projected to the front side of the vehicle 2 (hereinafter referred to as "lateral projection 1"), the multiple basic element images 20 projected to the center side of the vehicle 2 (hereinafter referred to as "lateral projection 2"), and the multiple basic element images 20 projected to the rear side of the vehicle 2 (hereinafter referred to as "lateral projection 3") may be projected at the same time. Alternatively, lateral projection 1, lateral projection 2, and lateral projection 3 may be projected in this order. After one lateral projection 1 is projected, one lateral projection 2 and the first lateral projection 3 may be projected, and then the second lateral projection 1 may be projected in order, or the first and second lateral projections 1 may be projected in sequence, followed by the first and second lateral projections 2 and the first and second lateral projections 3, respectively. At this time, until the series of projections from lateral projection 1 to lateral projection 3 is completed, the projected images may remain projected, or the projection of the images may be terminated at any time. In each of lateral projection 1, lateral projection 2, and lateral projection 3, the multiple basic element images 20 are projected sequentially in a direction away from the vehicle 2. The projection timing patterns of lateral projection 1, lateral projection 2, and lateral projection 3 described above may be switched based on vehicle information such as speed information. For example, when the vehicle 2 is stopped, lateral projection 1, lateral projection 2, and lateral projection 3 may be projected at the same time, and when the vehicle 2 starts moving, lateral projection 1, lateral projection 2, and lateral projection 3 may be projected in this order. Alternatively, if the distance from vehicle 2 to the intersection is greater than a predetermined distance, lateral projection 1, lateral projection 2, and lateral projection 3 may be projected at the same time, and if the distance from vehicle 2 to the intersection is shorter than a predetermined distance, lateral projection 1, lateral projection 2, and lateral projection 3 may be projected in this order. Furthermore, while vehicle 2 is turning, all three lateral projections, lateral projection 1, lateral projection 2, and lateral projection 3, may be projected.

[0112] Furthermore, in the example shown in Figure 10D, lateral projection 1, lateral projection 2, and lateral projection 3 may be terminated simultaneously. Alternatively, the projections of lateral projection 1, lateral projection 2, and lateral projection 3 may be terminated sequentially based on steering angle information. For example, when the front part of a vehicle 2 having a long body is turned, the projection of lateral projection 1 may be terminated; when the central part is turned, the projection of lateral projection 2 may be terminated; and when the rear part is turned, the projection of lateral projection 3 may be terminated.

[0113] Furthermore, in the example shown in Figure 10D, once vehicle 2 begins to turn, only the lateral projection 2 may be projected. Alternatively, before vehicle 2 begins to turn, for example, when it is stopped waiting at a traffic light, only the lateral projection 2 may be projected, and once it begins to turn, the lateral projection 1, lateral projection 2, and lateral projection 3 may be projected in that order.

[0114] Furthermore, projection toward the front of vehicle 2 as shown in Figures 10A and 10B, and projection toward the side of vehicle 2 as shown in Figure 10D, may be performed simultaneously, or projection toward the rear of vehicle 2 as shown in Figure 10C, and projection toward the side of vehicle 2 as shown in Figure 10D, may be performed simultaneously.

[0115] Furthermore, in the examples shown in Figures 10A to 10D, based on object detection results derived from vehicle information such as infrared information and camera image information, multiple basic element images 20 may be projected onto areas where other vehicles 2 or people around vehicle 2 are easily visible. For example, if other vehicles 2 or people are behind vehicle 2, multiple basic element images 20 may be projected behind vehicle 2. Also, if other vehicles 2 or people behind vehicle 2 approach, multiple basic element images 20 may be projected to the sides in addition to the rear of vehicle 2. Furthermore, if other vehicles 2 or people behind vehicle 2 approach even further, multiple basic element images 20 may be projected in front of vehicle 2 in addition to the rear and sides. Conversely, if people or other vehicles 2 move away from vehicle 2, the projection of multiple basic element images 20 onto some or all areas may be terminated. In addition, the projection pattern of the multiple basic element images 20 may be changed depending on the distance between vehicle 2 and other vehicles 2 or people around vehicle 2. For example, if the distance between vehicle 2 and other vehicles 2 or people in its vicinity falls below a dangerous distance, the projection interval of the multiple basic element images 20 may be shortened. In this case, the lighting cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 do not need to be synchronized.

[0116] Furthermore, if the vehicle 2 is stopped before turning, the multiple basic element images 20 are projected so that the lighting cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 projected onto the display area of ​​the road surface around the vehicle 2 are synchronized. When the vehicle 2 begins to move for turning, the time interval between the projection of the multiple basic element images 20 may be shortened. In other words, when the vehicle 2 begins to move for turning, the lighting cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 projected onto the display area of ​​the road surface around the vehicle 2 do not need to be synchronized.

[0117] Furthermore, when the vehicle 2 begins to turn based on steering angle information, tire angle information, etc., the size, orientation, and number of basic element images 20 projected onto the road surface around the vehicle 2 may be changed. For example, before the vehicle 2 turns in response to the illumination of the turn signal 14, as shown in Figures 9A and 9B, the basic element images 20 on the side closer to the vehicle 2 are projected to indicate the current direction of travel of the vehicle 2, and the basic element images 20 on the side further away from the vehicle 2 are projected to indicate the turning direction indicated by the turn signal 14. Once the vehicle 2 begins to turn, all basic element images 20 may be projected to indicate the turning direction. Alternatively, once the vehicle 2 begins to turn, the projection of the basic element images 20 may be stopped. Alternatively, once the vehicle 2 begins to turn, multiple basic element images 20 may not be projected periodically, and all basic element images 20 may be kept projected.

[0118] Next, with reference to Figures 11A and 11B, other examples of image display when projecting information onto the road surface to the left of vehicle 2 during a left turn will be described. Figures 11A and 11B, like Figures 9A and 9B, and Figures 10A to 10D, show examples of images projected onto the road surface to the left of vehicle 2 when the left turn signal 14 of vehicle 2 is illuminated. In the examples shown in Figures 11A and 11B, based on the object detection results, multiple basic element images 20 are projected onto an area that is easily visible to other vehicles 2 or people in the vicinity of vehicle 2.

[0119] As shown in Figure 11A, if another vehicle 2 is present in front of vehicle 2, and the distance between vehicle 2 and the other vehicle 2 is shorter than a predetermined distance, and the projection area 14b on the front left side of vehicle 2 is narrower than usual, the number of basic element images 20 to be projected may be reduced. The size of the basic element images 20 to be projected may also be reduced. The size of the basic element images 20 must be at least large enough to ensure their visibility. Furthermore, in addition to the projection area 14b on the front left side of vehicle 2, multiple basic element images 20 may be projected onto the projection area 19b on the side left side of vehicle 2. This makes it possible to compensate for the reduced information transmission capacity caused by reducing the number of basic element images 20 projected onto the projection area 14b on the front left side of vehicle 2, or by reducing the size of the basic element images 20. For example, if vehicle 2 moves forward a short distance before turning, the basic element image 20 projected onto the projection area 14b on the front left side of vehicle 2 may be projected to indicate the direction of travel of vehicle 2, and the basic element image 20 projected onto the projection area 19b on the side left side of vehicle 2 may be projected to indicate the direction of turning. When the distance between vehicle 2 and another vehicle 2 is shorter than a predetermined distance, and projection is to be made onto the projection area 19b on the side left side of vehicle 2, projection to the front left side may be temporarily suspended when projection to the side left side begins, and projection to the front left side may be resumed when the distance to the other vehicle 2 becomes greater than the predetermined distance, and the projection to the side left side may be terminated or left unattended accordingly.

[0120] Furthermore, the number of basic element images 20 projected onto the projection area 14b on the front left side of the vehicle 2 may be different from the number of basic element images 20 projected onto the projection area 19b on the side left side of the vehicle 2. For example, multiple basic element images 20 may be projected onto the projection area 14b on the front left side of the vehicle 2, and one basic element image 20 may be projected onto the projection area 19b on the side left side of the vehicle 2.

[0121] Furthermore, before the vehicle 2 begins to turn, the basic element image 20 may be projected onto both the projection area 14b on the front left and the projection area 19b on the side left. Once the vehicle 2 begins to turn, the basic element image 20 may be projected only onto the projection area 14b on the front left, and while the vehicle 2 is turning, the basic element image 20 may be projected only onto the projection area 19b on the side left.

[0122] Furthermore, the projection cycles of the multiple basic element images 20 onto the projection area 14b on the front left side of vehicle 2 and the projection cycles of the multiple basic element images 20 onto the projection area 19b on the side left side of vehicle 2 do not need to be synchronized. Also, the projection cycles of the multiple basic element images 20 onto the projection area 14b on the front left side of vehicle 2, the projection cycles of the multiple basic element images 20 onto the projection area 19b on the side left side of vehicle 2, and the illumination cycles of the multiple lamps of the turn signal 14 do not need to be synchronized.

[0123] Furthermore, if another vehicle 2 is located behind vehicle 2, and the distance between vehicle 2 and the other vehicle 2 is shorter than a predetermined distance, and the projection area 17b on the rear left side of vehicle 2 is narrower than usual, the same measures as described above in Figure 11A may be taken.

[0124] As shown in Figure 11B, when another vehicle 2 approaches a predetermined distance behind vehicle 2 in the same lane, multiple basic element images 20 are projected onto the projection area 17b to the rear left of vehicle 2, in addition to the projection area 14b to the front left of vehicle 2. For example, when vehicle 2 is stopped and another vehicle 2 is approaching from behind, multiple basic element images 20 are projected periodically onto the projection area 14b to the front left and the projection area 17b to the rear left, sequentially, for example, in a direction away from vehicle 2. Furthermore, when the other vehicle 2 stops behind vehicle 2, all basic element images 20 may be projected onto the projection area 14b to the front left and the projection area 17b to the rear left, or the projection of basic element images 20 onto the projection area 17b to the rear left may be terminated. Furthermore, once the vehicle 2 begins to turn, multiple basic element images 20 may be projected periodically and sequentially toward the projection area corresponding to the direction of the turn, moving away from the vehicle 2.

[0125] Furthermore, in a left-turn lane, if multiple vehicles 2 are lined up, only the last vehicle 2 may have multiple basic element images 20 projected onto the projection area 17b on the rear left. Also, if a following vehicle 2 approaches from behind the vehicle 2 in the same lane, the projection of multiple basic element images 20 onto the projection area 17b on the rear left of the vehicle 2 may end, and for example, a notification prompting the following vehicle 2 to start projection may be sent from the vehicle 2 via vehicle-to-vehicle communication, and upon receiving this notification, the following vehicle 2 may project multiple basic element images 20 onto the projection area 17b on the rear left. This allows the following vehicle 2 of the last vehicle 2 to be informed that the lane in which the vehicle 2 is located is a left-turn lane. Similarly, in a right-turn lane, if multiple vehicles 2 are lined up, multiple basic element images 20 are projected onto the projection area 17a on the rear right.

[0126] Next, with reference to Figures 12A and 12B, examples of image displays projected onto the display area of ​​the road surface surrounding the vehicle 2 will be described. Figure 12A shows an example of an image projected onto the road surface to the right of the vehicle 2 when the vehicle 2 changes lanes from its current lane to the right lane and the right turn signal 14 of the vehicle 2 is illuminated. Figure 12B shows an example of an image projected onto the road surface to the right of the vehicle 2 when merging lanes, particularly when the vehicle 2 transitions from a stationary state to a moving state and merges into the right lane of the vehicle 2 and the right turn signal 14 of the vehicle 2 is illuminated.

[0127] As shown in Figure 12A, when the right turn signal 14 is illuminated (turn signal ON) in order for the vehicle 2 to move from the left lane to the right lane, multiple basic element images 20 are projected periodically onto the projection area 14a in front right of the vehicle 2 and the projection area 17a in rear right, sequentially, for example, in a direction away from the vehicle 2. Here, it is desirable that the illumination cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 projected onto the projection area 14a in front right, or the illumination cycle of the multiple lamps of the turn signal 14 and the projection cycle of the multiple basic element images 20 projected onto the projection area 17a in rear right, are synchronized. However, the speed at which the vehicle 2 travels when changing lanes is faster than the speed at which the vehicle 2 travels when turning right or left (turning). Therefore, when vehicle 2 changes lanes, the projection pattern of the multiple basic element images 20 projected onto the projection area 14a on the front right and the projection area 17a on the rear right may be different from that when turning left or right. For example, when vehicle 2 changes lanes, the number of projections of the multiple basic element images 20 projected onto the projection area 14a on the front right and the projection area 17a on the rear right may be reduced compared to when turning left or right. This can improve the visibility of the multiple basic element images 20 to other vehicles 2 traveling on the highway, for example. Alternatively, the time interval between projections of the multiple basic element images 20 projected onto the projection area 14a on the front right and the projection area 17a on the rear right may be shortened compared to when turning left or right. This makes it possible to transmit information to other vehicles 2 traveling on the highway more quickly. In this case, however, the lighting cycles of the multiple lamps of the turn signal 14 and the projection cycles of the multiple basic element images 20 projected onto the projection area 14a on the front right and the projection area 17a on the rear right do not need to be synchronized.

[0128] Furthermore, the position and number of basic element images 20 displayed on the road surface surrounding vehicle 2 may be changed according to the progress of vehicle 2's lane change. Specifically, for example, as shown in Figure 12A, when the right turn signal 14 is illuminated in order for vehicle 2 to change lanes, first, three basic element images 20 are projected periodically in the direction away from vehicle 2 onto the projection area 14a on the front right side of vehicle 2 and the projection area 17a on the rear right side of vehicle 2. Next, when it is determined that vehicle 2 has started to change lanes based on steering angle information, or when it is determined that it has crossed a lane based on information from sensors, etc., four basic element images 20 are projected periodically in the direction away from vehicle 2 onto the projection area 14a on the front right side of vehicle 2 to indicate the direction of travel of vehicle 2, and two basic element images 20 are projected periodically in the direction away from vehicle 2 onto the projection area 19a on the side right side. For example, the orientation and number of basic element images 20 projected onto the projection area 14a on the front right side of the vehicle 2 may be sequentially changed based on steering angle information, etc., to indicate the direction of travel of the vehicle 2. Next, when the vehicle 2 has completed changing lanes, the projection of the basic element images 20 onto the surrounding road surface of the vehicle 2 is terminated.

[0129] Similarly, when the vehicle 2 starts moving from a stationary position, the projection of the basic element images 20 may be performed in a different projection pattern than when turning left or right. For example, as shown in Figure 12B, when the right turn signal 14 is illuminated (turn signal ON) in order to start moving from a stationary position of the vehicle 2, multiple basic element images 20 are simultaneously projected onto the projection area 14a on the front right side of the vehicle 2, the projection area 19a on the side right side, and the projection area 17a on the rear right side. Next, when it is determined from gear information, vehicle speed information, and steering angle that the vehicle 2 has started moving and begun to move from its stationary position into the driving lane, multiple basic element images 20 are projected sequentially in the direction away from the vehicle 2 onto the projection area 14a on the front right side and the projection area 19a on the side right side.

[0130] Next, with reference to Figures 13A and 13B, other examples of image displays projected onto the display area of ​​the road surface surrounding Vehicle 2 will be described. Figures 13A and 13B show examples of images projected onto the road surface surrounding Vehicle 2 when the hazard lights are turned on to warn of danger, draw attention, or indicate actions such as parking or stopping of Vehicle 2.

[0131] As shown in Figure 13A, when the vehicle 2 is stopped (speed 0 km / h) and the hazard lights are turned on (hazard lights ON), multiple basic element images 20 are simultaneously projected onto the projection area 14a on the front right side of the vehicle 2, the projection area 14b on the front left side, the projection area 17a on the rear right side, and the projection area 17b on the rear left side. The multiple basic element images 20 may also be projected to flash simultaneously in sync with the flashing of the hazard lights. In addition to the hazard lights being on, similar projection of basic element images 20 may also be performed when the gear is determined to be in parking (P) or neutral (N) based on gear information. Furthermore, on the side where other vehicles 2 or people are located (for example, the rear projection areas 17a, 17b), multiple basic element images 20 may be projected sequentially in the direction away from the vehicle 2, while on the side where other vehicles 2 or people are not located (for example, the front projection areas 14a, 14b), multiple basic element images 20 may be projected simultaneously.

[0132] Furthermore, as shown in Figure 13A, the projection pattern of the multiple basic element images 20 projected onto the road surface surrounding the vehicle 2 when the hazard lights are turned on may differ depending on the vehicle's speed. For example, when the vehicle 2 is traveling at a low speed (speed 30 km / h) and the hazard lights are turned on (hazard lights ON), the multiple basic element images 20 are projected periodically and sequentially toward the projection area 14a on the front right side of the vehicle 2, the projection area 14b on the front left side, the projection area 17a on the rear right side, and the projection area 17b on the rear left side, moving away from the vehicle 2. In addition, the multiple basic element images 20 may be projected simultaneously toward the projection area 19a on the side right side and the projection area 19b on the side left side. Furthermore, when the vehicle 2 is traveling at high speed (speed 80 km / h), multiple basic element images 20 are projected in a different manner than when traveling at low speed. For example, multiple basic element images 20 are projected sequentially toward the direction away from the vehicle 2 to the projection area 14a on the front right, projection area 14b on the front left, projection area 17a on the rear right, and projection area 17b on the rear left, at a shorter period than when traveling at low speed. In addition, multiple basic element images 20 may be projected simultaneously to the projection area 19a on the side right and projection area 19b on the side left, and multiple basic element images 20 may also be projected simultaneously to each of the projection areas 14a, 14b, 17a, and 17b.

[0133] Furthermore, the basic element image 20 projected onto the road surface around the vehicle 2 when the turn signal 14 is illuminated may be different from the basic element image 20 projected onto the road surface around the vehicle 2 when the hazard lights are illuminated. For example, the color and size of the basic element image 20 projected onto the road surface around the vehicle 2 when the turn signal 14 is illuminated may be different from the color and size of the basic element image 20 projected onto the road surface around the vehicle 2 when the hazard lights are illuminated. Moreover, the period during which multiple basic element images 20 are projected sequentially may be different when the turn signal 14 is illuminated and when the hazard lights are illuminated, and the flashing period when multiple basic element images 20 are projected simultaneously may be different.

[0134] Furthermore, if the hazard lights are turned off, the projection of multiple basic element images 20 may be terminated in order from the far side to the near side of the vehicle 2, as shown in Figure 13B. Alternatively, if the hazard lights are turned off, the projection of all basic element images 20 may be terminated simultaneously. Also, on the side where other vehicles 2 or people are present (for example, the rear projection areas 17a, 17b), the projection of multiple basic element images 20 may be terminated in order from the far side to the near side of the vehicle 2, while on the side where other vehicles 2 or people are not present (for example, the front projection areas 14a, 14b), the projection of multiple basic element images 20 may be terminated simultaneously.

[0135] Next, with reference to Figures 14A to 14C, an example of image display projected onto the display area on the left side of the road surface when turning left will be described. Figure 14A shows an example of an image projected onto the display area on the road surface surrounding the vehicle 2 when the turn signal 14 is illuminated and then immediately or when it is turned off for a predetermined period of time or less. Figure 14B shows an example of managing the timing of ending the projection of multiple basic element images 20 onto the display area on the road surface surrounding the vehicle 2 by time. Figure 14C shows an example of determining the start of projection of multiple basic element images 20 for the second cycle when the projection of multiple basic element images 20 for the first cycle has ended. Figures 14A to 14C show, as an example, an example of an image projected onto the projection area 14b on the front left side of the vehicle 2.

[0136] As shown in Figure 14A, if the turn signal 14 is turned on and then immediately turned off, there is a possibility that the turn signal 14 will turn off midway through the projection of multiple basic element images 20 onto the surrounding road surface (in this example, the projection area 14b on the front left). For example, if the direction of travel of vehicle 2 is to be indicated to the surroundings by projecting five basic element images 20 onto the road surface, if the projection onto the road surface is stopped when the first two basic element images 20 from vehicle 2 have been projected, the direction of travel of vehicle 2 cannot be indicated. In such cases, the projection of the basic element images 20 may be stopped only after the projection of all basic element images 20 in the first cycle has been completed. Also, for example, if the turn signal 14 is turned off at the same time that the first two basic element images 20 from vehicle 2 have been projected, or if it is determined that a change of direction such as a right turn or left turn has been completed based on steering angle information, the remaining three basic element images 20 may be projected simultaneously. In this way, by simultaneously projecting the remaining basic element images 20, the direction of travel of the vehicle 2 can be indicated to the surroundings, and the projection of the basic element images 20 can be completed more quickly. Therefore, even when the illumination of the turn signals 14 is quickly switched, such as when the vehicle 2 turns left by illuminating the left turn signal 14 and then immediately turns on the right turn signal 14, it is possible to synchronize the projection of the basic element images 20 with the illumination of the turn signals 14.

[0137] In the example shown in Figure 14B, the timing from the start to the end of projection of multiple basic element images 20 onto the display area of ​​the road surface surrounding the vehicle 2 (in this example, the projection area 14b on the front left) is controlled by time. Specifically, first, when the turn signal 14 is illuminated and projection of multiple basic element images 20 onto the projection area 14b on the front left begins, time measurement is started (timer start). In this example, after the timer is started, the system is controlled to complete the projection of one cycle of multiple basic element images 20 within a predetermined time. The predetermined time is the time limit from the start to the end of projection of one cycle of multiple basic element images 20, and is a time defined by regulations. Alternatively, the predetermined time may be the illumination time of one cycle of the turn signal 14. Then, when the projection of one cycle of multiple basic element images 20 is completed within the predetermined time and the predetermined time has elapsed, the projection of multiple basic element images 20 is completed and the timer is stopped. Here, for example, the predetermined time may elapse and the projection of multiple basic element images 20 for one cycle may be completed at the same time, or the projection of multiple basic element images 20 for one cycle may be completed before the predetermined time elapses, and the multiple basic element images 20 may be left projected until the predetermined time is reached.

[0138] In the example shown in Figure 14B, the start of projection of the multiple basic element images 20 for the second cycle is determined when the projection of the multiple basic element images 20 for the first cycle is completed. Specifically, when the projection of the multiple basic element images 20 for the first cycle is completed, it is determined whether or not the turn signal 14 is lit based on the turn signal illumination information. If it is determined that the turn signal 14 is lit, the projection of the multiple basic element images 20 for the next cycle is started. That is, if the projection of the multiple basic element images 20 for one cycle is completed and it is determined that the turn signal 14 is still lit, the projection of the multiple basic element images 20 for the next cycle is started and the timer is also started, and as with the first cycle, road projection is performed based on time management by the timer so that the multiple basic element images 20 for that cycle are completed within a predetermined time.

[0139] The order in which the multiple basic element images 20 are projected is not limited to the direction away from the vehicle. For example, if five basic element images 20 are projected, the basic element images 20 may be projected in the order of 1st, 2nd, 3rd, 4th, and 5th from the side closest to the vehicle, and then the 1st and 2nd basic element images 20 may remain projected while the 3rd, 4th, and 5th basic element images 20 are projected sequentially, and this cycle may be repeated. Alternatively, the basic element images 20 may be projected in the order of 1st, 2nd, 3rd, 4th, and 5th from the side closest to the vehicle, and then the projection of the basic element images 20 may end in the order of 5th, 4th, 3rd, 2nd, and 1st, and this cycle may be repeated. Furthermore, the period in which the multiple basic element images 20 are projected may be changed according to the distance between vehicles 2. For example, if the distance between your vehicle 2 and another vehicle 2 traveling or parked ahead is greater than a predetermined distance, all basic element images 20 may be projected periodically in a direction away from your vehicle 2. If the distance between your vehicle 2 and another vehicle 2 traveling or parked ahead is closer than a predetermined distance, the number of basic element images 20 projected periodically in a direction away from the vehicle may be reduced as the distance decreases. In this case, reducing the number of projected basic element images 20 will also reduce the amount of information that can be transmitted to the surroundings. Therefore, when the number is reduced below a predetermined number, information may be supplemented by changing the size or shape of the basic element images 20 or by starting projection to projection areas other than the front.

[0140] In the examples shown in Figures 12A and 12B, 13A and 13B, and 14A to 14C, the conditions for starting information projection onto the road surface are explained using the case where the turn signal 14 is illuminated as an example, but the system is not limited to this, and other conditions may be combined. For example, projection onto the road surface may be performed when the turn signal 14 is illuminated and a sufficient area for projection onto the road surface is secured, or when the road surface conditions, weather, and brightness are suitable for projection, or when other vehicles or people are detected around the vehicle 2, or when it is determined that the vehicle 2 has entered another lane or has started a lane change or merging operation based on steering angle information or sensor information that detects lanes, or when the vehicle is moving, or when it is moving and the speed is below a predetermined level. Furthermore, projection onto the road surface may be terminated when these conditions are no longer met or when the lane change or merging operation is completed.

[0141] Next, with reference to Figures 15A and 15B, an example of image display will be described when the number of lamps in the turn signal 14 matches the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2. In this embodiment, the image display will be described using the case where the number of lamps in the turn signal 14 matches the number of basic element images 20, but the number of lamps in the turn signal 14 is not limited; for example, if the projection unit has multiple lamps, it is sufficient that the number of lamps in the projection unit matches the number of basic device images 20.

[0142] In the example shown in the upper part of Figure 15A, when the turn signal 14 has four lamps, four basic element images 20 are projected onto the display area of ​​the road surface surrounding the vehicle 2. In the example shown in the lower part of Figure 15A, when the turn signal 14 has eight lamps, eight basic element images 20 are projected onto the display area of ​​the road surface surrounding the vehicle 2. Compared to the case shown in the upper part of Figure 15A, the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2 is greater in the case shown in the lower part of Figure 15A. On the other hand, the size of the display area of ​​the road surface surrounding the vehicle 2 onto which the basic element images 20 are projected does not change. Therefore, the more basic element images 20 are projected onto the display area of ​​the road surface surrounding the vehicle 2, the smaller the size of each basic element image 20 may be. Furthermore, the more basic element images 20 are projected onto the display area of ​​the road surface surrounding the vehicle 2, the narrower the spacing between each basic element image 20 may be. Furthermore, the more basic element images 20 are projected onto the display area of ​​the road surface surrounding the vehicle 2, the shorter the projection period of each basic element image 20 may be. Also, the size of one basic element image 20 projected onto a single display area within one period may differ from the size of other basic element images 20, and the spacing between basic element images 20 may also differ. For example, the size of the basic element images 20 may gradually decrease as one moves away from the vehicle 2. In addition, the size, number, and spacing of the projected basic element images 20 may be changed according to the determination result of the surrounding conditions of the vehicle 2 based on vehicle information such as speed information and gear information. Furthermore, the size, number, and spacing of the projected basic element images 20 may differ in the projection areas 14a, 14b in front of the vehicle 2, the projection areas 19a, 19b to the sides, and the projection areas 17a, 17b behind the vehicle 2.

[0143] Furthermore, as shown in Figure 15B, when the five lamps of the turn signal 14 illuminate sequentially from the inside to the outside of the vehicle 2 in a periodic manner, five basic element images 20 are projected sequentially in a direction away from the vehicle 2 onto the display area of ​​the road surface surrounding the vehicle 2 (for example, the projection area 14b on the front left). Specifically, the first basic element image 20 is projected when the first lamp illuminates, the second basic element image 20 is projected when the second lamp illuminates, ..., and the fifth basic element image 20 is projected when the fifth lamp illuminates. In other words, the timing of the illumination of the turn signal 14 lamps coincides with the timing of the projection of the basic element images 20.

[0144] On the other hand, the timing of the turn signal 14's illumination and the timing of the projection of the basic element image 20 do not have to coincide. For example, one projection cycle of the basic element image 20 may correspond to two illumination cycles of the turn signal 14. For example, if the vehicle 2 is traveling at a speed slower than 30 km / h, one projection cycle of the basic element image 20 may correspond to two illumination cycles of the turn signal 14, and if the vehicle 2 is traveling at a speed of 30 km / h or more, one projection cycle of the basic element image 20 may correspond to one illumination cycle of the turn signal 14. Furthermore, for example, if no other vehicle 2 or person is detected within a predetermined range around vehicle 2, one projection cycle of the basic element image 20 may correspond to two lighting cycles of the turn signal 14. If another vehicle 2 or person is detected within a predetermined range around vehicle 2, one projection cycle of the basic element image 20 may correspond to one lighting cycle of the turn signal 14, or two projection cycles of the basic element image 20 may correspond to one lighting cycle of the turn signal 14.

[0145] Next, with reference to Figures 16A to 16C, an example of image display when the number of lamps on the turn signal 14 does not match the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2 will be explained. In the example shown in Figure 16A, the turn signal 14 has eight lamps, while the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2 is four. In this case, for example, when the first lamp of the turn signal 14 lights up, moving from the inside of the vehicle 2 outwards, the first basic element image 20 is projected in the direction away from the vehicle 2. Also, when the third lamp of the turn signal 14 lights up, the second basic element image 20 is projected, when the fifth lamp of the turn signal 14 lights up, the third basic element image 20 is projected, and when the seventh lamp of the turn signal 14 lights up, the fourth basic element image 20 is projected.

[0146] In the example shown in Figure 16B, the turn signal 14 has five lamps, while the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2 is three. In this case, for example, when the first lamp of the turn signal 14 lights up, the first basic element image 20 is projected in the direction away from the vehicle 2, moving from the inside to the outside of the vehicle 2. Then, when the third lamp of the turn signal 14 lights up, the second basic element image 20 is projected, and when the fifth lamp of the turn signal 14 lights up, the third basic element image 20 is projected.

[0147] In the example shown in Figure 16C, the turn signal 14 has three lamps, while the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2 is six. In this case, for example, when the first lamp of the turn signal 14 lights up, the first and second basic element images 20 are projected in the direction away from the vehicle 2, moving from the inside to the outside of the vehicle 2. Also, when the second lamp of the turn signal 14 lights up, the third and fourth basic element images 20 are projected, and when the third lamp of the turn signal 14 lights up, the fifth and sixth basic element images 20 are projected. Alternatively, the first basic element image 20 is projected from the inside of the vehicle 2 toward the outside, in the direction away from the vehicle 2, at the timing when the first lamp of the turn signal 14 lights up; the second basic element image 20 is projected between the time the first lamp of the turn signal 14 lights up and the time when the second lamp lights up; the third basic element image 20 is projected at the timing when the second lamp of the turn signal 14 lights up; the fourth basic element image 20 is projected between the time the second lamp of the turn signal 14 lights up and the time when the third lamp lights up; the fifth basic element image 20 is projected at the timing when the third lamp of the turn signal 14 lights up; and the sixth basic element image 20 is projected between the time when the lighting cycle of the turn signal 14 ends and the next cycle begins.

[0148] As shown in Figures 16A to 16C, even if the number of lamps in the turn signal 14 does not match the number of basic element images 20 projected onto the display area of ​​the road surface surrounding the vehicle 2, the lighting cycles of the multiple lamps of the turn signal 14 can be synchronized with the projection cycles of the multiple basic element images 20, and the lighting timing of the lamps of the turn signal 14 can be matched with the projection timing of the basic element images 20.

[0149] Furthermore, the size of the projection areas 14a and 14b in front of the vehicle 2 may differ from the size of the projection areas 19a and 19b on the sides and the projection areas 17a and 17b at the rear. Therefore, the number of basic element images 20 projected onto the projection areas 14a and 14b in front, the number of basic element images 20 projected onto the projection areas 19a and 19b on the sides, and the number of basic element images 20 projected onto the projection areas 17a and 17b at the rear will differ, and will inevitably not match the number of lamps on the turn signal 14. However, by using the method shown in Figures 16A to 16C, the projection cycle of the multiple basic element images 20 projected onto each projection area can be synchronized with the lighting cycle of the multiple lamps on the turn signal 14, and the projection timing of the basic element images 20 onto each projection area can be matched with the lighting timing of the lamps on the turn signal 14. Therefore, even when projecting basic element images 20 onto the projection areas 14a, 14b in front of the vehicle 2 and the projection areas 19a, 19b to the sides, it is possible to prevent the projection cycle of one of the basic element images 20 in the front projection areas 14a, 14b and the projection areas 19a, 19b from not synchronizing with the illumination cycle of the turn signal 14, and the projection timing of one of the basic element images 20 in the front projection areas 14a, 14b and the projection areas 19a, 19b from not matching the illumination timing of the turn signal 14.

[0150] Furthermore, even if the size of the projection area changes depending on the road surface conditions around the vehicle 2, and the number of basic element images 20 that can be projected onto the projection area changes as a result, by changing the projection time of the basic element images 20 projected onto the projection area, the projection cycle of the multiple basic element images 20 projected onto each projection area can be synchronized with the lighting cycle of the multiple lamps of the turn signal 14, and the projection timing of the basic element images 20 onto each projection area can be matched with the lighting timing of the lamps of the turn signal 14.

[0151] Specifically, for example, in the example shown in Figure 16C, if the number of basic element images 20 that can be projected onto the projection area decreases from six to three midway through, the projection time of each basic element image 20 can be doubled to synchronize the projection cycle of multiple basic element images 20 with the illumination cycle of multiple lamps of the turn signal 14, and the projection timing of the basic element images 20 can be matched with the illumination timing of the lamps of the turn signal 14. Specifically, in the example shown in Figure 16C, the first basic element image 20 is projected in the direction away from the vehicle 2 at the timing when the first lamp of the turn signal 14 illuminates, the second basic element image 20 is projected at the timing when the second lamp of the turn signal 14 illuminates, and the third basic element image 20 is projected at the timing when the third lamp of the turn signal 14 illuminates.

[0152] Furthermore, in the example shown in Figure 16A, if the number of basic element images 20 that can be projected onto the projection area increases from four to eight midway through the process, the projection time of each basic element image 20 can be halved to synchronize the projection cycle of multiple basic element images 20 with the illumination cycle of multiple lamps of the turn signal 14, and the projection timing of the basic element images 20 can be matched with the illumination timing of the lamps of the turn signal 14. Specifically, in the example shown in Figure 16A, the first basic element image 20 is projected in the direction away from the vehicle 2 at the timing when the first lamp of the turn signal 14 illuminates, the second basic element image 20 is projected at the timing when the second lamp of the turn signal 14 illuminates, ..., and the eighth basic element image 20 is projected at the timing when the eighth lamp of the turn signal 14 illuminates.

[0153] Furthermore, the projection pattern of the basic element images 20 may be changed if certain conditions are met. For example, as described above, the projection pattern of the basic element images 20 may be changed according to the vehicle speed, the distance to other vehicles 2 or people around the vehicle 2, etc. (for example, the time interval between the projection of multiple basic element images 20 may be changed), in which case the lighting cycle of the turn signal lamp 14 and the projection cycle of the basic element images 20 do not have to be synchronized. For example, when the vehicle 2 is stopped, multiple basic element images 20 are projected so that the lighting cycle of the turn signal lamp 14 and the projection cycle of the basic element images 20 are synchronized, but when the vehicle 2 starts moving, the time interval between the projection of multiple basic element images 20 may be shortened.

[0154] Furthermore, the more basic element images 20 are projected onto the road surface, the smaller the size of each basic element image 20 may be. Conversely, the fewer the basic element images 20 are, the larger the size of each basic element image 20 may be. For example, if the light source for projecting the basic element images 20 is composed of multiple LEDs, the size of the basic element images 20 and the distance between multiple basic element images 20 can be adjusted by setting the lighting position of the LEDs based on acquired information about the vehicle and the road surface. Alternatively, the size of the basic element images 20 may be changed by changing the opening of the light shield, or by changing the optical magnification of the projection device. For example, when driving on a wide road, the size of each basic element image 20 may be set to be larger. When driving at a low speed, the size of each basic element image 20 may be set to be larger. Also, when one lamp projects one or more basic element images 20, a light shield divided into multiple regions is used to control the light distribution according to the number of basic element images 20 projected by one lamp. The shape and size of each region of the light shield divided into multiple regions may be different. Based on information regarding the vehicle and the road surface, the focusing surface may be adjusted to match the shape and size of the basic element images 20 to be projected. Furthermore, the brightness of each basic element image may be made brighter or darker depending on information such as the road surface and weather (rain, etc.). Alternatively, if the relative distance between pedestrians or vehicles and surrounding objects increases due to factors such as driving speed or multiple lanes, the spacing between the basic element images 20 may be adjusted to prevent the spatial frequency from increasing due to the narrowing of the spacing between elements during oblique viewing.

[0155] Next, with reference to Figures 17A and 17B, an example of image display when vehicle 2 turns a corner or curve will be described. Figure 17A shows an example of multiple basic element images 20 projected onto the road surface around vehicle 2 when vehicle 2 turns a sharp corner. On the other hand, Figure 17B shows an example of multiple basic element images 20 projected onto the road surface around vehicle 2 when vehicle 2 turns a gentle curve. Whether vehicle 2 is turning a sharp corner or a gentle curve may be determined, for example, based on GPS information or navigation information. As shown in Figures 17A and 17B, when vehicle 2 is turning a sharp corner, the number of projected basic element images 20 may be reduced and the size of the projected basic element images 20 may be increased compared to when vehicle 2 is turning a gentle curve. This can improve the visibility of the basic element images 20. On the other hand, when vehicle 2 is turning a gentle curve, the size of the projected basic element images 20 may be reduced and the number of projected basic element images 20 may be increased compared to when vehicle 2 is turning a sharp corner. This allows vehicle 2 to present the gentle curve it is about to turn to its surroundings.

[0156] Furthermore, the projection pattern of the projected basic element images 20 may be changed as the vehicle 2 moves. Specifically, before the vehicle 2 enters a corner or curve, multiple basic element images 20 may be projected as shown in Figures 17A and 17B, and after the vehicle 2 enters a corner or curve, the projection of the basic element images 20 may be sequentially terminated depending on where the vehicle 2 is traveling on the corner or curve. For example, in the example shown in Figure 17B, when the vehicle 2 has entered the middle of the curve, the projection of the first to third or fourth basic element images 20 corresponding to the part of the curve that the vehicle 2 has finished traveling on may be terminated. Alternatively, in the example shown in Figure 17B, when the vehicle 2 has entered the middle of the curve, the projection of the first to third or fourth basic element images 20 corresponding to the part of the curve that the vehicle 2 has finished traveling on may be left on, and the remaining basic element images 20 may be sequentially projected in the direction of travel of the vehicle 2.

[0157] Furthermore, when vehicle 2 turns a sharp corner, the projection period of the multiple basic element images 20, which are sequentially projected in the direction of travel of vehicle 2, may be shortened. This makes it possible to represent the sharpness of the corner that vehicle 2 is turning through the projection of the multiple basic element images 20. Alternatively, in the example shown in Figure 17A, the first and second basic element images 20 may be projected in the direction of travel of vehicle 2 at the normal projection time interval, and the third basic element image 20 may be projected at a shorter projection time interval. In other words, the projection time interval of the multiple basic element images 20 projected onto a single projection area does not have to be constant.

[0158] In the examples shown in Figures 18A and 18B, and Figures 19A and 19B, the conditions for starting information projection onto the road surface are explained using the case where the turn signal 14 is illuminated as an example, but the system is not limited to this and other conditions may be combined. For example, projection onto the road surface may be performed when the turn signal 14 is illuminated and a sufficient area for projection onto the road surface is secured, or when the road surface conditions, weather, and brightness are suitable for projection, or when other vehicles or people are detected around the vehicle 2, or when it is determined based on navigation information, etc., that the vehicle 2 is about to enter an intersection but has not yet entered the intersection, or when the vehicle 2 is moving, or is moving and its speed is below a predetermined level. Furthermore, projection onto the road surface may be terminated when these conditions are no longer met or when a lane change or merging operation is completed. Next, with reference to Figures 18A and 18B, an example of image display when the vehicle 2 turns right at an intersection will be explained.

[0159] Figure 18A shows an example of multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 when the distance D from the point where the vehicle's turn signal 14 starts to illuminate to the intersection is relatively long and the vehicle's speed is relatively slow. On the other hand, Figure 18B shows an example of multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 when the distance d from the point where the vehicle's turn signal 14 starts to illuminate to the intersection is relatively short (D > d) and the vehicle's speed is relatively fast. The distance from vehicle 2 to the intersection and the vehicle's speed may be estimated based on, for example, speed information, GPS information, and navigation information. As shown in Figures 18A and 18B, the projection pattern of the multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 may be changed according to the time until vehicle 2 enters the intersection. Specifically, if the time until vehicle 2 enters the intersection is relatively long, multiple basic element images 20 may be projected in the normal projection manner, and if the time until vehicle 2 enters the intersection is relatively short, multiple basic element images 20 may be projected in a projection manner modified from the normal projection manner. More specifically, as shown in Figure 18A, if the time until vehicle 2 enters the intersection is relatively long, three of the six basic element images 20 are projected from the side closest to vehicle 2 in a direction indicating the direction of vehicle 2's movement at that moment, and the remaining three basic element images 20 are projected in a direction indicating the direction in which vehicle 2 will turn at the intersection. On the other hand, as shown in Figure 18B, if the time until vehicle 2 enters the intersection is relatively short, two of the six basic element images 20 are projected from the side closest to vehicle 2 in a direction indicating the direction of vehicle 2's movement at that moment, and the remaining four basic element images 20 are projected in a direction indicating the direction in which vehicle 2 will turn at the intersection. By changing the projection pattern in this way, it is possible to represent that the time it takes for vehicle 2 to enter the intersection is relatively short.

[0160] Note that the changes in projection patterns are not limited to the example shown in Figure 18B. For example, all of the six basic element images 20 may be projected sequentially in a direction indicating the direction in which the vehicle 2 will turn at the intersection. Alternatively, if the time until the vehicle 2 enters the intersection is relatively short, the number of basic element images 20 to be projected may be reduced, and all of the basic element images 20 may be projected in a direction indicating the direction in which the vehicle 2 will turn at the intersection. When reducing the number of basic element images 20 to be projected, the projection period of the basic element images 20 may be shortened by keeping the projection time interval of each basic element image 20 the same as before reducing the number of basic element images 20. This makes it possible to inform the surroundings that the vehicle 2 will turn at the intersection earlier.

[0161] Furthermore, in the example shown in Figure 18B, the two basic element images 20 indicating the current direction of travel of vehicle 2 may be projected as is, while the remaining four basic element images 20 indicating the direction in which vehicle 2 will turn at the intersection may be projected sequentially in a direction away from vehicle 2. This makes it possible to emphasize the direction in which vehicle 2 will turn at the intersection.

[0162] Furthermore, if the time until vehicle 2 enters the intersection is relatively short, the remaining multiple basic element images 20 indicating the direction in which vehicle 2 will turn at the intersection may be projected periodically and sequentially toward the side of vehicle 2 (the right side of vehicle 2 in the example shown in Figure 18B), moving away from vehicle 2.

[0163] Furthermore, if the time until vehicle 2 enters the intersection is relatively short, all of the six basic element images 20 may be projected simultaneously in a direction indicating the direction in which vehicle 2 is turning at the intersection. This allows the direction in which vehicle 2 is turning at the intersection to be immediately displayed to the surroundings. The six basic element images 20 that were projected simultaneously may remain projected until vehicle 2 has finished turning at the intersection. Alternatively, the six basic element images 20 that were projected simultaneously may be made to blink until vehicle 2 has finished turning at the intersection. Alternatively, after projecting the six basic element images 20 simultaneously, the basic element images 20 may be projected sequentially in a direction away from vehicle 2 until vehicle 2 has finished turning at the intersection.

[0164] Next, with reference to Figures 19A and 19B, other examples of image display when vehicle 2 turns right at an intersection will be described. Figure 19A shows an example of multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 when the distance D from the point where the vehicle 2's turn signal 14 starts to light up to the intersection is relatively long and the vehicle 2 is traveling at a relatively slow speed. On the other hand, Figure 19B shows an example of multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 when the distance d from the point where the vehicle 2's turn signal 14 starts to light up to the intersection is relatively short (D > d) and the vehicle 2 is traveling at a relatively fast speed. As shown in Figures 19A and 19B, the projection pattern of the multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 may be changed depending on the time until vehicle 2 enters the intersection. Specifically, if the time until vehicle 2 enters the intersection is relatively long, multiple basic element images 20 may be projected in the normal projection mode, or if the time until vehicle 2 enters the intersection is relatively long, multiple basic element images 20 may be projected in a projection mode modified from the normal projection mode. More specifically, as shown in Figure 19A, if the time until vehicle 2 enters the intersection is relatively long, the projection period length of the multiple basic element images 20 (six basic element images 20 in Figures 19A and 19B) is set to the normal 200 msec. As shown in Figure 19B, if the time until vehicle 2 enters the intersection is relatively short, the projection period length is temporarily shortened to, for example, 150 msec, in order to indicate the direction in which vehicle 2 will turn at the intersection by projecting multiple basic element images 20 (six basic element images 20 in Figures 19A and 19B) within that short time. By changing the projection pattern in this way, even if the time until vehicle 2 enters the intersection is relatively short, the fact that vehicle 2 is turning at the intersection can be represented by the projection of multiple basic element images 20. Furthermore, if the time from the point where the vehicle 2's turn signal 14 starts to light up until vehicle 2 enters the intersection is longer than the general average, for example, the projection period of the multiple basic element images 20 can be temporarily made longer than usual, for example, to 250 msec.

[0165] Furthermore, after temporarily shortening the projection period of the multiple basic element images 20 to a shorter length than normal, once vehicle 2 has finished turning at the intersection, the projection period of the multiple basic element images 20 is returned to its normal length. However, if it is determined that the time it takes for vehicle 2 to enter the intersection tends to be relatively short due to the driver's habits, etc., the setting may be changed so that the normal projection period is always shorter, rather than only temporarily. Also, if it is determined that the time it takes for vehicle 2 to enter the intersection tends to be relatively long, the setting may be changed so that the normal projection period is always longer, rather than only temporarily.

[0166] Furthermore, the changes in projection patterns are not limited to the example shown in Figure 19B. For example, in the example shown in Figure 19B, the first basic element image 20 (the basic element image 20 closest to the vehicle 2) and the sixth basic element image 20 (the basic element image 20 furthest from the vehicle 2) may be projected first, and while continuing this projection, the second to fifth basic element images 20 may be projected sequentially in a direction away from the vehicle 2. Alternatively, all six basic element images 20 may be projected simultaneously, and after continuing the projection for a certain period of time, the six basic element images 20 may be projected sequentially in a direction away from the vehicle 2. This makes it possible to inform the surroundings early that the vehicle 2 is turning at an intersection.

[0167] When vehicle 2 turns at an intersection, the projection pattern of the multiple basic element images 20 projected onto the display area of ​​the road surface surrounding vehicle 2 may be changed. For example, the number, orientation, and position of the basic element images 20 displayed on the road surface surrounding vehicle 2 may be changed according to the progress of vehicle 2's right or left turn. For example, in the examples shown in Figures 18A and 18B, or Figures 19A and 19B, before vehicle 2 turns at an intersection, all six basic element images 20 may be projected periodically, and while vehicle 2 is turning at an intersection, the number of projected basic element images 20 may decrease according to the progress of vehicle 2's right or left turn. Alternatively, the orientation (angle) of the basic element image 20 indicating the direction in which vehicle 2 is turning at an intersection may be gradually changed according to the progress of vehicle 2's right or left turn, and when vehicle 2 has finished turning at an intersection, the orientation of all basic element images 20 may indicate the direction of vehicle 2's travel.

[0168] According to the embodiment described above, as an example, multiple basic element images 20 can be projected onto the road surface surrounding the vehicle 2 in accordance with the lighting timing of multiple lamps of the chain-type turn signal 14. Specifically, based on the turn signal lighting information, the projection timing of each of the multiple basic element images 20 is determined to correspond to the lighting timing of at least some of the multiple lamps included in the turn signal 14, and the projection of the multiple basic element images 20 is controlled based on said projection timing. As a result, multiple basic element images 20 can be projected onto the road surface surrounding the vehicle 2 in accordance with the lighting timing of multiple lamps of the chain-type turn signal 14.

[0169] It should be noted that the present invention is not limited to the embodiments described above, but includes various modifications and equivalent configurations within the spirit of the attached claims. For example, the embodiments described above are described in detail for the purpose of clearly illustrating the present invention, and the present invention is not necessarily limited to having all of the described configurations. Also, for example, some of the configurations of the embodiments may be added, deleted, or replaced with other configurations.

[0170] Furthermore, the projection pattern of the multiple basic element images 20 may be changed depending on whether the vehicle 2 is traveling downhill or uphill. For example, when the vehicle 2 is traveling downhill, the size of the basic element images 20 may be made smaller in the direction away from the vehicle 2. This can represent the vehicle 2 going downhill. On the other hand, when the vehicle 2 is traveling uphill, the size of the basic element images 20 may be made larger in the direction away from the vehicle 2. This can represent the vehicle 2 going uphill. Alternatively, when the vehicle 2 is traveling downhill, the number of projected basic element images 20 may be increased and the size of the basic element images 20 may be made smaller. On the other hand, when the vehicle 2 is traveling uphill, the number of projected basic element images 20 may be decreased and the size of the basic element images 20 may be increased. Alternatively, when vehicle 2 is traveling downhill, the projection period of the basic element image 20 may be shortened, and when vehicle 2 is traveling uphill, the projection period of the basic element image 20 may be lengthened. This allows multiple basic element images 20 to be projected quickly, making it possible to represent vehicle 2 going downhill.

[0171] Furthermore, when the six basic element images 20 are projected sequentially in a direction away from the vehicle 2, when the vehicle 2 is traveling downhill, the projection time interval for the first three basic element images 20 from the side closest to the vehicle 2 may be made longer, and the projection time interval for the remaining three basic element images 20 may be made shorter. On the other hand, when the vehicle 2 is traveling uphill, the projection time interval for the first three basic element images 20 from the side closest to the vehicle 2 may be made shorter, and the projection time interval for the remaining three basic element images 20 may be made longer. This makes it possible to represent the vehicle 2 going downhill and the vehicle 2 going uphill.

[0172] Furthermore, the periodic projection of multiple basic element images 20 described above can also be applied to the illumination of a single turn signal 14, which is not a chain reaction. Specifically, for example, multiple basic element images 20 may be projected sequentially in a direction away from the vehicle 2, in time with the flashing of one lamp of the turn signal 14.

[0173] Furthermore, by using the technology according to the above embodiment, necessary information such as images for the driver and images for people around the vehicle can be appropriately displayed. This makes it possible to provide an information projection device that contributes to safe driving, and consequently, helps to reduce traffic accidents. Moreover, it becomes possible to contribute to "3. Good Health and Well-being" of the United Nations' Sustainable Development Goals (SDGs).

[0174] This application claims priority based on Japanese Patent Application No. 2025-024326, filed on 18 February 2025, and incorporates all of its disclosures herein. Potential for industrial use

[0175] This technology can provide a more appropriate display of video for the driver and video for people around the vehicle.

[0176] 2. Vehicle 11. Projection device 13. Headlamp 14. Turn signal 100. Controller

Claims

1. An information projection device comprising: an acquisition unit for acquiring vehicle information relating to a vehicle; and a projection unit for projecting one or more basic element images onto the periphery of the vehicle, wherein the projection unit projects the one or more basic element images at the projection timing of the basic element images based on the vehicle information relating to the vehicle acquired by the acquisition unit.

2. An information projection device according to claim 1, wherein the basic element images are a plurality, and the projection unit performs projection to start projecting the basic element images onto the road surface surrounding the vehicle based on information from when the vehicle's turn signal lights up until it turns off, and to complete projection of all the basic element images that constitute an image showing the vehicle's movement.

3. An information projection device according to claim 1, wherein the basic element images are a plurality of, and the projection unit projects the plurality of basic element images in such a manner that it repeats a projection cycle in which it sequentially projects the basic element images toward a predetermined direction, and after all of the basic element images have been projected, it completes the projection of all of the basic element images.

4. An information projection device according to claim 2, wherein the basic element image is a chevron-shaped image, and the device projects a plurality of basic element images such that at least some of the basic element images indicate the turning direction of the vehicle indicated by the turn signal or steering angle.

5. An information projection device according to claim 3, wherein the length of the projection period is shorter than the lighting period of the lamp of the direction indicator.

6. An information projection device according to claim 1, wherein the projection unit projects a plurality of the basic element images so as to project a plurality of the basic element images simultaneously.

7. An information projection device according to claim 2, which controls the projection of a plurality of basic element images such that the timing of lighting one or more of the plurality of lamps of the direction indicator coincides with the projection timing of one or more of the plurality of basic element images.

8. An information projection device according to claim 7, wherein the number of basic element images is less than the number of lamps constituting the direction indicator.

9. An information projection device according to claim 7, wherein the number of basic element images is the same as the number of lamps constituting the direction indicator.

10. An information projection device according to claim 7, wherein the projection unit changes the projection mode of a plurality of basic element images when it determines that a predetermined condition is met based on the vehicle information.

11. An information projection device according to claim 1, wherein the vehicle information includes GPS information and navigation information, and further comprises a processor, wherein the processor determines the shape of the path in the direction of travel of the vehicle based on the vehicle information, and controls the projection of one or more basic element images to represent the shape of the path.

12. An information projection device according to claim 2, wherein the projection of a plurality of basic element images is controlled such that the size of the basic element images decreases as the number of the plurality of basic element images increases.

Images