Information projection device

Abstract

To provide a technology that enables more appropriate display of images for the driver and images for people around the vehicle. According to this invention, it contributes to Sustainable Development Goal 3, "Good Health and Well-being." [Solution] The information projection device comprises an acquisition unit that acquires vehicle information relating to a vehicle, and a projection unit that projects images. Based on the vehicle information acquired by the acquisition unit, the projection unit projects a rectangular image, which is projected linearly to the left and right sides of the vehicle, and when detecting the turning direction of the vehicle, it projects the image to display and transmit the turning direction.

Description

Technical Field

[0001] The present invention relates to an information projection device, an information projection system, and an information projection method.

Background Art

[0002] As shown in Patent Document 1 and Patent Document 2, a technology for projecting information onto a road surface is known.

[0003] Patent Document 1 discloses a vehicle-mounted projection device for projecting a route guidance image onto the road surface in front of the host vehicle. This vehicle-mounted projection device includes a route search means for searching for the current position of the host vehicle and the route from the current position to a set destination, and a projection means for projecting a route guidance image for guiding the host vehicle in the branch direction onto the road surface in front of the host vehicle based on the route information searched by the route search means when the host vehicle approaches a branch point on the route to such an extent that a passenger can visually recognize it.

[0004] Patent Document 2 discloses a technology capable of easily attracting the attention of a moving object such as a pedestrian, and as an example, discloses a road surface projection method. This road surface projection method includes a step of pre-storing image data of an image to be projected onto the road surface, a step of monitoring the surrounding area of the host vehicle, a step of discriminating a moving object based on the monitoring result, a step of setting a discrimination area in the monitored surrounding area, and a step of reading out the pre-stored image data and projecting the image onto the road surface position near the moving object when the discriminated moving object exists in the discrimination area.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

[0006] The challenge lies in providing technology that can more appropriately display video for the driver and video for surrounding vehicles and people. [Means for solving the problem]

[0007] Furthermore, according to an embodiment of the present invention, the following information projection device is provided. This information projection device comprises an acquisition unit that acquires vehicle information relating to a vehicle, and a projection unit that projects an image. Based on the vehicle information acquired by the acquisition unit, the projection unit projects a projection image, which is a rectangular image projected linearly to the left and right sides of the vehicle, and when detecting the turning direction of the vehicle, it projects the projection image to display and transmit the turning direction. [Effects of the Invention]

[0008] The present invention provides a technology that enables more appropriate display of images for the driver and images for surrounding vehicles and people. Other problems, configurations, and effects will be clarified by the following description of embodiments for carrying out the invention. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of a vehicle equipped with an information projection device. [Figure 2] This is a diagram showing an example of a configuration installed in a vehicle. [Figure 3A] This figure shows an example of video display when information is projected onto the road surface in front of the vehicle. [Figure 3B] This figure shows an example of video display when information is projected onto the road surface behind the vehicle. [Figure 4A] This figure shows an example of the configuration of a projection device. [Figure 4B] This figure shows an example of the configuration of a projection device. [Figure 4C] This figure shows an example of the configuration of a projection device. [Figure 5A] This is a diagram for explaining an example of the arrangement of optical components and the like. [Figure 5B] This is a diagram for explaining an example of the arrangement of optical components and the like. [Figure 5C] This is a diagram for explaining an example of the arrangement of optical components and the like. [Figure 6] This is a diagram showing an example of the display area of the video viewed by the driver. [Figure 7] This is a diagram for explaining an example of the display area onto which video light is projected. [Figure 8] This is a flowchart for explaining an example of information projection. [Figure 9] This is a diagram showing an example of image display when information is projected to the rear of the vehicle. [Figure 10] This is a diagram showing an example of image display when information is projected to the rear of the vehicle. [Figure 11A] This is a diagram for explaining the control amount of the projected image. [Figure 11B] This is a diagram for explaining the control amount of the projected image.

Mode for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiments are examples for explaining the present invention, and for the sake of clarity of explanation, appropriate omissions and simplifications have been made. The present invention can also be implemented in various other forms. Unless otherwise particularly limited, each component may be singular or plural.

[0011] In the drawings, the positions, sizes, shapes, ranges, etc. of the respective components shown may not represent the actual positions, sizes, shapes, ranges, etc. in order to facilitate understanding of the invention. Therefore, the present invention is not necessarily limited to the positions, sizes, shapes, ranges, etc. disclosed in the drawings.

[0012] As examples of various types of information, it may be described using expressions such as "table", "list", "queue", etc., but the various types of information may be represented by data structures other than these. For example, various types of information such as "XX table", "XX list", "XX queue", etc. may be referred to as "XX information". When explaining identification information, expressions such as "identification information", "identifier", "name", "ID", "number", etc. are used, and these can be replaced with each other.

[0013] When there are multiple components having the same or similar functions, they may be described with the same reference numeral and different subscripts. Also, when it is not necessary to distinguish these multiple components, the subscripts may be omitted in the description.

[0014] In the embodiments, the processes performed by executing a program may be described. Here, the computer executes the program by a processor (e.g., CPU, GPU), and performs the processes defined in the program while using storage resources (e.g., memory) and interface devices (e.g., communication ports), etc. Therefore, the subject of the processes performed by executing the program may be the processor. Similarly, the subject of the processes performed by executing the program may be a controller, device, system, computer, or node having a processor. The subject of the processes performed by executing the program may be an arithmetic unit and may include a dedicated circuit for performing specific processes. Here, the dedicated circuit is, for example, an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), a CPLD (Complex Programmable Logic Device), etc.

[0015] The program may be installed on the computer from the program source. The program source may be, for example, a program distribution server or a storage medium readable by the computer. If the program source is a program distribution server, the program distribution server includes a processor and storage resources for storing the program to be distributed, and the processor of the program distribution server may distribute the program to other computers. In addition, in some embodiments, two or more programs may be implemented as a single program, or one program may be implemented as two or more programs.

[0016] In this embodiment, an example of a technology for displaying information on the road surface using a projection device mounted on a vehicle will be described. In this embodiment, with respect to the vehicle and driver, the horizontal direction is the left-right direction, the lateral direction of the vehicle, or the width direction of the vehicle; the vertical direction is the up-down direction of the vehicle, or the longitudinal direction; and the perpendicular direction, which is orthogonal to the lateral or longitudinal direction of the vehicle, is the longitudinal direction of the vehicle, or the direction of travel of the vehicle.

[0017] Figure 1 is a diagram illustrating the vehicle's layout. As shown in Figure 1, vehicle 2 includes, for example, a projection device 11 (information projection device), an in-vehicle video display device 12, a car navigation system 150, a headlamp 13 (i.e., headlights 13), a taillight, a turn signal 14, and a controller 100. Vehicle 2 also has an in-vehicle system 300 that includes these components. This in-vehicle system 300 implements an in-vehicle network, and the controller 100 can send and receive data or information with these components, and other components described later. The in-vehicle system 300 implements, for example, CAN (Controller Area Network), in-vehicle Ethernet, and LIN (Local Interconnect Network).

[0018] Furthermore, the in-vehicle system 300 can communicate with the outside of the vehicle via a communication device. Examples of communication with the outside of the vehicle include direct communication and indirect communication. In direct communication, the 760MHz band, 5.9GHz band, etc., are used internationally as ITS (Intelligent Transport System) communication bands, and direct communication is performed between vehicles, between vehicles and infrastructure, and between vehicles and pedestrians. In contrast, indirect communication uses mobile phone bands other than 5.9GHz, and indirect communication is performed via a mobile carrier network. The in-vehicle system 300 can, for example, send and receive data or information with a server 24 connected to the network 21 via an access point 22 or relay station 23 on the network 21. The in-vehicle system 300 may also communicate with other vehicles, external devices 25, or information terminals 26 carried by pedestrians, or with infrastructure such as terminals installed on the roads on which the vehicle is traveling. As an example of vehicle-to-infrastructure communication, traffic congestion information and weather information are received using radio beacons or optical beacons.

[0019] Vehicle information 4, an example of data or information acquired by the in-vehicle system 300, includes, for example, in-vehicle sensor information such as speed information, gear information, steering angle information, lamp illumination information, ambient light information, distance information, infrared information, engine ON / OFF information, camera image information, acceleration gyro information, GPS information, navigation information, vehicle-to-vehicle communication information, vehicle-to-infrastructure communication information, pedestrian-to-vehicle communication information, Lidar (Light Detection and Ranging), road surface condition information, raindrop-related information, and wiper-related information. Camera image information includes in-vehicle camera image information and exterior camera image information. GPS information includes current time information, latitude and longitude information. This vehicle information can be acquired, for example, from sensors described later.

[0020] Furthermore, vehicle information 4 includes information entered by the driver. The driver can enter information using an appropriate device for inputting information. This device may be one that is pre-installed in the vehicle. Alternatively, this device may be an external device that can be connected to the in-vehicle system 300 by wire or wireless, such as an input device, tablet, smartphone, wearable device including AR (Augmented Reality) glasses and HMD (Head Mounted Display), or personal computer.

[0021] The in-vehicle system 300 can perform various types of control, such as driving control and display control, using the acquired data or information.

[0022] The projection device 11 projects video light for displaying information. A specific configuration example of the projection device 11 will be described later. The driver and people around the vehicle 2, that is, pedestrians walking near the vehicle, drivers and passengers of other vehicles traveling near the vehicle, etc., can see the video projected by the projection device 11.

[0023] The in-vehicle video display device 12 generates video light for displaying information and projects the video light toward a predetermined display area 5 on the windshield 3. In this way, the in-vehicle video display device 12 superimposes, for example, a virtual image corresponding to the displayed video onto the scenery, making it visible to the vehicle driver (from the driver's perspective). In this example, video light is projected toward the display area 5 of the windshield 3, but the projection unit that projects the video light may also be a projection member such as a combiner. The in-vehicle video display device 12 can be, for example, a known HUD (Head-Up Display) comprising a light source, a display panel that forms the displayed video, a control unit, and so on.

[0024] The CarNavi 150 is an electronic device called a car navigation system. For example, the CarNavi 150 uses map information and GPS location data to show the current location and the route to the destination. The CarNavi 150 can also use traffic information such as VICS (Vehicle Information and Communication System, registered trademark) to present an efficient route to the destination.

[0025] In this example, the headlights 13 are provided in pairs on the left and right sides at the front of the vehicle. Inside the headlights 13 are lamps, which are light-emitting elements. The turn signals 14 are devices used to indicate the direction to the surroundings when turning right or left, changing lanes, etc., and like the headlights 13, they are provided in pairs on the left and right sides at the front of the vehicle.

[0026] The controller 100 is an electronic control unit (ECC) mounted in the vehicle 2, and as an example, comprises a processing unit (e.g., a central processing unit), a memory device, and an input / output device (I / O unit). The memory device can be configured using, for example, main memory and auxiliary memory. The main memory is the work area of ​​the processing unit, and the processing unit stores data in the main memory and performs data processing. The main memory is, for example, RAM (Random Access Memory). The auxiliary memory is a non-volatile storage device that stores data non-volatilely. The auxiliary memory is, for example, ROM (Read Only Memory).

[0027] The controller 100 receives data or information via input / output devices and the in-vehicle network. Furthermore, the controller 100 can control various devices connected to the in-vehicle network via the input / output devices and the in-vehicle network.

[0028] The controller 100 receives, for example, vehicle information 4 and information obtained from the server 24 via an input / output device. Based on the acquired information, the controller 100 may then control the operation of the headlights 13, the turn signals 14, the projection device 11, the in-car video display device 12, the car navigation system 150, and so on.

[0029] The projection device 11 may be connected to various sensors mounted on the vehicle 2, devices mounted on the vehicle 2 (for example, a car navigation system 150), communication devices used for communication with the outside of the vehicle, etc., and may acquire data or information. The projection device 11 may then use the acquired data or information to generate video light for displaying the information and project the video light.

[0030] Furthermore, the projection device 11 can omit communication with the controller 100. Here, the projection device 11 can acquire data or information from a configuration different from the controller 100, for example, through communication based on CAN, in-vehicle Ethernet, etc. The same can be applied to the in-vehicle video display device 12.

[0031] Alternatively, the controller 100 may generate video data using the acquired data or information, transmit the generated video data to the projection device 11, and the projection device 11 may generate video light for displaying information based on the video data generated by the controller 100 and project the video light. On the other hand, the controller 100 may not generate video data, and the video generation unit 527 (described later) may generate the video data and transmit the generated video data to the projection device 11. Here, the controller 100 and the projection device 11 may communicate based on, for example, FPD-Link III, GMSL (Gigabit Multimedia Serial Link), and the projection device 11 may acquire video data from the controller 100. The projection device 11 may also perform video processing on the acquired video data, which includes processing related to image distortion correction, color correction, brightness correction, contrast correction, and conversion (e.g., decoding). The video data may be stored in advance in the memory of the controller or projection device, or it may be processed in real time without being stored in memory. If the controller or projection device's memory holds the data in advance, the stored video data may be modified sequentially by system updates or user operations via wired or wireless methods. Similarly, the projection device 11 may be connected to various sensors mounted in the vehicle, devices mounted in the vehicle 2 (e.g., a car navigation system 150), communication devices used for communication with the outside of the vehicle, etc., and may acquire data or information through communication based on CAN, in-vehicle Ethernet, etc. The projection device 11 may then generate video light for displaying information based on the acquired information and project the video light. The same can be applied to the in-vehicle video display device 12.

[0032] Furthermore, the controller 100 may control the headlights 13 and the projection device 11 in coordination. For example, the controller 100 may turn on the headlights 13 and cause the projection device 11 to project image light in front of the vehicle. Alternatively, the controller 100 may turn off the headlights 13 and cause the projection device 11 to generate an image of the information to be displayed and project the image light in front of the vehicle. In other words, the headlights 13 and the projection device 11 may operate in coordination via the controller 100.

[0033] On the other hand, the headlights 13 and projection device 11 may operate without the controller 100. For example, the headlights 13 and projection device 11 may be connected, and the operation of the headlights 13 may be controlled by the projection device 11 (more specifically, the control unit of the projection device 11). The projection device 11 may, for example, turn on the headlights 13, generate an image of the information to be displayed, and project the image light in front of the vehicle. Alternatively, the projection device 11 may, for example, turn off the headlights 13, generate an image of the information to be displayed, and project the image light in front of the vehicle.

[0034] For example, the projection device 11 may be mounted on the front of the vehicle body, and the image light from the projection device 11 may be projected onto the road surface in front of the vehicle. The projection device 11 may also be mounted, for example, near the roof of the vehicle body 2. Alternatively, the projection device 11 may be mounted, for example, on the side mirror area, on the roof, on the side or bottom of the vehicle body 2. However, the present invention is not limited to these examples.

[0035] The projection device 11 may be installed as a single unit or in multiple units. For example, a pair of projection devices 11 may be installed at the front of the vehicle 2. Alternatively, the projection device 11 may be integrated into the headlight 13, for example. If the projection device 11 is integrated into the headlight 13, the light source of the headlight 13 can also be used as the light source for projection.

[0036] For example, the projection device 11 may be mounted on the rear of the vehicle body, and the image light from the projection device 11 may be projected onto the road surface behind the vehicle. Alternatively, a pair of projection devices 11 may be mounted on the rear end of the vehicle 2. Furthermore, the projection device 11 may be integrated into the interior of a taillight, for example. When the projection device 11 is integrated into the interior of a taillight, the light source of the taillight can also be used as the light source for projection. The taillight described above may also be a stop lamp or a reverse lamp, and the following description of a taillight may be replaced with a stop lamp or a reverse lamp.

[0037] Furthermore, the controller 100 may control the taillights and the projection device 11 in coordination. For example, the controller 100 may turn on the taillights and cause the projection device 11 to generate an image of the information to be displayed, and project the image light to the rear of the vehicle. Alternatively, the controller 100 may turn off the taillights and cause the projection device 11 to generate an image of the information to be displayed, and project the image light to the rear of the vehicle. In other words, the taillights and the projection device 11 may operate in coordination via the controller 100.

[0038] On the other hand, the taillights and projection device 11 may operate without the controller 100. For example, the taillights and projection device 11 may be connected, and the operation of the taillights may be controlled by the projection device 11 (more specifically, the control unit of the projection device 11). The projection device 11 may, for example, turn on the taillights, generate an image of the information to be displayed, and project the image light to the rear of the vehicle. Alternatively, the projection device 11 may, for example, turn off the taillights, generate an image of the information to be displayed, and project the image light to the rear of the vehicle.

[0039] Furthermore, the controller 100 may control the turn signal 14 and the projection device 11 in coordination. For example, the controller 100 may turn on the turn signal 14, cause the projection device 11 to generate an image of the information to be displayed, and project the image light onto the front or rear of the side of the vehicle. Alternatively, the controller 100 may turn off the turn signal 14, cause the projection device 11 to generate an image of the information to be displayed, and project the image light onto the front or rear of the side of the vehicle. In other words, the turn signal 14 and the projection device 11 may operate in coordination via the controller 100. Furthermore, the turning on and off of the turn signal 14 may be controlled by the driver. As an example, the projection device may be provided to project the image light toward the road surface on the side of the vehicle 2.

[0040] Information such as vehicle information 4 is acquired using devices such as cameras and various sensors. Figure 2 shows an example of how the controller 100 is connected to various devices. Furthermore, control units such as the projection device 11, in-vehicle video display device 12, and car navigation system 150 are connected to the devices shown in Figure 2, making it possible to acquire information directly without going through the controller 100. The various devices in Figure 2 can be deleted, other types of devices added, or replaced with other types of devices as appropriate.

[0041] The vehicle speed sensor 501 detects the speed of vehicle 2 and is used to generate speed information as a result of the detection. The shift position sensor 502 detects the current gear and is used to generate gear information as a result of the detection. The steering angle sensor 503 detects the current steering angle and is used to generate steering angle information as a result of the detection.

[0042] The headlight sensor 504 detects, for example, whether the headlight 13 is ON or OFF. The headlight sensor 504 may also detect the brightness of the headlight 13 when it is lit. The headlight sensor 504 is used to generate lamp illumination information, which is the result of the detection. The vehicle 2 may also be provided with a high / low sensor to detect whether the headlight 13 is high beam or low beam, and the high / low sensor is used to generate information indicating whether it is high beam or low beam. The vehicle 2 may also be provided with a taillight sensor (not shown). The taillight sensor detects, for example, whether the taillight is ON or OFF. The taillight sensor may also detect the brightness of the taillight when it is lit. The taillight sensor is used to generate lamp illumination information, which is the result of the detection. Similarly, although not shown, sensors may be provided to detect the ON / OFF status and illumination brightness of stop lamps, reverse lamps, hazard lamps, and turn signals 14.

[0043] The illuminance sensor 505 and the chromaticity sensor 506 detect ambient light from the vehicle 2 and are used to generate ambient light information as detection results. The chromaticity sensor 506 may also be used to detect the color of the road surface around the vehicle 2 and generate projected surface color information as detection results. The distance measuring sensor 507 detects the distance between the vehicle 2 and an external object, or the distance between external objects, and is used to generate distance information as detection results. The infrared sensor 508 detects the presence and distance of objects in the vicinity of the vehicle and is used to generate infrared information as detection results. The engine start sensor 509 detects the ON / OFF status of the engine and is used to generate ON / OFF information as detection results.

[0044] The vehicle operation switches 510 are various switches operated by the driver or other users, and are used to generate operation information such as ON / OFF status for these switches. The vehicle operation switches 510 include steering wheel switches, switches on the dashboard, vehicle door switches, switches on the armrest, and switches on the center console.

[0045] The communication unit 511 is a configuration used for communication and includes, for example, a first communication unit 5111, a second communication unit 5112, a third communication unit 5113, an in-vehicle radio communication unit 5114, and an out-of-vehicle radio communication unit 5115.

[0046] The first communication unit 5111 is configured, for example, to perform communication using FPD-Link III, and includes communication lines and communication equipment used for FPD-Link III communication.

[0047] The second communication unit 5112 implements a communication protocol (CAN communication protocol) and includes communication lines and communication equipment used for CAN communication.

[0048] The third communication unit 5113 is configured to perform communication via in-vehicle Ethernet, implements the in-vehicle Ethernet communication protocol, and includes communication lines and communication equipment used for communication via in-vehicle Ethernet. The third communication unit 5113 may also include a USB (Universal Serial Bus) port, and the driver or other user may connect a device (e.g., a USB memory stick, a device with computer functionality) to the port as appropriate. The third communication unit 5113 may then perform communication via in-vehicle Ethernet between the device connected to the port and the connected configuration.

[0049] The in-vehicle wireless communication unit 5114 is configured to communicate with information equipment inside the vehicle, implements a communication protocol, and includes a wireless device. The in-vehicle wireless communication unit 5114 performs wireless communication using, for example, Wi-Fi® or Bluetooth®. Alternatively, the in-vehicle wireless communication unit 5114 may perform short-range wireless communication such as NFC (Near Field Communication).

[0050] The external wireless communication unit 5115 is configured to communicate with the outside of the vehicle 2, implements a communication protocol, and includes a wireless device. The external wireless communication unit 5115 performs wireless communication using, for example, LTE (Long Term Evolution), 5G, or Wi-Fi.

[0051] The configuration of the communication unit 511 may be changed as appropriate. The communication unit 511 may be configured to perform communication using, for example, LIN. Alternatively, the communication unit 511 may be configured to perform communication using, for example, GMSL.

[0052] The acceleration sensor 512 and gyro sensor 513 detect the acceleration and angular velocity of the vehicle 2 and are used to generate acceleration-gyro information that represents the attitude and behavior of the vehicle 2. The temperature sensor 514 detects the temperature inside and outside the vehicle and the road surface, and is used to generate temperature information based on the detection results.

[0053] The vehicle-to-infrastructure wireless transceiver 515 generates vehicle-to-infrastructure communication information through vehicle-to-infrastructure communication between vehicle 2 and roads, signs, signals, etc. The vehicle-to-vehicle wireless transceiver 516 generates vehicle-to-vehicle communication information through vehicle-to-vehicle communication between vehicle 2 and other surrounding vehicles. The terminal vehicle-to-vehicle wired wireless communication unit 517 is a device that acquires information from devices connected to the LTE network (e.g., WiFi devices) via wired or wireless communication. The controller 100 or control unit can acquire information transmitted and received on the LTE network via the terminal vehicle-to-vehicle wired wireless communication unit 517.

[0054] The GPS receiver 518 generates GPS information obtained by receiving GPS signals from GPS satellites. For example, the GPS receiver 518 can obtain the current time, latitude, and longitude. The VICS receiver 519 generates VICS information obtained by receiving VICS signals. Here, VICS signals include traffic congestion information and weather information from radio beacons and optical beacons. The GPS receiver 518 and the VICS receiver 519 may be provided as part of a navigation system.

[0055] The in-vehicle camera 520 and the exterior camera 521 capture images of the interior and exterior of the vehicle and are used to generate in-vehicle and exterior camera image information. Specifically, the in-vehicle camera 520 is, for example, a camera for a Driver Monitoring System (DMS) that captures the driver's posture, eye position, and movement. In this case, by analyzing the captured images, the driver's fatigue level and gaze position can be determined.

[0056] The voice input device 522 receives the driver's voice and is used to generate voice information. The driver can input operation details via the voice input device 522 by uttering sounds. The voice output device 523 is a device that outputs voice processed by, for example, the controller 100 or the control unit.

[0057] The humidity sensor 524 detects humidity and is used to generate humidity information. The humidity sensor 524 may also detect humidity outside the vehicle 2 or on the road surface, and generate humidity information for the outside of the vehicle 2. Alternatively, the humidity sensor 524 may also detect humidity inside the vehicle 2, and generate humidity information for the inside of the vehicle.

[0058] The rain sensor 525 detects raindrops and is used to generate rainfall information. The wiper switch 526 detects the ON / OFF status of the wiper 6 and is used to generate ON / OFF information for the wiper 6. The turn signal switch (not shown) detects the driver's operation of the turn signal 14 and is used to generate turn signal information.

[0059] The video generation unit 527 may generate video information based on information acquired from each sensor, or from external devices 25, or mobile terminals 26, or from the internet, or it may generate video information based on information acquired by the controller 100. Information other than that of the vehicle includes information from external devices 25 or mobile terminals 26, or from the internet. On the other hand, the video generation unit 527 is not required, in which case the controller 100 may be configured to have a video generation function.

[0060] The raindrop sensor 528 detects the amount and size of raindrops. The raindrop sensor 528 can measure the rainfall state by detecting a decrease in the amount of light incident on the detector due to the presence of raindrops. The amount of raindrops detected by the raindrop sensor 528 may be used to generate related information such as the operating time of the wiper 6. Furthermore, the operating state of the wiper 6 may be changed in conjunction with the vehicle's speed and the detection results of the raindrop sensor 528, or it may be used to correct related information such as the operating time of the wiper 6.

[0061] The road surface sensor 529 detects information regarding the road surface condition. The road surface sensor 529 may directly measure the wetness of the road surface, or it may detect friction with the road surface. Alternatively, it may detect acceleration based on the road surface condition, or it may classify the road surface condition into states such as dry, semi-wet, wet, slush, snow, compacted snow, and ice from the acceleration waveform.

[0062] The controller 100 or processor may, for example, send and receive data or information via wireless communication to acquire information necessary for driving. The controller 100 or processor may also acquire information necessary for autonomous driving. Furthermore, the controller 100 or processor may, for example, send and receive data or information via wireless communication to perform data or information update processing. As part of the update processing, the controller 100 or processor may, for example, update various types of data or information (map data, data used for image processing, software, etc.). Such technology is sometimes referred to as OTA (Over the Air) technology.

[0063] Next, an example of information projection by a projection device will be described with reference to Figure 3. As shown in Figure 3A, image light is projected from the projection device onto the road surface in front. The figure shows a projection area 14a projected from the projection device 11 through the front right window 13a of the vehicle 2, and a projection area 14b projected from the projection device 11 through the front left window 13b of the vehicle. The projection images of each projection area (14a, 14b) are combined to project an image (in this example, an arrow 16 indicating that the vehicle 2 is moving straight) onto the road surface in front of the vehicle 2. In this example, the projection areas (14a, 14b) are divided into left and right, but the projection areas may also be divided into areas near and far from the vehicle. Furthermore, the image light may be projected using only one of the projection devices 11 installed on the left and right sides of the vehicle. In this example, the projection device 11 is incorporated inside the headlight 13, and the light source of the headlight 13 is used as the light source for projection. However, as mentioned above, the arrangement of the projection device 11 can be changed as appropriate. The projection device 11 may have a different light-emitting configuration than the headlight 13, and the light emitted from this configuration may be used to project image light.

[0064] As shown in Figure 3B, image light is projected from the projection device 11 onto the road surface behind the vehicle 2. The figure shows a projection area 17a projected from the projection device 11 on the rear right side of the vehicle 2 through the rear right window 15a of the vehicle 2, and a projection area 17b projected from the projection device 11 on the rear left side of the vehicle 2 through the rear left window 15b of the vehicle 2. The projection images of each projection area (17a, 17b) are combined to project an image (in this example, an arrow 18 related to a reverse indicator indicating that the vehicle is moving straight backward) onto the road surface behind the vehicle. In this example, the projection areas (17a, 17b) are divided into left and right, but the projection areas may also be divided into areas near and far from the vehicle. Alternatively, only one of the projection devices 11 installed on the left and right sides of the vehicle may be used to project image light. In this example, the projection devices 11 are installed so that the light source of the taillights can be used as the light source for projection. However, as mentioned above, the arrangement of the projection device 11 can be changed as appropriate. The projection device 11 may have a light-emitting configuration different from that of the taillights, and the light emitted from this configuration may be used to project the image light.

[0065] Referring to Figure 4, an example configuration of the projection device 11 will be described. The projection device 11 generates an image of the information to be displayed using data or information acquired via various sensors and a communication unit, and projects the image light. For example, data or information may be input to the projection device 11 from the controller 100. For example, signal data, video data, etc., may be input to the projection device 11 from the controller 100. The projection device 11 may then perform processing using the input information. Alternatively, for example, the controller 100 may control the projection device 11 instead of the control unit of the projection device 11. Alternatively, the control unit of the projection device 11 and the controller 100 may share the processing; for example, the controller 100 may control the brightness of the headlights 13 and taillights, and the control unit of the projection device 11 may control the brightness of the projected image.

[0066] As shown in Figure 4, the projection device 11 includes a projection optical system 701 and a light source device 702. The projection device 11 also includes a power supply 703, a cooling unit 704, an operation input unit 705, a video signal input unit 706, an audio signal input unit 707, an audio output unit 708, a communication unit 709, a non-volatile memory 710, a memory 711, a storage unit 712, an adjustment unit 713, and a control unit 714. The control unit 714 may be configured as a processing unit. The control unit 714 can control the operation of the projection device 11. On the other hand, if there is no control unit, the controller 100 can also control the projection device 11.

[0067] The projection optical system 701 is a configuration used for projecting light. The projection optical system 701 includes, for example, optical components such as lenses and / or mirrors.

[0068] The light source device 702 is a device capable of generating image light. For example, the light source device can use a high-pressure mercury lamp, a xenon lamp, an LED light source, a laser light source, etc. The light source device may also be equipped with optical elements used for focusing and homogenizing light.

[0069] Power supply 703, for example, supplies power to the light source. Furthermore, power supply 703 supplies the necessary power to each other component.

[0070] The cooling unit 704 cools each part that becomes hot, such as the light source, power supply 703, or light source device 702, using air cooling or liquid cooling as needed.

[0071] The operation input unit 705 is, for example, an operation button or a remote control receiver, and receives operation signals from the user. The input of an operation signal from the user switches the ON / OFF state of the switch (operation switch) that starts the projection device 11.

[0072] The video signal input unit 706 is an interface device for acquiring video data from an external source. The audio signal input unit 707 is an interface device for acquiring audio data from an external source. The audio output unit 708 can, for example, output audio based on audio data input to the audio signal input unit 707. The audio output unit 708 may output, for example, operation sounds or error warning sounds.

[0073] The communication unit 709 is an interface device used for communication with the outside world. The communication unit 709 is connected to, for example, an external information processing device (for example, a controller 100) and inputs and outputs various control signals. The communication unit 709 may also be connected to various sensors, communication devices provided on the vehicle 2, etc., and inputs and outputs various data or information.

[0074] The non-volatile memory 710 stores various data used, for example, in the projector function. The data stored in the non-volatile memory 710 includes pre-prepared image data and video data for projecting images.

[0075] Memory 711 stores the projected video data and control parameters for each part of the device.

[0076] The storage unit 712 is a device that records video, images, audio, and various other data. For example, video, images, audio, and various other data may be pre-recorded at the time of product shipment, or video, images, audio, and various other data acquired from external devices or external servers via the communication unit 709 may be recorded. Furthermore, the control unit 714 may acquire updated data or information from an external source via the communication unit 709 and update the recorded data or information with the new data or information. In addition, at the user's discretion, some or all of the recorded data or information may be updated with new data or information. Video, images, and various other data recorded in the storage unit 712 can be output as projected video. Audio recorded in the storage unit 712 can be output as audio from the audio output unit 708.

[0077] The adjustment unit 713 is capable of adjusting the video light and includes, for example, an image adjustment unit and a polarization adjustment unit. The image adjustment unit performs image processing on video data input at the video signal input unit, image data stored in the non-volatile memory 710, and video data. Examples of such image processing include image distortion correction, scaling processing such as enlarging, reducing, and transforming images, brightness adjustment processing to change the brightness of images, contrast adjustment processing to change the contrast curve of images (including adjustment of the gradation linearity characteristics of brightness), color correction processing to change the chromaticity of images, and retinex processing to decompose an image into light components (illumination light component, reflected light component, ambient light component) and change the weighting of each component. The image adjustment unit is realized when the control unit 714 stores data in the memory 711 and executes image processing.

[0078] The polarization adjustment unit adjusts the polarization degree of the projected image light. Here, polarization degree refers to the ratio of P-polarization component and S-polarization component, which are the polarized light components contained in the light (P-polarization and S-polarization are defined with respect to the projection surface). For example, the projection device 11 is provided with a configuration that can adjust the polarization degree of the emitted light, such as a polarization separation element and a polarization conversion element described later, and the control unit 714 adjusts the polarization degree of the image light by controlling this configuration. The polarization control unit is realized by the control unit 714 storing data (parameters used for control, etc.) in the memory 711 and controlling the said configuration. Alternatively, multiple projection devices 11 with different polarization degrees may be provided and switched between.

[0079] In the example shown in Figure 4B, the light source device 702a comprises a light source 7021, a display element 7022, an optical element 7023, a polarization separation element 7024, and a polarization conversion element 7025. The light source 7021 generates light for image projection. The optical element 7023 is used for focusing and homogenizing light. Note that explanations similar to those above may be omitted. The polarization separation element 7024 is an element that separates incident light into S-polarized and P-polarized light. For example, a polarizing beam splitter is used in the polarization separation element 7024, separating light by reflecting or transmitting light in a specific polarization state. The polarization conversion element 7025 is an element that converts the degree of polarization. For example, a waveplate is used in the polarization conversion element 7025, changing the polarization state by delaying the phase of light. Here, for example, the polarization conversion element 7025 may be connected to an actuator (e.g., a motor) used to control the transmitted incident angle, and the adjustment unit 713 or polarization adjustment unit 722 in Figure 4A may adjust the incident light to a polarization degree corresponding to the incident angle.

[0080] The projection device 11 also includes a display element 7022, a display element drive unit (not shown), and the like. The display element 7022 is an element that generates an image by modulating transmitted or reflected light, and uses, for example, a transmissive LCD (Liquid Crystal Display) panel, a reflective LCD panel, or a DMD (Digital Micromirror Device) (registered trademark) panel. The display element drive unit sends a drive signal to the display element 7022, causing the display element 7022 to generate an image. In addition to configurations that can display multiple images using control signals such as DMDs and LCDs, the display element 7022 also includes configurations that only display a fixed image, such as a mask type.

[0081] In the example shown in Figure 4C, the light source device 702b does not have a light source that serves as a backlight for the display element. In this example, the display element itself emits light. Note that explanations similar to those above may be omitted in some cases.

[0082] The light source device 702b comprises a display light-emitting element 7026, an optical element 7023, a polarization separation element 7024, and a polarization conversion element 7025. The display light-emitting element 7026 is configured as a self-emissive display such as an LED array or an OLED (Organic Light Emitting Diode) display. The optical element 7023 is an optical system used for focusing and homogenizing light. The optical element 7023, the polarization separation element 7024, and the polarization conversion element 7025 are the same as those described in Figure 4B.

[0083] Next, an example of the arrangement of optical components will be described with reference to Figure 5. Figure 5A shows an example of projecting an image using a reflective display element with a DMD (Direct Display Module) method. The first optical element 901 is an optical element that focuses the light generated by the light source 900, and is, for example, a collimator. The second optical element 902 is a mirror that projects the focused light onto the display element 907. In this example, the display element 907 is configured as a DMD type panel, and the projection of light is adjusted or controlled for each display pixel. The third optical element 903 is configured to project image light and is made up of optical components such as lenses and mirrors. A reflective LCD panel may be used as the reflective display element.

[0084] Figure 5B shows an example in which the display light-emitting element 908 itself emits light and projects an image. The display light-emitting element 908 is configured as an LED array panel or an LED matrix panel, and an image is generated by the combination of the illuminated position and illuminated color of the LEDs on the panel. The fourth optical element 904 is configured to project image light and is made up of optical components such as lenses and mirrors. In addition to the above panels, an OLED display may be used as the display light-emitting element.

[0085] Figure 5C shows an example of displaying an image by transmitting light through the display element 909. The fifth optical element 905 is the same as the first optical element 901 described above. The display element 909 is, for example, a transmissive LCD panel, and an image is generated on the display element 909. The sixth optical element 906 is configured to project image light and is constructed using optical components such as lenses and mirrors. The display element 909 may also be configured by placing a mask with a predetermined pattern on the light source side. In this case, a fixed image based on the pattern formed on the mask can be displayed by light that is not obstructed by the mask, but transmits through the mask. Alternatively, the display element 909 may be configured by placing a lens with a predetermined pattern on the light source side. In this case, the display element 909 can display a fixed image based on the pattern formed on the lens. The predetermined pattern formed on the lens is formed on the lens surface or inside the lens, and the formed pattern partially blocks or partially transmits light transmission. The lens used in the display element 909 may be a microlens array. In that case, the patterns formed on each lens will be different.

[0086] A modified example is described in which a light-shielding plate is provided instead of the display element in Figure 5C. As an example, the light-shielding plate has a window that transmits light rays from the light source 900. The shape of the window is not limited and may be a geometric shape such as a rectangle or chevron, or it may be an icon, a letter, or a number. The window may also be a shape that can be changed according to the image being projected; for example, based on acquired information, a rectangular image may be changed to a chevron image and continuously projected. The sixth optical element 906 is configured to project light rays transmitted through the window of the light-shielding plate onto the road surface and is composed of optical components such as a lens, a mirror, and an aperture. The length, size, and brightness of the image projected onto the road surface are controlled by the sixth optical element 906. Furthermore, the length, size, and brightness of the image projected onto the road surface can also be controlled by changing the shape, size, transmittance, and aperture duty cycle of the window of the light-shielding plate. In addition, the image projected onto the road surface can be made to blink by repeatedly turning the light source 900 on and off.

[0087] Another modification involves providing multiple sets of light sources 900, first optical elements 901, light shields, and sixth optical elements 906. The sixth optical element 906 projects light rays that have passed through the windows of the multiple light shields onto the road surface in an overlapping manner, thereby enabling the projection of a rectangular image onto the road surface in a straight line. Furthermore, the sixth optical element 906 separates the light rays that have passed through the windows of the multiple light shields and projects them onto the road surface, enabling the projection of multiple rectangular images arranged in a straight line onto the road surface. In addition, by sequentially lighting up the multiple light sources 900, it becomes possible to project a rectangular image onto the road surface that lights up sequentially in a predetermined direction (for example, a direction away from vehicles).

[0088] The light sources shown in Figures 5A and 5C can be composed of the light source of the projection device 11, but they may also be the light sources of the headlights 13 or the taillights. In this case, the light source of the projection device 11 may be omitted. On the other hand, the light sources shown in Figures 5A and 5C may also be a combination of the light source of the projection device 11 and the light sources of the headlights 13 or the taillights. Furthermore, the light source of the projection device 11 may consist of one or more light sources. Similarly, the display elements or light shielding plates corresponding to the light sources may also consist of one or more.

[0089] Next, an example of the display area of ​​the image as seen by the driver will be explained with reference to Figure 6. Figure 6 shows the illumination area A1 of the high beam of the headlight 13, the illumination area A2 of the low beam of the headlight 13, and the image area A3 for the road surface image projected by the projection device 11. The high beam is projected onto the upper illumination area of ​​the high beam. That is, the high beam that brightly illuminates the distance can be projected onto this illumination area. The high beam is projected onto the lower illumination area of ​​the high beam, and since it overlaps with the projection area of ​​the low beam, the low beam may be formed by blocking a part of the illumination area of ​​the headlight 13 that can project the high beam. In addition, the image area A3 projected by the projection device 11 is included in the illumination area below the low beam illumination area A2 and the high beam illumination area A1. For this reason, the projection device 11 can project images using the low beam and high beam of the headlight 13, and the projection device 11 may be provided separately from the headlight 13.

[0090] An example of a projection area around a vehicle will be described with reference to Figure 7. Figure 7 shows the vehicle front road surface display area A11, the vehicle rear road surface display area A12, and the vehicle left and right road surface display areas A13. The vehicle front road surface display area A11 is a display area formed on the road surface in front of the vehicle's position, and the projection device 11 may, for example, be configured to project image light into this area and display information. The vehicle rear road surface display area A12 is a display area formed on the road surface behind the vehicle's position, and the projection device 11 may, for example, be configured to project image light into this area and display information. The vehicle left and right road surface display areas A13 are display areas formed on the road surface to the left and / or right of the vehicle's position, and the projection device 11 may, for example, be configured to project image light into this area and display information. This region A13 can be, for example, an area where information displayed by vehicles and people (such as pedestrians) around the vehicle can be seen.

[0091] An example of information projection will be described with reference to Figure 8. In the information projection of this embodiment, the processor controls the projection image and image projection. The processor may function as the vehicle's controller 100, the control unit of the projection device 11, or an external device. Specifically, the controller 100 may control the projection device 11, the control unit of the projection device 11 may control the projection image and image projection based on information from the vehicle or an external source, the controller 100 and the projection device 11 may share the processing, or an external device or mobile terminal may control the projection image and image projection. For example, when the controller 100 controls the projection device 11, the controller 100 sends image information based on information from sensors to the projection device 11, and if further image adjustment is necessary, it also sends image adjustment information to the projection device 11, and the projection device 11 projects an image based on the image information and the image adjustment information. Alternatively, the controller 100 may perform image information generation processing, or image adjustment processing and generation processing of adjusted image information, send only the image information to the projection device 11, and the projection device 11 may perform only image projection.

[0092] Figure 8 shows an example of video projection processing. In the following embodiments, the control related to video projection processing is not particularly limited. As shown in Figure 8, step S1 is a projection start determination step, in which the start of projection is determined according to pre-set information of the projection device 11. For example, if it is determined that the switch of the projection device 11 is turned on, projection can be started. If it is determined that the switch of the projection device 11 is turned off, projection cannot be started.

[0093] Next, step S2 is a vehicle information acquisition step, in which vehicle information necessary for the projection control determination in step S3 is acquired. For example, vehicle information from the navigation system or road information from an external device is acquired. Steering angle information is acquired as vehicle information. Furthermore, speed information, gear information, acceleration gyro information, road surface condition information, raindrop-related information (also referred to as "raindrop amount information"), wiper operation mode information, and turn signal illumination information related to the illumination of the turn signals 14 may be acquired as vehicle information.

[0094] Next, step S3 is a projection control determination step, in which it is determined what kind of control to perform on the projected image (hereinafter also referred to as the "projected image") based on the vehicle information acquired in step S2. For example, in step S3, the turning direction of vehicle 2 is determined based on the steering angle information, and the projection of the projected image is controlled to indicate the turning direction of vehicle 2. Specifically, based on the steering angle information, the turning direction of vehicle 2 is determined if the steering angle is greater than or equal to a predetermined angle. This is because there is some play between the steering angle and the turning angle of vehicle 2. The predetermined angle varies depending on vehicle 2, but for example, it may be 10°, 20°, etc. More specifically, if rectangular images are projected linearly to the left and right rear of vehicle 2, the projection of the projected image is controlled so that the linear rectangular image projected to the right rear of vehicle 2 and the linear rectangular image projected to the left rear of vehicle 2 are asymmetrical, in order to indicate the turning direction of vehicle 2.

[0095] Next, step S4 is the projection start step, in which the projection of the image is started based on the determination result of step S3. For example, if it is determined in step S3 that vehicle 2 is moving backward, or that vehicle 2 has started to move backward, an image is projected from the projection device mounted on the rear of the vehicle onto the left and right areas behind vehicle 2. Furthermore, if it is determined in step S3, based on the vehicle information, that vehicle 2 has started to turn, the projection of the images projected onto the left and right areas behind vehicle 2 is controlled to be asymmetrical to match the direction of vehicle 2's turn, and the controlled image is projected.

[0096] Next, step S5 is a projection termination determination step, in which it is determined whether or not to terminate the projection of the image based on the projection termination conditions, which include the vehicle information 4. For example, in step S5, if it is determined that the gear has been changed from reverse to a position other than reverse based on the gear information, it is determined to terminate the projection of the image. For example, if the gear has been changed to the parking position, it is determined to terminate the projection of the image.

[0097] Next, step S6 is the projection termination step. If it is determined in step S5 that the image projection should be terminated, the image projection is terminated in step S6.

[0098] Furthermore, steps S2 to S4 may be repeated until it is determined in step S5 that the image projection has ended.

[0099] The information projection shown in Figure 8 is implemented by a configuration that allows for direct or indirect control of the projection device 11. That is, the information projection shown in Figure 8 may be implemented by a configuration based on a controller 100, a control unit 714 of the projection device 11, other processing devices installed inside the vehicle, or processing devices outside the vehicle. Here, one of these configurations may perform the projection, or multiple configurations may share the performance of each processing step of the projection. In controlling the projection device 11, the controller 100 may transmit signals to the projection device 11 to control it. In addition, the control unit 714 of the projection device 11 may control the display of the projection device 11 based on information acquired from the vehicle.

[0100] Figure 9 shows an example of the present invention in which vehicle 2 is reversing out of a parking lot. When the backward movement of vehicle 2 is detected, as shown in Figure 9(a), rectangular images 19a and 19b are projected linearly to the left and right rear of vehicle 2. At this point, the images projected to the left and right rear of vehicle 2 are symmetrical, and the direction of vehicle 2's turn cannot be determined. Next, vehicle information, such as steering angle information, is obtained, and if it is determined that vehicle 2 is moving backward and turning, the rectangular images 19a and 19b are projected asymmetrically. By making the rectangular images projected to the rear of the vehicle asymmetrical, it becomes possible to indicate the direction of vehicle 2's turn. Figure 9(b) is an example in which, when it is determined that vehicle 2 is turning to the right, the projection of the projected images is controlled so that the rectangular image 19a projected to the right rear of vehicle 2 is shorter than the rectangular image 19b projected to the left rear of vehicle 2. In this example, the direction of the turn is indicated by changing only the rectangular shape projected to the rear right, relative to the rectangular shape projected to the rear left. The asymmetry of this projection may be changed according to the steering angle. For example, the asymmetry may be emphasized when the steering angle increases, the asymmetry may be mitigated when the steering angle decreases, and the asymmetry may be eliminated when the steering angle falls below a predetermined angle.

[0101] Referring to Figure 10, an example of image display when projecting information onto the road surface behind the vehicle will be explained. Specifically, Figures 10(a) to (f) show examples of images projected onto the vehicle rear road surface display area A12 (Figure 7) when it is determined in step S3 that vehicle 2 is moving backward.

[0102] Figure 10(a) shows how a rectangular image 19a projected onto the rear right side of vehicle 2 is projected to be relatively shorter than a rectangular image 19b projected onto the rear left side of vehicle 2. When vehicle 2 is reversing, the turning radius of the wheels located farther away from the direction of turning increases. In this example, the turning direction is indicated relative to the vehicle 2 by shortening the rectangular shape projected in the direction of turning. The length of the rectangular image can be changed by changing the number of light sources that are lit if the image is composed of multiple light sources, or by changing the aperture area of ​​image elements other than the light sources or the light-shielding plate. In addition, the brightness of the light sources that represent the four sides of the rectangle may be brighter than the brightness of the light source within the rectangle.

[0103] Figure 10(b) shows how the projected image is displayed such that the rectangular image 19a projected onto the rear right side of vehicle 2 is relatively brighter than the rectangular image 19b projected onto the rear left side of vehicle 2. For example, the projection of the images may be controlled so that the rectangular image 19a is projected only onto the rear right side of vehicle 2, and the rectangular image 19b is not projected onto the rear left side of vehicle 2. In this example, the direction of rotation of vehicle 2 is indicated relative to the vehicle 2 by emphasizing the image in the direction of rotation. The brightness of the rectangular image may be changed by controlling the current value to the light source. The current value may be controlled by changing the duty cycle using pulse width modulation. Alternatively, gradation control may be performed using an image element, or the aperture duty cycle or transmittance control of a light-shielding plate may be used.

[0104] Figure 10(c) shows how the projected images are displayed, with a rectangular image 19a flashing on the rear right side of the vehicle 2 and a rectangular image 19b continuously lit on the rear left side of the vehicle 2. Alternatively, the projection may be controlled so that, for example, only the rectangular image 19a is projected on the rear right side of the vehicle 2, and the rectangular image 19b is not projected on the rear left side. In this example, the direction of rotation of the vehicle 2 is indicated relative to the vehicle 2 by emphasizing the image in the direction of rotation. The flashing of the rectangular images may be controlled by pulse control of the current value to the light source. Current value control may be performed by changing the duty cycle using pulse width modulation. Alternatively, gradation control using an image element, or aperture duty cycle and transmittance control of a light-shielding plate may be used.

[0105] Figure 10(d) shows how the projected images are displayed, with the rectangular image 19a projected onto the rear right side of the vehicle 2 being sequentially lit as it moves away from the vehicle 2, and the entire rectangular image 19b projected onto the rear left side of the vehicle 2 being constantly lit. Note that the projection of the images may be controlled, for example, so that only the rectangular image 19a is projected onto the rear right side of the vehicle 2, and the rectangular image 19b is not projected onto the rear left side of the vehicle 2. Furthermore, the sequential lighting may be performed in accordance with the rearward movement of the vehicle 2, or the frequency of sequential lighting may be changed according to the speed of the rearward movement. In this example, by sequentially illuminating the images in the direction of the vehicle 2's turn, the rearward movement of the vehicle 2 is indicated to the area around the vehicle 2 along with its turning direction. If the sequential lighting of the rectangular images is composed of multiple light sources, the light sources to be lit may be individually selected using switching elements such as relays, or the lighting may be performed by changing the image elements other than the light sources or the openings of the light-shielding plates.

[0106] Figure 10(e) shows how the projected images are displayed such that the number of rectangular images 19a projected onto the rear right side of vehicle 2 is relatively less than the number of rectangular images 19b projected onto the rear left side of vehicle 2. In this example, when vehicle 2 is reversing, multiple rectangular images are displayed in a straight line. In such a case, the turning direction is indicated relative to the vehicle 2 by changing the number of projected rectangular images while keeping the size of each rectangular image unchanged. The number of rectangular images can be changed by changing the number of light sources that are illuminated if each image is composed of a separate light source, or by changing the number or shape of the openings in the image elements other than the light sources or in the light shielding plate.

[0107] Figure 10(f) shows how the projection of the images is controlled so that the size of the rectangular image 19a projected on the rear right side of vehicle 2 is relatively smaller than the size of the rectangular image 19b projected on the rear left side of vehicle 2. In this example, the direction of rotation is indicated relative to the vehicle 2 by making the rectangular shape projected in the direction of rotation smaller. The size of the rectangular image may be changed by changing the number of light sources that are lit if the image is composed of multiple light sources, or by changing the magnification of the projection lens. Alternatively, it may be changed by changing the lit area of ​​image elements other than the light sources or the aperture area of ​​the light shielding plate.

[0108] Furthermore, Figures 10(g) and 10(h) show examples of images projected onto the rear road surface display area A12 of the vehicle when, in step S3, it is determined that the road surface around the vehicle 2 is wet to a predetermined degree or more based on road surface condition information or raindrop-related information. Here, "predetermined degree" means the degree to which the image projected onto the road surface corresponding to the rear road surface display area A12 of the vehicle is specularly reflected. When the road surface is wet due to the effects of raindrops, etc., a layer of water is formed on the road surface, reducing the unevenness of the road surface. As a result, the diffuse reflectance on the road surface decreases, and consequently the specular reflectance increases, which may cause glare from the light projected from the vehicle 2 to the surroundings. Therefore, the projected image or the projection of the image may be controlled by detecting road surface condition information or raindrop-related information from the information of the raindrop sensor 528 and the road surface sensor 529. Alternatively, in step S3, if it is determined that the amount of rainfall is above a predetermined level based on the wiper operation mode information, the image shown in Figure 10(g) or Figure 10(h) may be projected onto the vehicle rear road surface display area A12. Furthermore, if the reflection state of the vehicle rear road surface display area A12 is determined based on the image of the area behind the vehicle from the external camera 521, and it is determined that the proportion of specular reflection is above a predetermined level, the image shown in Figure 10(g) or Figure 10(h) may be projected onto the vehicle rear road surface display area A12.

[0109] Figure 10(g) shows how the projected images are positioned so that the size of the rectangular images 19a and 19b projected to the left and right rear of vehicle 2 is shorter than the length of the rectangular images 19a and 19b projected to the left and right rear of vehicle 2 under normal conditions. The proportion of specular reflection of light emitted from vehicle 2 to the road surface changes depending on the angle of light, so it is desirable to control the angle of light according to the wetness of the road surface. In particular, for images projected to locations far from the vehicle, the angle of incidence of light to the road surface becomes large. When the road surface is wet, a layer of water forms on the road surface, and if the angle of incidence of light is large, the proportion of light specularly reflected at the surface of the water layer increases, making it difficult to see the image projected onto the vehicle rear road surface display area A12. Furthermore, specularly reflected light causes glare to the surroundings. Therefore, by stopping the display of images far from the vehicle and switching to displaying only images near the vehicle in accordance with changes in the road surface conditions, it is possible to achieve both image visibility and suppression of glare to the surroundings. When shortening an image, it is desirable to reduce the proportion of the vehicle's distance from the camera compared to the normal image.

[0110] Figure 10(h) shows how the projected images are displayed such that the number of rectangular images 19a and 19b projected to the left and right rear of vehicle 2 is less than the number of rectangular images 19a and 19b projected to the left and right rear of vehicle 2 under normal conditions. This example shows how the number of illuminated light sources for displaying the image is changed. As mentioned above, images far from the vehicle cause specular reflection, making them difficult to see from the surroundings and causing glare. In cases like this example, where the image is composed of multiple rectangular images, it is desirable to reduce the proportion of rectangular images far from the vehicle compared to the normal state.

[0111] Controlling the projected images shown in Figures 9 and 10 can be achieved using a simple optical system with a light-shielding plate, as described as a modified example. For example, by controlling the aperture and light source of the light-shielding plate, it is possible to control the projected images as shown in Figures 9, 10(a) to (c), (f), and (g). Furthermore, by using multiple sets of simple optical systems with light-shielding plates, it is possible to control the projected images as shown in Figures 9, 10(a) to (g). In other words, the projection device 11 mounted on the vehicle 2 to project the projected images shown in Figures 9 and 10 onto the rear road surface display area A12 only needs to have an optical system with a relatively inexpensive light-shielding plate instead of a display element. Therefore, it does not require drive circuits and other components necessary when using a display element, and can be realized with a simple configuration, allowing for miniaturization and weight reduction of the projection device 11, improving its mountability on the vehicle 2. It also reduces the manufacturing costs of the projection device 11 and the vehicle 2.

[0112] The information projection related to this disclosure is not limited to the above description. For example, in the projection control determination step of step S3, once the projected image is controlled, the projected image does not need to be controlled until the projection of the image is completed in step S6. Normally, when backing up vehicle 2, a rough turning direction is determined once, and then fine direction adjustments are made. However, if even these fine direction adjustments are displayed in the projected image projected behind vehicle 2, people around vehicle 2 may become distracted by the projected image and neglect to pay attention to vehicle 2. Therefore, by not changing the projected image once it has been controlled until the projection is completed, it is possible to prevent people around vehicle 2 from losing attention to vehicle 2. One of the features of this disclosure is that the turning direction is indicated without changing the angle of the projected image.

[0113] In step 3, the projected image may be controlled based on the turn signal illumination information. The turn signal illumination information includes information about the turning direction of vehicle 2, and the turn signal illumination information can be used instead of the steering angle information. Also, in step S3, if it is determined that the turn signal is illuminated based on the turn signal illumination information, the projected image may not be controlled. When vehicle 2 is backing up, the turn signal is rarely illuminated, but if the projection of the image projected behind vehicle 2 is controlled to convey the turning direction of vehicle 2 even when the turn signal is illuminated, the information displayed to people around vehicle 2 will be excessive or redundant. Therefore, by not controlling the projected image when the turn signal is illuminated, it is possible to prevent the information displayed to people around vehicle 2 from becoming excessive or redundant. Alternatively, if an image projection linked to the turn signal is performed, the projection image linked to reversing may not be controlled. If multiple projected images change simultaneously, the information displayed to people surrounding vehicle 2 becomes excessive or redundant; therefore, it is desirable to change only one image at a time. For example, if the projected image linked to the turn signal is flashing or sequentially illuminating, the projected image related to reversing should not change.

[0114] Furthermore, the manner in which the projected image is controlled in step S3 is not limited to the example described above. Figures 11A and 11B show an example of the control amount / adjustment amount of the projected image based on the vehicle information of vehicle 2. Here, the total steering angle is shown on the horizontal axis as an example of vehicle information. The control amount is shown on the vertical axis, and the control amount / adjustment amount is the amount of image correction applied to the projected image based on the vehicle information. As shown in Figures 9 to 10(g), the projection device of vehicle 2 changes the rectangular image projected onto the rear left and right areas of vehicle 2 based on the vehicle information. The degree of image change performed during this change is called the control amount. In the text, the control amount is sometimes referred to as the adjustment amount, but they have the same meaning. The larger the control amount, the greater the degree of change from the projected image before control. Furthermore, the change in the control amount based on the vehicle information is not limited to a linear change. For example, in step S3, when determining the control of the projected image based on the steering angle information, the control of the projected image may be performed such that the control amount / adjustment amount of the projected image is nonlinear with respect to the magnitude of the steering angle. For example, as shown in Figure 11A, the projection image may be controlled such that the change in the control amount of the projection image when the steering angle is small is greater than the change in the control amount of the projection image when the steering angle is large. Specifically, when the vehicle 2 turns to the rear right, the brightness (control amount) of the rectangular image 19a projected to the rear right of the vehicle 2 when the steering angle is small is controlled to change more significantly than the brightness (control amount) of the rectangular image 19a projected to the rear right of the vehicle 2 when the steering angle is large. As a result, even with a small steering angle, the rectangular image 19a projected to the rear right of the vehicle 2 changes sufficiently compared to the rectangular image 19b projected to the rear left of the vehicle 2, thereby alerting people around the vehicle 2.

[0115] Furthermore, the change in the control / adjustment amount of the projected image may differ depending on whether the steering angle increases or decreases. For example, when the steering angle begins to increase, the control amount of the projected image may be changed as shown by the dashed line in Figure 11B. Similarly, when the steering angle begins to decrease, the control amount of the projected image may be changed as shown by the dashed line in Figure 11B. This ensures that even with a small change in the steering angle, the rectangular image 19a projected onto the rear right side of the vehicle 2 changes sufficiently to alert people around the vehicle 2.

[0116] Furthermore, in step S3, based on the speed information, the control amount / adjustment amount of the projected image may be increased as the speed of vehicle 2 increases. Alternatively, the control of the projected image may be performed so that the control amount of the projected image is nonlinear with respect to the speed of vehicle 2.

[0117] Furthermore, the control of each projection image shown in Figures 10(a) to (g) may be combined. For example, the rectangular image 19a projected on the rear right side of the vehicle 2 may be made shorter and brighter than the rectangular image 19b projected on the rear left side of the vehicle 2. In addition, as shown in Figure 10(a), the rectangular image 19a projected on the rear right side of the vehicle 2 may be made shorter and brighter than the rectangular image 19b projected on the rear left side of the vehicle 2, and may also be made to blink.

[0118] Furthermore, for example, when the vehicle 2 is turned to the rear right when the road surface corresponding to the rear road surface display area A12 of the vehicle is wet to a predetermined extent, the size of the rectangular images 19a and 19b projected to the left and right rear of the vehicle 2 may be made smaller than usual, and the rectangular image 19a projected to the rear right of the vehicle 2 may be made brighter than the rectangular image 19b projected to the rear left of the vehicle 2.

[0119] Furthermore, for example, the faster the speed of vehicle 2, the brighter the rectangular image 19a projected to the rear right of vehicle 2 may be, and the shorter the length of the rectangular image 19b projected to the rear left of vehicle 2. Also, the faster the speed of vehicle 2, the shorter the flashing period of the rectangular image 19a projected to the rear right of vehicle 2 may be.

[0120] The examples described so far have focused on projection images displayed at the rear of the vehicle, but this is not limited to the rear. Any image displayed linearly on either side of the vehicle is applicable, including projection images displayed at the front or sides of the vehicle. For example, if it is determined that the gear is in the drive position, a rectangular image may be projected onto the front left and right areas of vehicle 2. Furthermore, by obtaining steering angle information as vehicle information, the projected image on the front left and right areas of vehicle 2 may be displayed asymmetrically, corresponding to the vehicle's direction of travel. Alternatively, a rectangular image may be projected onto the side of vehicle 2, including either the rear or front, or both, and the projected image may be displayed asymmetrically based on the vehicle information.

[0121] According to the embodiments described above, as an example, the direction of the vehicle 2 turning backward can be displayed to people in the vicinity using a projection device 11 having a relatively simple optical system. Specifically, since it only involves projecting rectangular images in a straight line to the left and right rear of the vehicle 2, the projection device 11 only needs to have an optical system equipped with a relatively inexpensive light-shielding plate instead of a display element. Simplifying the optical system and circuitry makes the projection device 11 smaller and lighter, improving its mountability on the vehicle 2 and reducing the manufacturing costs of both the projection device 11 and the vehicle 2. Furthermore, by controlling the projection of the images so that the straight rectangular image projected to the right rear of the vehicle 2 and the straight rectangular image projected to the left rear of the vehicle 2 are asymmetrical, the direction of the vehicle 2 turning backward can be displayed to people in the vicinity.

[0122] It should be noted that the present invention is not limited to the embodiments described above, but includes various modifications and equivalent configurations within the spirit of the attached claims. For example, the embodiments described above are described in detail for the purpose of clearly illustrating the present invention, and the present invention is not necessarily limited to having all of the described configurations. Also, for example, some of the configurations of the embodiments may be added, deleted, or replaced with other configurations.

[0123] Furthermore, by using the technology according to the above embodiment, necessary information such as images for the driver and images for people around the vehicle can be appropriately displayed. This makes it possible to provide an information projection device that contributes to safe driving, and consequently, helps to reduce traffic accidents. Moreover, it becomes possible to contribute to "Goal 3: Ensure good health and well-being for all" of the United Nations' Sustainable Development Goals (SDGs). [Explanation of Symbols]

[0124] 2 vehicles 11 Projection device 13 Headlights 14 Turn signal 100 controllers

Claims

1. An information projection device mounted on a vehicle that projects images onto the road surface, An acquisition unit that acquires information about the aforementioned vehicle, It comprises a projection unit that projects images, The projection unit projects a projection image, which is a rectangular image projected linearly onto the left and right sides of the vehicle, based on the information about the vehicle acquired by the acquisition unit. When detecting the turning direction of the vehicle, the projected image is projected to transmit the turning direction. Information projection device.

2. An information projection device according to claim 1, The information relating to the vehicle is steering angle information relating to the steering angle, The projection unit is, When the steering angle is greater than or equal to a predetermined angle, the projected image is projected such that the projected image projected in the direction of the vehicle's turning and the projected image projected on the opposite side of the vehicle's turning direction are asymmetrical. Information projection device.

3. An information projection device according to claim 2, The projection unit is, The projection image is projected such that the length of the projection image projected to the side of the vehicle corresponding to the turning direction is shorter than the length of the projection image projected to the side of the vehicle opposite to the turning direction. Information projection device.

4. An information projection device according to claim 2, The aforementioned projected image is an image in which multiple rectangular images are arranged in a straight line. The projection unit is, The projection images are projected such that the number of rectangular images projected onto the side of the vehicle corresponding to the turning direction is less than the number of rectangular images projected onto the side of the vehicle opposite to the turning direction. Information projection device.

5. An information projection device according to claim 2, The projection unit is, The projected image is made to flash the projected image projected to the side of the vehicle corresponding to the turning direction, and to continuously illuminate the projected image projected to the side of the vehicle opposite to the turning direction. Information projection device.

6. An information projection device according to claim 2, The projection unit is, The projected image is projected such that the luminosity of the projected image projected to the side of the vehicle corresponding to the turning direction is different from the luminosity of the projected image projected to the side of the vehicle opposite to the turning direction. Information projection device.

7. An information projection device according to claim 2, The projection unit is, The projected image is illuminated sequentially in a predetermined direction on the side of the vehicle corresponding to the turning direction, and the entire projected image projected on the side opposite to the turning direction of the vehicle is kept constantly illuminated. Information projection device.

8. An information projection device according to claim 2, The projection unit is, The projection image is projected such that the control amount of the projection image becomes nonlinear with respect to the magnitude of the steering angle. Information projection device.

9. An information projection device according to claim 1, The information relating to the vehicle includes at least one of the following: road surface condition information relating to the condition of the road surface around the vehicle, raindrop-related information relating to raindrops around the vehicle, and wiper operation mode information relating to the operation of the wipers. The projection unit is, When it is determined that the road surface around the vehicle is wet to a predetermined degree based on at least one of the road surface condition information, the raindrop-related information, and the wiper operation mode information, the projected image is projected such that the range of the projected image projected to the left and right rear of the vehicle is smaller than under normal conditions. Information projection device.

10. An information projection device according to claim 1, The information relating to the vehicle includes turn signal illumination information relating to the illumination of the turn signals, The projection unit is, If it is determined that the turn signal is illuminated based on the turn signal illumination information, the projection image is projected such that the projection image projected onto the side of the vehicle where the turn signal is illuminated and the projection image projected onto the side of the vehicle where the turn signal is not illuminated are symmetrical. Information projection device.

Images