Vehicle display system and image projection device

Abstract

This vehicular display system is provided with: a first lamp fitting which emits near-infrared light; a second lamp fitting which emits visible light; a first camera which images a first image of a vehicle exterior being illuminated by the first lamp fitting; a second camera which includes the imaging range of the first camera, and which images a second image of the vehicle exterior being illuminated by the second lamp fitting; a control unit which, on the basis of the brightness of the second image, generates a third image in which the brightness of pixels in the first image corresponding to pixels in the second image is reduced; and a head-up display which displays the third image generated by the control unit.

Description

[Technical Field]

[0001] The present disclosure relates to a display system for a vehicle and an image projection device. [Background technology]

[0002] Patent Document 1 discloses an image correction device for a vehicle that corrects images captured by a near-infrared camera to allow the occupant to visually recognize obstacles ahead of the vehicle. It also discloses a nighttime driving visibility support device (night vision) that displays images from the near-infrared camera on a head-up display device to support the occupant's driving visibility at night or under adverse conditions.

[0003] Patent Document 2 discloses a head-up display in which visible light emitted by a display is reflected by a concave mirror on the windshield in the direction of the occupant, thereby displaying a virtual image to the occupant.

[0004] When external light such as sunlight enters the head-up display, the heat rays (infrared light) contained in the external light are concentrated on the display, causing a localized temperature rise, which may lead to distorted image display or thermal damage to the display.

[0005] In Patent Document 2, a cold mirror disposed between the display and the concave mirror prevents infrared light from being concentrated on the display. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2003-199094 [Patent Document 2] Japanese Patent Publication No. 2003-344801 Summary of the Invention [Problem to be solved by the invention]

[0007] Patent Document 1 discloses that, in order to clearly show pedestrians attempting to cross the roadway rather than the headlights of oncoming vehicles or streetlights, if there is a pixel in an image captured by a near-infrared camera that has a density value higher than the obstacle density value of the pixel corresponding to the pedestrian, the image is modified so that the density value of that pixel becomes a density value lower than the obstacle density value.

[0008] However, Patent Document 1 also displays an image captured by a near-infrared camera in the visible range, which results in the visible light image and the near-infrared light image being displayed overlapping each other in the visible range, which can be annoying for vehicle occupants in terms of visibility.

[0009] An object of the present disclosure is to provide a vehicle display system with improved visibility in the visible range.

[0010] Furthermore, the present disclosure has an object to provide an image projection device that can suppress the occurrence of heat damage caused by external light. [Means for solving the problem]

[0011] A vehicle display system according to a first aspect of the present disclosure includes: A vehicle display system provided in a vehicle, a first lamp that irradiates near-infrared light to the exterior of the vehicle; a second lamp that irradiates visible light to the outside of the vehicle; a first camera configured to capture a first image of the exterior of the vehicle illuminated by the first lamp; a second camera that captures a second image of the outside of the vehicle illuminated by the second lamp and that includes an imaging range of the first camera; a control unit that generates a third image by reducing the brightness of pixels of the first image corresponding to pixels of the second image based on the brightness of the second image; a head-up display configured to display the third image generated by the controller.

[0012] According to the vehicle display system of the present disclosure, the first camera and the second camera capture the same imaging range. Within the same imaging range, the control unit reduces the brightness of pixels in the first image corresponding to pixels in the second image based on the brightness of the second image captured using visible light. Even if the second image captured using visible light includes high-brightness pixels, the brightness of the corresponding pixels in the first image is reduced, and the corresponding pixels in the generated third image are displayed darkly. That is, in the third image displayed by the head-up display, pixels corresponding to high-brightness pixels in the second image captured using visible light are displayed darkly. Therefore, it is possible to reduce the visibility inconvenience caused by overlapping of the first image captured using visible light and the second image captured using near-infrared light in the visible range.

[0013] An image projection device according to a second aspect of the present disclosure, An image projection device that is provided in a vehicle and configured to display a predetermined image, an image generating device that emits light for generating the predetermined image; a reflecting section that reflects light emitted by the image generating device; a connection portion that connects the image generating device and the reflecting portion, At least a part of the connection portion is made of a bimetal.

[0014] The bimetal has the property of deforming in response to temperature changes. According to the above configuration, when external light enters the image projection device and the heat rays (far infrared rays) contained in the external light are focused on the image generation device, the temperature near the image generation device rises, causing at least a portion of the connection to deform. This changes the positional relationship between the reflector and the image generation device, preventing deterioration of the image generation device due to the heat rays being focused on the image generation device. As a result, heat damage caused by external light can be reduced.

[0015] In this specification, the "temperature in the vicinity of the image generating device" refers to the temperature around the image generating device, and includes the temperature of the area where the connection portion is located. [Effects of the Invention]

[0016] According to the present disclosure, it is possible to provide a vehicle display system with improved visibility in the visible range.

[0017] Furthermore, according to the present disclosure, it is possible to provide an image projection device that can suppress the occurrence of heat damage caused by external light. [Brief explanation of the drawings]

[0018] [Figure 1] FIG. 1 is a block diagram of a vehicle system including a vehicle display system according to a first embodiment. [Figure 2] FIG. 2 is a schematic diagram of a head-up display (HUD) according to this embodiment included in the vehicle display system. [Figure 3] FIG. 3 is a flowchart showing the flow of processing performed by the vehicular display system. [Figure 4] FIG. 4 is a schematic diagram of a second image captured by a second camera included in the vehicle display system. [Figure 5] FIG. 5 is a schematic diagram of a reference image generated by a vehicle display system. [Figure 6] FIG. 6 is a schematic diagram of a first image captured by a first camera included in the vehicle display system. [Figure 7] FIG. 7 is a schematic diagram of a third image generated by the vehicle display system. [Figure 8] FIG. 8 is a schematic diagram showing the configuration of a HUD according to the second embodiment. [Figure 9] FIG. 9 is a schematic diagram showing a partial configuration of the HUD as viewed from above. [Figure 10] FIG. 10 is a schematic diagram for explaining the optical path when external light enters the HUD. [Figure 11] FIG. 11 is a schematic diagram for explaining the optical path when external light enters the HUD. [Figure 12] FIG. 12 is a schematic diagram showing a partial configuration of a modified HUD as viewed from above. [Figure 13] FIG. 13 is a schematic diagram showing the configuration of a HUD according to the third embodiment. [Figure 14] FIG. 14 is a schematic diagram for explaining the optical path when external light enters the HUD. [Figure 15] FIG. 15 is a schematic diagram for explaining the optical path when external light enters the HUD. [Figure 16] FIG. 16 is a schematic diagram showing the configuration of a HUD according to a modified example. [Figure 17] FIG. 17 is a schematic diagram for explaining the optical path when external light enters the HUD. [Figure 18] FIG. 18 is a schematic diagram for explaining the optical path when external light enters the HUD. DETAILED DESCRIPTION OF THE INVENTION

[0019] Hereinafter, an embodiment of the present disclosure (hereinafter referred to as the present embodiment) will be described with reference to the drawings. For the sake of convenience, the dimensions of each component shown in the drawings may differ from the actual dimensions of each component.

[0020] In the description of this embodiment, for convenience of explanation, the "left-right direction," "up-down direction," and "front-rear direction" may be referred to as appropriate. These directions are relative directions set for the HUD (head-up display) 42 shown in FIG. 2. Here, the "left-right direction" is a direction that includes the "left direction" and the "right direction." The "up-down direction" is a direction that includes the "upward direction" and the "downward direction." The "front-rear direction" is a direction that includes the "forward direction" and the "rearward direction." Although not shown in FIG. 2, the left-right direction is a direction that is perpendicular to the up-down direction and the front-rear direction.

[0021] (First embodiment) A vehicle system 2 according to this embodiment will be described below with reference to Fig. 1. Fig. 1 is a block diagram of the vehicle system 2. A vehicle 1 equipped with the vehicle system 2 is a vehicle (automobile) capable of running in an autonomous driving mode.

[0022] 1, the vehicle system 2 includes a vehicle control unit 3, a vehicle display system 4 (hereinafter simply referred to as the "display system 4"), a sensor 5, a camera 6, and a radar 7. The vehicle system 2 further includes an HMI (Human Machine Interface) 8, a GPS (Global Positioning System) 9, a wireless communication unit 10, a storage device 11, a steering actuator 12, a steering device 13, a brake actuator 14, a brake device 15, an accelerator actuator 16, and an accelerator device 17.

[0023] The vehicle control unit 3 is configured to control the driving of the vehicle. The vehicle control unit 3 is configured, for example, by at least one electronic control unit (ECU). The electronic control unit includes a computer system (e.g., a system on a chip (SoC)) including one or more processors and one or more memories, and an electronic circuit configured of active elements such as transistors and passive elements. The processor includes, for example, at least one of a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), and a tensor processing unit (TPU). The CPU may be configured with multiple CPU cores. The GPU may be configured with multiple GPU cores. The memory includes a read-only memory (ROM) and a random access memory (RAM). A vehicle control program may be stored in the ROM. For example, the vehicle control program may include an artificial intelligence (AI) program for autonomous driving. The AI ​​program is a program (trained model) constructed by supervised or unsupervised machine learning (particularly, deep learning) using a multi-layer neural network. The RAM may temporarily store a vehicle control program, vehicle control data, and / or surrounding environment information indicating the surrounding environment of the vehicle. The processor may be configured to load a program specified from various vehicle control programs stored in the ROM onto the RAM and execute various processes in cooperation with the RAM. The computer system may also be configured using a non-von Neumann computer such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array). The computer system may also be configured using a combination of a von Neumann computer and a non-von Neumann computer.

[0024] The display system 4 includes a headlamp 20, an imaging camera 30, a road surface drawing device 45, a HUD 42, and a display control unit 43.

[0025] The headlamps 20 are arranged on the left and right sides of the front of the vehicle 1, and include a first lamp 21 that irradiates near-infrared light to the outside of the vehicle 1, and a second lamp 22 that irradiates visible light to the outside of the vehicle 1. The first lamp 21 and the second lamp 22 each have one or more light-emitting elements such as an LED (Light Emitting Diode) or an LD (Laser Diode), and optical members such as a lens and a reflector.

[0026] The first lamp 21 is configured to irradiate near-infrared light in a range that includes at least a range above the horizontal. For example, the first lamp 21 is a high beam lamp configured to irradiate a high beam ahead of the vehicle 1. The second lamp 22 is configured to irradiate visible light in a range that includes a range above the horizontal and a range below the horizontal. For example, the second lamp 22 includes a high beam lamp configured to irradiate a high beam ahead of the vehicle 1 and a low beam lamp configured to irradiate a low beam ahead of the vehicle 1. The high beam lamp of the second lamp 22 has an ADB (Adaptive Driving Beam) function to reduce glare to pedestrians and occupants of oncoming vehicles. The first lamp 21 may also irradiate near-infrared light in a range that includes a range below the horizontal. The first lamp 21 and the second lamp 22 may be integrally provided in a single housing, or may be provided in separate housings.

[0027] The imaging camera 30 includes a first camera 31 that captures a first image X1 of the exterior of the vehicle 1 illuminated by the first lamp 21, and a second camera 32 that captures a second image X2 of the exterior of the vehicle 1 illuminated by the second lamp 22. The imaging range of the first camera 31 and the imaging range of the second camera 32 include the same imaging area. To obtain approximately the same imaging angle and approximately the same imaging range, the first camera 31 and the second camera 32 are preferably integrally provided in the same housing. The first image X1 is a near-infrared image formed by receiving reflected light of light irradiated by the first lamp 21 that irradiates near-infrared light and near-infrared light emitted from the exterior. The second image X2 is a visible light image formed by receiving reflected light of light irradiated by the second lamp 22 that irradiates visible light and visible light emitted from the exterior.

[0028] The road surface drawing device 45 is disposed in the lamp chamber of the headlamp 20. The road surface drawing device 45 is configured to emit a light pattern toward a road surface outside the vehicle 1. The road surface drawing device 45 includes, for example, a light source unit, a drive mirror, an optical system such as lenses and mirrors, a light source drive circuit, and a mirror drive circuit. The light source unit is a laser light source or an LED light source. For example, the laser light source is an RGB laser light source configured to emit red laser light, green laser light, and blue laser light, respectively. The drive mirror is, for example, a MEMS (Micro Electro Mechanical Systems) mirror, a DMD (Digital Mirror Device), a galvanometer mirror, a polygon mirror, or the like. The light source drive circuit is configured to drive and control the light source unit. The light source drive circuit is configured to generate a control signal for controlling the operation of the light source unit based on a signal related to a predetermined light pattern transmitted from the display control unit 43, and then transmit the generated control signal to the light source unit. The mirror drive circuit is configured to drive and control the drive mirror. The mirror drive circuit is configured to generate a control signal for controlling the operation of the drive mirror based on a signal related to a predetermined light pattern transmitted from the display control unit 43, and then transmit the generated control signal to the drive mirror. When the light source unit is an RGB laser light source, the road surface drawing device 45 can draw light patterns of various colors on the road surface by scanning the laser light. For example, the light pattern may be an arrow-shaped light pattern indicating the traveling direction of the vehicle.

[0029] The road surface drawing device 45 may use a raster scan method, a DLP (Digital Light Processing) method, or an LCOS (Liquid Crystal on Silicon) method. If the DLP method or the LCOS method is used, the light source unit may be an LED light source. The road surface drawing device may use a projection method as its drawing method. If the projection method is used, the light source unit may be a plurality of LED light sources arranged in a matrix. The road surface drawing device 45 may be disposed in the lamp chambers of the left and right headlamps, respectively, or may be disposed on the vehicle roof, bumper, or grille.

[0030] At least a portion of the HUD 42 is located inside the vehicle 1. Specifically, the HUD 42 is installed in a predetermined location inside the vehicle 1. For example, the HUD 42 may be disposed in the dashboard of the vehicle 1. The HUD 42 is a visual interface between the vehicle 1 and the occupant. The HUD 42 is configured to display predetermined information (hereinafter referred to as HUD information) to the occupant so that the HUD information is superimposed on the real space outside the vehicle 1 (particularly, the surrounding environment in front of the vehicle). In this manner, the HUD 42 is an AR (Augmented Reality) display. The HUD information displayed by the HUD 42 is, for example, vehicle driving information related to the driving of the vehicle 1 and / or surrounding environment information related to the surrounding environment of the vehicle 1 (particularly, information related to objects present outside the vehicle 1). Details of the HUD 42 will be described later.

[0031] The display control unit 43 is configured to control the operations of the road surface drawing device 45, the headlamps 20, and the HUD 42. The display control unit 43 is configured by an electronic control unit (ECU). The electronic control unit includes a computer system (e.g., SoC, etc.) including one or more processors and one or more memories, and an electronic circuit configured by active elements such as transistors and passive elements. The processor includes at least one of a CPU, an MPU, a GPU, and a TPU. The memory includes a ROM and a RAM. The computer system may also be configured by a non-von Neumann type computer such as an ASIC or an FPGA. The display control unit 43 is an example of a control unit.

[0032] In this embodiment, the vehicle control unit 3 and the display control unit 43 are provided as separate components, but the vehicle control unit 3 and the display control unit 43 may also be configured as an integrated unit. In this regard, the display control unit 43 and the vehicle control unit 3 may be configured as a single electronic control unit. Furthermore, the display control unit 43 may be configured by two electronic control units: an electronic control unit configured to control the operation of the headlamps 20 and the road surface drawing device 45, and an electronic control unit configured to control the operation of the HUD 42. Furthermore, the control board 425 that controls the operation of the HUD 42 may be configured as a part of the display control unit 43.

[0033] The sensor 5 includes at least one of an acceleration sensor, a speed sensor, and a gyro sensor. The sensor 5 is configured to detect the driving state of the vehicle 1 and output driving state information to the vehicle control unit 3. The sensor 5 may further include a seating sensor that detects whether the driver is sitting in the driver's seat, a face direction sensor that detects the direction of the driver's face, an external weather sensor that detects the external weather conditions, and a human presence sensor that detects whether a person is inside the vehicle.

[0034] The camera 6 is a camera including an imaging element such as a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). The camera 6 includes one or more external cameras 6A and an internal camera 6B. The external camera 6A is configured to acquire image data showing the vehicle's surroundings and transmit the image data to the vehicle control unit 3. The vehicle control unit 3 acquires surrounding environment information based on the transmitted image data. Here, the surrounding environment information may include information about objects (pedestrians, other vehicles, signs, etc.) present outside the vehicle 1. For example, the surrounding environment information may include information about the attributes of objects present outside the vehicle 1 and information about the distance and position of the objects relative to the vehicle 1. The external camera 6A may be configured as a monocular camera or a stereo camera. The imaging camera 30 may be substituted for the external camera 6A.

[0035] The internal camera 6B is disposed inside the vehicle 1 and configured to acquire image data showing the occupant. The internal camera 6B functions as a tracking camera that tracks the occupant's viewpoint E. Here, the occupant's viewpoint E may be either the viewpoint of the occupant's left eye or the viewpoint of the occupant's right eye. Alternatively, the viewpoint E may be defined as the midpoint of a line segment connecting the viewpoint of the left eye and the viewpoint of the right eye. The display control unit 43 may identify the position of the occupant's viewpoint E based on the image data acquired by the internal camera 6B. The position of the occupant's viewpoint E may be updated at a predetermined interval based on the image data, or may be determined only once when the vehicle is started.

[0036] The radar 7 includes at least one of a millimeter wave radar, a microwave radar, and a laser radar (e.g., a LiDAR unit). For example, the LiDAR unit is configured to detect the surrounding environment of the vehicle 1. In particular, the LiDAR unit is configured to acquire 3D mapping data (point cloud data) indicating the surrounding environment of the vehicle 1, and then transmit the 3D mapping data to the vehicle control unit 3. The vehicle control unit 3 identifies surrounding environment information based on the transmitted 3D mapping data.

[0037] The HMI 8 is composed of an input unit that accepts input operations from the driver and an output unit that outputs driving information and the like to the driver. The input unit includes a steering wheel, an accelerator pedal, a brake pedal, a driving mode changeover switch that changes the vehicle's driving mode, and the like. The output unit is a display (excluding the HUD) that displays various driving information. The GPS 9 is configured to acquire current location information of the vehicle 1 and output the acquired current location information to the vehicle control unit 3.

[0038] The wireless communication unit 10 is configured to receive information (e.g., travel information, etc.) about other vehicles around the vehicle 1 from the other vehicles and transmit information (e.g., travel information, etc.) about the vehicle 1 to the other vehicles (vehicle-to-vehicle communication). The wireless communication unit 10 is also configured to receive infrastructure information from infrastructure facilities such as traffic lights and marker lights and transmit travel information about the vehicle 1 to the infrastructure facilities (road-to-vehicle communication). The wireless communication unit 10 is also configured to receive information about pedestrians from portable electronic devices (smartphones, tablets, wearable devices, etc.) carried by pedestrians and transmit travel information about the vehicle 1 to the portable electronic devices (pedestrian-to-vehicle communication). The vehicle 1 may communicate with other vehicles, infrastructure facilities, or portable electronic devices directly in ad hoc mode or via an access point. The vehicle 1 may also communicate with other vehicles, infrastructure facilities, or portable electronic devices via a communication network (not shown). The communication network includes at least one of the Internet, a local area network (LAN), a wide area network (WAN), and a radio access network (RAN). The wireless communication standard may be, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), ZigBee (registered trademark), LPWA, DSRC (registered trademark), or Li-Fi. Vehicle 1 may also communicate with other vehicles, infrastructure facilities, or portable electronic devices using a fifth-generation mobile communication system (5G).

[0039] The storage device 11 is an external storage device such as a hard disk drive (HDD) or a solid state drive (SSD). Two-dimensional or three-dimensional map information and / or a vehicle control program may be stored in the storage device 11. For example, the three-dimensional map information may be composed of 3D mapping data (point cloud data). The storage device 11 is configured to output the map information and the vehicle control program to the vehicle control device 3 in response to a request from the vehicle control device 3. The map information and the vehicle control program may be updated via the wireless communication unit 10 and a communication network.

[0040] When the vehicle is traveling in the autonomous driving mode, the vehicle control unit 3 automatically generates at least one of a steering control signal, an accelerator control signal, and a brake control signal based on traveling condition information, surrounding environment information, current position information, map information, etc. The steering actuator 12 is configured to receive the steering control signal from the vehicle control unit 3 and control the steering device 13 based on the received steering control signal. The brake actuator 14 is configured to receive the brake control signal from the vehicle control unit 3 and control the brake device 15 based on the received brake control signal. The accelerator actuator 16 is configured to receive the accelerator control signal from the vehicle control unit 3 and control the accelerator device 17 based on the received accelerator control signal. In this way, the vehicle control unit 3 automatically controls the traveling of the vehicle 1 based on the traveling condition information, surrounding environment information, current position information, map information, etc. In other words, in the autonomous driving mode, the traveling of the vehicle 1 is automatically controlled by the vehicle system 2.

[0041] On the other hand, when the vehicle 1 is driven in the manual driving mode, the vehicle control unit 3 generates a steering control signal, an accelerator control signal, and a brake control signal in accordance with the driver's manual operation of the accelerator pedal, the brake pedal, and the steering wheel. In this way, in the manual driving mode, the steering control signal, the accelerator control signal, and the brake control signal are generated by the driver's manual operation, so that the driving of the vehicle 1 is controlled by the driver.

[0042] Next, the driving modes of the vehicle will be described. The driving modes include an autonomous driving mode and a manual driving mode. The autonomous driving modes include a fully autonomous driving mode, an advanced driving assistance mode, and a driving assistance mode. In the fully autonomous driving mode, the vehicle system 2 automatically performs all driving control, including steering control, braking control, and accelerator control, and the driver is not in a state where he or she can drive the vehicle 1. In the advanced driving assistance mode, the vehicle system 2 automatically performs all driving control, including steering control, braking control, and accelerator control, and the driver is in a state where he or she can drive the vehicle 1 but does not drive the vehicle 1. In the driving assistance mode, the vehicle system 2 automatically performs some driving control, including steering control, braking control, and accelerator control, and the driver drives the vehicle 1 with the driving assistance of the vehicle system 2. On the other hand, in the manual driving mode, the vehicle system 2 does not automatically perform driving control, and the driver drives the vehicle 1 without the driving assistance of the vehicle system 2.

[0043] Next, the HUD 42 will be described in detail. Fig. 2 is a schematic diagram of the HUD 42 according to this embodiment. As shown in Fig. 2, the HUD 42 includes a HUD main body 420. The HUD main body 420 has a housing 422 and an exit window 423. The exit window 423 is a transparent plate that transmits visible light. Inside the housing 422, the HUD main body 420 has a picture generation unit (PGU) 424, a control board 425, a concave mirror 426, a drive mechanism 427, and a plane mirror 428.

[0044] The image generation unit 424 is configured to emit light for generating a predetermined image. The image generation unit 424 is fixed to the housing 422. The light emitted from the image generation unit 424 is, for example, visible light. Although detailed illustration is omitted, the image generation unit 424 includes a light source, optical components, and a display device. The light source is, for example, a laser light source or an LED light source. The LED light source is, for example, a white LED light source. The laser light source is, for example, an RGB laser light source configured to emit red laser light, green laser light, and blue laser light, respectively. The optical components include a prism, a lens, a diffuser, a magnifying glass, etc. The optical components transmit the light emitted from the light source and emit it toward the display device. The display device is, for example, a liquid crystal display, a DMD (Digital Mirror Device), etc. The drawing method of the image generation unit 424 may be a raster scan method, a DLP (Digital Light Processing) method, or an LCOS (Liquid Crystal On Silicon) method. When the DLP system or the LCOS system is adopted, the light source of the HUD 42 may be an LED light source. Note that when the liquid crystal display system is adopted, the light source of the HUD 42 may be a white LED light source. The image generation unit 424 is an example of an image generation device.

[0045] The control board 425 is configured to control the operation of each unit, including the image generation unit 424 and the drive mechanism 427. The control board 425 is equipped with a processor such as a CPU (Central Processing Unit) and a memory, and the processor executes a computer program read from the memory to control the operation of the image generation unit 424. The control board 425 is configured to generate a control signal for controlling the operation of the image generation unit 424 based on image data transmitted from the display control unit 43, and transmit the generated control signal to the image generation unit 424. The control board 425 is connected to the vehicle control unit 3 of the vehicle 1, and may generate a control signal based on, for example, vehicle driving information, surrounding environment information, etc. transmitted from the vehicle control unit 3, and transmit the generated control signal to the image generation unit 424. The control board 425 may also control the concave mirror 426 to change its orientation via the drive mechanism 427.

[0046] The concave mirror 426 is disposed on the optical path of the light emitted from the image generation unit 424 and reflected by the plane mirror 428. Specifically, the concave mirror 426 is disposed in front of the image generation unit 424 and the plane mirror 428 inside the HUD main body 420. The concave mirror 426 is configured to reflect the light emitted by the image generation unit 424 toward the windshield 18 (for example, the front window of the vehicle 1) through the exit window 423. The concave mirror 426 has a concavely curved reflective surface that forms a virtual image, and reflects the image of the light emitted from the image generation unit 424 and formed at a predetermined magnification.

[0047] The light emitted from the exit window 423 of the HUD main body 420 is irradiated onto the windshield 18. A portion of the light irradiated from the HUD main body 420 onto the windshield 18 is reflected toward the occupant's viewpoint E. As a result, the occupant recognizes the light emitted from the HUD main body 420 as a virtual image (predetermined image) formed at a predetermined distance in front of the windshield 18. In this way, the image displayed by the HUD 42 is superimposed on the real space in front of the vehicle 1 through the windshield 18, and as a result, the occupant can visually recognize the virtual image object I formed by the predetermined image as floating above the road outside the vehicle.

[0048] When a 2D image (planar image) is formed as the virtual image object I, a predetermined image is projected to become a virtual image at a single distance that is arbitrarily determined. When a 3D image (stereoscopic image) is formed as the virtual image object I, a plurality of predetermined images that may be identical or different from one another are projected to become virtual images at different distances. The distance of the virtual image object I (the distance from the occupant's viewpoint E to the virtual image) can be adjusted by adjusting the distance from the image generation unit 424 to the occupant's viewpoint E (for example, by adjusting the distance between the image generation unit 424 and the concave mirror 426). The HUD main body 420 does not need to have the plane mirror 428. In this case, the light emitted from the image generation unit 424 is incident on the concave mirror 426 without being reflected by the plane mirror 428.

[0049] Next, the processing flow of the display system 4 according to this embodiment will be described.

[0050] As shown in FIG. 3, first, the first lamp 21 irradiates the outside of the vehicle 1 with near-infrared light (step SA1). Then, the first camera 31 captures an image of the outside of the vehicle 1 illuminated by the near-infrared light to obtain a first image X1 (step SA2). In the first image X1, which is a near-infrared light image, pixels corresponding to objects brightly illuminated by the near-infrared light are pixels with high brightness, and pixels corresponding to objects relatively dimly illuminated by the near-infrared light are pixels with low brightness. The brightness may have a value between 0 and 255. The first camera 31 transmits the obtained first image X1 to the display control unit 43.

[0051] Similarly, the second lamp 22 irradiates the outside of the vehicle 1 with visible light (step SB1). Thereafter, the second camera 32 captures an image of the outside of the vehicle 1 illuminated by visible light to acquire a second image X2 (step SB2). In the second image X2, which is a visible light image, pixels corresponding to objects brightly illuminated by visible light are pixels with high brightness, and pixels corresponding to objects relatively dimly illuminated by visible light are pixels with low brightness. Brightness may have a value between 0 and 255. The second camera 32 transmits the acquired second image X2 to the display control unit 43.

[0052] Because the imaging range of the first camera 31 and the imaging range of the second camera 32 include the same imaging range, pixel P1A in the first image X1 captured by the first camera 31 and pixel P2A in the second image X2 captured by the second camera 32 correspond to each other and represent an object at the same position. Similarly, pixel P1B in the first image X1 and pixel P2B in the second image X2 correspond to each other and represent another object at the same position.

[0053] The first lamp 21 emits near-infrared light in a range in front of the vehicle 1, including above the horizontal, while the second lamp 22 emits visible light in a range in front of the vehicle 1, including above the horizontal and below the horizontal. The second lamp 22 has an ADB function to reduce glare on pedestrians and occupants of oncoming vehicles when emitting visible light. That is, the second lamp 22 does not emit visible light toward pedestrians or the body of an oncoming vehicle, but the first lamp 21 emits near-infrared light toward pedestrians and the body of an oncoming vehicle. Pixel P1A of the first image X1 is a pixel with a luminance reflecting near-infrared light, and pixel P2A of the second image X2 is a pixel with a luminance reflecting visible light. Similarly, pixel P1B of the first image X1 is a pixel with a luminance reflecting near-infrared light, and pixel P2B of the second image X2 is a pixel with a luminance reflecting visible light. The respective luminances are not related to each other and are independent values.

[0054] The display control unit 43 performs a gradation inversion process on the transmitted second image X2 (step SB3). Specifically, the display control unit 43 relatively inverts the luminance of high-luminance pixels in the second image X2 and the luminance of low-luminance pixels in the second image X2. Through the gradation inversion process, the luminance of pixels detected as bright pixels is converted from a high value to a low value, and the luminance of pixels detected as dark pixels is converted from a low value to a high value. For example, if the luminance of pixel P2A (an example of a high-luminance pixel), which is displayed the brightest in the second image X2, is 255, the luminance of pixel P2A is converted to 0 through the gradation inversion process. For example, if the luminance of pixel P2B (an example of a low-luminance pixel), which is displayed relatively dark in the second image X2, is 30, the luminance of pixel P2B is converted to 225 through the gradation inversion process.

[0055] The display control unit 43 further performs a transparency process on the second image X2 that has been subjected to the tone inversion process (step SB4). Specifically, the display control unit 43 sets a high transparency for the pixel P2B whose luminance has increased, and sets a low transparency for the pixel P2A whose luminance has decreased. For example, if the luminance of the pixel P2B is converted to 225 by the tone inversion process, a transparency of 225 is set for the pixel P2B. For example, if the luminance of the pixel P2A is converted to 0 by the tone inversion process, a transparency of 0 is set for the pixel P2A.

[0056] The display control unit 43 generates a reference image Y by performing a transparency process on the second image X2 (step SB5). The pixel P2A, which is displayed brightest in the second image X2, which is a visible light image, corresponds to the pixel P2A' in the reference image Y. The transparency of the pixel P2A' is 0. The pixel P2B, which is displayed relatively dark in the second image X2, which is a visible light image, corresponds to the pixel P2B' in the reference image Y. The transparency of the pixel P2B' is 225.

[0057] After generating the reference image Y, the display control unit 43 generates a third image X3 by overlaying the generated reference image Y on the first image X1 transmitted from the first camera 31 (step S7). For example, if the brightness of pixel P1A in the first image X1 corresponding to pixel P2A' in the reference image Y is 100, pixel P2A' with transparency 0 is overlaid on pixel P1A with brightness 100. At this time, pixel P2A' with transparency 0 does not transmit any light regardless of the brightness value of the pixel P1A with which it is overlaid, so the brightness of pixel P1A becomes 0. For example, if the brightness of pixel P1B in the first image X1 corresponding to pixel P2B' in the reference image Y is 100, pixel P2B' with transparency 225 is overlaid on pixel P1B with brightness 100. At this time, pixel P2B' with transparency 225 transmits most of the brightness of pixel P1B with which it is overlaid, so the brightness of pixel P1B becomes, for example, 88.

[0058] In this way, the display control unit 43 generates the third image X3 by lowering the brightness of pixels in the first image X1 that correspond to pixels in the second image X2, based on the brightness of the second image X2. More specifically, a low transparency is set to pixels that were displayed brightest in the second image X2, which is a visible light image, so that the corresponding pixels in the third image X3 appear dark. Conversely, a high transparency is set to pixels that were displayed relatively dark in the second image X2, which is a visible light image, so that the corresponding pixels in the third image X3 appear relatively bright.

[0059] The third image X3 generated by the display control unit 43 is displayed by the HUD 42 toward the occupant of the vehicle 1 (step S8). Specifically, the HUD 42 is configured to display the third image X3 toward the occupant so that the third image X3 is superimposed on the visible space outside the vehicle 1. In this way, the occupant of the vehicle 1 can view the third image X3 in which the brightness of the pixels of the first image X1, which is a near-infrared light image, has been reduced based on the brightness of the second image X2, which is a visible light image.

[0060] When the third image X3 is generated (step S7), it is preferable that the imaging timings of the first camera 31 and the second camera 32 differ by a predetermined small time so that the superimposed reference image Y and the first image X1 both show the same object. Specifically, it is preferable that the imaging timing of the first camera 31 is delayed from the imaging timing of the second camera 32 by a small time required for the display control unit 43 to generate the reference image Y based on the second image X2.

[0061] Furthermore, the display control unit 43 may adjust the contrast of the second image X2 before setting transparency for the pixels of the second image X2 (step SB6). The display control unit 43 may perform such contrast adjustment before the tone inversion process (step SB3) or before the transparency process (step SB4). For example, when the luminance distribution in the image is biased toward high luminance or low luminance, the display control unit 43 may adjust the contrast so that the difference between the luminance of pixel P2A and the luminance of pixel P2B increases (so that the difference in contrast of the second image X2 changes significantly). Alternatively, the display control unit 43 may adjust the contrast so that the difference between the luminance of pixel P2A and the luminance of pixel P2B decreases (so that the difference in contrast of the second image X2 changes gradually).

[0062] The display control unit 43 may adjust the contrast of the third image X3 (step SB6) before displaying the third image X3 on the HUD 42 (step S8). For example, the display control unit 43 may adjust the contrast so that the difference in contrast of the third image X3 changes significantly. Alternatively, the display control unit 43 may adjust the contrast so that the difference in contrast of the third image X3 changes gradually.

[0063] Next, with reference to FIGS. 4 to 7, images generated by the display system 4 according to this embodiment will be described. FIGS. 4 to 7 show schematic diagrams of various images handled by the display control unit 43 when the vehicle 1 is traveling at night with the headlights 20 turned on. A common feature between FIGS. 4 to 7 is that an oncoming vehicle 60 is traveling on the road on which the vehicle 1 is traveling. The oncoming vehicle 60 is traveling with headlights 62 attached to a body 61 of the oncoming vehicle turned on. The area brightly displayed by the illumination of the low beam lamps of the headlights 20 of the vehicle 1 is referred to as area 53. The area brightly displayed by the illumination of the low beam lamps of the headlights 62 is referred to as area 63. A pedestrian 70 is located ahead of the vehicle 1, farther away than area 53. HH indicates the horizon. The first lamp 21 of this embodiment is configured to illuminate the entire area ahead of the vehicle 1, including the area above (farther away from) the horizon HH.

[0064] FIG. 4 is a schematic diagram of the second image X2 captured by the second camera 32 (step SB2 in FIG. 3). As shown in FIG. 4, in the second image X2, which is a visible light image, the headlights 62 of the oncoming vehicle 60 are displayed most brightly. The luminance of a pixel P262 in the second image X2, which corresponds to the headlights 62, is, for example, 255. Furthermore, the area 53 illuminated by the headlights 20 of the vehicle 1 and the area 63 illuminated by the headlights 62 of the oncoming vehicle 60 are displayed relatively brightly. The luminance of a pixel P253 corresponding to the area 53 and the luminance of a pixel P263 corresponding to the area 63 are, for example, 200. The oncoming vehicle body 61 and the pedestrian 70 of the oncoming vehicle 60 are displayed dark, and the occupants of the vehicle 1 can hardly see the oncoming vehicle body 61 and the pedestrian 70. The luminance of a pixel P261 corresponding to the oncoming vehicle body 61 and the pedestrian 70 are, for example, 30. The second image X2 is transmitted to the display control unit 43.

[0065] The display control unit 43 performs a gradation inversion process on the transmitted second image X2 (step SB3 in FIG. 3). For example, the luminance of pixel P262 corresponding to headlamp 62 is converted from 255 to 0. The luminance of pixel P253 corresponding to region 53 and the luminance of pixel P263 corresponding to region 63 are converted from 200 to 55. The luminance of pixel P261 corresponding to oncoming vehicle body 61 and the luminance of pixel P270 corresponding to pedestrian 70 are converted from 30 to 225. In this way, the display control unit 43 relatively inverts the luminance of high-luminance pixels in the second image X2 and the luminance of low-luminance pixels in the second image X2.

[0066] After the gradation inversion process, the display control unit 43 performs a transparency process on the second image X2 that has been subjected to the gradation inversion process (step SB4 in FIG. 3). As a result, a transparency of 0 is set for pixel P262 corresponding to headlamp 62. A transparency of 55 is set for pixel P253 corresponding to region 53 and pixel P263 corresponding to region 63. A transparency of 225 is set for pixel P261 corresponding to oncoming vehicle body 61 and pixel P270 corresponding to pedestrian 70. In this manner, the display control unit 43 generates a reference image Y (step SB5 in FIG. 3). FIG. 5 is a schematic diagram of the reference image Y generated by the display control unit 43. Pixels set to a high transparency in the reference image Y correspond to pixels in a portion that will be displayed brightly in the image (third image X3) that will ultimately be displayed, and pixels set to a low transparency in the reference image Y correspond to pixels in a portion that will not be displayed or will be displayed darkly in the image (third image X3) that will ultimately be displayed. 5, in the reference image Y, a low transparency of 0 is set for pixel P262' corresponding to headlamp 62, which was displayed brightest in second image X2. On the other hand, a relatively high transparency of 225 is set for pixel P261' corresponding to body 61 of the oncoming vehicle and pixel P270 corresponding to pedestrian 70', which were displayed dark in second image X2. A relatively low transparency of 55 is set for pixel P253' corresponding to region 53 and pixel P263' corresponding to region 63, which were displayed relatively bright in second image X2. In this way, in this embodiment, by creating reference image Y, pixels to be displayed as third image X3 to be displayed to the occupants of vehicle 1 are extracted from second image X2, which is a visible light image.

[0067] FIG. 6 is a schematic diagram of a first image X1 captured by the first camera 31 (step SA1 in FIG. 3). As shown in FIG. 5, in the first image X1, which is a near-infrared light image, the headlamp 62 of the oncoming vehicle 60 is displayed most brightly. The luminance of a pixel P162 in the first image X1, which corresponds to the headlamp 62, is, for example, 255. The area 53 illuminated by the headlamp 20 of the vehicle 1 and the area 63 illuminated by the headlamp 62 of the oncoming vehicle 60 are displayed relatively brightly. The luminance of a pixel P153 corresponding to the area 53 and the luminance of a pixel P163 corresponding to the area 63 are, for example, 200. The oncoming vehicle body 61 and the pedestrian 70 of the oncoming vehicle 60 are also displayed relatively brightly. The luminance of a pixel P161 corresponding to the oncoming vehicle body 61 and the luminance of a pixel P170 corresponding to the pedestrian 70 are, for example, 200. The first image X1 is transmitted to the display control unit 43.

[0068] The display control unit 43 generates a third image X3 by superimposing the transmitted first image X1 (FIG. 6) on the generated reference image Y (FIG. 5) (step S7 in FIG. 3). This image processing is so-called mask processing, and the third image X3 is a masked image. For example, pixel P262' of the reference image Y is superimposed on pixel P162 of the first image X1, which corresponds to the headlamp 62. Because the transparency of pixel P262' is 0, the luminance of pixel P162 becomes 0 when superimposed. Pixel P253' of the reference image Y is superimposed on pixel P153 of the first image X1, which corresponds to region 53. Because the transparency of pixel P253' is 55, the luminance of pixel P153 becomes approximately 40 when superimposed. The same applies to pixel P163 of the first image X1, which corresponds to region 63. Pixel P261' of the reference image Y is superimposed on pixel P161 of the first image X1, which corresponds to the oncoming vehicle body 61. The transparency of pixel P261' is 225, so when they are superimposed, the brightness of pixel P161 becomes approximately 180. The same is true for pixel P170 of the first image X1 corresponding to the pedestrian 70.

[0069] FIG. 7 is a schematic diagram of the third image X3 generated by the display control unit 43. As shown in FIG. 7, a low transparency is set for pixel P262 of the headlamp 62, which was displayed brightest in the second image X2, which is a visible light image, and therefore the corresponding pixel in the third image X3 is displayed dark. In this example, the brightness of the pixel of the headlamp 62 in the third image X3 is too low, so the headlamp 62 is not displayed at all in the third image X3. Conversely, a high transparency is set for pixel P261 of the oncoming vehicle body 61 or pixel P270 of the pedestrian 70, which were displayed relatively dark in the second image X2, which is a visible light image, and therefore the corresponding pixel in the third image X3 is displayed relatively bright. In this example, the occupant of the vehicle 1 can visually recognize the oncoming vehicle body 61 or the pedestrian 70 based on the third image X3. A low transparency is set for pixel P253 or P263 of region 53 or region 63, which were displayed relatively bright in the second image X2, which is a visible light image, and therefore the corresponding pixel in the third image X3 is displayed dark. In this example, the brightness of the area 53 or the area 63 of the third image X3 is too low, so that the occupants of the vehicle 1 hardly see the area 53 or the area 63.

[0070] A vehicular display system without the use of this embodiment will be described. Generally, an occupant of a vehicle 1 traveling at night can see the contents of the second image X2 (visible light image) shown in FIG. 4 through the windshield. For example, the occupant can see the headlights 62 of an oncoming vehicle 60 and areas 53 and 63, but cannot see the oncoming vehicle body 61 or a pedestrian 70. This is because the number of objects illuminated by visible light is limited under poor visibility conditions such as at night or in bad weather. If the first image X1 (near-infrared light image) shown in FIG. 6 is displayed on the HUD 42 to assist visibility, the occupant can see the oncoming vehicle body 61 and the pedestrian 70 through the HUD 42. However, the occupant also sees the headlights 62 and areas 53 and 63 through the HUD 42. If the headlights 62 and areas 53, 63 of the oncoming vehicle 60 that are already visible through the windshield are also displayed on the HUD 42, this may be bothersome to the occupants in terms of visibility.

[0071] On the other hand, in this embodiment, the first camera 31 and the second camera 32 include the same imaging range. Within the same imaging range, the display control unit 43 reduces the brightness of pixels in the first image X1 that correspond to high-brightness pixels in the second image X2 based on the brightness of the second image X2 captured using visible light. Even if the second image X2 captured using visible light includes high-brightness pixels, the brightness of the corresponding pixels in the first image X1 is reduced, and therefore the corresponding pixels in the generated third image X3 are displayed darkly. That is, in the third image X3 displayed by the HUD 42, pixels that correspond to high-brightness pixels in the second image X2 captured using visible light are displayed darkly. For example, the headlights 62 and areas 53 and 63 of the oncoming vehicle 60 are displayed darkly on the HUD 42. The headlights 62 and areas 53 and 63 of the oncoming vehicle 60, which are already visible through the windshield, are displayed darkly on the HUD 42, thereby reducing the inconvenience of visibility. As described above, according to this embodiment, compared to when the first image X1, which is a near-infrared light image, is displayed directly on the HUD 42, the third image X3, in which the brightness of the pixels of the first image X1 corresponding to the second image X2, which is a visible light image, is reduced, is displayed on the HUD 42, thereby providing a better nighttime driving visibility support system (night vision system).

[0072] The display control unit 43 inverts the second image X2 so that the brightness of high-brightness pixels is low and the brightness of low-brightness pixels is high, and sets the transparency level based on the inverted pixel values. By overlaying the reference image Y generated in this way on the first image X1, a highly accurate third image X3 can be generated. This reduces the visibility annoyance caused by the overlap of the first image X1 and the second image X2 in the visible region.

[0073] The display control unit 43 can adjust the difference in transparency by adjusting the contrast difference of the second image X2 before setting the transparency. For example, if the contrast difference of the second image X2 is increased, the difference in luminance between high-luminance pixels and low-luminance pixels becomes larger, and therefore the difference in transparency also becomes larger. As a result, the display control unit 43 can create a reference image Y in which the boundary between high-luminance pixels and low-luminance pixels is clearly visible, and can extract a third image X3 in which the boundary between high-luminance pixels and low-luminance pixels is more emphasized. On the other hand, if the contrast difference between high-luminance pixels and low-luminance pixels is reduced, the difference in transparency is also set smoothly. As a result, the display control unit 43 can represent even the subtle differences in luminance at the boundary between high-luminance pixels and low-luminance pixels in the reference image Y, and can generate a more precise third image X3.

[0074] The third image X3 generated by the display control unit 43 may have low overall brightness. However, the display control unit adjusts the contrast of the third image X3, so that the brightness of pixels with relatively high brightness in the third image X3 can be set higher, and even the brightness of pixels with relatively low brightness can be set high enough to be visible to the occupants of the vehicle 1. Therefore, the third image X3 as a whole will not be too dark, and the third image X3 can be displayed more clearly using the HUD 42.

[0075] The first lamp 21 that emits near-infrared light is configured to emit near-infrared light in a range that includes above the horizontal, i.e., over a long distance. Therefore, at night or under adverse conditions, near-infrared light can be emitted to distant obstacles that are invisible to the occupants of the vehicle 1, allowing the occupants to check the distant obstacles and improving driving safety.

[0076] Second Embodiment FIG. 8 is a schematic diagram of a HUD 42A according to the second embodiment, viewed from the side of the vehicle 1. FIG. 9 is a schematic diagram of an image generation unit 424, a concave mirror 426, and a connection unit 429, viewed from above. The HUD 42A is provided in the vehicle 1. For example, the HUD 42A is disposed in the dashboard of the vehicle 1. In the description of the second embodiment, for convenience, descriptions of components having the same reference numbers as components already described in the description of the first embodiment will be omitted. The HUD 42A is an example of an image projection device.

[0077] The HUD 42A is configured to display a predetermined image. The predetermined image may include a still image or a moving image (video). The HUD 42A functions as a visual interface between the vehicle 1 and the occupants of the vehicle 1. Specifically, the HUD 42A is configured to display predetermined information as an image so that the information is superimposed on the real space outside the vehicle 1 (particularly, the surrounding environment in front of the vehicle 1). The information displayed by the HUD 42A is, for example, vehicle driving information related to the driving of the vehicle 1 and / or surrounding environment information related to the surrounding environment of the vehicle 1 (particularly, information related to objects present outside the vehicle 1).

[0078] 8, HUD main body 420 of HUD 42A has, inside housing 422, an image generation unit (PGU) 424, a control board 425, a plane mirror 428, a concave mirror 426, and a connection unit 429. Concave mirror 426 is an example of a reflecting unit.

[0079] In this example, as illustrated in FIG. 9, the image generating unit 424 has a frame unit 242 that surrounds a display device 241.

[0080] Plane mirror 428 is disposed on the optical path of the light emitted from image generation unit 424. Specifically, plane mirror 428 is disposed above image generation unit 424 and configured to reflect the light emitted from image generation unit 424 toward concave mirror 426. Plane mirror 428 has a flat reflecting surface and reflects the image of the light emitted from image generation unit 424 and formed at the same magnification.

[0081] In this example, concave mirror 426 has a rotation axis 426A and is configured to be rotatable around rotation axis 426A.

[0082] 9, connecting portion 429 is configured to connect image generating portion 424 and concave mirror 426. In this example, as illustrated in FIG. 9, connecting portion 429 is configured by a connecting portion that connects the left end of frame portion 242 of image generating portion 424 to the left end of concave mirror 426, and a connecting portion that connects the right end of frame portion 242 to the right end of concave mirror 426.

[0083] Connection portion 429 is formed from a bimetal. A bimetal has the property of deforming in response to temperature changes. Specifically, a bimetal is made up of multiple metal plates with different thermal expansion coefficients, and deforms into a curved or flat shape in response to temperature changes. That is, connection portion 429 is configured to deform in response to changes in the ambient temperature, and the deformation of connection portion 429 causes concave mirror 426 connected to connection portion 429 to rotate about rotation axis 426A, changing the orientation of its reflecting surface.

[0084] In the HUD 42A configured as described above, as illustrated in Fig. 8, light L1 emitted from the image generation unit 424 is reflected by the plane mirror 428 and the concave mirror 426 and emitted from the exit window 423 of the HUD main body 420. The light emitted from the exit window 423 of the HUD main body 420 is irradiated onto the windshield 18. A portion of the light irradiated onto the windshield 18 from the exit window 423 is reflected toward the occupant's viewpoint E. As a result, the occupant recognizes the light emitted from the HUD main body 420 as a virtual image (a predetermined image) formed at a predetermined distance in front of the windshield 18.

[0085] 10, external light L2 such as sunlight incident from outside the vehicle may enter the housing 422 through the exit window 423 of the HUD 42A, be reflected by the concave mirror 426 and the plane mirror 428, and be condensed on the image generation unit 424. In this case, far infrared rays contained in the external light may cause an excessive temperature rise in the image generation unit 424, which may result in deterioration of the image generation unit 424.

[0086] In contrast, the connecting portion 429 according to the second embodiment deforms as illustrated in FIG. 11 when external light L2 incident from outside the vehicle is focused on the image generating unit 424, causing a rise in temperature near the image generating unit 424. This causes the concave mirror 426 to rotate about the rotation axis 426A, changing the orientation of its reflecting surface. This change in the angle of the reflecting surface of the concave mirror 426 relative to the reflecting surface of the plane mirror 428 causes the external light L2 reflected by the concave mirror 426 to be reflected by the plane mirror 428 in a direction different from that toward the image generating unit 424. This prevents the external light L2 reflected by the concave mirror 426 and the plane mirror 428 from entering the image generating unit 424, thereby suppressing deterioration of the image generating unit 424 due to far-infrared rays contained in the external light L2 being focused on the image generating unit 424. As a result, heat damage can be prevented.

[0087] In this embodiment, the connecting portion 429 formed of a bimetal can be configured to deform when the temperature near the image generating portion 424 exceeds a predetermined threshold. For example, the connecting portion 429 can be configured to deform when the temperature near the image generating portion 424 is 90°C or higher.

[0088] As described above, the deformation of connecting portion 429 in accordance with the rise in temperature near image generating unit 424 changes the angle of the reflecting surface of concave mirror 426 relative to the reflecting surface of plane mirror 428, making it possible to prevent external light L2 reflected by plane mirror 428 from entering image generating unit 424. On the other hand, the light emitted from image generating unit 424 and reflected by plane mirror 428 does not enter the predetermined position on concave mirror 426 due to the change in the angle of the reflecting surface of concave mirror 426 relative to the reflecting surface of plane mirror 428, and therefore the image displayed by HUD 42A will not be displayed in the position where it should be.

[0089] However, with the above configuration, the connection portion 429 is configured not to deform when the temperature near the image generation portion 424 is equal to or lower than a predetermined threshold. Therefore, it is possible to ensure the visibility of the image displayed by the HUD 42A while suppressing deterioration of the image generation portion 424 due to external light L2.

[0090] In this embodiment, the bimetal constituting the connecting portion 429 can be formed by bonding a metal plate made of a Cr-Ni-MN alloy and a metal plate made of a Ni-Fe alloy. For example, as illustrated in FIG. 10 , the connecting portion 429 is formed of a bimetal made of a metal plate 429A1 made of a Cr-Ni-MN alloy and a metal plate 429A2 made of a Ni-Fe alloy. The connecting portion 429 is formed in an upwardly curved state due to the contraction of the metal plate 429A1 made of the Cr-Ni-MN alloy. On the other hand, for example, when the temperature near the image generating unit 424 reaches 90°C or higher, the metal plate 429A1 made of the Cr-Ni-MN alloy expands, as illustrated in FIG. 11 , and the connecting portion 429 is deformed into a flat shape.

[0091] With this configuration, the connection portion 429 deforms at a temperature close to the upper limit temperature at which the display device constituting the image generation portion 424 can operate normally (for example, approximately 105°C in the case of an LCD display), so that it is possible to ensure the visibility of the image displayed by the HUD 42A while suppressing deterioration of the image generation portion 424 due to external light L2.

[0092] In this embodiment, the frame portion 242 of the image generating unit 424 can be made of metal. With this configuration, the temperature rise of the display device 241 of the image generating unit 424 can be transmitted to the connecting portion 429 by thermal conduction of the frame portion 242.

[0093] Alternatively, the frame portion 242 may be formed from a bimetal. In this case, as illustrated in FIG. 12 , the connecting portion 429 and the frame portion 242 may be formed to constitute a single member. That is, the connecting portion 429 and the frame portion 242 may have a monolithic structure. With such a configuration, the frame portion 242 changes as the temperature of the image generating unit 424 increases. Therefore, the angle of the reflecting surface of the concave mirror 426 relative to the reflecting surface of the plane mirror 428 can be changed as the temperature of the image generating unit 424 or its vicinity increases.

[0094] (Third embodiment) Next, a HUD 42B according to a third embodiment will be described with reference to Figures 13 to 15. For the sake of convenience, the description of the third embodiment will omit descriptions of components having the same reference numbers as those already described in the second embodiment. Also, in Figure 13, the control board 425 is not shown.

[0095] The HUD 42B of the third embodiment differs from the HUD 42A of the second embodiment in that the light emitted from the image generation unit 424 is reflected by the concave mirror 426, whereas the HUD 42B of the second embodiment is reflected by the plane mirror 428 and the concave mirror 426.

[0096] 13, concave mirror 426 is disposed on the optical path of light emitted from image generation unit 424. Specifically, within housing 422, concave mirror 426 is disposed in front of image generation unit 424, and the reflective surface of concave mirror 426 faces the light emission surface (display device 241) of image generation unit 424.

[0097] Light L3 emitted from the image generation unit 424 is reflected by the concave mirror 426 and emitted from the exit window 423 of the HUD main body 420. The light emitted from the exit window 423 of the HUD main body 420 is irradiated onto the windshield 18. A portion of the light irradiated onto the windshield 18 from the exit window 423 is reflected toward the viewpoint E of the occupant.

[0098] On the other hand, as illustrated in FIG. 14, when external light L4 that has entered the housing 422 of the HUD 42B is reflected by the concave mirror 426 and focused on the image generation unit 424, and the temperature near the image generation unit 424 rises, the connecting portion 429 is deformed, as illustrated in FIG. 15. This causes the concave mirror 426 to rotate about the rotation axis 426A, changing the orientation of its reflecting surface. By changing the angle of the reflecting surface of the concave mirror 426 with respect to the light exit surface (display device 241) of the image generation unit 424 in this way, the external light L4 reflected by the concave mirror 426 is reflected in a direction different from that of the image generation unit 424. Therefore, it is possible to prevent the external light L4 reflected by the concave mirror 426 from entering the image generation unit 424, thereby preventing heat damage.

[0099] Although the embodiments of the present disclosure have been described above, it goes without saying that the technical scope of the present disclosure should not be interpreted as being limited by the description of the present embodiments. The present embodiments are merely examples, and it will be understood by those skilled in the art that various modifications of the embodiments are possible within the scope of the invention described in the claims. The technical scope of the present disclosure should be determined based on the scope of the invention described in the claims and its equivalents.

[0100] In the second and third embodiments described above, the connecting portion 429 is made of a bimetal. However, a structure in which at least a portion of the connecting portion 429 is made of a bimetal may also be employed. As illustrated in FIG. 16 , the connecting portion 429 has a coupling portion 429B and a driving portion 429C. The coupling portion 429B is made of a bimetal and is configured to couple the driving portion 429C and the image generating portion 424.

[0101] Drive unit 429C is connected to concave mirror 426. Drive unit 429C rotates concave mirror 426 around rotation axis 426A based on a control signal transmitted from control board 425 (not shown), thereby changing the orientation of the reflecting surface of concave mirror 426.

[0102] 16 and 17, the driving unit 429C has a shaft 429D and a moving mechanism 429E. One end of the shaft 429D is connected to the concave mirror 426. The moving mechanism 429E is composed of, for example, a worm gear and a DC motor, and moves the shaft 429D in the axial direction. By moving the shaft 429D in the axial direction, the concave mirror 426 rotates around the rotation axis 426A.

[0103] As illustrated in FIG. 17, when external light that has entered the housing 422 of the HUD 42C is reflected by the concave mirror 426 and focused on the image generation unit 424, the temperature in the vicinity of the image generation unit 424 rises, causing the connector 429B to deform, as illustrated in FIG. 18. The deformation of the connector 429B causes the movement mechanism 429E connected to the connector 429B to move together with the shaft 429D. This causes the concave mirror 426 to rotate about the rotation axis 426A, changing the orientation of its reflective surface and changing the angle of the reflective surface of the concave mirror 426 relative to the display device 241 of the image generation unit 424. Therefore, it is possible to prevent external light reflected by the concave mirror 426 from entering the image generation unit 424, thereby preventing heat damage.

[0104] The moving mechanism 429E has a movable shaft 429E1, and the movable shaft 429E1 may be configured to be movable within a rail (not shown). That is, the movable shaft 429E1 of the moving mechanism 429E moves within the rail as the connecting portion 429B deforms. This makes it easy to position the driving portion 429C.

[0105] In the second and third embodiments described above, the connecting portion 429 connects the image generating portion 424 and the concave mirror 426. However, in the second embodiment, the connecting portion 429 may be configured to connect the image generating portion 424 and the plane mirror 428. In the third embodiment, the concave mirror 426 may be configured as a plane mirror, and the connecting portion 429 may be configured to connect the image generating portion 424 and the plane mirror.

[0106] In the second embodiment described above, the connecting portion 429 is configured to deform from a curved state to a flat state as the temperature increases. However, the connecting portion 429 may be configured to deform from a flat state to a curved state as the temperature increases. Similarly, in the third embodiment described above, the connecting portion 429 is configured to deform from a flat state to a curved state as the temperature increases. However, the connecting portion 429 may be configured to deform from a curved state to a flat state as the temperature increases.

[0107] In the second and third embodiments described above, the image generating unit 424 has a frame portion 242 that surrounds the display device 241, and the connecting portion 429 is connected to the frame portion 242. However, the connecting portion 429 may be connected to another portion of the image generating unit 424. For example, in FIG. 8 , the connecting portion 429 may be connected to a lower portion of the image generating unit 424 that is remote from the display device 241.

[0108] In the second and third embodiments described above, concave mirror 426 rotates about rotation axis 426A, thereby changing the orientation of the reflecting surface of concave mirror 426. However, other configurations are possible as long as the angle of the reflecting surface of concave mirror 426 relative to the reflecting surface of plane mirror 428 and the light exit surface of image generation unit 424 changes when concave mirror 426 is displaced.

[0109] In the second and third embodiments described above, the light emitted from the image generation unit 424 is reflected by the concave mirror 426 and irradiated onto the windshield 18. However, for example, the light reflected by the concave mirror 426 may be irradiated onto a combiner (not shown) provided inside the windshield 18. The combiner may be formed, for example, of a transparent plastic disk. A portion of the light irradiated onto the combiner from the image generation unit 424 of the HUD main body 420 is reflected toward the occupant's viewpoint E, similar to when light is irradiated onto the windshield 18.

[0110] This application claims priority to Japanese Application No. 2020-153909 filed on September 14, 2020, and Japanese Application No. 2020-190155 filed on November 16, 2020, and incorporates by reference all of the contents of the aforementioned Japanese applications.

Claims

1. A vehicle display system provided in a vehicle, a first lamp that irradiates near-infrared light to the exterior of the vehicle; a second lamp that irradiates visible light to the outside of the vehicle; a first camera configured to capture a first image of the exterior of the vehicle illuminated by the first lamp; a second camera that captures a second image of the outside of the vehicle illuminated by the second lamp and that includes an imaging range of the first camera; a control unit that generates a third image by reducing the brightness of pixels of the first image corresponding to pixels of the second image based on the brightness of the second image; a head-up display configured to display the third image generated by the controller; the control unit relatively inverts the luminance of high-luminance pixels and the luminance of low-luminance pixels in the second image, sets high transparency for pixels with high luminance, and sets low transparency for pixels with low luminance to generate a reference image; The control unit generates the third image by superimposing the reference image and the first image.

2. The vehicular display system according to claim 1 , wherein the control unit adjusts a contrast of the second image before setting the transparency.

3. The vehicular display system according to claim 1 , wherein the control unit adjusts a contrast of the third image.

4. The vehicular display system according to claim 1 , wherein the first lamp is configured to irradiate the near-infrared light in a range including an area above the horizontal.

5. An image projection device that is provided in a vehicle and configured to display a predetermined image, an image generating device that emits light for generating the predetermined image; a reflecting section that reflects light emitted by the image generating device; a connection portion that connects the image generating device and the reflecting portion, At least a part of the connecting portion is formed from a bimetal.

6. 6. The image projection device according to claim 5, wherein at least a part of the connection portion formed by the bimetal is deformed when a temperature in the vicinity of the image generation device exceeds a predetermined threshold value.

7. 6. The image projection device according to claim 5, wherein said bimetal is formed by bonding a metal plate made of a Cr-Ni-MN alloy and a metal plate made of a Ni-Fe alloy together.

8. the image generating device includes a display device and a frame unit surrounding the display device; the connection portion is connected to the frame portion, The image projection device according to claim 5 , wherein the frame portion is formed from the bimetal.

9. the image generating device includes a display device and a frame unit surrounding the display device; the connection portion is connected to the frame portion, The image projection device according to claim 5 , wherein the frame portion is made of metal.

Images